2023-11-04T01:11:41.990 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:11:41.990 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} --verbose -- /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/orig.config.yaml 2023-11-04T01:11:42.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:11:42.111 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} email: pdonnell@redhat.com first_in_suite: false job_id: '7445922' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - RECENT_CRASH sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: dry_run: true install: ceph: flavor: default sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231103.180916 sha1: 702f9e6492477037e018f68dfdf636a30c24f329 owner: scheduled_pdonnell@teuthology priority: 50 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7192 sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-batrick-testing-20231103.180916 suite_path: /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 702f9e6492477037e018f68dfdf636a30c24f329 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOD0jW6E3I+clddOmIj07v/rlwclmd5mvPtTmVtQlTOPepyoKz8yD1/es570Vm9uYYDvuuRT9W5qhw05GGFbgGs= smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJXX70ohOtHXVLtKw4roiKmJIEL1kDj6tbpju/9xVCAKESxMwgNBG57aBnKloHwb3zFrz06nxHez4jsZMRFjt5c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - exec: mon.a: - ceph config set mgr mgr/crash/warn_recent_interval 0 - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_snapshots teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-03_18:12:33 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822 2023-11-04T01:11:42.111 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa; will attempt to use it 2023-11-04T01:11:42.112 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks 2023-11-04T01:11:42.112 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-04T01:11:42.113 INFO:teuthology.task.internal:Checking packages... 2023-11-04T01:11:42.135 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4' 2023-11-04T01:11:42.135 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-04T01:11:42.135 INFO:teuthology.packaging:ref: None 2023-11-04T01:11:42.135 INFO:teuthology.packaging:tag: None 2023-11-04T01:11:42.135 INFO:teuthology.packaging:branch: main 2023-11-04T01:11:42.135 INFO:teuthology.packaging:sha1: 7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:11:42.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2023-11-04T01:11:42.364 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7052-g7188d8cd-1jammy 2023-11-04T01:11:42.364 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-04T01:11:42.371 INFO:teuthology.task.internal:no buildpackages task found 2023-11-04T01:11:42.371 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-04T01:11:42.403 INFO:teuthology.task.internal:Saving configuration 2023-11-04T01:11:42.419 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-04T01:11:42.438 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:11:42.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:36.791963', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFhaz+Hh01vURr4QUJsjWbqCchiRE86M6Whr19TV5tqn'} 2023-11-04T01:11:42.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:36.790783', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHQ4Qf/kS/C32ry0KwGAGT5qNVzL01dNIM3YWn5Jq5J4'} 2023-11-04T01:11:42.487 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-04T01:11:42.494 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-04T01:11:42.494 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-04T01:11:42.494 INFO:teuthology.run_tasks:Running task console_log... 2023-11-04T01:11:42.591 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7f3bd7f040>, signals=[15]) 2023-11-04T01:11:42.592 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-04T01:11:42.598 INFO:teuthology.task.internal:Opening connections... 2023-11-04T01:11:42.598 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:11:42.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:11:42.672 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:11:42.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:11:42.749 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-04T01:22:49.626 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-11-04T01:22:49.637 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-11-04T01:22:49.638 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-11-04T01:22:49.687 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T01:22:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2023-11-04T01:22:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="22.04" 2023-11-04T01:22:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T01:22:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=jammy 2023-11-04T01:22:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2023-11-04T01:22:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2023-11-04T01:22:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T01:22:49.689 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T01:22:49.689 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T01:22:49.689 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T01:22:49.689 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=jammy 2023-11-04T01:22:49.690 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-11-04T01:22:49.724 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-11-04T01:22:49.731 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-11-04T01:22:49.731 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-11-04T01:22:49.779 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="22.04" 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=jammy 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T01:22:49.780 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T01:22:49.781 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T01:22:49.781 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T01:22:49.781 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=jammy 2023-11-04T01:22:49.781 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-11-04T01:22:49.798 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-04T01:22:49.809 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-04T01:22:49.831 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-04T01:22:49.831 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:22:49.833 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2023-11-04T01:22:49.839 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-04T01:22:49.882 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-04T01:22:49.883 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:22:49.885 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2023-11-04T01:22:49.906 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-04T01:22:49.977 INFO:teuthology.run_tasks:Running task kernel... 2023-11-04T01:22:49.997 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-04T01:22:49.998 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-04T01:22:49.998 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:22:49.998 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-04T01:22:50.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:22:50.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:22:50.004 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2023-11-04T01:22:50.004 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2023-11-04T01:22:50.052 INFO:teuthology.orchestra.run.smithi002.stdout:5.15.0-56-generic 2023-11-04T01:22:50.052 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.15.0-56-generic 2023-11-04T01:22:50.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get clean 2023-11-04T01:22:50.055 INFO:teuthology.orchestra.run.smithi090.stdout:5.15.0-56-generic 2023-11-04T01:22:50.055 INFO:teuthology.task.kernel:Running kernel on smithi090: 5.15.0-56-generic 2023-11-04T01:22:50.056 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get clean 2023-11-04T01:22:50.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2023-11-04T01:22:50.209 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2023-11-04T01:22:50.332 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-04T01:22:50.382 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:22:50.382 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-11-04T01:22:50.385 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-04T01:22:50.443 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:22:50.471 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-04T01:22:50.525 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-11-04T01:22:50.537 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [940 kB] 2023-11-04T01:22:50.630 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [360 kB] 2023-11-04T01:22:50.631 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [940 kB] 2023-11-04T01:22:50.635 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [186 kB] 2023-11-04T01:22:50.637 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-04T01:22:50.637 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-04T01:22:50.638 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,085 kB] 2023-11-04T01:22:50.655 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [176 kB] 2023-11-04T01:22:50.657 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:22:50.657 INFO:teuthology.orchestra.run.smithi002.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [563 kB] 2023-11-04T01:22:50.663 INFO:teuthology.orchestra.run.smithi002.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [797 kB] 2023-11-04T01:22:50.670 INFO:teuthology.orchestra.run.smithi002.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [146 kB] 2023-11-04T01:22:50.671 INFO:teuthology.orchestra.run.smithi002.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-04T01:22:50.672 INFO:teuthology.orchestra.run.smithi002.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-04T01:22:50.672 INFO:teuthology.orchestra.run.smithi002.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-04T01:22:50.702 INFO:teuthology.orchestra.run.smithi002.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-04T01:22:50.703 INFO:teuthology.orchestra.run.smithi002.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-04T01:22:50.716 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [524 kB] 2023-11-04T01:22:50.734 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [360 kB] 2023-11-04T01:22:50.738 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [186 kB] 2023-11-04T01:22:50.741 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-11-04T01:22:50.741 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,085 kB] 2023-11-04T01:22:50.758 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.4 kB] 2023-11-04T01:22:50.759 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [176 kB] 2023-11-04T01:22:50.761 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:22:50.761 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [797 kB] 2023-11-04T01:22:50.772 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [563 kB] 2023-11-04T01:22:50.775 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,149 kB] 2023-11-04T01:22:50.779 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [146 kB] 2023-11-04T01:22:50.796 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2023-11-04T01:22:50.797 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-11-04T01:22:50.797 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-11-04T01:22:50.797 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-11-04T01:22:50.797 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-11-04T01:22:50.812 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [245 kB] 2023-11-04T01:22:50.817 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-04T01:22:50.817 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,105 kB] 2023-11-04T01:22:50.834 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.9 kB] 2023-11-04T01:22:50.835 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [179 kB] 2023-11-04T01:22:50.837 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:22:50.837 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [999 kB] 2023-11-04T01:22:50.849 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [661 kB] 2023-11-04T01:22:50.856 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [219 kB] 2023-11-04T01:22:50.859 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-04T01:22:50.861 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-04T01:22:50.862 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-04T01:22:50.862 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-04T01:22:50.862 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-04T01:22:50.879 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-04T01:22:50.880 INFO:teuthology.orchestra.run.smithi002.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-11-04T01:22:50.880 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-04T01:22:50.881 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-04T01:22:50.881 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-04T01:22:50.881 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-04T01:22:50.881 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-04T01:22:50.901 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-04T01:22:50.901 INFO:teuthology.orchestra.run.smithi090.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-04T01:22:51.019 INFO:teuthology.orchestra.run.smithi002.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,149 kB] 2023-11-04T01:22:51.295 INFO:teuthology.orchestra.run.smithi002.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [524 kB] 2023-11-04T01:22:51.334 INFO:teuthology.orchestra.run.smithi002.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [245 kB] 2023-11-04T01:22:51.351 INFO:teuthology.orchestra.run.smithi002.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2023-11-04T01:22:51.352 INFO:teuthology.orchestra.run.smithi002.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,105 kB] 2023-11-04T01:22:51.406 INFO:teuthology.orchestra.run.smithi002.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.9 kB] 2023-11-04T01:22:51.407 INFO:teuthology.orchestra.run.smithi002.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [179 kB] 2023-11-04T01:22:51.414 INFO:teuthology.orchestra.run.smithi002.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2023-11-04T01:22:51.578 INFO:teuthology.orchestra.run.smithi002.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [661 kB] 2023-11-04T01:22:52.150 INFO:teuthology.orchestra.run.smithi002.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [999 kB] 2023-11-04T01:22:52.261 INFO:teuthology.orchestra.run.smithi002.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [219 kB] 2023-11-04T01:22:52.280 INFO:teuthology.orchestra.run.smithi002.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2023-11-04T01:22:52.281 INFO:teuthology.orchestra.run.smithi002.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-11-04T01:22:52.285 INFO:teuthology.orchestra.run.smithi002.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-11-04T01:22:52.286 INFO:teuthology.orchestra.run.smithi002.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-11-04T01:22:52.286 INFO:teuthology.orchestra.run.smithi002.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-11-04T01:22:52.287 INFO:teuthology.orchestra.run.smithi002.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [56.3 kB] 2023-11-04T01:22:52.290 INFO:teuthology.orchestra.run.smithi002.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [64.2 kB] 2023-11-04T01:22:52.295 INFO:teuthology.orchestra.run.smithi002.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-11-04T01:22:52.460 INFO:teuthology.orchestra.run.smithi002.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-11-04T01:22:52.542 INFO:teuthology.orchestra.run.smithi002.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.9 kB] 2023-11-04T01:22:52.623 INFO:teuthology.orchestra.run.smithi002.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.8 kB] 2023-11-04T01:22:52.678 INFO:teuthology.orchestra.run.smithi002.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-11-04T01:22:52.734 INFO:teuthology.orchestra.run.smithi002.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2023-11-04T01:22:56.308 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 10.1 MB in 1s (6,776 kB/s) 2023-11-04T01:22:57.188 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 10.1 MB in 2s (4,067 kB/s) 2023-11-04T01:22:57.790 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-11-04T01:22:57.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:22:57.864 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-11-04T01:22:58.050 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2023-11-04T01:22:58.051 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2023-11-04T01:22:58.209 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:22:58.209 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:22:58.210 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:22:58.210 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:22:58.210 INFO:teuthology.orchestra.run.smithi090.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-04T01:22:58.210 INFO:teuthology.orchestra.run.smithi090.stdout: python2.7-minimal 2023-11-04T01:22:58.210 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:22:58.211 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2023-11-04T01:22:58.211 INFO:teuthology.orchestra.run.smithi090.stdout: linux-generic linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:22:58.211 INFO:teuthology.orchestra.run.smithi090.stdout: linux-headers-generic linux-image-5.15.0-88-generic 2023-11-04T01:22:58.211 INFO:teuthology.orchestra.run.smithi090.stdout: linux-modules-5.15.0-88-generic linux-modules-extra-5.15.0-88-generic 2023-11-04T01:22:58.212 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2023-11-04T01:22:58.213 INFO:teuthology.orchestra.run.smithi090.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-04T01:22:58.213 INFO:teuthology.orchestra.run.smithi090.stdout:Recommended packages: 2023-11-04T01:22:58.213 INFO:teuthology.orchestra.run.smithi090.stdout: thermald 2023-11-04T01:22:58.264 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2023-11-04T01:22:58.264 INFO:teuthology.orchestra.run.smithi090.stdout: linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:22:58.264 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.15.0-88-generic linux-modules-5.15.0-88-generic 2023-11-04T01:22:58.265 INFO:teuthology.orchestra.run.smithi090.stdout: linux-modules-extra-5.15.0-88-generic 2023-11-04T01:22:58.265 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2023-11-04T01:22:58.266 INFO:teuthology.orchestra.run.smithi090.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-04T01:22:58.356 INFO:teuthology.orchestra.run.smithi090.stdout:3 upgraded, 5 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:22:58.356 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 113 MB of archives. 2023-11-04T01:22:58.356 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-04T01:22:58.356 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-88-generic amd64 5.15.0-88.98 [22.4 MB] 2023-11-04T01:22:58.494 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2023-11-04T01:22:58.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:22:58.572 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2023-11-04T01:22:58.766 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2023-11-04T01:22:58.767 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2023-11-04T01:22:58.934 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:22:58.934 INFO:teuthology.orchestra.run.smithi002.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:22:58.934 INFO:teuthology.orchestra.run.smithi002.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:22:58.935 INFO:teuthology.orchestra.run.smithi002.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:22:58.935 INFO:teuthology.orchestra.run.smithi002.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-04T01:22:58.935 INFO:teuthology.orchestra.run.smithi002.stdout: python2.7-minimal 2023-11-04T01:22:58.935 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:22:58.936 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2023-11-04T01:22:58.936 INFO:teuthology.orchestra.run.smithi002.stdout: linux-generic linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:22:58.936 INFO:teuthology.orchestra.run.smithi002.stdout: linux-headers-generic linux-image-5.15.0-88-generic 2023-11-04T01:22:58.936 INFO:teuthology.orchestra.run.smithi002.stdout: linux-modules-5.15.0-88-generic linux-modules-extra-5.15.0-88-generic 2023-11-04T01:22:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2023-11-04T01:22:58.937 INFO:teuthology.orchestra.run.smithi002.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-11-04T01:22:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:Recommended packages: 2023-11-04T01:22:58.938 INFO:teuthology.orchestra.run.smithi002.stdout: thermald 2023-11-04T01:22:58.974 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2023-11-04T01:22:58.974 INFO:teuthology.orchestra.run.smithi002.stdout: linux-headers-5.15.0-88 linux-headers-5.15.0-88-generic 2023-11-04T01:22:58.974 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-5.15.0-88-generic linux-modules-5.15.0-88-generic 2023-11-04T01:22:58.974 INFO:teuthology.orchestra.run.smithi002.stdout: linux-modules-extra-5.15.0-88-generic 2023-11-04T01:22:58.975 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages will be upgraded: 2023-11-04T01:22:58.976 INFO:teuthology.orchestra.run.smithi002.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-04T01:22:59.157 INFO:teuthology.orchestra.run.smithi002.stdout:3 upgraded, 5 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:22:59.157 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 113 MB of archives. 2023-11-04T01:22:59.157 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 582 MB of additional disk space will be used. 2023-11-04T01:22:59.157 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-88-generic amd64 5.15.0-88.98 [22.4 MB] 2023-11-04T01:22:59.538 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-88-generic amd64 5.15.0-88.98 [11.5 MB] 2023-11-04T01:22:59.960 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-88-generic amd64 5.15.0-88.98 [64.0 MB] 2023-11-04T01:23:00.526 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-88-generic amd64 5.15.0-88.98 [11.5 MB] 2023-11-04T01:23:00.879 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-88-generic amd64 5.15.0-88.98 [64.0 MB] 2023-11-04T01:23:02.856 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.88.85 [1,698 B] 2023-11-04T01:23:02.856 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.88.85 [2,488 B] 2023-11-04T01:23:02.942 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88 all 5.15.0-88.98 [12.3 MB] 2023-11-04T01:23:03.113 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.88.85 [1,698 B] 2023-11-04T01:23:03.114 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.88.85 [2,488 B] 2023-11-04T01:23:03.114 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88 all 5.15.0-88.98 [12.3 MB] 2023-11-04T01:23:03.400 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88-generic amd64 5.15.0-88.98 [2,878 kB] 2023-11-04T01:23:03.570 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.88.85 [2,340 B] 2023-11-04T01:23:03.903 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-88-generic amd64 5.15.0-88.98 [2,878 kB] 2023-11-04T01:23:03.954 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 113 MB in 5s (21.3 MB/s) 2023-11-04T01:23:04.096 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.88.85 [2,340 B] 2023-11-04T01:23:04.118 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-modules-5.15.0-88-generic. 2023-11-04T01:23:04.516 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 113 MB in 5s (22.1 MB/s) 2023-11-04T01:23:04.721 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-modules-5.15.0-88-generic. 2023-11-04T01:23:06.707 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-04T01:23:06.711 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../0-linux-modules-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:06.782 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-11-04T01:23:06.786 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../0-linux-modules-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:06.809 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:06.875 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:09.168 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-image-5.15.0-88-generic. 2023-11-04T01:23:09.190 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../1-linux-image-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:09.279 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:09.687 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-image-5.15.0-88-generic. 2023-11-04T01:23:09.709 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../1-linux-image-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:09.772 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-88-generic. 2023-11-04T01:23:09.792 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:09.794 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:09.830 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:10.324 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-88-generic. 2023-11-04T01:23:10.345 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:10.382 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:16.148 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../3-linux-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:23:16.308 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:23:16.625 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:23:16.728 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-image-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:23:17.064 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-headers-5.15.0-88. 2023-11-04T01:23:17.075 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../5-linux-headers-5.15.0-88_5.15.0-88.98_all.deb ... 2023-11-04T01:23:17.139 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:23:19.954 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../3-linux-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:23:20.065 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:23:20.432 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:23:20.561 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-image-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:23:20.865 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-headers-5.15.0-88. 2023-11-04T01:23:20.888 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../5-linux-headers-5.15.0-88_5.15.0-88.98_all.deb ... 2023-11-04T01:23:20.924 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:23:22.947 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package linux-headers-5.15.0-88-generic. 2023-11-04T01:23:22.985 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../6-linux-headers-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:23.038 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:23:26.182 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking linux-headers-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:23:26.524 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:23:26.653 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:26.804 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-headers-generic (5.15.0.88.85) ... 2023-11-04T01:23:26.932 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:28.306 INFO:teuthology.orchestra.run.smithi002.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:23:28.306 INFO:teuthology.orchestra.run.smithi002.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-04T01:23:28.307 INFO:teuthology.orchestra.run.smithi002.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:23:28.307 INFO:teuthology.orchestra.run.smithi002.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:28.469 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:29.401 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package linux-headers-5.15.0-88-generic. 2023-11-04T01:23:29.437 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../6-linux-headers-5.15.0-88-generic_5.15.0-88.98_amd64.deb ... 2023-11-04T01:23:29.484 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:30.695 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:31.859 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.88.85_amd64.deb ... 2023-11-04T01:23:31.982 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking linux-headers-generic (5.15.0.88.85) over (5.15.0.56.54) ... 2023-11-04T01:23:32.181 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-image-generic (5.15.0.88.85) ... 2023-11-04T01:23:32.305 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up linux-generic (5.15.0.88.85) ... 2023-11-04T01:23:32.341 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-5.15.0-88 (5.15.0-88.98) ... 2023-11-04T01:23:32.432 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:32.493 INFO:teuthology.orchestra.run.smithi002.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-04T01:23:32.494 INFO:teuthology.orchestra.run.smithi002.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:32.496 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:32.624 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-headers-generic (5.15.0.88.85) ... 2023-11-04T01:23:32.751 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:34.128 INFO:teuthology.orchestra.run.smithi090.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:23:34.129 INFO:teuthology.orchestra.run.smithi090.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-11-04T01:23:34.129 INFO:teuthology.orchestra.run.smithi090.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:23:34.129 INFO:teuthology.orchestra.run.smithi090.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:34.310 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-modules-extra-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:35.711 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-modules-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:37.164 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-image-generic (5.15.0.88.85) ... 2023-11-04T01:23:37.289 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up linux-generic (5.15.0.88.85) ... 2023-11-04T01:23:37.416 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for linux-image-5.15.0-88-generic (5.15.0-88.98) ... 2023-11-04T01:23:37.486 INFO:teuthology.orchestra.run.smithi090.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-04T01:23:37.486 INFO:teuthology.orchestra.run.smithi090.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:46.850 INFO:teuthology.orchestra.run.smithi002.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-04T01:23:46.850 INFO:teuthology.orchestra.run.smithi002.stdout:Sourcing file `/etc/default/grub' 2023-11-04T01:23:46.873 INFO:teuthology.orchestra.run.smithi002.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:23:46.885 INFO:teuthology.orchestra.run.smithi002.stdout:Generating grub configuration file ... 2023-11-04T01:23:47.211 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:23:47.230 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:47.487 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:23:47.493 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:23:47.563 INFO:teuthology.orchestra.run.smithi002.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:23:47.569 INFO:teuthology.orchestra.run.smithi002.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:23:47.733 INFO:teuthology.orchestra.run.smithi002.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:23:47.733 INFO:teuthology.orchestra.run.smithi002.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:23:47.733 INFO:teuthology.orchestra.run.smithi002.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:23:47.774 INFO:teuthology.orchestra.run.smithi002.stdout:done 2023-11-04T01:23:48.191 DEBUG:teuthology.orchestra.run.smithi002:> dpkg -s linux-image-generic 2023-11-04T01:23:48.230 INFO:teuthology.orchestra.run.smithi002.stdout:Package: linux-image-generic 2023-11-04T01:23:48.230 INFO:teuthology.orchestra.run.smithi002.stdout:Status: install ok installed 2023-11-04T01:23:48.230 INFO:teuthology.orchestra.run.smithi002.stdout:Priority: optional 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Section: kernel 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Installed-Size: 20 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: amd64 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Source: linux-meta 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Version: 5.15.0.88.85 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Recommends: thermald 2023-11-04T01:23:48.231 INFO:teuthology.orchestra.run.smithi002.stdout:Description: Generic Linux kernel image 2023-11-04T01:23:48.232 INFO:teuthology.orchestra.run.smithi002.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:23:48.232 INFO:teuthology.orchestra.run.smithi002.stdout: available. 2023-11-04T01:23:48.232 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-88-generic 2023-11-04T01:23:48.232 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:23:48.232 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:23:48.232 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-04T01:23:48.233 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:23:48.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get clean 2023-11-04T01:23:48.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2023-11-04T01:23:48.574 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-04T01:23:48.608 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:23:48.666 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-04T01:23:48.710 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:23:49.919 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2023-11-04T01:23:49.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:23:49.989 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2023-11-04T01:23:50.166 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2023-11-04T01:23:50.166 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2023-11-04T01:23:50.317 INFO:teuthology.orchestra.run.smithi002.stdout:linux-image-generic is already the newest version (5.15.0.88.85). 2023-11-04T01:23:50.318 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:23:50.318 INFO:teuthology.orchestra.run.smithi002.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:23:50.318 INFO:teuthology.orchestra.run.smithi002.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:23:50.318 INFO:teuthology.orchestra.run.smithi002.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:23:50.318 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:23:50.318 INFO:teuthology.orchestra.run.smithi002.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:23:50.318 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:23:50.356 INFO:teuthology.orchestra.run.smithi002.stdout:0 upgraded, 0 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:23:50.357 DEBUG:teuthology.orchestra.run.smithi002:> dpkg -s linux-image-generic 2023-11-04T01:23:50.413 INFO:teuthology.orchestra.run.smithi002.stdout:Package: linux-image-generic 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Status: install ok installed 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Priority: optional 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Section: kernel 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Installed-Size: 20 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: amd64 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Source: linux-meta 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Version: 5.15.0.88.85 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:23:50.414 INFO:teuthology.orchestra.run.smithi002.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:23:50.415 INFO:teuthology.orchestra.run.smithi002.stdout:Recommends: thermald 2023-11-04T01:23:50.415 INFO:teuthology.orchestra.run.smithi002.stdout:Description: Generic Linux kernel image 2023-11-04T01:23:50.415 INFO:teuthology.orchestra.run.smithi002.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:23:50.415 INFO:teuthology.orchestra.run.smithi002.stdout: available. 2023-11-04T01:23:50.415 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2023-11-04T01:23:50.458 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.NzvVkAU8FU 2023-11-04T01:23:50.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NzvVkAU8FU 2023-11-04T01:23:50.515 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.NzvVkAU8FU 2023-11-04T01:23:50.632 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.NzvVkAU8FU is 10KB 2023-11-04T01:23:50.644 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.NzvVkAU8FU 2023-11-04T01:23:50.650 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-04T01:23:50.703 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:23:50.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-04T01:23:50.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-04T01:23:50.783 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-88-generic 2023-11-04T01:23:50.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo update-grub 2023-11-04T01:23:51.923 INFO:teuthology.orchestra.run.smithi002.stderr:Sourcing file `/etc/default/grub' 2023-11-04T01:23:51.925 INFO:teuthology.orchestra.run.smithi002.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:23:51.926 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2023-11-04T01:23:52.169 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:23:52.176 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:23:52.406 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:23:52.449 INFO:teuthology.orchestra.run.smithi002.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:23:52.454 INFO:teuthology.orchestra.run.smithi002.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:23:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:23:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:23:52.576 INFO:teuthology.orchestra.run.smithi002.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:23:52.590 INFO:teuthology.orchestra.run.smithi002.stderr:done 2023-11-04T01:23:52.599 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2023-11-04T01:23:52.840 INFO:teuthology.orchestra.run.smithi090.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-04T01:23:52.840 INFO:teuthology.orchestra.run.smithi090.stdout:Sourcing file `/etc/default/grub' 2023-11-04T01:23:52.870 INFO:teuthology.orchestra.run.smithi090.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:23:52.895 INFO:teuthology.orchestra.run.smithi090.stdout:Generating grub configuration file ... 2023-11-04T01:23:53.310 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:23:53.346 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:53.693 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:23:53.699 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:23:53.797 INFO:teuthology.orchestra.run.smithi090.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:23:53.802 INFO:teuthology.orchestra.run.smithi090.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:23:54.067 INFO:teuthology.orchestra.run.smithi090.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:23:54.067 INFO:teuthology.orchestra.run.smithi090.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:23:54.067 INFO:teuthology.orchestra.run.smithi090.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:23:54.168 INFO:teuthology.orchestra.run.smithi090.stdout:done 2023-11-04T01:23:54.735 DEBUG:teuthology.orchestra.run.smithi090:> dpkg -s linux-image-generic 2023-11-04T01:23:54.758 INFO:teuthology.orchestra.run.smithi090.stdout:Package: linux-image-generic 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Status: install ok installed 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Priority: optional 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Section: kernel 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Installed-Size: 20 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: amd64 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Source: linux-meta 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Version: 5.15.0.88.85 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:23:54.759 INFO:teuthology.orchestra.run.smithi090.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:23:54.760 INFO:teuthology.orchestra.run.smithi090.stdout:Recommends: thermald 2023-11-04T01:23:54.760 INFO:teuthology.orchestra.run.smithi090.stdout:Description: Generic Linux kernel image 2023-11-04T01:23:54.760 INFO:teuthology.orchestra.run.smithi090.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:23:54.760 INFO:teuthology.orchestra.run.smithi090.stdout: available. 2023-11-04T01:23:54.760 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-88-generic 2023-11-04T01:23:54.760 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-04T01:23:54.760 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-04T01:23:54.760 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-04T01:23:54.760 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi090.front.sepia.ceph.com, path=None, version=distro) 2023-11-04T01:23:54.761 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get clean 2023-11-04T01:23:54.943 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2023-11-04T01:23:55.100 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:23:55.132 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-04T01:23:55.173 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:23:55.179 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-04T01:23:56.399 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-11-04T01:23:56.416 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-04T01:23:56.475 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-11-04T01:23:56.666 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2023-11-04T01:23:56.666 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2023-11-04T01:23:56.828 INFO:teuthology.orchestra.run.smithi090.stdout:linux-image-generic is already the newest version (5.15.0.88.85). 2023-11-04T01:23:56.829 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:23:56.829 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:23:56.829 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:23:56.829 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:23:56.829 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:23:56.829 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:23:56.829 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:23:56.868 INFO:teuthology.orchestra.run.smithi090.stdout:0 upgraded, 0 newly installed, 0 to remove and 270 not upgraded. 2023-11-04T01:23:56.870 DEBUG:teuthology.orchestra.run.smithi090:> dpkg -s linux-image-generic 2023-11-04T01:23:56.886 INFO:teuthology.orchestra.run.smithi090.stdout:Package: linux-image-generic 2023-11-04T01:23:56.887 INFO:teuthology.orchestra.run.smithi090.stdout:Status: install ok installed 2023-11-04T01:23:56.887 INFO:teuthology.orchestra.run.smithi090.stdout:Priority: optional 2023-11-04T01:23:56.887 INFO:teuthology.orchestra.run.smithi090.stdout:Section: kernel 2023-11-04T01:23:56.887 INFO:teuthology.orchestra.run.smithi090.stdout:Installed-Size: 20 2023-11-04T01:23:56.887 INFO:teuthology.orchestra.run.smithi090.stdout:Maintainer: Ubuntu Kernel Team 2023-11-04T01:23:56.887 INFO:teuthology.orchestra.run.smithi090.stdout:Architecture: amd64 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout:Source: linux-meta 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout:Version: 5.15.0.88.85 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-88), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout:Depends: linux-image-5.15.0-88-generic, linux-modules-extra-5.15.0-88-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout:Recommends: thermald 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout:Description: Generic Linux kernel image 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout: This package will always depend on the latest generic kernel image 2023-11-04T01:23:56.890 INFO:teuthology.orchestra.run.smithi090.stdout: available. 2023-11-04T01:23:56.891 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2023-11-04T01:23:56.939 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.NeMZClZZgf 2023-11-04T01:23:56.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NeMZClZZgf 2023-11-04T01:23:56.999 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.NeMZClZZgf 2023-11-04T01:23:57.136 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.NeMZClZZgf is 10KB 2023-11-04T01:23:57.149 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.NeMZClZZgf 2023-11-04T01:23:57.155 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-04T01:23:57.215 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:23:57.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-04T01:23:57.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-04T01:23:57.305 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-88-generic 2023-11-04T01:23:57.306 DEBUG:teuthology.orchestra.run.smithi090:> sudo update-grub 2023-11-04T01:23:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub' 2023-11-04T01:23:59.127 INFO:teuthology.orchestra.run.smithi090.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-04T01:23:59.144 INFO:teuthology.orchestra.run.smithi090.stderr:Generating grub configuration file ... 2023-11-04T01:23:59.400 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.15.0-88-generic 2023-11-04T01:23:59.406 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.15.0-88-generic 2023-11-04T01:23:59.845 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-04T01:23:59.850 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-04T01:23:59.894 INFO:teuthology.orchestra.run.smithi090.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-04T01:23:59.900 INFO:teuthology.orchestra.run.smithi090.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-04T01:24:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-04T01:24:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-04T01:24:00.049 INFO:teuthology.orchestra.run.smithi090.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-04T01:24:00.078 INFO:teuthology.orchestra.run.smithi090.stderr:done 2023-11-04T01:24:00.080 DEBUG:teuthology.orchestra.run.smithi090:> sudo shutdown -r now 2023-11-04T01:24:22.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-04T01:24:22.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-04T01:24:22.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:30.090 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-04T01:24:30.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-04T01:24:30.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:24:57.083 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-11-04T01:25:04.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-04T01:25:06.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-04T01:25:06.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:25:13.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-04T01:25:13.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:25:16.826 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-04T01:25:24.476 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-11-04T01:25:28.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-04T01:25:28.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:25:36.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-04T01:25:36.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:25:39.546 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-11-04T01:25:47.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-11-04T01:25:54.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-04T01:25:54.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:25:54.838 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-11-04T01:25:55.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-04T01:25:55.349 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-88-generic"... 2023-11-04T01:25:55.349 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2023-11-04T01:25:55.396 INFO:teuthology.orchestra.run.smithi002.stdout:5.15.0-88-generic 2023-11-04T01:25:55.396 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-88-generic vs 5.15.0-88-generic 2023-11-04T01:25:55.397 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:25:55.397 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-04T01:25:56.398 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-04T01:25:56.398 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:25:56.476 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2023-11-04T01:25:56.515 DEBUG:teuthology.parallel:result is None 2023-11-04T01:26:02.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-04T01:26:02.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:26:02.643 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-11-04T01:26:03.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-04T01:26:03.899 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-88-generic"... 2023-11-04T01:26:03.899 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2023-11-04T01:26:03.905 INFO:teuthology.orchestra.run.smithi090.stdout:5.15.0-88-generic 2023-11-04T01:26:03.905 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-88-generic vs 5.15.0-88-generic 2023-11-04T01:26:03.905 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-04T01:26:03.905 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-04T01:26:04.906 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-04T01:26:04.906 DEBUG:teuthology.orchestra.run.smithi090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-04T01:26:05.243 INFO:teuthology.orchestra.run.smithi090.stdout:ttyS1 2023-11-04T01:26:05.263 DEBUG:teuthology.parallel:result is None 2023-11-04T01:26:05.263 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-04T01:26:05.272 INFO:teuthology.task.internal:Creating test directory... 2023-11-04T01:26:05.272 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:26:05.275 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-04T01:26:05.280 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-04T01:26:05.308 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-04T01:26:05.367 INFO:teuthology.task.internal:Creating archive directory... 2023-11-04T01:26:05.367 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:26:05.375 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-04T01:26:05.440 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-04T01:26:05.448 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-04T01:26:05.448 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:26:05.451 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-04T01:26:05.475 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:26:05.482 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:26:05.484 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:26:05.490 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:26:05.491 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-04T01:26:05.503 INFO:teuthology.task.internal:Configuring sudo... 2023-11-04T01:26:05.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:26:05.531 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-04T01:26:05.554 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-04T01:26:05.563 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-04T01:26:05.563 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:26:05.599 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-04T01:26:05.605 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:26:05.650 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:26:05.699 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:26:05.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:26:05.762 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:26:05.773 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:26:05.821 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:26:05.821 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-04T01:26:05.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2023-11-04T01:26:05.895 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2023-11-04T01:26:06.035 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-04T01:26:06.043 INFO:teuthology.task.internal:Starting timer... 2023-11-04T01:26:06.043 INFO:teuthology.run_tasks:Running task pcp... 2023-11-04T01:26:06.094 INFO:teuthology.run_tasks:Running task selinux... 2023-11-04T01:26:06.145 DEBUG:teuthology.task.selinux:Excluding smithi002: OS 'ubuntu' does not support SELinux 2023-11-04T01:26:06.145 DEBUG:teuthology.task.selinux:Excluding smithi090: OS 'ubuntu' does not support SELinux 2023-11-04T01:26:06.145 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-04T01:26:06.145 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-04T01:26:06.145 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-04T01:26:06.146 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-04T01:26:06.226 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-04T01:26:06.226 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-04T01:26:06.260 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-04T01:26:06.261 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi090.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-04T01:38:33.030 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi090.front.sepia.ceph.com')] 2023-11-04T01:38:33.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-04T01:38:33.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:38:33.112 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-11-04T01:38:33.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-04T01:38:33.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-04T01:38:33.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:38:33.297 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-11-04T01:38:33.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-11-04T01:38:33.408 INFO:teuthology.run_tasks:Running task clock... 2023-11-04T01:38:33.420 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-04T01:38:33.421 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:38:33.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:38:33.424 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-04T01:38:33.424 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Command line: ntpd -gq 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: ---------------------------------------------------- 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: ntp-4 is maintained by Network Time Foundation, 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: corporation. Support and training for ntp-4 are 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: available at https://www.nwtime.org/support 2023-11-04T01:38:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: ---------------------------------------------------- 2023-11-04T01:38:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: proto: precision = 0.046 usec (-24) 2023-11-04T01:38:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: basedate set to 2022-02-04 2023-11-04T01:38:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: gps base set to 2022-02-06 (week 2196) 2023-11-04T01:38:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:38:33.454 INFO:teuthology.orchestra.run.smithi002.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:38:33.455 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:38:33.455 INFO:teuthology.orchestra.run.smithi002.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:38:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Listen and drop on 0 v6wildcard [::]:123 2023-11-04T01:38:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-04T01:38:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Listen normally on 2 lo 127.0.0.1:123 2023-11-04T01:38:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Listen normally on 3 ens1f0 172.21.15.2:123 2023-11-04T01:38:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Listen normally on 4 lo [::1]:123 2023-11-04T01:38:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1920%4]:123 2023-11-04T01:38:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:33 ntpd[27911]: Listening on routing socket on fd #22 for interface updates 2023-11-04T01:38:33.478 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-04T01:38:33.479 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Command line: ntpd -gq 2023-11-04T01:38:33.479 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: ---------------------------------------------------- 2023-11-04T01:38:33.479 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: ntp-4 is maintained by Network Time Foundation, 2023-11-04T01:38:33.479 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-04T01:38:33.479 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: corporation. Support and training for ntp-4 are 2023-11-04T01:38:33.479 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: available at https://www.nwtime.org/support 2023-11-04T01:38:33.479 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: ---------------------------------------------------- 2023-11-04T01:38:33.480 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: proto: precision = 0.046 usec (-24) 2023-11-04T01:38:33.480 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: basedate set to 2022-02-04 2023-11-04T01:38:33.480 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: gps base set to 2022-02-06 (week 2196) 2023-11-04T01:38:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:38:33.481 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-04T01:38:33.481 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:38:33.481 INFO:teuthology.orchestra.run.smithi090.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-04T01:38:33.482 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Listen and drop on 0 v6wildcard [::]:123 2023-11-04T01:38:33.482 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-04T01:38:33.482 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Listen normally on 2 lo 127.0.0.1:123 2023-11-04T01:38:33.482 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Listen normally on 3 enp3s0f1 172.21.15.90:123 2023-11-04T01:38:33.483 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Listen normally on 4 lo [::1]:123 2023-11-04T01:38:33.483 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d767%5]:123 2023-11-04T01:38:33.483 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:33 ntpd[28059]: Listening on routing socket on fd #22 for interface updates 2023-11-04T01:38:34.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:34 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:34.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:34 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:34.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:34 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:34.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:34 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:34.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:34 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:34.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:34 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:34.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:34 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:34.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:34 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:34.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:34 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:34.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:34 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:34.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:34 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:34.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:34 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:35.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:35 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:35.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:35 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:35.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:35 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:35.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:35 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:35.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:35 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:35.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:35 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:35.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:35 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:35.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:35 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:36.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:36 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:36.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:36 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:36.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:36 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:36.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:36 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:36.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:36 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:36.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:36 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:36.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:36.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:36.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:36.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:36.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:36.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:36.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:36.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:36.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:36.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:36.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:36.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:36 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:37.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:37.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:37.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:37.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:37.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:37.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:37.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:37.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:37.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:37.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:37.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:37.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:37 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:37.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:37.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:37.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:37.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:37.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:37.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:37.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:37.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:37 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:38.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:38 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:38.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:38 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:38.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:38 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:38.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:38 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:38.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:38 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:38.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:38 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:38.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:38.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:38.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:38.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:38.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:38.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:38.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:38.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:38.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:38.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:38.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:38.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:38 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:39.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:39.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:39 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:39.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:39 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:39.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:39 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:39.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:39 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:39.479 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:39 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:39.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:39 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:39.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:39 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:40.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:40.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:40.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:40.452 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:40.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:40.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:40.453 INFO:teuthology.orchestra.run.smithi002.stdout: 4 Nov 01:38:40 ntpd[27911]: ntpd: time slew -0.003113 s 2023-11-04T01:38:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd: time slew -0.003113s 2023-11-04T01:38:40.453 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-04T01:38:40.454 INFO:teuthology.orchestra.run.smithi002.stderr: 4 Nov 01:38:40 ntpd[27911]: can't open /var/log/ntpstats/loopstats.20231104: Permission denied 2023-11-04T01:38:40.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:40.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:40.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:40.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:40.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:40.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:40.480 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:40.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:40.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-04T01:38:40.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: can't open /var/log/ntpstats/rawstats.20231104: Permission denied 2023-11-04T01:38:40.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-04T01:38:40.481 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: can't open /var/log/ntpstats/peerstats.20231104: Permission denied 2023-11-04T01:38:40.481 INFO:teuthology.orchestra.run.smithi090.stdout: 4 Nov 01:38:40 ntpd[28059]: ntpd: time slew -0.003348 s 2023-11-04T01:38:40.481 INFO:teuthology.orchestra.run.smithi090.stdout:ntpd: time slew -0.003348s 2023-11-04T01:38:40.482 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-04T01:38:40.482 INFO:teuthology.orchestra.run.smithi090.stderr: 4 Nov 01:38:40 ntpd[28059]: can't open /var/log/ntpstats/loopstats.20231104: Permission denied 2023-11-04T01:38:40.536 INFO:teuthology.orchestra.run.smithi002.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T01:38:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================== 2023-11-04T01:38:40.536 INFO:teuthology.orchestra.run.smithi002.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.536 INFO:teuthology.orchestra.run.smithi002.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.536 INFO:teuthology.orchestra.run.smithi002.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.536 INFO:teuthology.orchestra.run.smithi002.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.551 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T01:38:40.552 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2023-11-04T01:38:40.552 INFO:teuthology.orchestra.run.smithi090.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.552 INFO:teuthology.orchestra.run.smithi090.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.552 INFO:teuthology.orchestra.run.smithi090.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.552 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-04T01:38:40.552 INFO:teuthology.run_tasks:Running task install... 2023-11-04T01:38:40.566 DEBUG:teuthology.task.install:project ceph 2023-11-04T01:38:40.567 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}} 2023-11-04T01:38:40.567 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'} 2023-11-04T01:38:40.567 INFO:teuthology.task.install:Using flavor: default 2023-11-04T01:38:40.576 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-04T01:38:40.576 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-04T01:38:40.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-key list | grep Ceph 2023-11-04T01:38:40.577 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-key list | grep Ceph 2023-11-04T01:38:40.637 INFO:teuthology.orchestra.run.smithi002.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-04T01:38:40.650 INFO:teuthology.orchestra.run.smithi090.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-04T01:38:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-04T01:38:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:uid [ unknown] Ceph.com (release key) 2023-11-04T01:38:40.667 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-04T01:38:40.667 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-04T01:38:40.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:38:40.677 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-04T01:38:40.677 INFO:teuthology.orchestra.run.smithi090.stdout:uid [ unknown] Ceph.com (release key) 2023-11-04T01:38:40.677 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-04T01:38:40.678 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-04T01:38:40.678 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:38:40.885 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default/ 2023-11-04T01:38:40.885 INFO:teuthology.task.install.deb:Package version is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:40.890 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default/ 2023-11-04T01:38:40.890 INFO:teuthology.task.install.deb:Package version is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:41.179 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:38:41.180 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-04T01:38:41.185 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:38:41.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-04T01:38:41.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo apt-get update 2023-11-04T01:38:41.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo apt-get update 2023-11-04T01:38:41.399 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-04T01:38:41.400 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:38:41.410 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-04T01:38:41.427 INFO:teuthology.orchestra.run.smithi090.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:38:41.452 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy InRelease 2023-11-04T01:38:41.478 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-04T01:38:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy InRelease 2023-11-04T01:38:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-04T01:38:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-04T01:38:41.510 INFO:teuthology.orchestra.run.smithi090.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-04T01:38:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-04T01:38:41.549 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-04T01:38:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-04T01:38:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-04T01:38:41.623 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-11-04T01:38:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-11-04T01:38:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-04T01:38:41.693 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-04T01:38:41.756 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 27.8 kB in 0s (80.3 kB/s) 2023-11-04T01:38:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 27.8 kB in 1s (55.2 kB/s) 2023-11-04T01:38:42.596 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-11-04T01:38:42.611 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7035-g7532011a-1jammy cephadm=18.0.0-7035-g7532011a-1jammy ceph-mds=18.0.0-7035-g7532011a-1jammy ceph-mgr=18.0.0-7035-g7532011a-1jammy ceph-common=18.0.0-7035-g7532011a-1jammy ceph-fuse=18.0.0-7035-g7532011a-1jammy ceph-test=18.0.0-7035-g7532011a-1jammy ceph-volume=18.0.0-7035-g7532011a-1jammy radosgw=18.0.0-7035-g7532011a-1jammy python3-rados=18.0.0-7035-g7532011a-1jammy python3-rgw=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy python3-rbd=18.0.0-7035-g7532011a-1jammy libcephfs2=18.0.0-7035-g7532011a-1jammy libcephfs-dev=18.0.0-7035-g7532011a-1jammy librados2=18.0.0-7035-g7532011a-1jammy librbd1=18.0.0-7035-g7532011a-1jammy rbd-fuse=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy cephfs-shell=18.0.0-7035-g7532011a-1jammy cephfs-top=18.0.0-7035-g7532011a-1jammy cephfs-mirror=18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:42.672 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-11-04T01:38:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2023-11-04T01:38:42.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7035-g7532011a-1jammy cephadm=18.0.0-7035-g7532011a-1jammy ceph-mds=18.0.0-7035-g7532011a-1jammy ceph-mgr=18.0.0-7035-g7532011a-1jammy ceph-common=18.0.0-7035-g7532011a-1jammy ceph-fuse=18.0.0-7035-g7532011a-1jammy ceph-test=18.0.0-7035-g7532011a-1jammy ceph-volume=18.0.0-7035-g7532011a-1jammy radosgw=18.0.0-7035-g7532011a-1jammy python3-rados=18.0.0-7035-g7532011a-1jammy python3-rgw=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy python3-rbd=18.0.0-7035-g7532011a-1jammy libcephfs2=18.0.0-7035-g7532011a-1jammy libcephfs-dev=18.0.0-7035-g7532011a-1jammy librados2=18.0.0-7035-g7532011a-1jammy librbd1=18.0.0-7035-g7532011a-1jammy rbd-fuse=18.0.0-7035-g7532011a-1jammy python3-cephfs=18.0.0-7035-g7532011a-1jammy cephfs-shell=18.0.0-7035-g7532011a-1jammy cephfs-top=18.0.0-7035-g7532011a-1jammy cephfs-mirror=18.0.0-7035-g7532011a-1jammy 2023-11-04T01:38:42.859 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2023-11-04T01:38:42.860 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2023-11-04T01:38:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2023-11-04T01:38:43.024 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:38:43.024 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:38:43.025 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:38:43.025 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:38:43.025 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:38:43.026 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:38:43.026 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:38:43.026 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2023-11-04T01:38:43.026 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-04T01:38:43.026 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-04T01:38:43.026 INFO:teuthology.orchestra.run.smithi090.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:38:43.026 INFO:teuthology.orchestra.run.smithi090.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-04T01:38:43.027 INFO:teuthology.orchestra.run.smithi090.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-04T01:38:43.027 INFO:teuthology.orchestra.run.smithi090.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-04T01:38:43.027 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-04T01:38:43.027 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-04T01:38:43.027 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-04T01:38:43.027 INFO:teuthology.orchestra.run.smithi090.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-04T01:38:43.027 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:38:43.028 INFO:teuthology.orchestra.run.smithi090.stdout: socat xmlstarlet 2023-11-04T01:38:43.029 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2023-11-04T01:38:43.029 INFO:teuthology.orchestra.run.smithi090.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-04T01:38:43.029 INFO:teuthology.orchestra.run.smithi090.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-04T01:38:43.029 INFO:teuthology.orchestra.run.smithi090.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-04T01:38:43.029 INFO:teuthology.orchestra.run.smithi090.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-04T01:38:43.029 INFO:teuthology.orchestra.run.smithi090.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-04T01:38:43.030 INFO:teuthology.orchestra.run.smithi090.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-04T01:38:43.030 INFO:teuthology.orchestra.run.smithi090.stdout: python3-watchdog 2023-11-04T01:38:43.030 INFO:teuthology.orchestra.run.smithi090.stdout:Recommended packages: 2023-11-04T01:38:43.030 INFO:teuthology.orchestra.run.smithi090.stdout: btrfs-tools 2023-11-04T01:38:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2023-11-04T01:38:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2023-11-04T01:38:43.127 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2023-11-04T01:38:43.127 INFO:teuthology.orchestra.run.smithi090.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-04T01:38:43.127 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-04T01:38:43.127 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-04T01:38:43.127 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-04T01:38:43.128 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:38:43.129 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:38:43.130 INFO:teuthology.orchestra.run.smithi090.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-04T01:38:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:38:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:38:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:38:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:38:43.208 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:38:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:38:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:38:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2023-11-04T01:38:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-04T01:38:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-04T01:38:43.210 INFO:teuthology.orchestra.run.smithi002.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-04T01:38:43.211 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: socat xmlstarlet 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2023-11-04T01:38:43.212 INFO:teuthology.orchestra.run.smithi002.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: python3-watchdog 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:Recommended packages: 2023-11-04T01:38:43.213 INFO:teuthology.orchestra.run.smithi002.stdout: btrfs-tools 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi090.stdout:0 upgraded, 114 newly installed, 0 to remove and 258 not upgraded. 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 185 MB of archives. 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-04T01:38:43.287 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7035-g7532011a-1jammy [3,467 kB] 2023-11-04T01:38:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2023-11-04T01:38:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-04T01:38:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-04T01:38:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-04T01:38:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-04T01:38:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-04T01:38:43.316 INFO:teuthology.orchestra.run.smithi002.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-04T01:38:43.316 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-04T01:38:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-04T01:38:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-04T01:38:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-04T01:38:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-04T01:38:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-04T01:38:43.317 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-04T01:38:43.318 INFO:teuthology.orchestra.run.smithi002.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-04T01:38:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-04T01:38:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-04T01:38:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-04T01:38:43.319 INFO:teuthology.orchestra.run.smithi002.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-04T01:38:43.398 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-04T01:38:43.444 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-04T01:38:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:0 upgraded, 114 newly installed, 0 to remove and 258 not upgraded. 2023-11-04T01:38:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 185 MB of archives. 2023-11-04T01:38:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-04T01:38:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-04T01:38:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7035-g7532011a-1jammy [3,467 kB] 2023-11-04T01:38:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-04T01:38:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-04T01:38:43.639 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-04T01:38:43.737 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-04T01:38:43.751 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-04T01:38:43.802 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-04T01:38:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-04T01:38:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-04T01:38:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-04T01:38:43.958 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7035-g7532011a-1jammy [3,110 kB] 2023-11-04T01:38:43.980 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-04T01:38:43.989 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-04T01:38:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-04T01:38:44.015 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-04T01:38:44.023 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-04T01:38:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-04T01:38:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-04T01:38:44.185 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7035-g7532011a-1jammy [688 kB] 2023-11-04T01:38:44.188 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-04T01:38:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-04T01:38:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-04T01:38:44.225 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7035-g7532011a-1jammy [356 kB] 2023-11-04T01:38:44.241 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7035-g7532011a-1jammy [32.8 kB] 2023-11-04T01:38:44.244 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7035-g7532011a-1jammy [180 kB] 2023-11-04T01:38:44.255 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7035-g7532011a-1jammy [62.4 kB] 2023-11-04T01:38:44.257 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7035-g7532011a-1jammy [330 kB] 2023-11-04T01:38:44.275 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7035-g7532011a-1jammy [6,245 kB] 2023-11-04T01:38:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-04T01:38:44.519 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7035-g7532011a-1jammy [112 kB] 2023-11-04T01:38:44.522 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7035-g7532011a-1jammy [439 kB] 2023-11-04T01:38:44.539 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7035-g7532011a-1jammy [22.6 MB] 2023-11-04T01:38:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7035-g7532011a-1jammy [3,110 kB] 2023-11-04T01:38:44.751 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-04T01:38:44.755 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-04T01:38:44.755 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-04T01:38:44.763 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-04T01:38:44.763 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-04T01:38:44.764 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-04T01:38:44.765 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-04T01:38:44.766 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-04T01:38:44.767 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-04T01:38:44.833 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-04T01:38:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-04T01:38:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-04T01:38:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-04T01:38:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-04T01:38:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-04T01:38:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-04T01:38:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-04T01:38:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-04T01:38:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-04T01:38:45.015 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-04T01:38:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-04T01:38:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-04T01:38:45.216 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-04T01:38:45.246 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-04T01:38:45.270 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-04T01:38:45.373 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-04T01:38:45.387 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-04T01:38:45.395 INFO:teuthology.orchestra.run.smithi090.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-04T01:38:45.409 INFO:teuthology.orchestra.run.smithi002.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-04T01:38:45.438 INFO:teuthology.orchestra.run.smithi002.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-04T01:38:45.439 INFO:teuthology.orchestra.run.smithi002.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7035-g7532011a-1jammy [688 kB] 2023-11-04T01:38:45.447 INFO:teuthology.orchestra.run.smithi090.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-04T01:38:45.463 INFO:teuthology.orchestra.run.smithi002.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-04T01:38:45.566 INFO:teuthology.orchestra.run.smithi002.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-04T01:38:45.573 INFO:teuthology.orchestra.run.smithi090.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-04T01:38:45.573 INFO:teuthology.orchestra.run.smithi090.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7035-g7532011a-1jammy [6,900 kB] 2023-11-04T01:38:45.573 INFO:teuthology.orchestra.run.smithi090.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-04T01:38:45.579 INFO:teuthology.orchestra.run.smithi002.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-04T01:38:45.583 INFO:teuthology.orchestra.run.smithi002.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7035-g7532011a-1jammy [356 kB] 2023-11-04T01:38:45.587 INFO:teuthology.orchestra.run.smithi002.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-04T01:38:45.624 INFO:teuthology.orchestra.run.smithi002.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7035-g7532011a-1jammy [32.8 kB] 2023-11-04T01:38:45.631 INFO:teuthology.orchestra.run.smithi002.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7035-g7532011a-1jammy [180 kB] 2023-11-04T01:38:45.639 INFO:teuthology.orchestra.run.smithi002.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-04T01:38:45.649 INFO:teuthology.orchestra.run.smithi002.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7035-g7532011a-1jammy [62.4 kB] 2023-11-04T01:38:45.656 INFO:teuthology.orchestra.run.smithi090.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-04T01:38:45.667 INFO:teuthology.orchestra.run.smithi002.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-04T01:38:45.671 INFO:teuthology.orchestra.run.smithi002.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7035-g7532011a-1jammy [330 kB] 2023-11-04T01:38:45.678 INFO:teuthology.orchestra.run.smithi002.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-04T01:38:45.738 INFO:teuthology.orchestra.run.smithi002.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7035-g7532011a-1jammy [6,245 kB] 2023-11-04T01:38:45.790 INFO:teuthology.orchestra.run.smithi002.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-04T01:38:45.806 INFO:teuthology.orchestra.run.smithi090.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7035-g7532011a-1jammy [238 kB] 2023-11-04T01:38:45.811 INFO:teuthology.orchestra.run.smithi090.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7035-g7532011a-1jammy [124 kB] 2023-11-04T01:38:45.814 INFO:teuthology.orchestra.run.smithi090.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7035-g7532011a-1jammy [1,495 kB] 2023-11-04T01:38:45.820 INFO:teuthology.orchestra.run.smithi090.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-04T01:38:45.845 INFO:teuthology.orchestra.run.smithi090.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7035-g7532011a-1jammy [9,947 kB] 2023-11-04T01:38:45.954 INFO:teuthology.orchestra.run.smithi002.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-04T01:38:46.003 INFO:teuthology.orchestra.run.smithi090.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-04T01:38:46.053 INFO:teuthology.orchestra.run.smithi090.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-04T01:38:46.138 INFO:teuthology.orchestra.run.smithi002.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-04T01:38:46.185 INFO:teuthology.orchestra.run.smithi090.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-04T01:38:46.187 INFO:teuthology.orchestra.run.smithi002.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-04T01:38:46.250 INFO:teuthology.orchestra.run.smithi090.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7035-g7532011a-1jammy [31.8 MB] 2023-11-04T01:38:46.276 INFO:teuthology.orchestra.run.smithi090.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-04T01:38:46.295 INFO:teuthology.orchestra.run.smithi090.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-11-04T01:38:46.320 INFO:teuthology.orchestra.run.smithi002.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-04T01:38:46.322 INFO:teuthology.orchestra.run.smithi090.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-04T01:38:46.335 INFO:teuthology.orchestra.run.smithi090.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-04T01:38:46.374 INFO:teuthology.orchestra.run.smithi090.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-04T01:38:46.382 INFO:teuthology.orchestra.run.smithi090.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-04T01:38:46.410 INFO:teuthology.orchestra.run.smithi090.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-04T01:38:46.411 INFO:teuthology.orchestra.run.smithi002.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-04T01:38:46.430 INFO:teuthology.orchestra.run.smithi002.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-11-04T01:38:46.457 INFO:teuthology.orchestra.run.smithi002.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-04T01:38:46.470 INFO:teuthology.orchestra.run.smithi002.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-04T01:38:46.508 INFO:teuthology.orchestra.run.smithi002.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-04T01:38:46.517 INFO:teuthology.orchestra.run.smithi002.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-04T01:38:46.545 INFO:teuthology.orchestra.run.smithi002.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-04T01:38:46.799 INFO:teuthology.orchestra.run.smithi090.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-04T01:38:46.845 INFO:teuthology.orchestra.run.smithi002.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7035-g7532011a-1jammy [112 kB] 2023-11-04T01:38:46.870 INFO:teuthology.orchestra.run.smithi002.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7035-g7532011a-1jammy [439 kB] 2023-11-04T01:38:46.934 INFO:teuthology.orchestra.run.smithi002.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-04T01:38:46.948 INFO:teuthology.orchestra.run.smithi002.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7035-g7532011a-1jammy [22.6 MB] 2023-11-04T01:38:47.115 INFO:teuthology.orchestra.run.smithi090.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-04T01:38:47.203 INFO:teuthology.orchestra.run.smithi090.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-04T01:38:47.228 INFO:teuthology.orchestra.run.smithi090.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-04T01:38:47.239 INFO:teuthology.orchestra.run.smithi090.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-04T01:38:47.251 INFO:teuthology.orchestra.run.smithi002.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-04T01:38:47.289 INFO:teuthology.orchestra.run.smithi090.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-04T01:38:47.341 INFO:teuthology.orchestra.run.smithi002.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-04T01:38:47.366 INFO:teuthology.orchestra.run.smithi002.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-04T01:38:47.377 INFO:teuthology.orchestra.run.smithi002.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-04T01:38:47.427 INFO:teuthology.orchestra.run.smithi002.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-04T01:38:47.538 INFO:teuthology.orchestra.run.smithi090.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-04T01:38:47.547 INFO:teuthology.orchestra.run.smithi090.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-04T01:38:47.548 INFO:teuthology.orchestra.run.smithi090.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-04T01:38:47.618 INFO:teuthology.orchestra.run.smithi090.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-04T01:38:47.618 INFO:teuthology.orchestra.run.smithi090.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-04T01:38:47.680 INFO:teuthology.orchestra.run.smithi002.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-04T01:38:47.688 INFO:teuthology.orchestra.run.smithi002.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-04T01:38:47.689 INFO:teuthology.orchestra.run.smithi002.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-04T01:38:47.755 INFO:teuthology.orchestra.run.smithi002.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-04T01:38:47.755 INFO:teuthology.orchestra.run.smithi002.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-04T01:38:47.784 INFO:teuthology.orchestra.run.smithi090.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-04T01:38:47.857 INFO:teuthology.orchestra.run.smithi090.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7035-g7532011a-1jammy [14.0 kB] 2023-11-04T01:38:47.858 INFO:teuthology.orchestra.run.smithi090.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7035-g7532011a-1jammy [838 kB] 2023-11-04T01:38:47.874 INFO:teuthology.orchestra.run.smithi090.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7035-g7532011a-1jammy [2,144 kB] 2023-11-04T01:38:47.913 INFO:teuthology.orchestra.run.smithi090.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7035-g7532011a-1jammy [284 kB] 2023-11-04T01:38:47.917 INFO:teuthology.orchestra.run.smithi090.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7035-g7532011a-1jammy [138 kB] 2023-11-04T01:38:47.919 INFO:teuthology.orchestra.run.smithi090.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7035-g7532011a-1jammy [1,900 kB] 2023-11-04T01:38:47.921 INFO:teuthology.orchestra.run.smithi002.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-04T01:38:47.941 INFO:teuthology.orchestra.run.smithi090.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7035-g7532011a-1jammy [8,625 kB] 2023-11-04T01:38:47.979 INFO:teuthology.orchestra.run.smithi090.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-04T01:38:48.028 INFO:teuthology.orchestra.run.smithi090.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-04T01:38:48.091 INFO:teuthology.orchestra.run.smithi090.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-04T01:38:48.116 INFO:teuthology.orchestra.run.smithi002.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-04T01:38:48.123 INFO:teuthology.orchestra.run.smithi090.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-04T01:38:48.158 INFO:teuthology.orchestra.run.smithi090.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-04T01:38:48.165 INFO:teuthology.orchestra.run.smithi002.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-04T01:38:48.229 INFO:teuthology.orchestra.run.smithi002.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-04T01:38:48.262 INFO:teuthology.orchestra.run.smithi002.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-04T01:38:48.297 INFO:teuthology.orchestra.run.smithi002.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-04T01:38:48.308 INFO:teuthology.orchestra.run.smithi090.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-04T01:38:48.327 INFO:teuthology.orchestra.run.smithi090.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7035-g7532011a-1jammy [14.2 kB] 2023-11-04T01:38:48.328 INFO:teuthology.orchestra.run.smithi090.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7035-g7532011a-1jammy [48.7 MB] 2023-11-04T01:38:48.343 INFO:teuthology.orchestra.run.smithi090.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-04T01:38:48.366 INFO:teuthology.orchestra.run.smithi090.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-04T01:38:48.373 INFO:teuthology.orchestra.run.smithi090.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-04T01:38:48.414 INFO:teuthology.orchestra.run.smithi090.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-04T01:38:48.448 INFO:teuthology.orchestra.run.smithi002.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-04T01:38:48.483 INFO:teuthology.orchestra.run.smithi002.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-04T01:38:48.506 INFO:teuthology.orchestra.run.smithi002.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-04T01:38:48.515 INFO:teuthology.orchestra.run.smithi002.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-04T01:38:48.554 INFO:teuthology.orchestra.run.smithi002.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-04T01:38:48.601 INFO:teuthology.orchestra.run.smithi090.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-04T01:38:48.740 INFO:teuthology.orchestra.run.smithi002.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-04T01:38:48.779 INFO:teuthology.orchestra.run.smithi090.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-04T01:38:48.919 INFO:teuthology.orchestra.run.smithi002.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-04T01:38:49.120 INFO:teuthology.orchestra.run.smithi090.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-04T01:38:49.182 INFO:teuthology.orchestra.run.smithi090.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-04T01:38:49.182 INFO:teuthology.orchestra.run.smithi090.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-04T01:38:49.190 INFO:teuthology.orchestra.run.smithi090.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-04T01:38:49.192 INFO:teuthology.orchestra.run.smithi090.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-04T01:38:49.211 INFO:teuthology.orchestra.run.smithi090.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-04T01:38:49.219 INFO:teuthology.orchestra.run.smithi090.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-04T01:38:49.260 INFO:teuthology.orchestra.run.smithi002.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-04T01:38:49.279 INFO:teuthology.orchestra.run.smithi090.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-04T01:38:49.280 INFO:teuthology.orchestra.run.smithi090.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-04T01:38:49.321 INFO:teuthology.orchestra.run.smithi002.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-04T01:38:49.321 INFO:teuthology.orchestra.run.smithi002.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-04T01:38:49.329 INFO:teuthology.orchestra.run.smithi002.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-04T01:38:49.331 INFO:teuthology.orchestra.run.smithi002.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-04T01:38:49.350 INFO:teuthology.orchestra.run.smithi002.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-04T01:38:49.358 INFO:teuthology.orchestra.run.smithi002.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-04T01:38:49.419 INFO:teuthology.orchestra.run.smithi002.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-04T01:38:49.420 INFO:teuthology.orchestra.run.smithi002.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-04T01:38:49.445 INFO:teuthology.orchestra.run.smithi090.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-04T01:38:49.586 INFO:teuthology.orchestra.run.smithi002.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-04T01:38:49.879 INFO:teuthology.orchestra.run.smithi090.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-04T01:38:49.894 INFO:teuthology.orchestra.run.smithi090.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-04T01:38:50.019 INFO:teuthology.orchestra.run.smithi002.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-04T01:38:50.034 INFO:teuthology.orchestra.run.smithi002.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-04T01:38:50.954 INFO:teuthology.orchestra.run.smithi090.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7035-g7532011a-1jammy [120 kB] 2023-11-04T01:38:50.957 INFO:teuthology.orchestra.run.smithi090.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7035-g7532011a-1jammy [225 kB] 2023-11-04T01:38:50.962 INFO:teuthology.orchestra.run.smithi090.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7035-g7532011a-1jammy [34.0 kB] 2023-11-04T01:38:50.963 INFO:teuthology.orchestra.run.smithi090.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7035-g7532011a-1jammy [23.4 kB] 2023-11-04T01:38:50.963 INFO:teuthology.orchestra.run.smithi090.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7035-g7532011a-1jammy [38.3 kB] 2023-11-04T01:38:50.964 INFO:teuthology.orchestra.run.smithi090.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7035-g7532011a-1jammy [12.3 MB] 2023-11-04T01:38:51.519 INFO:teuthology.orchestra.run.smithi090.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7035-g7532011a-1jammy [90.8 kB] 2023-11-04T01:38:51.738 INFO:teuthology.orchestra.run.smithi002.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7035-g7532011a-1jammy [6,900 kB] 2023-11-04T01:38:52.086 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 185 MB in 8s (22.1 MB/s) 2023-11-04T01:38:52.206 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-04T01:38:52.291 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165985 files and directories currently installed.) 2023-11-04T01:38:52.296 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-04T01:38:52.338 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-04T01:38:52.628 INFO:teuthology.orchestra.run.smithi002.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7035-g7532011a-1jammy [238 kB] 2023-11-04T01:38:52.657 INFO:teuthology.orchestra.run.smithi002.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7035-g7532011a-1jammy [124 kB] 2023-11-04T01:38:52.666 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-04T01:38:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7035-g7532011a-1jammy [1,495 kB] 2023-11-04T01:38:52.692 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-04T01:38:52.733 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:38:52.864 INFO:teuthology.orchestra.run.smithi002.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7035-g7532011a-1jammy [9,947 kB] 2023-11-04T01:38:53.062 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cmd2. 2023-11-04T01:38:53.089 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-04T01:38:53.129 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-04T01:38:53.441 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-04T01:38:53.467 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-04T01:38:53.541 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:38:53.871 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-04T01:38:53.897 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-04T01:38:53.938 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:38:54.219 INFO:teuthology.orchestra.run.smithi002.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7035-g7532011a-1jammy [31.8 MB] 2023-11-04T01:38:54.275 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-04T01:38:54.302 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-04T01:38:54.341 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:38:54.729 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-04T01:38:54.756 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:38:54.804 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:38:55.209 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-04T01:38:55.235 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:38:55.275 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:38:55.587 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-04T01:38:55.614 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:38:55.654 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:38:56.025 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-04T01:38:56.052 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-04T01:38:56.092 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:38:56.437 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librados2. 2023-11-04T01:38:56.463 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../010-librados2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:38:56.503 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:57.125 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librbd1. 2023-11-04T01:38:57.151 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../011-librbd1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:38:57.191 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:57.645 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs2. 2023-11-04T01:38:57.671 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:38:57.711 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:58.014 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rados. 2023-11-04T01:38:58.041 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:38:58.089 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:58.260 INFO:teuthology.orchestra.run.smithi002.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7035-g7532011a-1jammy [14.0 kB] 2023-11-04T01:38:58.261 INFO:teuthology.orchestra.run.smithi002.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7035-g7532011a-1jammy [838 kB] 2023-11-04T01:38:58.277 INFO:teuthology.orchestra.run.smithi002.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7035-g7532011a-1jammy [2,144 kB] 2023-11-04T01:38:58.394 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-04T01:38:58.420 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:38:58.460 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:58.506 INFO:teuthology.orchestra.run.smithi002.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7035-g7532011a-1jammy [284 kB] 2023-11-04T01:38:58.542 INFO:teuthology.orchestra.run.smithi002.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7035-g7532011a-1jammy [138 kB] 2023-11-04T01:38:58.549 INFO:teuthology.orchestra.run.smithi002.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7035-g7532011a-1jammy [1,900 kB] 2023-11-04T01:38:58.713 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cephfs. 2023-11-04T01:38:58.739 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:38:58.755 INFO:teuthology.orchestra.run.smithi002.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7035-g7532011a-1jammy [8,625 kB] 2023-11-04T01:38:58.780 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:59.108 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-04T01:38:59.134 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:38:59.174 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:38:59.480 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-prettytable. 2023-11-04T01:38:59.506 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-04T01:38:59.546 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-04T01:38:59.687 INFO:teuthology.orchestra.run.smithi002.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7035-g7532011a-1jammy [14.2 kB] 2023-11-04T01:38:59.687 INFO:teuthology.orchestra.run.smithi002.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7035-g7532011a-1jammy [48.7 MB] 2023-11-04T01:38:59.816 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rbd. 2023-11-04T01:38:59.831 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:38:59.874 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:00.204 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-04T01:39:00.230 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-04T01:39:00.270 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:39:00.615 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package librgw2. 2023-11-04T01:39:00.641 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../020-librgw2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:00.682 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:01.318 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rgw. 2023-11-04T01:39:01.344 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:01.385 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:01.756 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-04T01:39:01.783 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-04T01:39:01.823 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:39:02.135 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libradosstriper1. 2023-11-04T01:39:02.161 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:02.209 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:02.631 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-common. 2023-11-04T01:39:02.657 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:02.698 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:04.113 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-base. 2023-11-04T01:39:04.139 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:04.189 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:04.547 INFO:teuthology.orchestra.run.smithi002.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7035-g7532011a-1jammy [120 kB] 2023-11-04T01:39:04.550 INFO:teuthology.orchestra.run.smithi002.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7035-g7532011a-1jammy [225 kB] 2023-11-04T01:39:04.554 INFO:teuthology.orchestra.run.smithi002.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7035-g7532011a-1jammy [34.0 kB] 2023-11-04T01:39:04.556 INFO:teuthology.orchestra.run.smithi002.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7035-g7532011a-1jammy [23.4 kB] 2023-11-04T01:39:04.557 INFO:teuthology.orchestra.run.smithi002.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7035-g7532011a-1jammy [38.3 kB] 2023-11-04T01:39:04.558 INFO:teuthology.orchestra.run.smithi002.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7035-g7532011a-1jammy [12.3 MB] 2023-11-04T01:39:04.953 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-04T01:39:04.979 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-04T01:39:05.019 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:39:05.217 INFO:teuthology.orchestra.run.smithi002.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/main/7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7035-g7532011a-1jammy [90.8 kB] 2023-11-04T01:39:05.297 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cheroot. 2023-11-04T01:39:05.323 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-04T01:39:05.389 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:39:05.727 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-04T01:39:05.753 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-04T01:39:05.778 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 185 MB in 22s (8,463 kB/s) 2023-11-04T01:39:05.794 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:39:06.045 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-04T01:39:06.089 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-04T01:39:06.115 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-04T01:39:06.149 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165985 files and directories currently installed.) 2023-11-04T01:39:06.154 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-04T01:39:06.155 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:39:06.193 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-04T01:39:06.460 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-04T01:39:06.487 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-04T01:39:06.514 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-04T01:39:06.535 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:39:06.554 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:39:06.815 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cmd2. 2023-11-04T01:39:06.831 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-04T01:39:06.838 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-tempora. 2023-11-04T01:39:06.865 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-04T01:39:06.865 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-04T01:39:06.905 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-04T01:39:07.151 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-04T01:39:07.178 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-04T01:39:07.183 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-portend. 2023-11-04T01:39:07.210 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-04T01:39:07.250 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-04T01:39:07.251 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:39:07.529 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-04T01:39:07.556 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-04T01:39:07.588 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-04T01:39:07.596 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-04T01:39:07.615 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-04T01:39:07.655 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:39:07.891 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-04T01:39:07.918 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-04T01:39:07.957 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:39:08.033 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-04T01:39:08.060 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-04T01:39:08.099 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:39:08.305 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-natsort. 2023-11-04T01:39:08.331 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-04T01:39:08.379 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-04T01:39:08.470 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-04T01:39:08.496 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:39:08.536 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:39:08.691 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-logutils. 2023-11-04T01:39:08.718 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-04T01:39:08.758 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-04T01:39:08.948 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-04T01:39:08.974 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:39:09.031 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:39:09.036 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-04T01:39:09.063 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-04T01:39:09.104 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:39:09.384 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-04T01:39:09.399 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-mako. 2023-11-04T01:39:09.411 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-04T01:39:09.426 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-04T01:39:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:39:09.499 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:39:09.762 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-04T01:39:09.789 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-04T01:39:09.803 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-04T01:39:09.820 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:39:09.830 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-04T01:39:09.869 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:39:10.166 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-04T01:39:10.192 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-04T01:39:10.232 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:39:10.323 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librados2. 2023-11-04T01:39:10.350 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../010-librados2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:10.389 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:10.535 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webob. 2023-11-04T01:39:10.562 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-04T01:39:10.610 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:39:10.951 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librbd1. 2023-11-04T01:39:10.965 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-waitress. 2023-11-04T01:39:10.977 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../011-librbd1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:10.992 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-04T01:39:11.017 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:11.034 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:39:11.343 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-tempita. 2023-11-04T01:39:11.370 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-04T01:39:11.410 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:39:11.503 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libcephfs2. 2023-11-04T01:39:11.530 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:11.570 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:11.705 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-paste. 2023-11-04T01:39:11.732 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-04T01:39:11.771 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:39:11.806 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rados. 2023-11-04T01:39:11.832 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:11.864 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:12.101 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-04T01:39:12.125 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-04T01:39:12.168 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:39:12.192 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-04T01:39:12.219 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:12.258 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:12.463 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-04T01:39:12.490 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-04T01:39:12.494 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cephfs. 2023-11-04T01:39:12.510 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:12.530 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:39:12.552 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:12.826 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-webtest. 2023-11-04T01:39:12.841 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-04T01:39:12.863 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-04T01:39:12.876 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-04T01:39:12.890 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:12.930 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:13.171 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pecan. 2023-11-04T01:39:13.197 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-04T01:39:13.224 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-prettytable. 2023-11-04T01:39:13.237 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:39:13.240 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-04T01:39:13.274 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-04T01:39:13.502 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rbd. 2023-11-04T01:39:13.518 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:13.560 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:13.645 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-certifi. 2023-11-04T01:39:13.671 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-04T01:39:13.719 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-04T01:39:13.913 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-04T01:39:13.940 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-04T01:39:13.980 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:39:14.098 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-idna. 2023-11-04T01:39:14.125 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-04T01:39:14.173 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-04T01:39:14.316 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package librgw2. 2023-11-04T01:39:14.342 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../020-librgw2_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:14.382 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:14.518 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-urllib3. 2023-11-04T01:39:14.545 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-11-04T01:39:14.592 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:39:14.889 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-requests. 2023-11-04T01:39:14.893 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rgw. 2023-11-04T01:39:14.909 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:14.916 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-04T01:39:14.943 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:14.956 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:39:15.276 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-04T01:39:15.303 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-04T01:39:15.342 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:39:15.382 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-04T01:39:15.409 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-04T01:39:15.446 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:39:15.639 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-04T01:39:15.654 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:15.689 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:15.765 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libradosstriper1. 2023-11-04T01:39:15.792 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:15.832 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:16.111 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-04T01:39:16.131 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:16.169 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:16.211 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-common. 2023-11-04T01:39:16.237 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:16.269 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:17.459 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-openssl. 2023-11-04T01:39:17.485 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-04T01:39:17.533 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-04T01:39:17.903 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr. 2023-11-04T01:39:17.930 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:17.970 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:18.233 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-base. 2023-11-04T01:39:18.260 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:18.309 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:18.375 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mon. 2023-11-04T01:39:18.401 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:18.441 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:19.004 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-04T01:39:19.030 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-04T01:39:19.070 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:39:19.337 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-osd. 2023-11-04T01:39:19.363 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:19.372 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cheroot. 2023-11-04T01:39:19.400 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-04T01:39:19.403 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:19.456 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:39:19.753 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-04T01:39:19.768 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-04T01:39:19.811 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:39:20.114 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-04T01:39:20.140 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-04T01:39:20.180 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:39:20.483 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-04T01:39:20.510 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-04T01:39:20.550 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:39:21.002 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-tempora. 2023-11-04T01:39:21.029 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-04T01:39:21.061 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-04T01:39:21.293 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph. 2023-11-04T01:39:21.319 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../060-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:21.359 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:21.372 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-portend. 2023-11-04T01:39:21.399 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-04T01:39:21.438 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-04T01:39:21.687 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-fuse. 2023-11-04T01:39:21.713 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:21.741 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-04T01:39:21.768 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-04T01:39:21.808 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-04T01:39:22.037 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:22.119 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-04T01:39:22.146 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-04T01:39:22.186 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:39:22.539 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-natsort. 2023-11-04T01:39:22.566 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-04T01:39:22.605 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-04T01:39:22.617 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mds. 2023-11-04T01:39:22.644 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:22.684 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:22.892 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-logutils. 2023-11-04T01:39:22.918 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-04T01:39:22.958 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-04T01:39:23.054 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephadm. 2023-11-04T01:39:23.081 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../063-cephadm_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:23.121 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:23.244 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-04T01:39:23.261 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-04T01:39:23.303 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:39:23.432 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-04T01:39:23.456 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-04T01:39:23.499 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-04T01:39:23.580 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-mako. 2023-11-04T01:39:23.608 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-04T01:39:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:39:23.837 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-04T01:39:23.852 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:39:23.903 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:39:23.984 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-04T01:39:24.011 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-04T01:39:24.050 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:39:24.353 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-04T01:39:24.380 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-04T01:39:24.420 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:39:24.714 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-webob. 2023-11-04T01:39:24.741 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-04T01:39:24.780 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:39:25.108 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-waitress. 2023-11-04T01:39:25.136 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-04T01:39:25.143 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-babel. 2023-11-04T01:39:25.170 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:39:25.170 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:39:25.211 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:39:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-tempita. 2023-11-04T01:39:25.480 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-04T01:39:25.519 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:39:25.531 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-jinja2. 2023-11-04T01:39:25.558 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-04T01:39:25.606 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-04T01:39:25.822 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-paste. 2023-11-04T01:39:25.849 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-04T01:39:25.889 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:39:26.002 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-04T01:39:26.028 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:26.068 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:26.192 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-04T01:39:26.219 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-04T01:39:26.258 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:39:26.440 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-04T01:39:26.467 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-04T01:39:26.506 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:39:26.570 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-04T01:39:26.597 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-04T01:39:26.636 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:39:26.785 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-04T01:39:26.811 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-04T01:39:26.851 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-04T01:39:26.939 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-webtest. 2023-11-04T01:39:26.967 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-04T01:39:27.006 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-04T01:39:27.148 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-routes. 2023-11-04T01:39:27.175 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-04T01:39:27.215 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:39:27.292 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pecan. 2023-11-04T01:39:27.308 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-04T01:39:27.342 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:39:27.560 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-04T01:39:27.587 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:27.626 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:27.680 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-certifi. 2023-11-04T01:39:27.707 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-04T01:39:27.738 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-04T01:39:28.057 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-04T01:39:28.083 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-idna. 2023-11-04T01:39:28.084 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-04T01:39:28.110 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-04T01:39:28.132 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:39:28.149 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-04T01:39:28.494 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-urllib3. 2023-11-04T01:39:28.521 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-11-04T01:39:28.560 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:39:28.619 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-joblib. 2023-11-04T01:39:28.646 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-04T01:39:28.686 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:39:28.880 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-requests. 2023-11-04T01:39:28.908 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-04T01:39:28.946 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:39:29.058 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-04T01:39:29.085 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-04T01:39:29.133 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:39:29.258 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-04T01:39:29.285 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-04T01:39:29.324 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:39:29.411 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-sklearn. 2023-11-04T01:39:29.438 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-04T01:39:29.478 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:39:29.619 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-04T01:39:29.635 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:29.677 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:29.998 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-04T01:39:30.015 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:30.048 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:30.368 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-openssl. 2023-11-04T01:39:30.372 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-04T01:39:30.395 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-04T01:39:30.400 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:30.434 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-04T01:39:30.439 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:30.779 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr. 2023-11-04T01:39:30.807 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:30.845 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:31.365 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mon. 2023-11-04T01:39:31.393 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:31.423 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:31.511 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-cachetools. 2023-11-04T01:39:31.538 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-04T01:39:31.577 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-04T01:39:31.872 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-04T01:39:31.899 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-04T01:39:31.938 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:39:32.251 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-04T01:39:32.278 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-04T01:39:32.317 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:39:32.327 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-osd. 2023-11-04T01:39:32.354 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:32.393 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:32.622 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-rsa. 2023-11-04T01:39:32.639 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-04T01:39:32.680 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-04T01:39:32.993 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-google-auth. 2023-11-04T01:39:33.020 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-04T01:39:33.068 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-04T01:39:33.475 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-04T01:39:33.502 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-04T01:39:33.541 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:39:33.853 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-websocket. 2023-11-04T01:39:33.880 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-04T01:39:33.927 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-04T01:39:34.291 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-04T01:39:34.314 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph. 2023-11-04T01:39:34.318 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-04T01:39:34.341 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../060-ceph_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:34.366 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:39:34.380 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:34.691 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-fuse. 2023-11-04T01:39:34.718 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:34.749 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:35.128 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mds. 2023-11-04T01:39:35.155 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:35.174 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-04T01:39:35.194 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:35.198 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:35.240 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:35.564 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package cephadm. 2023-11-04T01:39:35.568 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-04T01:39:35.591 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../063-cephadm_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:35.596 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-04T01:39:35.630 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:35.643 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:39:35.917 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-04T01:39:35.944 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-04T01:39:35.983 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-04T01:39:35.989 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-04T01:39:36.016 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:39:36.055 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:39:36.301 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package jq. 2023-11-04T01:39:36.317 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:39:36.319 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-04T01:39:36.347 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:39:36.359 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-04T01:39:36.386 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:39:36.612 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package socat. 2023-11-04T01:39:36.628 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-04T01:39:36.662 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:39:36.983 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package xmlstarlet. 2023-11-04T01:39:37.010 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-04T01:39:37.050 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:39:37.399 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-babel. 2023-11-04T01:39:37.416 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-04T01:39:37.449 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:39:37.865 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-test. 2023-11-04T01:39:37.893 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:37.939 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:37.970 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-jinja2. 2023-11-04T01:39:37.997 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-04T01:39:38.036 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-04T01:39:38.347 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-04T01:39:38.375 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:38.414 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:38.734 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-04T01:39:38.761 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-04T01:39:38.800 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:39:39.112 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-04T01:39:39.139 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-04T01:39:39.178 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-04T01:39:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-routes. 2023-11-04T01:39:39.509 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-04T01:39:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:39:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-04T01:39:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-04T01:39:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-04T01:39:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:39:40.462 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ceph-volume. 2023-11-04T01:39:40.489 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:40.528 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:40.891 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-04T01:39:40.918 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-joblib. 2023-11-04T01:39:40.958 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-04T01:39:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:39:41.263 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-colorama. 2023-11-04T01:39:41.290 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-04T01:39:41.329 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-04T01:39:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-04T01:39:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-04T01:39:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:39:41.574 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-shell. 2023-11-04T01:39:41.589 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:41.632 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:41.877 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package cephfs-top. 2023-11-04T01:39:41.893 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:41.935 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-sklearn. 2023-11-04T01:39:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-04T01:39:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:39:42.165 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-04T01:39:42.181 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:42.223 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:42.644 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package nvme-cli. 2023-11-04T01:39:42.671 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-04T01:39:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-04T01:39:42.710 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:39:42.733 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:43.050 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-04T01:39:43.078 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-04T01:39:43.117 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:39:43.621 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-04T01:39:43.648 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-04T01:39:43.687 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-04T01:39:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-cachetools. 2023-11-04T01:39:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-04T01:39:43.799 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-04T01:39:43.983 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pastescript. 2023-11-04T01:39:44.011 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-04T01:39:44.050 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-04T01:39:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-04T01:39:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-04T01:39:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:39:44.354 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pluggy. 2023-11-04T01:39:44.381 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-04T01:39:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-04T01:39:44.420 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:39:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-04T01:39:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:39:44.709 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-psutil. 2023-11-04T01:39:44.736 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-04T01:39:44.783 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-04T01:39:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-rsa. 2023-11-04T01:39:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-04T01:39:44.866 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-04T01:39:45.154 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-py. 2023-11-04T01:39:45.181 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-04T01:39:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-google-auth. 2023-11-04T01:39:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-04T01:39:45.228 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-04T01:39:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-04T01:39:45.532 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pygments. 2023-11-04T01:39:45.560 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-04T01:39:45.599 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:39:45.632 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-04T01:39:45.648 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-04T01:39:45.682 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:39:45.977 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-websocket. 2023-11-04T01:39:46.005 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-04T01:39:46.043 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-04T01:39:46.172 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-04T01:39:46.199 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-04T01:39:46.238 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:39:46.364 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-04T01:39:46.391 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-04T01:39:46.430 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:39:46.550 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-toml. 2023-11-04T01:39:46.577 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-04T01:39:46.624 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-04T01:39:46.929 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-pytest. 2023-11-04T01:39:46.956 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-04T01:39:47.004 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:39:47.310 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-04T01:39:47.336 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:47.366 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package python3-simplejson. 2023-11-04T01:39:47.377 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:47.394 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-04T01:39:47.432 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:39:47.671 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-04T01:39:47.687 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-04T01:39:47.700 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-04T01:39:47.714 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-04T01:39:47.754 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:39:47.780 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:39:48.116 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-04T01:39:48.144 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:39:48.182 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:39:48.451 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package jq. 2023-11-04T01:39:48.468 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-04T01:39:48.510 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-04T01:39:48.625 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package radosgw. 2023-11-04T01:39:48.653 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../112-radosgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:48.700 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:48.763 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package socat. 2023-11-04T01:39:48.788 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-04T01:39:48.829 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:39:49.124 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package xmlstarlet. 2023-11-04T01:39:49.152 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-04T01:39:49.190 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:39:49.488 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package rbd-fuse. 2023-11-04T01:39:49.516 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:49.554 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:49.561 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-test. 2023-11-04T01:39:49.590 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:49.628 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:49.884 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-04T01:39:50.135 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:39:50.261 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:39:50.531 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-04T01:39:50.869 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-04T01:39:51.359 INFO:teuthology.orchestra.run.smithi090.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-04T01:39:51.473 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:51.965 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ceph-volume. 2023-11-04T01:39:51.993 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:52.031 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:52.033 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user cephadm....done 2023-11-04T01:39:52.182 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:39:52.419 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-04T01:39:52.447 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:52.458 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:39:52.494 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:52.723 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:39:52.814 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-colorama. 2023-11-04T01:39:52.835 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:39:52.841 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-04T01:39:52.880 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-04T01:39:53.158 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package cephfs-shell. 2023-11-04T01:39:53.186 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:53.233 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:53.320 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-04T01:39:53.535 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package cephfs-top. 2023-11-04T01:39:53.563 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7035-g7532011a-1jammy_all.deb ... 2023-11-04T01:39:53.571 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:39:53.610 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:53.698 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-04T01:39:53.871 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-04T01:39:53.899 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:39:53.938 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:54.009 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:39:54.308 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package nvme-cli. 2023-11-04T01:39:54.336 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-04T01:39:54.369 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-04T01:39:54.374 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:39:54.620 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-04T01:39:54.763 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-04T01:39:54.791 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-04T01:39:54.829 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:39:54.872 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-04T01:39:55.132 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:39:55.266 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-04T01:39:55.294 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-04T01:39:55.332 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-04T01:39:55.386 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:39:55.635 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pastescript. 2023-11-04T01:39:55.635 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:39:55.663 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-04T01:39:55.701 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-04T01:39:55.895 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:39:55.996 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pluggy. 2023-11-04T01:39:56.024 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-04T01:39:56.054 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:39:56.154 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:39:56.264 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-04T01:39:56.341 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-psutil. 2023-11-04T01:39:56.369 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-04T01:39:56.407 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-04T01:39:56.498 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:39:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-py. 2023-11-04T01:39:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-04T01:39:56.749 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:39:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-04T01:39:56.877 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-04T01:39:57.030 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pygments. 2023-11-04T01:39:57.058 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-04T01:39:57.096 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:39:57.228 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:39:57.346 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-04T01:39:57.614 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:39:57.781 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-04T01:39:57.809 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-04T01:39:57.850 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:39:57.856 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:39:58.153 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-toml. 2023-11-04T01:39:58.158 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:39:58.181 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-04T01:39:58.219 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-04T01:39:58.507 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-pytest. 2023-11-04T01:39:58.535 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-04T01:39:58.573 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:39:58.882 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:39:58.927 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package python3-simplejson. 2023-11-04T01:39:58.955 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-04T01:39:58.993 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:39:59.138 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:39:59.263 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-04T01:39:59.264 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:39:59.279 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-04T01:39:59.321 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:39:59.390 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:39:59.683 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-04T01:40:00.058 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package radosgw. 2023-11-04T01:40:00.075 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-04T01:40:00.087 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../112-radosgw_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:40:00.124 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:00.344 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:40:00.730 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:40:00.869 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package rbd-fuse. 2023-11-04T01:40:00.886 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7035-g7532011a-1jammy_amd64.deb ... 2023-11-04T01:40:00.927 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:00.998 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-04T01:40:01.265 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-04T01:40:01.308 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:40:01.524 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-04T01:40:01.650 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-04T01:40:01.684 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:40:01.916 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-04T01:40:01.935 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:40:02.062 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:02.287 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-04T01:40:02.364 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-idna (3.3-1) ... 2023-11-04T01:40:02.665 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:40:02.777 INFO:teuthology.orchestra.run.smithi002.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-04T01:40:02.843 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:03.421 INFO:teuthology.orchestra.run.smithi002.stdout:Adding system user cephadm....done 2023-11-04T01:40:03.575 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-04T01:40:03.851 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-04T01:40:03.865 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:40:03.982 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-04T01:40:04.152 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-04T01:40:04.242 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:40:04.278 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-04T01:40:04.368 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:40:04.478 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:40:04.546 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-04T01:40:04.754 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:40:04.797 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-04T01:40:04.898 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-04T01:40:05.005 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-04T01:40:05.191 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-04T01:40:05.258 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:40:05.384 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:40:05.560 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-04T01:40:05.685 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:40:05.819 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-04T01:40:05.928 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-04T01:40:06.079 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-04T01:40:06.171 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-04T01:40:06.363 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-04T01:40:06.422 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:40:06.606 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-04T01:40:06.665 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-04T01:40:06.849 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-04T01:40:06.926 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:40:07.086 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-04T01:40:07.133 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-ceph-argparse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:07.345 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:40:07.401 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-04T01:40:07.455 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:40:07.527 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-04T01:40:07.739 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:40:07.811 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-04T01:40:08.024 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:40:08.271 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-04T01:40:08.276 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:40:08.380 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-04T01:40:08.723 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-04T01:40:08.849 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-04T01:40:08.944 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-04T01:40:09.117 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-04T01:40:09.196 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:40:09.322 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:40:09.385 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-04T01:40:09.691 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:40:09.694 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-04T01:40:09.950 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-04T01:40:10.211 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:40:10.312 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-04T01:40:10.430 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-04T01:40:10.622 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:40:10.689 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-04T01:40:10.790 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-04T01:40:10.907 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-04T01:40:10.931 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:40:11.199 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-04T01:40:11.208 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-04T01:40:11.325 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-04T01:40:11.593 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-04T01:40:11.601 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-04T01:40:11.861 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-04T01:40:11.862 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:40:12.122 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:40:12.246 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-04T01:40:12.482 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-04T01:40:12.547 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-04T01:40:12.758 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:40:12.848 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-04T01:40:13.086 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:40:13.192 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-04T01:40:13.196 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:13.323 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:13.442 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-04T01:40:13.449 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:13.568 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:13.669 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:13.795 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:13.869 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-idna (3.3-1) ... 2023-11-04T01:40:13.896 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-04T01:40:14.166 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:14.187 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-04T01:40:14.292 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:14.418 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:14.628 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:40:14.628 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:40:15.128 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:15.288 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:15.414 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:15.434 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:40:15.525 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:40:15.568 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-04T01:40:15.828 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-04T01:40:15.954 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-04T01:40:16.072 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-11-04T01:40:16.356 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-04T01:40:16.616 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-04T01:40:16.780 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:16.875 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:40:16.906 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:17.001 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-04T01:40:17.058 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:17.209 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:17.311 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-04T01:40:17.361 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:17.495 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:17.587 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-04T01:40:17.847 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-04T01:40:18.057 INFO:teuthology.orchestra.run.smithi090.stdout:Adding group ceph....done 2023-11-04T01:40:18.081 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-04T01:40:18.357 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-04T01:40:18.400 INFO:teuthology.orchestra.run.smithi090.stdout:Adding system user ceph....done 2023-11-04T01:40:18.569 INFO:teuthology.orchestra.run.smithi090.stdout:Setting system user ceph properties....done 2023-11-04T01:40:18.589 INFO:teuthology.orchestra.run.smithi090.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-04T01:40:18.633 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-04T01:40:18.726 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-04T01:40:18.759 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-04T01:40:19.052 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-04T01:40:19.058 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-04T01:40:19.178 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-04T01:40:19.479 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-04T01:40:19.557 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:19.762 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:40:19.762 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:40:19.772 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-04T01:40:20.006 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-04T01:40:20.292 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:20.386 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-04T01:40:20.419 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:20.659 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-04T01:40:20.785 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-04T01:40:20.890 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:40:20.890 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:40:21.186 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-04T01:40:21.413 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:21.463 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-04T01:40:21.697 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-04T01:40:21.765 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-04T01:40:21.798 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-04T01:40:22.116 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-04T01:40:22.307 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:22.417 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-04T01:40:22.543 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:40:22.543 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:40:22.693 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-04T01:40:22.819 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-04T01:40:23.093 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:23.095 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-04T01:40:23.312 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:40:23.312 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:40:23.371 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-04T01:40:23.606 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-04T01:40:23.895 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:23.966 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-04T01:40:24.284 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-04T01:40:24.389 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:40:24.389 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:40:24.644 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-04T01:40:24.770 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librados2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:24.904 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librgw2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:24.933 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.005 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.084 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.208 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libcephfs2 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.335 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libradosstriper1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.384 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.460 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-04T01:40:25.689 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:40:25.689 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:40:25.737 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up librbd1 (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.855 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-modules-core (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:25.956 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.171 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:40:26.172 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-04T01:40:26.230 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.356 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.482 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.633 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.733 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libcephfs-dev (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.858 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rados (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.985 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up cephfs-top (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:26.986 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:40:27.110 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-04T01:40:28.140 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:40:28.432 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rbd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:28.558 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up rbd-fuse (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:28.619 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:40:28.622 DEBUG:teuthology.orchestra.run.smithi090:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-04T01:40:28.674 INFO:teuthology.orchestra.run.smithi090.stdout:Reading package lists... 2023-11-04T01:40:28.683 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-rgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:28.810 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up python3-cephfs (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:28.862 INFO:teuthology.orchestra.run.smithi090.stdout:Building dependency tree... 2023-11-04T01:40:28.862 INFO:teuthology.orchestra.run.smithi090.stdout:Reading state information... 2023-11-04T01:40:28.936 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up cephfs-shell (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:40:29.025 INFO:teuthology.orchestra.run.smithi090.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:40:29.026 INFO:teuthology.orchestra.run.smithi090.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout:The following additional packages will be installed: 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-04T01:40:29.027 INFO:teuthology.orchestra.run.smithi090.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:40:29.028 INFO:teuthology.orchestra.run.smithi090.stdout:Suggested packages: 2023-11-04T01:40:29.028 INFO:teuthology.orchestra.run.smithi090.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-04T01:40:29.028 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-04T01:40:29.028 INFO:teuthology.orchestra.run.smithi090.stdout: libengine-pkcs11-openssl 2023-11-04T01:40:29.062 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-common (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:29.063 INFO:teuthology.orchestra.run.smithi090.stdout:The following NEW packages will be installed: 2023-11-04T01:40:29.064 INFO:teuthology.orchestra.run.smithi090.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-04T01:40:29.064 INFO:teuthology.orchestra.run.smithi090.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-04T01:40:29.065 INFO:teuthology.orchestra.run.smithi090.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-04T01:40:29.065 INFO:teuthology.orchestra.run.smithi090.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-04T01:40:29.065 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-04T01:40:29.065 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-04T01:40:29.065 INFO:teuthology.orchestra.run.smithi090.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:40:29.066 INFO:teuthology.orchestra.run.smithi090.stdout:The following packages will be upgraded: 2023-11-04T01:40:29.066 INFO:teuthology.orchestra.run.smithi090.stdout: libssl3 2023-11-04T01:40:29.119 INFO:teuthology.orchestra.run.smithi090.stdout:1 upgraded, 39 newly installed, 0 to remove and 257 not upgraded. 2023-11-04T01:40:29.119 INFO:teuthology.orchestra.run.smithi090.stdout:Need to get 54.6 MB of archives. 2023-11-04T01:40:29.119 INFO:teuthology.orchestra.run.smithi090.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-04T01:40:29.119 INFO:teuthology.orchestra.run.smithi090.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-04T01:40:29.238 INFO:teuthology.orchestra.run.smithi090.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-04T01:40:29.318 INFO:teuthology.orchestra.run.smithi090.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-04T01:40:29.353 INFO:teuthology.orchestra.run.smithi090.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-04T01:40:29.365 INFO:teuthology.orchestra.run.smithi090.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-04T01:40:29.404 INFO:teuthology.orchestra.run.smithi090.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-04T01:40:29.472 INFO:teuthology.orchestra.run.smithi090.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-04T01:40:29.510 INFO:teuthology.orchestra.run.smithi090.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-04T01:40:29.546 INFO:teuthology.orchestra.run.smithi002.stdout:Adding group ceph....done 2023-11-04T01:40:29.556 INFO:teuthology.orchestra.run.smithi090.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-04T01:40:29.607 INFO:teuthology.orchestra.run.smithi090.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-04T01:40:29.661 INFO:teuthology.orchestra.run.smithi090.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-04T01:40:29.674 INFO:teuthology.orchestra.run.smithi090.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-04T01:40:29.709 INFO:teuthology.orchestra.run.smithi090.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-04T01:40:29.932 INFO:teuthology.orchestra.run.smithi002.stdout:Adding system user ceph....done 2023-11-04T01:40:30.091 INFO:teuthology.orchestra.run.smithi002.stdout:Setting system user ceph properties....done 2023-11-04T01:40:30.105 INFO:teuthology.orchestra.run.smithi002.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-04T01:40:30.137 INFO:teuthology.orchestra.run.smithi090.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-04T01:40:30.139 INFO:teuthology.orchestra.run.smithi090.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-04T01:40:30.140 INFO:teuthology.orchestra.run.smithi090.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-04T01:40:30.143 INFO:teuthology.orchestra.run.smithi090.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-04T01:40:30.143 INFO:teuthology.orchestra.run.smithi090.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-04T01:40:30.178 INFO:teuthology.orchestra.run.smithi090.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-04T01:40:30.181 INFO:teuthology.orchestra.run.smithi090.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-04T01:40:30.191 INFO:teuthology.orchestra.run.smithi090.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-04T01:40:30.191 INFO:teuthology.orchestra.run.smithi090.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-04T01:40:30.221 INFO:teuthology.orchestra.run.smithi090.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-04T01:40:30.237 INFO:teuthology.orchestra.run.smithi090.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-04T01:40:30.238 INFO:teuthology.orchestra.run.smithi090.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-04T01:40:30.250 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-04T01:40:30.284 INFO:teuthology.orchestra.run.smithi090.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-04T01:40:30.352 INFO:teuthology.orchestra.run.smithi090.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-04T01:40:30.353 INFO:teuthology.orchestra.run.smithi090.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-04T01:40:30.354 INFO:teuthology.orchestra.run.smithi090.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-04T01:40:30.355 INFO:teuthology.orchestra.run.smithi090.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-04T01:40:30.378 INFO:teuthology.orchestra.run.smithi090.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-04T01:40:30.381 INFO:teuthology.orchestra.run.smithi090.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-04T01:40:30.614 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-04T01:40:30.665 INFO:teuthology.orchestra.run.smithi090.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-04T01:40:30.665 INFO:teuthology.orchestra.run.smithi090.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-04T01:40:30.665 INFO:teuthology.orchestra.run.smithi090.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-04T01:40:30.665 INFO:teuthology.orchestra.run.smithi090.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-04T01:40:30.666 INFO:teuthology.orchestra.run.smithi090.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-04T01:40:30.666 INFO:teuthology.orchestra.run.smithi090.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-04T01:40:30.677 INFO:teuthology.orchestra.run.smithi090.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-04T01:40:30.677 INFO:teuthology.orchestra.run.smithi090.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-04T01:40:31.083 INFO:teuthology.orchestra.run.smithi090.stdout:Preconfiguring packages ... 2023-11-04T01:40:31.155 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up cephfs-mirror (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:31.253 INFO:teuthology.orchestra.run.smithi090.stdout:Fetched 54.6 MB in 2s (34.0 MB/s) 2023-11-04T01:40:31.358 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:40:31.358 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-04T01:40:31.394 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package flex. 2023-11-04T01:40:31.486 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172900 files and directories currently installed.) 2023-11-04T01:40:31.492 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-04T01:40:31.526 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-04T01:40:31.907 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-test (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:32.041 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up radosgw (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:32.068 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:40:32.242 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-04T01:40:32.537 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:40:32.537 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-04T01:40:32.677 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:40:33.091 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-base (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:33.219 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package bison. 2023-11-04T01:40:33.319 INFO:teuthology.orchestra.run.smithi090.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172973 files and directories currently installed.) 2023-11-04T01:40:33.325 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-04T01:40:33.371 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:40:33.597 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-04T01:40:33.790 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-04T01:40:33.817 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-04T01:40:33.857 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:40:34.128 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mds (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:34.193 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package dump. 2023-11-04T01:40:34.220 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-04T01:40:34.260 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking dump (0.4b47-3) ... 2023-11-04T01:40:34.357 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:40:34.357 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-04T01:40:34.548 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package indent. 2023-11-04T01:40:34.576 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:34.623 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:40:34.868 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-04T01:40:34.895 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-04T01:40:34.914 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:34.934 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:40:35.143 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:40:35.143 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-04T01:40:35.240 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-04T01:40:35.267 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-04T01:40:35.306 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:40:35.567 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-04T01:40:35.583 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-04T01:40:35.617 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:40:35.723 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-osd (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:36.056 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:40:36.056 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-04T01:40:36.254 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-04T01:40:36.282 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-04T01:40:36.321 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:40:36.600 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-04T01:40:36.616 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:36.617 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-04T01:40:36.658 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:40:36.742 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:36.893 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mon (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:36.903 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libjson-perl. 2023-11-04T01:40:36.930 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-04T01:40:36.978 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-04T01:40:37.113 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:40:37.113 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-04T01:40:37.283 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-04T01:40:37.310 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-04T01:40:37.349 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:40:37.653 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-cephadm (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:37.829 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:37.955 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-mgr-dashboard (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:38.106 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ceph-volume (18.0.0-7035-g7532011a-1jammy) ... 2023-11-04T01:40:38.460 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:40:39.177 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:40:39.185 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-04T01:40:39.213 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:40:39.252 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:40:39.530 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-04T01:40:39.557 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:40:39.596 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:40:39.637 INFO:teuthology.orchestra.run.smithi002.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:40:39.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-04T01:40:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:Reading package lists... 2023-11-04T01:40:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:Building dependency tree... 2023-11-04T01:40:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:Reading state information... 2023-11-04T01:40:39.951 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-04T01:40:39.979 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:40:40.017 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages were automatically installed and are no longer required: 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-04T01:40:40.101 INFO:teuthology.orchestra.run.smithi002.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-04T01:40:40.102 INFO:teuthology.orchestra.run.smithi002.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-04T01:40:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-04T01:40:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-04T01:40:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:The following additional packages will be installed: 2023-11-04T01:40:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-04T01:40:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-04T01:40:40.103 INFO:teuthology.orchestra.run.smithi002.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-04T01:40:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-04T01:40:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:40:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:Suggested packages: 2023-11-04T01:40:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-04T01:40:40.104 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-04T01:40:40.105 INFO:teuthology.orchestra.run.smithi002.stdout: libengine-pkcs11-openssl 2023-11-04T01:40:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:The following NEW packages will be installed: 2023-11-04T01:40:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-04T01:40:40.143 INFO:teuthology.orchestra.run.smithi002.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-04T01:40:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-04T01:40:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-04T01:40:40.144 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-04T01:40:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-04T01:40:40.145 INFO:teuthology.orchestra.run.smithi002.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-04T01:40:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:The following packages will be upgraded: 2023-11-04T01:40:40.146 INFO:teuthology.orchestra.run.smithi002.stdout: libssl3 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:1 upgraded, 39 newly installed, 0 to remove and 257 not upgraded. 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:Need to get 54.6 MB of archives. 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-04T01:40:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-04T01:40:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-04T01:40:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-04T01:40:40.370 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-04T01:40:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-04T01:40:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-04T01:40:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-04T01:40:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-04T01:40:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-04T01:40:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-04T01:40:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-04T01:40:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-04T01:40:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-04T01:40:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-04T01:40:40.398 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-04T01:40:40.437 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:40:40.686 INFO:teuthology.orchestra.run.smithi002.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-04T01:40:40.687 INFO:teuthology.orchestra.run.smithi002.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-04T01:40:40.687 INFO:teuthology.orchestra.run.smithi002.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-04T01:40:40.690 INFO:teuthology.orchestra.run.smithi002.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-04T01:40:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-04T01:40:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-04T01:40:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-04T01:40:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-04T01:40:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-04T01:40:40.757 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-04T01:40:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-04T01:40:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-04T01:40:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-04T01:40:40.784 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:40:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-04T01:40:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-04T01:40:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-04T01:40:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-04T01:40:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-04T01:40:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-04T01:40:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-04T01:40:40.832 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:40:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-04T01:40:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-04T01:40:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-04T01:40:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-04T01:40:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-04T01:40:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-04T01:40:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-04T01:40:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-04T01:40:41.161 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-04T01:40:41.189 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:41.227 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:Preconfiguring packages ... 2023-11-04T01:40:41.572 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-04T01:40:41.600 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:Fetched 54.6 MB in 1s (62.3 MB/s) 2023-11-04T01:40:41.639 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:40:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package flex. 2023-11-04T01:40:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172900 files and directories currently installed.) 2023-11-04T01:40:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-04T01:40:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-04T01:40:41.975 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-04T01:40:42.003 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:42.042 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:40:42.279 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-04T01:40:42.295 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:40:42.329 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:40:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:40:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-04T01:40:42.891 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-04T01:40:42.919 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-04T01:40:42.958 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:40:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:40:43.304 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package modemmanager. 2023-11-04T01:40:43.332 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:40:43.379 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:40:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package bison. 2023-11-04T01:40:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172973 files and directories currently installed.) 2023-11-04T01:40:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-04T01:40:43.799 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:40:44.085 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package network-manager. 2023-11-04T01:40:44.113 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:40:44.160 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:40:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-04T01:40:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-04T01:40:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:40:44.819 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package ppp. 2023-11-04T01:40:44.847 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-04T01:40:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package dump. 2023-11-04T01:40:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-04T01:40:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking dump (0.4b47-3) ... 2023-11-04T01:40:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package indent. 2023-11-04T01:40:45.233 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:40:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:40:45.543 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-04T01:40:45.560 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package pptp-linux. 2023-11-04T01:40:45.560 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-04T01:40:45.576 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-04T01:40:45.610 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:40:45.618 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-04T01:40:45.862 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-04T01:40:45.878 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-04T01:40:45.921 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-04T01:40:46.022 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-04T01:40:46.050 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-04T01:40:46.097 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:40:46.225 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-04T01:40:46.253 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-04T01:40:46.300 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client-common (238) ... 2023-11-04T01:40:46.366 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-04T01:40:46.382 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-04T01:40:46.424 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:40:46.562 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-04T01:40:46.578 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:46.612 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:46.761 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-04T01:40:46.789 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-04T01:40:46.827 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:40:47.130 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-04T01:40:47.158 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-04T01:40:47.205 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:40:47.294 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-common. 2023-11-04T01:40:47.322 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-04T01:40:47.378 INFO:teuthology.orchestra.run.smithi090.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-04T01:40:47.408 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-common (238) ... 2023-11-04T01:40:47.507 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libjson-perl. 2023-11-04T01:40:47.536 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-04T01:40:47.574 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-04T01:40:47.846 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-14. 2023-11-04T01:40:47.872 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:47.923 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:47.952 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-04T01:40:47.980 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-04T01:40:48.018 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:40:49.850 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql. 2023-11-04T01:40:49.879 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-04T01:40:49.917 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql (14+238) ... 2023-11-04T01:40:50.162 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-client. 2023-11-04T01:40:50.190 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-04T01:40:50.237 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-client (14+238) ... 2023-11-04T01:40:50.315 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-04T01:40:50.343 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:40:50.381 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:40:50.447 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-04T01:40:50.464 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-04T01:40:50.506 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-04T01:40:50.600 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-04T01:40:50.616 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-04T01:40:50.658 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:40:50.834 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package tcl8.6. 2023-11-04T01:40:50.862 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-04T01:40:50.901 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:40:50.986 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-04T01:40:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:40:51.069 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:40:51.163 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package tcl. 2023-11-04T01:40:51.179 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-04T01:40:51.226 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-04T01:40:51.391 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-04T01:40:51.419 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-04T01:40:51.449 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:40:51.575 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package wpasupplicant. 2023-11-04T01:40:51.603 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-04T01:40:51.649 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:40:51.751 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-04T01:40:51.780 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:40:51.818 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:40:51.997 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-04T01:40:52.010 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-04T01:40:52.046 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-04T01:40:52.171 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-04T01:40:52.199 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:52.237 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:52.598 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-04T01:40:52.609 INFO:teuthology.orchestra.run.smithi090.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-04T01:40:52.626 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:52.637 INFO:teuthology.orchestra.run.smithi090.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-04T01:40:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:40:52.684 INFO:teuthology.orchestra.run.smithi090.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:40:52.943 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-04T01:40:52.970 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client-common (238) ... 2023-11-04T01:40:52.971 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:53.001 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:40:53.175 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-04T01:40:53.228 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-04T01:40:53.244 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-04T01:40:53.286 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:40:53.301 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:40:53.427 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:53.553 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:40:53.680 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:40:53.789 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-04T01:40:53.806 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:53.818 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-04T01:40:53.856 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:40:54.150 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package modemmanager. 2023-11-04T01:40:54.179 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-04T01:40:54.217 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:40:54.281 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-04T01:40:54.363 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:40:54.756 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:40:54.756 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:40:54.881 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package network-manager. 2023-11-04T01:40:54.910 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-04T01:40:54.957 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:40:55.326 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:40:55.436 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:40:55.562 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-04T01:40:55.589 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package ppp. 2023-11-04T01:40:55.618 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-04T01:40:55.688 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:40:55.814 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:40:55.911 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:40:55.941 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:40:56.066 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:40:56.252 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package pptp-linux. 2023-11-04T01:40:56.280 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-04T01:40:56.319 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-04T01:40:56.571 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-04T01:40:56.588 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-04T01:40:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-04T01:40:56.848 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:40:56.891 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-04T01:40:56.908 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-04T01:40:56.941 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking postgresql-client-common (238) ... 2023-11-04T01:40:56.974 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up dump (0.4b47-3) ... 2023-11-04T01:40:57.068 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-04T01:40:57.134 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:40:57.245 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-04T01:40:57.253 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:40:57.273 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:57.311 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:57.380 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-04T01:40:57.506 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-04T01:40:57.632 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:40:57.722 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-04T01:40:57.809 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:40:57.916 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package postgresql-common. 2023-11-04T01:40:57.935 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:40:57.944 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-04T01:40:58.002 INFO:teuthology.orchestra.run.smithi002.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-04T01:40:58.031 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking postgresql-common (238) ... 2023-11-04T01:40:58.103 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:40:58.222 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:40:58.348 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-04T01:40:58.481 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package postgresql-14. 2023-11-04T01:40:58.509 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-04T01:40:58.516 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-client (14+238) ... 2023-11-04T01:40:58.551 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:40:58.642 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:40:59.166 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:40:59.167 INFO:teuthology.orchestra.run.smithi090.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-04T01:40:59.167 INFO:teuthology.orchestra.run.smithi090.stdout:which means they are currently configured by ifupdown: 2023-11-04T01:40:59.167 INFO:teuthology.orchestra.run.smithi090.stdout:- enp3s0f1 2023-11-04T01:40:59.167 INFO:teuthology.orchestra.run.smithi090.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-04T01:40:59.167 INFO:teuthology.orchestra.run.smithi090.stdout:remove their configuration from /etc/network/interfaces. 2023-11-04T01:40:59.167 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:40:59.290 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-04T01:40:59.625 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-04T01:40:59.859 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package postgresql. 2023-11-04T01:40:59.876 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-04T01:40:59.909 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking postgresql (14+238) ... 2023-11-04T01:40:59.980 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-04T01:41:00.136 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package postgresql-client. 2023-11-04T01:41:00.153 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-04T01:41:00.194 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking postgresql-client (14+238) ... 2023-11-04T01:41:00.565 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-04T01:41:00.593 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-04T01:41:00.631 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-04T01:41:00.829 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:41:00.909 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package tcl8.6. 2023-11-04T01:41:00.937 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-04T01:41:00.967 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:41:01.207 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:41:01.245 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package tcl. 2023-11-04T01:41:01.274 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-04T01:41:01.316 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-04T01:41:01.333 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-04T01:41:01.459 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-common (238) ... 2023-11-04T01:41:01.664 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package wpasupplicant. 2023-11-04T01:41:01.693 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-04T01:41:01.730 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:41:02.102 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-04T01:41:02.118 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-04T01:41:02.160 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-04T01:41:02.318 INFO:teuthology.orchestra.run.smithi090.stdout:Adding user postgres to group ssl-cert 2023-11-04T01:41:02.471 INFO:teuthology.orchestra.run.smithi002.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-04T01:41:02.500 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-04T01:41:02.538 INFO:teuthology.orchestra.run.smithi002.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:41:02.553 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:02.553 INFO:teuthology.orchestra.run.smithi090.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-04T01:41:02.830 INFO:teuthology.orchestra.run.smithi090.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-04T01:41:02.830 INFO:teuthology.orchestra.run.smithi090.stdout:Removing obsolete dictionary files: 2023-11-04T01:41:02.832 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up postgresql-client-common (238) ... 2023-11-04T01:41:03.044 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-04T01:41:03.170 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-04T01:41:03.296 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:41:03.421 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-04T01:41:03.426 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-04T01:41:03.547 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-04T01:41:03.673 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:41:03.846 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:41:04.167 INFO:teuthology.orchestra.run.smithi090.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-04T01:41:04.191 INFO:teuthology.orchestra.run.smithi090.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-04T01:41:04.223 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-04T01:41:04.301 INFO:teuthology.orchestra.run.smithi090.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-04T01:41:04.301 INFO:teuthology.orchestra.run.smithi090.stdout:This user must also own the server process. 2023-11-04T01:41:04.301 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:04.301 INFO:teuthology.orchestra.run.smithi090.stdout:The database cluster will be initialized with locale "en_US". 2023-11-04T01:41:04.301 INFO:teuthology.orchestra.run.smithi090.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-04T01:41:04.301 INFO:teuthology.orchestra.run.smithi090.stdout:The default text search configuration will be set to "english". 2023-11-04T01:41:04.302 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:04.302 INFO:teuthology.orchestra.run.smithi090.stdout:Data page checksums are disabled. 2023-11-04T01:41:04.302 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:04.302 INFO:teuthology.orchestra.run.smithi090.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-04T01:41:04.302 INFO:teuthology.orchestra.run.smithi090.stdout:creating subdirectories ... ok 2023-11-04T01:41:04.302 INFO:teuthology.orchestra.run.smithi090.stdout:selecting dynamic shared memory implementation ... posix 2023-11-04T01:41:04.312 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-04T01:41:04.318 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default max_connections ... 100 2023-11-04T01:41:04.338 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default shared_buffers ... 128MB 2023-11-04T01:41:04.348 INFO:teuthology.orchestra.run.smithi090.stdout:selecting default time zone ... Etc/UTC 2023-11-04T01:41:04.348 INFO:teuthology.orchestra.run.smithi090.stdout:creating configuration files ... ok 2023-11-04T01:41:04.461 INFO:teuthology.orchestra.run.smithi090.stdout:running bootstrap script ... ok 2023-11-04T01:41:04.762 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:41:04.763 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-04T01:41:05.118 INFO:teuthology.orchestra.run.smithi090.stdout:performing post-bootstrap initialization ... ok 2023-11-04T01:41:05.323 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-04T01:41:05.433 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-04T01:41:05.534 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-04T01:41:05.660 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-04T01:41:05.786 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-04T01:41:05.912 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-04T01:41:05.985 INFO:teuthology.orchestra.run.smithi090.stdout:syncing data to disk ... ok 2023-11-04T01:41:06.038 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-04T01:41:06.431 INFO:teuthology.orchestra.run.smithi090.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-04T01:41:06.651 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-04T01:41:06.777 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up dump (0.4b47-3) ... 2023-11-04T01:41:06.871 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-04T01:41:07.054 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:41:07.180 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-04T01:41:07.305 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-04T01:41:07.432 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-04T01:41:07.566 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-04T01:41:07.639 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-04T01:41:07.726 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-04T01:41:07.827 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-04T01:41:08.003 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-04T01:41:08.129 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:41:08.255 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-04T01:41:08.423 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up postgresql-client (14+238) ... 2023-11-04T01:41:08.549 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-04T01:41:09.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:09.020 INFO:teuthology.orchestra.run.smithi002.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-04T01:41:09.020 INFO:teuthology.orchestra.run.smithi002.stdout:which means they are currently configured by ifupdown: 2023-11-04T01:41:09.020 INFO:teuthology.orchestra.run.smithi002.stdout:- ens1f0 2023-11-04T01:41:09.020 INFO:teuthology.orchestra.run.smithi002.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-04T01:41:09.020 INFO:teuthology.orchestra.run.smithi002.stdout:remove their configuration from /etc/network/interfaces. 2023-11-04T01:41:09.020 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:09.163 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-04T01:41:09.472 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:41:09.521 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-04T01:41:09.598 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-04T01:41:09.724 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up postgresql (14+238) ... 2023-11-04T01:41:09.834 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:41:09.876 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-04T01:41:09.961 INFO:teuthology.orchestra.run.smithi090.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:41:10.217 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:41:10.217 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:41:10.452 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-04T01:41:10.611 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-04T01:41:10.813 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-04T01:41:10.988 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-04T01:41:11.165 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:41:11.264 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up postgresql-common (238) ... 2023-11-04T01:41:11.334 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:41:12.163 INFO:teuthology.orchestra.run.smithi002.stdout:Adding user postgres to group ssl-cert 2023-11-04T01:41:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:12.398 INFO:teuthology.orchestra.run.smithi002.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-04T01:41:12.589 INFO:teuthology.orchestra.run.smithi002.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-04T01:41:12.589 INFO:teuthology.orchestra.run.smithi002.stdout:Removing obsolete dictionary files: 2023-11-04T01:41:12.707 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-04T01:41:12.816 INFO:teuthology.orchestra.run.smithi090.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-04T01:41:13.180 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-04T01:41:13.560 INFO:teuthology.orchestra.run.smithi090.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:41:13.563 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:13.590 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-04T01:41:13.972 INFO:teuthology.orchestra.run.smithi002.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-04T01:41:13.993 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout:This user must also own the server process. 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout:The database cluster will be initialized with locale "en_US". 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout:The default text search configuration will be set to "english". 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout:Data page checksums are disabled. 2023-11-04T01:41:14.037 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:14.038 INFO:teuthology.orchestra.run.smithi002.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-04T01:41:14.038 INFO:teuthology.orchestra.run.smithi002.stdout:creating subdirectories ... ok 2023-11-04T01:41:14.038 INFO:teuthology.orchestra.run.smithi002.stdout:selecting dynamic shared memory implementation ... posix 2023-11-04T01:41:14.055 INFO:teuthology.orchestra.run.smithi002.stdout:selecting default max_connections ... 100 2023-11-04T01:41:14.076 INFO:teuthology.orchestra.run.smithi002.stdout:selecting default shared_buffers ... 128MB 2023-11-04T01:41:14.090 INFO:teuthology.orchestra.run.smithi002.stdout:selecting default time zone ... Etc/UTC 2023-11-04T01:41:14.091 INFO:teuthology.orchestra.run.smithi002.stdout:creating configuration files ... ok 2023-11-04T01:41:14.212 INFO:teuthology.orchestra.run.smithi002.stdout:running bootstrap script ... ok 2023-11-04T01:41:14.861 INFO:teuthology.orchestra.run.smithi002.stdout:performing post-bootstrap initialization ... ok 2023-11-04T01:41:15.468 INFO:teuthology.orchestra.run.smithi002.stdout:syncing data to disk ... ok 2023-11-04T01:41:15.900 INFO:teuthology.orchestra.run.smithi002.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-04T01:41:18.830 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:41:18.956 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-04T01:41:19.082 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up postgresql (14+238) ... 2023-11-04T01:41:19.208 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-04T01:41:19.351 INFO:teuthology.orchestra.run.smithi002.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-04T01:41:19.637 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:41:19.638 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-04T01:41:20.212 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-04T01:41:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-04T01:41:20.674 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-04T01:41:22.060 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-04T01:41:22.493 INFO:teuthology.orchestra.run.smithi002.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-04T01:41:23.126 INFO:teuthology.orchestra.run.smithi002.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-04T01:41:23.127 DEBUG:teuthology.parallel:result is None 2023-11-04T01:41:23.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:41:23.341 DEBUG:teuthology.orchestra.run.smithi002:> dpkg-query -W -f '${Version}' ceph 2023-11-04T01:41:23.361 INFO:teuthology.orchestra.run.smithi002.stdout:18.0.0-7035-g7532011a-1jammy 2023-11-04T01:41:23.362 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:41:23.362 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035-g7532011a-1jammy is installed. 2023-11-04T01:41:23.362 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4 2023-11-04T01:41:23.586 DEBUG:teuthology.orchestra.run.smithi090:> dpkg-query -W -f '${Version}' ceph 2023-11-04T01:41:23.606 INFO:teuthology.orchestra.run.smithi090.stdout:18.0.0-7035-g7532011a-1jammy 2023-11-04T01:41:23.606 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7035-g7532011a-1jammy 2023-11-04T01:41:23.606 INFO:teuthology.task.install:The correct ceph version 18.0.0-7035-g7532011a-1jammy is installed. 2023-11-04T01:41:23.607 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-04T01:41:23.607 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:23.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:41:23.621 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:23.622 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-04T01:41:23.661 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-04T01:41:23.661 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:23.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:41:23.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:41:23.732 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:23.732 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2023-11-04T01:41:23.745 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-04T01:41:23.800 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-04T01:41:23.800 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:23.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:41:23.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:41:23.868 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:23.868 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-04T01:41:23.881 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-04T01:41:23.935 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-04T01:41:23.936 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:23.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:41:23.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:41:24.004 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:24.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2023-11-04T01:41:24.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-04T01:41:24.071 INFO:teuthology.run_tasks:Running task ceph... 2023-11-04T01:41:24.138 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-04T01:41:24.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2023-11-04T01:41:24.140 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2023-11-04T01:41:24.154 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-04T01:41:24.154 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:41:24.198 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-04T01:41:24.210 INFO:tasks.ceph:Creating extra log directories... 2023-11-04T01:41:24.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:41:24.254 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-04T01:41:24.274 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-04T01:41:24.274 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-04T01:41:24.274 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-04T01:41:24.274 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:24.274 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:41:24.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:24.392 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:24.393 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-04T01:41:24.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:24.479 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-04T01:41:24.479 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-04T01:41:24.479 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7445922', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231103.180916', 'sha1': '702f9e6492477037e018f68dfdf636a30c24f329'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7192, 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-batrick-testing-20231103.180916', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '702f9e6492477037e018f68dfdf636a30c24f329', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOD0jW6E3I+clddOmIj07v/rlwclmd5mvPtTmVtQlTOPepyoKz8yD1/es570Vm9uYYDvuuRT9W5qhw05GGFbgGs=', 'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJXX70ohOtHXVLtKw4roiKmJIEL1kDj6tbpju/9xVCAKESxMwgNBG57aBnKloHwb3zFrz06nxHez4jsZMRFjt5c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'RECENT_CRASH'], 'sha1': '7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'exec': {'mon.a': ['ceph config set mgr mgr/crash/warn_recent_interval 0']}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_snapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-03_18:12:33', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3084822'} 2023-11-04T01:41:24.480 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:41:24.482 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-04T01:41:24.521 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:41:24.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2023-11-04T01:41:24.576 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:24.576 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:41:24.589 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:41:24.589 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2023-11-04T01:41:24.637 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:41:24.637 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:24.637 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 891 Links: 1 2023-11-04T01:41:24.637 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:24.637 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-04 01:34:56.642489325 +0000 2023-11-04T01:41:24.637 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-04 01:34:55.618498429 +0000 2023-11-04T01:41:24.637 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-04 01:34:55.618498429 +0000 2023-11-04T01:41:24.638 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-04T01:41:24.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:41:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-04T01:41:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-04T01:41:24.691 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000263251 s, 1.9 MB/s 2023-11-04T01:41:24.693 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:41:24.743 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2023-11-04T01:41:24.793 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:41:24.793 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:24.793 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 908 Links: 1 2023-11-04T01:41:24.793 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:24.794 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-04 01:34:57.670480187 +0000 2023-11-04T01:41:24.794 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-04 01:34:56.870487299 +0000 2023-11-04T01:41:24.794 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-04 01:34:56.870487299 +0000 2023-11-04T01:41:24.794 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-04T01:41:24.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:41:24.851 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-04T01:41:24.852 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-04T01:41:24.852 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000312608 s, 1.6 MB/s 2023-11-04T01:41:24.853 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:41:24.902 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2023-11-04T01:41:24.949 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:41:24.949 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:24.949 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-11-04T01:41:24.949 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:24.949 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-04 01:34:57.890478232 +0000 2023-11-04T01:41:24.949 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-04 01:34:57.886478268 +0000 2023-11-04T01:41:24.949 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-04 01:34:57.886478268 +0000 2023-11-04T01:41:24.950 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-04T01:41:24.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:41:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-04T01:41:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-04T01:41:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000291108 s, 1.8 MB/s 2023-11-04T01:41:25.004 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:41:25.054 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2023-11-04T01:41:25.100 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:41:25.101 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:25.101 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-11-04T01:41:25.101 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:25.101 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-04 01:34:59.358465182 +0000 2023-11-04T01:41:25.101 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-04 01:34:58.738470693 +0000 2023-11-04T01:41:25.101 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-04 01:34:58.738470693 +0000 2023-11-04T01:41:25.101 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: - 2023-11-04T01:41:25.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:41:25.155 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-04T01:41:25.155 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-04T01:41:25.155 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000290218 s, 1.8 MB/s 2023-11-04T01:41:25.156 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:41:25.206 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:25.206 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:25.206 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2023-11-04T01:41:25.212 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-04T01:41:25.213 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2023-11-04T01:41:25.260 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-04T01:41:25.261 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:25.261 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 884 Links: 1 2023-11-04T01:41:25.261 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:25.261 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-11-04 01:35:00.550031006 +0000 2023-11-04T01:41:25.261 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-11-04 01:34:59.894036866 +0000 2023-11-04T01:41:25.261 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-11-04 01:34:59.894036866 +0000 2023-11-04T01:41:25.261 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-11-04T01:41:25.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-04T01:41:25.315 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-11-04T01:41:25.315 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-11-04T01:41:25.315 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000397058 s, 1.3 MB/s 2023-11-04T01:41:25.316 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-04T01:41:25.367 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2023-11-04T01:41:25.412 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-04T01:41:25.413 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:25.413 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-11-04T01:41:25.413 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:25.413 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-11-04 01:35:01.470022789 +0000 2023-11-04T01:41:25.413 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-11-04 01:35:00.770029041 +0000 2023-11-04T01:41:25.413 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-11-04 01:35:00.770029041 +0000 2023-11-04T01:41:25.413 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-11-04T01:41:25.413 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-04T01:41:25.466 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-11-04T01:41:25.467 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-11-04T01:41:25.467 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000423656 s, 1.2 MB/s 2023-11-04T01:41:25.468 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-04T01:41:25.517 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2023-11-04T01:41:25.564 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-04T01:41:25.565 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:25.565 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-11-04T01:41:25.565 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:25.565 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-11-04 01:35:02.358014856 +0000 2023-11-04T01:41:25.565 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-11-04 01:35:01.698020752 +0000 2023-11-04T01:41:25.565 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-11-04 01:35:01.698020752 +0000 2023-11-04T01:41:25.565 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-11-04T01:41:25.565 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-04T01:41:25.619 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-11-04T01:41:25.619 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-11-04T01:41:25.619 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000432534 s, 1.2 MB/s 2023-11-04T01:41:25.620 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-04T01:41:25.670 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2023-11-04T01:41:25.716 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-04T01:41:25.717 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-04T01:41:25.717 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 940 Links: 1 2023-11-04T01:41:25.717 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-04T01:41:25.717 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2023-11-04 01:35:03.238006996 +0000 2023-11-04T01:41:25.717 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2023-11-04 01:35:02.574012927 +0000 2023-11-04T01:41:25.717 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2023-11-04 01:35:02.574012927 +0000 2023-11-04T01:41:25.717 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: - 2023-11-04T01:41:25.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-04T01:41:25.770 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2023-11-04T01:41:25.770 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2023-11-04T01:41:25.771 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000408726 s, 1.3 MB/s 2023-11-04T01:41:25.771 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-04T01:41:25.822 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:25.822 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:41:25.822 INFO:tasks.ceph:Generating config... 2023-11-04T01:41:25.824 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-04T01:41:25.824 INFO:tasks.ceph:[client] debug client = 20 2023-11-04T01:41:25.824 INFO:tasks.ceph:[client] debug ms = 1 2023-11-04T01:41:25.824 INFO:tasks.ceph:[client] pid file = 2023-11-04T01:41:25.824 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-04T01:41:25.824 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-04T01:41:25.825 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-04T01:41:25.825 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-04T01:41:25.825 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-04T01:41:25.825 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-04T01:41:25.825 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-04T01:41:25.825 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-04T01:41:25.825 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-04T01:41:25.826 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-04T01:41:25.826 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-04T01:41:25.826 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:25.827 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-04T01:41:25.828 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-04T01:41:25.828 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-04T01:41:25.828 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-04T01:41:25.828 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-04T01:41:25.828 INFO:tasks.ceph:Setting up mon.a... 2023-11-04T01:41:25.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-04T01:41:25.864 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2023-11-04T01:41:25.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-04T01:41:25.972 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:41:26.028 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.90'), ('mon.c', '[v2:172.21.15.90:3301,v1:172.21.15.90:6790]')] 2023-11-04T01:41:26.029 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-04T01:41:26.029 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:26.030 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:41:26.077 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.90 --addv c '[v2:172.21.15.90:3301,v1:172.21.15.90:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:26.162 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:26.162 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid 5d11bb68-eb80-4957-a295-0326089fcc10 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = pacific 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 5d11bb68-eb80-4957-a295-0326089fcc10 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2023-11-04T01:41:26.165335+0000 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-11-04T01:41:26.165335+0000 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 16 (pacific) 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.b 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] mon.c 2023-11-04T01:41:26.163 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-04T01:41:26.165 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-04T01:41:26.212 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5d11bb68-eb80-4957-a295-0326089fcc10... 2023-11-04T01:41:26.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:26.258 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:41:26.286 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2023-11-04T01:41:26.286 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2023-11-04T01:41:26.287 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2023-11-04T01:41:26.288 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.289 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 5d11bb68-eb80-4957-a295-0326089fcc10 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2023-11-04T01:41:26.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2023-11-04T01:41:26.291 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.292 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2023-11-04T01:41:26.293 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-04T01:41:26.294 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2023-11-04T01:41:26.295 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:26.296 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:26.297 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2023-11-04T01:41:26.298 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-04T01:41:26.299 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2023-11-04T01:41:26.301 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:41:26.302 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2023-11-04T01:41:26.303 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.2,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 5d11bb68-eb80-4957-a295-0326089fcc10 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.304 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2023-11-04T01:41:26.305 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2023-11-04T01:41:26.306 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2023-11-04T01:41:26.307 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2023-11-04T01:41:26.308 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2023-11-04T01:41:26.309 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.310 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:41:26.311 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2023-11-04T01:41:26.312 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2023-11-04T01:41:26.313 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds balancer = 20 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2023-11-04T01:41:26.314 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2023-11-04T01:41:26.314 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-04T01:41:26.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-04T01:41:26.388 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-04T01:41:26.388 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:26.388 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-04T01:41:26.394 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:26.394 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-04T01:41:26.444 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:41:26.444 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:26.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:41:26.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:41:26.508 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:26.508 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:26.556 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:41:26.556 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:26.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-04T01:41:26.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-04T01:41:26.580 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:26.580 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:26.629 INFO:tasks.ceph:Setting up mon nodes... 2023-11-04T01:41:26.629 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-04T01:41:26.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:41:26.675 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-04T01:41:26.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:41:26.720 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-04T01:41:26.761 INFO:tasks.ceph:Setting up mds nodes... 2023-11-04T01:41:26.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:41:26.806 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-04T01:41:26.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-04T01:41:26.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:41:26.950 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-04T01:41:26.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-04T01:41:27.014 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:41:27.058 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-04T01:41:27.062 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-04T01:41:27.117 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:41:27.200 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-04T01:41:27.203 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-04T01:41:27.256 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-04T01:41:27.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-04T01:41:27.294 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-04T01:41:27.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-04T01:41:27.382 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-04T01:41:27.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-04T01:41:27.429 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-04T01:41:27.442 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-04T01:41:27.516 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-04T01:41:27.526 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-04T01:41:27.526 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-04T01:41:27.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-04T01:41:27.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:27.541 INFO:tasks.ceph:role: osd.0 2023-11-04T01:41:27.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:41:27.541 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:41:27.599 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:27.599 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:27.599 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:27.599 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:27.600 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:27.600 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:27.600 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:27.600 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:27.600 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:27.600 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:27.623 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-04T01:41:27.625 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-04T01:41:27.625 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-04T01:41:27.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-04T01:41:27.740 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:27.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:27.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-04T01:41:27.794 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:27.794 INFO:tasks.ceph:role: osd.1 2023-11-04T01:41:27.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:41:27.794 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:27.852 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:27.853 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:27.876 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-04T01:41:27.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-04T01:41:27.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-04T01:41:27.942 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-04T01:41:27.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:27.998 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:27.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-04T01:41:28.050 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:28.050 INFO:tasks.ceph:role: osd.2 2023-11-04T01:41:28.050 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:41:28.051 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:41:28.105 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:28.105 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:28.105 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:28.105 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:28.105 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:28.106 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:28.106 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:28.106 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:28.106 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:28.106 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:28.128 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-04T01:41:28.130 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-04T01:41:28.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-04T01:41:28.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-04T01:41:28.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:28.248 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:28.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-04T01:41:28.303 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:28.303 INFO:tasks.ceph:role: osd.3 2023-11-04T01:41:28.303 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:41:28.304 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:28.356 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:28.357 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:28.357 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:28.380 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-04T01:41:28.382 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-04T01:41:28.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-04T01:41:28.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-04T01:41:28.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:28.498 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:28.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:28.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:28.607+0000 7f517f1c0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-04T01:41:28.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:28.607+0000 7f517f1c0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-04T01:41:28.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:28.607+0000 7f517f1c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:41:28.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:28.607+0000 7f517f1c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:41:28.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:28.607+0000 7f517f1c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-04T01:41:28.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:28.607+0000 7f517f1c0640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-04T01:41:31.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-04T01:41:31.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:31.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:31.707+0000 7fe5aa987640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-04T01:41:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:31.707+0000 7fe5aa987640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-04T01:41:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:31.707+0000 7fe5aa987640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:41:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:31.707+0000 7fe5aa987640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:41:31.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:31.707+0000 7fe5aa987640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-04T01:41:31.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:31.707+0000 7fe5aa987640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-04T01:41:34.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-04T01:41:34.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:34.851+0000 7ff117214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-04T01:41:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:34.851+0000 7ff117214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-04T01:41:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:34.851+0000 7ff117214640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:41:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:34.851+0000 7ff117214640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:41:34.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:34.851+0000 7ff117214640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-04T01:41:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:34.851+0000 7ff117214640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-04T01:41:37.848 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-04T01:41:37.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:37.991+0000 7f4173821640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-04T01:41:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:37.991+0000 7f4173821640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-04T01:41:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:37.991+0000 7f4173821640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:41:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:37.991+0000 7f4173821640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:41:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:37.991+0000 7f4173821640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-04T01:41:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:37.991+0000 7f4173821640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-04T01:41:40.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-04T01:41:41.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-04T01:41:41.064 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:41.064 INFO:tasks.ceph:role: osd.4 2023-11-04T01:41:41.064 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:41:41.065 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-04T01:41:41.127 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:41.127 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:41.127 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:41.128 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:41.128 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:41.128 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:41.128 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:41.128 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:41.128 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:41.128 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:41.616 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2023-11-04T01:41:41.618 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-11-04T01:41:41.618 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-04T01:41:41.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-04T01:41:41.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:41.784 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:41.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-04T01:41:41.843 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:41.844 INFO:tasks.ceph:role: osd.5 2023-11-04T01:41:41.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:41:41.844 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-04T01:41:41.917 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:41.917 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:41.917 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:41.917 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:41.917 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:41.917 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:41.917 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:41.918 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:41.918 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:41.918 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:42.363 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2023-11-04T01:41:42.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-11-04T01:41:42.366 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-04T01:41:42.441 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-04T01:41:42.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:42.493 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:42.493 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-04T01:41:42.548 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:42.548 INFO:tasks.ceph:role: osd.6 2023-11-04T01:41:42.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:41:42.548 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-04T01:41:42.611 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:42.611 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:42.612 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:43.074 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2023-11-04T01:41:43.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-11-04T01:41:43.075 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-04T01:41:43.215 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-04T01:41:43.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:43.226 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:43.226 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-04T01:41:43.280 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-04T01:41:43.280 INFO:tasks.ceph:role: osd.7 2023-11-04T01:41:43.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:41:43.280 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-04T01:41:43.348 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-04T01:41:43.348 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-04T01:41:43.348 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-04T01:41:43.348 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-04T01:41:43.348 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-04T01:41:43.349 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2023-11-04T01:41:43.349 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-04T01:41:43.349 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-04T01:41:43.349 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-04T01:41:43.349 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-04T01:41:43.848 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2023-11-04T01:41:43.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2023-11-04T01:41:43.850 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-04T01:41:44.006 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-04T01:41:44.017 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: /sbin/restorecon: command not found 2023-11-04T01:41:44.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:41:44.018 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:44.139 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:44.134+0000 7f25dfa92640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:44.138+0000 7f25dfa92640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:44.138+0000 7f25dfa92640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:44.138+0000 7f25dfa92640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:41:44.143 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:44.138+0000 7f25dfa92640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-04T01:41:44.144 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:44.142+0000 7f25dfa92640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-04T01:41:47.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-04T01:41:47.198 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:47.278 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:47.274+0000 7ff57fbd6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-04T01:41:47.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:47.274+0000 7ff57fbd6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-04T01:41:47.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:47.274+0000 7ff57fbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:41:47.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:47.274+0000 7ff57fbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:41:47.279 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:47.274+0000 7ff57fbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-04T01:41:47.280 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:47.278+0000 7ff57fbd6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-04T01:41:50.283 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-04T01:41:50.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:50.418 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:50.414+0000 7fdb764ce640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:50.414+0000 7fdb764ce640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:50.414+0000 7fdb764ce640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:41:50.419 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:50.414+0000 7fdb764ce640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:41:50.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:50.414+0000 7fdb764ce640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-04T01:41:50.420 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:50.418+0000 7fdb764ce640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-04T01:41:53.427 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-04T01:41:53.488 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:53.571 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:53.566+0000 7f59db8b9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-04T01:41:53.572 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:53.570+0000 7f59db8b9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-04T01:41:53.572 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:53.570+0000 7f59db8b9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:41:53.572 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:53.570+0000 7f59db8b9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:41:53.572 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:53.570+0000 7f59db8b9640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-04T01:41:53.572 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:41:53.570+0000 7f59db8b9640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-04T01:41:54.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:54.483 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:41:56.576 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-04T01:41:56.590 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-04T01:41:56.590 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:56.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-04T01:41:56.605 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:56.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-04T01:41:56.660 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:56.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-04T01:41:56.716 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:56.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-04T01:41:56.772 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:56.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-04T01:41:56.827 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:56.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-04T01:41:56.884 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:56.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-04T01:41:56.939 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:56.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-04T01:41:56.952 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:56.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-04T01:41:57.006 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:57.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-04T01:41:57.059 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:57.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-04T01:41:57.110 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:57.110 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-04T01:41:57.167 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:57.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-04T01:41:57.223 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:57.223 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-04T01:41:57.279 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:57.279 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-04T01:41:57.284 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:57.285 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-04T01:41:57.332 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:57.332 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-04T01:41:57.338 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:41:57.338 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-04T01:41:57.384 INFO:tasks.ceph:Adding keys to all mons... 2023-11-04T01:41:57.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:41:57.386 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-04T01:41:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2023-11-04T01:41:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBGoUVlhYtpKBAAn1snUSz1+SKC8frnVuvFdA== 2023-11-04T01:41:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2023-11-04T01:41:57.430 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBGoUVlnFZCMBAAsgGcwY3jbh9F9NEVwbamwg== 2023-11-04T01:41:57.430 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBGoUVlFSvMOBAA0k4I7A+4TRIrxBOwUdIZLw== 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBIoUVlnpFvJBAAAyqa0u7D+cz+Gy4XpppWYQ== 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBLoUVlObtjKhAAbf3wgZ9mpp8+pI1IGyIwdg== 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBOoUVlOF4QMxAANdCz1HMyMGzyFpUv9xawYA== 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBRoUVlMnFiOxAA2d7ZoQEhtXkAMhu0yPh4iw== 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBGoUVlcZ/jKhAAWDrmzYgapIV+SBRNrXWAjg== 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2023-11-04T01:41:57.431 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVlDZRuAxAA6zx8mu5wQEvvcICXPTXZZQ== 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVl/PDbCxAA+6y8He/9gQZa1vvdJH+iCg== 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBYoUVlfe9FCBAA3oVMNubThpWJoxlqFzaAfg== 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBboUVlTfGNEBAA2FNXiCKGJ2s4XeH+paqrNw== 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBeoUVluX7oGBAAh+/toMBPGjq99EonfWEPtQ== 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBhoUVlGhEAIhAAO8mqoIPekhVmAxnR1VKXeQ== 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ== 2023-11-04T01:41:57.432 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2023-11-04T01:41:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVlPzfyFhAAbCRYmyHHFu2GDtyZOL2ISw== 2023-11-04T01:41:57.433 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2023-11-04T01:41:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVlDtmNGRAAFXXp/X0fnL9uuEIfj1Eadw== 2023-11-04T01:41:57.433 INFO:teuthology.orchestra.run.smithi002.stdout:[client.3] 2023-11-04T01:41:57.433 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVl1jK2HhAAH1E38zcrKticBLLRR/8IuA== 2023-11-04T01:41:57.437 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBGoUVlhYtpKBAAn1snUSz1+SKC8frnVuvFdA== 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBGoUVlnFZCMBAAsgGcwY3jbh9F9NEVwbamwg== 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBGoUVlFSvMOBAA0k4I7A+4TRIrxBOwUdIZLw== 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBIoUVlnpFvJBAAAyqa0u7D+cz+Gy4XpppWYQ== 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBLoUVlObtjKhAAbf3wgZ9mpp8+pI1IGyIwdg== 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBOoUVlOF4QMxAANdCz1HMyMGzyFpUv9xawYA== 2023-11-04T01:41:57.438 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBRoUVlMnFiOxAA2d7ZoQEhtXkAMhu0yPh4iw== 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBGoUVlcZ/jKhAAWDrmzYgapIV+SBRNrXWAjg== 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBHoUVlDZRuAxAA6zx8mu5wQEvvcICXPTXZZQ== 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBHoUVl/PDbCxAA+6y8He/9gQZa1vvdJH+iCg== 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBYoUVlfe9FCBAA3oVMNubThpWJoxlqFzaAfg== 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBboUVlTfGNEBAA2FNXiCKGJ2s4XeH+paqrNw== 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2023-11-04T01:41:57.439 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBeoUVluX7oGBAAh+/toMBPGjq99EonfWEPtQ== 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBhoUVlGhEAIhAAO8mqoIPekhVmAxnR1VKXeQ== 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ== 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout:[client.2] 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBHoUVlPzfyFhAAbCRYmyHHFu2GDtyZOL2ISw== 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout:[client.1] 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBHoUVlDtmNGRAAFXXp/X0fnL9uuEIfj1Eadw== 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout:[client.3] 2023-11-04T01:41:57.440 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQBHoUVl1jK2HhAAH1E38zcrKticBLLRR/8IuA== 2023-11-04T01:41:57.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:41:57.477 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:41:57.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:57.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:57.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:57.622 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:57.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.667 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.749 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.837 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.917 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:57.995 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:41:58.005 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-04T01:41:58.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:58.093 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:58.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:58.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-04T01:41:58.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.261 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.501 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-04T01:41:58.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.581 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.639 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.665 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.722 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.845 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-04T01:41:58.891 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-04T01:41:58.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-04T01:41:58.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:41:59.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-04T01:41:59.045 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-04T01:41:59.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:41:59.162 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-04T01:41:59.173 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-04T01:41:59.225 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-04T01:41:59.324 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-04T01:41:59.334 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:59.337 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-04T01:41:59.379 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-04T01:41:59.380 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-04T01:41:59.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-04T01:41:59.385 INFO:tasks.ceph.mon.a:Started 2023-11-04T01:41:59.385 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-04T01:41:59.385 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-04T01:41:59.425 INFO:tasks.ceph.mon.b:Started 2023-11-04T01:41:59.425 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-04T01:41:59.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-04T01:41:59.428 INFO:tasks.ceph.mon.c:Started 2023-11-04T01:41:59.428 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-04T01:41:59.428 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-04T01:41:59.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-04T01:41:59.431 INFO:tasks.ceph.mgr.y:Started 2023-11-04T01:41:59.431 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-04T01:41:59.431 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-04T01:41:59.433 INFO:tasks.ceph.mgr.x:Started 2023-11-04T01:41:59.434 INFO:tasks.ceph:Setting crush tunables to default 2023-11-04T01:41:59.434 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2023-11-04T01:41:59.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bda06c640 1 Processor -- start 2023-11-04T01:41:59.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bda06c640 1 -- start start 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bda06c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bda06c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bda06c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd40cd830 con 0x7f8bd415af50 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bda06c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd40b3780 con 0x7f8bd40cf4c0 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bda06c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40cdad0 con 0x7f8bd40b32f0 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8bd415af50 0x7f8bd40ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40414/0 (socket says 172.21.15.2:40414) 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd37fe640 1 -- 172.21.15.2:0/184211704 learned_addr learned my addr 172.21.15.2:0/184211704 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd3fff640 1 -- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 msgr2=0x7f8bd40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd3fff640 1 -- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 msgr2=0x7f8bd40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd3fff640 1 --2- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd3fff640 1 --2- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 msgr2=0x7f8bd40cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 msgr2=0x7f8bd40cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:41:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.550+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:41:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd3fff640 1 --2- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd3fff640 1 -- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 msgr2=0x7f8bd40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-04T01:41:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd3fff640 1 -- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 msgr2=0x7f8bd40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:41:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd3fff640 1 --2- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:41:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd3fff640 1 --2- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:41:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 msgr2=0x7f8bd40cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-04T01:41:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 msgr2=0x7f8bd40cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-04T01:41:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-04T01:41:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.754+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:41:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220780371 0 0) 0x7f8bd40cd830 con 0x7f8bd415af50 2023-11-04T01:41:59.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bc0003530 con 0x7f8bd415af50 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1968003453 0 0) 0x7f8bc0003530 con 0x7f8bd415af50 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 msgr2=0x7f8bd40cb330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40b32f0 0x7f8bd40cb330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 msgr2=0x7f8bd40d0610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 --2- 172.21.15.2:0/184211704 >> v2:172.21.15.2:3300/0 conn(0x7f8bd40cf4c0 0x7f8bd40d0610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd40cddb0 con 0x7f8bd415af50 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f8bcc001800 con 0x7f8bd415af50 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 >> v1:172.21.15.2:6789/0 conn(0x7f8bd415af50 legacy=0x7f8bd40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc0003980 0x7f8bc0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bc0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc0005190 0x7f8bc000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40b3780 con 0x7f8bc00047d0 2023-11-04T01:41:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40cdad0 con 0x7f8bc0003980 2023-11-04T01:41:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc000bf00 con 0x7f8bc0005190 2023-11-04T01:41:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bc0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd37fe640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc0003980 0x7f8bc0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.838+0000 7f8bd3fff640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc0005190 0x7f8bc000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.842+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc0005190 msgr2=0x7f8bc000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.842+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bc0005190 0x7f8bc000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.842+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc0003980 msgr2=0x7f8bc0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:41:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.842+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bc0003980 0x7f8bc0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.842+0000 7f8bd2ffd640 1 -- 172.21.15.2:0/184211704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0003530 con 0x7f8bc00047d0 2023-11-04T01:41:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.846+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bc0004c50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00e8d0 tx=0x7f8bbc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1e7b416de5ebd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.846+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0a5750 con 0x7f8bc00047d0 2023-11-04T01:41:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.846+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0a9070 con 0x7f8bc00047d0 2023-11-04T01:41:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.846+0000 7f8bd27fc640 1 -- 172.21.15.2:0/184211704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0a5af0 con 0x7f8bc00047d0 2023-11-04T01:41:59.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.846+0000 7f8bda06c640 1 -- 172.21.15.2:0/184211704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 msgr2=0x7f8bc0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.846+0000 7f8bda06c640 1 --2- 172.21.15.2:0/184211704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bc0004c50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00e8d0 tx=0x7f8bbc01c850 comp rx=0 tx=0).stop 2023-11-04T01:41:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.846+0000 7f8bd3fff640 1 -- 172.21.15.2:0/184211704 reap_dead start 2023-11-04T01:41:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.850+0000 7f8bda06c640 1 -- 172.21.15.2:0/184211704 shutdown_connections 2023-11-04T01:41:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.850+0000 7f8bda06c640 1 -- 172.21.15.2:0/184211704 >> 172.21.15.2:0/184211704 conn(0x7f8bd4065dc0 msgr2=0x7f8bd40661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.850+0000 7f8bda06c640 1 -- 172.21.15.2:0/184211704 shutdown_connections 2023-11-04T01:41:59.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.850+0000 7f8bda06c640 1 -- 172.21.15.2:0/184211704 wait complete. 2023-11-04T01:41:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.850+0000 7f8bda06c640 1 Processor -- start 2023-11-04T01:41:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.850+0000 7f8bda06c640 1 -- start start 2023-11-04T01:41:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bd415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bd4150af0 0x7f8bd40ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40ca9b0 0x7f8bd40b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:41:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd40c81c0 con 0x7f8bc00047d0 2023-11-04T01:41:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd41f3430 con 0x7f8bd4150af0 2023-11-04T01:41:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4150f70 con 0x7f8bd40ca9b0 2023-11-04T01:41:59.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bd415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bd415cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47128/0 (socket says 172.21.15.2:47128) 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 -- 172.21.15.2:0/668717541 learned_addr learned my addr 172.21.15.2:0/668717541 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bd4150af0 0x7f8bd40ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd3fff640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40ca9b0 0x7f8bd40b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 -- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40ca9b0 msgr2=0x7f8bd40b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40ca9b0 0x7f8bd40b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 -- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bd4150af0 msgr2=0x7f8bd40ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bd4150af0 0x7f8bd40ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 -- 172.21.15.2:0/668717541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4155a30 con 0x7f8bc00047d0 2023-11-04T01:41:59.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd2ffd640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bd4150af0 0x7f8bd40ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bd37fe640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bd415cad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00f850 tx=0x7f8bcc00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bcbfff640 1 -- 172.21.15.2:0/668717541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0072e0 con 0x7f8bc00047d0 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bcbfff640 1 -- 172.21.15.2:0/668717541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc007460 con 0x7f8bc00047d0 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4155470 con 0x7f8bc00047d0 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bcbfff640 1 -- 172.21.15.2:0/668717541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0057b0 con 0x7f8bc00047d0 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd40c7e50 con 0x7f8bc00047d0 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bcbfff640 1 -- 172.21.15.2:0/668717541 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8bcc005c10 con 0x7f8bc00047d0 2023-11-04T01:41:59.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.854+0000 7f8bcbfff640 1 -- 172.21.15.2:0/668717541 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8bcc01d4a0 con 0x7f8bc00047d0 2023-11-04T01:41:59.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.858+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd40675f0 con 0x7f8bc00047d0 2023-11-04T01:41:59.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.866+0000 7f8bcbfff640 1 -- 172.21.15.2:0/668717541 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8bcc00d730 con 0x7f8bc00047d0 2023-11-04T01:41:59.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.930+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8bd40d1a50 con 0x7f8bc00047d0 2023-11-04T01:41:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bcbfff640 1 -- 172.21.15.2:0/668717541 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8bcc00d8d0 con 0x7f8bc00047d0 2023-11-04T01:41:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 msgr2=0x7f8bd415cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bd415cad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00f850 tx=0x7f8bcc00fd10 comp rx=0 tx=0).stop 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 shutdown_connections 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bd40ca9b0 0x7f8bd40b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bd4150af0 0x7f8bd40ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 --2- 172.21.15.2:0/668717541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bc00047d0 0x7f8bd415cad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 >> 172.21.15.2:0/668717541 conn(0x7f8bd4065dc0 msgr2=0x7f8bd40661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 shutdown_connections 2023-11-04T01:41:59.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:41:59.934+0000 7f8bda06c640 1 -- 172.21.15.2:0/668717541 wait complete. 2023-11-04T01:41:59.952 INFO:tasks.ceph:check_enable_crimson: False 2023-11-04T01:41:59.952 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-04T01:41:59.953 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:59.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-04T01:41:59.962 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:41:59.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-04T01:42:00.015 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:42:00.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-04T01:42:00.067 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:42:00.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-04T01:42:00.093 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:00.090+0000 7fdca1d56180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:42:00.119 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:42:00.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-04T01:42:00.133 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:42:00.133 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-04T01:42:00.186 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:42:00.186 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-04T01:42:00.238 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:42:00.238 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-04T01:42:00.291 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 4b98eb46-0787-4344-9794-6296461471f3 0 2023-11-04T01:42:00.343 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:00.342+0000 7f9d401d0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-04T01:42:00.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.454+0000 7fdefee54640 1 Processor -- start 2023-11-04T01:42:00.458 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.454+0000 7fdefee54640 1 -- start start 2023-11-04T01:42:00.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.454+0000 7fdefee54640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef806de30 0x7fdef80719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80cdb70 con 0x7fdef8159f00 2023-11-04T01:42:00.459 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef80cde50 con 0x7fdef8071250 2023-11-04T01:42:00.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef815a2e0 con 0x7fdef806de30 2023-11-04T01:42:00.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefd3f1640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fdef8071250 0x7fdef80ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:45506/0 (socket says 172.21.15.90:45506) 2023-11-04T01:42:00.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefd3f1640 1 -- 172.21.15.90:0/175478038 learned_addr learned my addr 172.21.15.90:0/175478038 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-11-04T01:42:00.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef7fff640 1 --2- 172.21.15.90:0/175478038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef806de30 0x7fdef80719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.460 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef77fe640 1 -- 172.21.15.90:0/175478038 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185472090 0 0) 0x7fdef80cde50 con 0x7fdef8071250 2023-11-04T01:42:00.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef77fe640 1 -- 172.21.15.90:0/175478038 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee0003530 con 0x7fdef8071250 2023-11-04T01:42:00.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef7fff640 1 -- 172.21.15.90:0/175478038 >> v1:172.21.15.90:6789/0 conn(0x7fdef8071250 legacy=0x7fdef80ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef7fff640 1 -- 172.21.15.90:0/175478038 >> v1:172.21.15.2:6789/0 conn(0x7fdef8159f00 legacy=0x7fdef8070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.461 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef7fff640 1 -- 172.21.15.90:0/175478038 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef815e4f0 con 0x7fdef806de30 2023-11-04T01:42:00.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef7fff640 1 --2- 172.21.15.90:0/175478038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef806de30 0x7fdef80719e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0097f0 tx=0x7fdeec01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16f0b996d08e43d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:00.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef77fe640 1 -- 172.21.15.90:0/175478038 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0ad660 con 0x7fdef806de30 2023-11-04T01:42:00.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef77fe640 1 -- 172.21.15.90:0/175478038 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec0ad7c0 con 0x7fdef806de30 2023-11-04T01:42:00.462 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdef77fe640 1 -- 172.21.15.90:0/175478038 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0adb50 con 0x7fdef806de30 2023-11-04T01:42:00.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- 172.21.15.90:0/175478038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef806de30 msgr2=0x7fdef80719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 --2- 172.21.15.90:0/175478038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef806de30 0x7fdef80719e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0097f0 tx=0x7fdeec01c400 comp rx=0 tx=0).stop 2023-11-04T01:42:00.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- 172.21.15.90:0/175478038 shutdown_connections 2023-11-04T01:42:00.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 --2- 172.21.15.90:0/175478038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef806de30 0x7fdef80719e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.463 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- 172.21.15.90:0/175478038 >> 172.21.15.90:0/175478038 conn(0x7fdef80cfc70 msgr2=0x7fdef80d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:00.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- 172.21.15.90:0/175478038 shutdown_connections 2023-11-04T01:42:00.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.458+0000 7fdefee54640 1 -- 172.21.15.90:0/175478038 wait complete. 2023-11-04T01:42:00.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 Processor -- start 2023-11-04T01:42:00.464 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 -- start start 2023-11-04T01:42:00.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdef8071250 0x7fdef8144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef8159f00 0x7fdef81473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdef8156140 0x7fdef81435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef8145470 con 0x7fdef8071250 2023-11-04T01:42:00.466 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef814b150 con 0x7fdef8156140 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef814b430 con 0x7fdef8159f00 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef8159f00 0x7fdef81473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefd3f1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdef8156140 0x7fdef81435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef8159f00 0x7fdef81473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:39306/0 (socket says 172.21.15.90:39306) 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 -- 172.21.15.90:0/4090390271 learned_addr learned my addr 172.21.15.90:0/4090390271 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefcbf0640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdef8071250 0x7fdef8144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 -- 172.21.15.90:0/4090390271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdef8156140 msgr2=0x7fdef81435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdef8156140 0x7fdef81435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 -- 172.21.15.90:0/4090390271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdef8071250 msgr2=0x7fdef8144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdef8071250 0x7fdef8144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 -- 172.21.15.90:0/4090390271 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec009420 con 0x7fdef8159f00 2023-11-04T01:42:00.467 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef7fff640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef8159f00 0x7fdef81473d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdeec019010 tx=0x7fdeec0191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:00.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef57fa640 1 -- 172.21.15.90:0/4090390271 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0b6610 con 0x7fdef8159f00 2023-11-04T01:42:00.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef57fa640 1 -- 172.21.15.90:0/4090390271 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec0b6790 con 0x7fdef8159f00 2023-11-04T01:42:00.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef57fa640 1 -- 172.21.15.90:0/4090390271 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0b6b40 con 0x7fdef8159f00 2023-11-04T01:42:00.468 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef814b710 con 0x7fdef8159f00 2023-11-04T01:42:00.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef81565f0 con 0x7fdef8159f00 2023-11-04T01:42:00.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef57fa640 1 -- 172.21.15.90:0/4090390271 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdeec0b4040 con 0x7fdef8159f00 2023-11-04T01:42:00.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.462+0000 7fdef57fa640 1 -- 172.21.15.90:0/4090390271 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdeec0c1cc0 con 0x7fdef8159f00 2023-11-04T01:42:00.469 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.466+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef80675f0 con 0x7fdef8159f00 2023-11-04T01:42:00.485 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.482+0000 7fdef57fa640 1 -- 172.21.15.90:0/4090390271 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdeec0b2070 con 0x7fdef8159f00 2023-11-04T01:42:00.596 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.594+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4b98eb46-0787-4344-9794-6296461471f3", "id": 0} v 0) v1 -- 0x7fdef814bbc0 con 0x7fdef8159f00 2023-11-04T01:42:00.602 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdef57fa640 1 -- 172.21.15.90:0/4090390271 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b98eb46-0787-4344-9794-6296461471f3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdeec0c1460 con 0x7fdef8159f00 2023-11-04T01:42:00.602 INFO:teuthology.orchestra.run.smithi090.stdout:0 2023-11-04T01:42:00.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef8159f00 msgr2=0x7fdef81473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdefee54640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef8159f00 0x7fdef81473d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdeec019010 tx=0x7fdeec0191a0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.603 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 shutdown_connections 2023-11-04T01:42:00.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdefee54640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdef8156140 0x7fdef81435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdefee54640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdef8159f00 0x7fdef81473d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdefee54640 1 --2- 172.21.15.90:0/4090390271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdef8071250 0x7fdef8144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.598+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 >> 172.21.15.90:0/4090390271 conn(0x7fdef80cfc70 msgr2=0x7fdef8158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:00.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.602+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 shutdown_connections 2023-11-04T01:42:00.604 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.602+0000 7fdefee54640 1 -- 172.21.15.90:0/4090390271 wait complete. 2023-11-04T01:42:00.620 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 19381572-605e-4337-a904-1a4a1057f1e0 1 2023-11-04T01:42:00.644 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:00.642+0000 7fdca1d56180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:42:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.730+0000 7f2ca5637640 1 Processor -- start 2023-11-04T01:42:00.735 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.730+0000 7f2ca5637640 1 -- start start 2023-11-04T01:42:00.736 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2ca5637640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ca0144840 0x7f2ca015f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2ca5637640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ca00b56a0 0x7f2ca00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2ca5637640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca006cc10 con 0x7f2ca0070b40 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2ca5637640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca0071d10 con 0x7f2ca0144840 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2ca5637640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca015fb20 con 0x7f2ca00b56a0 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ca00b56a0 0x7f2ca00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ca00b56a0 0x7f2ca00ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45244/0 (socket says 172.21.15.90:45244) 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 -- 172.21.15.90:0/672000922 learned_addr learned my addr 172.21.15.90:0/672000922 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9effd640 1 --2- 172.21.15.90:0/672000922 >> v2:172.21.15.2:3300/0 conn(0x7f2ca0144840 0x7f2ca015f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 -- 172.21.15.90:0/672000922 >> v2:172.21.15.2:3300/0 conn(0x7f2ca0144840 msgr2=0x7f2ca015f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:00.737 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 --2- 172.21.15.90:0/672000922 >> v2:172.21.15.2:3300/0 conn(0x7f2ca0144840 0x7f2ca015f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 -- 172.21.15.90:0/672000922 >> v1:172.21.15.2:6789/0 conn(0x7f2ca0070b40 legacy=0x7f2ca00b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 -- 172.21.15.90:0/672000922 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0071100 con 0x7f2ca00b56a0 2023-11-04T01:42:00.738 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9f7fe640 1 --2- 172.21.15.90:0/672000922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca00b56a0 0x7f2ca00ce680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00cdf50 tx=0x7f2c9801c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36894f6c8756361a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9dffb640 1 -- 172.21.15.90:0/672000922 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980a5790 con 0x7f2ca00b56a0 2023-11-04T01:42:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9dffb640 1 -- 172.21.15.90:0/672000922 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c980a58f0 con 0x7f2ca00b56a0 2023-11-04T01:42:00.739 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2c9dffb640 1 -- 172.21.15.90:0/672000922 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c980a5c80 con 0x7f2ca00b56a0 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2ca5637640 1 -- 172.21.15.90:0/672000922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca00b56a0 msgr2=0x7f2ca00ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.734+0000 7f2ca5637640 1 --2- 172.21.15.90:0/672000922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca00b56a0 0x7f2ca00ce680 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00cdf50 tx=0x7f2c9801c8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- 172.21.15.90:0/672000922 shutdown_connections 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 --2- 172.21.15.90:0/672000922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca00b56a0 0x7f2ca00ce680 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 --2- 172.21.15.90:0/672000922 >> v2:172.21.15.2:3300/0 conn(0x7f2ca0144840 0x7f2ca015f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- 172.21.15.90:0/672000922 >> 172.21.15.90:0/672000922 conn(0x7f2ca00cfc70 msgr2=0x7f2ca00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- 172.21.15.90:0/672000922 shutdown_connections 2023-11-04T01:42:00.740 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- 172.21.15.90:0/672000922 wait complete. 2023-11-04T01:42:00.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 Processor -- start 2023-11-04T01:42:00.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- start start 2023-11-04T01:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca0070b40 0x7f2ca015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca00b56a0 0x7f2ca0137670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ca0144840 0x7f2ca0141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca015e9b0 con 0x7f2ca00b56a0 2023-11-04T01:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0137bb0 con 0x7f2ca0070b40 2023-11-04T01:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca015e6d0 con 0x7f2ca0144840 2023-11-04T01:42:00.743 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca0070b40 0x7f2ca015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca0070b40 0x7f2ca015e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45260/0 (socket says 172.21.15.90:45260) 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 -- 172.21.15.90:0/1346721724 learned_addr learned my addr 172.21.15.90:0/1346721724 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9f7fe640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ca0144840 0x7f2ca0141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9e7fc640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca00b56a0 0x7f2ca0137670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 -- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ca0144840 msgr2=0x7f2ca0141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ca0144840 0x7f2ca0141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 -- 172.21.15.90:0/1346721724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca00b56a0 msgr2=0x7f2ca0137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca00b56a0 0x7f2ca0137670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 -- 172.21.15.90:0/1346721724 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98009b30 con 0x7f2ca0070b40 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9f7fe640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ca0144840 0x7f2ca0141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c9effd640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca0070b40 0x7f2ca015e0c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000d620 tx=0x7f2c9000dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:00.744 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c977fe640 1 -- 172.21.15.90:0/1346721724 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000b620 con 0x7f2ca0070b40 2023-11-04T01:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c977fe640 1 -- 172.21.15.90:0/1346721724 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000b7a0 con 0x7f2ca0070b40 2023-11-04T01:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca0164cc0 con 0x7f2ca0070b40 2023-11-04T01:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c977fe640 1 -- 172.21.15.90:0/1346721724 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000bb50 con 0x7f2ca0070b40 2023-11-04T01:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca0165280 con 0x7f2ca0070b40 2023-11-04T01:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c977fe640 1 -- 172.21.15.90:0/1346721724 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2c9001e460 con 0x7f2ca0070b40 2023-11-04T01:42:00.745 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.738+0000 7f2c977fe640 1 -- 172.21.15.90:0/1346721724 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2c900149b0 con 0x7f2ca0070b40 2023-11-04T01:42:00.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.742+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca01654a0 con 0x7f2ca0070b40 2023-11-04T01:42:00.746 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.742+0000 7f2c977fe640 1 -- 172.21.15.90:0/1346721724 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2c90014bc0 con 0x7f2ca0070b40 2023-11-04T01:42:00.813 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.810+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19381572-605e-4337-a904-1a4a1057f1e0", "id": 1} v 0) v1 -- 0x7f2ca00675f0 con 0x7f2ca0070b40 2023-11-04T01:42:00.822 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.818+0000 7f2c977fe640 1 -- 172.21.15.90:0/1346721724 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19381572-605e-4337-a904-1a4a1057f1e0", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2c9001e850 con 0x7f2ca0070b40 2023-11-04T01:42:00.822 INFO:teuthology.orchestra.run.smithi090.stdout:1 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.818+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca0070b40 msgr2=0x7f2ca015e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.818+0000 7f2ca5637640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca0070b40 0x7f2ca015e0c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000d620 tx=0x7f2c9000dae0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.818+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 shutdown_connections 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.818+0000 7f2ca5637640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2ca0144840 0x7f2ca0141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.818+0000 7f2ca5637640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ca00b56a0 0x7f2ca0137670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.818+0000 7f2ca5637640 1 --2- 172.21.15.90:0/1346721724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ca0070b40 0x7f2ca015e0c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.822+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 >> 172.21.15.90:0/1346721724 conn(0x7f2ca00cfc70 msgr2=0x7f2ca0157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.822+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 shutdown_connections 2023-11-04T01:42:00.824 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.822+0000 7f2ca5637640 1 -- 172.21.15.90:0/1346721724 wait complete. 2023-11-04T01:42:00.838 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:00.834+0000 7fdca1d56180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:42:00.841 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 80984f1f-d33a-4749-9e85-c8a026d24552 2 2023-11-04T01:42:00.880 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:00.882+0000 7f9d401d0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-04T01:42:01.002 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf7a5e640 1 Processor -- start 2023-11-04T01:42:01.002 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf7a5e640 1 -- start start 2023-11-04T01:42:01.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf7a5e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fedf0163f50 0x7fedf0166340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf7a5e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf015b5a0 con 0x7fedf015b1c0 2023-11-04T01:42:01.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf7a5e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf00cbc20 con 0x7fedf0070250 2023-11-04T01:42:01.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf7a5e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf00706d0 con 0x7fedf0163f50 2023-11-04T01:42:01.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf5ffb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fedf0163f50 0x7fedf0166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.003 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf5ffb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fedf0163f50 0x7fedf0166340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45262/0 (socket says 172.21.15.90:45262) 2023-11-04T01:42:01.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf5ffb640 1 -- 172.21.15.90:0/1761659585 learned_addr learned my addr 172.21.15.90:0/1761659585 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf5ffb640 1 -- 172.21.15.90:0/1761659585 >> v1:172.21.15.90:6789/0 conn(0x7fedf0070250 legacy=0x7fedf015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf5ffb640 1 -- 172.21.15.90:0/1761659585 >> v1:172.21.15.2:6789/0 conn(0x7fedf015b1c0 legacy=0x7fedf015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:00.998+0000 7fedf5ffb640 1 -- 172.21.15.90:0/1761659585 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00c9780 con 0x7fedf0163f50 2023-11-04T01:42:01.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf5ffb640 1 --2- 172.21.15.90:0/1761659585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf0163f50 0x7fedf0166340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fede8009e50 tx=0x7fede801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bbf1c98d0e2fa87 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fede7fff640 1 -- 172.21.15.90:0/1761659585 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede80a56f0 con 0x7fedf0163f50 2023-11-04T01:42:01.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fede7fff640 1 -- 172.21.15.90:0/1761659585 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede80a5850 con 0x7fedf0163f50 2023-11-04T01:42:01.005 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fede7fff640 1 -- 172.21.15.90:0/1761659585 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede80a5be0 con 0x7fedf0163f50 2023-11-04T01:42:01.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 -- 172.21.15.90:0/1761659585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf0163f50 msgr2=0x7fedf0166340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 --2- 172.21.15.90:0/1761659585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf0163f50 0x7fedf0166340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fede8009e50 tx=0x7fede801c940 comp rx=0 tx=0).stop 2023-11-04T01:42:01.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 -- 172.21.15.90:0/1761659585 shutdown_connections 2023-11-04T01:42:01.006 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 --2- 172.21.15.90:0/1761659585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf0163f50 0x7fedf0166340 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 -- 172.21.15.90:0/1761659585 >> 172.21.15.90:0/1761659585 conn(0x7fedf00b0e90 msgr2=0x7fedf00b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 -- 172.21.15.90:0/1761659585 shutdown_connections 2023-11-04T01:42:01.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 -- 172.21.15.90:0/1761659585 wait complete. 2023-11-04T01:42:01.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 Processor -- start 2023-11-04T01:42:01.007 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.002+0000 7fedf7a5e640 1 -- start start 2023-11-04T01:42:01.009 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf0070250 0x7fedf014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.009 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf015b1c0 0x7fedf014f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.009 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedf0163f50 0x7fedf01506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0155cf0 con 0x7fedf0070250 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0155f90 con 0x7fedf015b1c0 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0156270 con 0x7fedf0163f50 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf4ff9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf015b1c0 0x7fedf014f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf5ffb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedf0163f50 0x7fedf01506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf4ff9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf015b1c0 0x7fedf014f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45268/0 (socket says 172.21.15.90:45268) 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf4ff9640 1 -- 172.21.15.90:0/634761876 learned_addr learned my addr 172.21.15.90:0/634761876 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf57fa640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf0070250 0x7fedf014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf5ffb640 1 -- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf015b1c0 msgr2=0x7fedf014f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf5ffb640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf015b1c0 0x7fedf014f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf5ffb640 1 -- 172.21.15.90:0/634761876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf0070250 msgr2=0x7fedf014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf5ffb640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf0070250 0x7fedf014ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf5ffb640 1 -- 172.21.15.90:0/634761876 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede8009b30 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf4ff9640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf015b1c0 0x7fedf014f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf5ffb640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedf0163f50 0x7fedf01506f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fede80ab000 tx=0x7fede80196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fede5ffb640 1 -- 172.21.15.90:0/634761876 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8009510 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fede5ffb640 1 -- 172.21.15.90:0/634761876 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede80b8680 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf0156550 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fede5ffb640 1 -- 172.21.15.90:0/634761876 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede80b89f0 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf014f630 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fede5ffb640 1 -- 172.21.15.90:0/634761876 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fede80c1410 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fede5ffb640 1 -- 172.21.15.90:0/634761876 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fede80b6860 con 0x7fedf0163f50 2023-11-04T01:42:01.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.006+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf00744a0 con 0x7fedf0163f50 2023-11-04T01:42:01.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.010+0000 7fede5ffb640 1 -- 172.21.15.90:0/634761876 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fede80bc030 con 0x7fedf0163f50 2023-11-04T01:42:01.064 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:01.066+0000 7f9d401d0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-04T01:42:01.078 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.074+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "80984f1f-d33a-4749-9e85-c8a026d24552", "id": 2} v 0) v1 -- 0x7fedf006b550 con 0x7fedf0163f50 2023-11-04T01:42:01.089 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fede5ffb640 1 -- 172.21.15.90:0/634761876 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80984f1f-d33a-4749-9e85-c8a026d24552", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fede80b6510 con 0x7fedf0163f50 2023-11-04T01:42:01.090 INFO:teuthology.orchestra.run.smithi090.stdout:2 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedf0163f50 msgr2=0x7fedf01506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedf0163f50 0x7fedf01506f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fede80ab000 tx=0x7fede80196e0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 shutdown_connections 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fedf0163f50 0x7fedf01506f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fedf015b1c0 0x7fedf014f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 --2- 172.21.15.90:0/634761876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fedf0070250 0x7fedf014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 >> 172.21.15.90:0/634761876 conn(0x7fedf00b0e90 msgr2=0x7fedf0154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 shutdown_connections 2023-11-04T01:42:01.091 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.086+0000 7fedf7a5e640 1 -- 172.21.15.90:0/634761876 wait complete. 2023-11-04T01:42:01.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 081f0dcf-f419-490d-8553-3aebdef7e5ae 3 2023-11-04T01:42:01.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efebce9b640 1 Processor -- start 2023-11-04T01:42:01.222 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efebce9b640 1 -- start start 2023-11-04T01:42:01.223 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efebce9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efeb815af50 0x7efeb80cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efebce9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efeb80cf4c0 0x7efeb80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efebce9b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80cd830 con 0x7efeb80b32f0 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efebce9b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80b3780 con 0x7efeb815af50 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efebce9b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80cdad0 con 0x7efeb80cf4c0 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efeb6d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efeb80cf4c0 0x7efeb80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efeb6d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efeb80cf4c0 0x7efeb80d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45272/0 (socket says 172.21.15.90:45272) 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.218+0000 7efeb6d9d640 1 -- 172.21.15.90:0/3432662830 learned_addr learned my addr 172.21.15.90:0/3432662830 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb659c640 1 --2- 172.21.15.90:0/3432662830 >> v2:172.21.15.2:3300/0 conn(0x7efeb815af50 0x7efeb80cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb6d9d640 1 -- 172.21.15.90:0/3432662830 >> v2:172.21.15.2:3300/0 conn(0x7efeb815af50 msgr2=0x7efeb80cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb6d9d640 1 --2- 172.21.15.90:0/3432662830 >> v2:172.21.15.2:3300/0 conn(0x7efeb815af50 0x7efeb80cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb6d9d640 1 -- 172.21.15.90:0/3432662830 >> v1:172.21.15.90:6789/0 conn(0x7efeb80b32f0 legacy=0x7efeb80ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb6d9d640 1 -- 172.21.15.90:0/3432662830 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80cddb0 con 0x7efeb80cf4c0 2023-11-04T01:42:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb6d9d640 1 --2- 172.21.15.90:0/3432662830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb80cf4c0 0x7efeb80d0610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efeb8066a00 tx=0x7efeb001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6f5465e65ef547 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb559a640 1 -- 172.21.15.90:0/3432662830 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00a5820 con 0x7efeb80cf4c0 2023-11-04T01:42:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb559a640 1 -- 172.21.15.90:0/3432662830 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb00a5980 con 0x7efeb80cf4c0 2023-11-04T01:42:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efeb559a640 1 -- 172.21.15.90:0/3432662830 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00a5d10 con 0x7efeb80cf4c0 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efebce9b640 1 -- 172.21.15.90:0/3432662830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb80cf4c0 msgr2=0x7efeb80d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.222+0000 7efebce9b640 1 --2- 172.21.15.90:0/3432662830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb80cf4c0 0x7efeb80d0610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efeb8066a00 tx=0x7efeb001c940 comp rx=0 tx=0).stop 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- 172.21.15.90:0/3432662830 shutdown_connections 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 --2- 172.21.15.90:0/3432662830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb80cf4c0 0x7efeb80d0610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 --2- 172.21.15.90:0/3432662830 >> v2:172.21.15.2:3300/0 conn(0x7efeb815af50 0x7efeb80cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- 172.21.15.90:0/3432662830 >> 172.21.15.90:0/3432662830 conn(0x7efeb8065dc0 msgr2=0x7efeb80661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- 172.21.15.90:0/3432662830 shutdown_connections 2023-11-04T01:42:01.228 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- 172.21.15.90:0/3432662830 wait complete. 2023-11-04T01:42:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 Processor -- start 2023-11-04T01:42:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- start start 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb80cf4c0 0x7efeb80c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb815af50 0x7efeb81f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb806cf70 0x7efeb81f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb81f5d80 con 0x7efeb806cf70 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb81f6060 con 0x7efeb815af50 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c48b0 con 0x7efeb80cf4c0 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb5d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb815af50 0x7efeb81f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb80cf4c0 0x7efeb80c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb5d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb815af50 0x7efeb81f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45276/0 (socket says 172.21.15.90:45276) 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb5d9b640 1 -- 172.21.15.90:0/724573932 learned_addr learned my addr 172.21.15.90:0/724573932 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb6d9d640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb806cf70 0x7efeb81f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb659c640 1 -- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb815af50 msgr2=0x7efeb81f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb659c640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb815af50 0x7efeb81f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb659c640 1 -- 172.21.15.90:0/724573932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb806cf70 msgr2=0x7efeb81f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb659c640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb806cf70 0x7efeb81f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb659c640 1 -- 172.21.15.90:0/724573932 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009b30 con 0x7efeb80cf4c0 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb5d9b640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb815af50 0x7efeb81f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeb659c640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb80cf4c0 0x7efeb80c6c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efea800c5c0 tx=0x7efea800ca80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeaeffd640 1 -- 172.21.15.90:0/724573932 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8004220 con 0x7efeb80cf4c0 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeaeffd640 1 -- 172.21.15.90:0/724573932 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea8004380 con 0x7efeb80cf4c0 2023-11-04T01:42:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb80c4b90 con 0x7efeb80cf4c0 2023-11-04T01:42:01.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeaeffd640 1 -- 172.21.15.90:0/724573932 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8003840 con 0x7efeb80cf4c0 2023-11-04T01:42:01.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb80c71b0 con 0x7efeb80cf4c0 2023-11-04T01:42:01.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeaeffd640 1 -- 172.21.15.90:0/724573932 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efea80039a0 con 0x7efeb80cf4c0 2023-11-04T01:42:01.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efeaeffd640 1 -- 172.21.15.90:0/724573932 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7efea8019400 con 0x7efeb80cf4c0 2023-11-04T01:42:01.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.226+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb80675f0 con 0x7efeb80cf4c0 2023-11-04T01:42:01.233 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.230+0000 7efeaeffd640 1 -- 172.21.15.90:0/724573932 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7efea8038b40 con 0x7efeb80cf4c0 2023-11-04T01:42:01.300 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.298+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "081f0dcf-f419-490d-8553-3aebdef7e5ae", "id": 3} v 0) v1 -- 0x7efeb8066520 con 0x7efeb80cf4c0 2023-11-04T01:42:01.309 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efeaeffd640 1 -- 172.21.15.90:0/724573932 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "081f0dcf-f419-490d-8553-3aebdef7e5ae", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7efea8027030 con 0x7efeb80cf4c0 2023-11-04T01:42:01.309 INFO:teuthology.orchestra.run.smithi090.stdout:3 2023-11-04T01:42:01.310 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb80cf4c0 msgr2=0x7efeb80c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb80cf4c0 0x7efeb80c6c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efea800c5c0 tx=0x7efea800ca80 comp rx=0 tx=0).stop 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 shutdown_connections 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efeb806cf70 0x7efeb81f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efeb815af50 0x7efeb81f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 --2- 172.21.15.90:0/724573932 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efeb80cf4c0 0x7efeb80c6c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 >> 172.21.15.90:0/724573932 conn(0x7efeb8065dc0 msgr2=0x7efeb8073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 shutdown_connections 2023-11-04T01:42:01.311 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.306+0000 7efebce9b640 1 -- 172.21.15.90:0/724573932 wait complete. 2023-11-04T01:42:01.326 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 3620286f-8097-49a2-aba7-ca472a29caad 4 2023-11-04T01:42:01.438 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.434+0000 7fdca1d56180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:42:01.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a37322640 1 Processor -- start 2023-11-04T01:42:01.440 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a37322640 1 -- start start 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a37322640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a300719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a37322640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300cdb70 con 0x7f0a3006de30 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a37322640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300cde50 con 0x7f0a30159f00 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a37322640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3015a2e0 con 0x7f0a30071250 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a350be640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0a30159f00 0x7f0a30070b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:45538/0 (socket says 172.21.15.90:45538) 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a350be640 1 -- 172.21.15.90:0/1026978843 learned_addr learned my addr 172.21.15.90:0/1026978843 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-11-04T01:42:01.443 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a358bf640 1 --2- 172.21.15.90:0/1026978843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a300719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a27fff640 1 -- 172.21.15.90:0/1026978843 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940340585 0 0) 0x7f0a300cde50 con 0x7f0a30159f00 2023-11-04T01:42:01.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a27fff640 1 -- 172.21.15.90:0/1026978843 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a1c003530 con 0x7f0a30159f00 2023-11-04T01:42:01.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a358bf640 1 -- 172.21.15.90:0/1026978843 >> v1:172.21.15.90:6789/0 conn(0x7f0a30159f00 legacy=0x7f0a30070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a358bf640 1 -- 172.21.15.90:0/1026978843 >> v1:172.21.15.2:6789/0 conn(0x7f0a3006de30 legacy=0x7f0a300ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.444 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.438+0000 7f0a358bf640 1 -- 172.21.15.90:0/1026978843 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3015e4f0 con 0x7f0a30071250 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a358bf640 1 --2- 172.21.15.90:0/1026978843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a300719e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009dc0 tx=0x7f0a2801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89abb4d8a969e0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a27fff640 1 -- 172.21.15.90:0/1026978843 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280a58d0 con 0x7f0a30071250 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a27fff640 1 -- 172.21.15.90:0/1026978843 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a280a5a30 con 0x7f0a30071250 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a27fff640 1 -- 172.21.15.90:0/1026978843 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280a5dc0 con 0x7f0a30071250 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- 172.21.15.90:0/1026978843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 msgr2=0x7f0a300719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.445 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 --2- 172.21.15.90:0/1026978843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a300719e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a28009dc0 tx=0x7f0a2801c8b0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- 172.21.15.90:0/1026978843 shutdown_connections 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 --2- 172.21.15.90:0/1026978843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a300719e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- 172.21.15.90:0/1026978843 >> 172.21.15.90:0/1026978843 conn(0x7f0a300cfc70 msgr2=0x7f0a300d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- 172.21.15.90:0/1026978843 shutdown_connections 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- 172.21.15.90:0/1026978843 wait complete. 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 Processor -- start 2023-11-04T01:42:01.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- start start 2023-11-04T01:42:01.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a3014be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a30159f00 0x7f0a30154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3014c700 0x7f0a301562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3014cbb0 con 0x7f0a30159f00 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30156800 con 0x7f0a3014c700 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a37322640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30156a80 con 0x7f0a30071250 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a350be640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a3014be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a358bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3014c700 0x7f0a301562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a358bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3014c700 0x7f0a301562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45292/0 (socket says 172.21.15.90:45292) 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a358bf640 1 -- 172.21.15.90:0/3714348396 learned_addr learned my addr 172.21.15.90:0/3714348396 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.442+0000 7f0a350be640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a3014be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:39344/0 (socket says 172.21.15.90:39344) 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a348bd640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a30159f00 0x7f0a30154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a358bf640 1 -- 172.21.15.90:0/3714348396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 msgr2=0x7f0a3014be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a358bf640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a3014be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a358bf640 1 -- 172.21.15.90:0/3714348396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a30159f00 msgr2=0x7f0a30154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.449 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a358bf640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a30159f00 0x7f0a30154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a358bf640 1 -- 172.21.15.90:0/3714348396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28009a70 con 0x7f0a3014c700 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a358bf640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3014c700 0x7f0a301562c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a2801a4e0 tx=0x7f0a28019650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a25ffb640 1 -- 172.21.15.90:0/3714348396 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280b9650 con 0x7f0a3014c700 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a25ffb640 1 -- 172.21.15.90:0/3714348396 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a280b97b0 con 0x7f0a3014c700 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a30153c40 con 0x7f0a3014c700 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a25ffb640 1 -- 172.21.15.90:0/3714348396 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a280b9b60 con 0x7f0a3014c700 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a30154200 con 0x7f0a3014c700 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a25ffb640 1 -- 172.21.15.90:0/3714348396 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0a280ad440 con 0x7f0a3014c700 2023-11-04T01:42:01.450 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a25ffb640 1 -- 172.21.15.90:0/3714348396 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0a280c2aa0 con 0x7f0a3014c700 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3006e710 con 0x7f0a3014c700 2023-11-04T01:42:01.451 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.446+0000 7f0a25ffb640 1 -- 172.21.15.90:0/3714348396 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0a280bd020 con 0x7f0a3014c700 2023-11-04T01:42:01.494 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.490+0000 7fdca1d56180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:42:01.518 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.514+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3620286f-8097-49a2-aba7-ca472a29caad", "id": 4} v 0) v1 -- 0x7f0a300675f0 con 0x7f0a3014c700 2023-11-04T01:42:01.526 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.522+0000 7f0a25ffb640 1 -- 172.21.15.90:0/3714348396 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3620286f-8097-49a2-aba7-ca472a29caad", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0a280b2070 con 0x7f0a3014c700 2023-11-04T01:42:01.526 INFO:teuthology.orchestra.run.smithi090.stdout:4 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3014c700 msgr2=0x7f0a301562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3014c700 0x7f0a301562c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0a2801a4e0 tx=0x7f0a28019650 comp rx=0 tx=0).stop 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 shutdown_connections 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a3014c700 0x7f0a301562c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a30159f00 0x7f0a30154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 --2- 172.21.15.90:0/3714348396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a30071250 0x7f0a3014be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 >> 172.21.15.90:0/3714348396 conn(0x7f0a300cfc70 msgr2=0x7f0a3006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.528 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 shutdown_connections 2023-11-04T01:42:01.529 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.526+0000 7f0a37322640 1 -- 172.21.15.90:0/3714348396 wait complete. 2023-11-04T01:42:01.543 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 36f5bec4-109c-432c-b807-cdc87e8ca112 5 2023-11-04T01:42:01.550 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.546+0000 7fdca1d56180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:42:01.629 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.626+0000 7fdca1d56180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:42:01.654 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:01.654+0000 7f9d401d0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-04T01:42:01.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc956e3e640 1 Processor -- start 2023-11-04T01:42:01.661 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc956e3e640 1 -- start start 2023-11-04T01:42:01.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc956e3e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc950065dc0 0x7fc9500ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc956e3e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9500caed0 0x7fc9500ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc956e3e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc950066250 con 0x7fc950159f50 2023-11-04T01:42:01.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc956e3e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95006b3f0 con 0x7fc950065dc0 2023-11-04T01:42:01.663 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc956e3e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95006b6d0 con 0x7fc9500caed0 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc9553db640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9500caed0 0x7fc9500ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc9553db640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9500caed0 0x7fc9500ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:39346/0 (socket says 172.21.15.90:39346) 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc9553db640 1 -- 172.21.15.90:0/939536682 learned_addr learned my addr 172.21.15.90:0/939536682 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc94ffff640 1 --2- 172.21.15.90:0/939536682 >> v2:172.21.15.2:3300/0 conn(0x7fc950065dc0 0x7fc9500ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc9553db640 1 -- 172.21.15.90:0/939536682 >> v2:172.21.15.2:3300/0 conn(0x7fc950065dc0 msgr2=0x7fc9500ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc9553db640 1 --2- 172.21.15.90:0/939536682 >> v2:172.21.15.2:3300/0 conn(0x7fc950065dc0 0x7fc9500ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc9553db640 1 -- 172.21.15.90:0/939536682 >> v1:172.21.15.2:6789/0 conn(0x7fc950159f50 legacy=0x7fc9500ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.664 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.658+0000 7fc9553db640 1 -- 172.21.15.90:0/939536682 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95015a330 con 0x7fc9500caed0 2023-11-04T01:42:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc9553db640 1 --2- 172.21.15.90:0/939536682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9500caed0 0x7fc9500ca870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc940009870 tx=0x7fc94001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e49114784f6e579 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc94f7fe640 1 -- 172.21.15.90:0/939536682 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400ac630 con 0x7fc9500caed0 2023-11-04T01:42:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc94f7fe640 1 -- 172.21.15.90:0/939536682 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9400ac790 con 0x7fc9500caed0 2023-11-04T01:42:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc94f7fe640 1 -- 172.21.15.90:0/939536682 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400acb20 con 0x7fc9500caed0 2023-11-04T01:42:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 -- 172.21.15.90:0/939536682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9500caed0 msgr2=0x7fc9500ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 --2- 172.21.15.90:0/939536682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9500caed0 0x7fc9500ca870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc940009870 tx=0x7fc94001c500 comp rx=0 tx=0).stop 2023-11-04T01:42:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 -- 172.21.15.90:0/939536682 shutdown_connections 2023-11-04T01:42:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 --2- 172.21.15.90:0/939536682 >> v2:172.21.15.2:3300/0 conn(0x7fc950065dc0 0x7fc9500ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 --2- 172.21.15.90:0/939536682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9500caed0 0x7fc9500ca870 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 -- 172.21.15.90:0/939536682 >> 172.21.15.90:0/939536682 conn(0x7fc9500b0e30 msgr2=0x7fc9500b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 -- 172.21.15.90:0/939536682 shutdown_connections 2023-11-04T01:42:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 -- 172.21.15.90:0/939536682 wait complete. 2023-11-04T01:42:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 Processor -- start 2023-11-04T01:42:01.667 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.662+0000 7fc956e3e640 1 -- start start 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9500caed0 0x7fc95014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc950159f50 0x7fc9500c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9501f7150 0x7fc9501f7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc950159530 con 0x7fc9501f7150 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9500b5090 con 0x7fc9500caed0 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc950159250 con 0x7fc950159f50 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc950159f50 0x7fc9500c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc954bda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9500caed0 0x7fc95014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc950159f50 0x7fc9500c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:39356/0 (socket says 172.21.15.90:39356) 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 -- 172.21.15.90:0/1633395939 learned_addr learned my addr 172.21.15.90:0/1633395939 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc9553db640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9501f7150 0x7fc9501f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 -- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9500caed0 msgr2=0x7fc95014f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9500caed0 0x7fc95014f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 -- 172.21.15.90:0/1633395939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9501f7150 msgr2=0x7fc9501f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9501f7150 0x7fc9501f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 -- 172.21.15.90:0/1633395939 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9400094d0 con 0x7fc950159f50 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc954bda640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9500caed0 0x7fc95014f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc9553db640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9501f7150 0x7fc9501f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:01.670 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94ffff640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc950159f50 0x7fc9500c48d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc944007f70 tx=0x7fc94400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94d7fa640 1 -- 172.21.15.90:0/1633395939 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400b860 con 0x7fc950159f50 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94d7fa640 1 -- 172.21.15.90:0/1633395939 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944016070 con 0x7fc950159f50 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9500b4ad0 con 0x7fc950159f50 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94d7fa640 1 -- 172.21.15.90:0/1633395939 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400bbc0 con 0x7fc950159f50 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95015b240 con 0x7fc950159f50 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94d7fa640 1 -- 172.21.15.90:0/1633395939 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc9440128e0 con 0x7fc950159f50 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc94d7fa640 1 -- 172.21.15.90:0/1633395939 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fc944018070 con 0x7fc950159f50 2023-11-04T01:42:01.671 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.666+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9500c4490 con 0x7fc950159f50 2023-11-04T01:42:01.672 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.670+0000 7fc94d7fa640 1 -- 172.21.15.90:0/1633395939 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc944012d70 con 0x7fc950159f50 2023-11-04T01:42:01.683 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.682+0000 7fdca1d56180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:42:01.710 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:01.710+0000 7f9d401d0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-04T01:42:01.741 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.738+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "36f5bec4-109c-432c-b807-cdc87e8ca112", "id": 5} v 0) v1 -- 0x7fc9500675f0 con 0x7fc950159f50 2023-11-04T01:42:01.749 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc94d7fa640 1 -- 172.21.15.90:0/1633395939 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36f5bec4-109c-432c-b807-cdc87e8ca112", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc94400bd20 con 0x7fc950159f50 2023-11-04T01:42:01.749 INFO:teuthology.orchestra.run.smithi090.stdout:5 2023-11-04T01:42:01.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc950159f50 msgr2=0x7fc9500c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc950159f50 0x7fc9500c48d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc944007f70 tx=0x7fc94400dbe0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 shutdown_connections 2023-11-04T01:42:01.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9501f7150 0x7fc9501f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc950159f50 0x7fc9500c48d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 --2- 172.21.15.90:0/1633395939 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9500caed0 0x7fc95014f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.751 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 >> 172.21.15.90:0/1633395939 conn(0x7fc9500b0e30 msgr2=0x7fc9500aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 shutdown_connections 2023-11-04T01:42:01.752 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.746+0000 7fc956e3e640 1 -- 172.21.15.90:0/1633395939 wait complete. 2023-11-04T01:42:01.763 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.758+0000 7fdca1d56180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:42:01.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new d13ad869-187b-4b0d-a52b-223debadef85 6 2023-11-04T01:42:01.765 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:01.766+0000 7f9d401d0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-04T01:42:01.815 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.810+0000 7fdca1d56180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:42:01.846 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:01.846+0000 7f9d401d0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-04T01:42:01.900 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:01.898+0000 7f9d401d0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-04T01:42:01.926 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.922+0000 7f2be91ae640 1 Processor -- start 2023-11-04T01:42:01.927 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.922+0000 7f2be91ae640 1 -- start start 2023-11-04T01:42:01.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2be4159420 0x7f2be415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2be40ca2b0 0x7f2be4159800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be40cd3b0 con 0x7f2be40ce9e0 2023-11-04T01:42:01.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be40cdff0 con 0x7f2be40ca2b0 2023-11-04T01:42:01.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be415e140 con 0x7f2be4159420 2023-11-04T01:42:01.928 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be2d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2be4159420 0x7f2be415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2bdbfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2be40ce9e0 0x7f2be40c9ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:45544/0 (socket says 172.21.15.90:45544) 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be2d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2be4159420 0x7f2be415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45316/0 (socket says 172.21.15.90:45316) 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2bdbfff640 1 -- 172.21.15.90:0/1724737812 learned_addr learned my addr 172.21.15.90:0/1724737812 (peer_addr_for_me v1:172.21.15.90:0/0) 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be359e640 1 --2- 172.21.15.90:0/1724737812 >> v2:172.21.15.2:3300/0 conn(0x7f2be40ca2b0 0x7f2be4159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be2d9d640 1 -- 172.21.15.90:0/1724737812 >> v2:172.21.15.2:3300/0 conn(0x7f2be40ca2b0 msgr2=0x7f2be4159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be2d9d640 1 --2- 172.21.15.90:0/1724737812 >> v2:172.21.15.2:3300/0 conn(0x7f2be40ca2b0 0x7f2be4159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be259c640 1 -- 172.21.15.90:0/1724737812 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138294403 0 0) 0x7f2be40cd3b0 con 0x7f2be40ce9e0 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be2d9d640 1 -- 172.21.15.90:0/1724737812 >> v1:172.21.15.90:6789/0 conn(0x7f2be40ce9e0 legacy=0x7f2be40c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.929 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be2d9d640 1 -- 172.21.15.90:0/1724737812 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40cd650 con 0x7f2be4159420 2023-11-04T01:42:01.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be2d9d640 1 --2- 172.21.15.90:0/1724737812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be4159420 0x7f2be415dc00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2be4073d80 tx=0x7f2bd401c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a25468ae1e14ab7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.930 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be259c640 1 -- 172.21.15.90:0/1724737812 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40ab600 con 0x7f2be4159420 2023-11-04T01:42:01.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be259c640 1 -- 172.21.15.90:0/1724737812 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40a7050 con 0x7f2be4159420 2023-11-04T01:42:01.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be259c640 1 -- 172.21.15.90:0/1724737812 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40ab980 con 0x7f2be4159420 2023-11-04T01:42:01.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 -- 172.21.15.90:0/1724737812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be4159420 msgr2=0x7f2be415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.931 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 --2- 172.21.15.90:0/1724737812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be4159420 0x7f2be415dc00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2be4073d80 tx=0x7f2bd401c3d0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 -- 172.21.15.90:0/1724737812 shutdown_connections 2023-11-04T01:42:01.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 --2- 172.21.15.90:0/1724737812 >> v2:172.21.15.2:3300/0 conn(0x7f2be40ca2b0 0x7f2be4159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 --2- 172.21.15.90:0/1724737812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be4159420 0x7f2be415dc00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 -- 172.21.15.90:0/1724737812 >> 172.21.15.90:0/1724737812 conn(0x7f2be40b0e30 msgr2=0x7f2be40b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:01.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.926+0000 7f2be91ae640 1 -- 172.21.15.90:0/1724737812 shutdown_connections 2023-11-04T01:42:01.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- 172.21.15.90:0/1724737812 wait complete. 2023-11-04T01:42:01.932 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 Processor -- start 2023-11-04T01:42:01.933 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- start start 2023-11-04T01:42:01.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be40ca2b0 0x7f2be414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be40ce9e0 0x7f2be414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2be4159420 0x7f2be414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:01.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40aed20 con 0x7f2be4159420 2023-11-04T01:42:01.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40ae9d0 con 0x7f2be40ce9e0 2023-11-04T01:42:01.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be414f880 con 0x7f2be40ca2b0 2023-11-04T01:42:01.935 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be40ca2b0 0x7f2be414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2bdbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be40ce9e0 0x7f2be414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be40ca2b0 0x7f2be414ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.90:39362/0 (socket says 172.21.15.90:39362) 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 -- 172.21.15.90:0/1823169358 learned_addr learned my addr 172.21.15.90:0/1823169358 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be359e640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2be4159420 0x7f2be414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 -- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be40ce9e0 msgr2=0x7f2be414c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be40ce9e0 0x7f2be414c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 -- 172.21.15.90:0/1823169358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2be4159420 msgr2=0x7f2be414e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2be4159420 0x7f2be414e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 -- 172.21.15.90:0/1823169358 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4009420 con 0x7f2be40ca2b0 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2bdbfff640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be40ce9e0 0x7f2be414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:01.936 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be2d9d640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be40ca2b0 0x7f2be414ef80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ae040 tx=0x7f2bd401ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2bdb7fe640 1 -- 172.21.15.90:0/1823169358 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b7650 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2bdb7fe640 1 -- 172.21.15.90:0/1823169358 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40b77b0 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be414fb60 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2bdb7fe640 1 -- 172.21.15.90:0/1823169358 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b7b60 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be414f4c0 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2bdb7fe640 1 -- 172.21.15.90:0/1823169358 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bd40c0400 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2bdb7fe640 1 -- 172.21.15.90:0/1823169358 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2bd40b59f0 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.930+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be4159d00 con 0x7f2be40ca2b0 2023-11-04T01:42:01.937 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:01.934+0000 7f2bdb7fe640 1 -- 172.21.15.90:0/1823169358 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2bd40bb020 con 0x7f2be40ca2b0 2023-11-04T01:42:01.960 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:01.958+0000 7fdca1d56180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:42:01.980 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:01.978+0000 7f9d401d0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-04T01:42:02.004 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.002+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d13ad869-187b-4b0d-a52b-223debadef85", "id": 6} v 0) v1 -- 0x7f2be40675f0 con 0x7f2be40ca2b0 2023-11-04T01:42:02.010 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2bdb7fe640 1 -- 172.21.15.90:0/1823169358 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d13ad869-187b-4b0d-a52b-223debadef85", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bd40cf0b0 con 0x7f2be40ca2b0 2023-11-04T01:42:02.010 INFO:teuthology.orchestra.run.smithi090.stdout:6 2023-11-04T01:42:02.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be40ca2b0 msgr2=0x7f2be414ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be40ca2b0 0x7f2be414ef80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ae040 tx=0x7f2bd401ac10 comp rx=0 tx=0).stop 2023-11-04T01:42:02.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 shutdown_connections 2023-11-04T01:42:02.011 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2be4159420 0x7f2be414e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be40ce9e0 0x7f2be414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 --2- 172.21.15.90:0/1823169358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be40ca2b0 0x7f2be414ef80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 >> 172.21.15.90:0/1823169358 conn(0x7f2be40b0e30 msgr2=0x7f2be415ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 shutdown_connections 2023-11-04T01:42:02.012 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.006+0000 7f2be91ae640 1 -- 172.21.15.90:0/1823169358 wait complete. 2023-11-04T01:42:02.021 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:02.018+0000 7fdca1d56180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:42:02.026 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd new 994cb1fb-92a2-4a71-9517-c45e2c77c20d 7 2023-11-04T01:42:02.033 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:02.034+0000 7f9d401d0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-04T01:42:02.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbf00cf640 1 Processor -- start 2023-11-04T01:42:02.176 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbf00cf640 1 -- start start 2023-11-04T01:42:02.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbf00cf640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbe815aff0 0x7fdbe80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbf00cf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe80ca0a0 0x7fdbe806a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbf00cf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe806a290 con 0x7fdbe8070270 2023-11-04T01:42:02.177 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbf00cf640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe80cbba0 con 0x7fdbe815aff0 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbf00cf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8071e90 con 0x7fdbe80ca0a0 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbede6b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbe815aff0 0x7fdbe80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbede6b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbe815aff0 0x7fdbe80cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45336/0 (socket says 172.21.15.90:45336) 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbede6b640 1 -- 172.21.15.90:0/3335439132 learned_addr learned my addr 172.21.15.90:0/3335439132 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbee66c640 1 --2- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe80ca0a0 0x7fdbe806a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbede6b640 1 -- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe80ca0a0 msgr2=0x7fdbe806a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbede6b640 1 --2- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe80ca0a0 0x7fdbe806a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbede6b640 1 -- 172.21.15.90:0/3335439132 >> v1:172.21.15.2:6789/0 conn(0x7fdbe8070270 legacy=0x7fdbe80c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbede6b640 1 -- 172.21.15.90:0/3335439132 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8072170 con 0x7fdbe815aff0 2023-11-04T01:42:02.178 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.174+0000 7fdbee66c640 1 --2- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe80ca0a0 0x7fdbe806a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:02.179 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:02.178+0000 7f9d401d0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-04T01:42:02.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 --2- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe80cb5c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009870 tx=0x7fdbe401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fbbd54b4a71ac87 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbece69640 1 -- 172.21.15.90:0/3335439132 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40a89b0 con 0x7fdbe815aff0 2023-11-04T01:42:02.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbece69640 1 -- 172.21.15.90:0/3335439132 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe40a8b10 con 0x7fdbe815aff0 2023-11-04T01:42:02.180 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbece69640 1 -- 172.21.15.90:0/3335439132 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40a8ea0 con 0x7fdbe815aff0 2023-11-04T01:42:02.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 msgr2=0x7fdbe80cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 --2- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe80cb5c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009870 tx=0x7fdbe401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- 172.21.15.90:0/3335439132 shutdown_connections 2023-11-04T01:42:02.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 --2- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe80ca0a0 0x7fdbe806a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 --2- 172.21.15.90:0/3335439132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe80cb5c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- 172.21.15.90:0/3335439132 >> 172.21.15.90:0/3335439132 conn(0x7fdbe80b0e30 msgr2=0x7fdbe80b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.181 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- 172.21.15.90:0/3335439132 shutdown_connections 2023-11-04T01:42:02.182 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- 172.21.15.90:0/3335439132 wait complete. 2023-11-04T01:42:02.184 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 Processor -- start 2023-11-04T01:42:02.184 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- start start 2023-11-04T01:42:02.184 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe8070270 0x7fdbe8152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.184 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe80ca0a0 0x7fdbe80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.184 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe8155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8152c90 con 0x7fdbe80ca0a0 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80b04f0 con 0x7fdbe815aff0 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c9350 con 0x7fdbe8070270 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbee66c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe8155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbee66c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe8155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45342/0 (socket says 172.21.15.90:45342) 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbee66c640 1 -- 172.21.15.90:0/673841542 learned_addr learned my addr 172.21.15.90:0/673841542 (peer_addr_for_me v2:172.21.15.90:0/0) 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe8070270 0x7fdbe8152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbed66a640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe80ca0a0 0x7fdbe80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 -- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 msgr2=0x7fdbe8155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe8155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.185 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 -- 172.21.15.90:0/673841542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe80ca0a0 msgr2=0x7fdbe80ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe80ca0a0 0x7fdbe80ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 -- 172.21.15.90:0/673841542 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0009a70 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbede6b640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe8070270 0x7fdbe8152750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40af000 tx=0x7fdbe401ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbde7fc640 1 -- 172.21.15.90:0/673841542 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40be070 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbde7fc640 1 -- 172.21.15.90:0/673841542 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe40ba400 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe40094d0 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbde7fc640 1 -- 172.21.15.90:0/673841542 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe40ba7d0 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.178+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe80afea0 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.182+0000 7fdbde7fc640 1 -- 172.21.15.90:0/673841542 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdbe40bac30 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.182+0000 7fdbde7fc640 1 -- 172.21.15.90:0/673841542 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fdbe40c2a20 con 0x7fdbe8070270 2023-11-04T01:42:02.186 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.182+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe80675f0 con 0x7fdbe8070270 2023-11-04T01:42:02.187 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.182+0000 7fdbde7fc640 1 -- 172.21.15.90:0/673841542 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdbe40b5070 con 0x7fdbe8070270 2023-11-04T01:42:02.241 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:02.242+0000 7f9d401d0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-04T01:42:02.248 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.246+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd new", "uuid": "994cb1fb-92a2-4a71-9517-c45e2c77c20d", "id": 7} v 0) v1 -- 0x7fdbe80675f0 con 0x7fdbe8070270 2023-11-04T01:42:02.255 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.250+0000 7fdbde7fc640 1 -- 172.21.15.90:0/673841542 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "994cb1fb-92a2-4a71-9517-c45e2c77c20d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdbe40c2cc0 con 0x7fdbe8070270 2023-11-04T01:42:02.255 INFO:teuthology.orchestra.run.smithi090.stdout:7 2023-11-04T01:42:02.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe8070270 msgr2=0x7fdbe8152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe8070270 0x7fdbe8152750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40af000 tx=0x7fdbe401ba90 comp rx=0 tx=0).stop 2023-11-04T01:42:02.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 shutdown_connections 2023-11-04T01:42:02.256 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbe815aff0 0x7fdbe8155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbe80ca0a0 0x7fdbe80ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 --2- 172.21.15.90:0/673841542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbe8070270 0x7fdbe8152750 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 >> 172.21.15.90:0/673841542 conn(0x7fdbe80b0e30 msgr2=0x7fdbe81577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 shutdown_connections 2023-11-04T01:42:02.257 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:02.254+0000 7fdbf00cf640 1 -- 172.21.15.90:0/673841542 wait complete. 2023-11-04T01:42:02.270 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-04T01:42:02.270 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-04T01:42:02.273 INFO:tasks.ceph.osd.0:Started 2023-11-04T01:42:02.273 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-04T01:42:02.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-04T01:42:02.275 INFO:tasks.ceph.osd.1:Started 2023-11-04T01:42:02.275 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-04T01:42:02.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-04T01:42:02.278 INFO:tasks.ceph.osd.2:Started 2023-11-04T01:42:02.278 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-04T01:42:02.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-04T01:42:02.280 INFO:tasks.ceph.osd.3:Started 2023-11-04T01:42:02.280 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-04T01:42:02.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-04T01:42:02.283 INFO:tasks.ceph.osd.4:Started 2023-11-04T01:42:02.283 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-04T01:42:02.283 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-04T01:42:02.285 INFO:tasks.ceph.osd.5:Started 2023-11-04T01:42:02.285 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-04T01:42:02.285 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-04T01:42:02.286 INFO:tasks.ceph.osd.6:Started 2023-11-04T01:42:02.287 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-04T01:42:02.287 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-04T01:42:02.289 INFO:tasks.ceph.osd.7:Started 2023-11-04T01:42:02.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:02.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7ff693640 1 Processor -- start 2023-11-04T01:42:02.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7ff693640 1 -- start start 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7ff693640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7f80d0690 0x7fc7f80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7ff693640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80b6070 con 0x7fc7f80b4990 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7ff693640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80b8ed0 con 0x7fc7f80d0ae0 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7ff693640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f80d1ce0 con 0x7fc7f80d0690 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7fcc2e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7f80d0690 0x7fc7f80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7fd42f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc7f80b4990 0x7fc7f80b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44874/0 (socket says 172.21.15.2:44874) 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7fcc2e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc7f80d0690 0x7fc7f80b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37450/0 (socket says 172.21.15.2:37450) 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7fd42f640 1 -- 172.21.15.2:0/303111894 learned_addr learned my addr 172.21.15.2:0/303111894 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7fcc2e640 1 -- 172.21.15.2:0/303111894 >> v1:172.21.15.90:6789/0 conn(0x7fc7f80d0ae0 legacy=0x7fc7f80b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7fcc2e640 1 -- 172.21.15.2:0/303111894 >> v1:172.21.15.2:6789/0 conn(0x7fc7f80b4990 legacy=0x7fc7f80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.414+0000 7fc7fcc2e640 1 -- 172.21.15.2:0/303111894 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80d1fc0 con 0x7fc7f80d0690 2023-11-04T01:42:02.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7fcc2e640 1 --2- 172.21.15.2:0/303111894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80d0690 0x7fc7f80b64e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097c0 tx=0x7fc7e801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb314de0371de622 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7effff640 1 -- 172.21.15.2:0/303111894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80a8970 con 0x7fc7f80d0690 2023-11-04T01:42:02.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7effff640 1 -- 172.21.15.2:0/303111894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e80a8ad0 con 0x7fc7f80d0690 2023-11-04T01:42:02.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7effff640 1 -- 172.21.15.2:0/303111894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80a8e60 con 0x7fc7f80d0690 2023-11-04T01:42:02.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 -- 172.21.15.2:0/303111894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80d0690 msgr2=0x7fc7f80b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 --2- 172.21.15.2:0/303111894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80d0690 0x7fc7f80b64e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80097c0 tx=0x7fc7e801ec70 comp rx=0 tx=0).stop 2023-11-04T01:42:02.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 -- 172.21.15.2:0/303111894 shutdown_connections 2023-11-04T01:42:02.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 --2- 172.21.15.2:0/303111894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80d0690 0x7fc7f80b64e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 -- 172.21.15.2:0/303111894 >> 172.21.15.2:0/303111894 conn(0x7fc7f80cf990 msgr2=0x7fc7f80cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 -- 172.21.15.2:0/303111894 shutdown_connections 2023-11-04T01:42:02.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 -- 172.21.15.2:0/303111894 wait complete. 2023-11-04T01:42:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 Processor -- start 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.418+0000 7fc7ff693640 1 -- start start 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80b4990 0x7fc7f8146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7f80d0690 0x7fc7f80b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7f80d0ae0 0x7fc7f80b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8159400 con 0x7fc7f80b4990 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81596a0 con 0x7fc7f80d0690 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8159980 con 0x7fc7f80d0ae0 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80b4990 0x7fc7f8146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80b4990 0x7fc7f8146150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37454/0 (socket says 172.21.15.2:37454) 2023-11-04T01:42:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 -- 172.21.15.2:0/1284721645 learned_addr learned my addr 172.21.15.2:0/1284721645 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fcc2e640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7f80d0690 0x7fc7f80b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fdc30640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7f80d0ae0 0x7fc7f80b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 -- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7f80d0ae0 msgr2=0x7fc7f80b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7f80d0ae0 0x7fc7f80b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 -- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7f80d0690 msgr2=0x7fc7f80b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7f80d0690 0x7fc7f80b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 -- 172.21.15.2:0/1284721645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009420 con 0x7fc7f80b4990 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fdc30640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7f80d0ae0 0x7fc7f80b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7fd42f640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80b4990 0x7fc7f8146150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000cbc0 tx=0x7fc7f000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7edffb640 1 -- 172.21.15.2:0/1284721645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000aca0 con 0x7fc7f80b4990 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7edffb640 1 -- 172.21.15.2:0/1284721645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000ae00 con 0x7fc7f80b4990 2023-11-04T01:42:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7edffb640 1 -- 172.21.15.2:0/1284721645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0012600 con 0x7fc7f80b4990 2023-11-04T01:42:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f8159c60 con 0x7fc7f80b4990 2023-11-04T01:42:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f8146690 con 0x7fc7f80b4990 2023-11-04T01:42:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7edffb640 1 -- 172.21.15.2:0/1284721645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc7f0012a60 con 0x7fc7f80b4990 2023-11-04T01:42:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7edffb640 1 -- 172.21.15.2:0/1284721645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc7f0012d10 con 0x7fc7f80b4990 2023-11-04T01:42:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.422+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8159e50 con 0x7fc7f80b4990 2023-11-04T01:42:02.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.426+0000 7fc7edffb640 1 -- 172.21.15.2:0/1284721645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc7f0021060 con 0x7fc7f80b4990 2023-11-04T01:42:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.482+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7f80744a0 con 0x7fc7f80b4990 2023-11-04T01:42:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.482+0000 7fc7edffb640 1 -- 172.21.15.2:0/1284721645 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc7f0017070 con 0x7fc7f80b4990 2023-11-04T01:42:02.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:02.484 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:02.252578+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80b4990 msgr2=0x7fc7f8146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80b4990 0x7fc7f8146150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000cbc0 tx=0x7fc7f000a060 comp rx=0 tx=0).stop 2023-11-04T01:42:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 shutdown_connections 2023-11-04T01:42:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7f80d0ae0 0x7fc7f80b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc7f80d0690 0x7fc7f80b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 --2- 172.21.15.2:0/1284721645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7f80b4990 0x7fc7f8146150 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 >> 172.21.15.2:0/1284721645 conn(0x7fc7f80cf990 msgr2=0x7fc7f80b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 shutdown_connections 2023-11-04T01:42:02.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:02.486+0000 7fc7ff693640 1 -- 172.21.15.2:0/1284721645 wait complete. 2023-11-04T01:42:02.500 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-04T01:42:02.500 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-04T01:42:02.779 INFO:tasks.ceph.mgr.x.smithi090.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-04T01:42:02.779 INFO:tasks.ceph.mgr.x.smithi090.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-04T01:42:02.779 INFO:tasks.ceph.mgr.x.smithi090.stderr: from numpy import show_config as show_numpy_config 2023-11-04T01:42:02.836 INFO:tasks.ceph.mgr.y.smithi002.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-04T01:42:02.836 INFO:tasks.ceph.mgr.y.smithi002.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-04T01:42:02.836 INFO:tasks.ceph.mgr.y.smithi002.stderr: from numpy import show_config as show_numpy_config 2023-11-04T01:42:02.854 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:02.850+0000 7fdca1d56180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:42:02.897 INFO:tasks.ceph.osd.7.smithi090.stderr:2023-11-04T01:42:02.894+0000 7fbcee868640 -1 Falling back to public interface 2023-11-04T01:42:02.906 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:02.906+0000 7f9d401d0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-04T01:42:02.913 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-04T01:42:02.914+0000 7fb059938640 -1 Falling back to public interface 2023-11-04T01:42:02.917 INFO:tasks.ceph.osd.4.smithi090.stderr:2023-11-04T01:42:02.914+0000 7f4e036c0640 -1 Falling back to public interface 2023-11-04T01:42:02.921 INFO:tasks.ceph.osd.5.smithi090.stderr:2023-11-04T01:42:02.918+0000 7f3f60729640 -1 Falling back to public interface 2023-11-04T01:42:02.924 INFO:tasks.ceph.osd.6.smithi090.stderr:2023-11-04T01:42:02.922+0000 7f4690172640 -1 Falling back to public interface 2023-11-04T01:42:02.928 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-04T01:42:02.930+0000 7f541e88b640 -1 Falling back to public interface 2023-11-04T01:42:02.930 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-04T01:42:02.930+0000 7ffa32260640 -1 Falling back to public interface 2023-11-04T01:42:02.933 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-04T01:42:02.934+0000 7f214e290640 -1 Falling back to public interface 2023-11-04T01:42:03.023 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:03.018+0000 7fdca1d56180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:42:03.078 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:03.078+0000 7f9d401d0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:42:03.209 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:03.206+0000 7fdca1d56180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:42:03.251 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:03.250+0000 7f9d401d0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-04T01:42:03.289 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:03.286+0000 7fdca1d56180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:42:03.306 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:03.323 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:03.322+0000 7f9d401d0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-04T01:42:03.423 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:03.418+0000 7fdca1d56180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:42:03.424 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.422+0000 7f8f38b54640 1 Processor -- start 2023-11-04T01:42:03.424 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.422+0000 7f8f38b54640 1 -- start start 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f38b54640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8f340b1960 0x7f8f340cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f38b54640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8f340b1d40 0x7f8f340ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f38b54640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f340cdc80 con 0x7f8f3415cd60 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f38b54640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f34071e40 con 0x7f8f340b1d40 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f38b54640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f340ca700 con 0x7f8f340b1960 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f32d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8f3415cd60 0x7f8f3415d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44878/0 (socket says 172.21.15.2:44878) 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f32d9d640 1 -- 172.21.15.2:0/2688185132 learned_addr learned my addr 172.21.15.2:0/2688185132 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f31d9b640 1 --2- 172.21.15.2:0/2688185132 >> v2:172.21.15.2:3300/0 conn(0x7f8f340b1d40 0x7f8f340ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.425 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f3259c640 1 --2- 172.21.15.2:0/2688185132 >> v2:172.21.15.90:3300/0 conn(0x7f8f340b1960 0x7f8f340cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.426 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f31d9b640 1 -- 172.21.15.2:0/2688185132 >> v2:172.21.15.90:3300/0 conn(0x7f8f340b1960 msgr2=0x7f8f340cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:03.426 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f31d9b640 1 --2- 172.21.15.2:0/2688185132 >> v2:172.21.15.90:3300/0 conn(0x7f8f340b1960 0x7f8f340cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.426 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f31d9b640 1 -- 172.21.15.2:0/2688185132 >> v1:172.21.15.2:6789/0 conn(0x7f8f3415cd60 legacy=0x7f8f3415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.426 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f31d9b640 1 -- 172.21.15.2:0/2688185132 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340cf5a0 con 0x7f8f340b1d40 2023-11-04T01:42:03.426 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f3159a640 1 -- 172.21.15.2:0/2688185132 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859817818 0 0) 0x7f8f340cdc80 con 0x7f8f3415cd60 2023-11-04T01:42:03.427 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f31d9b640 1 --2- 172.21.15.2:0/2688185132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f340b1d40 0x7f8f340ca1c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f34066f90 tx=0x7f8f2401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5154726fb92f155 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.427 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f3159a640 1 -- 172.21.15.2:0/2688185132 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240a7070 con 0x7f8f340b1d40 2023-11-04T01:42:03.427 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f3159a640 1 -- 172.21.15.2:0/2688185132 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f240ab430 con 0x7f8f340b1d40 2023-11-04T01:42:03.427 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.426+0000 7f8f3159a640 1 -- 172.21.15.2:0/2688185132 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240ab7c0 con 0x7f8f340b1d40 2023-11-04T01:42:03.428 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- 172.21.15.2:0/2688185132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f340b1d40 msgr2=0x7f8f340ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.428 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 --2- 172.21.15.2:0/2688185132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f340b1d40 0x7f8f340ca1c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f34066f90 tx=0x7f8f2401c430 comp rx=0 tx=0).stop 2023-11-04T01:42:03.429 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- 172.21.15.2:0/2688185132 shutdown_connections 2023-11-04T01:42:03.429 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 --2- 172.21.15.2:0/2688185132 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f340b1d40 0x7f8f340ca1c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.429 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 --2- 172.21.15.2:0/2688185132 >> v2:172.21.15.90:3300/0 conn(0x7f8f340b1960 0x7f8f340cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.429 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- 172.21.15.2:0/2688185132 >> 172.21.15.2:0/2688185132 conn(0x7f8f3406e760 msgr2=0x7f8f3406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.429 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- 172.21.15.2:0/2688185132 shutdown_connections 2023-11-04T01:42:03.429 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- 172.21.15.2:0/2688185132 wait complete. 2023-11-04T01:42:03.429 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 Processor -- start 2023-11-04T01:42:03.430 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- start start 2023-11-04T01:42:03.432 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f340b1960 0x7f8f340c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.432 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f340b1d40 0x7f8f340c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.432 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f3415cd60 0x7f8f3415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:03.432 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340c82d0 con 0x7f8f3415cd60 2023-11-04T01:42:03.432 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f341f8c70 con 0x7f8f340b1960 2023-11-04T01:42:03.432 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f341f8f50 con 0x7f8f340b1d40 2023-11-04T01:42:03.432 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f3415cd60 0x7f8f3415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f3415cd60 0x7f8f3415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37472/0 (socket says 172.21.15.2:37472) 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 -- 172.21.15.2:0/1637105464 learned_addr learned my addr 172.21.15.2:0/1637105464 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f3259c640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f340b1960 0x7f8f340c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f31d9b640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f340b1d40 0x7f8f340c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 -- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f340b1d40 msgr2=0x7f8f340c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f340b1d40 0x7f8f340c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 -- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f340b1960 msgr2=0x7f8f340c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f340b1960 0x7f8f340c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 -- 172.21.15.2:0/1637105464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009420 con 0x7f8f3415cd60 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f31d9b640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f340b1d40 0x7f8f340c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f32d9d640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f3415cd60 0x7f8f3415be70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00caf0 tx=0x7f8f2c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f22ffd640 1 -- 172.21.15.2:0/1637105464 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00ac00 con 0x7f8f3415cd60 2023-11-04T01:42:03.433 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f22ffd640 1 -- 172.21.15.2:0/1637105464 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00ad60 con 0x7f8f3415cd60 2023-11-04T01:42:03.434 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f22ffd640 1 -- 172.21.15.2:0/1637105464 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c012640 con 0x7f8f3415cd60 2023-11-04T01:42:03.434 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f341f9230 con 0x7f8f3415cd60 2023-11-04T01:42:03.434 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f341f97f0 con 0x7f8f3415cd60 2023-11-04T01:42:03.434 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f22ffd640 1 -- 172.21.15.2:0/1637105464 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8f2c012aa0 con 0x7f8f3415cd60 2023-11-04T01:42:03.434 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.430+0000 7f8f22ffd640 1 -- 172.21.15.2:0/1637105464 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8f2c012d50 con 0x7f8f3415cd60 2023-11-04T01:42:03.434 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.434+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f340675f0 con 0x7f8f3415cd60 2023-11-04T01:42:03.434 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.434+0000 7f8f22ffd640 1 -- 172.21.15.2:0/1637105464 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8f2c01b400 con 0x7f8f3415cd60 2023-11-04T01:42:03.466 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:03.466+0000 7f9d401d0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-04T01:42:03.492 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f34073be0 con 0x7f8f3415cd60 2023-11-04T01:42:03.493 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f22ffd640 1 -- 172.21.15.2:0/1637105464 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8f2c01b5a0 con 0x7f8f3415cd60 2023-11-04T01:42:03.493 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-04T01:42:03.493 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:02.252578+0000","last_up_change":"0.000000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:03.494 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f3415cd60 msgr2=0x7f8f3415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:03.494 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f3415cd60 0x7f8f3415be70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00caf0 tx=0x7f8f2c0021d0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.494 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 shutdown_connections 2023-11-04T01:42:03.494 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f3415cd60 0x7f8f3415be70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.495 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8f340b1d40 0x7f8f340c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.495 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 --2- 172.21.15.2:0/1637105464 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f340b1960 0x7f8f340c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:03.495 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 >> 172.21.15.2:0/1637105464 conn(0x7f8f3406e760 msgr2=0x7f8f340ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:03.495 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 shutdown_connections 2023-11-04T01:42:03.495 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:03.494+0000 7f8f38b54640 1 -- 172.21.15.2:0/1637105464 wait complete. 2023-11-04T01:42:03.509 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-04T01:42:04.056 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:04.054+0000 7fdca1d56180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:42:04.099 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:04.098+0000 7f9d401d0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-04T01:42:04.131 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:04.126+0000 7fdca1d56180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:42:04.177 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:04.178+0000 7f9d401d0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-04T01:42:04.300 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:04.298+0000 7fdca1d56180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:42:04.355 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:04.354+0000 7f9d401d0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-04T01:42:04.373 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:04.370+0000 7fdca1d56180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:42:04.432 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:04.430+0000 7f9d401d0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-04T01:42:04.663 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:04.658+0000 7fdca1d56180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:42:04.722 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:04.718+0000 7fdca1d56180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:42:04.737 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:04.738+0000 7f9d401d0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-04T01:42:04.801 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-04T01:42:04.802+0000 7f9d401d0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-04T01:42:05.762 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:05.758+0000 7fdc494e1640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-04T01:42:05.762 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:42:05.758+0000 7fdc494e1640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-04T01:42:06.633 INFO:tasks.ceph.osd.7.smithi090.stderr:2023-11-04T01:42:06.630+0000 7fbcee868640 -1 osd.7 0 log_to_monitors true 2023-11-04T01:42:06.743 INFO:tasks.ceph.osd.4.smithi090.stderr:2023-11-04T01:42:06.738+0000 7f4e036c0640 -1 osd.4 0 log_to_monitors true 2023-11-04T01:42:06.816 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-04T01:42:06.813+0000 7fb059938640 -1 osd.3 0 log_to_monitors true 2023-11-04T01:42:06.835 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-04T01:42:06.833+0000 7f541e88b640 -1 osd.0 0 log_to_monitors true 2023-11-04T01:42:06.841 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-04T01:42:06.841+0000 7f214e290640 -1 osd.2 0 log_to_monitors true 2023-11-04T01:42:06.864 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-04T01:42:06.861+0000 7ffa32260640 -1 osd.1 0 log_to_monitors true 2023-11-04T01:42:06.864 INFO:tasks.ceph.osd.6.smithi090.stderr:2023-11-04T01:42:06.862+0000 7f4690172640 -1 osd.6 0 log_to_monitors true 2023-11-04T01:42:06.869 INFO:tasks.ceph.osd.5.smithi090.stderr:2023-11-04T01:42:06.866+0000 7f3f60729640 -1 osd.5 0 log_to_monitors true 2023-11-04T01:42:09.522 INFO:tasks.ceph.osd.7.smithi090.stderr:2023-11-04T01:42:09.518+0000 7fbce9fef640 -1 osd.7 0 waiting for initial osdmap 2023-11-04T01:42:09.587 INFO:tasks.ceph.osd.4.smithi090.stderr:2023-11-04T01:42:09.578+0000 7f4dfee47640 -1 osd.4 0 waiting for initial osdmap 2023-11-04T01:42:09.588 INFO:tasks.ceph.osd.7.smithi090.stderr:2023-11-04T01:42:09.550+0000 7fbce263c640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:09.629 INFO:tasks.ceph.osd.4.smithi090.stderr:2023-11-04T01:42:09.626+0000 7f4df7494640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:10.143 INFO:tasks.ceph.osd.6.smithi090.stderr:2023-11-04T01:42:10.138+0000 7f468b8f9640 -1 osd.6 0 waiting for initial osdmap 2023-11-04T01:42:10.168 INFO:tasks.ceph.osd.6.smithi090.stderr:2023-11-04T01:42:10.166+0000 7f4683f46640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:10.212 INFO:tasks.ceph.osd.5.smithi090.stderr:2023-11-04T01:42:10.210+0000 7f3f5beb0640 -1 osd.5 0 waiting for initial osdmap 2023-11-04T01:42:10.241 INFO:tasks.ceph.osd.5.smithi090.stderr:2023-11-04T01:42:10.238+0000 7f3f544fd640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:10.316 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:10.396 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-04T01:42:10.393+0000 7f2149a17640 -1 osd.2 0 waiting for initial osdmap 2023-11-04T01:42:10.438 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-04T01:42:10.437+0000 7f2142064640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:10.448 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-04T01:42:10.445+0000 7fb0550bf640 -1 osd.3 0 waiting for initial osdmap 2023-11-04T01:42:10.471 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f64a004b640 1 Processor -- start 2023-11-04T01:42:10.471 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f64a004b640 1 -- start start 2023-11-04T01:42:10.472 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f64a004b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f649815a080 0x7f6498065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.472 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f64a004b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f649806a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.472 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f64a004b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980cc740 con 0x7f649815e7f0 2023-11-04T01:42:10.472 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f64a004b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6498066510 con 0x7f649815a080 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f64a004b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649806c300 con 0x7f649815e340 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649dde7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f649815a080 0x7f6498065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649d5e6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f649815e7f0 0x7f649815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44890/0 (socket says 172.21.15.2:44890) 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649d5e6640 1 -- 172.21.15.2:0/3379061796 learned_addr learned my addr 172.21.15.2:0/3379061796 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649e5e8640 1 --2- 172.21.15.2:0/3379061796 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f649806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649dde7640 1 -- 172.21.15.2:0/3379061796 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 msgr2=0x7f649806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649dde7640 1 --2- 172.21.15.2:0/3379061796 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f649806a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649dde7640 1 -- 172.21.15.2:0/3379061796 >> v1:172.21.15.2:6789/0 conn(0x7f649815e7f0 legacy=0x7f649815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649dde7640 1 -- 172.21.15.2:0/3379061796 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649806c020 con 0x7f649815a080 2023-11-04T01:42:10.473 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.469+0000 7f649e5e8640 1 --2- 172.21.15.2:0/3379061796 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f649806a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:10.474 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f649dde7640 1 --2- 172.21.15.2:0/3379061796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f649815a080 0x7f6498065fd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f64940097c0 tx=0x7f649401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195d9bb03bbaae31 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.474 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f649cde5640 1 -- 172.21.15.2:0/3379061796 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940ab600 con 0x7f649815a080 2023-11-04T01:42:10.474 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f649cde5640 1 -- 172.21.15.2:0/3379061796 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940a7050 con 0x7f649815a080 2023-11-04T01:42:10.474 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f649cde5640 1 -- 172.21.15.2:0/3379061796 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64940ab980 con 0x7f649815a080 2023-11-04T01:42:10.475 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 -- 172.21.15.2:0/3379061796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f649815a080 msgr2=0x7f6498065fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.475 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 --2- 172.21.15.2:0/3379061796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f649815a080 0x7f6498065fd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f64940097c0 tx=0x7f649401c3a0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.476 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 -- 172.21.15.2:0/3379061796 shutdown_connections 2023-11-04T01:42:10.476 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 --2- 172.21.15.2:0/3379061796 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f649806a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.476 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 --2- 172.21.15.2:0/3379061796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f649815a080 0x7f6498065fd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.476 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 -- 172.21.15.2:0/3379061796 >> 172.21.15.2:0/3379061796 conn(0x7f64980716a0 msgr2=0x7f6498071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.476 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 -- 172.21.15.2:0/3379061796 shutdown_connections 2023-11-04T01:42:10.476 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.473+0000 7f64a004b640 1 -- 172.21.15.2:0/3379061796 wait complete. 2023-11-04T01:42:10.477 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 Processor -- start 2023-11-04T01:42:10.477 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 -- start start 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f64981f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f649815e7f0 0x7f649814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64980ad5f0 0x7f649815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980b1e00 con 0x7f64980ad5f0 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980af0c0 con 0x7f649815e7f0 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64981f4960 con 0x7f649815e340 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64980ad5f0 0x7f649815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64980ad5f0 0x7f649815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37538/0 (socket says 172.21.15.2:37538) 2023-11-04T01:42:10.479 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 -- 172.21.15.2:0/1705682671 learned_addr learned my addr 172.21.15.2:0/1705682671 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649d5e6640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f649815e7f0 0x7f649814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649dde7640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f64981f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 -- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 msgr2=0x7f64981f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f64981f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 -- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f649815e7f0 msgr2=0x7f649814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f649815e7f0 0x7f649814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 -- 172.21.15.2:0/1705682671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494009420 con 0x7f64980ad5f0 2023-11-04T01:42:10.480 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f649e5e8640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64980ad5f0 0x7f649815c8d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f649000cf20 tx=0x7f649000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.481 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f648e7fc640 1 -- 172.21.15.2:0/1705682671 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000d840 con 0x7f64980ad5f0 2023-11-04T01:42:10.481 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f648e7fc640 1 -- 172.21.15.2:0/1705682671 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649000d9a0 con 0x7f64980ad5f0 2023-11-04T01:42:10.481 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649814ee50 con 0x7f64980ad5f0 2023-11-04T01:42:10.481 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f648e7fc640 1 -- 172.21.15.2:0/1705682671 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000dd50 con 0x7f64980ad5f0 2023-11-04T01:42:10.481 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.477+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64981f4e70 con 0x7f64980ad5f0 2023-11-04T01:42:10.481 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.481+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64980af200 con 0x7f64980ad5f0 2023-11-04T01:42:10.482 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-04T01:42:10.481+0000 7fb04d70c640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:10.482 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.481+0000 7f648e7fc640 1 -- 172.21.15.2:0/1705682671 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f649001d360 con 0x7f64980ad5f0 2023-11-04T01:42:10.482 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.481+0000 7f648e7fc640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f647c066490 0x7f647c068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:10.482 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.481+0000 7f648e7fc640 1 -- 172.21.15.2:0/1705682671 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f64900838c0 con 0x7f64980ad5f0 2023-11-04T01:42:10.489 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.489+0000 7f649dde7640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f647c066490 0x7f647c068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:10.489 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.489+0000 7f649dde7640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f647c066490 0x7f647c068950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64940ad000 tx=0x7f6494008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:10.491 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.489+0000 7f648e7fc640 1 -- 172.21.15.2:0/1705682671 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64980af200 con 0x7f64980ad5f0 2023-11-04T01:42:10.559 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-04T01:42:10.557+0000 7ffa2d9e7640 -1 osd.1 0 waiting for initial osdmap 2023-11-04T01:42:10.569 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-04T01:42:10.569+0000 7f541a012640 -1 osd.0 0 waiting for initial osdmap 2023-11-04T01:42:10.589 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-04T01:42:10.589+0000 7ffa26034640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:10.610 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-04T01:42:10.609+0000 7f541265f640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-04T01:42:10.668 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.665+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64980af200 con 0x7f64980ad5f0 2023-11-04T01:42:10.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.669+0000 7f648e7fc640 1 -- 172.21.15.2:0/1705682671 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9876 (secure 0 0 0) 0x7f64980af200 con 0x7f64980ad5f0 2023-11-04T01:42:10.670 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-04T01:42:10.670 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":14,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:10.527045+0000","last_up_change":"2023-11-04T01:42:10.527045+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:10.673 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f647c066490 msgr2=0x7f647c068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.673 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f647c066490 0x7f647c068950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f64940ad000 tx=0x7f6494008040 comp rx=0 tx=0).stop 2023-11-04T01:42:10.673 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64980ad5f0 msgr2=0x7f649815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64980ad5f0 0x7f649815c8d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f649000cf20 tx=0x7f649000a7d0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 shutdown_connections 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f647c066490 0x7f647c068950 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64980ad5f0 0x7f649815c8d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f649815e7f0 0x7f649814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 --2- 172.21.15.2:0/1705682671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f649815e340 0x7f64981f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 >> 172.21.15.2:0/1705682671 conn(0x7f64980716a0 msgr2=0x7f64981598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 shutdown_connections 2023-11-04T01:42:10.674 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:10.673+0000 7f64a004b640 1 -- 172.21.15.2:0/1705682671 wait complete. 2023-11-04T01:42:10.687 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-11-04T01:42:17.495 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:17.620 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.616+0000 7fe30c7c6640 1 Processor -- start 2023-11-04T01:42:17.620 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.616+0000 7fe30c7c6640 1 -- start start 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30c7c6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 0x7fe304065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30c7c6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040cc740 con 0x7fe30415e7f0 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30c7c6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30406c300 con 0x7fe30415e340 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30c7c6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe304066510 con 0x7fe30415a080 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309d61640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe30415e7f0 0x7fe30415dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35620/0 (socket says 172.21.15.2:35620) 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309d61640 1 -- 172.21.15.2:0/4201850511 learned_addr learned my addr 172.21.15.2:0/4201850511 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30a562640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 0x7fe304065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657363995 0 0) 0x7fe3040cc740 con 0x7fe30415e7f0 2023-11-04T01:42:17.622 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f0005740 con 0x7fe30415e7f0 2023-11-04T01:42:17.624 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1825064526 0 0) 0x7fe2f0005740 con 0x7fe30415e7f0 2023-11-04T01:42:17.624 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 msgr2=0x7fe304065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.624 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 0x7fe304065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.624 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 >> v1:172.21.15.90:6789/0 conn(0x7fe30415e340 legacy=0x7fe30406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.624 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30406c020 con 0x7fe30415e7f0 2023-11-04T01:42:17.624 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fe2f4001680 con 0x7fe30415e7f0 2023-11-04T01:42:17.624 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 >> v1:172.21.15.2:6789/0 conn(0x7fe30415e7f0 legacy=0x7fe30415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2f0005bc0 0x7fe2f0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 0x7fe2f00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe2f00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe304066510 con 0x7fe2f0006f20 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f000dc50 con 0x7fe2f0005bc0 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f000de10 con 0x7fe30415a080 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30ad63640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe2f00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30a562640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2f0005bc0 0x7fe2f0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309d61640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 0x7fe2f00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30ad63640 1 -- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 msgr2=0x7fe2f00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30ad63640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe30415a080 0x7fe2f00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.625 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30ad63640 1 -- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2f0005bc0 msgr2=0x7fe2f0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:17.626 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30ad63640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe2f0005bc0 0x7fe2f0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.626 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30ad63640 1 -- 172.21.15.2:0/4201850511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0005740 con 0x7fe2f0006f20 2023-11-04T01:42:17.627 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe30ad63640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe2f00073a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001e40 tx=0x7fe2fc01c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd5f5f850bb0b7b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.627 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc003b80 con 0x7fe2f0006f20 2023-11-04T01:42:17.627 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc003ce0 con 0x7fe2f0006f20 2023-11-04T01:42:17.627 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.620+0000 7fe309560640 1 -- 172.21.15.2:0/4201850511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0052c0 con 0x7fe2f0006f20 2023-11-04T01:42:17.627 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4201850511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 msgr2=0x7fe2f00073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.627 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 --2- 172.21.15.2:0/4201850511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe2f00073a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001e40 tx=0x7fe2fc01c740 comp rx=0 tx=0).stop 2023-11-04T01:42:17.628 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30ad63640 1 -- 172.21.15.2:0/4201850511 reap_dead start 2023-11-04T01:42:17.628 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4201850511 shutdown_connections 2023-11-04T01:42:17.628 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4201850511 >> 172.21.15.2:0/4201850511 conn(0x7fe3040716a0 msgr2=0x7fe304071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.628 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4201850511 shutdown_connections 2023-11-04T01:42:17.628 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4201850511 wait complete. 2023-11-04T01:42:17.628 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 Processor -- start 2023-11-04T01:42:17.628 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- start start 2023-11-04T01:42:17.630 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe304156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.630 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3040b0ec0 0x7fe304155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3040c51b0 0x7fe3040c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040b03f0 con 0x7fe2f0006f20 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040b0a50 con 0x7fe3040b0ec0 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040afe30 con 0x7fe3040c51b0 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe304156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe304156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49060/0 (socket says 172.21.15.2:49060) 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 -- 172.21.15.2:0/4059351314 learned_addr learned my addr 172.21.15.2:0/4059351314 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe309d61640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3040b0ec0 0x7fe304155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30ad63640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3040c51b0 0x7fe3040c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 -- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3040c51b0 msgr2=0x7fe3040c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3040c51b0 0x7fe3040c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.631 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 -- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3040b0ec0 msgr2=0x7fe304155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3040b0ec0 0x7fe304155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 -- 172.21.15.2:0/4059351314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040b0110 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30a562640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe304156390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3000115e0 tx=0x7fe300011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe2faffd640 1 -- 172.21.15.2:0/4059351314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000f8f0 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe2faffd640 1 -- 172.21.15.2:0/4059351314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000fa50 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3040b1540 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe2faffd640 1 -- 172.21.15.2:0/4059351314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000fdc0 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.624+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe304156070 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.628+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3040675f0 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.628+0000 7fe2faffd640 1 -- 172.21.15.2:0/4059351314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe300015460 con 0x7fe2f0006f20 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.628+0000 7fe2faffd640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe2e80664d0 0x7fe2e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.632 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.628+0000 7fe2faffd640 1 -- 172.21.15.2:0/4059351314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe300083f70 con 0x7fe2f0006f20 2023-11-04T01:42:17.633 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.628+0000 7fe309d61640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe2e80664d0 0x7fe2e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.633 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.628+0000 7fe309d61640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe2e80664d0 0x7fe2e8068990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe3041587b0 tx=0x7fe2f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.635 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.632+0000 7fe2faffd640 1 -- 172.21.15.2:0/4059351314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3000b5090 con 0x7fe2f0006f20 2023-11-04T01:42:17.790 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.788+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe304159e60 con 0x7fe2f0006f20 2023-11-04T01:42:17.792 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.788+0000 7fe2faffd640 1 -- 172.21.15.2:0/4059351314 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12742 (secure 0 0 0) 0x7fe300022090 con 0x7fe2f0006f20 2023-11-04T01:42:17.792 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-04T01:42:17.792 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":17,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:13.579944+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:17.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe2e80664d0 msgr2=0x7fe2e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe2e80664d0 0x7fe2e8068990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe3041587b0 tx=0x7fe2f4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:17.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 msgr2=0x7fe304156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe304156390 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe3000115e0 tx=0x7fe300011aa0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 shutdown_connections 2023-11-04T01:42:17.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe2e80664d0 0x7fe2e8068990 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3040c51b0 0x7fe3040c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3040b0ec0 0x7fe304155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 --2- 172.21.15.2:0/4059351314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2f0006f20 0x7fe304156390 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 >> 172.21.15.2:0/4059351314 conn(0x7fe3040716a0 msgr2=0x7fe30406ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 shutdown_connections 2023-11-04T01:42:17.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-04T01:42:17.792+0000 7fe30c7c6640 1 -- 172.21.15.2:0/4059351314 wait complete. 2023-11-04T01:42:17.809 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-04T01:42:17.809 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-04T01:42:17.810 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:42:17.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:42:17.812 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:42:17.812 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:42:17.812 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:42:17.814 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:42:17.814 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:42:17.814 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:42:17.817 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:42:17.817 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:42:17.817 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:42:17.819 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:42:17.820 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-04T01:42:17.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:17.878 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:42:17.880 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:42:17.900 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:42:17.903 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:42:17.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.928+0000 7fb030e87640 1 Processor -- start 2023-11-04T01:42:17.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.928+0000 7fb030e87640 1 -- start start 2023-11-04T01:42:17.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.928+0000 7fb030e87640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c15af80 0x7fb02c0ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.928+0000 7fb030e87640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c15b360 con 0x7fb02c0b1e10 2023-11-04T01:42:17.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.928+0000 7fb030e87640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c071880 con 0x7fb02c06ace0 2023-11-04T01:42:17.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.928+0000 7fb030e87640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c071b60 con 0x7fb02c15af80 2023-11-04T01:42:17.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb02ad9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb02c0b1e10 0x7fb02c15eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35632/0 (socket says 172.21.15.2:35632) 2023-11-04T01:42:17.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb02ad9d640 1 -- 172.21.15.2:0/2215473589 learned_addr learned my addr 172.21.15.2:0/2215473589 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:17.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb02a59c640 1 --2- 172.21.15.2:0/2215473589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c15af80 0x7fb02c0ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb029d9b640 1 -- 172.21.15.2:0/2215473589 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482601034 0 0) 0x7fb02c15b360 con 0x7fb02c0b1e10 2023-11-04T01:42:17.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb029d9b640 1 -- 172.21.15.2:0/2215473589 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb018003530 con 0x7fb02c0b1e10 2023-11-04T01:42:17.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb029d9b640 1 -- 172.21.15.2:0/2215473589 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3513625224 0 0) 0x7fb018003530 con 0x7fb02c0b1e10 2023-11-04T01:42:17.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb02a59c640 1 -- 172.21.15.2:0/2215473589 >> v1:172.21.15.90:6789/0 conn(0x7fb02c06ace0 legacy=0x7fb02c0b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb02a59c640 1 -- 172.21.15.2:0/2215473589 >> v1:172.21.15.2:6789/0 conn(0x7fb02c0b1e10 legacy=0x7fb02c15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb02a59c640 1 -- 172.21.15.2:0/2215473589 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c06a200 con 0x7fb02c15af80 2023-11-04T01:42:17.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb02a59c640 1 --2- 172.21.15.2:0/2215473589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c15af80 0x7fb02c0ca1c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097f0 tx=0x7fb01c01c200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f7335d06be14ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb029d9b640 1 -- 172.21.15.2:0/2215473589 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb024001a00 con 0x7fb02c15af80 2023-11-04T01:42:17.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb029d9b640 1 -- 172.21.15.2:0/2215473589 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c0a7050 con 0x7fb02c15af80 2023-11-04T01:42:17.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb029d9b640 1 -- 172.21.15.2:0/2215473589 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c0ab620 con 0x7fb02c15af80 2023-11-04T01:42:17.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb030e87640 1 -- 172.21.15.2:0/2215473589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c15af80 msgr2=0x7fb02c0ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb030e87640 1 --2- 172.21.15.2:0/2215473589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c15af80 0x7fb02c0ca1c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0097f0 tx=0x7fb01c01c200 comp rx=0 tx=0).stop 2023-11-04T01:42:17.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb030e87640 1 -- 172.21.15.2:0/2215473589 shutdown_connections 2023-11-04T01:42:17.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb030e87640 1 --2- 172.21.15.2:0/2215473589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c15af80 0x7fb02c0ca1c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb030e87640 1 -- 172.21.15.2:0/2215473589 >> 172.21.15.2:0/2215473589 conn(0x7fb02c06e760 msgr2=0x7fb02c06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:17.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb030e87640 1 -- 172.21.15.2:0/2215473589 shutdown_connections 2023-11-04T01:42:17.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.932+0000 7fb030e87640 1 -- 172.21.15.2:0/2215473589 wait complete. 2023-11-04T01:42:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 Processor -- start 2023-11-04T01:42:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 -- start start 2023-11-04T01:42:17.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c06ace0 0x7fb02c0c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02c0b1e10 0x7fb02c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb02c15af80 0x7fb02c141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c153da0 con 0x7fb02c0b1e10 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c153120 con 0x7fb02c15af80 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c153400 con 0x7fb02c06ace0 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02c0b1e10 0x7fb02c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02c0b1e10 0x7fb02c1527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49104/0 (socket says 172.21.15.2:49104) 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 -- 172.21.15.2:0/1019793612 learned_addr learned my addr 172.21.15.2:0/1019793612 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb02a59c640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c06ace0 0x7fb02c0c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb02ad9d640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb02c15af80 0x7fb02c141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 -- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c06ace0 msgr2=0x7fb02c0c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c06ace0 0x7fb02c0c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 -- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb02c15af80 msgr2=0x7fb02c141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb02c15af80 0x7fb02c141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 -- 172.21.15.2:0/1019793612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c009420 con 0x7fb02c0b1e10 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb023fff640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02c0b1e10 0x7fb02c1527b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c750 tx=0x7fb01400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb022ffd640 1 -- 172.21.15.2:0/1019793612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014005270 con 0x7fb02c0b1e10 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb022ffd640 1 -- 172.21.15.2:0/1019793612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0140053f0 con 0x7fb02c0b1e10 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c1536e0 con 0x7fb02c0b1e10 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb022ffd640 1 -- 172.21.15.2:0/1019793612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400a880 con 0x7fb02c0b1e10 2023-11-04T01:42:17.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c0c5860 con 0x7fb02c0b1e10 2023-11-04T01:42:17.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c0675f0 con 0x7fb02c0b1e10 2023-11-04T01:42:17.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.936+0000 7fb022ffd640 1 -- 172.21.15.2:0/1019793612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb01400a9e0 con 0x7fb02c0b1e10 2023-11-04T01:42:17.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.940+0000 7fb022ffd640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb00c0664a0 0x7fb00c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:17.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.940+0000 7fb022ffd640 1 -- 172.21.15.2:0/1019793612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb014083190 con 0x7fb02c0b1e10 2023-11-04T01:42:17.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.940+0000 7fb02a59c640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb00c0664a0 0x7fb00c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:17.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.940+0000 7fb02a59c640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb00c0664a0 0x7fb00c068960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ad000 tx=0x7fb01c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:17.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:17.944+0000 7fb022ffd640 1 -- 172.21.15.2:0/1019793612 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb014050a50 con 0x7fb02c0b1e10 2023-11-04T01:42:18.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb02c0b25b0 con 0x7fb02c0b1e10 2023-11-04T01:42:18.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb022ffd640 1 -- 172.21.15.2:0/1019793612 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12742 (secure 0 0 0) 0x7fb014054070 con 0x7fb02c0b1e10 2023-11-04T01:42:18.103 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:18.103 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:13.579944+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb00c0664a0 msgr2=0x7fb00c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb00c0664a0 0x7fb00c068960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ad000 tx=0x7fb01c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:42:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02c0b1e10 msgr2=0x7fb02c1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02c0b1e10 0x7fb02c1527b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c750 tx=0x7fb01400cc10 comp rx=0 tx=0).stop 2023-11-04T01:42:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 shutdown_connections 2023-11-04T01:42:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb00c0664a0 0x7fb00c068960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb02c15af80 0x7fb02c141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb02c0b1e10 0x7fb02c1527b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 --2- 172.21.15.2:0/1019793612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb02c06ace0 0x7fb02c0c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 >> 172.21.15.2:0/1019793612 conn(0x7fb02c06e760 msgr2=0x7fb02c155ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 shutdown_connections 2023-11-04T01:42:18.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.100+0000 7fb030e87640 1 -- 172.21.15.2:0/1019793612 wait complete. 2023-11-04T01:42:18.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:18.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f741642a640 1 Processor -- start 2023-11-04T01:42:18.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f741642a640 1 -- start start 2023-11-04T01:42:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f741642a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 0x7f74100cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f741642a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f741015e490 0x7f74100cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f741642a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741006c0c0 con 0x7f741006d160 2023-11-04T01:42:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f741642a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7410071200 con 0x7f741015e490 2023-11-04T01:42:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f741642a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741006c3a0 con 0x7f741015af70 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f741006d160 0x7f741015dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35636/0 (socket says 172.21.15.2:35636) 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740f7fe640 1 -- 172.21.15.2:0/3884661119 learned_addr learned my addr 172.21.15.2:0/3884661119 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740ffff640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 0x7f74100cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f74149c7640 1 --2- 172.21.15.2:0/3884661119 >> v2:172.21.15.90:3300/0 conn(0x7f741015e490 0x7f74100cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367618444 0 0) 0x7f741006c0c0 con 0x7f741006d160 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73f8005740 con 0x7f741006d160 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908273155 0 0) 0x7f73f8005740 con 0x7f741006d160 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 msgr2=0x7f74100cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 0x7f74100cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 >> v2:172.21.15.90:3300/0 conn(0x7f741015e490 msgr2=0x7f74100cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 --2- 172.21.15.2:0/3884661119 >> v2:172.21.15.90:3300/0 conn(0x7f741015e490 0x7f74100cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741006c680 con 0x7f741006d160 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f7404001680 con 0x7f741006d160 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 >> v1:172.21.15.2:6789/0 conn(0x7f741006d160 legacy=0x7f741015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f73f8005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 0x7f73f80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8006f20 0x7f73f80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7410071200 con 0x7f73f8005b90 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741006c3a0 con 0x7f73f8006f20 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f800dba0 con 0x7f741015af70 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740ffff640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f73f8005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f74149c7640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8006f20 0x7f73f80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740f7fe640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 0x7f73f80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740ffff640 1 -- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 msgr2=0x7f73f80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740ffff640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f741015af70 0x7f73f80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740ffff640 1 -- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8006f20 msgr2=0x7f73f80073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740ffff640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8006f20 0x7f73f80073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.240+0000 7f740ffff640 1 -- 172.21.15.2:0/3884661119 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8005740 con 0x7f73f8005b90 2023-11-04T01:42:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f740ffff640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f73f8005fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7400009ae0 tx=0x7f740001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a673f659771f3d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000a6430 con 0x7f73f8005b90 2023-11-04T01:42:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74000a6590 con 0x7f73f8005b90 2023-11-04T01:42:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f740effd640 1 -- 172.21.15.2:0/3884661119 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000a6940 con 0x7f73f8005b90 2023-11-04T01:42:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f741642a640 1 -- 172.21.15.2:0/3884661119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 msgr2=0x7f73f8005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f741642a640 1 --2- 172.21.15.2:0/3884661119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f73f8005fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7400009ae0 tx=0x7f740001ca50 comp rx=0 tx=0).stop 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f74149c7640 1 -- 172.21.15.2:0/3884661119 reap_dead start 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f741642a640 1 -- 172.21.15.2:0/3884661119 shutdown_connections 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f741642a640 1 -- 172.21.15.2:0/3884661119 >> 172.21.15.2:0/3884661119 conn(0x7f74100cb510 msgr2=0x7f74100cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f741642a640 1 -- 172.21.15.2:0/3884661119 shutdown_connections 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f741642a640 1 -- 172.21.15.2:0/3884661119 wait complete. 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.244+0000 7f741642a640 1 Processor -- start 2023-11-04T01:42:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 -- start start 2023-11-04T01:42:18.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f74100af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74100b2410 0x7f74100b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74100c6f70 0x7f74100c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100c6b50 con 0x7f73f8005b90 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74101f1640 con 0x7f74100c6f70 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74100afbf0 con 0x7f74100b2410 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f74100af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f74100af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49128/0 (socket says 172.21.15.2:49128) 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 -- 172.21.15.2:0/837428535 learned_addr learned my addr 172.21.15.2:0/837428535 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740f7fe640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74100b2410 0x7f74100b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f74149c7640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74100c6f70 0x7f74100c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 -- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74100b2410 msgr2=0x7f74100b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74100b2410 0x7f74100b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 -- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74100c6f70 msgr2=0x7f74100c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74100c6f70 0x7f74100c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 -- 172.21.15.2:0/837428535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74100c5ed0 con 0x7f73f8005b90 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740f7fe640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74100b2410 0x7f74100b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740ffff640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f74100af280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f740001c880 tx=0x7f73f8007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740cff9640 1 -- 172.21.15.2:0/837428535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000f000 con 0x7f73f8005b90 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740cff9640 1 -- 172.21.15.2:0/837428535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74000a6d80 con 0x7f73f8005b90 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74100c61b0 con 0x7f73f8005b90 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740cff9640 1 -- 172.21.15.2:0/837428535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000b9630 con 0x7f73f8005b90 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74100c6770 con 0x7f73f8005b90 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74100744a0 con 0x7f73f8005b90 2023-11-04T01:42:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740cff9640 1 -- 172.21.15.2:0/837428535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74000a7410 con 0x7f73f8005b90 2023-11-04T01:42:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740cff9640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73fc0664d0 0x7f73fc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740cff9640 1 -- 172.21.15.2:0/837428535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f740011d780 con 0x7f73f8005b90 2023-11-04T01:42:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.248+0000 7f740f7fe640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73fc0664d0 0x7f73fc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.252+0000 7f740f7fe640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73fc0664d0 0x7f73fc068990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7404001ec0 tx=0x7f7404000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.252+0000 7f740cff9640 1 -- 172.21.15.2:0/837428535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74000eb100 con 0x7f73f8005b90 2023-11-04T01:42:18.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.404+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f741006b950 con 0x7f73f8005b90 2023-11-04T01:42:18.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f740cff9640 1 -- 172.21.15.2:0/837428535 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74000be0a0 con 0x7f73f8005b90 2023-11-04T01:42:18.409 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73fc0664d0 msgr2=0x7f73fc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73fc0664d0 0x7f73fc068990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7404001ec0 tx=0x7f7404000f80 comp rx=0 tx=0).stop 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 msgr2=0x7f74100af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f74100af280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f740001c880 tx=0x7f73f8007a10 comp rx=0 tx=0).stop 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 shutdown_connections 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73fc0664d0 0x7f73fc068990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74100c6f70 0x7f74100c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74100b2410 0x7f74100b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 --2- 172.21.15.2:0/837428535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8005b90 0x7f74100af280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 >> 172.21.15.2:0/837428535 conn(0x7f74100cb510 msgr2=0x7f7410158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 shutdown_connections 2023-11-04T01:42:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.408+0000 7f741642a640 1 -- 172.21.15.2:0/837428535 wait complete. 2023-11-04T01:42:18.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:18.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0d019df640 1 Processor -- start 2023-11-04T01:42:18.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0d019df640 1 -- start start 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0d019df640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0cfc0d0690 0x7f0cfc0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0d019df640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0cfc0d0ae0 0x7f0cfc0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0d019df640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0b6070 con 0x7f0cfc0b4990 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0d019df640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc0b8ed0 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0d019df640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc0d1ce0 con 0x7f0cfc0d0690 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0cfc0d0ae0 0x7f0cfc0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0cfc0d0ae0 0x7f0cfc0b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49140/0 (socket says 172.21.15.2:49140) 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/2088324517 learned_addr learned my addr 172.21.15.2:0/2088324517 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfa7fc640 1 --2- 172.21.15.2:0/2088324517 >> v2:172.21.15.90:3300/0 conn(0x7f0cfc0d0690 0x7f0cfc0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/2088324517 >> v2:172.21.15.90:3300/0 conn(0x7f0cfc0d0690 msgr2=0x7f0cfc0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfb7fe640 1 --2- 172.21.15.2:0/2088324517 >> v2:172.21.15.90:3300/0 conn(0x7f0cfc0d0690 0x7f0cfc0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/2088324517 >> v1:172.21.15.90:6789/0 conn(0x7f0cfc0b4990 legacy=0x7f0cfc0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.540+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/2088324517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0d1fc0 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0cfb7fe640 1 --2- 172.21.15.2:0/2088324517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0b6a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc08c090 tx=0x7f0cec01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891052faf9318ab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0cf9ffb640 1 -- 172.21.15.2:0/2088324517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0a89f0 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0cf9ffb640 1 -- 172.21.15.2:0/2088324517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0a8b50 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0cf9ffb640 1 -- 172.21.15.2:0/2088324517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0b0440 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- 172.21.15.2:0/2088324517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 msgr2=0x7f0cfc0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 --2- 172.21.15.2:0/2088324517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0b6a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc08c090 tx=0x7f0cec01ecf0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- 172.21.15.2:0/2088324517 shutdown_connections 2023-11-04T01:42:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 --2- 172.21.15.2:0/2088324517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0b6a20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 --2- 172.21.15.2:0/2088324517 >> v2:172.21.15.90:3300/0 conn(0x7f0cfc0d0690 0x7f0cfc0b64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- 172.21.15.2:0/2088324517 >> 172.21.15.2:0/2088324517 conn(0x7f0cfc0cf990 msgr2=0x7f0cfc0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- 172.21.15.2:0/2088324517 shutdown_connections 2023-11-04T01:42:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- 172.21.15.2:0/2088324517 wait complete. 2023-11-04T01:42:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 Processor -- start 2023-11-04T01:42:18.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- start start 2023-11-04T01:42:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc0b4990 0x7f0cfc15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cfc0d0690 0x7f0cfc0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0aa0d0 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0abfd0 con 0x7f0cfc0b4990 2023-11-04T01:42:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0d019df640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0abcf0 con 0x7f0cfc0d0690 2023-11-04T01:42:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.544+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0ab3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49148/0 (socket says 172.21.15.2:49148) 2023-11-04T01:42:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/486050486 learned_addr learned my addr 172.21.15.2:0/486050486 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:18.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfaffd640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc0b4990 0x7f0cfc15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfa7fc640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cfc0d0690 0x7f0cfc0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cfc0d0690 msgr2=0x7f0cfc0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cfc0d0690 0x7f0cfc0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc0b4990 msgr2=0x7f0cfc15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc0b4990 0x7f0cfc15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 -- 172.21.15.2:0/486050486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0094d0 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfb7fe640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0ab3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009930 tx=0x7f0cec01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cf3fff640 1 -- 172.21.15.2:0/486050486 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0b1d90 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cf3fff640 1 -- 172.21.15.2:0/486050486 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0b9410 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0a9a80 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cf3fff640 1 -- 172.21.15.2:0/486050486 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0b97c0 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc15b9f0 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc0aa280 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cf3fff640 1 -- 172.21.15.2:0/486050486 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cec0b7040 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cf3fff640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0cdc0664a0 0x7f0cdc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cf3fff640 1 -- 172.21.15.2:0/486050486 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cec120a80 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfaffd640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0cdc0664a0 0x7f0cdc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:18.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.548+0000 7f0cfaffd640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0cdc0664a0 0x7f0cdc068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0b42e0 tx=0x7f0cf4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:18.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.552+0000 7f0cf3fff640 1 -- 172.21.15.2:0/486050486 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0cfc0aa280 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.744+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cfc0aa280 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.744+0000 7f0cf3fff640 1 -- 172.21.15.2:0/486050486 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f0cfc0aa280 con 0x7f0cfc0d0ae0 2023-11-04T01:42:18.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:18.748 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-04T01:42:18.748 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0cdc0664a0 msgr2=0x7f0cdc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0cdc0664a0 0x7f0cdc068960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc0b42e0 tx=0x7f0cf4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 msgr2=0x7f0cfc0ab3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0ab3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009930 tx=0x7f0cec01ba90 comp rx=0 tx=0).stop 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 shutdown_connections 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0cdc0664a0 0x7f0cdc068960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cfc0d0ae0 0x7f0cfc0ab3a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cfc0d0690 0x7f0cfc0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 --2- 172.21.15.2:0/486050486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cfc0b4990 0x7f0cfc15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 >> 172.21.15.2:0/486050486 conn(0x7f0cfc0cf990 msgr2=0x7f0cfc0b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 shutdown_connections 2023-11-04T01:42:18.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:18.748+0000 7f0d019df640 1 -- 172.21.15.2:0/486050486 wait complete. 2023-11-04T01:42:20.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.896+0000 7f5ae98dd640 1 Processor -- start 2023-11-04T01:42:20.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.896+0000 7f5ae98dd640 1 -- start start 2023-11-04T01:42:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae98dd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae98dd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ae40b0d40 0x7f5ae415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae98dd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae40c2670 con 0x7f5ae406f8f0 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae98dd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae4070140 con 0x7f5ae40b0d40 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae98dd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae406c9f0 con 0x7f5ae415afd0 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ae40b0d40 0x7f5ae415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ae40b0d40 0x7f5ae415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49152/0 (socket says 172.21.15.2:49152) 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae37fe640 1 -- 172.21.15.2:0/427217834 learned_addr learned my addr 172.21.15.2:0/427217834 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae2ffd640 1 --2- 172.21.15.2:0/427217834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae37fe640 1 -- 172.21.15.2:0/427217834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 msgr2=0x7f5ae40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae37fe640 1 --2- 172.21.15.2:0/427217834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae37fe640 1 -- 172.21.15.2:0/427217834 >> v1:172.21.15.90:6789/0 conn(0x7f5ae406f8f0 legacy=0x7f5ae40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:20.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.900+0000 7f5ae37fe640 1 -- 172.21.15.2:0/427217834 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae406bc30 con 0x7f5ae40b0d40 2023-11-04T01:42:20.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae37fe640 1 --2- 172.21.15.2:0/427217834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae40b0d40 0x7f5ae415ec80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009e80 tx=0x7f5adc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b791b80ea15541f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae1ffb640 1 -- 172.21.15.2:0/427217834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0a5800 con 0x7f5ae40b0d40 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae1ffb640 1 -- 172.21.15.2:0/427217834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc0a5960 con 0x7f5ae40b0d40 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae1ffb640 1 -- 172.21.15.2:0/427217834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0a5cf0 con 0x7f5ae40b0d40 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 -- 172.21.15.2:0/427217834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae40b0d40 msgr2=0x7f5ae415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/427217834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae40b0d40 0x7f5ae415ec80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5adc009e80 tx=0x7f5adc01c980 comp rx=0 tx=0).stop 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 -- 172.21.15.2:0/427217834 shutdown_connections 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/427217834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae40b0d40 0x7f5ae415ec80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/427217834 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 -- 172.21.15.2:0/427217834 >> 172.21.15.2:0/427217834 conn(0x7f5ae40cebb0 msgr2=0x7f5ae40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 -- 172.21.15.2:0/427217834 shutdown_connections 2023-11-04T01:42:20.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.904+0000 7f5ae98dd640 1 -- 172.21.15.2:0/427217834 wait complete. 2023-11-04T01:42:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 Processor -- start 2023-11-04T01:42:20.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 -- start start 2023-11-04T01:42:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae406f8f0 0x7f5ae40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae40b0d40 0x7f5ae40b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae41f6ce0 con 0x7f5ae406f8f0 2023-11-04T01:42:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae41f7540 con 0x7f5ae40b0d40 2023-11-04T01:42:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40b4450 con 0x7f5ae415afd0 2023-11-04T01:42:20.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae406f8f0 0x7f5ae40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae406f8f0 0x7f5ae40c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49164/0 (socket says 172.21.15.2:49164) 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 -- 172.21.15.2:0/574272810 learned_addr learned my addr 172.21.15.2:0/574272810 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae37fe640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae27fc640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae40b0d40 0x7f5ae40b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 -- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 msgr2=0x7f5ae40b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 -- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae40b0d40 msgr2=0x7f5ae40b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae40b0d40 0x7f5ae40b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 -- 172.21.15.2:0/574272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc009b30 con 0x7f5ae406f8f0 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae37fe640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae27fc640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae40b0d40 0x7f5ae40b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae2ffd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae406f8f0 0x7f5ae40c7fd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400c820 tx=0x7f5ad400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5adbfff640 1 -- 172.21.15.2:0/574272810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4007a30 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5adbfff640 1 -- 172.21.15.2:0/574272810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4007b90 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae41f6ef0 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5adbfff640 1 -- 172.21.15.2:0/574272810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400ce10 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae41f79d0 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.908+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae40744a0 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.912+0000 7f5adbfff640 1 -- 172.21.15.2:0/574272810 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ad40113f0 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.912+0000 7f5adbfff640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ac40664a0 0x7f5ac4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.912+0000 7f5adbfff640 1 -- 172.21.15.2:0/574272810 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ad4083ae0 con 0x7f5ae406f8f0 2023-11-04T01:42:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.912+0000 7f5ae27fc640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ac40664a0 0x7f5ac4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.912+0000 7f5ae27fc640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ac40664a0 0x7f5ac4068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4141380 tx=0x7f5acc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:20.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:20.916+0000 7f5adbfff640 1 -- 172.21.15.2:0/574272810 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ad4051340 con 0x7f5ae406f8f0 2023-11-04T01:42:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.100+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ae406cba0 con 0x7f5ae406f8f0 2023-11-04T01:42:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.100+0000 7f5adbfff640 1 -- 172.21.15.2:0/574272810 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7f5ad4054960 con 0x7f5ae406f8f0 2023-11-04T01:42:21.104 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:21.104 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-04T01:42:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ac40664a0 msgr2=0x7f5ac4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ac40664a0 0x7f5ac4068960 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4141380 tx=0x7f5acc009040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae406f8f0 msgr2=0x7f5ae40c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae406f8f0 0x7f5ae40c7fd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400c820 tx=0x7f5ad400cce0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 shutdown_connections 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ac40664a0 0x7f5ac4068960 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ae415afd0 0x7f5ae40b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ae40b0d40 0x7f5ae40b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 --2- 172.21.15.2:0/574272810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ae406f8f0 0x7f5ae40c7fd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 >> 172.21.15.2:0/574272810 conn(0x7f5ae40cebb0 msgr2=0x7f5ae41578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 shutdown_connections 2023-11-04T01:42:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.104+0000 7f5ae98dd640 1 -- 172.21.15.2:0/574272810 wait complete. 2023-11-04T01:42:21.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.232+0000 7f265af9a640 1 Processor -- start 2023-11-04T01:42:21.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.232+0000 7f265af9a640 1 -- start start 2023-11-04T01:42:21.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f265af9a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f26540715d0 0x7f26540b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f265af9a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f26540b0b70 0x7f265415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f265af9a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26540c2670 con 0x7f265415afd0 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f265af9a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2654070140 con 0x7f26540b0b70 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f265af9a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2654071a60 con 0x7f26540715d0 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2659537640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f26540b0b70 0x7f265415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2658d36640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f265415afd0 0x7f265406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35646/0 (socket says 172.21.15.2:35646) 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2658d36640 1 -- 172.21.15.2:0/2183182295 learned_addr learned my addr 172.21.15.2:0/2183182295 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2653fff640 1 --2- 172.21.15.2:0/2183182295 >> v2:172.21.15.90:3300/0 conn(0x7f26540715d0 0x7f26540b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2659537640 1 -- 172.21.15.2:0/2183182295 >> v2:172.21.15.90:3300/0 conn(0x7f26540715d0 msgr2=0x7f26540b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2659537640 1 --2- 172.21.15.2:0/2183182295 >> v2:172.21.15.90:3300/0 conn(0x7f26540715d0 0x7f26540b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2659537640 1 -- 172.21.15.2:0/2183182295 >> v1:172.21.15.2:6789/0 conn(0x7f265415afd0 legacy=0x7f265406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2659537640 1 -- 172.21.15.2:0/2183182295 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265406bc30 con 0x7f26540b0b70 2023-11-04T01:42:21.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f2659537640 1 --2- 172.21.15.2:0/2183182295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f265415ec80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26540ce900 tx=0x7f264c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a17eff52ab70e6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f26537fe640 1 -- 172.21.15.2:0/2183182295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0a57d0 con 0x7f26540b0b70 2023-11-04T01:42:21.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f26537fe640 1 -- 172.21.15.2:0/2183182295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c0a5930 con 0x7f26540b0b70 2023-11-04T01:42:21.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.236+0000 7f26537fe640 1 -- 172.21.15.2:0/2183182295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0a5cc0 con 0x7f26540b0b70 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- 172.21.15.2:0/2183182295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 msgr2=0x7f265415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 --2- 172.21.15.2:0/2183182295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f265415ec80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f26540ce900 tx=0x7f264c01c910 comp rx=0 tx=0).stop 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- 172.21.15.2:0/2183182295 shutdown_connections 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 --2- 172.21.15.2:0/2183182295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f265415ec80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 --2- 172.21.15.2:0/2183182295 >> v2:172.21.15.90:3300/0 conn(0x7f26540715d0 0x7f26540b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- 172.21.15.2:0/2183182295 >> 172.21.15.2:0/2183182295 conn(0x7f26540cebb0 msgr2=0x7f26540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- 172.21.15.2:0/2183182295 shutdown_connections 2023-11-04T01:42:21.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- 172.21.15.2:0/2183182295 wait complete. 2023-11-04T01:42:21.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 Processor -- start 2023-11-04T01:42:21.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- start start 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26540715d0 0x7f26540b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f26540b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f265415afd0 0x7f26541519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26540cafd0 con 0x7f26540b0b70 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26540cacf0 con 0x7f265415afd0 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26540ac960 con 0x7f26540715d0 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f26540b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f26540b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49196/0 (socket says 172.21.15.2:49196) 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 -- 172.21.15.2:0/3963165116 learned_addr learned my addr 172.21.15.2:0/3963165116 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2659537640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f265415afd0 0x7f26541519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2658d36640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26540715d0 0x7f26540b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 -- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26540715d0 msgr2=0x7f26540b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26540715d0 0x7f26540b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 -- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f265415afd0 msgr2=0x7f26541519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f265415afd0 0x7f26541519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 -- 172.21.15.2:0/3963165116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c009a70 con 0x7f26540b0b70 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2659537640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f265415afd0 0x7f26541519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f2653fff640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f26540b2a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f264800d5f0 tx=0x7f264800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f26517fa640 1 -- 172.21.15.2:0/3963165116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26480125f0 con 0x7f26540b0b70 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f26517fa640 1 -- 172.21.15.2:0/3963165116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2648012750 con 0x7f26540b0b70 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26540acc40 con 0x7f26540b0b70 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f26517fa640 1 -- 172.21.15.2:0/3963165116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648012ae0 con 0x7f26540b0b70 2023-11-04T01:42:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.240+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26540ca980 con 0x7f26540b0b70 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.244+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26540744a0 con 0x7f26540b0b70 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.244+0000 7f26517fa640 1 -- 172.21.15.2:0/3963165116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2648012c40 con 0x7f26540b0b70 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.244+0000 7f26517fa640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26400664a0 0x7f2640068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.244+0000 7f26517fa640 1 -- 172.21.15.2:0/3963165116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2648084030 con 0x7f26540b0b70 2023-11-04T01:42:21.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.244+0000 7f2658d36640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26400664a0 0x7f2640068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.244+0000 7f2658d36640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26400664a0 0x7f2640068960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f265415f030 tx=0x7f2644009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.248+0000 7f26517fa640 1 -- 172.21.15.2:0/3963165116 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2648051800 con 0x7f26540b0b70 2023-11-04T01:42:21.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.400+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f265406cba0 con 0x7f26540b0b70 2023-11-04T01:42:21.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.400+0000 7f26517fa640 1 -- 172.21.15.2:0/3963165116 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12742 (secure 0 0 0) 0x7f2648007380 con 0x7f26540b0b70 2023-11-04T01:42:21.404 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:21.404 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:13.579944+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26400664a0 msgr2=0x7f2640068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26400664a0 0x7f2640068960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f265415f030 tx=0x7f2644009040 comp rx=0 tx=0).stop 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 msgr2=0x7f26540b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f26540b2a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f264800d5f0 tx=0x7f264800dab0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 shutdown_connections 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26400664a0 0x7f2640068960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f265415afd0 0x7f26541519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26540b0b70 0x7f26540b2a50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 --2- 172.21.15.2:0/3963165116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26540715d0 0x7f26540b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 >> 172.21.15.2:0/3963165116 conn(0x7f26540cebb0 msgr2=0x7f2654154fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 shutdown_connections 2023-11-04T01:42:21.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.404+0000 7f265af9a640 1 -- 172.21.15.2:0/3963165116 wait complete. 2023-11-04T01:42:21.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:21.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6de5c5c640 1 Processor -- start 2023-11-04T01:42:21.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6de5c5c640 1 -- start start 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6de5c5c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6de006ce40 0x7f6de006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6de5c5c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6de006c040 0x7f6de006a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6de5c5c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de006d2f0 con 0x7f6de00adb80 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6de5c5c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de00ce790 con 0x7f6de006c040 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6de5c5c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de00cdef0 con 0x7f6de006ce40 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6de006c040 0x7f6de006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddf7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6de00adb80 0x7f6de0165180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42602/0 (socket says 172.21.15.2:42602) 2023-11-04T01:42:21.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddf7fe640 1 -- 172.21.15.2:0/2330615263 learned_addr learned my addr 172.21.15.2:0/2330615263 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddeffd640 1 --2- 172.21.15.2:0/2330615263 >> v2:172.21.15.90:3300/0 conn(0x7f6de006ce40 0x7f6de006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddffff640 1 -- 172.21.15.2:0/2330615263 >> v2:172.21.15.90:3300/0 conn(0x7f6de006ce40 msgr2=0x7f6de006bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddffff640 1 --2- 172.21.15.2:0/2330615263 >> v2:172.21.15.90:3300/0 conn(0x7f6de006ce40 0x7f6de006bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddffff640 1 -- 172.21.15.2:0/2330615263 >> v1:172.21.15.2:6789/0 conn(0x7f6de00adb80 legacy=0x7f6de0165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6ddffff640 1 -- 172.21.15.2:0/2330615263 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de00ce1d0 con 0x7f6de006c040 2023-11-04T01:42:21.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.544+0000 7f6dde7fc640 1 -- 172.21.15.2:0/2330615263 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837169900 0 0) 0x7f6de006d2f0 con 0x7f6de00adb80 2023-11-04T01:42:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6ddffff640 1 --2- 172.21.15.2:0/2330615263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006c040 0x7f6de006a160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6de006da50 tx=0x7f6dd001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16167aa863440684 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6dde7fc640 1 -- 172.21.15.2:0/2330615263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00ab600 con 0x7f6de006c040 2023-11-04T01:42:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6dde7fc640 1 -- 172.21.15.2:0/2330615263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd00a7050 con 0x7f6de006c040 2023-11-04T01:42:21.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6dde7fc640 1 -- 172.21.15.2:0/2330615263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00ab980 con 0x7f6de006c040 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2330615263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006c040 msgr2=0x7f6de006a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2330615263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006c040 0x7f6de006a160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6de006da50 tx=0x7f6dd001c310 comp rx=0 tx=0).stop 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2330615263 shutdown_connections 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2330615263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006c040 0x7f6de006a160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2330615263 >> v2:172.21.15.90:3300/0 conn(0x7f6de006ce40 0x7f6de006bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2330615263 >> 172.21.15.2:0/2330615263 conn(0x7f6de00cb420 msgr2=0x7f6de00cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2330615263 shutdown_connections 2023-11-04T01:42:21.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2330615263 wait complete. 2023-11-04T01:42:21.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 Processor -- start 2023-11-04T01:42:21.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- start start 2023-11-04T01:42:21.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6de006c040 0x7f6de00c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006ce40 0x7f6de0156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de00adb80 0x7f6de015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c8910 con 0x7f6de006ce40 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de0156bc0 con 0x7f6de00adb80 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6de5c5c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00b3540 con 0x7f6de006c040 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6ddeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006ce40 0x7f6de0156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6ddeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006ce40 0x7f6de0156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46122/0 (socket says 172.21.15.2:46122) 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.548+0000 7f6ddeffd640 1 -- 172.21.15.2:0/2530047495 learned_addr learned my addr 172.21.15.2:0/2530047495 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddf7fe640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6de006c040 0x7f6de00c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddffff640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de00adb80 0x7f6de015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddeffd640 1 -- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6de006c040 msgr2=0x7f6de00c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddeffd640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6de006c040 0x7f6de00c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddeffd640 1 -- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de00adb80 msgr2=0x7f6de015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddeffd640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de00adb80 0x7f6de015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddeffd640 1 -- 172.21.15.2:0/2530047495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009420 con 0x7f6de006ce40 2023-11-04T01:42:21.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddeffd640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006ce40 0x7f6de0156040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400d800 tx=0x7f6dd400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6dc7fff640 1 -- 172.21.15.2:0/2530047495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400b6c0 con 0x7f6de006ce40 2023-11-04T01:42:21.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6dc7fff640 1 -- 172.21.15.2:0/2530047495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd400b820 con 0x7f6de006ce40 2023-11-04T01:42:21.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6dc7fff640 1 -- 172.21.15.2:0/2530047495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd400bb90 con 0x7f6de006ce40 2023-11-04T01:42:21.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de00b3820 con 0x7f6de006ce40 2023-11-04T01:42:21.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de00b3de0 con 0x7f6de006ce40 2023-11-04T01:42:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de00744a0 con 0x7f6de006ce40 2023-11-04T01:42:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6dc7fff640 1 -- 172.21.15.2:0/2530047495 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6dd400bcf0 con 0x7f6de006ce40 2023-11-04T01:42:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6dc7fff640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6dcc0664a0 0x7f6dcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6dc7fff640 1 -- 172.21.15.2:0/2530047495 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6dd4083f50 con 0x7f6de006ce40 2023-11-04T01:42:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddf7fe640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6dcc0664a0 0x7f6dcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.552+0000 7f6ddf7fe640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6dcc0664a0 0x7f6dcc068960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80012f0 tx=0x7f6dd8001770 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.556+0000 7f6dc7fff640 1 -- 172.21.15.2:0/2530047495 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6dd40517b0 con 0x7f6de006ce40 2023-11-04T01:42:21.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6de00b4920 con 0x7f6de006ce40 2023-11-04T01:42:21.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6dc7fff640 1 -- 172.21.15.2:0/2530047495 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6dd4054dd0 con 0x7f6de006ce40 2023-11-04T01:42:21.715 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6dcc0664a0 msgr2=0x7f6dcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6dcc0664a0 0x7f6dcc068960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80012f0 tx=0x7f6dd8001770 comp rx=0 tx=0).stop 2023-11-04T01:42:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006ce40 msgr2=0x7f6de0156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006ce40 0x7f6de0156040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400d800 tx=0x7f6dd400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 shutdown_connections 2023-11-04T01:42:21.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6dcc0664a0 0x7f6dcc068960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de00adb80 0x7f6de015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6de006ce40 0x7f6de0156040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 --2- 172.21.15.2:0/2530047495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6de006c040 0x7f6de00c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 >> 172.21.15.2:0/2530047495 conn(0x7f6de00cb420 msgr2=0x7f6de00cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 shutdown_connections 2023-11-04T01:42:21.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.712+0000 7f6de5c5c640 1 -- 172.21.15.2:0/2530047495 wait complete. 2023-11-04T01:42:21.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:42:21.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.840+0000 7f1185870640 1 Processor -- start 2023-11-04T01:42:21.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.840+0000 7f1185870640 1 -- start start 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f1185870640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f11800ccac0 0x7f11800d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f1185870640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11800cdd20 0x7f11801617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f1185870640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118006ccf0 con 0x7f11800ccea0 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f1185870640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1180161d30 con 0x7f11800cdd20 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f1185870640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118006d220 con 0x7f11800ccac0 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11800cdd20 0x7f11801617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11800cdd20 0x7f11801617f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46138/0 (socket says 172.21.15.2:46138) 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117f7fe640 1 -- 172.21.15.2:0/2874616419 learned_addr learned my addr 172.21.15.2:0/2874616419 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117effd640 1 --2- 172.21.15.2:0/2874616419 >> v2:172.21.15.90:3300/0 conn(0x7f11800ccac0 0x7f11800d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117f7fe640 1 -- 172.21.15.2:0/2874616419 >> v2:172.21.15.90:3300/0 conn(0x7f11800ccac0 msgr2=0x7f11800d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117f7fe640 1 --2- 172.21.15.2:0/2874616419 >> v2:172.21.15.90:3300/0 conn(0x7f11800ccac0 0x7f11800d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117f7fe640 1 -- 172.21.15.2:0/2874616419 >> v1:172.21.15.90:6789/0 conn(0x7f11800ccea0 legacy=0x7f11800cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:21.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.844+0000 7f117f7fe640 1 -- 172.21.15.2:0/2874616419 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118006c630 con 0x7f11800cdd20 2023-11-04T01:42:21.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117f7fe640 1 --2- 172.21.15.2:0/2874616419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800cdd20 0x7f11801617f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1180068270 tx=0x7f117801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5998e6ab2518a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117dffb640 1 -- 172.21.15.2:0/2874616419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780aa5f0 con 0x7f11800cdd20 2023-11-04T01:42:21.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117dffb640 1 -- 172.21.15.2:0/2874616419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11780aa750 con 0x7f11800cdd20 2023-11-04T01:42:21.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117dffb640 1 -- 172.21.15.2:0/2874616419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780aaae0 con 0x7f11800cdd20 2023-11-04T01:42:21.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- 172.21.15.2:0/2874616419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800cdd20 msgr2=0x7f11801617f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 --2- 172.21.15.2:0/2874616419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800cdd20 0x7f11801617f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1180068270 tx=0x7f117801c490 comp rx=0 tx=0).stop 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- 172.21.15.2:0/2874616419 shutdown_connections 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 --2- 172.21.15.2:0/2874616419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800cdd20 0x7f11801617f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 --2- 172.21.15.2:0/2874616419 >> v2:172.21.15.90:3300/0 conn(0x7f11800ccac0 0x7f11800d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- 172.21.15.2:0/2874616419 >> 172.21.15.2:0/2874616419 conn(0x7f1180065dc0 msgr2=0x7f11800661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- 172.21.15.2:0/2874616419 shutdown_connections 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- 172.21.15.2:0/2874616419 wait complete. 2023-11-04T01:42:21.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 Processor -- start 2023-11-04T01:42:21.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- start start 2023-11-04T01:42:21.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11800ccac0 0x7f118014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800ccea0 0x7f118014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11800cdd20 0x7f11801553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118014f7d0 con 0x7f11800ccea0 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1180155000 con 0x7f11800cdd20 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1180154ad0 con 0x7f11800ccac0 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800ccea0 0x7f118014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800ccea0 0x7f118014f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46154/0 (socket says 172.21.15.2:46154) 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 -- 172.21.15.2:0/2049594895 learned_addr learned my addr 172.21.15.2:0/2049594895 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117effd640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11800ccac0 0x7f118014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 -- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11800ccac0 msgr2=0x7f118014f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11800ccac0 0x7f118014f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 -- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11800cdd20 msgr2=0x7f11801553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117f7fe640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11800cdd20 0x7f11801553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11800cdd20 0x7f11801553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:21.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 -- 172.21.15.2:0/2049594895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11780094d0 con 0x7f11800ccea0 2023-11-04T01:42:21.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f117e7fc640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800ccea0 0x7f118014f290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f117400c440 tx=0x7f117400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1167fff640 1 -- 172.21.15.2:0/2049594895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174012830 con 0x7f11800ccea0 2023-11-04T01:42:21.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1167fff640 1 -- 172.21.15.2:0/2049594895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1174012990 con 0x7f11800ccea0 2023-11-04T01:42:21.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1180152b00 con 0x7f11800ccea0 2023-11-04T01:42:21.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1167fff640 1 -- 172.21.15.2:0/2049594895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174012d40 con 0x7f11800ccea0 2023-11-04T01:42:21.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.848+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1180154d20 con 0x7f11800ccea0 2023-11-04T01:42:21.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.852+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11800675f0 con 0x7f11800ccea0 2023-11-04T01:42:21.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.852+0000 7f1167fff640 1 -- 172.21.15.2:0/2049594895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f117401b400 con 0x7f11800ccea0 2023-11-04T01:42:21.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.852+0000 7f1167fff640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f116c0664a0 0x7f116c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:21.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.852+0000 7f1167fff640 1 -- 172.21.15.2:0/2049594895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1174083a50 con 0x7f11800ccea0 2023-11-04T01:42:21.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.852+0000 7f117effd640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f116c0664a0 0x7f116c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:21.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.852+0000 7f117effd640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f116c0664a0 0x7f116c068960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1170009f30 tx=0x7f117000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:21.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:21.856+0000 7f1167fff640 1 -- 172.21.15.2:0/2049594895 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11740512b0 con 0x7f11800ccea0 2023-11-04T01:42:22.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11800b2c00 con 0x7f11800ccea0 2023-11-04T01:42:22.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1167fff640 1 -- 172.21.15.2:0/2049594895 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1174016020 con 0x7f11800ccea0 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:42:22.015 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f116c0664a0 msgr2=0x7f116c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f116c0664a0 0x7f116c068960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1170009f30 tx=0x7f117000b040 comp rx=0 tx=0).stop 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800ccea0 msgr2=0x7f118014f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800ccea0 0x7f118014f290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f117400c440 tx=0x7f117400c900 comp rx=0 tx=0).stop 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 shutdown_connections 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f116c0664a0 0x7f116c068960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11800cdd20 0x7f11801553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11800ccea0 0x7f118014f290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 --2- 172.21.15.2:0/2049594895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11800ccac0 0x7f118014f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 >> 172.21.15.2:0/2049594895 conn(0x7f1180065dc0 msgr2=0x7f11800b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 shutdown_connections 2023-11-04T01:42:22.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.012+0000 7f1185870640 1 -- 172.21.15.2:0/2049594895 wait complete. 2023-11-04T01:42:22.033 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:42:22.033 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:42:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bf9ed640 1 Processor -- start 2023-11-04T01:42:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bf9ed640 1 -- start start 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bf9ed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bf9ed640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35b80ca440 0x7f35b815f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bf9ed640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b815ea00 con 0x7f35b806b320 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bf9ed640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b815b240 con 0x7f35b80ca440 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bf9ed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b806cda0 con 0x7f35b815ae60 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bcf88640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35b80ca440 0x7f35b815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bcf88640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f35b80ca440 0x7f35b815f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46166/0 (socket says 172.21.15.2:46166) 2023-11-04T01:42:22.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bcf88640 1 -- 172.21.15.2:0/543820570 learned_addr learned my addr 172.21.15.2:0/543820570 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bd789640 1 --2- 172.21.15.2:0/543820570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bcf88640 1 -- 172.21.15.2:0/543820570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 msgr2=0x7f35b80cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bcf88640 1 --2- 172.21.15.2:0/543820570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bcf88640 1 -- 172.21.15.2:0/543820570 >> v1:172.21.15.90:6789/0 conn(0x7f35b806b320 legacy=0x7f35b806b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.152+0000 7f35bcf88640 1 -- 172.21.15.2:0/543820570 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b806d080 con 0x7f35b80ca440 2023-11-04T01:42:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bcf88640 1 --2- 172.21.15.2:0/543820570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b815f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009870 tx=0x7f35a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4811564db42deb6c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35affff640 1 -- 172.21.15.2:0/543820570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80aa610 con 0x7f35b80ca440 2023-11-04T01:42:22.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35affff640 1 -- 172.21.15.2:0/543820570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a80a6040 con 0x7f35b80ca440 2023-11-04T01:42:22.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35affff640 1 -- 172.21.15.2:0/543820570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80aa990 con 0x7f35b80ca440 2023-11-04T01:42:22.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- 172.21.15.2:0/543820570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 msgr2=0x7f35b815f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/543820570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b815f190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009870 tx=0x7f35a801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- 172.21.15.2:0/543820570 shutdown_connections 2023-11-04T01:42:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/543820570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b815f190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/543820570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- 172.21.15.2:0/543820570 >> 172.21.15.2:0/543820570 conn(0x7f35b80b0630 msgr2=0x7f35b80b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- 172.21.15.2:0/543820570 shutdown_connections 2023-11-04T01:42:22.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- 172.21.15.2:0/543820570 wait complete. 2023-11-04T01:42:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 Processor -- start 2023-11-04T01:42:22.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- start start 2023-11-04T01:42:22.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b806b320 0x7f35b80c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b80c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b814a350 con 0x7f35b80ca440 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b814b730 con 0x7f35b806b320 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.156+0000 7f35bf9ed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80c6540 con 0x7f35b815ae60 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b80c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b80c3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46182/0 (socket says 172.21.15.2:46182) 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 -- 172.21.15.2:0/3745900086 learned_addr learned my addr 172.21.15.2:0/3745900086 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bd789640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b806b320 0x7f35b80c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bdf8a640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 -- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 msgr2=0x7f35b80c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 -- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b806b320 msgr2=0x7f35b80c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b806b320 0x7f35b80c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 -- 172.21.15.2:0/3745900086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a80094d0 con 0x7f35b80ca440 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bcf88640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b80c3380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35a80ac040 tx=0x7f35a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35adffb640 1 -- 172.21.15.2:0/3745900086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80bd630 con 0x7f35b80ca440 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35adffb640 1 -- 172.21.15.2:0/3745900086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a80bd7b0 con 0x7f35b80ca440 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b80c6820 con 0x7f35b80ca440 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35adffb640 1 -- 172.21.15.2:0/3745900086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80bdb60 con 0x7f35b80ca440 2023-11-04T01:42:22.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b8149fe0 con 0x7f35b80ca440 2023-11-04T01:42:22.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b814a4c0 con 0x7f35b80ca440 2023-11-04T01:42:22.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35adffb640 1 -- 172.21.15.2:0/3745900086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f35a80b33f0 con 0x7f35b80ca440 2023-11-04T01:42:22.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35adffb640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f359c0664a0 0x7f359c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35adffb640 1 -- 172.21.15.2:0/3745900086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35a811e390 con 0x7f35b80ca440 2023-11-04T01:42:22.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bd789640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f359c0664a0 0x7f359c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.160+0000 7f35bd789640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f359c0664a0 0x7f359c068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35b80c3310 tx=0x7f35b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.164+0000 7f35adffb640 1 -- 172.21.15.2:0/3745900086 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35a80ebc10 con 0x7f35b80ca440 2023-11-04T01:42:22.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.312+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f35b80744a0 con 0x7f35b80ca440 2023-11-04T01:42:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.824+0000 7f35adffb640 1 -- 172.21.15.2:0/3745900086 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f35a80c20b0 con 0x7f35b80ca440 2023-11-04T01:42:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-04T01:42:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f359c0664a0 msgr2=0x7f359c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f359c0664a0 0x7f359c068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35b80c3310 tx=0x7f35b4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 msgr2=0x7f35b80c3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b80c3380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35a80ac040 tx=0x7f35a801ad10 comp rx=0 tx=0).stop 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 shutdown_connections 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f359c0664a0 0x7f359c068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f35b815ae60 0x7f35b80c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b80ca440 0x7f35b80c3380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 --2- 172.21.15.2:0/3745900086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35b806b320 0x7f35b80c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 >> 172.21.15.2:0/3745900086 conn(0x7f35b80b0630 msgr2=0x7f35b81577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 shutdown_connections 2023-11-04T01:42:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.828+0000 7f35bf9ed640 1 -- 172.21.15.2:0/3745900086 wait complete. 2023-11-04T01:42:22.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:42:22.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fbd2d640 1 Processor -- start 2023-11-04T01:42:22.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fbd2d640 1 -- start start 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fbd2d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19f4159f90 0x7f19f40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fbd2d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f40b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fbd2d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f40714c0 con 0x7f19f40b0a20 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fbd2d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f40b0eb0 con 0x7f19f4159f90 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fbd2d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40711e0 con 0x7f19f40ce4c0 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f9ac9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19f4159f90 0x7f19f40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fa2ca640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f19f40b0a20 0x7f19f40c91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42614/0 (socket says 172.21.15.2:42614) 2023-11-04T01:42:22.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19fa2ca640 1 -- 172.21.15.2:0/437944693 learned_addr learned my addr 172.21.15.2:0/437944693 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f9ac9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19f4159f90 0x7f19f40cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46198/0 (socket says 172.21.15.2:46198) 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f9ac9640 1 -- 172.21.15.2:0/437944693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 msgr2=0x7f19f40b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f92c8640 1 --2- 172.21.15.2:0/437944693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f40b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f9ac9640 1 --2- 172.21.15.2:0/437944693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f40b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f8ac7640 1 -- 172.21.15.2:0/437944693 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080951114 0 0) 0x7f19f40714c0 con 0x7f19f40b0a20 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f9ac9640 1 -- 172.21.15.2:0/437944693 >> v1:172.21.15.2:6789/0 conn(0x7f19f40b0a20 legacy=0x7f19f40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f9ac9640 1 -- 172.21.15.2:0/437944693 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40cd4a0 con 0x7f19f4159f90 2023-11-04T01:42:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.984+0000 7f19f92c8640 1 --2- 172.21.15.2:0/437944693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f40b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 --2- 172.21.15.2:0/437944693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f4159f90 0x7f19f40cdf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097c0 tx=0x7f19f001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40eefd0d109415f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f8ac7640 1 -- 172.21.15.2:0/437944693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00ac620 con 0x7f19f4159f90 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f8ac7640 1 -- 172.21.15.2:0/437944693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f00ac780 con 0x7f19f4159f90 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f8ac7640 1 -- 172.21.15.2:0/437944693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00acb10 con 0x7f19f4159f90 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- 172.21.15.2:0/437944693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f4159f90 msgr2=0x7f19f40cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/437944693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f4159f90 0x7f19f40cdf80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097c0 tx=0x7f19f001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- 172.21.15.2:0/437944693 shutdown_connections 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/437944693 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f40b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/437944693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f4159f90 0x7f19f40cdf80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- 172.21.15.2:0/437944693 >> 172.21.15.2:0/437944693 conn(0x7f19f40ce9e0 msgr2=0x7f19f40cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- 172.21.15.2:0/437944693 shutdown_connections 2023-11-04T01:42:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- 172.21.15.2:0/437944693 wait complete. 2023-11-04T01:42:22.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 Processor -- start 2023-11-04T01:42:22.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- start start 2023-11-04T01:42:22.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f40b0a20 0x7f19f414c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f4151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19f4159f90 0x7f19f415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f414cdb0 con 0x7f19f40b0a20 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40c65d0 con 0x7f19f4159f90 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19fbd2d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f40c68b0 con 0x7f19f40ce4c0 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f40b0a20 0x7f19f414c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f40b0a20 0x7f19f414c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46206/0 (socket says 172.21.15.2:46206) 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 -- 172.21.15.2:0/2270796495 learned_addr learned my addr 172.21.15.2:0/2270796495 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 -- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 msgr2=0x7f19f4151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f92c8640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f4151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f4151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 -- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19f4159f90 msgr2=0x7f19f415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:22.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19f4159f90 0x7f19f415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 -- 172.21.15.2:0/2270796495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0009420 con 0x7f19f40b0a20 2023-11-04T01:42:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.988+0000 7f19f9ac9640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f40b0a20 0x7f19f414c870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19f0019ff0 tx=0x7f19f0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19ea7fc640 1 -- 172.21.15.2:0/2270796495 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00b5610 con 0x7f19f40b0a20 2023-11-04T01:42:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19ea7fc640 1 -- 172.21.15.2:0/2270796495 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f00b5790 con 0x7f19f40b0a20 2023-11-04T01:42:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f40c6b90 con 0x7f19f40b0a20 2023-11-04T01:42:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19ea7fc640 1 -- 172.21.15.2:0/2270796495 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00b5b40 con 0x7f19f40b0a20 2023-11-04T01:42:22.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f40c7150 con 0x7f19f40b0a20 2023-11-04T01:42:22.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f40ad760 con 0x7f19f40b0a20 2023-11-04T01:42:22.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19ea7fc640 1 -- 172.21.15.2:0/2270796495 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f19f00b3040 con 0x7f19f40b0a20 2023-11-04T01:42:22.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19ea7fc640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19d80664a0 0x7f19d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:22.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19ea7fc640 1 -- 172.21.15.2:0/2270796495 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f19f011e280 con 0x7f19f40b0a20 2023-11-04T01:42:22.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19f92c8640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19d80664a0 0x7f19d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:22.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.992+0000 7f19f92c8640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19d80664a0 0x7f19d8068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19e4006fd0 tx=0x7f19e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:22.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:22.996+0000 7f19ea7fc640 1 -- 172.21.15.2:0/2270796495 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19f00eba50 con 0x7f19f40b0a20 2023-11-04T01:42:23.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.148+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19f40744a0 con 0x7f19f40b0a20 2023-11-04T01:42:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19ea7fc640 1 -- 172.21.15.2:0/2270796495 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f19f00ac5e0 con 0x7f19f40b0a20 2023-11-04T01:42:23.834 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-04T01:42:23.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19d80664a0 msgr2=0x7f19d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19d80664a0 0x7f19d8068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19e4006fd0 tx=0x7f19e4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:23.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f40b0a20 msgr2=0x7f19f414c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:23.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f40b0a20 0x7f19f414c870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19f0019ff0 tx=0x7f19f0019160 comp rx=0 tx=0).stop 2023-11-04T01:42:23.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 shutdown_connections 2023-11-04T01:42:23.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19d80664a0 0x7f19d8068960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19f4159f90 0x7f19f415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19f40ce4c0 0x7f19f4151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 --2- 172.21.15.2:0/2270796495 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19f40b0a20 0x7f19f414c870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:23.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 >> 172.21.15.2:0/2270796495 conn(0x7f19f40ce9e0 msgr2=0x7f19f40ae260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:23.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 shutdown_connections 2023-11-04T01:42:23.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:23.832+0000 7f19fbd2d640 1 -- 172.21.15.2:0/2270796495 wait complete. 2023-11-04T01:42:23.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:42:24.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeff58f640 1 Processor -- start 2023-11-04T01:42:24.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeff58f640 1 -- start start 2023-11-04T01:42:24.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeff58f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 0x7fbef815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeff58f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80cd3b0 con 0x7fbef80ce9e0 2023-11-04T01:42:24.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeff58f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef815e140 con 0x7fbef80ca2b0 2023-11-04T01:42:24.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeff58f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80cdff0 con 0x7fbef8159420 2023-11-04T01:42:24.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefcb2a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbef80ce9e0 0x7fbef80c9ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42628/0 (socket says 172.21.15.2:42628) 2023-11-04T01:42:24.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefcb2a640 1 -- 172.21.15.2:0/3762864761 learned_addr learned my addr 172.21.15.2:0/3762864761 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:24.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefd32b640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 0x7fbef815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796763435 0 0) 0x7fbef80cd3b0 con 0x7fbef80ce9e0 2023-11-04T01:42:24.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee4003530 con 0x7fbef80ce9e0 2023-11-04T01:42:24.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 73732378 0 0) 0x7fbee4003530 con 0x7fbef80ce9e0 2023-11-04T01:42:24.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 msgr2=0x7fbef815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 0x7fbef815dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 >> v1:172.21.15.90:6789/0 conn(0x7fbef80ca2b0 legacy=0x7fbef8159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80cd650 con 0x7fbef80ce9e0 2023-11-04T01:42:24.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fbeec001680 con 0x7fbef80ce9e0 2023-11-04T01:42:24.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 >> v1:172.21.15.2:6789/0 conn(0x7fbef80ce9e0 legacy=0x7fbef80c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee40039b0 0x7fbee4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 0x7fbee40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbee4004d10 0x7fbee4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80cdff0 con 0x7fbee4004d10 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee400bac0 con 0x7fbee40039b0 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee400bc80 con 0x7fbef8159420 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefdb2c640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbee4004d10 0x7fbee4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefd32b640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee40039b0 0x7fbee4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefcb2a640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 0x7fbee40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 msgr2=0x7fbee40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefdb2c640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef8159420 0x7fbee40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee40039b0 msgr2=0x7fbee4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefdb2c640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee40039b0 0x7fbee4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3762864761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4003530 con 0x7fbee4004d10 2023-11-04T01:42:24.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.000+0000 7fbefd32b640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee40039b0 0x7fbee4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbefdb2c640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbee4004d10 0x7fbee4005190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001e70 tx=0x7fbef001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891e404a1da813e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0003b80 con 0x7fbee4004d10 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0003ce0 con 0x7fbee4004d10 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeebfff640 1 -- 172.21.15.2:0/3762864761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef00052c0 con 0x7fbee4004d10 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 -- 172.21.15.2:0/3762864761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbee4004d10 msgr2=0x7fbee4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 --2- 172.21.15.2:0/3762864761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbee4004d10 0x7fbee4005190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbef0001e70 tx=0x7fbef001c760 comp rx=0 tx=0).stop 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3762864761 reap_dead start 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 -- 172.21.15.2:0/3762864761 shutdown_connections 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 -- 172.21.15.2:0/3762864761 >> 172.21.15.2:0/3762864761 conn(0x7fbef80b0e30 msgr2=0x7fbef80b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 -- 172.21.15.2:0/3762864761 shutdown_connections 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 -- 172.21.15.2:0/3762864761 wait complete. 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 Processor -- start 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.004+0000 7fbeff58f640 1 -- start start 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee4004d10 0x7fbef80c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef80c5840 0x7fbef80c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80b2cc0 0x7fbef80b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80b3680 con 0x7fbef80b2cc0 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81f2e30 con 0x7fbee4004d10 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80c8810 con 0x7fbef80c5840 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80b2cc0 0x7fbef80b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80b2cc0 0x7fbef80b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46224/0 (socket says 172.21.15.2:46224) 2023-11-04T01:42:24.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3865649155 learned_addr learned my addr 172.21.15.2:0/3865649155 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefcb2a640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef80c5840 0x7fbef80c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefd32b640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee4004d10 0x7fbef80c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef80c5840 msgr2=0x7fbef80c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef80c5840 0x7fbef80c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee4004d10 msgr2=0x7fbef80c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee4004d10 0x7fbef80c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 -- 172.21.15.2:0/3865649155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80c8af0 con 0x7fbef80b2cc0 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefd32b640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee4004d10 0x7fbef80c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbefdb2c640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80b2cc0 0x7fbef80b3140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbef001cc40 tx=0x7fbee4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbee9ffb640 1 -- 172.21.15.2:0/3865649155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0006d60 con 0x7fbef80b2cc0 2023-11-04T01:42:24.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbee9ffb640 1 -- 172.21.15.2:0/3865649155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0005820 con 0x7fbef80b2cc0 2023-11-04T01:42:24.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef80c83c0 con 0x7fbef80b2cc0 2023-11-04T01:42:24.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbee9ffb640 1 -- 172.21.15.2:0/3865649155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0007230 con 0x7fbef80b2cc0 2023-11-04T01:42:24.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef80adf30 con 0x7fbef80b2cc0 2023-11-04T01:42:24.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef80c8c80 con 0x7fbef80b2cc0 2023-11-04T01:42:24.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbee9ffb640 1 -- 172.21.15.2:0/3865649155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbef0007390 con 0x7fbef80b2cc0 2023-11-04T01:42:24.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbee9ffb640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbedc0664d0 0x7fbedc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:24.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.008+0000 7fbee9ffb640 1 -- 172.21.15.2:0/3865649155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbef011e660 con 0x7fbef80b2cc0 2023-11-04T01:42:24.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.012+0000 7fbefd32b640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbedc0664d0 0x7fbedc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:24.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.012+0000 7fbefd32b640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbedc0664d0 0x7fbedc068990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbef80b0500 tx=0x7fbef4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:24.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.012+0000 7fbee9ffb640 1 -- 172.21.15.2:0/3865649155 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbef00ebbb0 con 0x7fbef80b2cc0 2023-11-04T01:42:24.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.204+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbef80675f0 con 0x7fbef80b2cc0 2023-11-04T01:42:24.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:24.562 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:24.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.868+0000 7fbee9ffb640 1 -- 172.21.15.2:0/3865649155 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbef00bc0c0 con 0x7fbef80b2cc0 2023-11-04T01:42:24.872 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2023-11-04T01:42:24.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbedc0664d0 msgr2=0x7fbedc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbedc0664d0 0x7fbedc068990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbef80b0500 tx=0x7fbef4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:24.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80b2cc0 msgr2=0x7fbef80b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:24.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80b2cc0 0x7fbef80b3140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbef001cc40 tx=0x7fbee4005800 comp rx=0 tx=0).stop 2023-11-04T01:42:24.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 shutdown_connections 2023-11-04T01:42:24.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbedc0664d0 0x7fbedc068990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbef80b2cc0 0x7fbef80b3140 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbef80c5840 0x7fbef80c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 --2- 172.21.15.2:0/3865649155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbee4004d10 0x7fbef80c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:24.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 >> 172.21.15.2:0/3865649155 conn(0x7fbef80b0e30 msgr2=0x7fbef806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:24.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 shutdown_connections 2023-11-04T01:42:24.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:24.872+0000 7fbeff58f640 1 -- 172.21.15.2:0/3865649155 wait complete. 2023-11-04T01:42:24.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:25.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.024+0000 7f9c50925640 1 Processor -- start 2023-11-04T01:42:25.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.024+0000 7f9c50925640 1 -- start start 2023-11-04T01:42:25.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c50925640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c4c15b050 0x7f9c4c0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c50925640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c0cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c50925640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c15fa20 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c50925640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c0d0ca0 con 0x7f9c4c15b050 2023-11-04T01:42:25.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c50925640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0ce1a0 con 0x7f9c4c0cfe80 2023-11-04T01:42:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c4a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c4c15b050 0x7f9c4c0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c49d9b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c0cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c4a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c4c15b050 0x7f9c4c0d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:45206/0 (socket says 172.21.15.2:45206) 2023-11-04T01:42:25.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c4a59c640 1 -- 172.21.15.2:0/530612597 learned_addr learned my addr 172.21.15.2:0/530612597 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c4ad9d640 1 --1- 172.21.15.2:0/530612597 >> v1:172.21.15.90:6789/0 conn(0x7f9c4c0cdd30 0x7f9c4c0ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:43468/0 (socket says 172.21.15.2:43468) 2023-11-04T01:42:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c49d9b640 1 -- 172.21.15.2:0/530612597 >> v2:172.21.15.90:3300/0 conn(0x7f9c4c15b050 msgr2=0x7f9c4c0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c49d9b640 1 --2- 172.21.15.2:0/530612597 >> v2:172.21.15.90:3300/0 conn(0x7f9c4c15b050 0x7f9c4c0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c49d9b640 1 -- 172.21.15.2:0/530612597 >> v1:172.21.15.90:6789/0 conn(0x7f9c4c0cdd30 legacy=0x7f9c4c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c49d9b640 1 -- 172.21.15.2:0/530612597 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c06daf0 con 0x7f9c4c0cfe80 2023-11-04T01:42:25.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c4a59c640 1 --2- 172.21.15.2:0/530612597 >> v2:172.21.15.90:3300/0 conn(0x7f9c4c15b050 0x7f9c4c0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.028+0000 7f9c49d9b640 1 --2- 172.21.15.2:0/530612597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c0cd7f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009d90 tx=0x7f9c3c01c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2e8d63d5cf33194 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4959a640 1 -- 172.21.15.2:0/530612597 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0a5880 con 0x7f9c4c0cfe80 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4959a640 1 -- 172.21.15.2:0/530612597 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c0a59e0 con 0x7f9c4c0cfe80 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4959a640 1 -- 172.21.15.2:0/530612597 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0a5d70 con 0x7f9c4c0cfe80 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- 172.21.15.2:0/530612597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 msgr2=0x7f9c4c0cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 --2- 172.21.15.2:0/530612597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c0cd7f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009d90 tx=0x7f9c3c01c8a0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- 172.21.15.2:0/530612597 shutdown_connections 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 --2- 172.21.15.2:0/530612597 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c0cd7f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 --2- 172.21.15.2:0/530612597 >> v2:172.21.15.90:3300/0 conn(0x7f9c4c15b050 0x7f9c4c0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- 172.21.15.2:0/530612597 >> 172.21.15.2:0/530612597 conn(0x7f9c4c0b28f0 msgr2=0x7f9c4c0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- 172.21.15.2:0/530612597 shutdown_connections 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- 172.21.15.2:0/530612597 wait complete. 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 Processor -- start 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- start start 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c4c0cdd30 0x7f9c4c14d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c4c15b050 0x7f9c4c1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c165380 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c1f9a70 con 0x7f9c4c15b050 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c50925640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c164a50 con 0x7f9c4c0cfe80 2023-11-04T01:42:25.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c4c0cdd30 0x7f9c4c14d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c4c0cdd30 0x7f9c4c14d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46230/0 (socket says 172.21.15.2:46230) 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 -- 172.21.15.2:0/1682116197 learned_addr learned my addr 172.21.15.2:0/1682116197 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4ad9d640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c4c15b050 0x7f9c4c1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c49d9b640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 -- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 msgr2=0x7f9c4c150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 -- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c4c15b050 msgr2=0x7f9c4c1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c4c15b050 0x7f9c4c1510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 -- 172.21.15.2:0/1682116197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c400094d0 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.032+0000 7f9c4a59c640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c4c0cdd30 0x7f9c4c14d070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000ea00 tx=0x7f9c4000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c3affd640 1 -- 172.21.15.2:0/1682116197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000ca60 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c3affd640 1 -- 172.21.15.2:0/1682116197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000cbc0 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c009a70 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c3affd640 1 -- 172.21.15.2:0/1682116197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c40013470 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c165010 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c0ceb10 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c3affd640 1 -- 172.21.15.2:0/1682116197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c400135d0 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c3affd640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c2c0664a0 0x7f9c2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c3affd640 1 -- 172.21.15.2:0/1682116197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c400841a0 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c49d9b640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c2c0664a0 0x7f9c2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.036+0000 7f9c49d9b640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c2c0664a0 0x7f9c2c068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009d90 tx=0x7f9c3c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.040+0000 7f9c3affd640 1 -- 172.21.15.2:0/1682116197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c40051620 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.196+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c4c0b1410 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.200+0000 7f9c3affd640 1 -- 172.21.15.2:0/1682116197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16414 (secure 0 0 0) 0x7f9c4005b030 con 0x7f9c4c0cdd30 2023-11-04T01:42:25.205 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:25.205 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:24.209642+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c2c0664a0 msgr2=0x7f9c2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c2c0664a0 0x7f9c2c068960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009d90 tx=0x7f9c3c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:42:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c4c0cdd30 msgr2=0x7f9c4c14d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c4c0cdd30 0x7f9c4c14d070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c4000ea00 tx=0x7f9c4000eec0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 shutdown_connections 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c2c0664a0 0x7f9c2c068960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c4c15b050 0x7f9c4c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c4c0cfe80 0x7f9c4c150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 --2- 172.21.15.2:0/1682116197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c4c0cdd30 0x7f9c4c14d070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 >> 172.21.15.2:0/1682116197 conn(0x7f9c4c0b28f0 msgr2=0x7f9c4c0b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 shutdown_connections 2023-11-04T01:42:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.204+0000 7f9c50925640 1 -- 172.21.15.2:0/1682116197 wait complete. 2023-11-04T01:42:25.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:25.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58cd3f5640 1 Processor -- start 2023-11-04T01:42:25.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58cd3f5640 1 -- start start 2023-11-04T01:42:25.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58cd3f5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 0x7f58c80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58cd3f5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c80c2670 con 0x7f58c80b0d40 2023-11-04T01:42:25.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58cd3f5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c806bc30 con 0x7f58c806f8f0 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58cd3f5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8070140 con 0x7f58c815afd0 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f58c80b0d40 0x7f58c815ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42642/0 (socket says 172.21.15.2:42642) 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c77fe640 1 -- 172.21.15.2:0/2493653455 learned_addr learned my addr 172.21.15.2:0/2493653455 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 0x7f58c80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176513395 0 0) 0x7f58c80c2670 con 0x7f58c80b0d40 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b0003530 con 0x7f58c80b0d40 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908084861 0 0) 0x7f58b0003530 con 0x7f58c80b0d40 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 msgr2=0x7f58c80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 0x7f58c80715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 >> v1:172.21.15.90:6789/0 conn(0x7f58c806f8f0 legacy=0x7f58c80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c806bf10 con 0x7f58c80b0d40 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f58c0001a00 con 0x7f58c80b0d40 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 >> v1:172.21.15.2:6789/0 conn(0x7f58c80b0d40 legacy=0x7f58c815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58b00039b0 0x7f58b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58b00047d0 0x7f58b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 0x7f58b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8070140 con 0x7f58b00039b0 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b000ba40 con 0x7f58b00047d0 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b000bc00 con 0x7f58c815afd0 2023-11-04T01:42:25.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58b00039b0 0x7f58b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c77fe640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 0x7f58b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c67fc640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58b00047d0 0x7f58b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c6ffd640 1 -- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 msgr2=0x7f58b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 0x7f58b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c6ffd640 1 -- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58b00047d0 msgr2=0x7f58b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58b00047d0 0x7f58b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c6ffd640 1 -- 172.21.15.2:0/2493653455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b0003530 con 0x7f58b00039b0 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c77fe640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58c815afd0 0x7f58b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:25.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.336+0000 7f58c67fc640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58b00047d0 0x7f58b0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:25.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58b00039b0 0x7f58b0003dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ab0 tx=0x7f58b801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed5b71f267e2a04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80a8450 con 0x7f58b00039b0 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80a85b0 con 0x7f58b00039b0 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58c5ffb640 1 -- 172.21.15.2:0/2493653455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80a8960 con 0x7f58b00039b0 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58cd3f5640 1 -- 172.21.15.2:0/2493653455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58b00039b0 msgr2=0x7f58b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58cd3f5640 1 --2- 172.21.15.2:0/2493653455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58b00039b0 0x7f58b0003dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ab0 tx=0x7f58b801ca10 comp rx=0 tx=0).stop 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58c77fe640 1 -- 172.21.15.2:0/2493653455 reap_dead start 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58cd3f5640 1 -- 172.21.15.2:0/2493653455 shutdown_connections 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58cd3f5640 1 -- 172.21.15.2:0/2493653455 >> 172.21.15.2:0/2493653455 conn(0x7f58c80cebb0 msgr2=0x7f58c80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58cd3f5640 1 -- 172.21.15.2:0/2493653455 shutdown_connections 2023-11-04T01:42:25.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.340+0000 7f58cd3f5640 1 -- 172.21.15.2:0/2493653455 wait complete. 2023-11-04T01:42:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 Processor -- start 2023-11-04T01:42:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 -- start start 2023-11-04T01:42:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58b00039b0 0x7f58c8148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c8155720 0x7f58c80c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c80c4030 0x7f58c8148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80c2870 con 0x7f58c8155720 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c81485a0 con 0x7f58c80c4030 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80c3660 con 0x7f58b00039b0 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c8155720 0x7f58c80c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c8155720 0x7f58c80c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46260/0 (socket says 172.21.15.2:46260) 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 -- 172.21.15.2:0/3337813171 learned_addr learned my addr 172.21.15.2:0/3337813171 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58b00039b0 0x7f58c8148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c77fe640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c80c4030 0x7f58c8148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 -- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58b00039b0 msgr2=0x7f58c8148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58b00039b0 0x7f58c8148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 -- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c80c4030 msgr2=0x7f58c8148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c80c4030 0x7f58c8148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 -- 172.21.15.2:0/3337813171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c80c2a50 con 0x7f58c8155720 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58c67fc640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c8155720 0x7f58c80c3af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00e7e0 tx=0x7f58bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58af7fe640 1 -- 172.21.15.2:0/3337813171 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0050d0 con 0x7f58c8155720 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58af7fe640 1 -- 172.21.15.2:0/3337813171 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc005230 con 0x7f58c8155720 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c80c2d30 con 0x7f58c8155720 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58af7fe640 1 -- 172.21.15.2:0/3337813171 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc003600 con 0x7f58c8155720 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c80c32f0 con 0x7f58c8155720 2023-11-04T01:42:25.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.344+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c80c34b0 con 0x7f58c8155720 2023-11-04T01:42:25.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.348+0000 7f58af7fe640 1 -- 172.21.15.2:0/3337813171 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58bc003760 con 0x7f58c8155720 2023-11-04T01:42:25.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.348+0000 7f58af7fe640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58b40664d0 0x7f58b4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.348+0000 7f58af7fe640 1 -- 172.21.15.2:0/3337813171 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58bc083b20 con 0x7f58c8155720 2023-11-04T01:42:25.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.348+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58b40664d0 0x7f58b4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.348+0000 7f58c6ffd640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58b40664d0 0x7f58b4068990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f58b80af000 tx=0x7f58b80b3040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.352+0000 7f58af7fe640 1 -- 172.21.15.2:0/3337813171 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f58bc051060 con 0x7f58c8155720 2023-11-04T01:42:25.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.508+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58c80744a0 con 0x7f58c8155720 2023-11-04T01:42:25.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.512+0000 7f58af7fe640 1 -- 172.21.15.2:0/3337813171 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f58bc054680 con 0x7f58c8155720 2023-11-04T01:42:25.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:25.515 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.512+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58b40664d0 msgr2=0x7f58b4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.512+0000 7f58cd3f5640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58b40664d0 0x7f58b4068990 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f58b80af000 tx=0x7f58b80b3040 comp rx=0 tx=0).stop 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.512+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c8155720 msgr2=0x7f58c80c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.512+0000 7f58cd3f5640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c8155720 0x7f58c80c3af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00e7e0 tx=0x7f58bc00eca0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 shutdown_connections 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58b40664d0 0x7f58b4068990 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c80c4030 0x7f58c8148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f58c8155720 0x7f58c80c3af0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 --2- 172.21.15.2:0/3337813171 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f58b00039b0 0x7f58c8148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 >> 172.21.15.2:0/3337813171 conn(0x7f58c80cebb0 msgr2=0x7f58c80c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 shutdown_connections 2023-11-04T01:42:25.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.516+0000 7f58cd3f5640 1 -- 172.21.15.2:0/3337813171 wait complete. 2023-11-04T01:42:25.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:42:25.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c8479640 1 Processor -- start 2023-11-04T01:42:25.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c8479640 1 -- start start 2023-11-04T01:42:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c8479640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd0c015af70 0x7fd0c00cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c8479640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c015e890 con 0x7fd0c015e490 2023-11-04T01:42:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c8479640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c006c0c0 con 0x7fd0c006d160 2023-11-04T01:42:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c8479640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c006c3a0 con 0x7fd0c015af70 2023-11-04T01:42:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c6a16640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd0c015e490 0x7fd0c00701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42654/0 (socket says 172.21.15.2:42654) 2023-11-04T01:42:25.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c6a16640 1 -- 172.21.15.2:0/1960309789 learned_addr learned my addr 172.21.15.2:0/1960309789 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c6215640 1 --2- 172.21.15.2:0/1960309789 >> v2:172.21.15.90:3300/0 conn(0x7fd0c015af70 0x7fd0c00cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144774100 0 0) 0x7fd0b80014a0 con 0x7fd0c015e490 2023-11-04T01:42:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0ac003530 con 0x7fd0c015e490 2023-11-04T01:42:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733583918 0 0) 0x7fd0ac003530 con 0x7fd0c015e490 2023-11-04T01:42:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 >> v2:172.21.15.90:3300/0 conn(0x7fd0c015af70 msgr2=0x7fd0c00cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 --2- 172.21.15.2:0/1960309789 >> v2:172.21.15.90:3300/0 conn(0x7fd0c015af70 0x7fd0c00cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 >> v1:172.21.15.90:6789/0 conn(0x7fd0c006d160 legacy=0x7fd0c015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c006c680 con 0x7fd0c015e490 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fd0b8001b90 con 0x7fd0c015e490 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 >> v1:172.21.15.2:6789/0 conn(0x7fd0c015e490 legacy=0x7fd0c00701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac003980 0x7fd0ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0ac0047d0 0x7fd0ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0ac005190 0x7fd0ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c006c3a0 con 0x7fd0ac0047d0 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac00c030 con 0x7fd0ac005190 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac00c1f0 con 0x7fd0ac003980 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5a14640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0ac0047d0 0x7fd0ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c6215640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac003980 0x7fd0ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5a14640 1 -- 172.21.15.2:0/1960309789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac003980 msgr2=0x7fd0ac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5a14640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac003980 0x7fd0ac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5a14640 1 -- 172.21.15.2:0/1960309789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0ac005190 msgr2=0x7fd0ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5a14640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0ac005190 0x7fd0ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c6a16640 1 -- 172.21.15.2:0/1960309789 reap_dead start 2023-11-04T01:42:25.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.656+0000 7fd0c5a14640 1 -- 172.21.15.2:0/1960309789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac003530 con 0x7fd0ac0047d0 2023-11-04T01:42:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c5a14640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0ac0047d0 0x7fd0ac004c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0001780 tx=0x7fd0b001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca5200f47239204 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00052d0 con 0x7fd0ac0047d0 2023-11-04T01:42:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b00a7050 con 0x7fd0ac0047d0 2023-11-04T01:42:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c5213640 1 -- 172.21.15.2:0/1960309789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0003600 con 0x7fd0ac0047d0 2023-11-04T01:42:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 -- 172.21.15.2:0/1960309789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0ac0047d0 msgr2=0x7fd0ac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0ac0047d0 0x7fd0ac004c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0001780 tx=0x7fd0b001c3e0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 -- 172.21.15.2:0/1960309789 shutdown_connections 2023-11-04T01:42:25.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 --2- 172.21.15.2:0/1960309789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0ac0047d0 0x7fd0ac004c50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 -- 172.21.15.2:0/1960309789 >> 172.21.15.2:0/1960309789 conn(0x7fd0c00cb510 msgr2=0x7fd0c00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 -- 172.21.15.2:0/1960309789 shutdown_connections 2023-11-04T01:42:25.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 -- 172.21.15.2:0/1960309789 wait complete. 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 Processor -- start 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.660+0000 7fd0c8479640 1 -- start start 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac0047d0 0x7fd0c00c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c00c2ff0 0x7fd0c01f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c00ae150 0x7fd0c00ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00c6dc0 con 0x7fd0c00ae150 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00c61b0 con 0x7fd0c00c2ff0 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00c6490 con 0x7fd0ac0047d0 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c00ae150 0x7fd0c00ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c00ae150 0x7fd0c00ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46278/0 (socket says 172.21.15.2:46278) 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 -- 172.21.15.2:0/4074040067 learned_addr learned my addr 172.21.15.2:0/4074040067 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6215640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac0047d0 0x7fd0c00c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c5a14640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c00c2ff0 0x7fd0c01f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 -- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac0047d0 msgr2=0x7fd0c00c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac0047d0 0x7fd0c00c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 -- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c00c2ff0 msgr2=0x7fd0c01f0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c00c2ff0 0x7fd0c01f0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 -- 172.21.15.2:0/4074040067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00c6770 con 0x7fd0c00ae150 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6a16640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c00ae150 0x7fd0c00ae5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8004c00 tx=0x7fd0b800fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0b6ffd640 1 -- 172.21.15.2:0/4074040067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800d790 con 0x7fd0c00ae150 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0b6ffd640 1 -- 172.21.15.2:0/4074040067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800d8f0 con 0x7fd0c00ae150 2023-11-04T01:42:25.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c00c6a50 con 0x7fd0c00ae150 2023-11-04T01:42:25.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0b6ffd640 1 -- 172.21.15.2:0/4074040067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800dca0 con 0x7fd0c00ae150 2023-11-04T01:42:25.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c01f0640 con 0x7fd0c00ae150 2023-11-04T01:42:25.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c00c6be0 con 0x7fd0c00ae150 2023-11-04T01:42:25.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0b6ffd640 1 -- 172.21.15.2:0/4074040067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0b800a030 con 0x7fd0c00ae150 2023-11-04T01:42:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0b6ffd640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0a40664d0 0x7fd0a4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0b6ffd640 1 -- 172.21.15.2:0/4074040067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0b80860e0 con 0x7fd0c00ae150 2023-11-04T01:42:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.664+0000 7fd0c6215640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0a40664d0 0x7fd0a4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:25.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.668+0000 7fd0c6215640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0a40664d0 0x7fd0a4068990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009b60 tx=0x7fd0bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:25.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.668+0000 7fd0b6ffd640 1 -- 172.21.15.2:0/4074040067 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd0b8053610 con 0x7fd0c00ae150 2023-11-04T01:42:25.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.860+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd0c015e890 con 0x7fd0c00ae150 2023-11-04T01:42:25.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0b6ffd640 1 -- 172.21.15.2:0/4074040067 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd0c015e890 con 0x7fd0c00ae150 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0a40664d0 msgr2=0x7fd0a4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0a40664d0 0x7fd0a4068990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009b60 tx=0x7fd0bc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c00ae150 msgr2=0x7fd0c00ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c00ae150 0x7fd0c00ae5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8004c00 tx=0x7fd0b800fb10 comp rx=0 tx=0).stop 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 shutdown_connections 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0a40664d0 0x7fd0a4068990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0c00ae150 0x7fd0c00ae5d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0c00c2ff0 0x7fd0c01f0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 --2- 172.21.15.2:0/4074040067 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0ac0047d0 0x7fd0c00c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:25.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 >> 172.21.15.2:0/4074040067 conn(0x7fd0c00cb510 msgr2=0x7fd0c015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 shutdown_connections 2023-11-04T01:42:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:25.872+0000 7fd0c8479640 1 -- 172.21.15.2:0/4074040067 wait complete. 2023-11-04T01:42:25.896 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:42:25.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:42:26.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c2098c640 1 Processor -- start 2023-11-04T01:42:26.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c2098c640 1 -- start start 2023-11-04T01:42:26.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c2098c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c15acb0 0x7f1c1c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c2098c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c1c0b0c20 0x7f1c1c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c2098c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0cb130 con 0x7f1c1c15c160 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c2098c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c15bd40 con 0x7f1c1c0b0c20 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c2098c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c06fd80 con 0x7f1c1c15acb0 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c1c0b0c20 0x7f1c1c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c1c0b0c20 0x7f1c1c0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46294/0 (socket says 172.21.15.2:46294) 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1ad9d640 1 -- 172.21.15.2:0/1256880730 learned_addr learned my addr 172.21.15.2:0/1256880730 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1a59c640 1 --2- 172.21.15.2:0/1256880730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c15acb0 0x7f1c1c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1ad9d640 1 -- 172.21.15.2:0/1256880730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c15acb0 msgr2=0x7f1c1c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1ad9d640 1 --2- 172.21.15.2:0/1256880730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c15acb0 0x7f1c1c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1ad9d640 1 -- 172.21.15.2:0/1256880730 >> v1:172.21.15.90:6789/0 conn(0x7f1c1c15c160 legacy=0x7f1c1c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:26.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.020+0000 7f1c1ad9d640 1 -- 172.21.15.2:0/1256880730 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c15b680 con 0x7f1c1c0b0c20 2023-11-04T01:42:26.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c1ad9d640 1 --2- 172.21.15.2:0/1256880730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c0b0c20 0x7f1c1c0ca490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009e50 tx=0x7f1c1401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337ee810d37393e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c1959a640 1 -- 172.21.15.2:0/1256880730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a5840 con 0x7f1c1c0b0c20 2023-11-04T01:42:26.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c1959a640 1 -- 172.21.15.2:0/1256880730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140a59a0 con 0x7f1c1c0b0c20 2023-11-04T01:42:26.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c1959a640 1 -- 172.21.15.2:0/1256880730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a5d30 con 0x7f1c1c0b0c20 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 -- 172.21.15.2:0/1256880730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c0b0c20 msgr2=0x7f1c1c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 --2- 172.21.15.2:0/1256880730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c0b0c20 0x7f1c1c0ca490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009e50 tx=0x7f1c1401c9a0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 -- 172.21.15.2:0/1256880730 shutdown_connections 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 --2- 172.21.15.2:0/1256880730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c0b0c20 0x7f1c1c0ca490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 --2- 172.21.15.2:0/1256880730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c15acb0 0x7f1c1c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 -- 172.21.15.2:0/1256880730 >> 172.21.15.2:0/1256880730 conn(0x7f1c1c0cb510 msgr2=0x7f1c1c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 -- 172.21.15.2:0/1256880730 shutdown_connections 2023-11-04T01:42:26.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 -- 172.21.15.2:0/1256880730 wait complete. 2023-11-04T01:42:26.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 Processor -- start 2023-11-04T01:42:26.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.024+0000 7f1c2098c640 1 -- start start 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c0b0c20 0x7f1c1c0acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c15acb0 0x7f1c1c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c1c15c160 0x7f1c1c0af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c06b960 con 0x7f1c1c15acb0 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c06c750 con 0x7f1c1c15c160 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c06bb40 con 0x7f1c1c0b0c20 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c15acb0 0x7f1c1c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c15acb0 0x7f1c1c06cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46306/0 (socket says 172.21.15.2:46306) 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 -- 172.21.15.2:0/3475270078 learned_addr learned my addr 172.21.15.2:0/3475270078 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c1a59c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c0b0c20 0x7f1c1c0acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c1ad9d640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c1c15c160 0x7f1c1c0af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 -- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c0b0c20 msgr2=0x7f1c1c0acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c0b0c20 0x7f1c1c0acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 -- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c1c15c160 msgr2=0x7f1c1c0af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c1c15c160 0x7f1c1c0af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 -- 172.21.15.2:0/3475270078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009b30 con 0x7f1c1c15acb0 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c1a59c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c0b0c20 0x7f1c1c0acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c19d9b640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c15acb0 0x7f1c1c06cbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b410 tx=0x7f1c1000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c0affd640 1 -- 172.21.15.2:0/3475270078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10004020 con 0x7f1c1c15acb0 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c0affd640 1 -- 172.21.15.2:0/3475270078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10004180 con 0x7f1c1c15acb0 2023-11-04T01:42:26.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c06be20 con 0x7f1c1c15acb0 2023-11-04T01:42:26.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c0affd640 1 -- 172.21.15.2:0/3475270078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011630 con 0x7f1c1c15acb0 2023-11-04T01:42:26.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c06c3e0 con 0x7f1c1c15acb0 2023-11-04T01:42:26.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c0744a0 con 0x7f1c1c15acb0 2023-11-04T01:42:26.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c0affd640 1 -- 172.21.15.2:0/3475270078 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c10011790 con 0x7f1c1c15acb0 2023-11-04T01:42:26.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c0affd640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1bfc0664d0 0x7f1bfc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:26.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c0affd640 1 -- 172.21.15.2:0/3475270078 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c10083ad0 con 0x7f1c1c15acb0 2023-11-04T01:42:26.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.028+0000 7f1c1a59c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1bfc0664d0 0x7f1bfc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:26.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.032+0000 7f1c1a59c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1bfc0664d0 0x7f1bfc068990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c15a5b0 tx=0x7f1c0c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:26.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.032+0000 7f1c0affd640 1 -- 172.21.15.2:0/3475270078 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1c10050fe0 con 0x7f1c1c15acb0 2023-11-04T01:42:26.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.224+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1c1c0cde00 con 0x7f1c1c15acb0 2023-11-04T01:42:26.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.896+0000 7f1c0affd640 1 -- 172.21.15.2:0/3475270078 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1c10054600 con 0x7f1c1c15acb0 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.896+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1bfc0664d0 msgr2=0x7f1bfc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.896+0000 7f1c2098c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1bfc0664d0 0x7f1bfc068990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c15a5b0 tx=0x7f1c0c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.896+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c15acb0 msgr2=0x7f1c1c06cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c15acb0 0x7f1c1c06cbe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b410 tx=0x7f1c1000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 shutdown_connections 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1bfc0664d0 0x7f1bfc068990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1c1c15c160 0x7f1c1c0af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c1c15acb0 0x7f1c1c06cbe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 --2- 172.21.15.2:0/3475270078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1c1c0b0c20 0x7f1c1c0acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:26.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 >> 172.21.15.2:0/3475270078 conn(0x7f1c1c0cb510 msgr2=0x7f1c1c15c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:26.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 shutdown_connections 2023-11-04T01:42:26.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:26.900+0000 7f1c2098c640 1 -- 172.21.15.2:0/3475270078 wait complete. 2023-11-04T01:42:26.922 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:42:26.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:27.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff999888640 1 Processor -- start 2023-11-04T01:42:27.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff999888640 1 -- start start 2023-11-04T01:42:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff999888640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9940cead0 0x7ff9940c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff999888640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff994070bf0 0x7ff994071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff999888640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940cb9a0 con 0x7ff9941435e0 2023-11-04T01:42:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff999888640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940cc540 con 0x7ff9940cead0 2023-11-04T01:42:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff999888640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940c59a0 con 0x7ff994070bf0 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff9927fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff9940cead0 0x7ff9940c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff992ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff9941435e0 0x7ff9940cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42658/0 (socket says 172.21.15.2:42658) 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff992ffd640 1 -- 172.21.15.2:0/3793568778 learned_addr learned my addr 172.21.15.2:0/3793568778 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff9927fc640 1 -- 172.21.15.2:0/3793568778 >> v2:172.21.15.90:3300/0 conn(0x7ff994070bf0 msgr2=0x7ff994071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff9927fc640 1 --2- 172.21.15.2:0/3793568778 >> v2:172.21.15.90:3300/0 conn(0x7ff994070bf0 0x7ff994071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff9927fc640 1 -- 172.21.15.2:0/3793568778 >> v1:172.21.15.2:6789/0 conn(0x7ff9941435e0 legacy=0x7ff9940cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff991ffb640 1 -- 172.21.15.2:0/3793568778 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372829079 0 0) 0x7ff9940cb9a0 con 0x7ff9941435e0 2023-11-04T01:42:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.044+0000 7ff9927fc640 1 -- 172.21.15.2:0/3793568778 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940cb390 con 0x7ff9940cead0 2023-11-04T01:42:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff9927fc640 1 --2- 172.21.15.2:0/3793568778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff9940c4ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9940cb910 tx=0x7ff98801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985fc3b60cd71c73 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff991ffb640 1 -- 172.21.15.2:0/3793568778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988004230 con 0x7ff9940cead0 2023-11-04T01:42:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff991ffb640 1 -- 172.21.15.2:0/3793568778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880a7050 con 0x7ff9940cead0 2023-11-04T01:42:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff991ffb640 1 -- 172.21.15.2:0/3793568778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988003620 con 0x7ff9940cead0 2023-11-04T01:42:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- 172.21.15.2:0/3793568778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 msgr2=0x7ff9940c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 --2- 172.21.15.2:0/3793568778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff9940c4ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9940cb910 tx=0x7ff98801c460 comp rx=0 tx=0).stop 2023-11-04T01:42:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- 172.21.15.2:0/3793568778 shutdown_connections 2023-11-04T01:42:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 --2- 172.21.15.2:0/3793568778 >> v2:172.21.15.90:3300/0 conn(0x7ff994070bf0 0x7ff994071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 --2- 172.21.15.2:0/3793568778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff9940c4ae0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- 172.21.15.2:0/3793568778 >> 172.21.15.2:0/3793568778 conn(0x7ff9940cfc00 msgr2=0x7ff9940d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- 172.21.15.2:0/3793568778 shutdown_connections 2023-11-04T01:42:27.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- 172.21.15.2:0/3793568778 wait complete. 2023-11-04T01:42:27.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 Processor -- start 2023-11-04T01:42:27.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- start start 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff994070bf0 0x7ff994159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff99406e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9941435e0 0x7ff99406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9941646f0 con 0x7ff9940cead0 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff994159cc0 con 0x7ff994070bf0 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff999888640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff994163a70 con 0x7ff9941435e0 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff9927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff99406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff9927fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff99406e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46330/0 (socket says 172.21.15.2:46330) 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff9927fc640 1 -- 172.21.15.2:0/3179287750 learned_addr learned my addr 172.21.15.2:0/3179287750 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:27.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff992ffd640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff994070bf0 0x7ff994159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff9927fc640 1 -- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9941435e0 msgr2=0x7ff99406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff9927fc640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9941435e0 0x7ff99406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.048+0000 7ff9927fc640 1 -- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff994070bf0 msgr2=0x7ff994159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff9927fc640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff994070bf0 0x7ff994159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff9927fc640 1 -- 172.21.15.2:0/3179287750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009420 con 0x7ff9940cead0 2023-11-04T01:42:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff992ffd640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff994070bf0 0x7ff994159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff9927fc640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff99406e350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff988019070 tx=0x7ff988019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff97bfff640 1 -- 172.21.15.2:0/3179287750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988003cf0 con 0x7ff9940cead0 2023-11-04T01:42:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff97bfff640 1 -- 172.21.15.2:0/3179287750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988003e50 con 0x7ff9940cead0 2023-11-04T01:42:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff97bfff640 1 -- 172.21.15.2:0/3179287750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880ab660 con 0x7ff9940cead0 2023-11-04T01:42:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff994163d50 con 0x7ff9940cead0 2023-11-04T01:42:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff994164310 con 0x7ff9940cead0 2023-11-04T01:42:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9940675f0 con 0x7ff9940cead0 2023-11-04T01:42:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff97bfff640 1 -- 172.21.15.2:0/3179287750 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9880b2040 con 0x7ff9940cead0 2023-11-04T01:42:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff97bfff640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9800664a0 0x7ff980068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff97bfff640 1 -- 172.21.15.2:0/3179287750 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff98811dfa0 con 0x7ff9940cead0 2023-11-04T01:42:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff992ffd640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9800664a0 0x7ff980068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.052+0000 7ff992ffd640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9800664a0 0x7ff980068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0012f0 tx=0x7ff98c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.056+0000 7ff97bfff640 1 -- 172.21.15.2:0/3179287750 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff9880eb380 con 0x7ff9940cead0 2023-11-04T01:42:27.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.244+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9940cd970 con 0x7ff9940cead0 2023-11-04T01:42:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff97bfff640 1 -- 172.21.15.2:0/3179287750 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7ff9880ee9a0 con 0x7ff9940cead0 2023-11-04T01:42:27.250 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:27.250 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:42:27.250 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:42:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9800664a0 msgr2=0x7ff980068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9800664a0 0x7ff980068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0012f0 tx=0x7ff98c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:27.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 msgr2=0x7ff99406e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff99406e350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff988019070 tx=0x7ff988019200 comp rx=0 tx=0).stop 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 shutdown_connections 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9800664a0 0x7ff980068960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9941435e0 0x7ff99406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9940cead0 0x7ff99406e350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 --2- 172.21.15.2:0/3179287750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff994070bf0 0x7ff994159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 >> 172.21.15.2:0/3179287750 conn(0x7ff9940cfc00 msgr2=0x7ff9940cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 shutdown_connections 2023-11-04T01:42:27.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.248+0000 7ff999888640 1 -- 172.21.15.2:0/3179287750 wait complete. 2023-11-04T01:42:27.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.372+0000 7f4d6b380640 1 Processor -- start 2023-11-04T01:42:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.372+0000 7f4d6b380640 1 -- start start 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6b380640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 0x7f4d640b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6b380640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d640cb400 0x7f4d640cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6b380640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d640d0a60 con 0x7f4d640cd6d0 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6b380640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6415b390 con 0x7f4d640cb400 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6b380640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640d04a0 con 0x7f4d6415afb0 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6891b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d640cb400 0x7f4d640cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6991d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4d640cd6d0 0x7f4d640cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42666/0 (socket says 172.21.15.2:42666) 2023-11-04T01:42:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6991d640 1 -- 172.21.15.2:0/3186609353 learned_addr learned my addr 172.21.15.2:0/3186609353 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6911c640 1 --2- 172.21.15.2:0/3186609353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 0x7f4d640b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6891b640 1 -- 172.21.15.2:0/3186609353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 msgr2=0x7f4d640b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6891b640 1 --2- 172.21.15.2:0/3186609353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 0x7f4d640b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6891b640 1 -- 172.21.15.2:0/3186609353 >> v1:172.21.15.2:6789/0 conn(0x7f4d640cd6d0 legacy=0x7f4d640cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6891b640 1 -- 172.21.15.2:0/3186609353 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640d0780 con 0x7f4d640cb400 2023-11-04T01:42:27.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6891b640 1 --2- 172.21.15.2:0/3186609353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640cf190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d540097c0 tx=0x7f4d5401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3cab18b518a570 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d5bfff640 1 -- 172.21.15.2:0/3186609353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540ac620 con 0x7f4d640cb400 2023-11-04T01:42:27.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d5bfff640 1 -- 172.21.15.2:0/3186609353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d540ac780 con 0x7f4d640cb400 2023-11-04T01:42:27.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d5bfff640 1 -- 172.21.15.2:0/3186609353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540acb10 con 0x7f4d640cb400 2023-11-04T01:42:27.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6b380640 1 -- 172.21.15.2:0/3186609353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 msgr2=0x7f4d640cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.376+0000 7f4d6b380640 1 --2- 172.21.15.2:0/3186609353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640cf190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d540097c0 tx=0x7f4d5401c3c0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- 172.21.15.2:0/3186609353 shutdown_connections 2023-11-04T01:42:27.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 --2- 172.21.15.2:0/3186609353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640cf190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 --2- 172.21.15.2:0/3186609353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 0x7f4d640b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- 172.21.15.2:0/3186609353 >> 172.21.15.2:0/3186609353 conn(0x7f4d64065dc0 msgr2=0x7f4d640661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- 172.21.15.2:0/3186609353 shutdown_connections 2023-11-04T01:42:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- 172.21.15.2:0/3186609353 wait complete. 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 Processor -- start 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- start start 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d640cd6d0 0x7f4d64151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 0x7f4d64152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d641528c0 con 0x7f4d640cb400 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640c8e10 con 0x7f4d640cd6d0 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640c8290 con 0x7f4d6415afb0 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46344/0 (socket says 172.21.15.2:46344) 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 -- 172.21.15.2:0/798994333 learned_addr learned my addr 172.21.15.2:0/798994333 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 -- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 msgr2=0x7f4d64152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 0x7f4d64152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 -- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d640cd6d0 msgr2=0x7f4d64151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6891b640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d640cd6d0 0x7f4d64151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d640cd6d0 0x7f4d64151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 -- 172.21.15.2:0/798994333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54009420 con 0x7f4d640cb400 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6911c640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640b4a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000d800 tx=0x7f4d6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d59ffb640 1 -- 172.21.15.2:0/798994333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000b6c0 con 0x7f4d640cb400 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d59ffb640 1 -- 172.21.15.2:0/798994333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000b820 con 0x7f4d640cb400 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d640c8570 con 0x7f4d640cb400 2023-11-04T01:42:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d59ffb640 1 -- 172.21.15.2:0/798994333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000bb90 con 0x7f4d640cb400 2023-11-04T01:42:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d640c8b30 con 0x7f4d640cb400 2023-11-04T01:42:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.380+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6415b4f0 con 0x7f4d640cb400 2023-11-04T01:42:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.384+0000 7f4d59ffb640 1 -- 172.21.15.2:0/798994333 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d6000bcf0 con 0x7f4d640cb400 2023-11-04T01:42:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.384+0000 7f4d59ffb640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.384+0000 7f4d59ffb640 1 -- 172.21.15.2:0/798994333 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d60084400 con 0x7f4d640cb400 2023-11-04T01:42:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.384+0000 7f4d6891b640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.384+0000 7f4d6891b640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d540ae000 tx=0x7f4d540a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.388+0000 7f4d59ffb640 1 -- 172.21.15.2:0/798994333 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d60051880 con 0x7f4d640cb400 2023-11-04T01:42:27.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.536+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d640675f0 con 0x7f4d640cb400 2023-11-04T01:42:27.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.536+0000 7f4d59ffb640 1 -- 172.21.15.2:0/798994333 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f4d60054ea0 con 0x7f4d640cb400 2023-11-04T01:42:27.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:27.542 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:27.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 msgr2=0x7f4d48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d540ae000 tx=0x7f4d540a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:27.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 msgr2=0x7f4d640b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640b4a50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000d800 tx=0x7f4d6000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 shutdown_connections 2023-11-04T01:42:27.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415afb0 0x7f4d64152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d640cd6d0 0x7f4d64151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 --2- 172.21.15.2:0/798994333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640cb400 0x7f4d640b4a50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 >> 172.21.15.2:0/798994333 conn(0x7f4d64065dc0 msgr2=0x7f4d640661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 shutdown_connections 2023-11-04T01:42:27.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.540+0000 7f4d6b380640 1 -- 172.21.15.2:0/798994333 wait complete. 2023-11-04T01:42:27.559 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:42:27.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:27.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.675+0000 7f617d2df640 1 Processor -- start 2023-11-04T01:42:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.675+0000 7f617d2df640 1 -- start start 2023-11-04T01:42:27.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.675+0000 7f617d2df640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6178144180 0x7f617815ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.675+0000 7f617d2df640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617806d300 con 0x7f61781447f0 2023-11-04T01:42:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.675+0000 7f617d2df640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6178144560 con 0x7f617806a160 2023-11-04T01:42:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.675+0000 7f617d2df640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f617815f920 con 0x7f6178144180 2023-11-04T01:42:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f6176ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6178144180 0x7f617815ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f616ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f61781447f0 0x7f617806cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42680/0 (socket says 172.21.15.2:42680) 2023-11-04T01:42:27.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f616ffff640 1 -- 172.21.15.2:0/3429564899 learned_addr learned my addr 172.21.15.2:0/3429564899 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:27.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f6176ffd640 1 -- 172.21.15.2:0/3429564899 >> v1:172.21.15.90:6789/0 conn(0x7f617806a160 legacy=0x7f61780c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f6176ffd640 1 -- 172.21.15.2:0/3429564899 >> v1:172.21.15.2:6789/0 conn(0x7f61781447f0 legacy=0x7f617806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f6176ffd640 1 -- 172.21.15.2:0/3429564899 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617815f360 con 0x7f6178144180 2023-11-04T01:42:27.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f61767fc640 1 -- 172.21.15.2:0/3429564899 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265296610 0 0) 0x7f617806d300 con 0x7f61781447f0 2023-11-04T01:42:27.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f6176ffd640 1 --2- 172.21.15.2:0/3429564899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178144180 0x7f617815ea60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61680097c0 tx=0x7f616801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a1b8d40e57a4e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f61767fc640 1 -- 172.21.15.2:0/3429564899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680ad660 con 0x7f6178144180 2023-11-04T01:42:27.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f61767fc640 1 -- 172.21.15.2:0/3429564899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61680ad7c0 con 0x7f6178144180 2023-11-04T01:42:27.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f61767fc640 1 -- 172.21.15.2:0/3429564899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680adb50 con 0x7f6178144180 2023-11-04T01:42:27.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f617d2df640 1 -- 172.21.15.2:0/3429564899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178144180 msgr2=0x7f617815ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f617d2df640 1 --2- 172.21.15.2:0/3429564899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178144180 0x7f617815ea60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f61680097c0 tx=0x7f616801c450 comp rx=0 tx=0).stop 2023-11-04T01:42:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f617d2df640 1 -- 172.21.15.2:0/3429564899 shutdown_connections 2023-11-04T01:42:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f617d2df640 1 --2- 172.21.15.2:0/3429564899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178144180 0x7f617815ea60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f617d2df640 1 -- 172.21.15.2:0/3429564899 >> 172.21.15.2:0/3429564899 conn(0x7f61780cfc00 msgr2=0x7f61780d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f617d2df640 1 -- 172.21.15.2:0/3429564899 shutdown_connections 2023-11-04T01:42:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.679+0000 7f617d2df640 1 -- 172.21.15.2:0/3429564899 wait complete. 2023-11-04T01:42:27.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 Processor -- start 2023-11-04T01:42:27.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 -- start start 2023-11-04T01:42:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f617806a160 0x7f617815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61781447f0 0x7f61781378a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178159de0 0x7f61781433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617815ae10 con 0x7f6178159de0 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6178137de0 con 0x7f617806a160 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6178137ff0 con 0x7f61781447f0 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178159de0 0x7f61781433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178159de0 0x7f61781433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46356/0 (socket says 172.21.15.2:46356) 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 -- 172.21.15.2:0/3023627842 learned_addr learned my addr 172.21.15.2:0/3023627842 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f6176ffd640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f617806a160 0x7f617815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f616ffff640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61781447f0 0x7f61781378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 -- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61781447f0 msgr2=0x7f61781378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61781447f0 0x7f61781378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 -- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f617806a160 msgr2=0x7f617815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f617806a160 0x7f617815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 -- 172.21.15.2:0/3023627842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168009420 con 0x7f6178159de0 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f616ffff640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61781447f0 0x7f61781378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f61777fe640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178159de0 0x7f61781433f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f617000c770 tx=0x7f617000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f616f7fe640 1 -- 172.21.15.2:0/3023627842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170003b80 con 0x7f6178159de0 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f616f7fe640 1 -- 172.21.15.2:0/3023627842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6170003ce0 con 0x7f6178159de0 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617806ab00 con 0x7f6178159de0 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f616f7fe640 1 -- 172.21.15.2:0/3023627842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000aa90 con 0x7f6178159de0 2023-11-04T01:42:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6178142f60 con 0x7f6178159de0 2023-11-04T01:42:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.683+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61781430f0 con 0x7f6178159de0 2023-11-04T01:42:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.687+0000 7f616f7fe640 1 -- 172.21.15.2:0/3023627842 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f617000abf0 con 0x7f6178159de0 2023-11-04T01:42:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.687+0000 7f616f7fe640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61580664a0 0x7f6158068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.687+0000 7f616f7fe640 1 -- 172.21.15.2:0/3023627842 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6170083cd0 con 0x7f6178159de0 2023-11-04T01:42:27.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.687+0000 7f6176ffd640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61580664a0 0x7f6158068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:27.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.687+0000 7f6176ffd640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61580664a0 0x7f6158068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61680af000 tx=0x7f61680a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.691+0000 7f616f7fe640 1 -- 172.21.15.2:0/3023627842 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6170051150 con 0x7f6178159de0 2023-11-04T01:42:27.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.835+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f617806a980 con 0x7f61580664a0 2023-11-04T01:42:27.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.855+0000 7f616f7fe640 1 -- 172.21.15.2:0/3023627842 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260938 (secure 0 0 0) 0x7f61680be090 con 0x7f61580664a0 2023-11-04T01:42:27.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61580664a0 msgr2=0x7f6158068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61580664a0 0x7f6158068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61680af000 tx=0x7f61680a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178159de0 msgr2=0x7f61781433f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178159de0 0x7f61781433f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f617000c770 tx=0x7f617000cc30 comp rx=0 tx=0).stop 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 shutdown_connections 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61580664a0 0x7f6158068960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6178159de0 0x7f61781433f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61781447f0 0x7f61781378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 --2- 172.21.15.2:0/3023627842 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f617806a160 0x7f617815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 >> 172.21.15.2:0/3023627842 conn(0x7f61780cfc00 msgr2=0x7f61780b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 shutdown_connections 2023-11-04T01:42:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:27.859+0000 7f617d2df640 1 -- 172.21.15.2:0/3023627842 wait complete. 2023-11-04T01:42:27.880 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-04T01:42:26.759538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235660,"kb_used_data":2656,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739060,"statfs":{"total":773094113280,"available":772852797440,"internally_reserved":0,"allocated":2719744,"data_stored":1679452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001175"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538647+0000","last_change":"2023-11-04T01:42:24.526074+0000","last_active":"2023-11-04T01:42:24.538647+0000","last_peered":"2023-11-04T01:42:24.538647+0000","last_clean":"2023-11-04T01:42:24.538647+0000","last_became_active":"2023-11-04T01:42:24.525339+0000","last_became_peered":"2023-11-04T01:42:24.525339+0000","last_unstale":"2023-11-04T01:42:24.538647+0000","last_undegraded":"2023-11-04T01:42:24.538647+0000","last_fullsized":"2023-11-04T01:42:24.538647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543220+0000","last_change":"2023-11-04T01:42:24.532853+0000","last_active":"2023-11-04T01:42:24.543220+0000","last_peered":"2023-11-04T01:42:24.543220+0000","last_clean":"2023-11-04T01:42:24.543220+0000","last_became_active":"2023-11-04T01:42:24.531811+0000","last_became_peered":"2023-11-04T01:42:24.531811+0000","last_unstale":"2023-11-04T01:42:24.543220+0000","last_undegraded":"2023-11-04T01:42:24.543220+0000","last_fullsized":"2023-11-04T01:42:24.543220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553108+0000","last_change":"2023-11-04T01:42:24.532090+0000","last_active":"2023-11-04T01:42:24.553108+0000","last_peered":"2023-11-04T01:42:24.553108+0000","last_clean":"2023-11-04T01:42:24.553108+0000","last_became_active":"2023-11-04T01:42:24.531252+0000","last_became_peered":"2023-11-04T01:42:24.531252+0000","last_unstale":"2023-11-04T01:42:24.553108+0000","last_undegraded":"2023-11-04T01:42:24.553108+0000","last_fullsized":"2023-11-04T01:42:24.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553224+0000","last_change":"2023-11-04T01:42:24.532641+0000","last_active":"2023-11-04T01:42:24.553224+0000","last_peered":"2023-11-04T01:42:24.553224+0000","last_clean":"2023-11-04T01:42:24.553224+0000","last_became_active":"2023-11-04T01:42:24.531903+0000","last_became_peered":"2023-11-04T01:42:24.531903+0000","last_unstale":"2023-11-04T01:42:24.553224+0000","last_undegraded":"2023-11-04T01:42:24.553224+0000","last_fullsized":"2023-11-04T01:42:24.553224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543629+0000","last_change":"2023-11-04T01:42:24.532676+0000","last_active":"2023-11-04T01:42:24.543629+0000","last_peered":"2023-11-04T01:42:24.543629+0000","last_clean":"2023-11-04T01:42:24.543629+0000","last_became_active":"2023-11-04T01:42:24.531878+0000","last_became_peered":"2023-11-04T01:42:24.531878+0000","last_unstale":"2023-11-04T01:42:24.543629+0000","last_undegraded":"2023-11-04T01:42:24.543629+0000","last_fullsized":"2023-11-04T01:42:24.543629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573452+0000","last_change":"2023-11-04T01:42:24.555198+0000","last_active":"2023-11-04T01:42:25.573452+0000","last_peered":"2023-11-04T01:42:25.573452+0000","last_clean":"2023-11-04T01:42:25.573452+0000","last_became_active":"2023-11-04T01:42:24.554517+0000","last_became_peered":"2023-11-04T01:42:24.554517+0000","last_unstale":"2023-11-04T01:42:25.573452+0000","last_undegraded":"2023-11-04T01:42:25.573452+0000","last_fullsized":"2023-11-04T01:42:25.573452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572931+0000","last_change":"2023-11-04T01:42:24.537075+0000","last_active":"2023-11-04T01:42:25.572931+0000","last_peered":"2023-11-04T01:42:25.572931+0000","last_clean":"2023-11-04T01:42:25.572931+0000","last_became_active":"2023-11-04T01:42:24.536346+0000","last_became_peered":"2023-11-04T01:42:24.536346+0000","last_unstale":"2023-11-04T01:42:25.572931+0000","last_undegraded":"2023-11-04T01:42:25.572931+0000","last_fullsized":"2023-11-04T01:42:25.572931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538718+0000","last_change":"2023-11-04T01:42:24.526411+0000","last_active":"2023-11-04T01:42:24.538718+0000","last_peered":"2023-11-04T01:42:24.538718+0000","last_clean":"2023-11-04T01:42:24.538718+0000","last_became_active":"2023-11-04T01:42:24.525610+0000","last_became_peered":"2023-11-04T01:42:24.525610+0000","last_unstale":"2023-11-04T01:42:24.538718+0000","last_undegraded":"2023-11-04T01:42:24.538718+0000","last_fullsized":"2023-11-04T01:42:24.538718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505513+0000","last_change":"2023-11-04T01:42:24.551036+0000","last_active":"2023-11-04T01:42:25.505513+0000","last_peered":"2023-11-04T01:42:25.505513+0000","last_clean":"2023-11-04T01:42:25.505513+0000","last_became_active":"2023-11-04T01:42:24.550386+0000","last_became_peered":"2023-11-04T01:42:24.550386+0000","last_unstale":"2023-11-04T01:42:25.505513+0000","last_undegraded":"2023-11-04T01:42:25.505513+0000","last_fullsized":"2023-11-04T01:42:25.505513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506769+0000","last_change":"2023-11-04T01:42:24.559164+0000","last_active":"2023-11-04T01:42:25.506769+0000","last_peered":"2023-11-04T01:42:25.506769+0000","last_clean":"2023-11-04T01:42:25.506769+0000","last_became_active":"2023-11-04T01:42:24.558452+0000","last_became_peered":"2023-11-04T01:42:24.558452+0000","last_unstale":"2023-11-04T01:42:25.506769+0000","last_undegraded":"2023-11-04T01:42:25.506769+0000","last_fullsized":"2023-11-04T01:42:25.506769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:31.294438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546974+0000","last_change":"2023-11-04T01:42:24.542766+0000","last_active":"2023-11-04T01:42:24.546974+0000","last_peered":"2023-11-04T01:42:24.546974+0000","last_clean":"2023-11-04T01:42:24.546974+0000","last_became_active":"2023-11-04T01:42:24.542209+0000","last_became_peered":"2023-11-04T01:42:24.542209+0000","last_unstale":"2023-11-04T01:42:24.546974+0000","last_undegraded":"2023-11-04T01:42:24.546974+0000","last_fullsized":"2023-11-04T01:42:24.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:48.042046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507069+0000","last_change":"2023-11-04T01:42:24.533283+0000","last_active":"2023-11-04T01:42:25.507069+0000","last_peered":"2023-11-04T01:42:25.507069+0000","last_clean":"2023-11-04T01:42:25.507069+0000","last_became_active":"2023-11-04T01:42:24.530651+0000","last_became_peered":"2023-11-04T01:42:24.530651+0000","last_unstale":"2023-11-04T01:42:25.507069+0000","last_undegraded":"2023-11-04T01:42:25.507069+0000","last_fullsized":"2023-11-04T01:42:25.507069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:51.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504099+0000","last_change":"2023-11-04T01:42:24.528107+0000","last_active":"2023-11-04T01:42:25.504099+0000","last_peered":"2023-11-04T01:42:25.504099+0000","last_clean":"2023-11-04T01:42:25.504099+0000","last_became_active":"2023-11-04T01:42:24.527344+0000","last_became_peered":"2023-11-04T01:42:24.527344+0000","last_unstale":"2023-11-04T01:42:25.504099+0000","last_undegraded":"2023-11-04T01:42:25.504099+0000","last_fullsized":"2023-11-04T01:42:25.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:48.101766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546578+0000","last_change":"2023-11-04T01:42:24.544709+0000","last_active":"2023-11-04T01:42:24.546578+0000","last_peered":"2023-11-04T01:42:24.546578+0000","last_clean":"2023-11-04T01:42:24.546578+0000","last_became_active":"2023-11-04T01:42:24.543976+0000","last_became_peered":"2023-11-04T01:42:24.543976+0000","last_unstale":"2023-11-04T01:42:24.546578+0000","last_undegraded":"2023-11-04T01:42:24.546578+0000","last_fullsized":"2023-11-04T01:42:24.546578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505748+0000","last_change":"2023-11-04T01:42:24.532616+0000","last_active":"2023-11-04T01:42:25.505748+0000","last_peered":"2023-11-04T01:42:25.505748+0000","last_clean":"2023-11-04T01:42:25.505748+0000","last_became_active":"2023-11-04T01:42:24.529894+0000","last_became_peered":"2023-11-04T01:42:24.529894+0000","last_unstale":"2023-11-04T01:42:25.505748+0000","last_undegraded":"2023-11-04T01:42:25.505748+0000","last_fullsized":"2023-11-04T01:42:25.505748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544733+0000","last_change":"2023-11-04T01:42:24.540137+0000","last_active":"2023-11-04T01:42:24.544733+0000","last_peered":"2023-11-04T01:42:24.544733+0000","last_clean":"2023-11-04T01:42:24.544733+0000","last_became_active":"2023-11-04T01:42:24.539303+0000","last_became_peered":"2023-11-04T01:42:24.539303+0000","last_unstale":"2023-11-04T01:42:24.544733+0000","last_undegraded":"2023-11-04T01:42:24.544733+0000","last_fullsized":"2023-11-04T01:42:24.544733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553334+0000","last_change":"2023-11-04T01:42:24.537992+0000","last_active":"2023-11-04T01:42:24.553334+0000","last_peered":"2023-11-04T01:42:24.553334+0000","last_clean":"2023-11-04T01:42:24.553334+0000","last_became_active":"2023-11-04T01:42:24.537129+0000","last_became_peered":"2023-11-04T01:42:24.537129+0000","last_unstale":"2023-11-04T01:42:24.553334+0000","last_undegraded":"2023-11-04T01:42:24.553334+0000","last_fullsized":"2023-11-04T01:42:24.553334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573347+0000","last_change":"2023-11-04T01:42:24.530582+0000","last_active":"2023-11-04T01:42:25.573347+0000","last_peered":"2023-11-04T01:42:25.573347+0000","last_clean":"2023-11-04T01:42:25.573347+0000","last_became_active":"2023-11-04T01:42:24.529891+0000","last_became_peered":"2023-11-04T01:42:24.529891+0000","last_unstale":"2023-11-04T01:42:25.573347+0000","last_undegraded":"2023-11-04T01:42:25.573347+0000","last_fullsized":"2023-11-04T01:42:25.573347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573474+0000","last_change":"2023-11-04T01:42:24.554452+0000","last_active":"2023-11-04T01:42:25.573474+0000","last_peered":"2023-11-04T01:42:25.573474+0000","last_clean":"2023-11-04T01:42:25.573474+0000","last_became_active":"2023-11-04T01:42:24.553857+0000","last_became_peered":"2023-11-04T01:42:24.553857+0000","last_unstale":"2023-11-04T01:42:25.573474+0000","last_undegraded":"2023-11-04T01:42:25.573474+0000","last_fullsized":"2023-11-04T01:42:25.573474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:48.459289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543232+0000","last_change":"2023-11-04T01:42:24.532888+0000","last_active":"2023-11-04T01:42:24.543232+0000","last_peered":"2023-11-04T01:42:24.543232+0000","last_clean":"2023-11-04T01:42:24.543232+0000","last_became_active":"2023-11-04T01:42:24.532172+0000","last_became_peered":"2023-11-04T01:42:24.532172+0000","last_unstale":"2023-11-04T01:42:24.543232+0000","last_undegraded":"2023-11-04T01:42:24.543232+0000","last_fullsized":"2023-11-04T01:42:24.543232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505919+0000","last_change":"2023-11-04T01:42:24.532118+0000","last_active":"2023-11-04T01:42:25.505919+0000","last_peered":"2023-11-04T01:42:25.505919+0000","last_clean":"2023-11-04T01:42:25.505919+0000","last_became_active":"2023-11-04T01:42:24.530531+0000","last_became_peered":"2023-11-04T01:42:24.530531+0000","last_unstale":"2023-11-04T01:42:25.505919+0000","last_undegraded":"2023-11-04T01:42:25.505919+0000","last_fullsized":"2023-11-04T01:42:25.505919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546959+0000","last_change":"2023-11-04T01:42:24.541439+0000","last_active":"2023-11-04T01:42:24.546959+0000","last_peered":"2023-11-04T01:42:24.546959+0000","last_clean":"2023-11-04T01:42:24.546959+0000","last_became_active":"2023-11-04T01:42:24.540727+0000","last_became_peered":"2023-11-04T01:42:24.540727+0000","last_unstale":"2023-11-04T01:42:24.546959+0000","last_undegraded":"2023-11-04T01:42:24.546959+0000","last_fullsized":"2023-11-04T01:42:24.546959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:01.489039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.545101+0000","last_change":"2023-11-04T01:42:24.521552+0000","last_active":"2023-11-04T01:42:24.545101+0000","last_peered":"2023-11-04T01:42:24.545101+0000","last_clean":"2023-11-04T01:42:24.545101+0000","last_became_active":"2023-11-04T01:42:24.520794+0000","last_became_peered":"2023-11-04T01:42:24.520794+0000","last_unstale":"2023-11-04T01:42:24.545101+0000","last_undegraded":"2023-11-04T01:42:24.545101+0000","last_fullsized":"2023-11-04T01:42:24.545101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:18.253719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.888606+0000","last_change":"2023-11-04T01:42:23.881752+0000","last_active":"2023-11-04T01:42:24.888606+0000","last_peered":"2023-11-04T01:42:24.888606+0000","last_clean":"2023-11-04T01:42:24.888606+0000","last_became_active":"2023-11-04T01:42:23.871460+0000","last_became_peered":"2023-11-04T01:42:23.871460+0000","last_unstale":"2023-11-04T01:42:24.888606+0000","last_undegraded":"2023-11-04T01:42:24.888606+0000","last_fullsized":"2023-11-04T01:42:24.888606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504494+0000","last_change":"2023-11-04T01:42:24.536354+0000","last_active":"2023-11-04T01:42:25.504494+0000","last_peered":"2023-11-04T01:42:25.504494+0000","last_clean":"2023-11-04T01:42:25.504494+0000","last_became_active":"2023-11-04T01:42:24.535597+0000","last_became_peered":"2023-11-04T01:42:24.535597+0000","last_unstale":"2023-11-04T01:42:25.504494+0000","last_undegraded":"2023-11-04T01:42:25.504494+0000","last_fullsized":"2023-11-04T01:42:25.504494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:09.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507312+0000","last_change":"2023-11-04T01:42:23.854629+0000","last_active":"2023-11-04T01:42:25.507312+0000","last_peered":"2023-11-04T01:42:25.507312+0000","last_clean":"2023-11-04T01:42:25.507312+0000","last_became_active":"2023-11-04T01:42:23.854209+0000","last_became_peered":"2023-11-04T01:42:23.854209+0000","last_unstale":"2023-11-04T01:42:25.507312+0000","last_undegraded":"2023-11-04T01:42:25.507312+0000","last_fullsized":"2023-11-04T01:42:25.507312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572788+0000","last_change":"2023-11-04T01:42:23.871583+0000","last_active":"2023-11-04T01:42:25.572788+0000","last_peered":"2023-11-04T01:42:25.572788+0000","last_clean":"2023-11-04T01:42:25.572788+0000","last_became_active":"2023-11-04T01:42:23.870753+0000","last_became_peered":"2023-11-04T01:42:23.870753+0000","last_unstale":"2023-11-04T01:42:25.572788+0000","last_undegraded":"2023-11-04T01:42:25.572788+0000","last_fullsized":"2023-11-04T01:42:25.572788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:45.998097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.542631+0000","last_change":"2023-11-04T01:42:24.527244+0000","last_active":"2023-11-04T01:42:24.542631+0000","last_peered":"2023-11-04T01:42:24.542631+0000","last_clean":"2023-11-04T01:42:24.542631+0000","last_became_active":"2023-11-04T01:42:24.526519+0000","last_became_peered":"2023-11-04T01:42:24.526519+0000","last_unstale":"2023-11-04T01:42:24.542631+0000","last_undegraded":"2023-11-04T01:42:24.542631+0000","last_fullsized":"2023-11-04T01:42:24.542631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505615+0000","last_change":"2023-11-04T01:42:23.861230+0000","last_active":"2023-11-04T01:42:25.505615+0000","last_peered":"2023-11-04T01:42:25.505615+0000","last_clean":"2023-11-04T01:42:25.505615+0000","last_became_active":"2023-11-04T01:42:23.859784+0000","last_became_peered":"2023-11-04T01:42:23.859784+0000","last_unstale":"2023-11-04T01:42:25.505615+0000","last_undegraded":"2023-11-04T01:42:25.505615+0000","last_fullsized":"2023-11-04T01:42:25.505615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:43.619572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504003+0000","last_change":"2023-11-04T01:42:24.524254+0000","last_active":"2023-11-04T01:42:25.504003+0000","last_peered":"2023-11-04T01:42:25.504003+0000","last_clean":"2023-11-04T01:42:25.504003+0000","last_became_active":"2023-11-04T01:42:24.523478+0000","last_became_peered":"2023-11-04T01:42:24.523478+0000","last_unstale":"2023-11-04T01:42:25.504003+0000","last_undegraded":"2023-11-04T01:42:25.504003+0000","last_fullsized":"2023-11-04T01:42:25.504003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:49.878595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553300+0000","last_change":"2023-11-04T01:42:24.530263+0000","last_active":"2023-11-04T01:42:24.553300+0000","last_peered":"2023-11-04T01:42:24.553300+0000","last_clean":"2023-11-04T01:42:24.553300+0000","last_became_active":"2023-11-04T01:42:24.529507+0000","last_became_peered":"2023-11-04T01:42:24.529507+0000","last_unstale":"2023-11-04T01:42:24.553300+0000","last_undegraded":"2023-11-04T01:42:24.553300+0000","last_fullsized":"2023-11-04T01:42:24.553300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543396+0000","last_change":"2023-11-04T01:42:24.534026+0000","last_active":"2023-11-04T01:42:24.543396+0000","last_peered":"2023-11-04T01:42:24.543396+0000","last_clean":"2023-11-04T01:42:24.543396+0000","last_became_active":"2023-11-04T01:42:24.533338+0000","last_became_peered":"2023-11-04T01:42:24.533338+0000","last_unstale":"2023-11-04T01:42:24.543396+0000","last_undegraded":"2023-11-04T01:42:24.543396+0000","last_fullsized":"2023-11-04T01:42:24.543396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:50.563897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.884338+0000","last_change":"2023-11-04T01:42:23.872021+0000","last_active":"2023-11-04T01:42:24.884338+0000","last_peered":"2023-11-04T01:42:24.884338+0000","last_clean":"2023-11-04T01:42:24.884338+0000","last_became_active":"2023-11-04T01:42:23.870751+0000","last_became_peered":"2023-11-04T01:42:23.870751+0000","last_unstale":"2023-11-04T01:42:24.884338+0000","last_undegraded":"2023-11-04T01:42:24.884338+0000","last_fullsized":"2023-11-04T01:42:24.884338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.620945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506411+0000","last_change":"2023-11-04T01:42:24.546924+0000","last_active":"2023-11-04T01:42:25.506411+0000","last_peered":"2023-11-04T01:42:25.506411+0000","last_clean":"2023-11-04T01:42:25.506411+0000","last_became_active":"2023-11-04T01:42:24.546318+0000","last_became_peered":"2023-11-04T01:42:24.546318+0000","last_unstale":"2023-11-04T01:42:25.506411+0000","last_undegraded":"2023-11-04T01:42:25.506411+0000","last_fullsized":"2023-11-04T01:42:25.506411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:48.887573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.893734+0000","last_change":"2023-11-04T01:42:23.872849+0000","last_active":"2023-11-04T01:42:24.893734+0000","last_peered":"2023-11-04T01:42:24.893734+0000","last_clean":"2023-11-04T01:42:24.893734+0000","last_became_active":"2023-11-04T01:42:23.872394+0000","last_became_peered":"2023-11-04T01:42:23.872394+0000","last_unstale":"2023-11-04T01:42:24.893734+0000","last_undegraded":"2023-11-04T01:42:24.893734+0000","last_fullsized":"2023-11-04T01:42:24.893734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887748+0000","last_change":"2023-11-04T01:42:23.878097+0000","last_active":"2023-11-04T01:42:24.887748+0000","last_peered":"2023-11-04T01:42:24.887748+0000","last_clean":"2023-11-04T01:42:24.887748+0000","last_became_active":"2023-11-04T01:42:23.877265+0000","last_became_peered":"2023-11-04T01:42:23.877265+0000","last_unstale":"2023-11-04T01:42:24.887748+0000","last_undegraded":"2023-11-04T01:42:24.887748+0000","last_fullsized":"2023-11-04T01:42:24.887748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:22.344804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573080+0000","last_change":"2023-11-04T01:42:24.546728+0000","last_active":"2023-11-04T01:42:25.573080+0000","last_peered":"2023-11-04T01:42:25.573080+0000","last_clean":"2023-11-04T01:42:25.573080+0000","last_became_active":"2023-11-04T01:42:24.545946+0000","last_became_peered":"2023-11-04T01:42:24.545946+0000","last_unstale":"2023-11-04T01:42:25.573080+0000","last_undegraded":"2023-11-04T01:42:25.573080+0000","last_fullsized":"2023-11-04T01:42:25.573080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506789+0000","last_change":"2023-11-04T01:42:23.875211+0000","last_active":"2023-11-04T01:42:25.506789+0000","last_peered":"2023-11-04T01:42:25.506789+0000","last_clean":"2023-11-04T01:42:25.506789+0000","last_became_active":"2023-11-04T01:42:23.874649+0000","last_became_peered":"2023-11-04T01:42:23.874649+0000","last_unstale":"2023-11-04T01:42:25.506789+0000","last_undegraded":"2023-11-04T01:42:25.506789+0000","last_fullsized":"2023-11-04T01:42:25.506789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506005+0000","last_change":"2023-11-04T01:42:24.557710+0000","last_active":"2023-11-04T01:42:25.506005+0000","last_peered":"2023-11-04T01:42:25.506005+0000","last_clean":"2023-11-04T01:42:25.506005+0000","last_became_active":"2023-11-04T01:42:24.557097+0000","last_became_peered":"2023-11-04T01:42:24.557097+0000","last_unstale":"2023-11-04T01:42:25.506005+0000","last_undegraded":"2023-11-04T01:42:25.506005+0000","last_fullsized":"2023-11-04T01:42:25.506005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:07.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503660+0000","last_change":"2023-11-04T01:42:23.878725+0000","last_active":"2023-11-04T01:42:25.503660+0000","last_peered":"2023-11-04T01:42:25.503660+0000","last_clean":"2023-11-04T01:42:25.503660+0000","last_became_active":"2023-11-04T01:42:23.877930+0000","last_became_peered":"2023-11-04T01:42:23.877930+0000","last_unstale":"2023-11-04T01:42:25.503660+0000","last_undegraded":"2023-11-04T01:42:25.503660+0000","last_fullsized":"2023-11-04T01:42:25.503660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:52.439183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505874+0000","last_change":"2023-11-04T01:42:24.545238+0000","last_active":"2023-11-04T01:42:25.505874+0000","last_peered":"2023-11-04T01:42:25.505874+0000","last_clean":"2023-11-04T01:42:25.505874+0000","last_became_active":"2023-11-04T01:42:24.544606+0000","last_became_peered":"2023-11-04T01:42:24.544606+0000","last_unstale":"2023-11-04T01:42:25.505874+0000","last_undegraded":"2023-11-04T01:42:25.505874+0000","last_fullsized":"2023-11-04T01:42:25.505874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.561776+0000","last_change":"2023-11-04T01:42:24.560710+0000","last_active":"2023-11-04T01:42:24.561776+0000","last_peered":"2023-11-04T01:42:24.561776+0000","last_clean":"2023-11-04T01:42:24.561776+0000","last_became_active":"2023-11-04T01:42:24.560051+0000","last_became_peered":"2023-11-04T01:42:24.560051+0000","last_unstale":"2023-11-04T01:42:24.561776+0000","last_undegraded":"2023-11-04T01:42:24.561776+0000","last_fullsized":"2023-11-04T01:42:24.561776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:14.623927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504630+0000","last_change":"2023-11-04T01:42:23.892535+0000","last_active":"2023-11-04T01:42:25.504630+0000","last_peered":"2023-11-04T01:42:25.504630+0000","last_clean":"2023-11-04T01:42:25.504630+0000","last_became_active":"2023-11-04T01:42:23.891942+0000","last_became_peered":"2023-11-04T01:42:23.891942+0000","last_unstale":"2023-11-04T01:42:25.504630+0000","last_undegraded":"2023-11-04T01:42:25.504630+0000","last_fullsized":"2023-11-04T01:42:25.504630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:28.817061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.886886+0000","last_change":"2023-11-04T01:42:23.879946+0000","last_active":"2023-11-04T01:42:24.886886+0000","last_peered":"2023-11-04T01:42:24.886886+0000","last_clean":"2023-11-04T01:42:24.886886+0000","last_became_active":"2023-11-04T01:42:23.879106+0000","last_became_peered":"2023-11-04T01:42:23.879106+0000","last_unstale":"2023-11-04T01:42:24.886886+0000","last_undegraded":"2023-11-04T01:42:24.886886+0000","last_fullsized":"2023-11-04T01:42:24.886886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:56.805776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573731+0000","last_change":"2023-11-04T01:42:23.859651+0000","last_active":"2023-11-04T01:42:25.573731+0000","last_peered":"2023-11-04T01:42:25.573731+0000","last_clean":"2023-11-04T01:42:25.573731+0000","last_became_active":"2023-11-04T01:42:23.858848+0000","last_became_peered":"2023-11-04T01:42:23.858848+0000","last_unstale":"2023-11-04T01:42:25.573731+0000","last_undegraded":"2023-11-04T01:42:25.573731+0000","last_fullsized":"2023-11-04T01:42:25.573731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506723+0000","last_change":"2023-11-04T01:42:24.542701+0000","last_active":"2023-11-04T01:42:25.506723+0000","last_peered":"2023-11-04T01:42:25.506723+0000","last_clean":"2023-11-04T01:42:25.506723+0000","last_became_active":"2023-11-04T01:42:24.541785+0000","last_became_peered":"2023-11-04T01:42:24.541785+0000","last_unstale":"2023-11-04T01:42:25.506723+0000","last_undegraded":"2023-11-04T01:42:25.506723+0000","last_fullsized":"2023-11-04T01:42:25.506723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:54.044840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-04T01:42:14.368894+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:42:14.368894+0000","last_peered":"2023-11-04T01:42:14.368894+0000","last_clean":"2023-11-04T01:42:14.368894+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:42:14.368894+0000","last_undegraded":"2023-11-04T01:42:14.368894+0000","last_fullsized":"2023-11-04T01:42:14.368894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506303+0000","last_change":"2023-11-04T01:42:23.870050+0000","last_active":"2023-11-04T01:42:25.506303+0000","last_peered":"2023-11-04T01:42:25.506303+0000","last_clean":"2023-11-04T01:42:25.506303+0000","last_became_active":"2023-11-04T01:42:23.868558+0000","last_became_peered":"2023-11-04T01:42:23.868558+0000","last_unstale":"2023-11-04T01:42:25.506303+0000","last_undegraded":"2023-11-04T01:42:25.506303+0000","last_fullsized":"2023-11-04T01:42:25.506303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504592+0000","last_change":"2023-11-04T01:42:24.515619+0000","last_active":"2023-11-04T01:42:25.504592+0000","last_peered":"2023-11-04T01:42:25.504592+0000","last_clean":"2023-11-04T01:42:25.504592+0000","last_became_active":"2023-11-04T01:42:24.514861+0000","last_became_peered":"2023-11-04T01:42:24.514861+0000","last_unstale":"2023-11-04T01:42:25.504592+0000","last_undegraded":"2023-11-04T01:42:25.504592+0000","last_fullsized":"2023-11-04T01:42:25.504592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:12.327963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505707+0000","last_change":"2023-11-04T01:42:23.889363+0000","last_active":"2023-11-04T01:42:25.505707+0000","last_peered":"2023-11-04T01:42:25.505707+0000","last_clean":"2023-11-04T01:42:25.505707+0000","last_became_active":"2023-11-04T01:42:23.888990+0000","last_became_peered":"2023-11-04T01:42:23.888990+0000","last_unstale":"2023-11-04T01:42:25.505707+0000","last_undegraded":"2023-11-04T01:42:25.505707+0000","last_fullsized":"2023-11-04T01:42:25.505707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572945+0000","last_change":"2023-11-04T01:42:24.544491+0000","last_active":"2023-11-04T01:42:25.572945+0000","last_peered":"2023-11-04T01:42:25.572945+0000","last_clean":"2023-11-04T01:42:25.572945+0000","last_became_active":"2023-11-04T01:42:24.543670+0000","last_became_peered":"2023-11-04T01:42:24.543670+0000","last_unstale":"2023-11-04T01:42:25.572945+0000","last_undegraded":"2023-11-04T01:42:25.572945+0000","last_fullsized":"2023-11-04T01:42:25.572945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.510207+0000","last_change":"2023-11-04T01:42:23.887645+0000","last_active":"2023-11-04T01:42:24.510207+0000","last_peered":"2023-11-04T01:42:24.510207+0000","last_clean":"2023-11-04T01:42:24.510207+0000","last_became_active":"2023-11-04T01:42:23.887066+0000","last_became_peered":"2023-11-04T01:42:23.887066+0000","last_unstale":"2023-11-04T01:42:24.510207+0000","last_undegraded":"2023-11-04T01:42:24.510207+0000","last_fullsized":"2023-11-04T01:42:24.510207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:14.860163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543580+0000","last_change":"2023-11-04T01:42:24.530872+0000","last_active":"2023-11-04T01:42:24.543580+0000","last_peered":"2023-11-04T01:42:24.543580+0000","last_clean":"2023-11-04T01:42:24.543580+0000","last_became_active":"2023-11-04T01:42:24.529785+0000","last_became_peered":"2023-11-04T01:42:24.529785+0000","last_unstale":"2023-11-04T01:42:24.543580+0000","last_undegraded":"2023-11-04T01:42:24.543580+0000","last_fullsized":"2023-11-04T01:42:24.543580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:05.406379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507010+0000","last_change":"2023-11-04T01:42:23.864470+0000","last_active":"2023-11-04T01:42:25.507010+0000","last_peered":"2023-11-04T01:42:25.507010+0000","last_clean":"2023-11-04T01:42:25.507010+0000","last_became_active":"2023-11-04T01:42:23.864049+0000","last_became_peered":"2023-11-04T01:42:23.864049+0000","last_unstale":"2023-11-04T01:42:25.507010+0000","last_undegraded":"2023-11-04T01:42:25.507010+0000","last_fullsized":"2023-11-04T01:42:25.507010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.509613+0000","last_change":"2023-11-04T01:42:23.881220+0000","last_active":"2023-11-04T01:42:24.509613+0000","last_peered":"2023-11-04T01:42:24.509613+0000","last_clean":"2023-11-04T01:42:24.509613+0000","last_became_active":"2023-11-04T01:42:23.880569+0000","last_became_peered":"2023-11-04T01:42:23.880569+0000","last_unstale":"2023-11-04T01:42:24.509613+0000","last_undegraded":"2023-11-04T01:42:24.509613+0000","last_fullsized":"2023-11-04T01:42:24.509613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553251+0000","last_change":"2023-11-04T01:42:24.544821+0000","last_active":"2023-11-04T01:42:24.553251+0000","last_peered":"2023-11-04T01:42:24.553251+0000","last_clean":"2023-11-04T01:42:24.553251+0000","last_became_active":"2023-11-04T01:42:24.544158+0000","last_became_peered":"2023-11-04T01:42:24.544158+0000","last_unstale":"2023-11-04T01:42:24.553251+0000","last_undegraded":"2023-11-04T01:42:24.553251+0000","last_fullsized":"2023-11-04T01:42:24.553251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507284+0000","last_change":"2023-11-04T01:42:23.867710+0000","last_active":"2023-11-04T01:42:25.507284+0000","last_peered":"2023-11-04T01:42:25.507284+0000","last_clean":"2023-11-04T01:42:25.507284+0000","last_became_active":"2023-11-04T01:42:23.867162+0000","last_became_peered":"2023-11-04T01:42:23.867162+0000","last_unstale":"2023-11-04T01:42:25.507284+0000","last_undegraded":"2023-11-04T01:42:25.507284+0000","last_fullsized":"2023-11-04T01:42:25.507284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:48.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573619+0000","last_change":"2023-11-04T01:42:24.529944+0000","last_active":"2023-11-04T01:42:25.573619+0000","last_peered":"2023-11-04T01:42:25.573619+0000","last_clean":"2023-11-04T01:42:25.573619+0000","last_became_active":"2023-11-04T01:42:24.528837+0000","last_became_peered":"2023-11-04T01:42:24.528837+0000","last_unstale":"2023-11-04T01:42:25.573619+0000","last_undegraded":"2023-11-04T01:42:25.573619+0000","last_fullsized":"2023-11-04T01:42:25.573619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.261927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504841+0000","last_change":"2023-11-04T01:42:23.871604+0000","last_active":"2023-11-04T01:42:25.504841+0000","last_peered":"2023-11-04T01:42:25.504841+0000","last_clean":"2023-11-04T01:42:25.504841+0000","last_became_active":"2023-11-04T01:42:23.870746+0000","last_became_peered":"2023-11-04T01:42:23.870746+0000","last_unstale":"2023-11-04T01:42:25.504841+0000","last_undegraded":"2023-11-04T01:42:25.504841+0000","last_fullsized":"2023-11-04T01:42:25.504841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:22.043685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504543+0000","last_change":"2023-11-04T01:42:24.520352+0000","last_active":"2023-11-04T01:42:25.504543+0000","last_peered":"2023-11-04T01:42:25.504543+0000","last_clean":"2023-11-04T01:42:25.504543+0000","last_became_active":"2023-11-04T01:42:24.519515+0000","last_became_peered":"2023-11-04T01:42:24.519515+0000","last_unstale":"2023-11-04T01:42:25.504543+0000","last_undegraded":"2023-11-04T01:42:25.504543+0000","last_fullsized":"2023-11-04T01:42:25.504543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:31.963568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506869+0000","last_change":"2023-11-04T01:42:23.856440+0000","last_active":"2023-11-04T01:42:25.506869+0000","last_peered":"2023-11-04T01:42:25.506869+0000","last_clean":"2023-11-04T01:42:25.506869+0000","last_became_active":"2023-11-04T01:42:23.856067+0000","last_became_peered":"2023-11-04T01:42:23.856067+0000","last_unstale":"2023-11-04T01:42:25.506869+0000","last_undegraded":"2023-11-04T01:42:25.506869+0000","last_fullsized":"2023-11-04T01:42:25.506869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:21.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504391+0000","last_change":"2023-11-04T01:42:24.530290+0000","last_active":"2023-11-04T01:42:25.504391+0000","last_peered":"2023-11-04T01:42:25.504391+0000","last_clean":"2023-11-04T01:42:25.504391+0000","last_became_active":"2023-11-04T01:42:24.529568+0000","last_became_peered":"2023-11-04T01:42:24.529568+0000","last_unstale":"2023-11-04T01:42:25.504391+0000","last_undegraded":"2023-11-04T01:42:25.504391+0000","last_fullsized":"2023-11-04T01:42:25.504391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:42.384938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506042+0000","last_change":"2023-11-04T01:42:24.532587+0000","last_active":"2023-11-04T01:42:25.506042+0000","last_peered":"2023-11-04T01:42:25.506042+0000","last_clean":"2023-11-04T01:42:25.506042+0000","last_became_active":"2023-11-04T01:42:24.531827+0000","last_became_peered":"2023-11-04T01:42:24.531827+0000","last_unstale":"2023-11-04T01:42:25.506042+0000","last_undegraded":"2023-11-04T01:42:25.506042+0000","last_fullsized":"2023-11-04T01:42:25.506042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:09.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504135+0000","last_change":"2023-11-04T01:42:23.871960+0000","last_active":"2023-11-04T01:42:25.504135+0000","last_peered":"2023-11-04T01:42:25.504135+0000","last_clean":"2023-11-04T01:42:25.504135+0000","last_became_active":"2023-11-04T01:42:23.871205+0000","last_became_peered":"2023-11-04T01:42:23.871205+0000","last_unstale":"2023-11-04T01:42:25.504135+0000","last_undegraded":"2023-11-04T01:42:25.504135+0000","last_fullsized":"2023-11-04T01:42:25.504135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:33:54.986696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503773+0000","last_change":"2023-11-04T01:42:24.531520+0000","last_active":"2023-11-04T01:42:25.503773+0000","last_peered":"2023-11-04T01:42:25.503773+0000","last_clean":"2023-11-04T01:42:25.503773+0000","last_became_active":"2023-11-04T01:42:24.530762+0000","last_became_peered":"2023-11-04T01:42:24.530762+0000","last_unstale":"2023-11-04T01:42:25.503773+0000","last_undegraded":"2023-11-04T01:42:25.503773+0000","last_fullsized":"2023-11-04T01:42:25.503773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.137518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573320+0000","last_change":"2023-11-04T01:42:23.887853+0000","last_active":"2023-11-04T01:42:25.573320+0000","last_peered":"2023-11-04T01:42:25.573320+0000","last_clean":"2023-11-04T01:42:25.573320+0000","last_became_active":"2023-11-04T01:42:23.886915+0000","last_became_peered":"2023-11-04T01:42:23.886915+0000","last_unstale":"2023-11-04T01:42:25.573320+0000","last_undegraded":"2023-11-04T01:42:25.573320+0000","last_fullsized":"2023-11-04T01:42:25.573320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:25.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.539674+0000","last_change":"2023-11-04T01:42:24.528548+0000","last_active":"2023-11-04T01:42:24.539674+0000","last_peered":"2023-11-04T01:42:24.539674+0000","last_clean":"2023-11-04T01:42:24.539674+0000","last_became_active":"2023-11-04T01:42:24.527750+0000","last_became_peered":"2023-11-04T01:42:24.527750+0000","last_unstale":"2023-11-04T01:42:24.539674+0000","last_undegraded":"2023-11-04T01:42:24.539674+0000","last_fullsized":"2023-11-04T01:42:24.539674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:13.583907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506105+0000","last_change":"2023-11-04T01:42:23.865890+0000","last_active":"2023-11-04T01:42:25.506105+0000","last_peered":"2023-11-04T01:42:25.506105+0000","last_clean":"2023-11-04T01:42:25.506105+0000","last_became_active":"2023-11-04T01:42:23.865503+0000","last_became_peered":"2023-11-04T01:42:23.865503+0000","last_unstale":"2023-11-04T01:42:25.506105+0000","last_undegraded":"2023-11-04T01:42:25.506105+0000","last_fullsized":"2023-11-04T01:42:25.506105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:05.380495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506285+0000","last_change":"2023-11-04T01:42:24.527953+0000","last_active":"2023-11-04T01:42:25.506285+0000","last_peered":"2023-11-04T01:42:25.506285+0000","last_clean":"2023-11-04T01:42:25.506285+0000","last_became_active":"2023-11-04T01:42:24.527112+0000","last_became_peered":"2023-11-04T01:42:24.527112+0000","last_unstale":"2023-11-04T01:42:25.506285+0000","last_undegraded":"2023-11-04T01:42:25.506285+0000","last_fullsized":"2023-11-04T01:42:25.506285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:04.559600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507122+0000","last_change":"2023-11-04T01:42:24.560200+0000","last_active":"2023-11-04T01:42:25.507122+0000","last_peered":"2023-11-04T01:42:25.507122+0000","last_clean":"2023-11-04T01:42:25.507122+0000","last_became_active":"2023-11-04T01:42:24.559286+0000","last_became_peered":"2023-11-04T01:42:24.559286+0000","last_unstale":"2023-11-04T01:42:25.507122+0000","last_undegraded":"2023-11-04T01:42:25.507122+0000","last_fullsized":"2023-11-04T01:42:25.507122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:48.678049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544681+0000","last_change":"2023-11-04T01:42:24.540046+0000","last_active":"2023-11-04T01:42:24.544681+0000","last_peered":"2023-11-04T01:42:24.544681+0000","last_clean":"2023-11-04T01:42:24.544681+0000","last_became_active":"2023-11-04T01:42:24.539286+0000","last_became_peered":"2023-11-04T01:42:24.539286+0000","last_unstale":"2023-11-04T01:42:24.544681+0000","last_undegraded":"2023-11-04T01:42:24.544681+0000","last_fullsized":"2023-11-04T01:42:24.544681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887064+0000","last_change":"2023-11-04T01:42:23.879421+0000","last_active":"2023-11-04T01:42:24.887064+0000","last_peered":"2023-11-04T01:42:24.887064+0000","last_clean":"2023-11-04T01:42:24.887064+0000","last_became_active":"2023-11-04T01:42:23.874688+0000","last_became_peered":"2023-11-04T01:42:23.874688+0000","last_unstale":"2023-11-04T01:42:24.887064+0000","last_undegraded":"2023-11-04T01:42:24.887064+0000","last_fullsized":"2023-11-04T01:42:24.887064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546550+0000","last_change":"2023-11-04T01:42:24.544559+0000","last_active":"2023-11-04T01:42:24.546550+0000","last_peered":"2023-11-04T01:42:24.546550+0000","last_clean":"2023-11-04T01:42:24.546550+0000","last_became_active":"2023-11-04T01:42:24.543895+0000","last_became_peered":"2023-11-04T01:42:24.543895+0000","last_unstale":"2023-11-04T01:42:24.546550+0000","last_undegraded":"2023-11-04T01:42:24.546550+0000","last_fullsized":"2023-11-04T01:42:24.546550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504779+0000","last_change":"2023-11-04T01:42:23.868589+0000","last_active":"2023-11-04T01:42:25.504779+0000","last_peered":"2023-11-04T01:42:25.504779+0000","last_clean":"2023-11-04T01:42:25.504779+0000","last_became_active":"2023-11-04T01:42:23.867572+0000","last_became_peered":"2023-11-04T01:42:23.867572+0000","last_unstale":"2023-11-04T01:42:25.504779+0000","last_undegraded":"2023-11-04T01:42:25.504779+0000","last_fullsized":"2023-11-04T01:42:25.504779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:13.960345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":753664,"data_stored":638256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1150000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5549999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":657215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":200704,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":68367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:27.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.039+0000 7f6afaed3640 1 Processor -- start 2023-11-04T01:42:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.039+0000 7f6afaed3640 1 -- start start 2023-11-04T01:42:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6afaed3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6af40d0b10 0x7f6af415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6afaed3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af40d2280 con 0x7f6af415d240 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6afaed3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af40d2560 con 0x7f6af40b49c0 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6afaed3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af40d2840 con 0x7f6af40d0b10 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af8c6f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6af415d240 0x7f6af40d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42682/0 (socket says 172.21.15.2:42682) 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af8c6f640 1 -- 172.21.15.2:0/1982143621 learned_addr learned my addr 172.21.15.2:0/1982143621 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af3fff640 1 --2- 172.21.15.2:0/1982143621 >> v2:172.21.15.2:3300/0 conn(0x7f6af40d0b10 0x7f6af415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af37fe640 1 -- 172.21.15.2:0/1982143621 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205781303 0 0) 0x7f6af40d2280 con 0x7f6af415d240 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af37fe640 1 -- 172.21.15.2:0/1982143621 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003530 con 0x7f6af415d240 2023-11-04T01:42:28.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af3fff640 1 -- 172.21.15.2:0/1982143621 >> v1:172.21.15.90:6789/0 conn(0x7f6af40b49c0 legacy=0x7f6af40b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af3fff640 1 -- 172.21.15.2:0/1982143621 >> v1:172.21.15.2:6789/0 conn(0x7f6af415d240 legacy=0x7f6af40d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af37fe640 1 -- 172.21.15.2:0/1982143621 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943120602 0 0) 0x7f6adc003530 con 0x7f6af415d240 2023-11-04T01:42:28.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af3fff640 1 -- 172.21.15.2:0/1982143621 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40b66c0 con 0x7f6af40d0b10 2023-11-04T01:42:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af3fff640 1 --2- 172.21.15.2:0/1982143621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af415d620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80097c0 tx=0x7f6ae801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139fc41b6d89183b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af37fe640 1 -- 172.21.15.2:0/1982143621 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4001680 con 0x7f6af40d0b10 2023-11-04T01:42:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af37fe640 1 -- 172.21.15.2:0/1982143621 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae80a7050 con 0x7f6af40d0b10 2023-11-04T01:42:28.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.043+0000 7f6af37fe640 1 -- 172.21.15.2:0/1982143621 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80ab600 con 0x7f6af40d0b10 2023-11-04T01:42:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- 172.21.15.2:0/1982143621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 msgr2=0x7f6af415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 --2- 172.21.15.2:0/1982143621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af415d620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80097c0 tx=0x7f6ae801c3a0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- 172.21.15.2:0/1982143621 shutdown_connections 2023-11-04T01:42:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 --2- 172.21.15.2:0/1982143621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af415d620 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- 172.21.15.2:0/1982143621 >> 172.21.15.2:0/1982143621 conn(0x7f6af40cf9c0 msgr2=0x7f6af40cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- 172.21.15.2:0/1982143621 shutdown_connections 2023-11-04T01:42:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- 172.21.15.2:0/1982143621 wait complete. 2023-11-04T01:42:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 Processor -- start 2023-11-04T01:42:28.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- start start 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6af40b49c0 0x7f6af415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af415d240 0x7f6af4153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af415c900 con 0x7f6af40d0b10 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4159500 con 0x7f6af415d240 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af415a070 con 0x7f6af40b49c0 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af4151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46376/0 (socket says 172.21.15.2:46376) 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 -- 172.21.15.2:0/3970488749 learned_addr learned my addr 172.21.15.2:0/3970488749 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:28.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af9470640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af415d240 0x7f6af4153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af8c6f640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6af40b49c0 0x7f6af415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 -- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6af40b49c0 msgr2=0x7f6af415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6af40b49c0 0x7f6af415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 -- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af415d240 msgr2=0x7f6af4153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af415d240 0x7f6af4153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 -- 172.21.15.2:0/3970488749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8009420 con 0x7f6af40d0b10 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af9470640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af415d240 0x7f6af4153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af3fff640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af4151b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8000c10 tx=0x7f6ae8019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af17fa640 1 -- 172.21.15.2:0/3970488749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8003e60 con 0x7f6af40d0b10 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af17fa640 1 -- 172.21.15.2:0/3970488749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae8006e20 con 0x7f6af40d0b10 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6af17fa640 1 -- 172.21.15.2:0/3970488749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80ab600 con 0x7f6af40d0b10 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af41597a0 con 0x7f6af40d0b10 2023-11-04T01:42:28.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.047+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af4159d80 con 0x7f6af40d0b10 2023-11-04T01:42:28.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.051+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af40675f0 con 0x7f6af40d0b10 2023-11-04T01:42:28.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.051+0000 7f6af17fa640 1 -- 172.21.15.2:0/3970488749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ae80b2040 con 0x7f6af40d0b10 2023-11-04T01:42:28.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.051+0000 7f6af17fa640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ae00664a0 0x7f6ae0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.051+0000 7f6af17fa640 1 -- 172.21.15.2:0/3970488749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ae811dff0 con 0x7f6af40d0b10 2023-11-04T01:42:28.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.051+0000 7f6af8c6f640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ae00664a0 0x7f6ae0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.051+0000 7f6af8c6f640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ae00664a0 0x7f6ae0068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4001ec0 tx=0x7f6ae4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.055+0000 7f6af17fa640 1 -- 172.21.15.2:0/3970488749 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ae80eb410 con 0x7f6af40d0b10 2023-11-04T01:42:28.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.207+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6af40d33c0 con 0x7f6ae00664a0 2023-11-04T01:42:28.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6af17fa640 1 -- 172.21.15.2:0/3970488749 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260938 (secure 0 0 0) 0x7f6af40d33c0 con 0x7f6ae00664a0 2023-11-04T01:42:28.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:28.236 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:42:28.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ae00664a0 msgr2=0x7f6ae0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ae00664a0 0x7f6ae0068960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4001ec0 tx=0x7f6ae4009040 comp rx=0 tx=0).stop 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 msgr2=0x7f6af4151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af4151b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8000c10 tx=0x7f6ae8019140 comp rx=0 tx=0).stop 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 shutdown_connections 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ae00664a0 0x7f6ae0068960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6af415d240 0x7f6af4153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40d0b10 0x7f6af4151b90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 --2- 172.21.15.2:0/3970488749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6af40b49c0 0x7f6af415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 >> 172.21.15.2:0/3970488749 conn(0x7f6af40cf9c0 msgr2=0x7f6af4158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 shutdown_connections 2023-11-04T01:42:28.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.231+0000 7f6afaed3640 1 -- 172.21.15.2:0/3970488749 wait complete. 2023-11-04T01:42:28.252 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-04T01:42:26.759538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235660,"kb_used_data":2656,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739060,"statfs":{"total":773094113280,"available":772852797440,"internally_reserved":0,"allocated":2719744,"data_stored":1679452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001175"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538647+0000","last_change":"2023-11-04T01:42:24.526074+0000","last_active":"2023-11-04T01:42:24.538647+0000","last_peered":"2023-11-04T01:42:24.538647+0000","last_clean":"2023-11-04T01:42:24.538647+0000","last_became_active":"2023-11-04T01:42:24.525339+0000","last_became_peered":"2023-11-04T01:42:24.525339+0000","last_unstale":"2023-11-04T01:42:24.538647+0000","last_undegraded":"2023-11-04T01:42:24.538647+0000","last_fullsized":"2023-11-04T01:42:24.538647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543220+0000","last_change":"2023-11-04T01:42:24.532853+0000","last_active":"2023-11-04T01:42:24.543220+0000","last_peered":"2023-11-04T01:42:24.543220+0000","last_clean":"2023-11-04T01:42:24.543220+0000","last_became_active":"2023-11-04T01:42:24.531811+0000","last_became_peered":"2023-11-04T01:42:24.531811+0000","last_unstale":"2023-11-04T01:42:24.543220+0000","last_undegraded":"2023-11-04T01:42:24.543220+0000","last_fullsized":"2023-11-04T01:42:24.543220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553108+0000","last_change":"2023-11-04T01:42:24.532090+0000","last_active":"2023-11-04T01:42:24.553108+0000","last_peered":"2023-11-04T01:42:24.553108+0000","last_clean":"2023-11-04T01:42:24.553108+0000","last_became_active":"2023-11-04T01:42:24.531252+0000","last_became_peered":"2023-11-04T01:42:24.531252+0000","last_unstale":"2023-11-04T01:42:24.553108+0000","last_undegraded":"2023-11-04T01:42:24.553108+0000","last_fullsized":"2023-11-04T01:42:24.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553224+0000","last_change":"2023-11-04T01:42:24.532641+0000","last_active":"2023-11-04T01:42:24.553224+0000","last_peered":"2023-11-04T01:42:24.553224+0000","last_clean":"2023-11-04T01:42:24.553224+0000","last_became_active":"2023-11-04T01:42:24.531903+0000","last_became_peered":"2023-11-04T01:42:24.531903+0000","last_unstale":"2023-11-04T01:42:24.553224+0000","last_undegraded":"2023-11-04T01:42:24.553224+0000","last_fullsized":"2023-11-04T01:42:24.553224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543629+0000","last_change":"2023-11-04T01:42:24.532676+0000","last_active":"2023-11-04T01:42:24.543629+0000","last_peered":"2023-11-04T01:42:24.543629+0000","last_clean":"2023-11-04T01:42:24.543629+0000","last_became_active":"2023-11-04T01:42:24.531878+0000","last_became_peered":"2023-11-04T01:42:24.531878+0000","last_unstale":"2023-11-04T01:42:24.543629+0000","last_undegraded":"2023-11-04T01:42:24.543629+0000","last_fullsized":"2023-11-04T01:42:24.543629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573452+0000","last_change":"2023-11-04T01:42:24.555198+0000","last_active":"2023-11-04T01:42:25.573452+0000","last_peered":"2023-11-04T01:42:25.573452+0000","last_clean":"2023-11-04T01:42:25.573452+0000","last_became_active":"2023-11-04T01:42:24.554517+0000","last_became_peered":"2023-11-04T01:42:24.554517+0000","last_unstale":"2023-11-04T01:42:25.573452+0000","last_undegraded":"2023-11-04T01:42:25.573452+0000","last_fullsized":"2023-11-04T01:42:25.573452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572931+0000","last_change":"2023-11-04T01:42:24.537075+0000","last_active":"2023-11-04T01:42:25.572931+0000","last_peered":"2023-11-04T01:42:25.572931+0000","last_clean":"2023-11-04T01:42:25.572931+0000","last_became_active":"2023-11-04T01:42:24.536346+0000","last_became_peered":"2023-11-04T01:42:24.536346+0000","last_unstale":"2023-11-04T01:42:25.572931+0000","last_undegraded":"2023-11-04T01:42:25.572931+0000","last_fullsized":"2023-11-04T01:42:25.572931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538718+0000","last_change":"2023-11-04T01:42:24.526411+0000","last_active":"2023-11-04T01:42:24.538718+0000","last_peered":"2023-11-04T01:42:24.538718+0000","last_clean":"2023-11-04T01:42:24.538718+0000","last_became_active":"2023-11-04T01:42:24.525610+0000","last_became_peered":"2023-11-04T01:42:24.525610+0000","last_unstale":"2023-11-04T01:42:24.538718+0000","last_undegraded":"2023-11-04T01:42:24.538718+0000","last_fullsized":"2023-11-04T01:42:24.538718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505513+0000","last_change":"2023-11-04T01:42:24.551036+0000","last_active":"2023-11-04T01:42:25.505513+0000","last_peered":"2023-11-04T01:42:25.505513+0000","last_clean":"2023-11-04T01:42:25.505513+0000","last_became_active":"2023-11-04T01:42:24.550386+0000","last_became_peered":"2023-11-04T01:42:24.550386+0000","last_unstale":"2023-11-04T01:42:25.505513+0000","last_undegraded":"2023-11-04T01:42:25.505513+0000","last_fullsized":"2023-11-04T01:42:25.505513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506769+0000","last_change":"2023-11-04T01:42:24.559164+0000","last_active":"2023-11-04T01:42:25.506769+0000","last_peered":"2023-11-04T01:42:25.506769+0000","last_clean":"2023-11-04T01:42:25.506769+0000","last_became_active":"2023-11-04T01:42:24.558452+0000","last_became_peered":"2023-11-04T01:42:24.558452+0000","last_unstale":"2023-11-04T01:42:25.506769+0000","last_undegraded":"2023-11-04T01:42:25.506769+0000","last_fullsized":"2023-11-04T01:42:25.506769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:31.294438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546974+0000","last_change":"2023-11-04T01:42:24.542766+0000","last_active":"2023-11-04T01:42:24.546974+0000","last_peered":"2023-11-04T01:42:24.546974+0000","last_clean":"2023-11-04T01:42:24.546974+0000","last_became_active":"2023-11-04T01:42:24.542209+0000","last_became_peered":"2023-11-04T01:42:24.542209+0000","last_unstale":"2023-11-04T01:42:24.546974+0000","last_undegraded":"2023-11-04T01:42:24.546974+0000","last_fullsized":"2023-11-04T01:42:24.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:48.042046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507069+0000","last_change":"2023-11-04T01:42:24.533283+0000","last_active":"2023-11-04T01:42:25.507069+0000","last_peered":"2023-11-04T01:42:25.507069+0000","last_clean":"2023-11-04T01:42:25.507069+0000","last_became_active":"2023-11-04T01:42:24.530651+0000","last_became_peered":"2023-11-04T01:42:24.530651+0000","last_unstale":"2023-11-04T01:42:25.507069+0000","last_undegraded":"2023-11-04T01:42:25.507069+0000","last_fullsized":"2023-11-04T01:42:25.507069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:51.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504099+0000","last_change":"2023-11-04T01:42:24.528107+0000","last_active":"2023-11-04T01:42:25.504099+0000","last_peered":"2023-11-04T01:42:25.504099+0000","last_clean":"2023-11-04T01:42:25.504099+0000","last_became_active":"2023-11-04T01:42:24.527344+0000","last_became_peered":"2023-11-04T01:42:24.527344+0000","last_unstale":"2023-11-04T01:42:25.504099+0000","last_undegraded":"2023-11-04T01:42:25.504099+0000","last_fullsized":"2023-11-04T01:42:25.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:48.101766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546578+0000","last_change":"2023-11-04T01:42:24.544709+0000","last_active":"2023-11-04T01:42:24.546578+0000","last_peered":"2023-11-04T01:42:24.546578+0000","last_clean":"2023-11-04T01:42:24.546578+0000","last_became_active":"2023-11-04T01:42:24.543976+0000","last_became_peered":"2023-11-04T01:42:24.543976+0000","last_unstale":"2023-11-04T01:42:24.546578+0000","last_undegraded":"2023-11-04T01:42:24.546578+0000","last_fullsized":"2023-11-04T01:42:24.546578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505748+0000","last_change":"2023-11-04T01:42:24.532616+0000","last_active":"2023-11-04T01:42:25.505748+0000","last_peered":"2023-11-04T01:42:25.505748+0000","last_clean":"2023-11-04T01:42:25.505748+0000","last_became_active":"2023-11-04T01:42:24.529894+0000","last_became_peered":"2023-11-04T01:42:24.529894+0000","last_unstale":"2023-11-04T01:42:25.505748+0000","last_undegraded":"2023-11-04T01:42:25.505748+0000","last_fullsized":"2023-11-04T01:42:25.505748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544733+0000","last_change":"2023-11-04T01:42:24.540137+0000","last_active":"2023-11-04T01:42:24.544733+0000","last_peered":"2023-11-04T01:42:24.544733+0000","last_clean":"2023-11-04T01:42:24.544733+0000","last_became_active":"2023-11-04T01:42:24.539303+0000","last_became_peered":"2023-11-04T01:42:24.539303+0000","last_unstale":"2023-11-04T01:42:24.544733+0000","last_undegraded":"2023-11-04T01:42:24.544733+0000","last_fullsized":"2023-11-04T01:42:24.544733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553334+0000","last_change":"2023-11-04T01:42:24.537992+0000","last_active":"2023-11-04T01:42:24.553334+0000","last_peered":"2023-11-04T01:42:24.553334+0000","last_clean":"2023-11-04T01:42:24.553334+0000","last_became_active":"2023-11-04T01:42:24.537129+0000","last_became_peered":"2023-11-04T01:42:24.537129+0000","last_unstale":"2023-11-04T01:42:24.553334+0000","last_undegraded":"2023-11-04T01:42:24.553334+0000","last_fullsized":"2023-11-04T01:42:24.553334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573347+0000","last_change":"2023-11-04T01:42:24.530582+0000","last_active":"2023-11-04T01:42:25.573347+0000","last_peered":"2023-11-04T01:42:25.573347+0000","last_clean":"2023-11-04T01:42:25.573347+0000","last_became_active":"2023-11-04T01:42:24.529891+0000","last_became_peered":"2023-11-04T01:42:24.529891+0000","last_unstale":"2023-11-04T01:42:25.573347+0000","last_undegraded":"2023-11-04T01:42:25.573347+0000","last_fullsized":"2023-11-04T01:42:25.573347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573474+0000","last_change":"2023-11-04T01:42:24.554452+0000","last_active":"2023-11-04T01:42:25.573474+0000","last_peered":"2023-11-04T01:42:25.573474+0000","last_clean":"2023-11-04T01:42:25.573474+0000","last_became_active":"2023-11-04T01:42:24.553857+0000","last_became_peered":"2023-11-04T01:42:24.553857+0000","last_unstale":"2023-11-04T01:42:25.573474+0000","last_undegraded":"2023-11-04T01:42:25.573474+0000","last_fullsized":"2023-11-04T01:42:25.573474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:48.459289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543232+0000","last_change":"2023-11-04T01:42:24.532888+0000","last_active":"2023-11-04T01:42:24.543232+0000","last_peered":"2023-11-04T01:42:24.543232+0000","last_clean":"2023-11-04T01:42:24.543232+0000","last_became_active":"2023-11-04T01:42:24.532172+0000","last_became_peered":"2023-11-04T01:42:24.532172+0000","last_unstale":"2023-11-04T01:42:24.543232+0000","last_undegraded":"2023-11-04T01:42:24.543232+0000","last_fullsized":"2023-11-04T01:42:24.543232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505919+0000","last_change":"2023-11-04T01:42:24.532118+0000","last_active":"2023-11-04T01:42:25.505919+0000","last_peered":"2023-11-04T01:42:25.505919+0000","last_clean":"2023-11-04T01:42:25.505919+0000","last_became_active":"2023-11-04T01:42:24.530531+0000","last_became_peered":"2023-11-04T01:42:24.530531+0000","last_unstale":"2023-11-04T01:42:25.505919+0000","last_undegraded":"2023-11-04T01:42:25.505919+0000","last_fullsized":"2023-11-04T01:42:25.505919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546959+0000","last_change":"2023-11-04T01:42:24.541439+0000","last_active":"2023-11-04T01:42:24.546959+0000","last_peered":"2023-11-04T01:42:24.546959+0000","last_clean":"2023-11-04T01:42:24.546959+0000","last_became_active":"2023-11-04T01:42:24.540727+0000","last_became_peered":"2023-11-04T01:42:24.540727+0000","last_unstale":"2023-11-04T01:42:24.546959+0000","last_undegraded":"2023-11-04T01:42:24.546959+0000","last_fullsized":"2023-11-04T01:42:24.546959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:01.489039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.545101+0000","last_change":"2023-11-04T01:42:24.521552+0000","last_active":"2023-11-04T01:42:24.545101+0000","last_peered":"2023-11-04T01:42:24.545101+0000","last_clean":"2023-11-04T01:42:24.545101+0000","last_became_active":"2023-11-04T01:42:24.520794+0000","last_became_peered":"2023-11-04T01:42:24.520794+0000","last_unstale":"2023-11-04T01:42:24.545101+0000","last_undegraded":"2023-11-04T01:42:24.545101+0000","last_fullsized":"2023-11-04T01:42:24.545101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:18.253719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.888606+0000","last_change":"2023-11-04T01:42:23.881752+0000","last_active":"2023-11-04T01:42:24.888606+0000","last_peered":"2023-11-04T01:42:24.888606+0000","last_clean":"2023-11-04T01:42:24.888606+0000","last_became_active":"2023-11-04T01:42:23.871460+0000","last_became_peered":"2023-11-04T01:42:23.871460+0000","last_unstale":"2023-11-04T01:42:24.888606+0000","last_undegraded":"2023-11-04T01:42:24.888606+0000","last_fullsized":"2023-11-04T01:42:24.888606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504494+0000","last_change":"2023-11-04T01:42:24.536354+0000","last_active":"2023-11-04T01:42:25.504494+0000","last_peered":"2023-11-04T01:42:25.504494+0000","last_clean":"2023-11-04T01:42:25.504494+0000","last_became_active":"2023-11-04T01:42:24.535597+0000","last_became_peered":"2023-11-04T01:42:24.535597+0000","last_unstale":"2023-11-04T01:42:25.504494+0000","last_undegraded":"2023-11-04T01:42:25.504494+0000","last_fullsized":"2023-11-04T01:42:25.504494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:09.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507312+0000","last_change":"2023-11-04T01:42:23.854629+0000","last_active":"2023-11-04T01:42:25.507312+0000","last_peered":"2023-11-04T01:42:25.507312+0000","last_clean":"2023-11-04T01:42:25.507312+0000","last_became_active":"2023-11-04T01:42:23.854209+0000","last_became_peered":"2023-11-04T01:42:23.854209+0000","last_unstale":"2023-11-04T01:42:25.507312+0000","last_undegraded":"2023-11-04T01:42:25.507312+0000","last_fullsized":"2023-11-04T01:42:25.507312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572788+0000","last_change":"2023-11-04T01:42:23.871583+0000","last_active":"2023-11-04T01:42:25.572788+0000","last_peered":"2023-11-04T01:42:25.572788+0000","last_clean":"2023-11-04T01:42:25.572788+0000","last_became_active":"2023-11-04T01:42:23.870753+0000","last_became_peered":"2023-11-04T01:42:23.870753+0000","last_unstale":"2023-11-04T01:42:25.572788+0000","last_undegraded":"2023-11-04T01:42:25.572788+0000","last_fullsized":"2023-11-04T01:42:25.572788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:45.998097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.542631+0000","last_change":"2023-11-04T01:42:24.527244+0000","last_active":"2023-11-04T01:42:24.542631+0000","last_peered":"2023-11-04T01:42:24.542631+0000","last_clean":"2023-11-04T01:42:24.542631+0000","last_became_active":"2023-11-04T01:42:24.526519+0000","last_became_peered":"2023-11-04T01:42:24.526519+0000","last_unstale":"2023-11-04T01:42:24.542631+0000","last_undegraded":"2023-11-04T01:42:24.542631+0000","last_fullsized":"2023-11-04T01:42:24.542631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505615+0000","last_change":"2023-11-04T01:42:23.861230+0000","last_active":"2023-11-04T01:42:25.505615+0000","last_peered":"2023-11-04T01:42:25.505615+0000","last_clean":"2023-11-04T01:42:25.505615+0000","last_became_active":"2023-11-04T01:42:23.859784+0000","last_became_peered":"2023-11-04T01:42:23.859784+0000","last_unstale":"2023-11-04T01:42:25.505615+0000","last_undegraded":"2023-11-04T01:42:25.505615+0000","last_fullsized":"2023-11-04T01:42:25.505615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:43.619572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504003+0000","last_change":"2023-11-04T01:42:24.524254+0000","last_active":"2023-11-04T01:42:25.504003+0000","last_peered":"2023-11-04T01:42:25.504003+0000","last_clean":"2023-11-04T01:42:25.504003+0000","last_became_active":"2023-11-04T01:42:24.523478+0000","last_became_peered":"2023-11-04T01:42:24.523478+0000","last_unstale":"2023-11-04T01:42:25.504003+0000","last_undegraded":"2023-11-04T01:42:25.504003+0000","last_fullsized":"2023-11-04T01:42:25.504003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:49.878595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553300+0000","last_change":"2023-11-04T01:42:24.530263+0000","last_active":"2023-11-04T01:42:24.553300+0000","last_peered":"2023-11-04T01:42:24.553300+0000","last_clean":"2023-11-04T01:42:24.553300+0000","last_became_active":"2023-11-04T01:42:24.529507+0000","last_became_peered":"2023-11-04T01:42:24.529507+0000","last_unstale":"2023-11-04T01:42:24.553300+0000","last_undegraded":"2023-11-04T01:42:24.553300+0000","last_fullsized":"2023-11-04T01:42:24.553300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543396+0000","last_change":"2023-11-04T01:42:24.534026+0000","last_active":"2023-11-04T01:42:24.543396+0000","last_peered":"2023-11-04T01:42:24.543396+0000","last_clean":"2023-11-04T01:42:24.543396+0000","last_became_active":"2023-11-04T01:42:24.533338+0000","last_became_peered":"2023-11-04T01:42:24.533338+0000","last_unstale":"2023-11-04T01:42:24.543396+0000","last_undegraded":"2023-11-04T01:42:24.543396+0000","last_fullsized":"2023-11-04T01:42:24.543396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:50.563897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.884338+0000","last_change":"2023-11-04T01:42:23.872021+0000","last_active":"2023-11-04T01:42:24.884338+0000","last_peered":"2023-11-04T01:42:24.884338+0000","last_clean":"2023-11-04T01:42:24.884338+0000","last_became_active":"2023-11-04T01:42:23.870751+0000","last_became_peered":"2023-11-04T01:42:23.870751+0000","last_unstale":"2023-11-04T01:42:24.884338+0000","last_undegraded":"2023-11-04T01:42:24.884338+0000","last_fullsized":"2023-11-04T01:42:24.884338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.620945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506411+0000","last_change":"2023-11-04T01:42:24.546924+0000","last_active":"2023-11-04T01:42:25.506411+0000","last_peered":"2023-11-04T01:42:25.506411+0000","last_clean":"2023-11-04T01:42:25.506411+0000","last_became_active":"2023-11-04T01:42:24.546318+0000","last_became_peered":"2023-11-04T01:42:24.546318+0000","last_unstale":"2023-11-04T01:42:25.506411+0000","last_undegraded":"2023-11-04T01:42:25.506411+0000","last_fullsized":"2023-11-04T01:42:25.506411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:48.887573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.893734+0000","last_change":"2023-11-04T01:42:23.872849+0000","last_active":"2023-11-04T01:42:24.893734+0000","last_peered":"2023-11-04T01:42:24.893734+0000","last_clean":"2023-11-04T01:42:24.893734+0000","last_became_active":"2023-11-04T01:42:23.872394+0000","last_became_peered":"2023-11-04T01:42:23.872394+0000","last_unstale":"2023-11-04T01:42:24.893734+0000","last_undegraded":"2023-11-04T01:42:24.893734+0000","last_fullsized":"2023-11-04T01:42:24.893734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887748+0000","last_change":"2023-11-04T01:42:23.878097+0000","last_active":"2023-11-04T01:42:24.887748+0000","last_peered":"2023-11-04T01:42:24.887748+0000","last_clean":"2023-11-04T01:42:24.887748+0000","last_became_active":"2023-11-04T01:42:23.877265+0000","last_became_peered":"2023-11-04T01:42:23.877265+0000","last_unstale":"2023-11-04T01:42:24.887748+0000","last_undegraded":"2023-11-04T01:42:24.887748+0000","last_fullsized":"2023-11-04T01:42:24.887748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:22.344804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573080+0000","last_change":"2023-11-04T01:42:24.546728+0000","last_active":"2023-11-04T01:42:25.573080+0000","last_peered":"2023-11-04T01:42:25.573080+0000","last_clean":"2023-11-04T01:42:25.573080+0000","last_became_active":"2023-11-04T01:42:24.545946+0000","last_became_peered":"2023-11-04T01:42:24.545946+0000","last_unstale":"2023-11-04T01:42:25.573080+0000","last_undegraded":"2023-11-04T01:42:25.573080+0000","last_fullsized":"2023-11-04T01:42:25.573080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506789+0000","last_change":"2023-11-04T01:42:23.875211+0000","last_active":"2023-11-04T01:42:25.506789+0000","last_peered":"2023-11-04T01:42:25.506789+0000","last_clean":"2023-11-04T01:42:25.506789+0000","last_became_active":"2023-11-04T01:42:23.874649+0000","last_became_peered":"2023-11-04T01:42:23.874649+0000","last_unstale":"2023-11-04T01:42:25.506789+0000","last_undegraded":"2023-11-04T01:42:25.506789+0000","last_fullsized":"2023-11-04T01:42:25.506789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506005+0000","last_change":"2023-11-04T01:42:24.557710+0000","last_active":"2023-11-04T01:42:25.506005+0000","last_peered":"2023-11-04T01:42:25.506005+0000","last_clean":"2023-11-04T01:42:25.506005+0000","last_became_active":"2023-11-04T01:42:24.557097+0000","last_became_peered":"2023-11-04T01:42:24.557097+0000","last_unstale":"2023-11-04T01:42:25.506005+0000","last_undegraded":"2023-11-04T01:42:25.506005+0000","last_fullsized":"2023-11-04T01:42:25.506005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:07.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503660+0000","last_change":"2023-11-04T01:42:23.878725+0000","last_active":"2023-11-04T01:42:25.503660+0000","last_peered":"2023-11-04T01:42:25.503660+0000","last_clean":"2023-11-04T01:42:25.503660+0000","last_became_active":"2023-11-04T01:42:23.877930+0000","last_became_peered":"2023-11-04T01:42:23.877930+0000","last_unstale":"2023-11-04T01:42:25.503660+0000","last_undegraded":"2023-11-04T01:42:25.503660+0000","last_fullsized":"2023-11-04T01:42:25.503660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:52.439183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505874+0000","last_change":"2023-11-04T01:42:24.545238+0000","last_active":"2023-11-04T01:42:25.505874+0000","last_peered":"2023-11-04T01:42:25.505874+0000","last_clean":"2023-11-04T01:42:25.505874+0000","last_became_active":"2023-11-04T01:42:24.544606+0000","last_became_peered":"2023-11-04T01:42:24.544606+0000","last_unstale":"2023-11-04T01:42:25.505874+0000","last_undegraded":"2023-11-04T01:42:25.505874+0000","last_fullsized":"2023-11-04T01:42:25.505874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.561776+0000","last_change":"2023-11-04T01:42:24.560710+0000","last_active":"2023-11-04T01:42:24.561776+0000","last_peered":"2023-11-04T01:42:24.561776+0000","last_clean":"2023-11-04T01:42:24.561776+0000","last_became_active":"2023-11-04T01:42:24.560051+0000","last_became_peered":"2023-11-04T01:42:24.560051+0000","last_unstale":"2023-11-04T01:42:24.561776+0000","last_undegraded":"2023-11-04T01:42:24.561776+0000","last_fullsized":"2023-11-04T01:42:24.561776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:14.623927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504630+0000","last_change":"2023-11-04T01:42:23.892535+0000","last_active":"2023-11-04T01:42:25.504630+0000","last_peered":"2023-11-04T01:42:25.504630+0000","last_clean":"2023-11-04T01:42:25.504630+0000","last_became_active":"2023-11-04T01:42:23.891942+0000","last_became_peered":"2023-11-04T01:42:23.891942+0000","last_unstale":"2023-11-04T01:42:25.504630+0000","last_undegraded":"2023-11-04T01:42:25.504630+0000","last_fullsized":"2023-11-04T01:42:25.504630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:28.817061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.886886+0000","last_change":"2023-11-04T01:42:23.879946+0000","last_active":"2023-11-04T01:42:24.886886+0000","last_peered":"2023-11-04T01:42:24.886886+0000","last_clean":"2023-11-04T01:42:24.886886+0000","last_became_active":"2023-11-04T01:42:23.879106+0000","last_became_peered":"2023-11-04T01:42:23.879106+0000","last_unstale":"2023-11-04T01:42:24.886886+0000","last_undegraded":"2023-11-04T01:42:24.886886+0000","last_fullsized":"2023-11-04T01:42:24.886886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:56.805776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573731+0000","last_change":"2023-11-04T01:42:23.859651+0000","last_active":"2023-11-04T01:42:25.573731+0000","last_peered":"2023-11-04T01:42:25.573731+0000","last_clean":"2023-11-04T01:42:25.573731+0000","last_became_active":"2023-11-04T01:42:23.858848+0000","last_became_peered":"2023-11-04T01:42:23.858848+0000","last_unstale":"2023-11-04T01:42:25.573731+0000","last_undegraded":"2023-11-04T01:42:25.573731+0000","last_fullsized":"2023-11-04T01:42:25.573731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506723+0000","last_change":"2023-11-04T01:42:24.542701+0000","last_active":"2023-11-04T01:42:25.506723+0000","last_peered":"2023-11-04T01:42:25.506723+0000","last_clean":"2023-11-04T01:42:25.506723+0000","last_became_active":"2023-11-04T01:42:24.541785+0000","last_became_peered":"2023-11-04T01:42:24.541785+0000","last_unstale":"2023-11-04T01:42:25.506723+0000","last_undegraded":"2023-11-04T01:42:25.506723+0000","last_fullsized":"2023-11-04T01:42:25.506723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:54.044840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-04T01:42:14.368894+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:42:14.368894+0000","last_peered":"2023-11-04T01:42:14.368894+0000","last_clean":"2023-11-04T01:42:14.368894+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:42:14.368894+0000","last_undegraded":"2023-11-04T01:42:14.368894+0000","last_fullsized":"2023-11-04T01:42:14.368894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506303+0000","last_change":"2023-11-04T01:42:23.870050+0000","last_active":"2023-11-04T01:42:25.506303+0000","last_peered":"2023-11-04T01:42:25.506303+0000","last_clean":"2023-11-04T01:42:25.506303+0000","last_became_active":"2023-11-04T01:42:23.868558+0000","last_became_peered":"2023-11-04T01:42:23.868558+0000","last_unstale":"2023-11-04T01:42:25.506303+0000","last_undegraded":"2023-11-04T01:42:25.506303+0000","last_fullsized":"2023-11-04T01:42:25.506303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504592+0000","last_change":"2023-11-04T01:42:24.515619+0000","last_active":"2023-11-04T01:42:25.504592+0000","last_peered":"2023-11-04T01:42:25.504592+0000","last_clean":"2023-11-04T01:42:25.504592+0000","last_became_active":"2023-11-04T01:42:24.514861+0000","last_became_peered":"2023-11-04T01:42:24.514861+0000","last_unstale":"2023-11-04T01:42:25.504592+0000","last_undegraded":"2023-11-04T01:42:25.504592+0000","last_fullsized":"2023-11-04T01:42:25.504592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:12.327963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505707+0000","last_change":"2023-11-04T01:42:23.889363+0000","last_active":"2023-11-04T01:42:25.505707+0000","last_peered":"2023-11-04T01:42:25.505707+0000","last_clean":"2023-11-04T01:42:25.505707+0000","last_became_active":"2023-11-04T01:42:23.888990+0000","last_became_peered":"2023-11-04T01:42:23.888990+0000","last_unstale":"2023-11-04T01:42:25.505707+0000","last_undegraded":"2023-11-04T01:42:25.505707+0000","last_fullsized":"2023-11-04T01:42:25.505707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572945+0000","last_change":"2023-11-04T01:42:24.544491+0000","last_active":"2023-11-04T01:42:25.572945+0000","last_peered":"2023-11-04T01:42:25.572945+0000","last_clean":"2023-11-04T01:42:25.572945+0000","last_became_active":"2023-11-04T01:42:24.543670+0000","last_became_peered":"2023-11-04T01:42:24.543670+0000","last_unstale":"2023-11-04T01:42:25.572945+0000","last_undegraded":"2023-11-04T01:42:25.572945+0000","last_fullsized":"2023-11-04T01:42:25.572945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.510207+0000","last_change":"2023-11-04T01:42:23.887645+0000","last_active":"2023-11-04T01:42:24.510207+0000","last_peered":"2023-11-04T01:42:24.510207+0000","last_clean":"2023-11-04T01:42:24.510207+0000","last_became_active":"2023-11-04T01:42:23.887066+0000","last_became_peered":"2023-11-04T01:42:23.887066+0000","last_unstale":"2023-11-04T01:42:24.510207+0000","last_undegraded":"2023-11-04T01:42:24.510207+0000","last_fullsized":"2023-11-04T01:42:24.510207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:14.860163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543580+0000","last_change":"2023-11-04T01:42:24.530872+0000","last_active":"2023-11-04T01:42:24.543580+0000","last_peered":"2023-11-04T01:42:24.543580+0000","last_clean":"2023-11-04T01:42:24.543580+0000","last_became_active":"2023-11-04T01:42:24.529785+0000","last_became_peered":"2023-11-04T01:42:24.529785+0000","last_unstale":"2023-11-04T01:42:24.543580+0000","last_undegraded":"2023-11-04T01:42:24.543580+0000","last_fullsized":"2023-11-04T01:42:24.543580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:05.406379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507010+0000","last_change":"2023-11-04T01:42:23.864470+0000","last_active":"2023-11-04T01:42:25.507010+0000","last_peered":"2023-11-04T01:42:25.507010+0000","last_clean":"2023-11-04T01:42:25.507010+0000","last_became_active":"2023-11-04T01:42:23.864049+0000","last_became_peered":"2023-11-04T01:42:23.864049+0000","last_unstale":"2023-11-04T01:42:25.507010+0000","last_undegraded":"2023-11-04T01:42:25.507010+0000","last_fullsized":"2023-11-04T01:42:25.507010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.509613+0000","last_change":"2023-11-04T01:42:23.881220+0000","last_active":"2023-11-04T01:42:24.509613+0000","last_peered":"2023-11-04T01:42:24.509613+0000","last_clean":"2023-11-04T01:42:24.509613+0000","last_became_active":"2023-11-04T01:42:23.880569+0000","last_became_peered":"2023-11-04T01:42:23.880569+0000","last_unstale":"2023-11-04T01:42:24.509613+0000","last_undegraded":"2023-11-04T01:42:24.509613+0000","last_fullsized":"2023-11-04T01:42:24.509613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553251+0000","last_change":"2023-11-04T01:42:24.544821+0000","last_active":"2023-11-04T01:42:24.553251+0000","last_peered":"2023-11-04T01:42:24.553251+0000","last_clean":"2023-11-04T01:42:24.553251+0000","last_became_active":"2023-11-04T01:42:24.544158+0000","last_became_peered":"2023-11-04T01:42:24.544158+0000","last_unstale":"2023-11-04T01:42:24.553251+0000","last_undegraded":"2023-11-04T01:42:24.553251+0000","last_fullsized":"2023-11-04T01:42:24.553251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507284+0000","last_change":"2023-11-04T01:42:23.867710+0000","last_active":"2023-11-04T01:42:25.507284+0000","last_peered":"2023-11-04T01:42:25.507284+0000","last_clean":"2023-11-04T01:42:25.507284+0000","last_became_active":"2023-11-04T01:42:23.867162+0000","last_became_peered":"2023-11-04T01:42:23.867162+0000","last_unstale":"2023-11-04T01:42:25.507284+0000","last_undegraded":"2023-11-04T01:42:25.507284+0000","last_fullsized":"2023-11-04T01:42:25.507284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:48.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573619+0000","last_change":"2023-11-04T01:42:24.529944+0000","last_active":"2023-11-04T01:42:25.573619+0000","last_peered":"2023-11-04T01:42:25.573619+0000","last_clean":"2023-11-04T01:42:25.573619+0000","last_became_active":"2023-11-04T01:42:24.528837+0000","last_became_peered":"2023-11-04T01:42:24.528837+0000","last_unstale":"2023-11-04T01:42:25.573619+0000","last_undegraded":"2023-11-04T01:42:25.573619+0000","last_fullsized":"2023-11-04T01:42:25.573619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.261927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504841+0000","last_change":"2023-11-04T01:42:23.871604+0000","last_active":"2023-11-04T01:42:25.504841+0000","last_peered":"2023-11-04T01:42:25.504841+0000","last_clean":"2023-11-04T01:42:25.504841+0000","last_became_active":"2023-11-04T01:42:23.870746+0000","last_became_peered":"2023-11-04T01:42:23.870746+0000","last_unstale":"2023-11-04T01:42:25.504841+0000","last_undegraded":"2023-11-04T01:42:25.504841+0000","last_fullsized":"2023-11-04T01:42:25.504841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:22.043685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504543+0000","last_change":"2023-11-04T01:42:24.520352+0000","last_active":"2023-11-04T01:42:25.504543+0000","last_peered":"2023-11-04T01:42:25.504543+0000","last_clean":"2023-11-04T01:42:25.504543+0000","last_became_active":"2023-11-04T01:42:24.519515+0000","last_became_peered":"2023-11-04T01:42:24.519515+0000","last_unstale":"2023-11-04T01:42:25.504543+0000","last_undegraded":"2023-11-04T01:42:25.504543+0000","last_fullsized":"2023-11-04T01:42:25.504543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:31.963568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506869+0000","last_change":"2023-11-04T01:42:23.856440+0000","last_active":"2023-11-04T01:42:25.506869+0000","last_peered":"2023-11-04T01:42:25.506869+0000","last_clean":"2023-11-04T01:42:25.506869+0000","last_became_active":"2023-11-04T01:42:23.856067+0000","last_became_peered":"2023-11-04T01:42:23.856067+0000","last_unstale":"2023-11-04T01:42:25.506869+0000","last_undegraded":"2023-11-04T01:42:25.506869+0000","last_fullsized":"2023-11-04T01:42:25.506869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:21.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504391+0000","last_change":"2023-11-04T01:42:24.530290+0000","last_active":"2023-11-04T01:42:25.504391+0000","last_peered":"2023-11-04T01:42:25.504391+0000","last_clean":"2023-11-04T01:42:25.504391+0000","last_became_active":"2023-11-04T01:42:24.529568+0000","last_became_peered":"2023-11-04T01:42:24.529568+0000","last_unstale":"2023-11-04T01:42:25.504391+0000","last_undegraded":"2023-11-04T01:42:25.504391+0000","last_fullsized":"2023-11-04T01:42:25.504391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:42.384938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506042+0000","last_change":"2023-11-04T01:42:24.532587+0000","last_active":"2023-11-04T01:42:25.506042+0000","last_peered":"2023-11-04T01:42:25.506042+0000","last_clean":"2023-11-04T01:42:25.506042+0000","last_became_active":"2023-11-04T01:42:24.531827+0000","last_became_peered":"2023-11-04T01:42:24.531827+0000","last_unstale":"2023-11-04T01:42:25.506042+0000","last_undegraded":"2023-11-04T01:42:25.506042+0000","last_fullsized":"2023-11-04T01:42:25.506042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:09.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504135+0000","last_change":"2023-11-04T01:42:23.871960+0000","last_active":"2023-11-04T01:42:25.504135+0000","last_peered":"2023-11-04T01:42:25.504135+0000","last_clean":"2023-11-04T01:42:25.504135+0000","last_became_active":"2023-11-04T01:42:23.871205+0000","last_became_peered":"2023-11-04T01:42:23.871205+0000","last_unstale":"2023-11-04T01:42:25.504135+0000","last_undegraded":"2023-11-04T01:42:25.504135+0000","last_fullsized":"2023-11-04T01:42:25.504135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:33:54.986696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503773+0000","last_change":"2023-11-04T01:42:24.531520+0000","last_active":"2023-11-04T01:42:25.503773+0000","last_peered":"2023-11-04T01:42:25.503773+0000","last_clean":"2023-11-04T01:42:25.503773+0000","last_became_active":"2023-11-04T01:42:24.530762+0000","last_became_peered":"2023-11-04T01:42:24.530762+0000","last_unstale":"2023-11-04T01:42:25.503773+0000","last_undegraded":"2023-11-04T01:42:25.503773+0000","last_fullsized":"2023-11-04T01:42:25.503773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.137518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573320+0000","last_change":"2023-11-04T01:42:23.887853+0000","last_active":"2023-11-04T01:42:25.573320+0000","last_peered":"2023-11-04T01:42:25.573320+0000","last_clean":"2023-11-04T01:42:25.573320+0000","last_became_active":"2023-11-04T01:42:23.886915+0000","last_became_peered":"2023-11-04T01:42:23.886915+0000","last_unstale":"2023-11-04T01:42:25.573320+0000","last_undegraded":"2023-11-04T01:42:25.573320+0000","last_fullsized":"2023-11-04T01:42:25.573320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:25.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.539674+0000","last_change":"2023-11-04T01:42:24.528548+0000","last_active":"2023-11-04T01:42:24.539674+0000","last_peered":"2023-11-04T01:42:24.539674+0000","last_clean":"2023-11-04T01:42:24.539674+0000","last_became_active":"2023-11-04T01:42:24.527750+0000","last_became_peered":"2023-11-04T01:42:24.527750+0000","last_unstale":"2023-11-04T01:42:24.539674+0000","last_undegraded":"2023-11-04T01:42:24.539674+0000","last_fullsized":"2023-11-04T01:42:24.539674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:13.583907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506105+0000","last_change":"2023-11-04T01:42:23.865890+0000","last_active":"2023-11-04T01:42:25.506105+0000","last_peered":"2023-11-04T01:42:25.506105+0000","last_clean":"2023-11-04T01:42:25.506105+0000","last_became_active":"2023-11-04T01:42:23.865503+0000","last_became_peered":"2023-11-04T01:42:23.865503+0000","last_unstale":"2023-11-04T01:42:25.506105+0000","last_undegraded":"2023-11-04T01:42:25.506105+0000","last_fullsized":"2023-11-04T01:42:25.506105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:05.380495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506285+0000","last_change":"2023-11-04T01:42:24.527953+0000","last_active":"2023-11-04T01:42:25.506285+0000","last_peered":"2023-11-04T01:42:25.506285+0000","last_clean":"2023-11-04T01:42:25.506285+0000","last_became_active":"2023-11-04T01:42:24.527112+0000","last_became_peered":"2023-11-04T01:42:24.527112+0000","last_unstale":"2023-11-04T01:42:25.506285+0000","last_undegraded":"2023-11-04T01:42:25.506285+0000","last_fullsized":"2023-11-04T01:42:25.506285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:04.559600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507122+0000","last_change":"2023-11-04T01:42:24.560200+0000","last_active":"2023-11-04T01:42:25.507122+0000","last_peered":"2023-11-04T01:42:25.507122+0000","last_clean":"2023-11-04T01:42:25.507122+0000","last_became_active":"2023-11-04T01:42:24.559286+0000","last_became_peered":"2023-11-04T01:42:24.559286+0000","last_unstale":"2023-11-04T01:42:25.507122+0000","last_undegraded":"2023-11-04T01:42:25.507122+0000","last_fullsized":"2023-11-04T01:42:25.507122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:48.678049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544681+0000","last_change":"2023-11-04T01:42:24.540046+0000","last_active":"2023-11-04T01:42:24.544681+0000","last_peered":"2023-11-04T01:42:24.544681+0000","last_clean":"2023-11-04T01:42:24.544681+0000","last_became_active":"2023-11-04T01:42:24.539286+0000","last_became_peered":"2023-11-04T01:42:24.539286+0000","last_unstale":"2023-11-04T01:42:24.544681+0000","last_undegraded":"2023-11-04T01:42:24.544681+0000","last_fullsized":"2023-11-04T01:42:24.544681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887064+0000","last_change":"2023-11-04T01:42:23.879421+0000","last_active":"2023-11-04T01:42:24.887064+0000","last_peered":"2023-11-04T01:42:24.887064+0000","last_clean":"2023-11-04T01:42:24.887064+0000","last_became_active":"2023-11-04T01:42:23.874688+0000","last_became_peered":"2023-11-04T01:42:23.874688+0000","last_unstale":"2023-11-04T01:42:24.887064+0000","last_undegraded":"2023-11-04T01:42:24.887064+0000","last_fullsized":"2023-11-04T01:42:24.887064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546550+0000","last_change":"2023-11-04T01:42:24.544559+0000","last_active":"2023-11-04T01:42:24.546550+0000","last_peered":"2023-11-04T01:42:24.546550+0000","last_clean":"2023-11-04T01:42:24.546550+0000","last_became_active":"2023-11-04T01:42:24.543895+0000","last_became_peered":"2023-11-04T01:42:24.543895+0000","last_unstale":"2023-11-04T01:42:24.546550+0000","last_undegraded":"2023-11-04T01:42:24.546550+0000","last_fullsized":"2023-11-04T01:42:24.546550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504779+0000","last_change":"2023-11-04T01:42:23.868589+0000","last_active":"2023-11-04T01:42:25.504779+0000","last_peered":"2023-11-04T01:42:25.504779+0000","last_clean":"2023-11-04T01:42:25.504779+0000","last_became_active":"2023-11-04T01:42:23.867572+0000","last_became_peered":"2023-11-04T01:42:23.867572+0000","last_unstale":"2023-11-04T01:42:25.504779+0000","last_undegraded":"2023-11-04T01:42:25.504779+0000","last_fullsized":"2023-11-04T01:42:25.504779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:13.960345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":753664,"data_stored":638256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1150000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5549999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":657215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":200704,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":68367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:28.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cfdd07640 1 Processor -- start 2023-11-04T01:42:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cfdd07640 1 -- start start 2023-11-04T01:42:28.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cfdd07640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0cf80d0690 0x7f0cf80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cfdd07640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cf80d0ae0 0x7f0cf80b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cfdd07640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf80b6070 con 0x7f0cf80b4990 2023-11-04T01:42:28.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cfdd07640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80b8ed0 con 0x7f0cf80d0690 2023-11-04T01:42:28.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cfdd07640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80d1ce0 con 0x7f0cf80d0ae0 2023-11-04T01:42:28.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0cf80b4990 0x7f0cf80b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42696/0 (socket says 172.21.15.2:42696) 2023-11-04T01:42:28.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf77fe640 1 -- 172.21.15.2:0/970427952 learned_addr learned my addr 172.21.15.2:0/970427952 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:28.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf7fff640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cf80d0ae0 0x7f0cf80b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/970427952 >> v2:172.21.15.90:3300/0 conn(0x7f0cf80d0690 0x7f0cf80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516451747 0 0) 0x7f0cf80b6070 con 0x7f0cf80b4990 2023-11-04T01:42:28.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce0003530 con 0x7f0cf80b4990 2023-11-04T01:42:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4021269660 0 0) 0x7f0ce0003530 con 0x7f0cf80b4990 2023-11-04T01:42:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cf80d0ae0 msgr2=0x7f0cf80b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cf80d0ae0 0x7f0cf80b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 >> v2:172.21.15.90:3300/0 conn(0x7f0cf80d0690 msgr2=0x7f0cf80b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 --2- 172.21.15.2:0/970427952 >> v2:172.21.15.90:3300/0 conn(0x7f0cf80d0690 0x7f0cf80b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80d1fc0 con 0x7f0cf80b4990 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f0ce8001680 con 0x7f0cf80b4990 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 >> v1:172.21.15.2:6789/0 conn(0x7f0cf80b4990 legacy=0x7f0cf80b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cf80d0ae0 0x7f0ce0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce0003f00 0x7f0ce00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce0004d10 0x7f0ce0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80b8ed0 con 0x7f0ce0003f00 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80d1ce0 con 0x7f0ce0004d10 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce000b9c0 con 0x7f0cf80d0ae0 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce0003f00 0x7f0ce00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf6ffd640 1 -- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cf80d0ae0 msgr2=0x7f0ce0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0cf80d0ae0 0x7f0ce0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf6ffd640 1 -- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce0004d10 msgr2=0x7f0ce0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ce0004d10 0x7f0ce0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.419+0000 7f0cf6ffd640 1 -- 172.21.15.2:0/970427952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce0003530 con 0x7f0ce0003f00 2023-11-04T01:42:28.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce0003f00 0x7f0ce00047d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009ab0 tx=0x7f0cec01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8476d8511b0e4dd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0a5660 con 0x7f0ce0003f00 2023-11-04T01:42:28.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0a57c0 con 0x7f0ce0003f00 2023-11-04T01:42:28.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cf67fc640 1 -- 172.21.15.2:0/970427952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0a5b70 con 0x7f0ce0003f00 2023-11-04T01:42:28.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 -- 172.21.15.2:0/970427952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce0003f00 msgr2=0x7f0ce00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 --2- 172.21.15.2:0/970427952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ce0003f00 0x7f0ce00047d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009ab0 tx=0x7f0cec01ca70 comp rx=0 tx=0).stop 2023-11-04T01:42:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cf7fff640 1 -- 172.21.15.2:0/970427952 reap_dead start 2023-11-04T01:42:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 -- 172.21.15.2:0/970427952 shutdown_connections 2023-11-04T01:42:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 -- 172.21.15.2:0/970427952 >> 172.21.15.2:0/970427952 conn(0x7f0cf80cf990 msgr2=0x7f0cf80cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 -- 172.21.15.2:0/970427952 shutdown_connections 2023-11-04T01:42:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 -- 172.21.15.2:0/970427952 wait complete. 2023-11-04T01:42:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 Processor -- start 2023-11-04T01:42:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.423+0000 7f0cfdd07640 1 -- start start 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce0003f00 0x7f0cf80ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cf81f5a80 0x7f0cf80cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cf8151ab0 0x7f0cf8151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80cd1b0 con 0x7f0cf81f5a80 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80cb8a0 con 0x7f0cf8151ab0 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80ca800 con 0x7f0ce0003f00 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cf81f5a80 0x7f0cf80cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cf81f5a80 0x7f0cf80cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46398/0 (socket says 172.21.15.2:46398) 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 -- 172.21.15.2:0/3778608574 learned_addr learned my addr 172.21.15.2:0/3778608574 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf77fe640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce0003f00 0x7f0cf80ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf7fff640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cf8151ab0 0x7f0cf8151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 -- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce0003f00 msgr2=0x7f0cf80ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce0003f00 0x7f0cf80ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 -- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cf8151ab0 msgr2=0x7f0cf8151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cf8151ab0 0x7f0cf8151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 -- 172.21.15.2:0/3778608574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80caae0 con 0x7f0cf81f5a80 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf7fff640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cf8151ab0 0x7f0cf8151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf6ffd640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cf81f5a80 0x7f0cf80cc630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009a00 tx=0x7f0ce0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cdffff640 1 -- 172.21.15.2:0/3778608574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec004220 con 0x7f0cf81f5a80 2023-11-04T01:42:28.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cdffff640 1 -- 172.21.15.2:0/3778608574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec0043c0 con 0x7f0cf81f5a80 2023-11-04T01:42:28.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf80cadc0 con 0x7f0cf81f5a80 2023-11-04T01:42:28.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cdffff640 1 -- 172.21.15.2:0/3778608574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0ad890 con 0x7f0cf81f5a80 2023-11-04T01:42:28.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf80cb380 con 0x7f0cf81f5a80 2023-11-04T01:42:28.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf80744a0 con 0x7f0cf81f5a80 2023-11-04T01:42:28.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cdffff640 1 -- 172.21.15.2:0/3778608574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cec0b4040 con 0x7f0cf81f5a80 2023-11-04T01:42:28.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cdffff640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ce40664d0 0x7f0ce4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cdffff640 1 -- 172.21.15.2:0/3778608574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cec11e400 con 0x7f0cf81f5a80 2023-11-04T01:42:28.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.427+0000 7f0cf77fe640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ce40664d0 0x7f0ce4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.431+0000 7f0cf77fe640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ce40664d0 0x7f0ce4068990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8001810 tx=0x7f0ce8001760 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.431+0000 7f0cdffff640 1 -- 172.21.15.2:0/3778608574 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0cec0eb930 con 0x7f0cf81f5a80 2023-11-04T01:42:28.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.587+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0cf80cd1b0 con 0x7f0ce40664d0 2023-11-04T01:42:28.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.607+0000 7f0cdffff640 1 -- 172.21.15.2:0/3778608574 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260938 (secure 0 0 0) 0x7f0cf80cd1b0 con 0x7f0ce40664d0 2023-11-04T01:42:28.613 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:28.615 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ce40664d0 msgr2=0x7f0ce4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ce40664d0 0x7f0ce4068990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8001810 tx=0x7f0ce8001760 comp rx=0 tx=0).stop 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cf81f5a80 msgr2=0x7f0cf80cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cf81f5a80 0x7f0cf80cc630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009a00 tx=0x7f0ce0005800 comp rx=0 tx=0).stop 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 shutdown_connections 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ce40664d0 0x7f0ce4068990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0cf8151ab0 0x7f0cf8151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0cf81f5a80 0x7f0cf80cc630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 --2- 172.21.15.2:0/3778608574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ce0003f00 0x7f0cf80ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 >> 172.21.15.2:0/3778608574 conn(0x7f0cf80cf990 msgr2=0x7f0cf80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 shutdown_connections 2023-11-04T01:42:28.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.611+0000 7f0cfdd07640 1 -- 172.21.15.2:0/3778608574 wait complete. 2023-11-04T01:42:28.632 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-04T01:42:26.759538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235660,"kb_used_data":2656,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739060,"statfs":{"total":773094113280,"available":772852797440,"internally_reserved":0,"allocated":2719744,"data_stored":1679452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001175"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538647+0000","last_change":"2023-11-04T01:42:24.526074+0000","last_active":"2023-11-04T01:42:24.538647+0000","last_peered":"2023-11-04T01:42:24.538647+0000","last_clean":"2023-11-04T01:42:24.538647+0000","last_became_active":"2023-11-04T01:42:24.525339+0000","last_became_peered":"2023-11-04T01:42:24.525339+0000","last_unstale":"2023-11-04T01:42:24.538647+0000","last_undegraded":"2023-11-04T01:42:24.538647+0000","last_fullsized":"2023-11-04T01:42:24.538647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543220+0000","last_change":"2023-11-04T01:42:24.532853+0000","last_active":"2023-11-04T01:42:24.543220+0000","last_peered":"2023-11-04T01:42:24.543220+0000","last_clean":"2023-11-04T01:42:24.543220+0000","last_became_active":"2023-11-04T01:42:24.531811+0000","last_became_peered":"2023-11-04T01:42:24.531811+0000","last_unstale":"2023-11-04T01:42:24.543220+0000","last_undegraded":"2023-11-04T01:42:24.543220+0000","last_fullsized":"2023-11-04T01:42:24.543220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553108+0000","last_change":"2023-11-04T01:42:24.532090+0000","last_active":"2023-11-04T01:42:24.553108+0000","last_peered":"2023-11-04T01:42:24.553108+0000","last_clean":"2023-11-04T01:42:24.553108+0000","last_became_active":"2023-11-04T01:42:24.531252+0000","last_became_peered":"2023-11-04T01:42:24.531252+0000","last_unstale":"2023-11-04T01:42:24.553108+0000","last_undegraded":"2023-11-04T01:42:24.553108+0000","last_fullsized":"2023-11-04T01:42:24.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553224+0000","last_change":"2023-11-04T01:42:24.532641+0000","last_active":"2023-11-04T01:42:24.553224+0000","last_peered":"2023-11-04T01:42:24.553224+0000","last_clean":"2023-11-04T01:42:24.553224+0000","last_became_active":"2023-11-04T01:42:24.531903+0000","last_became_peered":"2023-11-04T01:42:24.531903+0000","last_unstale":"2023-11-04T01:42:24.553224+0000","last_undegraded":"2023-11-04T01:42:24.553224+0000","last_fullsized":"2023-11-04T01:42:24.553224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543629+0000","last_change":"2023-11-04T01:42:24.532676+0000","last_active":"2023-11-04T01:42:24.543629+0000","last_peered":"2023-11-04T01:42:24.543629+0000","last_clean":"2023-11-04T01:42:24.543629+0000","last_became_active":"2023-11-04T01:42:24.531878+0000","last_became_peered":"2023-11-04T01:42:24.531878+0000","last_unstale":"2023-11-04T01:42:24.543629+0000","last_undegraded":"2023-11-04T01:42:24.543629+0000","last_fullsized":"2023-11-04T01:42:24.543629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573452+0000","last_change":"2023-11-04T01:42:24.555198+0000","last_active":"2023-11-04T01:42:25.573452+0000","last_peered":"2023-11-04T01:42:25.573452+0000","last_clean":"2023-11-04T01:42:25.573452+0000","last_became_active":"2023-11-04T01:42:24.554517+0000","last_became_peered":"2023-11-04T01:42:24.554517+0000","last_unstale":"2023-11-04T01:42:25.573452+0000","last_undegraded":"2023-11-04T01:42:25.573452+0000","last_fullsized":"2023-11-04T01:42:25.573452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572931+0000","last_change":"2023-11-04T01:42:24.537075+0000","last_active":"2023-11-04T01:42:25.572931+0000","last_peered":"2023-11-04T01:42:25.572931+0000","last_clean":"2023-11-04T01:42:25.572931+0000","last_became_active":"2023-11-04T01:42:24.536346+0000","last_became_peered":"2023-11-04T01:42:24.536346+0000","last_unstale":"2023-11-04T01:42:25.572931+0000","last_undegraded":"2023-11-04T01:42:25.572931+0000","last_fullsized":"2023-11-04T01:42:25.572931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538718+0000","last_change":"2023-11-04T01:42:24.526411+0000","last_active":"2023-11-04T01:42:24.538718+0000","last_peered":"2023-11-04T01:42:24.538718+0000","last_clean":"2023-11-04T01:42:24.538718+0000","last_became_active":"2023-11-04T01:42:24.525610+0000","last_became_peered":"2023-11-04T01:42:24.525610+0000","last_unstale":"2023-11-04T01:42:24.538718+0000","last_undegraded":"2023-11-04T01:42:24.538718+0000","last_fullsized":"2023-11-04T01:42:24.538718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505513+0000","last_change":"2023-11-04T01:42:24.551036+0000","last_active":"2023-11-04T01:42:25.505513+0000","last_peered":"2023-11-04T01:42:25.505513+0000","last_clean":"2023-11-04T01:42:25.505513+0000","last_became_active":"2023-11-04T01:42:24.550386+0000","last_became_peered":"2023-11-04T01:42:24.550386+0000","last_unstale":"2023-11-04T01:42:25.505513+0000","last_undegraded":"2023-11-04T01:42:25.505513+0000","last_fullsized":"2023-11-04T01:42:25.505513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506769+0000","last_change":"2023-11-04T01:42:24.559164+0000","last_active":"2023-11-04T01:42:25.506769+0000","last_peered":"2023-11-04T01:42:25.506769+0000","last_clean":"2023-11-04T01:42:25.506769+0000","last_became_active":"2023-11-04T01:42:24.558452+0000","last_became_peered":"2023-11-04T01:42:24.558452+0000","last_unstale":"2023-11-04T01:42:25.506769+0000","last_undegraded":"2023-11-04T01:42:25.506769+0000","last_fullsized":"2023-11-04T01:42:25.506769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:31.294438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546974+0000","last_change":"2023-11-04T01:42:24.542766+0000","last_active":"2023-11-04T01:42:24.546974+0000","last_peered":"2023-11-04T01:42:24.546974+0000","last_clean":"2023-11-04T01:42:24.546974+0000","last_became_active":"2023-11-04T01:42:24.542209+0000","last_became_peered":"2023-11-04T01:42:24.542209+0000","last_unstale":"2023-11-04T01:42:24.546974+0000","last_undegraded":"2023-11-04T01:42:24.546974+0000","last_fullsized":"2023-11-04T01:42:24.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:48.042046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507069+0000","last_change":"2023-11-04T01:42:24.533283+0000","last_active":"2023-11-04T01:42:25.507069+0000","last_peered":"2023-11-04T01:42:25.507069+0000","last_clean":"2023-11-04T01:42:25.507069+0000","last_became_active":"2023-11-04T01:42:24.530651+0000","last_became_peered":"2023-11-04T01:42:24.530651+0000","last_unstale":"2023-11-04T01:42:25.507069+0000","last_undegraded":"2023-11-04T01:42:25.507069+0000","last_fullsized":"2023-11-04T01:42:25.507069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:51.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504099+0000","last_change":"2023-11-04T01:42:24.528107+0000","last_active":"2023-11-04T01:42:25.504099+0000","last_peered":"2023-11-04T01:42:25.504099+0000","last_clean":"2023-11-04T01:42:25.504099+0000","last_became_active":"2023-11-04T01:42:24.527344+0000","last_became_peered":"2023-11-04T01:42:24.527344+0000","last_unstale":"2023-11-04T01:42:25.504099+0000","last_undegraded":"2023-11-04T01:42:25.504099+0000","last_fullsized":"2023-11-04T01:42:25.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:48.101766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546578+0000","last_change":"2023-11-04T01:42:24.544709+0000","last_active":"2023-11-04T01:42:24.546578+0000","last_peered":"2023-11-04T01:42:24.546578+0000","last_clean":"2023-11-04T01:42:24.546578+0000","last_became_active":"2023-11-04T01:42:24.543976+0000","last_became_peered":"2023-11-04T01:42:24.543976+0000","last_unstale":"2023-11-04T01:42:24.546578+0000","last_undegraded":"2023-11-04T01:42:24.546578+0000","last_fullsized":"2023-11-04T01:42:24.546578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505748+0000","last_change":"2023-11-04T01:42:24.532616+0000","last_active":"2023-11-04T01:42:25.505748+0000","last_peered":"2023-11-04T01:42:25.505748+0000","last_clean":"2023-11-04T01:42:25.505748+0000","last_became_active":"2023-11-04T01:42:24.529894+0000","last_became_peered":"2023-11-04T01:42:24.529894+0000","last_unstale":"2023-11-04T01:42:25.505748+0000","last_undegraded":"2023-11-04T01:42:25.505748+0000","last_fullsized":"2023-11-04T01:42:25.505748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544733+0000","last_change":"2023-11-04T01:42:24.540137+0000","last_active":"2023-11-04T01:42:24.544733+0000","last_peered":"2023-11-04T01:42:24.544733+0000","last_clean":"2023-11-04T01:42:24.544733+0000","last_became_active":"2023-11-04T01:42:24.539303+0000","last_became_peered":"2023-11-04T01:42:24.539303+0000","last_unstale":"2023-11-04T01:42:24.544733+0000","last_undegraded":"2023-11-04T01:42:24.544733+0000","last_fullsized":"2023-11-04T01:42:24.544733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553334+0000","last_change":"2023-11-04T01:42:24.537992+0000","last_active":"2023-11-04T01:42:24.553334+0000","last_peered":"2023-11-04T01:42:24.553334+0000","last_clean":"2023-11-04T01:42:24.553334+0000","last_became_active":"2023-11-04T01:42:24.537129+0000","last_became_peered":"2023-11-04T01:42:24.537129+0000","last_unstale":"2023-11-04T01:42:24.553334+0000","last_undegraded":"2023-11-04T01:42:24.553334+0000","last_fullsized":"2023-11-04T01:42:24.553334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573347+0000","last_change":"2023-11-04T01:42:24.530582+0000","last_active":"2023-11-04T01:42:25.573347+0000","last_peered":"2023-11-04T01:42:25.573347+0000","last_clean":"2023-11-04T01:42:25.573347+0000","last_became_active":"2023-11-04T01:42:24.529891+0000","last_became_peered":"2023-11-04T01:42:24.529891+0000","last_unstale":"2023-11-04T01:42:25.573347+0000","last_undegraded":"2023-11-04T01:42:25.573347+0000","last_fullsized":"2023-11-04T01:42:25.573347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573474+0000","last_change":"2023-11-04T01:42:24.554452+0000","last_active":"2023-11-04T01:42:25.573474+0000","last_peered":"2023-11-04T01:42:25.573474+0000","last_clean":"2023-11-04T01:42:25.573474+0000","last_became_active":"2023-11-04T01:42:24.553857+0000","last_became_peered":"2023-11-04T01:42:24.553857+0000","last_unstale":"2023-11-04T01:42:25.573474+0000","last_undegraded":"2023-11-04T01:42:25.573474+0000","last_fullsized":"2023-11-04T01:42:25.573474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:48.459289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543232+0000","last_change":"2023-11-04T01:42:24.532888+0000","last_active":"2023-11-04T01:42:24.543232+0000","last_peered":"2023-11-04T01:42:24.543232+0000","last_clean":"2023-11-04T01:42:24.543232+0000","last_became_active":"2023-11-04T01:42:24.532172+0000","last_became_peered":"2023-11-04T01:42:24.532172+0000","last_unstale":"2023-11-04T01:42:24.543232+0000","last_undegraded":"2023-11-04T01:42:24.543232+0000","last_fullsized":"2023-11-04T01:42:24.543232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505919+0000","last_change":"2023-11-04T01:42:24.532118+0000","last_active":"2023-11-04T01:42:25.505919+0000","last_peered":"2023-11-04T01:42:25.505919+0000","last_clean":"2023-11-04T01:42:25.505919+0000","last_became_active":"2023-11-04T01:42:24.530531+0000","last_became_peered":"2023-11-04T01:42:24.530531+0000","last_unstale":"2023-11-04T01:42:25.505919+0000","last_undegraded":"2023-11-04T01:42:25.505919+0000","last_fullsized":"2023-11-04T01:42:25.505919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546959+0000","last_change":"2023-11-04T01:42:24.541439+0000","last_active":"2023-11-04T01:42:24.546959+0000","last_peered":"2023-11-04T01:42:24.546959+0000","last_clean":"2023-11-04T01:42:24.546959+0000","last_became_active":"2023-11-04T01:42:24.540727+0000","last_became_peered":"2023-11-04T01:42:24.540727+0000","last_unstale":"2023-11-04T01:42:24.546959+0000","last_undegraded":"2023-11-04T01:42:24.546959+0000","last_fullsized":"2023-11-04T01:42:24.546959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:01.489039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.545101+0000","last_change":"2023-11-04T01:42:24.521552+0000","last_active":"2023-11-04T01:42:24.545101+0000","last_peered":"2023-11-04T01:42:24.545101+0000","last_clean":"2023-11-04T01:42:24.545101+0000","last_became_active":"2023-11-04T01:42:24.520794+0000","last_became_peered":"2023-11-04T01:42:24.520794+0000","last_unstale":"2023-11-04T01:42:24.545101+0000","last_undegraded":"2023-11-04T01:42:24.545101+0000","last_fullsized":"2023-11-04T01:42:24.545101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:18.253719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.888606+0000","last_change":"2023-11-04T01:42:23.881752+0000","last_active":"2023-11-04T01:42:24.888606+0000","last_peered":"2023-11-04T01:42:24.888606+0000","last_clean":"2023-11-04T01:42:24.888606+0000","last_became_active":"2023-11-04T01:42:23.871460+0000","last_became_peered":"2023-11-04T01:42:23.871460+0000","last_unstale":"2023-11-04T01:42:24.888606+0000","last_undegraded":"2023-11-04T01:42:24.888606+0000","last_fullsized":"2023-11-04T01:42:24.888606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504494+0000","last_change":"2023-11-04T01:42:24.536354+0000","last_active":"2023-11-04T01:42:25.504494+0000","last_peered":"2023-11-04T01:42:25.504494+0000","last_clean":"2023-11-04T01:42:25.504494+0000","last_became_active":"2023-11-04T01:42:24.535597+0000","last_became_peered":"2023-11-04T01:42:24.535597+0000","last_unstale":"2023-11-04T01:42:25.504494+0000","last_undegraded":"2023-11-04T01:42:25.504494+0000","last_fullsized":"2023-11-04T01:42:25.504494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:09.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507312+0000","last_change":"2023-11-04T01:42:23.854629+0000","last_active":"2023-11-04T01:42:25.507312+0000","last_peered":"2023-11-04T01:42:25.507312+0000","last_clean":"2023-11-04T01:42:25.507312+0000","last_became_active":"2023-11-04T01:42:23.854209+0000","last_became_peered":"2023-11-04T01:42:23.854209+0000","last_unstale":"2023-11-04T01:42:25.507312+0000","last_undegraded":"2023-11-04T01:42:25.507312+0000","last_fullsized":"2023-11-04T01:42:25.507312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572788+0000","last_change":"2023-11-04T01:42:23.871583+0000","last_active":"2023-11-04T01:42:25.572788+0000","last_peered":"2023-11-04T01:42:25.572788+0000","last_clean":"2023-11-04T01:42:25.572788+0000","last_became_active":"2023-11-04T01:42:23.870753+0000","last_became_peered":"2023-11-04T01:42:23.870753+0000","last_unstale":"2023-11-04T01:42:25.572788+0000","last_undegraded":"2023-11-04T01:42:25.572788+0000","last_fullsized":"2023-11-04T01:42:25.572788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:45.998097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.542631+0000","last_change":"2023-11-04T01:42:24.527244+0000","last_active":"2023-11-04T01:42:24.542631+0000","last_peered":"2023-11-04T01:42:24.542631+0000","last_clean":"2023-11-04T01:42:24.542631+0000","last_became_active":"2023-11-04T01:42:24.526519+0000","last_became_peered":"2023-11-04T01:42:24.526519+0000","last_unstale":"2023-11-04T01:42:24.542631+0000","last_undegraded":"2023-11-04T01:42:24.542631+0000","last_fullsized":"2023-11-04T01:42:24.542631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505615+0000","last_change":"2023-11-04T01:42:23.861230+0000","last_active":"2023-11-04T01:42:25.505615+0000","last_peered":"2023-11-04T01:42:25.505615+0000","last_clean":"2023-11-04T01:42:25.505615+0000","last_became_active":"2023-11-04T01:42:23.859784+0000","last_became_peered":"2023-11-04T01:42:23.859784+0000","last_unstale":"2023-11-04T01:42:25.505615+0000","last_undegraded":"2023-11-04T01:42:25.505615+0000","last_fullsized":"2023-11-04T01:42:25.505615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:43.619572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504003+0000","last_change":"2023-11-04T01:42:24.524254+0000","last_active":"2023-11-04T01:42:25.504003+0000","last_peered":"2023-11-04T01:42:25.504003+0000","last_clean":"2023-11-04T01:42:25.504003+0000","last_became_active":"2023-11-04T01:42:24.523478+0000","last_became_peered":"2023-11-04T01:42:24.523478+0000","last_unstale":"2023-11-04T01:42:25.504003+0000","last_undegraded":"2023-11-04T01:42:25.504003+0000","last_fullsized":"2023-11-04T01:42:25.504003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:49.878595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553300+0000","last_change":"2023-11-04T01:42:24.530263+0000","last_active":"2023-11-04T01:42:24.553300+0000","last_peered":"2023-11-04T01:42:24.553300+0000","last_clean":"2023-11-04T01:42:24.553300+0000","last_became_active":"2023-11-04T01:42:24.529507+0000","last_became_peered":"2023-11-04T01:42:24.529507+0000","last_unstale":"2023-11-04T01:42:24.553300+0000","last_undegraded":"2023-11-04T01:42:24.553300+0000","last_fullsized":"2023-11-04T01:42:24.553300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543396+0000","last_change":"2023-11-04T01:42:24.534026+0000","last_active":"2023-11-04T01:42:24.543396+0000","last_peered":"2023-11-04T01:42:24.543396+0000","last_clean":"2023-11-04T01:42:24.543396+0000","last_became_active":"2023-11-04T01:42:24.533338+0000","last_became_peered":"2023-11-04T01:42:24.533338+0000","last_unstale":"2023-11-04T01:42:24.543396+0000","last_undegraded":"2023-11-04T01:42:24.543396+0000","last_fullsized":"2023-11-04T01:42:24.543396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:50.563897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.884338+0000","last_change":"2023-11-04T01:42:23.872021+0000","last_active":"2023-11-04T01:42:24.884338+0000","last_peered":"2023-11-04T01:42:24.884338+0000","last_clean":"2023-11-04T01:42:24.884338+0000","last_became_active":"2023-11-04T01:42:23.870751+0000","last_became_peered":"2023-11-04T01:42:23.870751+0000","last_unstale":"2023-11-04T01:42:24.884338+0000","last_undegraded":"2023-11-04T01:42:24.884338+0000","last_fullsized":"2023-11-04T01:42:24.884338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.620945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506411+0000","last_change":"2023-11-04T01:42:24.546924+0000","last_active":"2023-11-04T01:42:25.506411+0000","last_peered":"2023-11-04T01:42:25.506411+0000","last_clean":"2023-11-04T01:42:25.506411+0000","last_became_active":"2023-11-04T01:42:24.546318+0000","last_became_peered":"2023-11-04T01:42:24.546318+0000","last_unstale":"2023-11-04T01:42:25.506411+0000","last_undegraded":"2023-11-04T01:42:25.506411+0000","last_fullsized":"2023-11-04T01:42:25.506411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:48.887573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.893734+0000","last_change":"2023-11-04T01:42:23.872849+0000","last_active":"2023-11-04T01:42:24.893734+0000","last_peered":"2023-11-04T01:42:24.893734+0000","last_clean":"2023-11-04T01:42:24.893734+0000","last_became_active":"2023-11-04T01:42:23.872394+0000","last_became_peered":"2023-11-04T01:42:23.872394+0000","last_unstale":"2023-11-04T01:42:24.893734+0000","last_undegraded":"2023-11-04T01:42:24.893734+0000","last_fullsized":"2023-11-04T01:42:24.893734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887748+0000","last_change":"2023-11-04T01:42:23.878097+0000","last_active":"2023-11-04T01:42:24.887748+0000","last_peered":"2023-11-04T01:42:24.887748+0000","last_clean":"2023-11-04T01:42:24.887748+0000","last_became_active":"2023-11-04T01:42:23.877265+0000","last_became_peered":"2023-11-04T01:42:23.877265+0000","last_unstale":"2023-11-04T01:42:24.887748+0000","last_undegraded":"2023-11-04T01:42:24.887748+0000","last_fullsized":"2023-11-04T01:42:24.887748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:22.344804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573080+0000","last_change":"2023-11-04T01:42:24.546728+0000","last_active":"2023-11-04T01:42:25.573080+0000","last_peered":"2023-11-04T01:42:25.573080+0000","last_clean":"2023-11-04T01:42:25.573080+0000","last_became_active":"2023-11-04T01:42:24.545946+0000","last_became_peered":"2023-11-04T01:42:24.545946+0000","last_unstale":"2023-11-04T01:42:25.573080+0000","last_undegraded":"2023-11-04T01:42:25.573080+0000","last_fullsized":"2023-11-04T01:42:25.573080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506789+0000","last_change":"2023-11-04T01:42:23.875211+0000","last_active":"2023-11-04T01:42:25.506789+0000","last_peered":"2023-11-04T01:42:25.506789+0000","last_clean":"2023-11-04T01:42:25.506789+0000","last_became_active":"2023-11-04T01:42:23.874649+0000","last_became_peered":"2023-11-04T01:42:23.874649+0000","last_unstale":"2023-11-04T01:42:25.506789+0000","last_undegraded":"2023-11-04T01:42:25.506789+0000","last_fullsized":"2023-11-04T01:42:25.506789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506005+0000","last_change":"2023-11-04T01:42:24.557710+0000","last_active":"2023-11-04T01:42:25.506005+0000","last_peered":"2023-11-04T01:42:25.506005+0000","last_clean":"2023-11-04T01:42:25.506005+0000","last_became_active":"2023-11-04T01:42:24.557097+0000","last_became_peered":"2023-11-04T01:42:24.557097+0000","last_unstale":"2023-11-04T01:42:25.506005+0000","last_undegraded":"2023-11-04T01:42:25.506005+0000","last_fullsized":"2023-11-04T01:42:25.506005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:07.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503660+0000","last_change":"2023-11-04T01:42:23.878725+0000","last_active":"2023-11-04T01:42:25.503660+0000","last_peered":"2023-11-04T01:42:25.503660+0000","last_clean":"2023-11-04T01:42:25.503660+0000","last_became_active":"2023-11-04T01:42:23.877930+0000","last_became_peered":"2023-11-04T01:42:23.877930+0000","last_unstale":"2023-11-04T01:42:25.503660+0000","last_undegraded":"2023-11-04T01:42:25.503660+0000","last_fullsized":"2023-11-04T01:42:25.503660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:52.439183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505874+0000","last_change":"2023-11-04T01:42:24.545238+0000","last_active":"2023-11-04T01:42:25.505874+0000","last_peered":"2023-11-04T01:42:25.505874+0000","last_clean":"2023-11-04T01:42:25.505874+0000","last_became_active":"2023-11-04T01:42:24.544606+0000","last_became_peered":"2023-11-04T01:42:24.544606+0000","last_unstale":"2023-11-04T01:42:25.505874+0000","last_undegraded":"2023-11-04T01:42:25.505874+0000","last_fullsized":"2023-11-04T01:42:25.505874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.561776+0000","last_change":"2023-11-04T01:42:24.560710+0000","last_active":"2023-11-04T01:42:24.561776+0000","last_peered":"2023-11-04T01:42:24.561776+0000","last_clean":"2023-11-04T01:42:24.561776+0000","last_became_active":"2023-11-04T01:42:24.560051+0000","last_became_peered":"2023-11-04T01:42:24.560051+0000","last_unstale":"2023-11-04T01:42:24.561776+0000","last_undegraded":"2023-11-04T01:42:24.561776+0000","last_fullsized":"2023-11-04T01:42:24.561776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:14.623927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504630+0000","last_change":"2023-11-04T01:42:23.892535+0000","last_active":"2023-11-04T01:42:25.504630+0000","last_peered":"2023-11-04T01:42:25.504630+0000","last_clean":"2023-11-04T01:42:25.504630+0000","last_became_active":"2023-11-04T01:42:23.891942+0000","last_became_peered":"2023-11-04T01:42:23.891942+0000","last_unstale":"2023-11-04T01:42:25.504630+0000","last_undegraded":"2023-11-04T01:42:25.504630+0000","last_fullsized":"2023-11-04T01:42:25.504630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:28.817061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.886886+0000","last_change":"2023-11-04T01:42:23.879946+0000","last_active":"2023-11-04T01:42:24.886886+0000","last_peered":"2023-11-04T01:42:24.886886+0000","last_clean":"2023-11-04T01:42:24.886886+0000","last_became_active":"2023-11-04T01:42:23.879106+0000","last_became_peered":"2023-11-04T01:42:23.879106+0000","last_unstale":"2023-11-04T01:42:24.886886+0000","last_undegraded":"2023-11-04T01:42:24.886886+0000","last_fullsized":"2023-11-04T01:42:24.886886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:56.805776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573731+0000","last_change":"2023-11-04T01:42:23.859651+0000","last_active":"2023-11-04T01:42:25.573731+0000","last_peered":"2023-11-04T01:42:25.573731+0000","last_clean":"2023-11-04T01:42:25.573731+0000","last_became_active":"2023-11-04T01:42:23.858848+0000","last_became_peered":"2023-11-04T01:42:23.858848+0000","last_unstale":"2023-11-04T01:42:25.573731+0000","last_undegraded":"2023-11-04T01:42:25.573731+0000","last_fullsized":"2023-11-04T01:42:25.573731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506723+0000","last_change":"2023-11-04T01:42:24.542701+0000","last_active":"2023-11-04T01:42:25.506723+0000","last_peered":"2023-11-04T01:42:25.506723+0000","last_clean":"2023-11-04T01:42:25.506723+0000","last_became_active":"2023-11-04T01:42:24.541785+0000","last_became_peered":"2023-11-04T01:42:24.541785+0000","last_unstale":"2023-11-04T01:42:25.506723+0000","last_undegraded":"2023-11-04T01:42:25.506723+0000","last_fullsized":"2023-11-04T01:42:25.506723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:54.044840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-11-04T01:42:14.368894+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:42:14.368894+0000","last_peered":"2023-11-04T01:42:14.368894+0000","last_clean":"2023-11-04T01:42:14.368894+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:42:14.368894+0000","last_undegraded":"2023-11-04T01:42:14.368894+0000","last_fullsized":"2023-11-04T01:42:14.368894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506303+0000","last_change":"2023-11-04T01:42:23.870050+0000","last_active":"2023-11-04T01:42:25.506303+0000","last_peered":"2023-11-04T01:42:25.506303+0000","last_clean":"2023-11-04T01:42:25.506303+0000","last_became_active":"2023-11-04T01:42:23.868558+0000","last_became_peered":"2023-11-04T01:42:23.868558+0000","last_unstale":"2023-11-04T01:42:25.506303+0000","last_undegraded":"2023-11-04T01:42:25.506303+0000","last_fullsized":"2023-11-04T01:42:25.506303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504592+0000","last_change":"2023-11-04T01:42:24.515619+0000","last_active":"2023-11-04T01:42:25.504592+0000","last_peered":"2023-11-04T01:42:25.504592+0000","last_clean":"2023-11-04T01:42:25.504592+0000","last_became_active":"2023-11-04T01:42:24.514861+0000","last_became_peered":"2023-11-04T01:42:24.514861+0000","last_unstale":"2023-11-04T01:42:25.504592+0000","last_undegraded":"2023-11-04T01:42:25.504592+0000","last_fullsized":"2023-11-04T01:42:25.504592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:12.327963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505707+0000","last_change":"2023-11-04T01:42:23.889363+0000","last_active":"2023-11-04T01:42:25.505707+0000","last_peered":"2023-11-04T01:42:25.505707+0000","last_clean":"2023-11-04T01:42:25.505707+0000","last_became_active":"2023-11-04T01:42:23.888990+0000","last_became_peered":"2023-11-04T01:42:23.888990+0000","last_unstale":"2023-11-04T01:42:25.505707+0000","last_undegraded":"2023-11-04T01:42:25.505707+0000","last_fullsized":"2023-11-04T01:42:25.505707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572945+0000","last_change":"2023-11-04T01:42:24.544491+0000","last_active":"2023-11-04T01:42:25.572945+0000","last_peered":"2023-11-04T01:42:25.572945+0000","last_clean":"2023-11-04T01:42:25.572945+0000","last_became_active":"2023-11-04T01:42:24.543670+0000","last_became_peered":"2023-11-04T01:42:24.543670+0000","last_unstale":"2023-11-04T01:42:25.572945+0000","last_undegraded":"2023-11-04T01:42:25.572945+0000","last_fullsized":"2023-11-04T01:42:25.572945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.510207+0000","last_change":"2023-11-04T01:42:23.887645+0000","last_active":"2023-11-04T01:42:24.510207+0000","last_peered":"2023-11-04T01:42:24.510207+0000","last_clean":"2023-11-04T01:42:24.510207+0000","last_became_active":"2023-11-04T01:42:23.887066+0000","last_became_peered":"2023-11-04T01:42:23.887066+0000","last_unstale":"2023-11-04T01:42:24.510207+0000","last_undegraded":"2023-11-04T01:42:24.510207+0000","last_fullsized":"2023-11-04T01:42:24.510207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:14.860163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543580+0000","last_change":"2023-11-04T01:42:24.530872+0000","last_active":"2023-11-04T01:42:24.543580+0000","last_peered":"2023-11-04T01:42:24.543580+0000","last_clean":"2023-11-04T01:42:24.543580+0000","last_became_active":"2023-11-04T01:42:24.529785+0000","last_became_peered":"2023-11-04T01:42:24.529785+0000","last_unstale":"2023-11-04T01:42:24.543580+0000","last_undegraded":"2023-11-04T01:42:24.543580+0000","last_fullsized":"2023-11-04T01:42:24.543580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:05.406379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507010+0000","last_change":"2023-11-04T01:42:23.864470+0000","last_active":"2023-11-04T01:42:25.507010+0000","last_peered":"2023-11-04T01:42:25.507010+0000","last_clean":"2023-11-04T01:42:25.507010+0000","last_became_active":"2023-11-04T01:42:23.864049+0000","last_became_peered":"2023-11-04T01:42:23.864049+0000","last_unstale":"2023-11-04T01:42:25.507010+0000","last_undegraded":"2023-11-04T01:42:25.507010+0000","last_fullsized":"2023-11-04T01:42:25.507010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.509613+0000","last_change":"2023-11-04T01:42:23.881220+0000","last_active":"2023-11-04T01:42:24.509613+0000","last_peered":"2023-11-04T01:42:24.509613+0000","last_clean":"2023-11-04T01:42:24.509613+0000","last_became_active":"2023-11-04T01:42:23.880569+0000","last_became_peered":"2023-11-04T01:42:23.880569+0000","last_unstale":"2023-11-04T01:42:24.509613+0000","last_undegraded":"2023-11-04T01:42:24.509613+0000","last_fullsized":"2023-11-04T01:42:24.509613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553251+0000","last_change":"2023-11-04T01:42:24.544821+0000","last_active":"2023-11-04T01:42:24.553251+0000","last_peered":"2023-11-04T01:42:24.553251+0000","last_clean":"2023-11-04T01:42:24.553251+0000","last_became_active":"2023-11-04T01:42:24.544158+0000","last_became_peered":"2023-11-04T01:42:24.544158+0000","last_unstale":"2023-11-04T01:42:24.553251+0000","last_undegraded":"2023-11-04T01:42:24.553251+0000","last_fullsized":"2023-11-04T01:42:24.553251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507284+0000","last_change":"2023-11-04T01:42:23.867710+0000","last_active":"2023-11-04T01:42:25.507284+0000","last_peered":"2023-11-04T01:42:25.507284+0000","last_clean":"2023-11-04T01:42:25.507284+0000","last_became_active":"2023-11-04T01:42:23.867162+0000","last_became_peered":"2023-11-04T01:42:23.867162+0000","last_unstale":"2023-11-04T01:42:25.507284+0000","last_undegraded":"2023-11-04T01:42:25.507284+0000","last_fullsized":"2023-11-04T01:42:25.507284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:48.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573619+0000","last_change":"2023-11-04T01:42:24.529944+0000","last_active":"2023-11-04T01:42:25.573619+0000","last_peered":"2023-11-04T01:42:25.573619+0000","last_clean":"2023-11-04T01:42:25.573619+0000","last_became_active":"2023-11-04T01:42:24.528837+0000","last_became_peered":"2023-11-04T01:42:24.528837+0000","last_unstale":"2023-11-04T01:42:25.573619+0000","last_undegraded":"2023-11-04T01:42:25.573619+0000","last_fullsized":"2023-11-04T01:42:25.573619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.261927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504841+0000","last_change":"2023-11-04T01:42:23.871604+0000","last_active":"2023-11-04T01:42:25.504841+0000","last_peered":"2023-11-04T01:42:25.504841+0000","last_clean":"2023-11-04T01:42:25.504841+0000","last_became_active":"2023-11-04T01:42:23.870746+0000","last_became_peered":"2023-11-04T01:42:23.870746+0000","last_unstale":"2023-11-04T01:42:25.504841+0000","last_undegraded":"2023-11-04T01:42:25.504841+0000","last_fullsized":"2023-11-04T01:42:25.504841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:22.043685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504543+0000","last_change":"2023-11-04T01:42:24.520352+0000","last_active":"2023-11-04T01:42:25.504543+0000","last_peered":"2023-11-04T01:42:25.504543+0000","last_clean":"2023-11-04T01:42:25.504543+0000","last_became_active":"2023-11-04T01:42:24.519515+0000","last_became_peered":"2023-11-04T01:42:24.519515+0000","last_unstale":"2023-11-04T01:42:25.504543+0000","last_undegraded":"2023-11-04T01:42:25.504543+0000","last_fullsized":"2023-11-04T01:42:25.504543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:31.963568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506869+0000","last_change":"2023-11-04T01:42:23.856440+0000","last_active":"2023-11-04T01:42:25.506869+0000","last_peered":"2023-11-04T01:42:25.506869+0000","last_clean":"2023-11-04T01:42:25.506869+0000","last_became_active":"2023-11-04T01:42:23.856067+0000","last_became_peered":"2023-11-04T01:42:23.856067+0000","last_unstale":"2023-11-04T01:42:25.506869+0000","last_undegraded":"2023-11-04T01:42:25.506869+0000","last_fullsized":"2023-11-04T01:42:25.506869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:21.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504391+0000","last_change":"2023-11-04T01:42:24.530290+0000","last_active":"2023-11-04T01:42:25.504391+0000","last_peered":"2023-11-04T01:42:25.504391+0000","last_clean":"2023-11-04T01:42:25.504391+0000","last_became_active":"2023-11-04T01:42:24.529568+0000","last_became_peered":"2023-11-04T01:42:24.529568+0000","last_unstale":"2023-11-04T01:42:25.504391+0000","last_undegraded":"2023-11-04T01:42:25.504391+0000","last_fullsized":"2023-11-04T01:42:25.504391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:42.384938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506042+0000","last_change":"2023-11-04T01:42:24.532587+0000","last_active":"2023-11-04T01:42:25.506042+0000","last_peered":"2023-11-04T01:42:25.506042+0000","last_clean":"2023-11-04T01:42:25.506042+0000","last_became_active":"2023-11-04T01:42:24.531827+0000","last_became_peered":"2023-11-04T01:42:24.531827+0000","last_unstale":"2023-11-04T01:42:25.506042+0000","last_undegraded":"2023-11-04T01:42:25.506042+0000","last_fullsized":"2023-11-04T01:42:25.506042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:09.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504135+0000","last_change":"2023-11-04T01:42:23.871960+0000","last_active":"2023-11-04T01:42:25.504135+0000","last_peered":"2023-11-04T01:42:25.504135+0000","last_clean":"2023-11-04T01:42:25.504135+0000","last_became_active":"2023-11-04T01:42:23.871205+0000","last_became_peered":"2023-11-04T01:42:23.871205+0000","last_unstale":"2023-11-04T01:42:25.504135+0000","last_undegraded":"2023-11-04T01:42:25.504135+0000","last_fullsized":"2023-11-04T01:42:25.504135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:33:54.986696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503773+0000","last_change":"2023-11-04T01:42:24.531520+0000","last_active":"2023-11-04T01:42:25.503773+0000","last_peered":"2023-11-04T01:42:25.503773+0000","last_clean":"2023-11-04T01:42:25.503773+0000","last_became_active":"2023-11-04T01:42:24.530762+0000","last_became_peered":"2023-11-04T01:42:24.530762+0000","last_unstale":"2023-11-04T01:42:25.503773+0000","last_undegraded":"2023-11-04T01:42:25.503773+0000","last_fullsized":"2023-11-04T01:42:25.503773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.137518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573320+0000","last_change":"2023-11-04T01:42:23.887853+0000","last_active":"2023-11-04T01:42:25.573320+0000","last_peered":"2023-11-04T01:42:25.573320+0000","last_clean":"2023-11-04T01:42:25.573320+0000","last_became_active":"2023-11-04T01:42:23.886915+0000","last_became_peered":"2023-11-04T01:42:23.886915+0000","last_unstale":"2023-11-04T01:42:25.573320+0000","last_undegraded":"2023-11-04T01:42:25.573320+0000","last_fullsized":"2023-11-04T01:42:25.573320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:25.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.539674+0000","last_change":"2023-11-04T01:42:24.528548+0000","last_active":"2023-11-04T01:42:24.539674+0000","last_peered":"2023-11-04T01:42:24.539674+0000","last_clean":"2023-11-04T01:42:24.539674+0000","last_became_active":"2023-11-04T01:42:24.527750+0000","last_became_peered":"2023-11-04T01:42:24.527750+0000","last_unstale":"2023-11-04T01:42:24.539674+0000","last_undegraded":"2023-11-04T01:42:24.539674+0000","last_fullsized":"2023-11-04T01:42:24.539674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:13.583907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506105+0000","last_change":"2023-11-04T01:42:23.865890+0000","last_active":"2023-11-04T01:42:25.506105+0000","last_peered":"2023-11-04T01:42:25.506105+0000","last_clean":"2023-11-04T01:42:25.506105+0000","last_became_active":"2023-11-04T01:42:23.865503+0000","last_became_peered":"2023-11-04T01:42:23.865503+0000","last_unstale":"2023-11-04T01:42:25.506105+0000","last_undegraded":"2023-11-04T01:42:25.506105+0000","last_fullsized":"2023-11-04T01:42:25.506105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:05.380495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506285+0000","last_change":"2023-11-04T01:42:24.527953+0000","last_active":"2023-11-04T01:42:25.506285+0000","last_peered":"2023-11-04T01:42:25.506285+0000","last_clean":"2023-11-04T01:42:25.506285+0000","last_became_active":"2023-11-04T01:42:24.527112+0000","last_became_peered":"2023-11-04T01:42:24.527112+0000","last_unstale":"2023-11-04T01:42:25.506285+0000","last_undegraded":"2023-11-04T01:42:25.506285+0000","last_fullsized":"2023-11-04T01:42:25.506285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:04.559600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507122+0000","last_change":"2023-11-04T01:42:24.560200+0000","last_active":"2023-11-04T01:42:25.507122+0000","last_peered":"2023-11-04T01:42:25.507122+0000","last_clean":"2023-11-04T01:42:25.507122+0000","last_became_active":"2023-11-04T01:42:24.559286+0000","last_became_peered":"2023-11-04T01:42:24.559286+0000","last_unstale":"2023-11-04T01:42:25.507122+0000","last_undegraded":"2023-11-04T01:42:25.507122+0000","last_fullsized":"2023-11-04T01:42:25.507122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:48.678049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:23.829059+0000","last_change":"2023-11-04T01:42:23.829059+0000","last_active":"2023-11-04T01:42:23.829059+0000","last_peered":"2023-11-04T01:42:23.829059+0000","last_clean":"2023-11-04T01:42:23.829059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:23.829059+0000","last_undegraded":"2023-11-04T01:42:23.829059+0000","last_fullsized":"2023-11-04T01:42:23.829059+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:42:22.818428+0000","last_change":"2023-11-04T01:42:22.818428+0000","last_active":"2023-11-04T01:42:22.818428+0000","last_peered":"2023-11-04T01:42:22.818428+0000","last_clean":"2023-11-04T01:42:22.818428+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:42:22.818428+0000","last_undegraded":"2023-11-04T01:42:22.818428+0000","last_fullsized":"2023-11-04T01:42:22.818428+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544681+0000","last_change":"2023-11-04T01:42:24.540046+0000","last_active":"2023-11-04T01:42:24.544681+0000","last_peered":"2023-11-04T01:42:24.544681+0000","last_clean":"2023-11-04T01:42:24.544681+0000","last_became_active":"2023-11-04T01:42:24.539286+0000","last_became_peered":"2023-11-04T01:42:24.539286+0000","last_unstale":"2023-11-04T01:42:24.544681+0000","last_undegraded":"2023-11-04T01:42:24.544681+0000","last_fullsized":"2023-11-04T01:42:24.544681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887064+0000","last_change":"2023-11-04T01:42:23.879421+0000","last_active":"2023-11-04T01:42:24.887064+0000","last_peered":"2023-11-04T01:42:24.887064+0000","last_clean":"2023-11-04T01:42:24.887064+0000","last_became_active":"2023-11-04T01:42:23.874688+0000","last_became_peered":"2023-11-04T01:42:23.874688+0000","last_unstale":"2023-11-04T01:42:24.887064+0000","last_undegraded":"2023-11-04T01:42:24.887064+0000","last_fullsized":"2023-11-04T01:42:24.887064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546550+0000","last_change":"2023-11-04T01:42:24.544559+0000","last_active":"2023-11-04T01:42:24.546550+0000","last_peered":"2023-11-04T01:42:24.546550+0000","last_clean":"2023-11-04T01:42:24.546550+0000","last_became_active":"2023-11-04T01:42:24.543895+0000","last_became_peered":"2023-11-04T01:42:24.543895+0000","last_unstale":"2023-11-04T01:42:24.546550+0000","last_undegraded":"2023-11-04T01:42:24.546550+0000","last_fullsized":"2023-11-04T01:42:24.546550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504779+0000","last_change":"2023-11-04T01:42:23.868589+0000","last_active":"2023-11-04T01:42:25.504779+0000","last_peered":"2023-11-04T01:42:25.504779+0000","last_clean":"2023-11-04T01:42:25.504779+0000","last_became_active":"2023-11-04T01:42:23.867572+0000","last_became_peered":"2023-11-04T01:42:23.867572+0000","last_unstale":"2023-11-04T01:42:25.504779+0000","last_undegraded":"2023-11-04T01:42:25.504779+0000","last_fullsized":"2023-11-04T01:42:25.504779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:13.960345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":753664,"data_stored":638256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31336,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":159744,"data_stored":47888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1150000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5549999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":657215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":200704,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":68367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-11-04T01:42:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:22.818428+0000', 'last_change': '2023-11-04T01:42:22.818428+0000', 'last_active': '2023-11-04T01:42:22.818428+0000', 'last_peered': '2023-11-04T01:42:22.818428+0000', 'last_clean': '2023-11-04T01:42:22.818428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:22.818428+0000', 'last_undegraded': '2023-11-04T01:42:22.818428+0000', 'last_fullsized': '2023-11-04T01:42:22.818428+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:22.818428+0000', 'last_change': '2023-11-04T01:42:22.818428+0000', 'last_active': '2023-11-04T01:42:22.818428+0000', 'last_peered': '2023-11-04T01:42:22.818428+0000', 'last_clean': '2023-11-04T01:42:22.818428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:22.818428+0000', 'last_undegraded': '2023-11-04T01:42:22.818428+0000', 'last_fullsized': '2023-11-04T01:42:22.818428+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-11-04T01:42:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:22.818428+0000', 'last_change': '2023-11-04T01:42:22.818428+0000', 'last_active': '2023-11-04T01:42:22.818428+0000', 'last_peered': '2023-11-04T01:42:22.818428+0000', 'last_clean': '2023-11-04T01:42:22.818428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:22.818428+0000', 'last_undegraded': '2023-11-04T01:42:22.818428+0000', 'last_fullsized': '2023-11-04T01:42:22.818428+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:22.818428+0000', 'last_change': '2023-11-04T01:42:22.818428+0000', 'last_active': '2023-11-04T01:42:22.818428+0000', 'last_peered': '2023-11-04T01:42:22.818428+0000', 'last_clean': '2023-11-04T01:42:22.818428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:22.818428+0000', 'last_undegraded': '2023-11-04T01:42:22.818428+0000', 'last_fullsized': '2023-11-04T01:42:22.818428+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:22.818428+0000', 'last_change': '2023-11-04T01:42:22.818428+0000', 'last_active': '2023-11-04T01:42:22.818428+0000', 'last_peered': '2023-11-04T01:42:22.818428+0000', 'last_clean': '2023-11-04T01:42:22.818428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:22.818428+0000', 'last_undegraded': '2023-11-04T01:42:22.818428+0000', 'last_fullsized': '2023-11-04T01:42:22.818428+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:22.818428+0000', 'last_change': '2023-11-04T01:42:22.818428+0000', 'last_active': '2023-11-04T01:42:22.818428+0000', 'last_peered': '2023-11-04T01:42:22.818428+0000', 'last_clean': '2023-11-04T01:42:22.818428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:22.818428+0000', 'last_undegraded': '2023-11-04T01:42:22.818428+0000', 'last_fullsized': '2023-11-04T01:42:22.818428+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:23.829059+0000', 'last_change': '2023-11-04T01:42:23.829059+0000', 'last_active': '2023-11-04T01:42:23.829059+0000', 'last_peered': '2023-11-04T01:42:23.829059+0000', 'last_clean': '2023-11-04T01:42:23.829059+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:23.829059+0000', 'last_undegraded': '2023-11-04T01:42:23.829059+0000', 'last_fullsized': '2023-11-04T01:42:23.829059+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:23.829059+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-11-04T01:42:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:42:22.818428+0000', 'last_change': '2023-11-04T01:42:22.818428+0000', 'last_active': '2023-11-04T01:42:22.818428+0000', 'last_peered': '2023-11-04T01:42:22.818428+0000', 'last_clean': '2023-11-04T01:42:22.818428+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:42:22.818428+0000', 'last_undegraded': '2023-11-04T01:42:22.818428+0000', 'last_fullsized': '2023-11-04T01:42:22.818428+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'last_clean_scrub_stamp': '2023-11-04T01:42:22.818428+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:42:28.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:42:28.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 Processor -- start 2023-11-04T01:42:28.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 -- start start 2023-11-04T01:42:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff744143b60 0x7ff74406eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff744143f40 0x7ff74406a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff7440cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74406ab10 con 0x7ff744143b60 2023-11-04T01:42:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74415c5a0 con 0x7ff744143f40 2023-11-04T01:42:28.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff748b79640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74406e0b0 con 0x7ff74406a6a0 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff744143b60 0x7ff74406eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff744143b60 0x7ff74406eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46408/0 (socket says 172.21.15.2:46408) 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 -- 172.21.15.2:0/2482185311 learned_addr learned my addr 172.21.15.2:0/2482185311 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff742d9d640 1 --2- 172.21.15.2:0/2482185311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff7440cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff73bfff640 1 --2- 172.21.15.2:0/2482185311 >> v2:172.21.15.90:3300/0 conn(0x7ff744143f40 0x7ff74406a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 -- 172.21.15.2:0/2482185311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 msgr2=0x7ff7440cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 --2- 172.21.15.2:0/2482185311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff7440cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 -- 172.21.15.2:0/2482185311 >> v2:172.21.15.90:3300/0 conn(0x7ff744143f40 msgr2=0x7ff74406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 --2- 172.21.15.2:0/2482185311 >> v2:172.21.15.90:3300/0 conn(0x7ff744143f40 0x7ff74406a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff74259c640 1 -- 172.21.15.2:0/2482185311 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74406e390 con 0x7ff744143b60 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff742d9d640 1 --2- 172.21.15.2:0/2482185311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff7440cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:28.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.795+0000 7ff73bfff640 1 --2- 172.21.15.2:0/2482185311 >> v2:172.21.15.90:3300/0 conn(0x7ff744143f40 0x7ff74406a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff74259c640 1 --2- 172.21.15.2:0/2482185311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff74406eb90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff74406cb40 tx=0x7ff73401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1eacaf533c17ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff741d9b640 1 -- 172.21.15.2:0/2482185311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340ab670 con 0x7ff744143b60 2023-11-04T01:42:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff741d9b640 1 -- 172.21.15.2:0/2482185311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7340ab7d0 con 0x7ff744143b60 2023-11-04T01:42:28.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff741d9b640 1 -- 172.21.15.2:0/2482185311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340abb60 con 0x7ff744143b60 2023-11-04T01:42:28.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 -- 172.21.15.2:0/2482185311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 msgr2=0x7ff74406eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 --2- 172.21.15.2:0/2482185311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff74406eb90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff74406cb40 tx=0x7ff73401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 -- 172.21.15.2:0/2482185311 shutdown_connections 2023-11-04T01:42:28.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 --2- 172.21.15.2:0/2482185311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff7440cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 --2- 172.21.15.2:0/2482185311 >> v2:172.21.15.90:3300/0 conn(0x7ff744143f40 0x7ff74406a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 --2- 172.21.15.2:0/2482185311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff74406eb90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 -- 172.21.15.2:0/2482185311 >> 172.21.15.2:0/2482185311 conn(0x7ff7440b18e0 msgr2=0x7ff7440b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:28.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 -- 172.21.15.2:0/2482185311 shutdown_connections 2023-11-04T01:42:28.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 -- 172.21.15.2:0/2482185311 wait complete. 2023-11-04T01:42:28.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 Processor -- start 2023-11-04T01:42:28.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.799+0000 7ff748b79640 1 -- start start 2023-11-04T01:42:28.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff744152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff7440b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff744143f40 0x7ff7441f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441533a0 con 0x7ff744143b60 2023-11-04T01:42:28.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440b3510 con 0x7ff744143f40 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440b37f0 con 0x7ff74406a6a0 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff7440b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff7440b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46424/0 (socket says 172.21.15.2:46424) 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 -- 172.21.15.2:0/712650878 learned_addr learned my addr 172.21.15.2:0/712650878 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff74259c640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff744152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff742d9d640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff744143f40 0x7ff7441f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 -- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 msgr2=0x7ff744152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff744152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 -- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff744143f40 msgr2=0x7ff7441f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff744143f40 0x7ff7441f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 -- 172.21.15.2:0/712650878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340094d0 con 0x7ff744143b60 2023-11-04T01:42:28.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73bfff640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff7440b2ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00d800 tx=0x7ff72c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73affd640 1 -- 172.21.15.2:0/712650878 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0096c0 con 0x7ff744143b60 2023-11-04T01:42:28.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73affd640 1 -- 172.21.15.2:0/712650878 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c009820 con 0x7ff744143b60 2023-11-04T01:42:28.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73affd640 1 -- 172.21.15.2:0/712650878 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c009bd0 con 0x7ff744143b60 2023-11-04T01:42:28.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7440b3ad0 con 0x7ff744143b60 2023-11-04T01:42:28.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff744153120 con 0x7ff744143b60 2023-11-04T01:42:28.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff744071e60 con 0x7ff744143b60 2023-11-04T01:42:28.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73affd640 1 -- 172.21.15.2:0/712650878 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff72c009d30 con 0x7ff744143b60 2023-11-04T01:42:28.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73affd640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7240664a0 0x7ff724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:28.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff73affd640 1 -- 172.21.15.2:0/712650878 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff72c084580 con 0x7ff744143b60 2023-11-04T01:42:28.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.803+0000 7ff74259c640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7240664a0 0x7ff724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:28.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.807+0000 7ff74259c640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7240664a0 0x7ff724068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7340af000 tx=0x7ff7340a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:28.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:28.807+0000 7ff73affd640 1 -- 172.21.15.2:0/712650878 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff72c051a90 con 0x7ff744143b60 2023-11-04T01:42:28.904 INFO:tasks.ceph.mds.b.smithi090.stderr:2023-11-04T01:42:28.897+0000 7f9b54b78640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:42:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.027+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff744074510 con 0x7ff744143b60 2023-11-04T01:42:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.027+0000 7ff73affd640 1 -- 172.21.15.2:0/712650878 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7ff72c0550b0 con 0x7ff744143b60 2023-11-04T01:42:29.032 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:29.032 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1699062131,"num_in_osds":8,"osd_in_since":1699062122,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":241225728,"bytes_avail":772852887552,"bytes_total":773094113280,"write_bytes_sec":2417,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-04T01:41:59.811993+0000","services":{}},"progress_events":{}} 2023-11-04T01:42:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7240664a0 msgr2=0x7ff724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7240664a0 0x7ff724068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7340af000 tx=0x7ff7340a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 msgr2=0x7ff7440b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff7440b2ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff72c00d800 tx=0x7ff72c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 shutdown_connections 2023-11-04T01:42:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7240664a0 0x7ff724068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff744143f40 0x7ff7441f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff744143b60 0x7ff7440b2ce0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 --2- 172.21.15.2:0/712650878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff74406a6a0 0x7ff744152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 >> 172.21.15.2:0/712650878 conn(0x7ff7440b18e0 msgr2=0x7ff744071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 shutdown_connections 2023-11-04T01:42:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.031+0000 7ff748b79640 1 -- 172.21.15.2:0/712650878 wait complete. 2023-11-04T01:42:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:42:29.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:29.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.163+0000 7fd1df446640 1 Processor -- start 2023-11-04T01:42:29.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.163+0000 7fd1df446640 1 -- start start 2023-11-04T01:42:29.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1df446640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1d815b290 0x7fd1d806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1df446640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1d80c2670 0x7fd1d80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1df446640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d806c740 con 0x7fd1d806fe30 2023-11-04T01:42:29.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1df446640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d815b670 con 0x7fd1d80c2670 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1df446640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d806bb30 con 0x7fd1d815b290 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1d80c2670 0x7fd1d80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1d80c2670 0x7fd1d80b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46430/0 (socket says 172.21.15.2:46430) 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/3586624942 learned_addr learned my addr 172.21.15.2:0/3586624942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dd1e2640 1 --2- 172.21.15.2:0/3586624942 >> v2:172.21.15.90:3300/0 conn(0x7fd1d815b290 0x7fd1d806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/3586624942 >> v2:172.21.15.90:3300/0 conn(0x7fd1d815b290 msgr2=0x7fd1d806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 --2- 172.21.15.2:0/3586624942 >> v2:172.21.15.90:3300/0 conn(0x7fd1d815b290 0x7fd1d806f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/3586624942 >> v1:172.21.15.2:6789/0 conn(0x7fd1d806fe30 legacy=0x7fd1d80c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/3586624942 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d806be10 con 0x7fd1d80c2670 2023-11-04T01:42:29.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dd1e2640 1 --2- 172.21.15.2:0/3586624942 >> v2:172.21.15.90:3300/0 conn(0x7fd1d815b290 0x7fd1d806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1dc9e1640 1 --2- 172.21.15.2:0/3586624942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b0630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80ce930 tx=0x7fd1c801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1da910ce16aaa72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1cffff640 1 -- 172.21.15.2:0/3586624942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80ab600 con 0x7fd1d80c2670 2023-11-04T01:42:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1cffff640 1 -- 172.21.15.2:0/3586624942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80a7050 con 0x7fd1d80c2670 2023-11-04T01:42:29.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.167+0000 7fd1cffff640 1 -- 172.21.15.2:0/3586624942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80ab980 con 0x7fd1d80c2670 2023-11-04T01:42:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- 172.21.15.2:0/3586624942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 msgr2=0x7fd1d80b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 --2- 172.21.15.2:0/3586624942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b0630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80ce930 tx=0x7fd1c801c470 comp rx=0 tx=0).stop 2023-11-04T01:42:29.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- 172.21.15.2:0/3586624942 shutdown_connections 2023-11-04T01:42:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 --2- 172.21.15.2:0/3586624942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b0630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 --2- 172.21.15.2:0/3586624942 >> v2:172.21.15.90:3300/0 conn(0x7fd1d815b290 0x7fd1d806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- 172.21.15.2:0/3586624942 >> 172.21.15.2:0/3586624942 conn(0x7fd1d80cebb0 msgr2=0x7fd1d80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- 172.21.15.2:0/3586624942 shutdown_connections 2023-11-04T01:42:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- 172.21.15.2:0/3586624942 wait complete. 2023-11-04T01:42:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 Processor -- start 2023-11-04T01:42:29.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- start start 2023-11-04T01:42:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1d806fe30 0x7fd1d81365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1d815b290 0x7fd1d80b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80c6400 con 0x7fd1d80c2670 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80b4870 con 0x7fd1d806fe30 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80c65e0 con 0x7fd1d815b290 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46434/0 (socket says 172.21.15.2:46434) 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/1199525384 learned_addr learned my addr 172.21.15.2:0/1199525384 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dd1e2640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1d806fe30 0x7fd1d81365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dd9e3640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1d815b290 0x7fd1d80b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1d815b290 msgr2=0x7fd1d80b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1d815b290 0x7fd1d80b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1d806fe30 msgr2=0x7fd1d81365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1d806fe30 0x7fd1d81365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 -- 172.21.15.2:0/1199525384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094d0 con 0x7fd1d80c2670 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dd1e2640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1d806fe30 0x7fd1d81365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dd9e3640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1d815b290 0x7fd1d80b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1dc9e1640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b17d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8019080 tx=0x7fd1c8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1cdffb640 1 -- 172.21.15.2:0/1199525384 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80b37d0 con 0x7fd1d80c2670 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1cdffb640 1 -- 172.21.15.2:0/1199525384 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c80b3930 con 0x7fd1d80c2670 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d80c68c0 con 0x7fd1d80c2670 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1cdffb640 1 -- 172.21.15.2:0/1199525384 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80b3ce0 con 0x7fd1d80c2670 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.171+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d814a470 con 0x7fd1d80c2670 2023-11-04T01:42:29.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.175+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d815ab10 con 0x7fd1d80c2670 2023-11-04T01:42:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.175+0000 7fd1cdffb640 1 -- 172.21.15.2:0/1199525384 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1c80b2070 con 0x7fd1d80c2670 2023-11-04T01:42:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.175+0000 7fd1cdffb640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1bc0664a0 0x7fd1bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.175+0000 7fd1cdffb640 1 -- 172.21.15.2:0/1199525384 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1c811e1c0 con 0x7fd1d80c2670 2023-11-04T01:42:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.175+0000 7fd1dd1e2640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1bc0664a0 0x7fd1bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:29.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.175+0000 7fd1dd1e2640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1bc0664a0 0x7fd1bc068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4008890 tx=0x7fd1d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:29.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.179+0000 7fd1cdffb640 1 -- 172.21.15.2:0/1199525384 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1c80eb640 con 0x7fd1d80c2670 2023-11-04T01:42:29.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.331+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1d80ce700 con 0x7fd1bc0664a0 2023-11-04T01:42:29.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.351+0000 7fd1cdffb640 1 -- 172.21.15.2:0/1199525384 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264548 (secure 0 0 0) 0x7fd1d400c040 con 0x7fd1bc0664a0 2023-11-04T01:42:29.359 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:29.360 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:42:29.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1bc0664a0 msgr2=0x7fd1bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1bc0664a0 0x7fd1bc068960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4008890 tx=0x7fd1d4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 msgr2=0x7fd1d80b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b17d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8019080 tx=0x7fd1c8019210 comp rx=0 tx=0).stop 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 shutdown_connections 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1bc0664a0 0x7fd1bc068960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1d815b290 0x7fd1d80b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1d80c2670 0x7fd1d80b17d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 --2- 172.21.15.2:0/1199525384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1d806fe30 0x7fd1d81365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 >> 172.21.15.2:0/1199525384 conn(0x7fd1d80cebb0 msgr2=0x7fd1d815a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 shutdown_connections 2023-11-04T01:42:29.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:29.355+0000 7fd1df446640 1 -- 172.21.15.2:0/1199525384 wait complete. 2023-11-04T01:42:29.378 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-04T01:42:28.760278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235572,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739148,"statfs":{"total":773094113280,"available":772852887552,"internally_reserved":0,"allocated":2818048,"data_stored":1723612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.931225"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508406+0000","last_change":"2023-11-04T01:42:24.537942+0000","last_active":"2023-11-04T01:42:25.508406+0000","last_peered":"2023-11-04T01:42:25.508406+0000","last_clean":"2023-11-04T01:42:25.508406+0000","last_became_active":"2023-11-04T01:42:24.537165+0000","last_became_peered":"2023-11-04T01:42:24.537165+0000","last_unstale":"2023-11-04T01:42:25.508406+0000","last_undegraded":"2023-11-04T01:42:25.508406+0000","last_fullsized":"2023-11-04T01:42:25.508406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:27.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538647+0000","last_change":"2023-11-04T01:42:24.526074+0000","last_active":"2023-11-04T01:42:24.538647+0000","last_peered":"2023-11-04T01:42:24.538647+0000","last_clean":"2023-11-04T01:42:24.538647+0000","last_became_active":"2023-11-04T01:42:24.525339+0000","last_became_peered":"2023-11-04T01:42:24.525339+0000","last_unstale":"2023-11-04T01:42:24.538647+0000","last_undegraded":"2023-11-04T01:42:24.538647+0000","last_fullsized":"2023-11-04T01:42:24.538647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543220+0000","last_change":"2023-11-04T01:42:24.532853+0000","last_active":"2023-11-04T01:42:24.543220+0000","last_peered":"2023-11-04T01:42:24.543220+0000","last_clean":"2023-11-04T01:42:24.543220+0000","last_became_active":"2023-11-04T01:42:24.531811+0000","last_became_peered":"2023-11-04T01:42:24.531811+0000","last_unstale":"2023-11-04T01:42:24.543220+0000","last_undegraded":"2023-11-04T01:42:24.543220+0000","last_fullsized":"2023-11-04T01:42:24.543220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553108+0000","last_change":"2023-11-04T01:42:24.532090+0000","last_active":"2023-11-04T01:42:24.553108+0000","last_peered":"2023-11-04T01:42:24.553108+0000","last_clean":"2023-11-04T01:42:24.553108+0000","last_became_active":"2023-11-04T01:42:24.531252+0000","last_became_peered":"2023-11-04T01:42:24.531252+0000","last_unstale":"2023-11-04T01:42:24.553108+0000","last_undegraded":"2023-11-04T01:42:24.553108+0000","last_fullsized":"2023-11-04T01:42:24.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508158+0000","last_change":"2023-11-04T01:42:24.555465+0000","last_active":"2023-11-04T01:42:25.508158+0000","last_peered":"2023-11-04T01:42:25.508158+0000","last_clean":"2023-11-04T01:42:25.508158+0000","last_became_active":"2023-11-04T01:42:24.554690+0000","last_became_peered":"2023-11-04T01:42:24.554690+0000","last_unstale":"2023-11-04T01:42:25.508158+0000","last_undegraded":"2023-11-04T01:42:25.508158+0000","last_fullsized":"2023-11-04T01:42:25.508158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:50.998381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553224+0000","last_change":"2023-11-04T01:42:24.532641+0000","last_active":"2023-11-04T01:42:24.553224+0000","last_peered":"2023-11-04T01:42:24.553224+0000","last_clean":"2023-11-04T01:42:24.553224+0000","last_became_active":"2023-11-04T01:42:24.531903+0000","last_became_peered":"2023-11-04T01:42:24.531903+0000","last_unstale":"2023-11-04T01:42:24.553224+0000","last_undegraded":"2023-11-04T01:42:24.553224+0000","last_fullsized":"2023-11-04T01:42:24.553224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508004+0000","last_change":"2023-11-04T01:42:24.534979+0000","last_active":"2023-11-04T01:42:25.508004+0000","last_peered":"2023-11-04T01:42:25.508004+0000","last_clean":"2023-11-04T01:42:25.508004+0000","last_became_active":"2023-11-04T01:42:24.534228+0000","last_became_peered":"2023-11-04T01:42:24.534228+0000","last_unstale":"2023-11-04T01:42:25.508004+0000","last_undegraded":"2023-11-04T01:42:25.508004+0000","last_fullsized":"2023-11-04T01:42:25.508004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:22.475674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543629+0000","last_change":"2023-11-04T01:42:24.532676+0000","last_active":"2023-11-04T01:42:24.543629+0000","last_peered":"2023-11-04T01:42:24.543629+0000","last_clean":"2023-11-04T01:42:24.543629+0000","last_became_active":"2023-11-04T01:42:24.531878+0000","last_became_peered":"2023-11-04T01:42:24.531878+0000","last_unstale":"2023-11-04T01:42:24.543629+0000","last_undegraded":"2023-11-04T01:42:24.543629+0000","last_fullsized":"2023-11-04T01:42:24.543629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552545+0000","last_change":"2023-11-04T01:42:24.535521+0000","last_active":"2023-11-04T01:42:24.552545+0000","last_peered":"2023-11-04T01:42:24.552545+0000","last_clean":"2023-11-04T01:42:24.552545+0000","last_became_active":"2023-11-04T01:42:24.534783+0000","last_became_peered":"2023-11-04T01:42:24.534783+0000","last_unstale":"2023-11-04T01:42:24.552545+0000","last_undegraded":"2023-11-04T01:42:24.552545+0000","last_fullsized":"2023-11-04T01:42:24.552545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507864+0000","last_change":"2023-11-04T01:42:24.545554+0000","last_active":"2023-11-04T01:42:25.507864+0000","last_peered":"2023-11-04T01:42:25.507864+0000","last_clean":"2023-11-04T01:42:25.507864+0000","last_became_active":"2023-11-04T01:42:24.544913+0000","last_became_peered":"2023-11-04T01:42:24.544913+0000","last_unstale":"2023-11-04T01:42:25.507864+0000","last_undegraded":"2023-11-04T01:42:25.507864+0000","last_fullsized":"2023-11-04T01:42:25.507864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:10.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508181+0000","last_change":"2023-11-04T01:42:24.549621+0000","last_active":"2023-11-04T01:42:25.508181+0000","last_peered":"2023-11-04T01:42:25.508181+0000","last_clean":"2023-11-04T01:42:25.508181+0000","last_became_active":"2023-11-04T01:42:24.548804+0000","last_became_peered":"2023-11-04T01:42:24.548804+0000","last_unstale":"2023-11-04T01:42:25.508181+0000","last_undegraded":"2023-11-04T01:42:25.508181+0000","last_fullsized":"2023-11-04T01:42:25.508181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:36.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508310+0000","last_change":"2023-11-04T01:42:24.545059+0000","last_active":"2023-11-04T01:42:25.508310+0000","last_peered":"2023-11-04T01:42:25.508310+0000","last_clean":"2023-11-04T01:42:25.508310+0000","last_became_active":"2023-11-04T01:42:24.544341+0000","last_became_peered":"2023-11-04T01:42:24.544341+0000","last_unstale":"2023-11-04T01:42:25.508310+0000","last_undegraded":"2023-11-04T01:42:25.508310+0000","last_fullsized":"2023-11-04T01:42:25.508310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.705964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573452+0000","last_change":"2023-11-04T01:42:24.555198+0000","last_active":"2023-11-04T01:42:25.573452+0000","last_peered":"2023-11-04T01:42:25.573452+0000","last_clean":"2023-11-04T01:42:25.573452+0000","last_became_active":"2023-11-04T01:42:24.554517+0000","last_became_peered":"2023-11-04T01:42:24.554517+0000","last_unstale":"2023-11-04T01:42:25.573452+0000","last_undegraded":"2023-11-04T01:42:25.573452+0000","last_fullsized":"2023-11-04T01:42:25.573452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572931+0000","last_change":"2023-11-04T01:42:24.537075+0000","last_active":"2023-11-04T01:42:25.572931+0000","last_peered":"2023-11-04T01:42:25.572931+0000","last_clean":"2023-11-04T01:42:25.572931+0000","last_became_active":"2023-11-04T01:42:24.536346+0000","last_became_peered":"2023-11-04T01:42:24.536346+0000","last_unstale":"2023-11-04T01:42:25.572931+0000","last_undegraded":"2023-11-04T01:42:25.572931+0000","last_fullsized":"2023-11-04T01:42:25.572931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538718+0000","last_change":"2023-11-04T01:42:24.526411+0000","last_active":"2023-11-04T01:42:24.538718+0000","last_peered":"2023-11-04T01:42:24.538718+0000","last_clean":"2023-11-04T01:42:24.538718+0000","last_became_active":"2023-11-04T01:42:24.525610+0000","last_became_peered":"2023-11-04T01:42:24.525610+0000","last_unstale":"2023-11-04T01:42:24.538718+0000","last_undegraded":"2023-11-04T01:42:24.538718+0000","last_fullsized":"2023-11-04T01:42:24.538718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505513+0000","last_change":"2023-11-04T01:42:24.551036+0000","last_active":"2023-11-04T01:42:25.505513+0000","last_peered":"2023-11-04T01:42:25.505513+0000","last_clean":"2023-11-04T01:42:25.505513+0000","last_became_active":"2023-11-04T01:42:24.550386+0000","last_became_peered":"2023-11-04T01:42:24.550386+0000","last_unstale":"2023-11-04T01:42:25.505513+0000","last_undegraded":"2023-11-04T01:42:25.505513+0000","last_fullsized":"2023-11-04T01:42:25.505513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506769+0000","last_change":"2023-11-04T01:42:24.559164+0000","last_active":"2023-11-04T01:42:25.506769+0000","last_peered":"2023-11-04T01:42:25.506769+0000","last_clean":"2023-11-04T01:42:25.506769+0000","last_became_active":"2023-11-04T01:42:24.558452+0000","last_became_peered":"2023-11-04T01:42:24.558452+0000","last_unstale":"2023-11-04T01:42:25.506769+0000","last_undegraded":"2023-11-04T01:42:25.506769+0000","last_fullsized":"2023-11-04T01:42:25.506769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:31.294438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546974+0000","last_change":"2023-11-04T01:42:24.542766+0000","last_active":"2023-11-04T01:42:24.546974+0000","last_peered":"2023-11-04T01:42:24.546974+0000","last_clean":"2023-11-04T01:42:24.546974+0000","last_became_active":"2023-11-04T01:42:24.542209+0000","last_became_peered":"2023-11-04T01:42:24.542209+0000","last_unstale":"2023-11-04T01:42:24.546974+0000","last_undegraded":"2023-11-04T01:42:24.546974+0000","last_fullsized":"2023-11-04T01:42:24.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:48.042046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507069+0000","last_change":"2023-11-04T01:42:24.533283+0000","last_active":"2023-11-04T01:42:25.507069+0000","last_peered":"2023-11-04T01:42:25.507069+0000","last_clean":"2023-11-04T01:42:25.507069+0000","last_became_active":"2023-11-04T01:42:24.530651+0000","last_became_peered":"2023-11-04T01:42:24.530651+0000","last_unstale":"2023-11-04T01:42:25.507069+0000","last_undegraded":"2023-11-04T01:42:25.507069+0000","last_fullsized":"2023-11-04T01:42:25.507069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:51.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508171+0000","last_change":"2023-11-04T01:42:24.545087+0000","last_active":"2023-11-04T01:42:25.508171+0000","last_peered":"2023-11-04T01:42:25.508171+0000","last_clean":"2023-11-04T01:42:25.508171+0000","last_became_active":"2023-11-04T01:42:24.544372+0000","last_became_peered":"2023-11-04T01:42:24.544372+0000","last_unstale":"2023-11-04T01:42:25.508171+0000","last_undegraded":"2023-11-04T01:42:25.508171+0000","last_fullsized":"2023-11-04T01:42:25.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:30.235988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504099+0000","last_change":"2023-11-04T01:42:24.528107+0000","last_active":"2023-11-04T01:42:25.504099+0000","last_peered":"2023-11-04T01:42:25.504099+0000","last_clean":"2023-11-04T01:42:25.504099+0000","last_became_active":"2023-11-04T01:42:24.527344+0000","last_became_peered":"2023-11-04T01:42:24.527344+0000","last_unstale":"2023-11-04T01:42:25.504099+0000","last_undegraded":"2023-11-04T01:42:25.504099+0000","last_fullsized":"2023-11-04T01:42:25.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:48.101766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.540730+0000","last_change":"2023-11-04T01:42:24.516917+0000","last_active":"2023-11-04T01:42:24.540730+0000","last_peered":"2023-11-04T01:42:24.540730+0000","last_clean":"2023-11-04T01:42:24.540730+0000","last_became_active":"2023-11-04T01:42:24.516072+0000","last_became_peered":"2023-11-04T01:42:24.516072+0000","last_unstale":"2023-11-04T01:42:24.540730+0000","last_undegraded":"2023-11-04T01:42:24.540730+0000","last_fullsized":"2023-11-04T01:42:24.540730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546578+0000","last_change":"2023-11-04T01:42:24.544709+0000","last_active":"2023-11-04T01:42:24.546578+0000","last_peered":"2023-11-04T01:42:24.546578+0000","last_clean":"2023-11-04T01:42:24.546578+0000","last_became_active":"2023-11-04T01:42:24.543976+0000","last_became_peered":"2023-11-04T01:42:24.543976+0000","last_unstale":"2023-11-04T01:42:24.546578+0000","last_undegraded":"2023-11-04T01:42:24.546578+0000","last_fullsized":"2023-11-04T01:42:24.546578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505748+0000","last_change":"2023-11-04T01:42:24.532616+0000","last_active":"2023-11-04T01:42:25.505748+0000","last_peered":"2023-11-04T01:42:25.505748+0000","last_clean":"2023-11-04T01:42:25.505748+0000","last_became_active":"2023-11-04T01:42:24.529894+0000","last_became_peered":"2023-11-04T01:42:24.529894+0000","last_unstale":"2023-11-04T01:42:25.505748+0000","last_undegraded":"2023-11-04T01:42:25.505748+0000","last_fullsized":"2023-11-04T01:42:25.505748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544733+0000","last_change":"2023-11-04T01:42:24.540137+0000","last_active":"2023-11-04T01:42:24.544733+0000","last_peered":"2023-11-04T01:42:24.544733+0000","last_clean":"2023-11-04T01:42:24.544733+0000","last_became_active":"2023-11-04T01:42:24.539303+0000","last_became_peered":"2023-11-04T01:42:24.539303+0000","last_unstale":"2023-11-04T01:42:24.544733+0000","last_undegraded":"2023-11-04T01:42:24.544733+0000","last_fullsized":"2023-11-04T01:42:24.544733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553334+0000","last_change":"2023-11-04T01:42:24.537992+0000","last_active":"2023-11-04T01:42:24.553334+0000","last_peered":"2023-11-04T01:42:24.553334+0000","last_clean":"2023-11-04T01:42:24.553334+0000","last_became_active":"2023-11-04T01:42:24.537129+0000","last_became_peered":"2023-11-04T01:42:24.537129+0000","last_unstale":"2023-11-04T01:42:24.553334+0000","last_undegraded":"2023-11-04T01:42:24.553334+0000","last_fullsized":"2023-11-04T01:42:24.553334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573347+0000","last_change":"2023-11-04T01:42:24.530582+0000","last_active":"2023-11-04T01:42:25.573347+0000","last_peered":"2023-11-04T01:42:25.573347+0000","last_clean":"2023-11-04T01:42:25.573347+0000","last_became_active":"2023-11-04T01:42:24.529891+0000","last_became_peered":"2023-11-04T01:42:24.529891+0000","last_unstale":"2023-11-04T01:42:25.573347+0000","last_undegraded":"2023-11-04T01:42:25.573347+0000","last_fullsized":"2023-11-04T01:42:25.573347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573474+0000","last_change":"2023-11-04T01:42:24.554452+0000","last_active":"2023-11-04T01:42:25.573474+0000","last_peered":"2023-11-04T01:42:25.573474+0000","last_clean":"2023-11-04T01:42:25.573474+0000","last_became_active":"2023-11-04T01:42:24.553857+0000","last_became_peered":"2023-11-04T01:42:24.553857+0000","last_unstale":"2023-11-04T01:42:25.573474+0000","last_undegraded":"2023-11-04T01:42:25.573474+0000","last_fullsized":"2023-11-04T01:42:25.573474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:48.459289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543232+0000","last_change":"2023-11-04T01:42:24.532888+0000","last_active":"2023-11-04T01:42:24.543232+0000","last_peered":"2023-11-04T01:42:24.543232+0000","last_clean":"2023-11-04T01:42:24.543232+0000","last_became_active":"2023-11-04T01:42:24.532172+0000","last_became_peered":"2023-11-04T01:42:24.532172+0000","last_unstale":"2023-11-04T01:42:24.543232+0000","last_undegraded":"2023-11-04T01:42:24.543232+0000","last_fullsized":"2023-11-04T01:42:24.543232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505919+0000","last_change":"2023-11-04T01:42:24.532118+0000","last_active":"2023-11-04T01:42:25.505919+0000","last_peered":"2023-11-04T01:42:25.505919+0000","last_clean":"2023-11-04T01:42:25.505919+0000","last_became_active":"2023-11-04T01:42:24.530531+0000","last_became_peered":"2023-11-04T01:42:24.530531+0000","last_unstale":"2023-11-04T01:42:25.505919+0000","last_undegraded":"2023-11-04T01:42:25.505919+0000","last_fullsized":"2023-11-04T01:42:25.505919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546959+0000","last_change":"2023-11-04T01:42:24.541439+0000","last_active":"2023-11-04T01:42:24.546959+0000","last_peered":"2023-11-04T01:42:24.546959+0000","last_clean":"2023-11-04T01:42:24.546959+0000","last_became_active":"2023-11-04T01:42:24.540727+0000","last_became_peered":"2023-11-04T01:42:24.540727+0000","last_unstale":"2023-11-04T01:42:24.546959+0000","last_undegraded":"2023-11-04T01:42:24.546959+0000","last_fullsized":"2023-11-04T01:42:24.546959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:01.489039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.545101+0000","last_change":"2023-11-04T01:42:24.521552+0000","last_active":"2023-11-04T01:42:24.545101+0000","last_peered":"2023-11-04T01:42:24.545101+0000","last_clean":"2023-11-04T01:42:24.545101+0000","last_became_active":"2023-11-04T01:42:24.520794+0000","last_became_peered":"2023-11-04T01:42:24.520794+0000","last_unstale":"2023-11-04T01:42:24.545101+0000","last_undegraded":"2023-11-04T01:42:24.545101+0000","last_fullsized":"2023-11-04T01:42:24.545101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:18.253719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552544+0000","last_change":"2023-11-04T01:42:24.530960+0000","last_active":"2023-11-04T01:42:24.552544+0000","last_peered":"2023-11-04T01:42:24.552544+0000","last_clean":"2023-11-04T01:42:24.552544+0000","last_became_active":"2023-11-04T01:42:24.530166+0000","last_became_peered":"2023-11-04T01:42:24.530166+0000","last_unstale":"2023-11-04T01:42:24.552544+0000","last_undegraded":"2023-11-04T01:42:24.552544+0000","last_fullsized":"2023-11-04T01:42:24.552544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.888606+0000","last_change":"2023-11-04T01:42:23.881752+0000","last_active":"2023-11-04T01:42:24.888606+0000","last_peered":"2023-11-04T01:42:24.888606+0000","last_clean":"2023-11-04T01:42:24.888606+0000","last_became_active":"2023-11-04T01:42:23.871460+0000","last_became_peered":"2023-11-04T01:42:23.871460+0000","last_unstale":"2023-11-04T01:42:24.888606+0000","last_undegraded":"2023-11-04T01:42:24.888606+0000","last_fullsized":"2023-11-04T01:42:24.888606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504494+0000","last_change":"2023-11-04T01:42:24.536354+0000","last_active":"2023-11-04T01:42:25.504494+0000","last_peered":"2023-11-04T01:42:25.504494+0000","last_clean":"2023-11-04T01:42:25.504494+0000","last_became_active":"2023-11-04T01:42:24.535597+0000","last_became_peered":"2023-11-04T01:42:24.535597+0000","last_unstale":"2023-11-04T01:42:25.504494+0000","last_undegraded":"2023-11-04T01:42:25.504494+0000","last_fullsized":"2023-11-04T01:42:25.504494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:09.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507312+0000","last_change":"2023-11-04T01:42:23.854629+0000","last_active":"2023-11-04T01:42:25.507312+0000","last_peered":"2023-11-04T01:42:25.507312+0000","last_clean":"2023-11-04T01:42:25.507312+0000","last_became_active":"2023-11-04T01:42:23.854209+0000","last_became_peered":"2023-11-04T01:42:23.854209+0000","last_unstale":"2023-11-04T01:42:25.507312+0000","last_undegraded":"2023-11-04T01:42:25.507312+0000","last_fullsized":"2023-11-04T01:42:25.507312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572788+0000","last_change":"2023-11-04T01:42:23.871583+0000","last_active":"2023-11-04T01:42:25.572788+0000","last_peered":"2023-11-04T01:42:25.572788+0000","last_clean":"2023-11-04T01:42:25.572788+0000","last_became_active":"2023-11-04T01:42:23.870753+0000","last_became_peered":"2023-11-04T01:42:23.870753+0000","last_unstale":"2023-11-04T01:42:25.572788+0000","last_undegraded":"2023-11-04T01:42:25.572788+0000","last_fullsized":"2023-11-04T01:42:25.572788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:45.998097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.542631+0000","last_change":"2023-11-04T01:42:24.527244+0000","last_active":"2023-11-04T01:42:24.542631+0000","last_peered":"2023-11-04T01:42:24.542631+0000","last_clean":"2023-11-04T01:42:24.542631+0000","last_became_active":"2023-11-04T01:42:24.526519+0000","last_became_peered":"2023-11-04T01:42:24.526519+0000","last_unstale":"2023-11-04T01:42:24.542631+0000","last_undegraded":"2023-11-04T01:42:24.542631+0000","last_fullsized":"2023-11-04T01:42:24.542631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505615+0000","last_change":"2023-11-04T01:42:23.861230+0000","last_active":"2023-11-04T01:42:25.505615+0000","last_peered":"2023-11-04T01:42:25.505615+0000","last_clean":"2023-11-04T01:42:25.505615+0000","last_became_active":"2023-11-04T01:42:23.859784+0000","last_became_peered":"2023-11-04T01:42:23.859784+0000","last_unstale":"2023-11-04T01:42:25.505615+0000","last_undegraded":"2023-11-04T01:42:25.505615+0000","last_fullsized":"2023-11-04T01:42:25.505615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:43.619572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504003+0000","last_change":"2023-11-04T01:42:24.524254+0000","last_active":"2023-11-04T01:42:25.504003+0000","last_peered":"2023-11-04T01:42:25.504003+0000","last_clean":"2023-11-04T01:42:25.504003+0000","last_became_active":"2023-11-04T01:42:24.523478+0000","last_became_peered":"2023-11-04T01:42:24.523478+0000","last_unstale":"2023-11-04T01:42:25.504003+0000","last_undegraded":"2023-11-04T01:42:25.504003+0000","last_fullsized":"2023-11-04T01:42:25.504003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:49.878595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.497603+0000","last_change":"2023-11-04T01:42:23.872649+0000","last_active":"2023-11-04T01:42:24.497603+0000","last_peered":"2023-11-04T01:42:24.497603+0000","last_clean":"2023-11-04T01:42:24.497603+0000","last_became_active":"2023-11-04T01:42:23.872297+0000","last_became_peered":"2023-11-04T01:42:23.872297+0000","last_unstale":"2023-11-04T01:42:24.497603+0000","last_undegraded":"2023-11-04T01:42:24.497603+0000","last_fullsized":"2023-11-04T01:42:24.497603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553300+0000","last_change":"2023-11-04T01:42:24.530263+0000","last_active":"2023-11-04T01:42:24.553300+0000","last_peered":"2023-11-04T01:42:24.553300+0000","last_clean":"2023-11-04T01:42:24.553300+0000","last_became_active":"2023-11-04T01:42:24.529507+0000","last_became_peered":"2023-11-04T01:42:24.529507+0000","last_unstale":"2023-11-04T01:42:24.553300+0000","last_undegraded":"2023-11-04T01:42:24.553300+0000","last_fullsized":"2023-11-04T01:42:24.553300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508023+0000","last_change":"2023-11-04T01:42:23.873814+0000","last_active":"2023-11-04T01:42:25.508023+0000","last_peered":"2023-11-04T01:42:25.508023+0000","last_clean":"2023-11-04T01:42:25.508023+0000","last_became_active":"2023-11-04T01:42:23.873404+0000","last_became_peered":"2023-11-04T01:42:23.873404+0000","last_unstale":"2023-11-04T01:42:25.508023+0000","last_undegraded":"2023-11-04T01:42:25.508023+0000","last_fullsized":"2023-11-04T01:42:25.508023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:21.679291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543396+0000","last_change":"2023-11-04T01:42:24.534026+0000","last_active":"2023-11-04T01:42:24.543396+0000","last_peered":"2023-11-04T01:42:24.543396+0000","last_clean":"2023-11-04T01:42:24.543396+0000","last_became_active":"2023-11-04T01:42:24.533338+0000","last_became_peered":"2023-11-04T01:42:24.533338+0000","last_unstale":"2023-11-04T01:42:24.543396+0000","last_undegraded":"2023-11-04T01:42:24.543396+0000","last_fullsized":"2023-11-04T01:42:24.543396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:50.563897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.884338+0000","last_change":"2023-11-04T01:42:23.872021+0000","last_active":"2023-11-04T01:42:24.884338+0000","last_peered":"2023-11-04T01:42:24.884338+0000","last_clean":"2023-11-04T01:42:24.884338+0000","last_became_active":"2023-11-04T01:42:23.870751+0000","last_became_peered":"2023-11-04T01:42:23.870751+0000","last_unstale":"2023-11-04T01:42:24.884338+0000","last_undegraded":"2023-11-04T01:42:24.884338+0000","last_fullsized":"2023-11-04T01:42:24.884338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.620945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506411+0000","last_change":"2023-11-04T01:42:24.546924+0000","last_active":"2023-11-04T01:42:25.506411+0000","last_peered":"2023-11-04T01:42:25.506411+0000","last_clean":"2023-11-04T01:42:25.506411+0000","last_became_active":"2023-11-04T01:42:24.546318+0000","last_became_peered":"2023-11-04T01:42:24.546318+0000","last_unstale":"2023-11-04T01:42:25.506411+0000","last_undegraded":"2023-11-04T01:42:25.506411+0000","last_fullsized":"2023-11-04T01:42:25.506411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:48.887573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.893734+0000","last_change":"2023-11-04T01:42:23.872849+0000","last_active":"2023-11-04T01:42:24.893734+0000","last_peered":"2023-11-04T01:42:24.893734+0000","last_clean":"2023-11-04T01:42:24.893734+0000","last_became_active":"2023-11-04T01:42:23.872394+0000","last_became_peered":"2023-11-04T01:42:23.872394+0000","last_unstale":"2023-11-04T01:42:24.893734+0000","last_undegraded":"2023-11-04T01:42:24.893734+0000","last_fullsized":"2023-11-04T01:42:24.893734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508459+0000","last_change":"2023-11-04T01:42:24.525307+0000","last_active":"2023-11-04T01:42:25.508459+0000","last_peered":"2023-11-04T01:42:25.508459+0000","last_clean":"2023-11-04T01:42:25.508459+0000","last_became_active":"2023-11-04T01:42:24.522877+0000","last_became_peered":"2023-11-04T01:42:24.522877+0000","last_unstale":"2023-11-04T01:42:25.508459+0000","last_undegraded":"2023-11-04T01:42:25.508459+0000","last_fullsized":"2023-11-04T01:42:25.508459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887748+0000","last_change":"2023-11-04T01:42:23.878097+0000","last_active":"2023-11-04T01:42:24.887748+0000","last_peered":"2023-11-04T01:42:24.887748+0000","last_clean":"2023-11-04T01:42:24.887748+0000","last_became_active":"2023-11-04T01:42:23.877265+0000","last_became_peered":"2023-11-04T01:42:23.877265+0000","last_unstale":"2023-11-04T01:42:24.887748+0000","last_undegraded":"2023-11-04T01:42:24.887748+0000","last_fullsized":"2023-11-04T01:42:24.887748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:22.344804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573080+0000","last_change":"2023-11-04T01:42:24.546728+0000","last_active":"2023-11-04T01:42:25.573080+0000","last_peered":"2023-11-04T01:42:25.573080+0000","last_clean":"2023-11-04T01:42:25.573080+0000","last_became_active":"2023-11-04T01:42:24.545946+0000","last_became_peered":"2023-11-04T01:42:24.545946+0000","last_unstale":"2023-11-04T01:42:25.573080+0000","last_undegraded":"2023-11-04T01:42:25.573080+0000","last_fullsized":"2023-11-04T01:42:25.573080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506789+0000","last_change":"2023-11-04T01:42:23.875211+0000","last_active":"2023-11-04T01:42:25.506789+0000","last_peered":"2023-11-04T01:42:25.506789+0000","last_clean":"2023-11-04T01:42:25.506789+0000","last_became_active":"2023-11-04T01:42:23.874649+0000","last_became_peered":"2023-11-04T01:42:23.874649+0000","last_unstale":"2023-11-04T01:42:25.506789+0000","last_undegraded":"2023-11-04T01:42:25.506789+0000","last_fullsized":"2023-11-04T01:42:25.506789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506005+0000","last_change":"2023-11-04T01:42:24.557710+0000","last_active":"2023-11-04T01:42:25.506005+0000","last_peered":"2023-11-04T01:42:25.506005+0000","last_clean":"2023-11-04T01:42:25.506005+0000","last_became_active":"2023-11-04T01:42:24.557097+0000","last_became_peered":"2023-11-04T01:42:24.557097+0000","last_unstale":"2023-11-04T01:42:25.506005+0000","last_undegraded":"2023-11-04T01:42:25.506005+0000","last_fullsized":"2023-11-04T01:42:25.506005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:07.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507961+0000","last_change":"2023-11-04T01:42:23.858376+0000","last_active":"2023-11-04T01:42:25.507961+0000","last_peered":"2023-11-04T01:42:25.507961+0000","last_clean":"2023-11-04T01:42:25.507961+0000","last_became_active":"2023-11-04T01:42:23.856424+0000","last_became_peered":"2023-11-04T01:42:23.856424+0000","last_unstale":"2023-11-04T01:42:25.507961+0000","last_undegraded":"2023-11-04T01:42:25.507961+0000","last_fullsized":"2023-11-04T01:42:25.507961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:49.553266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552117+0000","last_change":"2023-11-04T01:42:24.529593+0000","last_active":"2023-11-04T01:42:24.552117+0000","last_peered":"2023-11-04T01:42:24.552117+0000","last_clean":"2023-11-04T01:42:24.552117+0000","last_became_active":"2023-11-04T01:42:24.528834+0000","last_became_peered":"2023-11-04T01:42:24.528834+0000","last_unstale":"2023-11-04T01:42:24.552117+0000","last_undegraded":"2023-11-04T01:42:24.552117+0000","last_fullsized":"2023-11-04T01:42:24.552117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:14.623927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503660+0000","last_change":"2023-11-04T01:42:23.878725+0000","last_active":"2023-11-04T01:42:25.503660+0000","last_peered":"2023-11-04T01:42:25.503660+0000","last_clean":"2023-11-04T01:42:25.503660+0000","last_became_active":"2023-11-04T01:42:23.877930+0000","last_became_peered":"2023-11-04T01:42:23.877930+0000","last_unstale":"2023-11-04T01:42:25.503660+0000","last_undegraded":"2023-11-04T01:42:25.503660+0000","last_fullsized":"2023-11-04T01:42:25.503660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:52.439183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505874+0000","last_change":"2023-11-04T01:42:24.545238+0000","last_active":"2023-11-04T01:42:25.505874+0000","last_peered":"2023-11-04T01:42:25.505874+0000","last_clean":"2023-11-04T01:42:25.505874+0000","last_became_active":"2023-11-04T01:42:24.544606+0000","last_became_peered":"2023-11-04T01:42:24.544606+0000","last_unstale":"2023-11-04T01:42:25.505874+0000","last_undegraded":"2023-11-04T01:42:25.505874+0000","last_fullsized":"2023-11-04T01:42:25.505874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.509259+0000","last_change":"2023-11-04T01:42:23.889452+0000","last_active":"2023-11-04T01:42:25.509259+0000","last_peered":"2023-11-04T01:42:25.509259+0000","last_clean":"2023-11-04T01:42:25.509259+0000","last_became_active":"2023-11-04T01:42:23.889046+0000","last_became_peered":"2023-11-04T01:42:23.889046+0000","last_unstale":"2023-11-04T01:42:25.509259+0000","last_undegraded":"2023-11-04T01:42:25.509259+0000","last_fullsized":"2023-11-04T01:42:25.509259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.561776+0000","last_change":"2023-11-04T01:42:24.560710+0000","last_active":"2023-11-04T01:42:24.561776+0000","last_peered":"2023-11-04T01:42:24.561776+0000","last_clean":"2023-11-04T01:42:24.561776+0000","last_became_active":"2023-11-04T01:42:24.560051+0000","last_became_peered":"2023-11-04T01:42:24.560051+0000","last_unstale":"2023-11-04T01:42:24.561776+0000","last_undegraded":"2023-11-04T01:42:24.561776+0000","last_fullsized":"2023-11-04T01:42:24.561776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:14.623927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504630+0000","last_change":"2023-11-04T01:42:23.892535+0000","last_active":"2023-11-04T01:42:25.504630+0000","last_peered":"2023-11-04T01:42:25.504630+0000","last_clean":"2023-11-04T01:42:25.504630+0000","last_became_active":"2023-11-04T01:42:23.891942+0000","last_became_peered":"2023-11-04T01:42:23.891942+0000","last_unstale":"2023-11-04T01:42:25.504630+0000","last_undegraded":"2023-11-04T01:42:25.504630+0000","last_fullsized":"2023-11-04T01:42:25.504630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:28.817061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508895+0000","last_change":"2023-11-04T01:42:24.555641+0000","last_active":"2023-11-04T01:42:25.508895+0000","last_peered":"2023-11-04T01:42:25.508895+0000","last_clean":"2023-11-04T01:42:25.508895+0000","last_became_active":"2023-11-04T01:42:24.554641+0000","last_became_peered":"2023-11-04T01:42:24.554641+0000","last_unstale":"2023-11-04T01:42:25.508895+0000","last_undegraded":"2023-11-04T01:42:25.508895+0000","last_fullsized":"2023-11-04T01:42:25.508895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.886886+0000","last_change":"2023-11-04T01:42:23.879946+0000","last_active":"2023-11-04T01:42:24.886886+0000","last_peered":"2023-11-04T01:42:24.886886+0000","last_clean":"2023-11-04T01:42:24.886886+0000","last_became_active":"2023-11-04T01:42:23.879106+0000","last_became_peered":"2023-11-04T01:42:23.879106+0000","last_unstale":"2023-11-04T01:42:24.886886+0000","last_undegraded":"2023-11-04T01:42:24.886886+0000","last_fullsized":"2023-11-04T01:42:24.886886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:56.805776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508541+0000","last_change":"2023-11-04T01:42:24.535305+0000","last_active":"2023-11-04T01:42:25.508541+0000","last_peered":"2023-11-04T01:42:25.508541+0000","last_clean":"2023-11-04T01:42:25.508541+0000","last_became_active":"2023-11-04T01:42:24.534392+0000","last_became_peered":"2023-11-04T01:42:24.534392+0000","last_unstale":"2023-11-04T01:42:25.508541+0000","last_undegraded":"2023-11-04T01:42:25.508541+0000","last_fullsized":"2023-11-04T01:42:25.508541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573731+0000","last_change":"2023-11-04T01:42:23.859651+0000","last_active":"2023-11-04T01:42:25.573731+0000","last_peered":"2023-11-04T01:42:25.573731+0000","last_clean":"2023-11-04T01:42:25.573731+0000","last_became_active":"2023-11-04T01:42:23.858848+0000","last_became_peered":"2023-11-04T01:42:23.858848+0000","last_unstale":"2023-11-04T01:42:25.573731+0000","last_undegraded":"2023-11-04T01:42:25.573731+0000","last_fullsized":"2023-11-04T01:42:25.573731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506723+0000","last_change":"2023-11-04T01:42:24.542701+0000","last_active":"2023-11-04T01:42:25.506723+0000","last_peered":"2023-11-04T01:42:25.506723+0000","last_clean":"2023-11-04T01:42:25.506723+0000","last_became_active":"2023-11-04T01:42:24.541785+0000","last_became_peered":"2023-11-04T01:42:24.541785+0000","last_unstale":"2023-11-04T01:42:25.506723+0000","last_undegraded":"2023-11-04T01:42:25.506723+0000","last_fullsized":"2023-11-04T01:42:25.506723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:54.044840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T01:42:23.844020+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:42:23.844020+0000","last_peered":"2023-11-04T01:42:23.844020+0000","last_clean":"2023-11-04T01:42:23.844020+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:42:23.844020+0000","last_undegraded":"2023-11-04T01:42:23.844020+0000","last_fullsized":"2023-11-04T01:42:23.844020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506303+0000","last_change":"2023-11-04T01:42:23.870050+0000","last_active":"2023-11-04T01:42:25.506303+0000","last_peered":"2023-11-04T01:42:25.506303+0000","last_clean":"2023-11-04T01:42:25.506303+0000","last_became_active":"2023-11-04T01:42:23.868558+0000","last_became_peered":"2023-11-04T01:42:23.868558+0000","last_unstale":"2023-11-04T01:42:25.506303+0000","last_undegraded":"2023-11-04T01:42:25.506303+0000","last_fullsized":"2023-11-04T01:42:25.506303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504592+0000","last_change":"2023-11-04T01:42:24.515619+0000","last_active":"2023-11-04T01:42:25.504592+0000","last_peered":"2023-11-04T01:42:25.504592+0000","last_clean":"2023-11-04T01:42:25.504592+0000","last_became_active":"2023-11-04T01:42:24.514861+0000","last_became_peered":"2023-11-04T01:42:24.514861+0000","last_unstale":"2023-11-04T01:42:25.504592+0000","last_undegraded":"2023-11-04T01:42:25.504592+0000","last_fullsized":"2023-11-04T01:42:25.504592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:12.327963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505707+0000","last_change":"2023-11-04T01:42:23.889363+0000","last_active":"2023-11-04T01:42:25.505707+0000","last_peered":"2023-11-04T01:42:25.505707+0000","last_clean":"2023-11-04T01:42:25.505707+0000","last_became_active":"2023-11-04T01:42:23.888990+0000","last_became_peered":"2023-11-04T01:42:23.888990+0000","last_unstale":"2023-11-04T01:42:25.505707+0000","last_undegraded":"2023-11-04T01:42:25.505707+0000","last_fullsized":"2023-11-04T01:42:25.505707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572945+0000","last_change":"2023-11-04T01:42:24.544491+0000","last_active":"2023-11-04T01:42:25.572945+0000","last_peered":"2023-11-04T01:42:25.572945+0000","last_clean":"2023-11-04T01:42:25.572945+0000","last_became_active":"2023-11-04T01:42:24.543670+0000","last_became_peered":"2023-11-04T01:42:24.543670+0000","last_unstale":"2023-11-04T01:42:25.572945+0000","last_undegraded":"2023-11-04T01:42:25.572945+0000","last_fullsized":"2023-11-04T01:42:25.572945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.510207+0000","last_change":"2023-11-04T01:42:23.887645+0000","last_active":"2023-11-04T01:42:24.510207+0000","last_peered":"2023-11-04T01:42:24.510207+0000","last_clean":"2023-11-04T01:42:24.510207+0000","last_became_active":"2023-11-04T01:42:23.887066+0000","last_became_peered":"2023-11-04T01:42:23.887066+0000","last_unstale":"2023-11-04T01:42:24.510207+0000","last_undegraded":"2023-11-04T01:42:24.510207+0000","last_fullsized":"2023-11-04T01:42:24.510207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:14.860163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543580+0000","last_change":"2023-11-04T01:42:24.530872+0000","last_active":"2023-11-04T01:42:24.543580+0000","last_peered":"2023-11-04T01:42:24.543580+0000","last_clean":"2023-11-04T01:42:24.543580+0000","last_became_active":"2023-11-04T01:42:24.529785+0000","last_became_peered":"2023-11-04T01:42:24.529785+0000","last_unstale":"2023-11-04T01:42:24.543580+0000","last_undegraded":"2023-11-04T01:42:24.543580+0000","last_fullsized":"2023-11-04T01:42:24.543580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:05.406379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507010+0000","last_change":"2023-11-04T01:42:23.864470+0000","last_active":"2023-11-04T01:42:25.507010+0000","last_peered":"2023-11-04T01:42:25.507010+0000","last_clean":"2023-11-04T01:42:25.507010+0000","last_became_active":"2023-11-04T01:42:23.864049+0000","last_became_peered":"2023-11-04T01:42:23.864049+0000","last_unstale":"2023-11-04T01:42:25.507010+0000","last_undegraded":"2023-11-04T01:42:25.507010+0000","last_fullsized":"2023-11-04T01:42:25.507010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508539+0000","last_change":"2023-11-04T01:42:24.547297+0000","last_active":"2023-11-04T01:42:25.508539+0000","last_peered":"2023-11-04T01:42:25.508539+0000","last_clean":"2023-11-04T01:42:25.508539+0000","last_became_active":"2023-11-04T01:42:24.546593+0000","last_became_peered":"2023-11-04T01:42:24.546593+0000","last_unstale":"2023-11-04T01:42:25.508539+0000","last_undegraded":"2023-11-04T01:42:25.508539+0000","last_fullsized":"2023-11-04T01:42:25.508539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.509613+0000","last_change":"2023-11-04T01:42:23.881220+0000","last_active":"2023-11-04T01:42:24.509613+0000","last_peered":"2023-11-04T01:42:24.509613+0000","last_clean":"2023-11-04T01:42:24.509613+0000","last_became_active":"2023-11-04T01:42:23.880569+0000","last_became_peered":"2023-11-04T01:42:23.880569+0000","last_unstale":"2023-11-04T01:42:24.509613+0000","last_undegraded":"2023-11-04T01:42:24.509613+0000","last_fullsized":"2023-11-04T01:42:24.509613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553251+0000","last_change":"2023-11-04T01:42:24.544821+0000","last_active":"2023-11-04T01:42:24.553251+0000","last_peered":"2023-11-04T01:42:24.553251+0000","last_clean":"2023-11-04T01:42:24.553251+0000","last_became_active":"2023-11-04T01:42:24.544158+0000","last_became_peered":"2023-11-04T01:42:24.544158+0000","last_unstale":"2023-11-04T01:42:24.553251+0000","last_undegraded":"2023-11-04T01:42:24.553251+0000","last_fullsized":"2023-11-04T01:42:24.553251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507284+0000","last_change":"2023-11-04T01:42:23.867710+0000","last_active":"2023-11-04T01:42:25.507284+0000","last_peered":"2023-11-04T01:42:25.507284+0000","last_clean":"2023-11-04T01:42:25.507284+0000","last_became_active":"2023-11-04T01:42:23.867162+0000","last_became_peered":"2023-11-04T01:42:23.867162+0000","last_unstale":"2023-11-04T01:42:25.507284+0000","last_undegraded":"2023-11-04T01:42:25.507284+0000","last_fullsized":"2023-11-04T01:42:25.507284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:48.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573619+0000","last_change":"2023-11-04T01:42:24.529944+0000","last_active":"2023-11-04T01:42:25.573619+0000","last_peered":"2023-11-04T01:42:25.573619+0000","last_clean":"2023-11-04T01:42:25.573619+0000","last_became_active":"2023-11-04T01:42:24.528837+0000","last_became_peered":"2023-11-04T01:42:24.528837+0000","last_unstale":"2023-11-04T01:42:25.573619+0000","last_undegraded":"2023-11-04T01:42:25.573619+0000","last_fullsized":"2023-11-04T01:42:25.573619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.261927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504841+0000","last_change":"2023-11-04T01:42:23.871604+0000","last_active":"2023-11-04T01:42:25.504841+0000","last_peered":"2023-11-04T01:42:25.504841+0000","last_clean":"2023-11-04T01:42:25.504841+0000","last_became_active":"2023-11-04T01:42:23.870746+0000","last_became_peered":"2023-11-04T01:42:23.870746+0000","last_unstale":"2023-11-04T01:42:25.504841+0000","last_undegraded":"2023-11-04T01:42:25.504841+0000","last_fullsized":"2023-11-04T01:42:25.504841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:22.043685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504543+0000","last_change":"2023-11-04T01:42:24.520352+0000","last_active":"2023-11-04T01:42:25.504543+0000","last_peered":"2023-11-04T01:42:25.504543+0000","last_clean":"2023-11-04T01:42:25.504543+0000","last_became_active":"2023-11-04T01:42:24.519515+0000","last_became_peered":"2023-11-04T01:42:24.519515+0000","last_unstale":"2023-11-04T01:42:25.504543+0000","last_undegraded":"2023-11-04T01:42:25.504543+0000","last_fullsized":"2023-11-04T01:42:25.504543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:31.963568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506869+0000","last_change":"2023-11-04T01:42:23.856440+0000","last_active":"2023-11-04T01:42:25.506869+0000","last_peered":"2023-11-04T01:42:25.506869+0000","last_clean":"2023-11-04T01:42:25.506869+0000","last_became_active":"2023-11-04T01:42:23.856067+0000","last_became_peered":"2023-11-04T01:42:23.856067+0000","last_unstale":"2023-11-04T01:42:25.506869+0000","last_undegraded":"2023-11-04T01:42:25.506869+0000","last_fullsized":"2023-11-04T01:42:25.506869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:21.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504391+0000","last_change":"2023-11-04T01:42:24.530290+0000","last_active":"2023-11-04T01:42:25.504391+0000","last_peered":"2023-11-04T01:42:25.504391+0000","last_clean":"2023-11-04T01:42:25.504391+0000","last_became_active":"2023-11-04T01:42:24.529568+0000","last_became_peered":"2023-11-04T01:42:24.529568+0000","last_unstale":"2023-11-04T01:42:25.504391+0000","last_undegraded":"2023-11-04T01:42:25.504391+0000","last_fullsized":"2023-11-04T01:42:25.504391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:42.384938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508823+0000","last_change":"2023-11-04T01:42:23.867463+0000","last_active":"2023-11-04T01:42:25.508823+0000","last_peered":"2023-11-04T01:42:25.508823+0000","last_clean":"2023-11-04T01:42:25.508823+0000","last_became_active":"2023-11-04T01:42:23.865925+0000","last_became_peered":"2023-11-04T01:42:23.865925+0000","last_unstale":"2023-11-04T01:42:25.508823+0000","last_undegraded":"2023-11-04T01:42:25.508823+0000","last_fullsized":"2023-11-04T01:42:25.508823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:29.802796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506042+0000","last_change":"2023-11-04T01:42:24.532587+0000","last_active":"2023-11-04T01:42:25.506042+0000","last_peered":"2023-11-04T01:42:25.506042+0000","last_clean":"2023-11-04T01:42:25.506042+0000","last_became_active":"2023-11-04T01:42:24.531827+0000","last_became_peered":"2023-11-04T01:42:24.531827+0000","last_unstale":"2023-11-04T01:42:25.506042+0000","last_undegraded":"2023-11-04T01:42:25.506042+0000","last_fullsized":"2023-11-04T01:42:25.506042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:09.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504135+0000","last_change":"2023-11-04T01:42:23.871960+0000","last_active":"2023-11-04T01:42:25.504135+0000","last_peered":"2023-11-04T01:42:25.504135+0000","last_clean":"2023-11-04T01:42:25.504135+0000","last_became_active":"2023-11-04T01:42:23.871205+0000","last_became_peered":"2023-11-04T01:42:23.871205+0000","last_unstale":"2023-11-04T01:42:25.504135+0000","last_undegraded":"2023-11-04T01:42:25.504135+0000","last_fullsized":"2023-11-04T01:42:25.504135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:33:54.986696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503773+0000","last_change":"2023-11-04T01:42:24.531520+0000","last_active":"2023-11-04T01:42:25.503773+0000","last_peered":"2023-11-04T01:42:25.503773+0000","last_clean":"2023-11-04T01:42:25.503773+0000","last_became_active":"2023-11-04T01:42:24.530762+0000","last_became_peered":"2023-11-04T01:42:24.530762+0000","last_unstale":"2023-11-04T01:42:25.503773+0000","last_undegraded":"2023-11-04T01:42:25.503773+0000","last_fullsized":"2023-11-04T01:42:25.503773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.137518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573320+0000","last_change":"2023-11-04T01:42:23.887853+0000","last_active":"2023-11-04T01:42:25.573320+0000","last_peered":"2023-11-04T01:42:25.573320+0000","last_clean":"2023-11-04T01:42:25.573320+0000","last_became_active":"2023-11-04T01:42:23.886915+0000","last_became_peered":"2023-11-04T01:42:23.886915+0000","last_unstale":"2023-11-04T01:42:25.573320+0000","last_undegraded":"2023-11-04T01:42:25.573320+0000","last_fullsized":"2023-11-04T01:42:25.573320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:25.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.539674+0000","last_change":"2023-11-04T01:42:24.528548+0000","last_active":"2023-11-04T01:42:24.539674+0000","last_peered":"2023-11-04T01:42:24.539674+0000","last_clean":"2023-11-04T01:42:24.539674+0000","last_became_active":"2023-11-04T01:42:24.527750+0000","last_became_peered":"2023-11-04T01:42:24.527750+0000","last_unstale":"2023-11-04T01:42:24.539674+0000","last_undegraded":"2023-11-04T01:42:24.539674+0000","last_fullsized":"2023-11-04T01:42:24.539674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:13.583907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506105+0000","last_change":"2023-11-04T01:42:23.865890+0000","last_active":"2023-11-04T01:42:25.506105+0000","last_peered":"2023-11-04T01:42:25.506105+0000","last_clean":"2023-11-04T01:42:25.506105+0000","last_became_active":"2023-11-04T01:42:23.865503+0000","last_became_peered":"2023-11-04T01:42:23.865503+0000","last_unstale":"2023-11-04T01:42:25.506105+0000","last_undegraded":"2023-11-04T01:42:25.506105+0000","last_fullsized":"2023-11-04T01:42:25.506105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:05.380495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506285+0000","last_change":"2023-11-04T01:42:24.527953+0000","last_active":"2023-11-04T01:42:25.506285+0000","last_peered":"2023-11-04T01:42:25.506285+0000","last_clean":"2023-11-04T01:42:25.506285+0000","last_became_active":"2023-11-04T01:42:24.527112+0000","last_became_peered":"2023-11-04T01:42:24.527112+0000","last_unstale":"2023-11-04T01:42:25.506285+0000","last_undegraded":"2023-11-04T01:42:25.506285+0000","last_fullsized":"2023-11-04T01:42:25.506285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:04.559600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507122+0000","last_change":"2023-11-04T01:42:24.560200+0000","last_active":"2023-11-04T01:42:25.507122+0000","last_peered":"2023-11-04T01:42:25.507122+0000","last_clean":"2023-11-04T01:42:25.507122+0000","last_became_active":"2023-11-04T01:42:24.559286+0000","last_became_peered":"2023-11-04T01:42:24.559286+0000","last_unstale":"2023-11-04T01:42:25.507122+0000","last_undegraded":"2023-11-04T01:42:25.507122+0000","last_fullsized":"2023-11-04T01:42:25.507122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:48.678049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508726+0000","last_change":"2023-11-04T01:42:23.875613+0000","last_active":"2023-11-04T01:42:25.508726+0000","last_peered":"2023-11-04T01:42:25.508726+0000","last_clean":"2023-11-04T01:42:25.508726+0000","last_became_active":"2023-11-04T01:42:23.875339+0000","last_became_peered":"2023-11-04T01:42:23.875339+0000","last_unstale":"2023-11-04T01:42:25.508726+0000","last_undegraded":"2023-11-04T01:42:25.508726+0000","last_fullsized":"2023-11-04T01:42:25.508726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552630+0000","last_change":"2023-11-04T01:42:24.541588+0000","last_active":"2023-11-04T01:42:24.552630+0000","last_peered":"2023-11-04T01:42:24.552630+0000","last_clean":"2023-11-04T01:42:24.552630+0000","last_became_active":"2023-11-04T01:42:24.536601+0000","last_became_peered":"2023-11-04T01:42:24.536601+0000","last_unstale":"2023-11-04T01:42:24.552630+0000","last_undegraded":"2023-11-04T01:42:24.552630+0000","last_fullsized":"2023-11-04T01:42:24.552630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508450+0000","last_change":"2023-11-04T01:42:23.873370+0000","last_active":"2023-11-04T01:42:25.508450+0000","last_peered":"2023-11-04T01:42:25.508450+0000","last_clean":"2023-11-04T01:42:25.508450+0000","last_became_active":"2023-11-04T01:42:23.873081+0000","last_became_peered":"2023-11-04T01:42:23.873081+0000","last_unstale":"2023-11-04T01:42:25.508450+0000","last_undegraded":"2023-11-04T01:42:25.508450+0000","last_fullsized":"2023-11-04T01:42:25.508450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544681+0000","last_change":"2023-11-04T01:42:24.540046+0000","last_active":"2023-11-04T01:42:24.544681+0000","last_peered":"2023-11-04T01:42:24.544681+0000","last_clean":"2023-11-04T01:42:24.544681+0000","last_became_active":"2023-11-04T01:42:24.539286+0000","last_became_peered":"2023-11-04T01:42:24.539286+0000","last_unstale":"2023-11-04T01:42:24.544681+0000","last_undegraded":"2023-11-04T01:42:24.544681+0000","last_fullsized":"2023-11-04T01:42:24.544681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887064+0000","last_change":"2023-11-04T01:42:23.879421+0000","last_active":"2023-11-04T01:42:24.887064+0000","last_peered":"2023-11-04T01:42:24.887064+0000","last_clean":"2023-11-04T01:42:24.887064+0000","last_became_active":"2023-11-04T01:42:23.874688+0000","last_became_peered":"2023-11-04T01:42:23.874688+0000","last_unstale":"2023-11-04T01:42:24.887064+0000","last_undegraded":"2023-11-04T01:42:24.887064+0000","last_fullsized":"2023-11-04T01:42:24.887064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546550+0000","last_change":"2023-11-04T01:42:24.544559+0000","last_active":"2023-11-04T01:42:24.546550+0000","last_peered":"2023-11-04T01:42:24.546550+0000","last_clean":"2023-11-04T01:42:24.546550+0000","last_became_active":"2023-11-04T01:42:24.543895+0000","last_became_peered":"2023-11-04T01:42:24.543895+0000","last_unstale":"2023-11-04T01:42:24.546550+0000","last_undegraded":"2023-11-04T01:42:24.546550+0000","last_fullsized":"2023-11-04T01:42:24.546550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504779+0000","last_change":"2023-11-04T01:42:23.868589+0000","last_active":"2023-11-04T01:42:25.504779+0000","last_peered":"2023-11-04T01:42:25.504779+0000","last_clean":"2023-11-04T01:42:25.504779+0000","last_became_active":"2023-11-04T01:42:23.867572+0000","last_became_peered":"2023-11-04T01:42:23.867572+0000","last_unstale":"2023-11-04T01:42:25.504779+0000","last_undegraded":"2023-11-04T01:42:25.504779+0000","last_fullsized":"2023-11-04T01:42:25.504779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:13.960345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":794624,"data_stored":657193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":73111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1150000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5549999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":657215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":200704,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":68367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:32.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:32.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.511+0000 7faf43e1e640 1 Processor -- start 2023-11-04T01:42:32.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.511+0000 7faf43e1e640 1 -- start start 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf43e1e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf3c0b1960 0x7faf3c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf43e1e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c15cd60 0x7faf3c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf43e1e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0cdc80 con 0x7faf3c0b1d40 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf43e1e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c071e40 con 0x7faf3c0b1960 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf43e1e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15d730 con 0x7faf3c15cd60 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf3c0b1960 0x7faf3c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf3c0b1960 0x7faf3c0cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49596/0 (socket says 172.21.15.2:49596) 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 -- 172.21.15.2:0/882892750 learned_addr learned my addr 172.21.15.2:0/882892750 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:32.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf423bb640 1 --2- 172.21.15.2:0/882892750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c15cd60 0x7faf3c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 -- 172.21.15.2:0/882892750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c15cd60 msgr2=0x7faf3c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 --2- 172.21.15.2:0/882892750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c15cd60 0x7faf3c15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 -- 172.21.15.2:0/882892750 >> v1:172.21.15.90:6789/0 conn(0x7faf3c0b1d40 legacy=0x7faf3c0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 -- 172.21.15.2:0/882892750 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0cf5a0 con 0x7faf3c0b1960 2023-11-04T01:42:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.515+0000 7faf41bba640 1 --2- 172.21.15.2:0/882892750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0cd740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf24009870 tx=0x7faf2401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a51b085c91f48c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf40bb8640 1 -- 172.21.15.2:0/882892750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240aa670 con 0x7faf3c0b1960 2023-11-04T01:42:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf40bb8640 1 -- 172.21.15.2:0/882892750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240aa7d0 con 0x7faf3c0b1960 2023-11-04T01:42:32.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf40bb8640 1 -- 172.21.15.2:0/882892750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240aab60 con 0x7faf3c0b1960 2023-11-04T01:42:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- 172.21.15.2:0/882892750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 msgr2=0x7faf3c0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 --2- 172.21.15.2:0/882892750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0cd740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf24009870 tx=0x7faf2401c510 comp rx=0 tx=0).stop 2023-11-04T01:42:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- 172.21.15.2:0/882892750 shutdown_connections 2023-11-04T01:42:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 --2- 172.21.15.2:0/882892750 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c15cd60 0x7faf3c15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 --2- 172.21.15.2:0/882892750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0cd740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- 172.21.15.2:0/882892750 >> 172.21.15.2:0/882892750 conn(0x7faf3c06e760 msgr2=0x7faf3c06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- 172.21.15.2:0/882892750 shutdown_connections 2023-11-04T01:42:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- 172.21.15.2:0/882892750 wait complete. 2023-11-04T01:42:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 Processor -- start 2023-11-04T01:42:32.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- start start 2023-11-04T01:42:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c0b1d40 0x7faf3c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf3c15cd60 0x7faf3c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c151760 con 0x7faf3c0b1960 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c150ae0 con 0x7faf3c15cd60 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf43e1e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c150dc0 con 0x7faf3c0b1d40 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49598/0 (socket says 172.21.15.2:49598) 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 -- 172.21.15.2:0/2826514288 learned_addr learned my addr 172.21.15.2:0/2826514288 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf413b9640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c0b1d40 0x7faf3c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 -- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c0b1d40 msgr2=0x7faf3c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c0b1d40 0x7faf3c14e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf423bb640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf3c15cd60 0x7faf3c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 -- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf3c15cd60 msgr2=0x7faf3c14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf3c15cd60 0x7faf3c14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 -- 172.21.15.2:0/2826514288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240094d0 con 0x7faf3c0b1960 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.519+0000 7faf41bba640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0afdc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf240ac040 tx=0x7faf2401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf3a7fc640 1 -- 172.21.15.2:0/2826514288 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240b3800 con 0x7faf3c0b1960 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf3a7fc640 1 -- 172.21.15.2:0/2826514288 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240b3980 con 0x7faf3c0b1960 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c1510a0 con 0x7faf3c0b1960 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf3a7fc640 1 -- 172.21.15.2:0/2826514288 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240b3d30 con 0x7faf3c0b1960 2023-11-04T01:42:32.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c151b80 con 0x7faf3c0b1960 2023-11-04T01:42:32.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c1518a0 con 0x7faf3c0b1960 2023-11-04T01:42:32.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf3a7fc640 1 -- 172.21.15.2:0/2826514288 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf240b2380 con 0x7faf3c0b1960 2023-11-04T01:42:32.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf3a7fc640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf1c0664a0 0x7faf1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf3a7fc640 1 -- 172.21.15.2:0/2826514288 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf2411e6f0 con 0x7faf3c0b1960 2023-11-04T01:42:32.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf413b9640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf1c0664a0 0x7faf1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.523+0000 7faf413b9640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf1c0664a0 0x7faf1c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf3c15b3f0 tx=0x7faf2c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.527+0000 7faf3a7fc640 1 -- 172.21.15.2:0/2826514288 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faf240ebc20 con 0x7faf3c0b1960 2023-11-04T01:42:32.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.683+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf3c0b2540 con 0x7faf1c0664a0 2023-11-04T01:42:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.703+0000 7faf3a7fc640 1 -- 172.21.15.2:0/2826514288 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264548 (secure 0 0 0) 0x7faf3c0b2540 con 0x7faf1c0664a0 2023-11-04T01:42:32.709 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:42:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf1c0664a0 msgr2=0x7faf1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf1c0664a0 0x7faf1c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf3c15b3f0 tx=0x7faf2c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 msgr2=0x7faf3c0afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0afdc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faf240ac040 tx=0x7faf2401ad50 comp rx=0 tx=0).stop 2023-11-04T01:42:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 shutdown_connections 2023-11-04T01:42:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf1c0664a0 0x7faf1c068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf3c15cd60 0x7faf3c14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf3c0b1d40 0x7faf3c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 --2- 172.21.15.2:0/2826514288 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf3c0b1960 0x7faf3c0afdc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 >> 172.21.15.2:0/2826514288 conn(0x7faf3c06e760 msgr2=0x7faf3c06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 shutdown_connections 2023-11-04T01:42:32.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.707+0000 7faf43e1e640 1 -- 172.21.15.2:0/2826514288 wait complete. 2023-11-04T01:42:32.726 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-04T01:42:30.760963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235572,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739148,"statfs":{"total":773094113280,"available":772852887552,"internally_reserved":0,"allocated":2818048,"data_stored":1723612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.924257"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508406+0000","last_change":"2023-11-04T01:42:24.537942+0000","last_active":"2023-11-04T01:42:25.508406+0000","last_peered":"2023-11-04T01:42:25.508406+0000","last_clean":"2023-11-04T01:42:25.508406+0000","last_became_active":"2023-11-04T01:42:24.537165+0000","last_became_peered":"2023-11-04T01:42:24.537165+0000","last_unstale":"2023-11-04T01:42:25.508406+0000","last_undegraded":"2023-11-04T01:42:25.508406+0000","last_fullsized":"2023-11-04T01:42:25.508406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:27.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538647+0000","last_change":"2023-11-04T01:42:24.526074+0000","last_active":"2023-11-04T01:42:24.538647+0000","last_peered":"2023-11-04T01:42:24.538647+0000","last_clean":"2023-11-04T01:42:24.538647+0000","last_became_active":"2023-11-04T01:42:24.525339+0000","last_became_peered":"2023-11-04T01:42:24.525339+0000","last_unstale":"2023-11-04T01:42:24.538647+0000","last_undegraded":"2023-11-04T01:42:24.538647+0000","last_fullsized":"2023-11-04T01:42:24.538647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543220+0000","last_change":"2023-11-04T01:42:24.532853+0000","last_active":"2023-11-04T01:42:24.543220+0000","last_peered":"2023-11-04T01:42:24.543220+0000","last_clean":"2023-11-04T01:42:24.543220+0000","last_became_active":"2023-11-04T01:42:24.531811+0000","last_became_peered":"2023-11-04T01:42:24.531811+0000","last_unstale":"2023-11-04T01:42:24.543220+0000","last_undegraded":"2023-11-04T01:42:24.543220+0000","last_fullsized":"2023-11-04T01:42:24.543220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553108+0000","last_change":"2023-11-04T01:42:24.532090+0000","last_active":"2023-11-04T01:42:24.553108+0000","last_peered":"2023-11-04T01:42:24.553108+0000","last_clean":"2023-11-04T01:42:24.553108+0000","last_became_active":"2023-11-04T01:42:24.531252+0000","last_became_peered":"2023-11-04T01:42:24.531252+0000","last_unstale":"2023-11-04T01:42:24.553108+0000","last_undegraded":"2023-11-04T01:42:24.553108+0000","last_fullsized":"2023-11-04T01:42:24.553108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508158+0000","last_change":"2023-11-04T01:42:24.555465+0000","last_active":"2023-11-04T01:42:25.508158+0000","last_peered":"2023-11-04T01:42:25.508158+0000","last_clean":"2023-11-04T01:42:25.508158+0000","last_became_active":"2023-11-04T01:42:24.554690+0000","last_became_peered":"2023-11-04T01:42:24.554690+0000","last_unstale":"2023-11-04T01:42:25.508158+0000","last_undegraded":"2023-11-04T01:42:25.508158+0000","last_fullsized":"2023-11-04T01:42:25.508158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:50.998381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553224+0000","last_change":"2023-11-04T01:42:24.532641+0000","last_active":"2023-11-04T01:42:24.553224+0000","last_peered":"2023-11-04T01:42:24.553224+0000","last_clean":"2023-11-04T01:42:24.553224+0000","last_became_active":"2023-11-04T01:42:24.531903+0000","last_became_peered":"2023-11-04T01:42:24.531903+0000","last_unstale":"2023-11-04T01:42:24.553224+0000","last_undegraded":"2023-11-04T01:42:24.553224+0000","last_fullsized":"2023-11-04T01:42:24.553224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508004+0000","last_change":"2023-11-04T01:42:24.534979+0000","last_active":"2023-11-04T01:42:25.508004+0000","last_peered":"2023-11-04T01:42:25.508004+0000","last_clean":"2023-11-04T01:42:25.508004+0000","last_became_active":"2023-11-04T01:42:24.534228+0000","last_became_peered":"2023-11-04T01:42:24.534228+0000","last_unstale":"2023-11-04T01:42:25.508004+0000","last_undegraded":"2023-11-04T01:42:25.508004+0000","last_fullsized":"2023-11-04T01:42:25.508004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:22.475674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543629+0000","last_change":"2023-11-04T01:42:24.532676+0000","last_active":"2023-11-04T01:42:24.543629+0000","last_peered":"2023-11-04T01:42:24.543629+0000","last_clean":"2023-11-04T01:42:24.543629+0000","last_became_active":"2023-11-04T01:42:24.531878+0000","last_became_peered":"2023-11-04T01:42:24.531878+0000","last_unstale":"2023-11-04T01:42:24.543629+0000","last_undegraded":"2023-11-04T01:42:24.543629+0000","last_fullsized":"2023-11-04T01:42:24.543629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552545+0000","last_change":"2023-11-04T01:42:24.535521+0000","last_active":"2023-11-04T01:42:24.552545+0000","last_peered":"2023-11-04T01:42:24.552545+0000","last_clean":"2023-11-04T01:42:24.552545+0000","last_became_active":"2023-11-04T01:42:24.534783+0000","last_became_peered":"2023-11-04T01:42:24.534783+0000","last_unstale":"2023-11-04T01:42:24.552545+0000","last_undegraded":"2023-11-04T01:42:24.552545+0000","last_fullsized":"2023-11-04T01:42:24.552545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507864+0000","last_change":"2023-11-04T01:42:24.545554+0000","last_active":"2023-11-04T01:42:25.507864+0000","last_peered":"2023-11-04T01:42:25.507864+0000","last_clean":"2023-11-04T01:42:25.507864+0000","last_became_active":"2023-11-04T01:42:24.544913+0000","last_became_peered":"2023-11-04T01:42:24.544913+0000","last_unstale":"2023-11-04T01:42:25.507864+0000","last_undegraded":"2023-11-04T01:42:25.507864+0000","last_fullsized":"2023-11-04T01:42:25.507864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:10.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508181+0000","last_change":"2023-11-04T01:42:24.549621+0000","last_active":"2023-11-04T01:42:25.508181+0000","last_peered":"2023-11-04T01:42:25.508181+0000","last_clean":"2023-11-04T01:42:25.508181+0000","last_became_active":"2023-11-04T01:42:24.548804+0000","last_became_peered":"2023-11-04T01:42:24.548804+0000","last_unstale":"2023-11-04T01:42:25.508181+0000","last_undegraded":"2023-11-04T01:42:25.508181+0000","last_fullsized":"2023-11-04T01:42:25.508181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:36.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508310+0000","last_change":"2023-11-04T01:42:24.545059+0000","last_active":"2023-11-04T01:42:25.508310+0000","last_peered":"2023-11-04T01:42:25.508310+0000","last_clean":"2023-11-04T01:42:25.508310+0000","last_became_active":"2023-11-04T01:42:24.544341+0000","last_became_peered":"2023-11-04T01:42:24.544341+0000","last_unstale":"2023-11-04T01:42:25.508310+0000","last_undegraded":"2023-11-04T01:42:25.508310+0000","last_fullsized":"2023-11-04T01:42:25.508310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.705964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573452+0000","last_change":"2023-11-04T01:42:24.555198+0000","last_active":"2023-11-04T01:42:25.573452+0000","last_peered":"2023-11-04T01:42:25.573452+0000","last_clean":"2023-11-04T01:42:25.573452+0000","last_became_active":"2023-11-04T01:42:24.554517+0000","last_became_peered":"2023-11-04T01:42:24.554517+0000","last_unstale":"2023-11-04T01:42:25.573452+0000","last_undegraded":"2023-11-04T01:42:25.573452+0000","last_fullsized":"2023-11-04T01:42:25.573452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572931+0000","last_change":"2023-11-04T01:42:24.537075+0000","last_active":"2023-11-04T01:42:25.572931+0000","last_peered":"2023-11-04T01:42:25.572931+0000","last_clean":"2023-11-04T01:42:25.572931+0000","last_became_active":"2023-11-04T01:42:24.536346+0000","last_became_peered":"2023-11-04T01:42:24.536346+0000","last_unstale":"2023-11-04T01:42:25.572931+0000","last_undegraded":"2023-11-04T01:42:25.572931+0000","last_fullsized":"2023-11-04T01:42:25.572931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.538718+0000","last_change":"2023-11-04T01:42:24.526411+0000","last_active":"2023-11-04T01:42:24.538718+0000","last_peered":"2023-11-04T01:42:24.538718+0000","last_clean":"2023-11-04T01:42:24.538718+0000","last_became_active":"2023-11-04T01:42:24.525610+0000","last_became_peered":"2023-11-04T01:42:24.525610+0000","last_unstale":"2023-11-04T01:42:24.538718+0000","last_undegraded":"2023-11-04T01:42:24.538718+0000","last_fullsized":"2023-11-04T01:42:24.538718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505513+0000","last_change":"2023-11-04T01:42:24.551036+0000","last_active":"2023-11-04T01:42:25.505513+0000","last_peered":"2023-11-04T01:42:25.505513+0000","last_clean":"2023-11-04T01:42:25.505513+0000","last_became_active":"2023-11-04T01:42:24.550386+0000","last_became_peered":"2023-11-04T01:42:24.550386+0000","last_unstale":"2023-11-04T01:42:25.505513+0000","last_undegraded":"2023-11-04T01:42:25.505513+0000","last_fullsized":"2023-11-04T01:42:25.505513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506769+0000","last_change":"2023-11-04T01:42:24.559164+0000","last_active":"2023-11-04T01:42:25.506769+0000","last_peered":"2023-11-04T01:42:25.506769+0000","last_clean":"2023-11-04T01:42:25.506769+0000","last_became_active":"2023-11-04T01:42:24.558452+0000","last_became_peered":"2023-11-04T01:42:24.558452+0000","last_unstale":"2023-11-04T01:42:25.506769+0000","last_undegraded":"2023-11-04T01:42:25.506769+0000","last_fullsized":"2023-11-04T01:42:25.506769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:31.294438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546974+0000","last_change":"2023-11-04T01:42:24.542766+0000","last_active":"2023-11-04T01:42:24.546974+0000","last_peered":"2023-11-04T01:42:24.546974+0000","last_clean":"2023-11-04T01:42:24.546974+0000","last_became_active":"2023-11-04T01:42:24.542209+0000","last_became_peered":"2023-11-04T01:42:24.542209+0000","last_unstale":"2023-11-04T01:42:24.546974+0000","last_undegraded":"2023-11-04T01:42:24.546974+0000","last_fullsized":"2023-11-04T01:42:24.546974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:48.042046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507069+0000","last_change":"2023-11-04T01:42:24.533283+0000","last_active":"2023-11-04T01:42:25.507069+0000","last_peered":"2023-11-04T01:42:25.507069+0000","last_clean":"2023-11-04T01:42:25.507069+0000","last_became_active":"2023-11-04T01:42:24.530651+0000","last_became_peered":"2023-11-04T01:42:24.530651+0000","last_unstale":"2023-11-04T01:42:25.507069+0000","last_undegraded":"2023-11-04T01:42:25.507069+0000","last_fullsized":"2023-11-04T01:42:25.507069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:51.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508171+0000","last_change":"2023-11-04T01:42:24.545087+0000","last_active":"2023-11-04T01:42:25.508171+0000","last_peered":"2023-11-04T01:42:25.508171+0000","last_clean":"2023-11-04T01:42:25.508171+0000","last_became_active":"2023-11-04T01:42:24.544372+0000","last_became_peered":"2023-11-04T01:42:24.544372+0000","last_unstale":"2023-11-04T01:42:25.508171+0000","last_undegraded":"2023-11-04T01:42:25.508171+0000","last_fullsized":"2023-11-04T01:42:25.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:30.235988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504099+0000","last_change":"2023-11-04T01:42:24.528107+0000","last_active":"2023-11-04T01:42:25.504099+0000","last_peered":"2023-11-04T01:42:25.504099+0000","last_clean":"2023-11-04T01:42:25.504099+0000","last_became_active":"2023-11-04T01:42:24.527344+0000","last_became_peered":"2023-11-04T01:42:24.527344+0000","last_unstale":"2023-11-04T01:42:25.504099+0000","last_undegraded":"2023-11-04T01:42:25.504099+0000","last_fullsized":"2023-11-04T01:42:25.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:48.101766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.540730+0000","last_change":"2023-11-04T01:42:24.516917+0000","last_active":"2023-11-04T01:42:24.540730+0000","last_peered":"2023-11-04T01:42:24.540730+0000","last_clean":"2023-11-04T01:42:24.540730+0000","last_became_active":"2023-11-04T01:42:24.516072+0000","last_became_peered":"2023-11-04T01:42:24.516072+0000","last_unstale":"2023-11-04T01:42:24.540730+0000","last_undegraded":"2023-11-04T01:42:24.540730+0000","last_fullsized":"2023-11-04T01:42:24.540730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546578+0000","last_change":"2023-11-04T01:42:24.544709+0000","last_active":"2023-11-04T01:42:24.546578+0000","last_peered":"2023-11-04T01:42:24.546578+0000","last_clean":"2023-11-04T01:42:24.546578+0000","last_became_active":"2023-11-04T01:42:24.543976+0000","last_became_peered":"2023-11-04T01:42:24.543976+0000","last_unstale":"2023-11-04T01:42:24.546578+0000","last_undegraded":"2023-11-04T01:42:24.546578+0000","last_fullsized":"2023-11-04T01:42:24.546578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505748+0000","last_change":"2023-11-04T01:42:24.532616+0000","last_active":"2023-11-04T01:42:25.505748+0000","last_peered":"2023-11-04T01:42:25.505748+0000","last_clean":"2023-11-04T01:42:25.505748+0000","last_became_active":"2023-11-04T01:42:24.529894+0000","last_became_peered":"2023-11-04T01:42:24.529894+0000","last_unstale":"2023-11-04T01:42:25.505748+0000","last_undegraded":"2023-11-04T01:42:25.505748+0000","last_fullsized":"2023-11-04T01:42:25.505748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544733+0000","last_change":"2023-11-04T01:42:24.540137+0000","last_active":"2023-11-04T01:42:24.544733+0000","last_peered":"2023-11-04T01:42:24.544733+0000","last_clean":"2023-11-04T01:42:24.544733+0000","last_became_active":"2023-11-04T01:42:24.539303+0000","last_became_peered":"2023-11-04T01:42:24.539303+0000","last_unstale":"2023-11-04T01:42:24.544733+0000","last_undegraded":"2023-11-04T01:42:24.544733+0000","last_fullsized":"2023-11-04T01:42:24.544733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553334+0000","last_change":"2023-11-04T01:42:24.537992+0000","last_active":"2023-11-04T01:42:24.553334+0000","last_peered":"2023-11-04T01:42:24.553334+0000","last_clean":"2023-11-04T01:42:24.553334+0000","last_became_active":"2023-11-04T01:42:24.537129+0000","last_became_peered":"2023-11-04T01:42:24.537129+0000","last_unstale":"2023-11-04T01:42:24.553334+0000","last_undegraded":"2023-11-04T01:42:24.553334+0000","last_fullsized":"2023-11-04T01:42:24.553334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573347+0000","last_change":"2023-11-04T01:42:24.530582+0000","last_active":"2023-11-04T01:42:25.573347+0000","last_peered":"2023-11-04T01:42:25.573347+0000","last_clean":"2023-11-04T01:42:25.573347+0000","last_became_active":"2023-11-04T01:42:24.529891+0000","last_became_peered":"2023-11-04T01:42:24.529891+0000","last_unstale":"2023-11-04T01:42:25.573347+0000","last_undegraded":"2023-11-04T01:42:25.573347+0000","last_fullsized":"2023-11-04T01:42:25.573347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573474+0000","last_change":"2023-11-04T01:42:24.554452+0000","last_active":"2023-11-04T01:42:25.573474+0000","last_peered":"2023-11-04T01:42:25.573474+0000","last_clean":"2023-11-04T01:42:25.573474+0000","last_became_active":"2023-11-04T01:42:24.553857+0000","last_became_peered":"2023-11-04T01:42:24.553857+0000","last_unstale":"2023-11-04T01:42:25.573474+0000","last_undegraded":"2023-11-04T01:42:25.573474+0000","last_fullsized":"2023-11-04T01:42:25.573474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:48.459289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543232+0000","last_change":"2023-11-04T01:42:24.532888+0000","last_active":"2023-11-04T01:42:24.543232+0000","last_peered":"2023-11-04T01:42:24.543232+0000","last_clean":"2023-11-04T01:42:24.543232+0000","last_became_active":"2023-11-04T01:42:24.532172+0000","last_became_peered":"2023-11-04T01:42:24.532172+0000","last_unstale":"2023-11-04T01:42:24.543232+0000","last_undegraded":"2023-11-04T01:42:24.543232+0000","last_fullsized":"2023-11-04T01:42:24.543232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505919+0000","last_change":"2023-11-04T01:42:24.532118+0000","last_active":"2023-11-04T01:42:25.505919+0000","last_peered":"2023-11-04T01:42:25.505919+0000","last_clean":"2023-11-04T01:42:25.505919+0000","last_became_active":"2023-11-04T01:42:24.530531+0000","last_became_peered":"2023-11-04T01:42:24.530531+0000","last_unstale":"2023-11-04T01:42:25.505919+0000","last_undegraded":"2023-11-04T01:42:25.505919+0000","last_fullsized":"2023-11-04T01:42:25.505919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546959+0000","last_change":"2023-11-04T01:42:24.541439+0000","last_active":"2023-11-04T01:42:24.546959+0000","last_peered":"2023-11-04T01:42:24.546959+0000","last_clean":"2023-11-04T01:42:24.546959+0000","last_became_active":"2023-11-04T01:42:24.540727+0000","last_became_peered":"2023-11-04T01:42:24.540727+0000","last_unstale":"2023-11-04T01:42:24.546959+0000","last_undegraded":"2023-11-04T01:42:24.546959+0000","last_fullsized":"2023-11-04T01:42:24.546959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:15:01.489039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.545101+0000","last_change":"2023-11-04T01:42:24.521552+0000","last_active":"2023-11-04T01:42:24.545101+0000","last_peered":"2023-11-04T01:42:24.545101+0000","last_clean":"2023-11-04T01:42:24.545101+0000","last_became_active":"2023-11-04T01:42:24.520794+0000","last_became_peered":"2023-11-04T01:42:24.520794+0000","last_unstale":"2023-11-04T01:42:24.545101+0000","last_undegraded":"2023-11-04T01:42:24.545101+0000","last_fullsized":"2023-11-04T01:42:24.545101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:18.253719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552544+0000","last_change":"2023-11-04T01:42:24.530960+0000","last_active":"2023-11-04T01:42:24.552544+0000","last_peered":"2023-11-04T01:42:24.552544+0000","last_clean":"2023-11-04T01:42:24.552544+0000","last_became_active":"2023-11-04T01:42:24.530166+0000","last_became_peered":"2023-11-04T01:42:24.530166+0000","last_unstale":"2023-11-04T01:42:24.552544+0000","last_undegraded":"2023-11-04T01:42:24.552544+0000","last_fullsized":"2023-11-04T01:42:24.552544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:47.008729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.888606+0000","last_change":"2023-11-04T01:42:23.881752+0000","last_active":"2023-11-04T01:42:24.888606+0000","last_peered":"2023-11-04T01:42:24.888606+0000","last_clean":"2023-11-04T01:42:24.888606+0000","last_became_active":"2023-11-04T01:42:23.871460+0000","last_became_peered":"2023-11-04T01:42:23.871460+0000","last_unstale":"2023-11-04T01:42:24.888606+0000","last_undegraded":"2023-11-04T01:42:24.888606+0000","last_fullsized":"2023-11-04T01:42:24.888606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504494+0000","last_change":"2023-11-04T01:42:24.536354+0000","last_active":"2023-11-04T01:42:25.504494+0000","last_peered":"2023-11-04T01:42:25.504494+0000","last_clean":"2023-11-04T01:42:25.504494+0000","last_became_active":"2023-11-04T01:42:24.535597+0000","last_became_peered":"2023-11-04T01:42:24.535597+0000","last_unstale":"2023-11-04T01:42:25.504494+0000","last_undegraded":"2023-11-04T01:42:25.504494+0000","last_fullsized":"2023-11-04T01:42:25.504494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:09.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507312+0000","last_change":"2023-11-04T01:42:23.854629+0000","last_active":"2023-11-04T01:42:25.507312+0000","last_peered":"2023-11-04T01:42:25.507312+0000","last_clean":"2023-11-04T01:42:25.507312+0000","last_became_active":"2023-11-04T01:42:23.854209+0000","last_became_peered":"2023-11-04T01:42:23.854209+0000","last_unstale":"2023-11-04T01:42:25.507312+0000","last_undegraded":"2023-11-04T01:42:25.507312+0000","last_fullsized":"2023-11-04T01:42:25.507312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572788+0000","last_change":"2023-11-04T01:42:23.871583+0000","last_active":"2023-11-04T01:42:25.572788+0000","last_peered":"2023-11-04T01:42:25.572788+0000","last_clean":"2023-11-04T01:42:25.572788+0000","last_became_active":"2023-11-04T01:42:23.870753+0000","last_became_peered":"2023-11-04T01:42:23.870753+0000","last_unstale":"2023-11-04T01:42:25.572788+0000","last_undegraded":"2023-11-04T01:42:25.572788+0000","last_fullsized":"2023-11-04T01:42:25.572788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:45.998097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.542631+0000","last_change":"2023-11-04T01:42:24.527244+0000","last_active":"2023-11-04T01:42:24.542631+0000","last_peered":"2023-11-04T01:42:24.542631+0000","last_clean":"2023-11-04T01:42:24.542631+0000","last_became_active":"2023-11-04T01:42:24.526519+0000","last_became_peered":"2023-11-04T01:42:24.526519+0000","last_unstale":"2023-11-04T01:42:24.542631+0000","last_undegraded":"2023-11-04T01:42:24.542631+0000","last_fullsized":"2023-11-04T01:42:24.542631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505615+0000","last_change":"2023-11-04T01:42:23.861230+0000","last_active":"2023-11-04T01:42:25.505615+0000","last_peered":"2023-11-04T01:42:25.505615+0000","last_clean":"2023-11-04T01:42:25.505615+0000","last_became_active":"2023-11-04T01:42:23.859784+0000","last_became_peered":"2023-11-04T01:42:23.859784+0000","last_unstale":"2023-11-04T01:42:25.505615+0000","last_undegraded":"2023-11-04T01:42:25.505615+0000","last_fullsized":"2023-11-04T01:42:25.505615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:43.619572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504003+0000","last_change":"2023-11-04T01:42:24.524254+0000","last_active":"2023-11-04T01:42:25.504003+0000","last_peered":"2023-11-04T01:42:25.504003+0000","last_clean":"2023-11-04T01:42:25.504003+0000","last_became_active":"2023-11-04T01:42:24.523478+0000","last_became_peered":"2023-11-04T01:42:24.523478+0000","last_unstale":"2023-11-04T01:42:25.504003+0000","last_undegraded":"2023-11-04T01:42:25.504003+0000","last_fullsized":"2023-11-04T01:42:25.504003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:49.878595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.497603+0000","last_change":"2023-11-04T01:42:23.872649+0000","last_active":"2023-11-04T01:42:24.497603+0000","last_peered":"2023-11-04T01:42:24.497603+0000","last_clean":"2023-11-04T01:42:24.497603+0000","last_became_active":"2023-11-04T01:42:23.872297+0000","last_became_peered":"2023-11-04T01:42:23.872297+0000","last_unstale":"2023-11-04T01:42:24.497603+0000","last_undegraded":"2023-11-04T01:42:24.497603+0000","last_fullsized":"2023-11-04T01:42:24.497603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553300+0000","last_change":"2023-11-04T01:42:24.530263+0000","last_active":"2023-11-04T01:42:24.553300+0000","last_peered":"2023-11-04T01:42:24.553300+0000","last_clean":"2023-11-04T01:42:24.553300+0000","last_became_active":"2023-11-04T01:42:24.529507+0000","last_became_peered":"2023-11-04T01:42:24.529507+0000","last_unstale":"2023-11-04T01:42:24.553300+0000","last_undegraded":"2023-11-04T01:42:24.553300+0000","last_fullsized":"2023-11-04T01:42:24.553300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:43:30.144754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508023+0000","last_change":"2023-11-04T01:42:23.873814+0000","last_active":"2023-11-04T01:42:25.508023+0000","last_peered":"2023-11-04T01:42:25.508023+0000","last_clean":"2023-11-04T01:42:25.508023+0000","last_became_active":"2023-11-04T01:42:23.873404+0000","last_became_peered":"2023-11-04T01:42:23.873404+0000","last_unstale":"2023-11-04T01:42:25.508023+0000","last_undegraded":"2023-11-04T01:42:25.508023+0000","last_fullsized":"2023-11-04T01:42:25.508023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:21.679291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543396+0000","last_change":"2023-11-04T01:42:24.534026+0000","last_active":"2023-11-04T01:42:24.543396+0000","last_peered":"2023-11-04T01:42:24.543396+0000","last_clean":"2023-11-04T01:42:24.543396+0000","last_became_active":"2023-11-04T01:42:24.533338+0000","last_became_peered":"2023-11-04T01:42:24.533338+0000","last_unstale":"2023-11-04T01:42:24.543396+0000","last_undegraded":"2023-11-04T01:42:24.543396+0000","last_fullsized":"2023-11-04T01:42:24.543396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:50.563897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.884338+0000","last_change":"2023-11-04T01:42:23.872021+0000","last_active":"2023-11-04T01:42:24.884338+0000","last_peered":"2023-11-04T01:42:24.884338+0000","last_clean":"2023-11-04T01:42:24.884338+0000","last_became_active":"2023-11-04T01:42:23.870751+0000","last_became_peered":"2023-11-04T01:42:23.870751+0000","last_unstale":"2023-11-04T01:42:24.884338+0000","last_undegraded":"2023-11-04T01:42:24.884338+0000","last_fullsized":"2023-11-04T01:42:24.884338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.620945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506411+0000","last_change":"2023-11-04T01:42:24.546924+0000","last_active":"2023-11-04T01:42:25.506411+0000","last_peered":"2023-11-04T01:42:25.506411+0000","last_clean":"2023-11-04T01:42:25.506411+0000","last_became_active":"2023-11-04T01:42:24.546318+0000","last_became_peered":"2023-11-04T01:42:24.546318+0000","last_unstale":"2023-11-04T01:42:25.506411+0000","last_undegraded":"2023-11-04T01:42:25.506411+0000","last_fullsized":"2023-11-04T01:42:25.506411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:48.887573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.893734+0000","last_change":"2023-11-04T01:42:23.872849+0000","last_active":"2023-11-04T01:42:24.893734+0000","last_peered":"2023-11-04T01:42:24.893734+0000","last_clean":"2023-11-04T01:42:24.893734+0000","last_became_active":"2023-11-04T01:42:23.872394+0000","last_became_peered":"2023-11-04T01:42:23.872394+0000","last_unstale":"2023-11-04T01:42:24.893734+0000","last_undegraded":"2023-11-04T01:42:24.893734+0000","last_fullsized":"2023-11-04T01:42:24.893734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508459+0000","last_change":"2023-11-04T01:42:24.525307+0000","last_active":"2023-11-04T01:42:25.508459+0000","last_peered":"2023-11-04T01:42:25.508459+0000","last_clean":"2023-11-04T01:42:25.508459+0000","last_became_active":"2023-11-04T01:42:24.522877+0000","last_became_peered":"2023-11-04T01:42:24.522877+0000","last_unstale":"2023-11-04T01:42:25.508459+0000","last_undegraded":"2023-11-04T01:42:25.508459+0000","last_fullsized":"2023-11-04T01:42:25.508459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887748+0000","last_change":"2023-11-04T01:42:23.878097+0000","last_active":"2023-11-04T01:42:24.887748+0000","last_peered":"2023-11-04T01:42:24.887748+0000","last_clean":"2023-11-04T01:42:24.887748+0000","last_became_active":"2023-11-04T01:42:23.877265+0000","last_became_peered":"2023-11-04T01:42:23.877265+0000","last_unstale":"2023-11-04T01:42:24.887748+0000","last_undegraded":"2023-11-04T01:42:24.887748+0000","last_fullsized":"2023-11-04T01:42:24.887748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:22.344804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573080+0000","last_change":"2023-11-04T01:42:24.546728+0000","last_active":"2023-11-04T01:42:25.573080+0000","last_peered":"2023-11-04T01:42:25.573080+0000","last_clean":"2023-11-04T01:42:25.573080+0000","last_became_active":"2023-11-04T01:42:24.545946+0000","last_became_peered":"2023-11-04T01:42:24.545946+0000","last_unstale":"2023-11-04T01:42:25.573080+0000","last_undegraded":"2023-11-04T01:42:25.573080+0000","last_fullsized":"2023-11-04T01:42:25.573080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506789+0000","last_change":"2023-11-04T01:42:23.875211+0000","last_active":"2023-11-04T01:42:25.506789+0000","last_peered":"2023-11-04T01:42:25.506789+0000","last_clean":"2023-11-04T01:42:25.506789+0000","last_became_active":"2023-11-04T01:42:23.874649+0000","last_became_peered":"2023-11-04T01:42:23.874649+0000","last_unstale":"2023-11-04T01:42:25.506789+0000","last_undegraded":"2023-11-04T01:42:25.506789+0000","last_fullsized":"2023-11-04T01:42:25.506789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506005+0000","last_change":"2023-11-04T01:42:24.557710+0000","last_active":"2023-11-04T01:42:25.506005+0000","last_peered":"2023-11-04T01:42:25.506005+0000","last_clean":"2023-11-04T01:42:25.506005+0000","last_became_active":"2023-11-04T01:42:24.557097+0000","last_became_peered":"2023-11-04T01:42:24.557097+0000","last_unstale":"2023-11-04T01:42:25.506005+0000","last_undegraded":"2023-11-04T01:42:25.506005+0000","last_fullsized":"2023-11-04T01:42:25.506005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:07.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507961+0000","last_change":"2023-11-04T01:42:23.858376+0000","last_active":"2023-11-04T01:42:25.507961+0000","last_peered":"2023-11-04T01:42:25.507961+0000","last_clean":"2023-11-04T01:42:25.507961+0000","last_became_active":"2023-11-04T01:42:23.856424+0000","last_became_peered":"2023-11-04T01:42:23.856424+0000","last_unstale":"2023-11-04T01:42:25.507961+0000","last_undegraded":"2023-11-04T01:42:25.507961+0000","last_fullsized":"2023-11-04T01:42:25.507961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:49.553266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552117+0000","last_change":"2023-11-04T01:42:24.529593+0000","last_active":"2023-11-04T01:42:24.552117+0000","last_peered":"2023-11-04T01:42:24.552117+0000","last_clean":"2023-11-04T01:42:24.552117+0000","last_became_active":"2023-11-04T01:42:24.528834+0000","last_became_peered":"2023-11-04T01:42:24.528834+0000","last_unstale":"2023-11-04T01:42:24.552117+0000","last_undegraded":"2023-11-04T01:42:24.552117+0000","last_fullsized":"2023-11-04T01:42:24.552117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:14.623927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503660+0000","last_change":"2023-11-04T01:42:23.878725+0000","last_active":"2023-11-04T01:42:25.503660+0000","last_peered":"2023-11-04T01:42:25.503660+0000","last_clean":"2023-11-04T01:42:25.503660+0000","last_became_active":"2023-11-04T01:42:23.877930+0000","last_became_peered":"2023-11-04T01:42:23.877930+0000","last_unstale":"2023-11-04T01:42:25.503660+0000","last_undegraded":"2023-11-04T01:42:25.503660+0000","last_fullsized":"2023-11-04T01:42:25.503660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:52.439183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505874+0000","last_change":"2023-11-04T01:42:24.545238+0000","last_active":"2023-11-04T01:42:25.505874+0000","last_peered":"2023-11-04T01:42:25.505874+0000","last_clean":"2023-11-04T01:42:25.505874+0000","last_became_active":"2023-11-04T01:42:24.544606+0000","last_became_peered":"2023-11-04T01:42:24.544606+0000","last_unstale":"2023-11-04T01:42:25.505874+0000","last_undegraded":"2023-11-04T01:42:25.505874+0000","last_fullsized":"2023-11-04T01:42:25.505874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.509259+0000","last_change":"2023-11-04T01:42:23.889452+0000","last_active":"2023-11-04T01:42:25.509259+0000","last_peered":"2023-11-04T01:42:25.509259+0000","last_clean":"2023-11-04T01:42:25.509259+0000","last_became_active":"2023-11-04T01:42:23.889046+0000","last_became_peered":"2023-11-04T01:42:23.889046+0000","last_unstale":"2023-11-04T01:42:25.509259+0000","last_undegraded":"2023-11-04T01:42:25.509259+0000","last_fullsized":"2023-11-04T01:42:25.509259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.561776+0000","last_change":"2023-11-04T01:42:24.560710+0000","last_active":"2023-11-04T01:42:24.561776+0000","last_peered":"2023-11-04T01:42:24.561776+0000","last_clean":"2023-11-04T01:42:24.561776+0000","last_became_active":"2023-11-04T01:42:24.560051+0000","last_became_peered":"2023-11-04T01:42:24.560051+0000","last_unstale":"2023-11-04T01:42:24.561776+0000","last_undegraded":"2023-11-04T01:42:24.561776+0000","last_fullsized":"2023-11-04T01:42:24.561776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:01:14.623927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504630+0000","last_change":"2023-11-04T01:42:23.892535+0000","last_active":"2023-11-04T01:42:25.504630+0000","last_peered":"2023-11-04T01:42:25.504630+0000","last_clean":"2023-11-04T01:42:25.504630+0000","last_became_active":"2023-11-04T01:42:23.891942+0000","last_became_peered":"2023-11-04T01:42:23.891942+0000","last_unstale":"2023-11-04T01:42:25.504630+0000","last_undegraded":"2023-11-04T01:42:25.504630+0000","last_fullsized":"2023-11-04T01:42:25.504630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:28.817061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508895+0000","last_change":"2023-11-04T01:42:24.555641+0000","last_active":"2023-11-04T01:42:25.508895+0000","last_peered":"2023-11-04T01:42:25.508895+0000","last_clean":"2023-11-04T01:42:25.508895+0000","last_became_active":"2023-11-04T01:42:24.554641+0000","last_became_peered":"2023-11-04T01:42:24.554641+0000","last_unstale":"2023-11-04T01:42:25.508895+0000","last_undegraded":"2023-11-04T01:42:25.508895+0000","last_fullsized":"2023-11-04T01:42:25.508895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.886886+0000","last_change":"2023-11-04T01:42:23.879946+0000","last_active":"2023-11-04T01:42:24.886886+0000","last_peered":"2023-11-04T01:42:24.886886+0000","last_clean":"2023-11-04T01:42:24.886886+0000","last_became_active":"2023-11-04T01:42:23.879106+0000","last_became_peered":"2023-11-04T01:42:23.879106+0000","last_unstale":"2023-11-04T01:42:24.886886+0000","last_undegraded":"2023-11-04T01:42:24.886886+0000","last_fullsized":"2023-11-04T01:42:24.886886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:56.805776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508541+0000","last_change":"2023-11-04T01:42:24.535305+0000","last_active":"2023-11-04T01:42:25.508541+0000","last_peered":"2023-11-04T01:42:25.508541+0000","last_clean":"2023-11-04T01:42:25.508541+0000","last_became_active":"2023-11-04T01:42:24.534392+0000","last_became_peered":"2023-11-04T01:42:24.534392+0000","last_unstale":"2023-11-04T01:42:25.508541+0000","last_undegraded":"2023-11-04T01:42:25.508541+0000","last_fullsized":"2023-11-04T01:42:25.508541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573731+0000","last_change":"2023-11-04T01:42:23.859651+0000","last_active":"2023-11-04T01:42:25.573731+0000","last_peered":"2023-11-04T01:42:25.573731+0000","last_clean":"2023-11-04T01:42:25.573731+0000","last_became_active":"2023-11-04T01:42:23.858848+0000","last_became_peered":"2023-11-04T01:42:23.858848+0000","last_unstale":"2023-11-04T01:42:25.573731+0000","last_undegraded":"2023-11-04T01:42:25.573731+0000","last_fullsized":"2023-11-04T01:42:25.573731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506723+0000","last_change":"2023-11-04T01:42:24.542701+0000","last_active":"2023-11-04T01:42:25.506723+0000","last_peered":"2023-11-04T01:42:25.506723+0000","last_clean":"2023-11-04T01:42:25.506723+0000","last_became_active":"2023-11-04T01:42:24.541785+0000","last_became_peered":"2023-11-04T01:42:24.541785+0000","last_unstale":"2023-11-04T01:42:25.506723+0000","last_undegraded":"2023-11-04T01:42:25.506723+0000","last_fullsized":"2023-11-04T01:42:25.506723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:54.044840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-04T01:42:23.844020+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:42:23.844020+0000","last_peered":"2023-11-04T01:42:23.844020+0000","last_clean":"2023-11-04T01:42:23.844020+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:42:23.844020+0000","last_undegraded":"2023-11-04T01:42:23.844020+0000","last_fullsized":"2023-11-04T01:42:23.844020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506303+0000","last_change":"2023-11-04T01:42:23.870050+0000","last_active":"2023-11-04T01:42:25.506303+0000","last_peered":"2023-11-04T01:42:25.506303+0000","last_clean":"2023-11-04T01:42:25.506303+0000","last_became_active":"2023-11-04T01:42:23.868558+0000","last_became_peered":"2023-11-04T01:42:23.868558+0000","last_unstale":"2023-11-04T01:42:25.506303+0000","last_undegraded":"2023-11-04T01:42:25.506303+0000","last_fullsized":"2023-11-04T01:42:25.506303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504592+0000","last_change":"2023-11-04T01:42:24.515619+0000","last_active":"2023-11-04T01:42:25.504592+0000","last_peered":"2023-11-04T01:42:25.504592+0000","last_clean":"2023-11-04T01:42:25.504592+0000","last_became_active":"2023-11-04T01:42:24.514861+0000","last_became_peered":"2023-11-04T01:42:24.514861+0000","last_unstale":"2023-11-04T01:42:25.504592+0000","last_undegraded":"2023-11-04T01:42:25.504592+0000","last_fullsized":"2023-11-04T01:42:25.504592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:12.327963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505707+0000","last_change":"2023-11-04T01:42:23.889363+0000","last_active":"2023-11-04T01:42:25.505707+0000","last_peered":"2023-11-04T01:42:25.505707+0000","last_clean":"2023-11-04T01:42:25.505707+0000","last_became_active":"2023-11-04T01:42:23.888990+0000","last_became_peered":"2023-11-04T01:42:23.888990+0000","last_unstale":"2023-11-04T01:42:25.505707+0000","last_undegraded":"2023-11-04T01:42:25.505707+0000","last_fullsized":"2023-11-04T01:42:25.505707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572945+0000","last_change":"2023-11-04T01:42:24.544491+0000","last_active":"2023-11-04T01:42:25.572945+0000","last_peered":"2023-11-04T01:42:25.572945+0000","last_clean":"2023-11-04T01:42:25.572945+0000","last_became_active":"2023-11-04T01:42:24.543670+0000","last_became_peered":"2023-11-04T01:42:24.543670+0000","last_unstale":"2023-11-04T01:42:25.572945+0000","last_undegraded":"2023-11-04T01:42:25.572945+0000","last_fullsized":"2023-11-04T01:42:25.572945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.510207+0000","last_change":"2023-11-04T01:42:23.887645+0000","last_active":"2023-11-04T01:42:24.510207+0000","last_peered":"2023-11-04T01:42:24.510207+0000","last_clean":"2023-11-04T01:42:24.510207+0000","last_became_active":"2023-11-04T01:42:23.887066+0000","last_became_peered":"2023-11-04T01:42:23.887066+0000","last_unstale":"2023-11-04T01:42:24.510207+0000","last_undegraded":"2023-11-04T01:42:24.510207+0000","last_fullsized":"2023-11-04T01:42:24.510207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:14.860163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.543580+0000","last_change":"2023-11-04T01:42:24.530872+0000","last_active":"2023-11-04T01:42:24.543580+0000","last_peered":"2023-11-04T01:42:24.543580+0000","last_clean":"2023-11-04T01:42:24.543580+0000","last_became_active":"2023-11-04T01:42:24.529785+0000","last_became_peered":"2023-11-04T01:42:24.529785+0000","last_unstale":"2023-11-04T01:42:24.543580+0000","last_undegraded":"2023-11-04T01:42:24.543580+0000","last_fullsized":"2023-11-04T01:42:24.543580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:05.406379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507010+0000","last_change":"2023-11-04T01:42:23.864470+0000","last_active":"2023-11-04T01:42:25.507010+0000","last_peered":"2023-11-04T01:42:25.507010+0000","last_clean":"2023-11-04T01:42:25.507010+0000","last_became_active":"2023-11-04T01:42:23.864049+0000","last_became_peered":"2023-11-04T01:42:23.864049+0000","last_unstale":"2023-11-04T01:42:25.507010+0000","last_undegraded":"2023-11-04T01:42:25.507010+0000","last_fullsized":"2023-11-04T01:42:25.507010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508539+0000","last_change":"2023-11-04T01:42:24.547297+0000","last_active":"2023-11-04T01:42:25.508539+0000","last_peered":"2023-11-04T01:42:25.508539+0000","last_clean":"2023-11-04T01:42:25.508539+0000","last_became_active":"2023-11-04T01:42:24.546593+0000","last_became_peered":"2023-11-04T01:42:24.546593+0000","last_unstale":"2023-11-04T01:42:25.508539+0000","last_undegraded":"2023-11-04T01:42:25.508539+0000","last_fullsized":"2023-11-04T01:42:25.508539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.509613+0000","last_change":"2023-11-04T01:42:23.881220+0000","last_active":"2023-11-04T01:42:24.509613+0000","last_peered":"2023-11-04T01:42:24.509613+0000","last_clean":"2023-11-04T01:42:24.509613+0000","last_became_active":"2023-11-04T01:42:23.880569+0000","last_became_peered":"2023-11-04T01:42:23.880569+0000","last_unstale":"2023-11-04T01:42:24.509613+0000","last_undegraded":"2023-11-04T01:42:24.509613+0000","last_fullsized":"2023-11-04T01:42:24.509613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.553251+0000","last_change":"2023-11-04T01:42:24.544821+0000","last_active":"2023-11-04T01:42:24.553251+0000","last_peered":"2023-11-04T01:42:24.553251+0000","last_clean":"2023-11-04T01:42:24.553251+0000","last_became_active":"2023-11-04T01:42:24.544158+0000","last_became_peered":"2023-11-04T01:42:24.544158+0000","last_unstale":"2023-11-04T01:42:24.553251+0000","last_undegraded":"2023-11-04T01:42:24.553251+0000","last_fullsized":"2023-11-04T01:42:24.553251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507284+0000","last_change":"2023-11-04T01:42:23.867710+0000","last_active":"2023-11-04T01:42:25.507284+0000","last_peered":"2023-11-04T01:42:25.507284+0000","last_clean":"2023-11-04T01:42:25.507284+0000","last_became_active":"2023-11-04T01:42:23.867162+0000","last_became_peered":"2023-11-04T01:42:23.867162+0000","last_unstale":"2023-11-04T01:42:25.507284+0000","last_undegraded":"2023-11-04T01:42:25.507284+0000","last_fullsized":"2023-11-04T01:42:25.507284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:48.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573619+0000","last_change":"2023-11-04T01:42:24.529944+0000","last_active":"2023-11-04T01:42:25.573619+0000","last_peered":"2023-11-04T01:42:25.573619+0000","last_clean":"2023-11-04T01:42:25.573619+0000","last_became_active":"2023-11-04T01:42:24.528837+0000","last_became_peered":"2023-11-04T01:42:24.528837+0000","last_unstale":"2023-11-04T01:42:25.573619+0000","last_undegraded":"2023-11-04T01:42:25.573619+0000","last_fullsized":"2023-11-04T01:42:25.573619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.261927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504841+0000","last_change":"2023-11-04T01:42:23.871604+0000","last_active":"2023-11-04T01:42:25.504841+0000","last_peered":"2023-11-04T01:42:25.504841+0000","last_clean":"2023-11-04T01:42:25.504841+0000","last_became_active":"2023-11-04T01:42:23.870746+0000","last_became_peered":"2023-11-04T01:42:23.870746+0000","last_unstale":"2023-11-04T01:42:25.504841+0000","last_undegraded":"2023-11-04T01:42:25.504841+0000","last_fullsized":"2023-11-04T01:42:25.504841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:22.043685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504543+0000","last_change":"2023-11-04T01:42:24.520352+0000","last_active":"2023-11-04T01:42:25.504543+0000","last_peered":"2023-11-04T01:42:25.504543+0000","last_clean":"2023-11-04T01:42:25.504543+0000","last_became_active":"2023-11-04T01:42:24.519515+0000","last_became_peered":"2023-11-04T01:42:24.519515+0000","last_unstale":"2023-11-04T01:42:25.504543+0000","last_undegraded":"2023-11-04T01:42:25.504543+0000","last_fullsized":"2023-11-04T01:42:25.504543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:31.963568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506869+0000","last_change":"2023-11-04T01:42:23.856440+0000","last_active":"2023-11-04T01:42:25.506869+0000","last_peered":"2023-11-04T01:42:25.506869+0000","last_clean":"2023-11-04T01:42:25.506869+0000","last_became_active":"2023-11-04T01:42:23.856067+0000","last_became_peered":"2023-11-04T01:42:23.856067+0000","last_unstale":"2023-11-04T01:42:25.506869+0000","last_undegraded":"2023-11-04T01:42:25.506869+0000","last_fullsized":"2023-11-04T01:42:25.506869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:21.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504391+0000","last_change":"2023-11-04T01:42:24.530290+0000","last_active":"2023-11-04T01:42:25.504391+0000","last_peered":"2023-11-04T01:42:25.504391+0000","last_clean":"2023-11-04T01:42:25.504391+0000","last_became_active":"2023-11-04T01:42:24.529568+0000","last_became_peered":"2023-11-04T01:42:24.529568+0000","last_unstale":"2023-11-04T01:42:25.504391+0000","last_undegraded":"2023-11-04T01:42:25.504391+0000","last_fullsized":"2023-11-04T01:42:25.504391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:42.384938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508823+0000","last_change":"2023-11-04T01:42:23.867463+0000","last_active":"2023-11-04T01:42:25.508823+0000","last_peered":"2023-11-04T01:42:25.508823+0000","last_clean":"2023-11-04T01:42:25.508823+0000","last_became_active":"2023-11-04T01:42:23.865925+0000","last_became_peered":"2023-11-04T01:42:23.865925+0000","last_unstale":"2023-11-04T01:42:25.508823+0000","last_undegraded":"2023-11-04T01:42:25.508823+0000","last_fullsized":"2023-11-04T01:42:25.508823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:29.802796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506042+0000","last_change":"2023-11-04T01:42:24.532587+0000","last_active":"2023-11-04T01:42:25.506042+0000","last_peered":"2023-11-04T01:42:25.506042+0000","last_clean":"2023-11-04T01:42:25.506042+0000","last_became_active":"2023-11-04T01:42:24.531827+0000","last_became_peered":"2023-11-04T01:42:24.531827+0000","last_unstale":"2023-11-04T01:42:25.506042+0000","last_undegraded":"2023-11-04T01:42:25.506042+0000","last_fullsized":"2023-11-04T01:42:25.506042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:09.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504135+0000","last_change":"2023-11-04T01:42:23.871960+0000","last_active":"2023-11-04T01:42:25.504135+0000","last_peered":"2023-11-04T01:42:25.504135+0000","last_clean":"2023-11-04T01:42:25.504135+0000","last_became_active":"2023-11-04T01:42:23.871205+0000","last_became_peered":"2023-11-04T01:42:23.871205+0000","last_unstale":"2023-11-04T01:42:25.504135+0000","last_undegraded":"2023-11-04T01:42:25.504135+0000","last_fullsized":"2023-11-04T01:42:25.504135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:33:54.986696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503773+0000","last_change":"2023-11-04T01:42:24.531520+0000","last_active":"2023-11-04T01:42:25.503773+0000","last_peered":"2023-11-04T01:42:25.503773+0000","last_clean":"2023-11-04T01:42:25.503773+0000","last_became_active":"2023-11-04T01:42:24.530762+0000","last_became_peered":"2023-11-04T01:42:24.530762+0000","last_unstale":"2023-11-04T01:42:25.503773+0000","last_undegraded":"2023-11-04T01:42:25.503773+0000","last_fullsized":"2023-11-04T01:42:25.503773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.137518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573320+0000","last_change":"2023-11-04T01:42:23.887853+0000","last_active":"2023-11-04T01:42:25.573320+0000","last_peered":"2023-11-04T01:42:25.573320+0000","last_clean":"2023-11-04T01:42:25.573320+0000","last_became_active":"2023-11-04T01:42:23.886915+0000","last_became_peered":"2023-11-04T01:42:23.886915+0000","last_unstale":"2023-11-04T01:42:25.573320+0000","last_undegraded":"2023-11-04T01:42:25.573320+0000","last_fullsized":"2023-11-04T01:42:25.573320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:25.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.539674+0000","last_change":"2023-11-04T01:42:24.528548+0000","last_active":"2023-11-04T01:42:24.539674+0000","last_peered":"2023-11-04T01:42:24.539674+0000","last_clean":"2023-11-04T01:42:24.539674+0000","last_became_active":"2023-11-04T01:42:24.527750+0000","last_became_peered":"2023-11-04T01:42:24.527750+0000","last_unstale":"2023-11-04T01:42:24.539674+0000","last_undegraded":"2023-11-04T01:42:24.539674+0000","last_fullsized":"2023-11-04T01:42:24.539674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:13.583907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506105+0000","last_change":"2023-11-04T01:42:23.865890+0000","last_active":"2023-11-04T01:42:25.506105+0000","last_peered":"2023-11-04T01:42:25.506105+0000","last_clean":"2023-11-04T01:42:25.506105+0000","last_became_active":"2023-11-04T01:42:23.865503+0000","last_became_peered":"2023-11-04T01:42:23.865503+0000","last_unstale":"2023-11-04T01:42:25.506105+0000","last_undegraded":"2023-11-04T01:42:25.506105+0000","last_fullsized":"2023-11-04T01:42:25.506105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:05.380495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506285+0000","last_change":"2023-11-04T01:42:24.527953+0000","last_active":"2023-11-04T01:42:25.506285+0000","last_peered":"2023-11-04T01:42:25.506285+0000","last_clean":"2023-11-04T01:42:25.506285+0000","last_became_active":"2023-11-04T01:42:24.527112+0000","last_became_peered":"2023-11-04T01:42:24.527112+0000","last_unstale":"2023-11-04T01:42:25.506285+0000","last_undegraded":"2023-11-04T01:42:25.506285+0000","last_fullsized":"2023-11-04T01:42:25.506285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:04.559600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507122+0000","last_change":"2023-11-04T01:42:24.560200+0000","last_active":"2023-11-04T01:42:25.507122+0000","last_peered":"2023-11-04T01:42:25.507122+0000","last_clean":"2023-11-04T01:42:25.507122+0000","last_became_active":"2023-11-04T01:42:24.559286+0000","last_became_peered":"2023-11-04T01:42:24.559286+0000","last_unstale":"2023-11-04T01:42:25.507122+0000","last_undegraded":"2023-11-04T01:42:25.507122+0000","last_fullsized":"2023-11-04T01:42:25.507122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:48.678049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508726+0000","last_change":"2023-11-04T01:42:23.875613+0000","last_active":"2023-11-04T01:42:25.508726+0000","last_peered":"2023-11-04T01:42:25.508726+0000","last_clean":"2023-11-04T01:42:25.508726+0000","last_became_active":"2023-11-04T01:42:23.875339+0000","last_became_peered":"2023-11-04T01:42:23.875339+0000","last_unstale":"2023-11-04T01:42:25.508726+0000","last_undegraded":"2023-11-04T01:42:25.508726+0000","last_fullsized":"2023-11-04T01:42:25.508726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.552630+0000","last_change":"2023-11-04T01:42:24.541588+0000","last_active":"2023-11-04T01:42:24.552630+0000","last_peered":"2023-11-04T01:42:24.552630+0000","last_clean":"2023-11-04T01:42:24.552630+0000","last_became_active":"2023-11-04T01:42:24.536601+0000","last_became_peered":"2023-11-04T01:42:24.536601+0000","last_unstale":"2023-11-04T01:42:24.552630+0000","last_undegraded":"2023-11-04T01:42:24.552630+0000","last_fullsized":"2023-11-04T01:42:24.552630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:56:14.551109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508450+0000","last_change":"2023-11-04T01:42:23.873370+0000","last_active":"2023-11-04T01:42:25.508450+0000","last_peered":"2023-11-04T01:42:25.508450+0000","last_clean":"2023-11-04T01:42:25.508450+0000","last_became_active":"2023-11-04T01:42:23.873081+0000","last_became_peered":"2023-11-04T01:42:23.873081+0000","last_unstale":"2023-11-04T01:42:25.508450+0000","last_undegraded":"2023-11-04T01:42:25.508450+0000","last_fullsized":"2023-11-04T01:42:25.508450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.544681+0000","last_change":"2023-11-04T01:42:24.540046+0000","last_active":"2023-11-04T01:42:24.544681+0000","last_peered":"2023-11-04T01:42:24.544681+0000","last_clean":"2023-11-04T01:42:24.544681+0000","last_became_active":"2023-11-04T01:42:24.539286+0000","last_became_peered":"2023-11-04T01:42:24.539286+0000","last_unstale":"2023-11-04T01:42:24.544681+0000","last_undegraded":"2023-11-04T01:42:24.544681+0000","last_fullsized":"2023-11-04T01:42:24.544681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.887064+0000","last_change":"2023-11-04T01:42:23.879421+0000","last_active":"2023-11-04T01:42:24.887064+0000","last_peered":"2023-11-04T01:42:24.887064+0000","last_clean":"2023-11-04T01:42:24.887064+0000","last_became_active":"2023-11-04T01:42:23.874688+0000","last_became_peered":"2023-11-04T01:42:23.874688+0000","last_unstale":"2023-11-04T01:42:24.887064+0000","last_undegraded":"2023-11-04T01:42:24.887064+0000","last_fullsized":"2023-11-04T01:42:24.887064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.546550+0000","last_change":"2023-11-04T01:42:24.544559+0000","last_active":"2023-11-04T01:42:24.546550+0000","last_peered":"2023-11-04T01:42:24.546550+0000","last_clean":"2023-11-04T01:42:24.546550+0000","last_became_active":"2023-11-04T01:42:24.543895+0000","last_became_peered":"2023-11-04T01:42:24.543895+0000","last_unstale":"2023-11-04T01:42:24.546550+0000","last_undegraded":"2023-11-04T01:42:24.546550+0000","last_fullsized":"2023-11-04T01:42:24.546550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:30.813427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504779+0000","last_change":"2023-11-04T01:42:23.868589+0000","last_active":"2023-11-04T01:42:25.504779+0000","last_peered":"2023-11-04T01:42:25.504779+0000","last_clean":"2023-11-04T01:42:25.504779+0000","last_became_active":"2023-11-04T01:42:23.867572+0000","last_became_peered":"2023-11-04T01:42:23.867572+0000","last_unstale":"2023-11-04T01:42:25.504779+0000","last_undegraded":"2023-11-04T01:42:25.504779+0000","last_fullsized":"2023-11-04T01:42:25.504779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:13.960345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":794624,"data_stored":657193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":73111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6639999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1150000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5549999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":657215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":66755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":200704,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":68367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.603}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:32.730 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:42:32.730 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-04T01:42:32.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-04T01:42:32.731 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-04T01:42:32.731 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-04T01:42:32.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.879+0000 7ff269667640 1 Processor -- start 2023-11-04T01:42:32.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.879+0000 7ff269667640 1 -- start start 2023-11-04T01:42:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff269667640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff2640ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff269667640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2640b0d40 0x7ff26415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff269667640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26406cfd0 con 0x7ff2640ca990 2023-11-04T01:42:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff269667640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2640ca030 con 0x7ff2640b0d40 2023-11-04T01:42:32.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff269667640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26415e830 con 0x7ff264159fc0 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2640b0d40 0x7ff26415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2640b0d40 0x7ff26415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49600/0 (socket says 172.21.15.2:49600) 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 -- 172.21.15.2:0/590917818 learned_addr learned my addr 172.21.15.2:0/590917818 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff262ffd640 1 --2- 172.21.15.2:0/590917818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff2640ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 -- 172.21.15.2:0/590917818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 msgr2=0x7ff2640ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 --2- 172.21.15.2:0/590917818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff2640ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 -- 172.21.15.2:0/590917818 >> v1:172.21.15.90:6789/0 conn(0x7ff2640ca990 legacy=0x7ff2640b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 -- 172.21.15.2:0/590917818 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26415eb10 con 0x7ff2640b0d40 2023-11-04T01:42:32.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff2637fe640 1 --2- 172.21.15.2:0/590917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640b0d40 0x7ff26415dc50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00d150 tx=0x7ff25c01ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87540e4a219e55bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.883+0000 7ff261ffb640 1 -- 172.21.15.2:0/590917818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00b2d0 con 0x7ff2640b0d40 2023-11-04T01:42:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff261ffb640 1 -- 172.21.15.2:0/590917818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c00b430 con 0x7ff2640b0d40 2023-11-04T01:42:32.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff261ffb640 1 -- 172.21.15.2:0/590917818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0a7be0 con 0x7ff2640b0d40 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- 172.21.15.2:0/590917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640b0d40 msgr2=0x7ff26415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 --2- 172.21.15.2:0/590917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640b0d40 0x7ff26415dc50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00d150 tx=0x7ff25c01ebe0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- 172.21.15.2:0/590917818 shutdown_connections 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 --2- 172.21.15.2:0/590917818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640b0d40 0x7ff26415dc50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 --2- 172.21.15.2:0/590917818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff2640ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- 172.21.15.2:0/590917818 >> 172.21.15.2:0/590917818 conn(0x7ff2640cebb0 msgr2=0x7ff2640cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- 172.21.15.2:0/590917818 shutdown_connections 2023-11-04T01:42:32.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- 172.21.15.2:0/590917818 wait complete. 2023-11-04T01:42:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 Processor -- start 2023-11-04T01:42:32.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- start start 2023-11-04T01:42:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2640b0d40 0x7ff2640c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640ca990 0x7ff264154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff26414a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2640c6e50 con 0x7ff2640ca990 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264153d80 con 0x7ff2640b0d40 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff269667640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26414ac60 con 0x7ff264159fc0 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640ca990 0x7ff264154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640ca990 0x7ff264154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49604/0 (socket says 172.21.15.2:49604) 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 -- 172.21.15.2:0/3708798914 learned_addr learned my addr 172.21.15.2:0/3708798914 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2637fe640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff26414a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff262ffd640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2640b0d40 0x7ff2640c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 -- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 msgr2=0x7ff26414a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff26414a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 -- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2640b0d40 msgr2=0x7ff2640c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2640b0d40 0x7ff2640c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.887+0000 7ff2627fc640 1 -- 172.21.15.2:0/3708798914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c00bd40 con 0x7ff2640ca990 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff2627fc640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640ca990 0x7ff264154920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c500 tx=0x7ff25800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff24b7fe640 1 -- 172.21.15.2:0/3708798914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258005220 con 0x7ff2640ca990 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff24b7fe640 1 -- 172.21.15.2:0/3708798914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff258005380 con 0x7ff2640ca990 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2640c61d0 con 0x7ff2640ca990 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff24b7fe640 1 -- 172.21.15.2:0/3708798914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258007270 con 0x7ff2640ca990 2023-11-04T01:42:32.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2640c6790 con 0x7ff2640ca990 2023-11-04T01:42:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2640c6f90 con 0x7ff2640ca990 2023-11-04T01:42:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff24b7fe640 1 -- 172.21.15.2:0/3708798914 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2580073d0 con 0x7ff2640ca990 2023-11-04T01:42:32.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff24b7fe640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2500664a0 0x7ff250068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff24b7fe640 1 -- 172.21.15.2:0/3708798914 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff258083820 con 0x7ff2640ca990 2023-11-04T01:42:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff262ffd640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2500664a0 0x7ff250068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:32.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.891+0000 7ff262ffd640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2500664a0 0x7ff250068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b930 tx=0x7ff254008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:32.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:32.895+0000 7ff24b7fe640 1 -- 172.21.15.2:0/3708798914 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff258050d30 con 0x7ff2640ca990 2023-11-04T01:42:33.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.087+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff2640c6f90 con 0x7ff2640ca990 2023-11-04T01:42:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff24b7fe640 1 -- 172.21.15.2:0/3708798914 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164428 (secure 0 0 0) 0x7ff2640c6f90 con 0x7ff2640ca990 2023-11-04T01:42:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2500664a0 msgr2=0x7ff250068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2500664a0 0x7ff250068960 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b930 tx=0x7ff254008040 comp rx=0 tx=0).stop 2023-11-04T01:42:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640ca990 msgr2=0x7ff264154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640ca990 0x7ff264154920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c500 tx=0x7ff25800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 shutdown_connections 2023-11-04T01:42:33.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2500664a0 0x7ff250068960 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff264159fc0 0x7ff26414a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2640ca990 0x7ff264154920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 --2- 172.21.15.2:0/3708798914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2640b0d40 0x7ff2640c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 >> 172.21.15.2:0/3708798914 conn(0x7ff2640cebb0 msgr2=0x7ff26415b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 shutdown_connections 2023-11-04T01:42:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.095+0000 7ff269667640 1 -- 172.21.15.2:0/3708798914 wait complete. 2023-11-04T01:42:33.164 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":650491919},{"type":"v1","addr":"172.21.15.90:6833","nonce":650491919}]},"active_addr":"172.21.15.90:6833/650491919","active_change":"2023-11-04T01:42:04.745730+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:v0.0.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":3202536272}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":434741158}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":2210662422}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":2189341281}]}]} 2023-11-04T01:42:33.167 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-04T01:42:33.167 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-04T01:42:33.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:33.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.287+0000 7f77effc7640 1 Processor -- start 2023-11-04T01:42:33.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.287+0000 7f77effc7640 1 -- start start 2023-11-04T01:42:33.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77effc7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 0x7f77e80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77effc7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e80c2670 con 0x7f77e806f8f0 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77effc7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e806bc30 con 0x7f77e80b0d40 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77effc7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8070140 con 0x7f77e815afd0 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ed562640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f77e806f8f0 0x7f77e80b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51982/0 (socket says 172.21.15.2:51982) 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ed562640 1 -- 172.21.15.2:0/1303383393 learned_addr learned my addr 172.21.15.2:0/1303383393 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77edd63640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 0x7f77e80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813435585 0 0) 0x7f77e80c2670 con 0x7f77e806f8f0 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d4003530 con 0x7f77e806f8f0 2023-11-04T01:42:33.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910429878 0 0) 0x7f77d4003530 con 0x7f77e806f8f0 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 msgr2=0x7f77e80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 0x7f77e80715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 >> v1:172.21.15.90:6789/0 conn(0x7f77e80b0d40 legacy=0x7f77e815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e806bf10 con 0x7f77e806f8f0 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f77d8001680 con 0x7f77e806f8f0 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 >> v1:172.21.15.2:6789/0 conn(0x7f77e806f8f0 legacy=0x7f77e80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 0x7f77d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4003f30 0x7f77d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4004d10 0x7f77d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8070140 con 0x7f77d4004d10 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d400ba70 con 0x7f77d4003f30 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d400bc30 con 0x7f77e815afd0 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ee564640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4004d10 0x7f77d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77edd63640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 0x7f77d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ed562640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4003f30 0x7f77d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ee564640 1 -- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 msgr2=0x7f77d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ee564640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e815afd0 0x7f77d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ee564640 1 -- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4003f30 msgr2=0x7f77d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ee564640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4003f30 0x7f77d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ee564640 1 -- 172.21.15.2:0/1303383393 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4003530 con 0x7f77d4004d10 2023-11-04T01:42:33.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.291+0000 7f77ed562640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4003f30 0x7f77d40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4004d10 0x7f77d4005190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77e0001e40 tx=0x7f77e001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa54ce66a224d909 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0003b80 con 0x7f77d4004d10 2023-11-04T01:42:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0003ce0 con 0x7f77d4004d10 2023-11-04T01:42:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ecd61640 1 -- 172.21.15.2:0/1303383393 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00052c0 con 0x7f77d4004d10 2023-11-04T01:42:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- 172.21.15.2:0/1303383393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4004d10 msgr2=0x7f77d4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 --2- 172.21.15.2:0/1303383393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77d4004d10 0x7f77d4005190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77e0001e40 tx=0x7f77e001c740 comp rx=0 tx=0).stop 2023-11-04T01:42:33.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 -- 172.21.15.2:0/1303383393 reap_dead start 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- 172.21.15.2:0/1303383393 shutdown_connections 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- 172.21.15.2:0/1303383393 >> 172.21.15.2:0/1303383393 conn(0x7f77e80cebb0 msgr2=0x7f77e80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- 172.21.15.2:0/1303383393 shutdown_connections 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- 172.21.15.2:0/1303383393 wait complete. 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 Processor -- start 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- start start 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4004d10 0x7f77e80c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e80c73d0 0x7f77e81589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e80b39a0 0x7f77e80b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c6b50 con 0x7f77e80b39a0 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c89d0 con 0x7f77d4004d10 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77effc7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80b4360 con 0x7f77e80c73d0 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e80b39a0 0x7f77e80b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e80b39a0 0x7f77e80b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49618/0 (socket says 172.21.15.2:49618) 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 -- 172.21.15.2:0/2218234871 learned_addr learned my addr 172.21.15.2:0/2218234871 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ed562640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e80c73d0 0x7f77e81589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77edd63640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4004d10 0x7f77e80c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 -- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e80c73d0 msgr2=0x7f77e81589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e80c73d0 0x7f77e81589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 -- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4004d10 msgr2=0x7f77e80c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4004d10 0x7f77e80c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 -- 172.21.15.2:0/2218234871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80c5fd0 con 0x7f77e80b39a0 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77ee564640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e80b39a0 0x7f77e80b3e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77e001cc20 tx=0x7f77d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.295+0000 7f77de7fc640 1 -- 172.21.15.2:0/2218234871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0007dc0 con 0x7f77e80b39a0 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77de7fc640 1 -- 172.21.15.2:0/2218234871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0005030 con 0x7f77e80b39a0 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e80c62b0 con 0x7f77e80b39a0 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77de7fc640 1 -- 172.21.15.2:0/2218234871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00053a0 con 0x7f77e80b39a0 2023-11-04T01:42:33.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e80c6870 con 0x7f77e80b39a0 2023-11-04T01:42:33.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e80c2910 con 0x7f77e80b39a0 2023-11-04T01:42:33.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77de7fc640 1 -- 172.21.15.2:0/2218234871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77e0005500 con 0x7f77e80b39a0 2023-11-04T01:42:33.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77de7fc640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77cc0664a0 0x7f77cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77de7fc640 1 -- 172.21.15.2:0/2218234871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77e011db90 con 0x7f77e80b39a0 2023-11-04T01:42:33.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77edd63640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77cc0664a0 0x7f77cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.299+0000 7f77edd63640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77cc0664a0 0x7f77cc068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009a30 tx=0x7f77e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.303+0000 7f77de7fc640 1 -- 172.21.15.2:0/2218234871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77e00eeb10 con 0x7f77e80b39a0 2023-11-04T01:42:33.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.455+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77e806c1c0 con 0x7f77e80b39a0 2023-11-04T01:42:33.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.455+0000 7f77de7fc640 1 -- 172.21.15.2:0/2218234871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f77e00bb020 con 0x7f77e80b39a0 2023-11-04T01:42:33.461 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:33.461 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77cc0664a0 msgr2=0x7f77cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77cc0664a0 0x7f77cc068960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009a30 tx=0x7f77e4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e80b39a0 msgr2=0x7f77e80b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e80b39a0 0x7f77e80b3e20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77e001cc20 tx=0x7f77d4005800 comp rx=0 tx=0).stop 2023-11-04T01:42:33.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 shutdown_connections 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77cc0664a0 0x7f77cc068960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77e80b39a0 0x7f77e80b3e20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77e80c73d0 0x7f77e81589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 --2- 172.21.15.2:0/2218234871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77d4004d10 0x7f77e80c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 >> 172.21.15.2:0/2218234871 conn(0x7f77e80cebb0 msgr2=0x7f77e80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 shutdown_connections 2023-11-04T01:42:33.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.459+0000 7f77effc7640 1 -- 172.21.15.2:0/2218234871 wait complete. 2023-11-04T01:42:33.479 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-04T01:42:33.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.583+0000 7f382b5e1640 1 Processor -- start 2023-11-04T01:42:33.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.583+0000 7f382b5e1640 1 -- start start 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f382b5e1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 0x7f38240b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f382b5e1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240c2670 con 0x7f38240b0b70 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f382b5e1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382406bc30 con 0x7f382415afd0 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f382b5e1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3824070140 con 0x7f38240715d0 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f38240b0b70 0x7f382415ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51986/0 (socket says 172.21.15.2:51986) 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 -- 172.21.15.2:0/56840896 learned_addr learned my addr 172.21.15.2:0/56840896 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3828b7c640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 0x7f38240b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329113194 0 0) 0x7f38240c2670 con 0x7f38240b0b70 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3810003530 con 0x7f38240b0b70 2023-11-04T01:42:33.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466772488 0 0) 0x7f3810003530 con 0x7f38240b0b70 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 msgr2=0x7f38240b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 0x7f38240b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 >> v1:172.21.15.90:6789/0 conn(0x7f382415afd0 legacy=0x7f382406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382406bf10 con 0x7f38240b0b70 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f381c001a00 con 0x7f38240b0b70 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 >> v1:172.21.15.2:6789/0 conn(0x7f38240b0b70 legacy=0x7f382415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 0x7f38100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3810003f80 0x7f38100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3810004d10 0x7f3810005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824070140 con 0x7f3810004d10 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381000bad0 con 0x7f3810003f80 2023-11-04T01:42:33.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381000bc90 con 0x7f38240715d0 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3810004d10 0x7f3810005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f382937d640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 0x7f38100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3828b7c640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3810003f80 0x7f38100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 -- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 msgr2=0x7f38100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38240715d0 0x7f38100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 -- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3810003f80 msgr2=0x7f38100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3810003f80 0x7f38100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3829b7e640 1 -- 172.21.15.2:0/56840896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810003530 con 0x7f3810004d10 2023-11-04T01:42:33.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.587+0000 7f3828b7c640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3810003f80 0x7f38100047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:33.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f3829b7e640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3810004d10 0x7f3810005190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f381c00a750 tx=0x7f381c01d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b3eb42f5681504 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c0ad630 con 0x7f3810004d10 2023-11-04T01:42:33.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c0a8070 con 0x7f3810004d10 2023-11-04T01:42:33.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f381bfff640 1 -- 172.21.15.2:0/56840896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c0ad9d0 con 0x7f3810004d10 2023-11-04T01:42:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 -- 172.21.15.2:0/56840896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3810004d10 msgr2=0x7f3810005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 --2- 172.21.15.2:0/56840896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3810004d10 0x7f3810005190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f381c00a750 tx=0x7f381c01d260 comp rx=0 tx=0).stop 2023-11-04T01:42:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f3829b7e640 1 -- 172.21.15.2:0/56840896 reap_dead start 2023-11-04T01:42:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 -- 172.21.15.2:0/56840896 shutdown_connections 2023-11-04T01:42:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 -- 172.21.15.2:0/56840896 >> 172.21.15.2:0/56840896 conn(0x7f38240cebb0 msgr2=0x7f38240cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 -- 172.21.15.2:0/56840896 shutdown_connections 2023-11-04T01:42:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 -- 172.21.15.2:0/56840896 wait complete. 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 Processor -- start 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 -- start start 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3824156360 0x7f38240cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f382415b3b0 0x7f38240c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.591+0000 7f382b5e1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38241570b0 0x7f3824157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382b5e1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240c6cc0 con 0x7f382415b3b0 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382b5e1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824157a70 con 0x7f3824156360 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382b5e1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38240c6420 con 0x7f38241570b0 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f382415b3b0 0x7f38240c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f382415b3b0 0x7f38240c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49638/0 (socket says 172.21.15.2:49638) 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 -- 172.21.15.2:0/2152428118 learned_addr learned my addr 172.21.15.2:0/2152428118 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:33.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3829b7e640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38241570b0 0x7f3824157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382937d640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3824156360 0x7f38240cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 -- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38241570b0 msgr2=0x7f3824157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38241570b0 0x7f3824157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 -- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3824156360 msgr2=0x7f38240cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3824156360 0x7f38240cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 -- 172.21.15.2:0/2152428118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240c6700 con 0x7f382415b3b0 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382937d640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3824156360 0x7f38240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3828b7c640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f382415b3b0 0x7f38240c5bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3814010890 tx=0x7f3814010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3819ffb640 1 -- 172.21.15.2:0/2152428118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814004220 con 0x7f382415b3b0 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3819ffb640 1 -- 172.21.15.2:0/2152428118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814004380 con 0x7f382415b3b0 2023-11-04T01:42:33.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38240c69e0 con 0x7f382415b3b0 2023-11-04T01:42:33.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3819ffb640 1 -- 172.21.15.2:0/2152428118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381400eb20 con 0x7f382415b3b0 2023-11-04T01:42:33.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38240c6130 con 0x7f382415b3b0 2023-11-04T01:42:33.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382415d090 con 0x7f382415b3b0 2023-11-04T01:42:33.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3819ffb640 1 -- 172.21.15.2:0/2152428118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f381400ec80 con 0x7f382415b3b0 2023-11-04T01:42:33.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3819ffb640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f38080664d0 0x7f3808068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f3819ffb640 1 -- 172.21.15.2:0/2152428118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3814084030 con 0x7f382415b3b0 2023-11-04T01:42:33.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382937d640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f38080664d0 0x7f3808068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.595+0000 7f382937d640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f38080664d0 0x7f3808068990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c10 tx=0x7f3820009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.599+0000 7f3819ffb640 1 -- 172.21.15.2:0/2152428118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f38140514b0 con 0x7f382415b3b0 2023-11-04T01:42:33.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.759+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38240744a0 con 0x7f382415b3b0 2023-11-04T01:42:33.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.759+0000 7f3819ffb640 1 -- 172.21.15.2:0/2152428118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f38140044f0 con 0x7f382415b3b0 2023-11-04T01:42:33.766 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f38080664d0 msgr2=0x7f3808068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f38080664d0 0x7f3808068990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c10 tx=0x7f3820009040 comp rx=0 tx=0).stop 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f382415b3b0 msgr2=0x7f38240c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f382415b3b0 0x7f38240c5bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3814010890 tx=0x7f3814010d50 comp rx=0 tx=0).stop 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 shutdown_connections 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f38080664d0 0x7f3808068990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f38241570b0 0x7f3824157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f382415b3b0 0x7f38240c5bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 --2- 172.21.15.2:0/2152428118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3824156360 0x7f38240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 >> 172.21.15.2:0/2152428118 conn(0x7f38240cebb0 msgr2=0x7f38240b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 shutdown_connections 2023-11-04T01:42:33.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.763+0000 7f382b5e1640 1 -- 172.21.15.2:0/2152428118 wait complete. 2023-11-04T01:42:33.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-04T01:42:33.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-04T01:42:33.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-04T01:42:33.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-04T01:42:33.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-04T01:42:33.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-04T01:42:33.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-04T01:42:33.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-04T01:42:33.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3c577e640 1 Processor -- start 2023-11-04T01:42:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3c577e640 1 -- start start 2023-11-04T01:42:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3c577e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c006d000 0x7fc3c00cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3c577e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc3c00cb830 0x7fc3c00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3c577e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c00ce230 con 0x7fc3c0158fc0 2023-11-04T01:42:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3c577e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c015da50 con 0x7fc3c00cb830 2023-11-04T01:42:33.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3c577e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00cc200 con 0x7fc3c006d000 2023-11-04T01:42:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3beffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc3c0158fc0 0x7fc3c015d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51990/0 (socket says 172.21.15.2:51990) 2023-11-04T01:42:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3beffd640 1 -- 172.21.15.2:0/2040497223 learned_addr learned my addr 172.21.15.2:0/2040497223 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:33.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3bf7fe640 1 --2- 172.21.15.2:0/2040497223 >> v2:172.21.15.90:3300/0 conn(0x7fc3c00cb830 0x7fc3c00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.955+0000 7fc3be7fc640 1 --2- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c006d000 0x7fc3c00cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.959+0000 7fc3bdffb640 1 -- 172.21.15.2:0/2040497223 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360329967 0 0) 0x7fc3c00ce230 con 0x7fc3c0158fc0 2023-11-04T01:42:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.959+0000 7fc3bdffb640 1 -- 172.21.15.2:0/2040497223 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3a8005740 con 0x7fc3c0158fc0 2023-11-04T01:42:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.959+0000 7fc3bf7fe640 1 -- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c006d000 msgr2=0x7fc3c00cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.959+0000 7fc3bf7fe640 1 --2- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c006d000 0x7fc3c00cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.959+0000 7fc3bf7fe640 1 -- 172.21.15.2:0/2040497223 >> v1:172.21.15.2:6789/0 conn(0x7fc3c0158fc0 legacy=0x7fc3c015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.959+0000 7fc3bf7fe640 1 -- 172.21.15.2:0/2040497223 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c015ceb0 con 0x7fc3c00cb830 2023-11-04T01:42:33.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.959+0000 7fc3bf7fe640 1 --2- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c00cb830 0x7fc3c00cbcc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800aea0 tx=0x7fc3b801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4395f4c945d0b61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3bdffb640 1 -- 172.21.15.2:0/2040497223 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800a2d0 con 0x7fc3c00cb830 2023-11-04T01:42:33.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3bdffb640 1 -- 172.21.15.2:0/2040497223 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b80a5720 con 0x7fc3c00cb830 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 -- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c00cb830 msgr2=0x7fc3c00cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 --2- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c00cb830 0x7fc3c00cbcc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800aea0 tx=0x7fc3b801c950 comp rx=0 tx=0).stop 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 -- 172.21.15.2:0/2040497223 shutdown_connections 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 --2- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c00cb830 0x7fc3c00cbcc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 --2- 172.21.15.2:0/2040497223 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c006d000 0x7fc3c00cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 -- 172.21.15.2:0/2040497223 >> 172.21.15.2:0/2040497223 conn(0x7fc3c00b0550 msgr2=0x7fc3c00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 -- 172.21.15.2:0/2040497223 shutdown_connections 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 -- 172.21.15.2:0/2040497223 wait complete. 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 Processor -- start 2023-11-04T01:42:33.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.963+0000 7fc3c577e640 1 -- start start 2023-11-04T01:42:33.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f717ada7640 1 Processor -- start 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c006d000 0x7fc3c00b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3c00cb830 0x7fc3c01458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c0158fc0 0x7fc3c0145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00c8bd0 con 0x7fc3c00cb830 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0146360 con 0x7fc3c006d000 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00c8610 con 0x7fc3c0158fc0 2023-11-04T01:42:33.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f717ada7640 1 -- start start 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3c00cb830 0x7fc3c01458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e9aac640 1 Processor -- start 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3c00cb830 0x7fc3c01458e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49640/0 (socket says 172.21.15.2:49640) 2023-11-04T01:42:33.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 -- 172.21.15.2:0/2291219765 learned_addr learned my addr 172.21.15.2:0/2291219765 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e9aac640 1 -- start start 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3beffd640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c006d000 0x7fc3c00b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3bf7fe640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c0158fc0 0x7fc3c0145e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 -- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c0158fc0 msgr2=0x7fc3c0145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3c0158fc0 0x7fc3c0145e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 -- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c006d000 msgr2=0x7fc3c00b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c006d000 0x7fc3c00b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 -- 172.21.15.2:0/2291219765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b800ab80 con 0x7fc3c00cb830 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3beffd640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3c006d000 0x7fc3c00b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3be7fc640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3c00cb830 0x7fc3c01458e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400d800 tx=0x7fc3b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f717ada7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f71740ceaa0 0x7f71740ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f717ada7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7174070d90 con 0x7f7174159e70 2023-11-04T01:42:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f717ada7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71740cef00 con 0x7f71740caf10 2023-11-04T01:42:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f717ada7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717406dd90 con 0x7f71740ceaa0 2023-11-04T01:42:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b40096a0 con 0x7fc3c00cb830 2023-11-04T01:42:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c00c88f0 con 0x7fc3c00cb830 2023-11-04T01:42:33.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c014f7f0 con 0x7fc3c00cb830 2023-11-04T01:42:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f7178b43640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7174159e70 0x7f717406cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52000/0 (socket says 172.21.15.2:52000) 2023-11-04T01:42:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f7178b43640 1 -- 172.21.15.2:0/807443603 learned_addr learned my addr 172.21.15.2:0/807443603 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f7173fff640 1 --2- 172.21.15.2:0/807443603 >> v2:172.21.15.90:3300/0 conn(0x7f71740ceaa0 0x7f71740ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b4009800 con 0x7fc3c00cb830 2023-11-04T01:42:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4009b70 con 0x7fc3c00cb830 2023-11-04T01:42:33.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e9aac640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc0e1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f0f93d6c640 1 Processor -- start 2023-11-04T01:42:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e9aac640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f40dc03b660 0x7f40dc007b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f0f93d6c640 1 -- start start 2023-11-04T01:42:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e9aac640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc054110 con 0x7f40dc0080c0 2023-11-04T01:42:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e9aac640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc054c90 con 0x7f40dc03b660 2023-11-04T01:42:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e3fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f40dc03b660 0x7f40dc007b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e3fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f40dc03b660 0x7f40dc007b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38436/0 (socket says 172.21.15.2:38436) 2023-11-04T01:42:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e3fff640 1 -- 172.21.15.2:0/133822163 learned_addr learned my addr 172.21.15.2:0/133822163 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:33.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e9aac640 1 -- 172.21.15.2:0/133822163 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc054360 con 0x7f40dc0e0040 2023-11-04T01:42:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f7173fff640 1 -- 172.21.15.2:0/807443603 >> v1:172.21.15.90:6789/0 conn(0x7f71740caf10 legacy=0x7f71740b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f7173fff640 1 -- 172.21.15.2:0/807443603 >> v1:172.21.15.2:6789/0 conn(0x7f7174159e70 legacy=0x7f717406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f7173fff640 1 -- 172.21.15.2:0/807443603 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717406d4f0 con 0x7f71740ceaa0 2023-11-04T01:42:33.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3a0000fd0 con 0x7fc3c00cb830 2023-11-04T01:42:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fb9a59f8640 1 Processor -- start 2023-11-04T01:42:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e37fe640 1 -- 172.21.15.2:0/133822163 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706197548 0 0) 0x7f40dc054110 con 0x7f40dc0080c0 2023-11-04T01:42:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e37fe640 1 -- 172.21.15.2:0/133822163 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d4003530 con 0x7f40dc0080c0 2023-11-04T01:42:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e8aaa640 1 --2- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc0e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e3fff640 1 -- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 msgr2=0x7f40dc0e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f93d6c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f84053c10 0x7f0f84007290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f93d6c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f84053ff0 0x7f0f8403c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f93d6c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f8403c5b0 0x7f0f8403ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f93d6c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f8403e8d0 con 0x7f0f84053ff0 2023-11-04T01:42:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f93d6c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840067d0 con 0x7f0f84053c10 2023-11-04T01:42:33.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f93d6c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8403eb20 con 0x7f0f8403c5b0 2023-11-04T01:42:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3b4009cd0 con 0x7fc3c00cb830 2023-11-04T01:42:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f8403c5b0 0x7f0f8403ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f8403c5b0 0x7f0f8403ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49160/0 (socket says 172.21.15.2:49160) 2023-11-04T01:42:33.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 -- 172.21.15.2:0/3024091852 learned_addr learned my addr 172.21.15.2:0/3024091852 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f91307640 1 --2- 172.21.15.2:0/3024091852 >> v2:172.21.15.2:3300/0 conn(0x7f0f84053ff0 0x7f0f8403c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7fb9a59f8640 1 -- start start 2023-11-04T01:42:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb9a59f8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9a0161510 0x7fb9a01618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb9a59f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a006ba90 0x7fb9a00c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb9a59f8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a00cc6f0 con 0x7fb9a006f8f0 2023-11-04T01:42:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb9a59f8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a00b10d0 con 0x7fb9a0161510 2023-11-04T01:42:33.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb9a59f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a006bf90 con 0x7fb9a006ba90 2023-11-04T01:42:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e3fff640 1 --2- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc0e1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.967+0000 7f40e3fff640 1 -- 172.21.15.2:0/133822163 >> v1:172.21.15.90:6789/0 conn(0x7f40dc0080c0 legacy=0x7f40dc055120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f40e3fff640 1 -- 172.21.15.2:0/133822163 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc054640 con 0x7f40dc03b660 2023-11-04T01:42:33.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f40e8aaa640 1 --2- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc0e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3a77fe640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3ac0664a0 0x7fc3ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f91b08640 1 --2- 172.21.15.2:0/3024091852 >> v2:172.21.15.90:3300/0 conn(0x7f0f84053c10 0x7f0f84007290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 -- 172.21.15.2:0/3024091852 >> v2:172.21.15.90:3300/0 conn(0x7f0f84053c10 msgr2=0x7f0f84007290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 --2- 172.21.15.2:0/3024091852 >> v2:172.21.15.90:3300/0 conn(0x7f0f84053c10 0x7f0f84007290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9a0161510 0x7fb9a01618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9a0161510 0x7fb9a01618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38452/0 (socket says 172.21.15.2:38452) 2023-11-04T01:42:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99effd640 1 -- 172.21.15.2:0/1352342673 learned_addr learned my addr 172.21.15.2:0/1352342673 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 -- 172.21.15.2:0/3024091852 >> v2:172.21.15.2:3300/0 conn(0x7f0f84053ff0 msgr2=0x7f0f8403c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 --2- 172.21.15.2:0/3024091852 >> v2:172.21.15.2:3300/0 conn(0x7f0f84053ff0 0x7f0f8403c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3b4084bc0 con 0x7fc3c00cb830 2023-11-04T01:42:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f0f92309640 1 -- 172.21.15.2:0/3024091852 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8403ee00 con 0x7f0f8403c5b0 2023-11-04T01:42:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3a77fe640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6816/315309868,v1:172.21.15.90:6817/315309868] conn(0x7fc3ac06e640 0x7fc3ac070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 --> [v2:172.21.15.90:6816/315309868,v1:172.21.15.90:6817/315309868] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3ac071110 con 0x7fc3ac06e640 2023-11-04T01:42:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3b4085010 con 0x7fc3c00cb830 2023-11-04T01:42:33.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3beffd640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3ac0664a0 0x7fc3ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99f7fe640 1 --2- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a006ba90 0x7fb9a00c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fa89759e640 1 Processor -- start 2023-11-04T01:42:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fa89759e640 1 -- start start 2023-11-04T01:42:33.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99effd640 1 -- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a006ba90 msgr2=0x7fb9a00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3bf7fe640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6816/315309868,v1:172.21.15.90:6817/315309868] conn(0x7fc3ac06e640 0x7fc3ac070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99effd640 1 --2- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a006ba90 0x7fb9a00c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99effd640 1 -- 172.21.15.2:0/1352342673 >> v1:172.21.15.2:6789/0 conn(0x7fb9a006f8f0 legacy=0x7fb9a00b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f7173fff640 1 --2- 172.21.15.2:0/807443603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71740ceaa0 0x7f71740ca9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f716800ba60 tx=0x7f716801eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef3b9f08a9d35ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f71737fe640 1 -- 172.21.15.2:0/807443603 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71680a7bf0 con 0x7f71740ceaa0 2023-11-04T01:42:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3beffd640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3ac0664a0 0x7fc3ac068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00049e0 tx=0x7fc3b000b2a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f71737fe640 1 -- 172.21.15.2:0/807443603 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71680a7d50 con 0x7f71740ceaa0 2023-11-04T01:42:33.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fa89759e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa89003ab50 0x7fa8900548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8dba3640 1 Processor -- start 2023-11-04T01:42:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8dba3640 1 -- start start 2023-11-04T01:42:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8dba3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee880cba80 0x7fee880c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8dba3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee88156e90 con 0x7fee8815a220 2023-11-04T01:42:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8dba3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee880c9590 con 0x7fee88156ab0 2023-11-04T01:42:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8dba3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee88159740 con 0x7fee880cba80 2023-11-04T01:42:33.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fc3bf7fe640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6816/315309868,v1:172.21.15.90:6817/315309868] conn(0x7fc3ac06e640 0x7fc3ac070a60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fa89759e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa8900df190 0x7fa890007320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fa89759e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa890054430 con 0x7fa8900049f0 2023-11-04T01:42:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fa89759e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890053820 con 0x7fa8900df190 2023-11-04T01:42:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fa89759e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa890053b00 con 0x7fa89003ab50 2023-11-04T01:42:33.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f40e3fff640 1 --2- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc03b660 0x7f40dc007b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009870 tx=0x7f40d801f1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e9dcc80d97e5bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8cba1640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fee88156ab0 0x7fee880cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:56150/0 (socket says 172.21.15.2:56150) 2023-11-04T01:42:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8cba1640 1 -- 172.21.15.2:0/2577135775 learned_addr learned my addr 172.21.15.2:0/2577135775 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8d3a2640 1 --2- 172.21.15.2:0/2577135775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee880cba80 0x7fee880c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f40e37fe640 1 -- 172.21.15.2:0/133822163 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80a7730 con 0x7f40dc03b660 2023-11-04T01:42:33.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f40e37fe640 1 -- 172.21.15.2:0/133822163 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d80a7890 con 0x7f40dc03b660 2023-11-04T01:42:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f40e37fe640 1 -- 172.21.15.2:0/133822163 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80a7c00 con 0x7f40dc03b660 2023-11-04T01:42:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee877fe640 1 -- 172.21.15.2:0/2577135775 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239020511 0 0) 0x7fee880c9590 con 0x7fee88156ab0 2023-11-04T01:42:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee877fe640 1 -- 172.21.15.2:0/2577135775 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee70003530 con 0x7fee88156ab0 2023-11-04T01:42:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8d3a2640 1 -- 172.21.15.2:0/2577135775 >> v1:172.21.15.90:6789/0 conn(0x7fee88156ab0 legacy=0x7fee880cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8d3a2640 1 -- 172.21.15.2:0/2577135775 >> v1:172.21.15.2:6789/0 conn(0x7fee8815a220 legacy=0x7fee8815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fee8d3a2640 1 -- 172.21.15.2:0/2577135775 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88159a20 con 0x7fee880cba80 2023-11-04T01:42:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f717ada7640 1 -- 172.21.15.2:0/807443603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71740ceaa0 msgr2=0x7f71740ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f717ada7640 1 --2- 172.21.15.2:0/807443603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71740ceaa0 0x7f71740ca9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f716800ba60 tx=0x7f716801eb20 comp rx=0 tx=0).stop 2023-11-04T01:42:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f717ada7640 1 -- 172.21.15.2:0/807443603 shutdown_connections 2023-11-04T01:42:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f717ada7640 1 --2- 172.21.15.2:0/807443603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71740ceaa0 0x7f71740ca9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7f717ada7640 1 -- 172.21.15.2:0/807443603 >> 172.21.15.2:0/807443603 conn(0x7f717406e760 msgr2=0x7f717406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 -- 172.21.15.2:0/807443603 shutdown_connections 2023-11-04T01:42:33.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 -- 172.21.15.2:0/807443603 wait complete. 2023-11-04T01:42:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 -- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc03b660 msgr2=0x7f40dc007b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 --2- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc03b660 0x7f40dc007b80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009870 tx=0x7f40d801f1d0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 -- 172.21.15.2:0/133822163 shutdown_connections 2023-11-04T01:42:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 --2- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc03b660 0x7f40dc007b80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 --2- 172.21.15.2:0/133822163 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc0e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 -- 172.21.15.2:0/133822163 >> 172.21.15.2:0/133822163 conn(0x7f40dc055cd0 msgr2=0x7f40dc0560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:33.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.971+0000 7fb99effd640 1 -- 172.21.15.2:0/1352342673 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a006c270 con 0x7fb9a0161510 2023-11-04T01:42:33.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 -- 172.21.15.2:0/133822163 shutdown_connections 2023-11-04T01:42:33.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 -- 172.21.15.2:0/133822163 wait complete. 2023-11-04T01:42:33.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb99f7fe640 1 --2- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a006ba90 0x7fb9a00c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:33.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 Processor -- start 2023-11-04T01:42:33.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f92309640 1 --2- 172.21.15.2:0/3024091852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f8403c5b0 0x7f0f8403ca40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009870 tx=0x7f0f8801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da90b1da38d9a958 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:33.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== osd.5 v2:172.21.15.90:6816/315309868 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fc3ac071110 con 0x7fc3ac06e640 2023-11-04T01:42:33.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f90b06640 1 -- 172.21.15.2:0/3024091852 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880a88b0 con 0x7f0f8403c5b0 2023-11-04T01:42:33.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f90b06640 1 -- 172.21.15.2:0/3024091852 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f880a8a10 con 0x7f0f8403c5b0 2023-11-04T01:42:33.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f90b06640 1 -- 172.21.15.2:0/3024091852 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880a8da0 con 0x7f0f8403c5b0 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 -- start start 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71740caf10 0x7f71741ee290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71740ceaa0 0x7f71741ec720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7174159e70 0x7f71741ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71740c3300 con 0x7f71740ceaa0 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71740c6c40 con 0x7f7174159e70 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f717ada7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71741ed330 con 0x7f71740caf10 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71740caf10 0x7f71741ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:33.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71740caf10 0x7f71741ee290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49186/0 (socket says 172.21.15.2:49186) 2023-11-04T01:42:34.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 -- 172.21.15.2:0/2621345217 learned_addr learned my addr 172.21.15.2:0/2621345217 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7179344640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7174159e70 0x7f71741ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb99effd640 1 --2- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a0161510 0x7fb9a01618f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb990009e50 tx=0x7fb99001c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5478cf163ce5bd40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 -- 172.21.15.2:0/3024091852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f8403c5b0 msgr2=0x7f0f8403ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 --2- 172.21.15.2:0/3024091852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f8403c5b0 0x7f0f8403ca40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009870 tx=0x7f0f8801ecf0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa89659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa8900049f0 0x7fa890052fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:56164/0 (socket says 172.21.15.2:56164) 2023-11-04T01:42:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa89659c640 1 -- 172.21.15.2:0/2380805301 learned_addr learned my addr 172.21.15.2:0/2380805301 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa896d9d640 1 --2- 172.21.15.2:0/2380805301 >> v2:172.21.15.2:3300/0 conn(0x7fa8900df190 0x7fa890007320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa895d9b640 1 --2- 172.21.15.2:0/2380805301 >> v2:172.21.15.90:3300/0 conn(0x7fa89003ab50 0x7fa8900548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 -- 172.21.15.2:0/3024091852 shutdown_connections 2023-11-04T01:42:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 --2- 172.21.15.2:0/3024091852 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f8403c5b0 0x7f0f8403ca40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 --2- 172.21.15.2:0/3024091852 >> v2:172.21.15.2:3300/0 conn(0x7f0f84053ff0 0x7f0f8403c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 --2- 172.21.15.2:0/3024091852 >> v2:172.21.15.90:3300/0 conn(0x7f0f84053c10 0x7f0f84007290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 -- 172.21.15.2:0/3024091852 >> 172.21.15.2:0/3024091852 conn(0x7f0f840559e0 msgr2=0x7f0f84055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7173fff640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71740ceaa0 0x7f71741ec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa895d9b640 1 -- 172.21.15.2:0/2380805301 >> v2:172.21.15.2:3300/0 conn(0x7fa8900df190 msgr2=0x7fa890007320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa895d9b640 1 --2- 172.21.15.2:0/2380805301 >> v2:172.21.15.2:3300/0 conn(0x7fa8900df190 0x7fa890007320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa895d9b640 1 -- 172.21.15.2:0/2380805301 >> v1:172.21.15.90:6789/0 conn(0x7fa8900049f0 legacy=0x7fa890052fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fa895d9b640 1 -- 172.21.15.2:0/2380805301 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890053de0 con 0x7fa89003ab50 2023-11-04T01:42:34.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 -- 172.21.15.2:0/3024091852 shutdown_connections 2023-11-04T01:42:34.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f0f93d6c640 1 -- 172.21.15.2:0/3024091852 wait complete. 2023-11-04T01:42:34.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb99dffb640 1 -- 172.21.15.2:0/1352342673 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900a56f0 con 0x7fb9a0161510 2023-11-04T01:42:34.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb99dffb640 1 -- 172.21.15.2:0/1352342673 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9900a5850 con 0x7fb9a0161510 2023-11-04T01:42:34.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb99dffb640 1 -- 172.21.15.2:0/1352342673 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900a5be0 con 0x7fb9a0161510 2023-11-04T01:42:34.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a0161510 msgr2=0x7fb9a01618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 --2- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a0161510 0x7fb9a01618f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb990009e50 tx=0x7fb99001c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fee8d3a2640 1 --2- 172.21.15.2:0/2577135775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee880cba80 0x7fee880c8fb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee800097f0 tx=0x7fee8001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c65d03b4f2795 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fee877fe640 1 -- 172.21.15.2:0/2577135775 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80004230 con 0x7fee880cba80 2023-11-04T01:42:34.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1352342673 shutdown_connections 2023-11-04T01:42:34.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 --2- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a006ba90 0x7fb9a00c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 --2- 172.21.15.2:0/1352342673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a0161510 0x7fb9a01618f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1352342673 >> 172.21.15.2:0/1352342673 conn(0x7fb9a00cebb0 msgr2=0x7fb9a00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fee877fe640 1 -- 172.21.15.2:0/2577135775 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee800a7050 con 0x7fee880cba80 2023-11-04T01:42:34.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fee877fe640 1 -- 172.21.15.2:0/2577135775 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80003620 con 0x7fee880cba80 2023-11-04T01:42:34.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1352342673 shutdown_connections 2023-11-04T01:42:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 -- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7174159e70 msgr2=0x7f71741ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7174159e70 0x7f71741ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 -- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71740ceaa0 msgr2=0x7f71741ec720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71740ceaa0 0x7f71741ec720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f7178b43640 1 -- 172.21.15.2:0/2621345217 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716800b6c0 con 0x7f71740caf10 2023-11-04T01:42:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f7178b43640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71740caf10 0x7f71741ee290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f716c00cbc0 tx=0x7f716c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00aca0 con 0x7f71740caf10 2023-11-04T01:42:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c00ae00 con 0x7f71740caf10 2023-11-04T01:42:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c012600 con 0x7f71740caf10 2023-11-04T01:42:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fee8dba3640 1 -- 172.21.15.2:0/2577135775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee880cba80 msgr2=0x7fee880c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fee8dba3640 1 --2- 172.21.15.2:0/2577135775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee880cba80 0x7fee880c8fb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee800097f0 tx=0x7fee8001c4a0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1352342673 wait complete. 2023-11-04T01:42:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 Processor -- start 2023-11-04T01:42:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 -- start start 2023-11-04T01:42:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f717ada7640 1 -- 172.21.15.2:0/2621345217 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71741ed610 con 0x7f71740caf10 2023-11-04T01:42:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f717ada7640 1 -- 172.21.15.2:0/2621345217 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71740c6e50 con 0x7f71740caf10 2023-11-04T01:42:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f717ada7640 1 -- 172.21.15.2:0/2621345217 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7154000fd0 con 0x7f71740caf10 2023-11-04T01:42:34.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fa895d9b640 1 --2- 172.21.15.2:0/2380805301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89003ab50 0x7fa8900548c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa89000e0e0 tx=0x7fa888024b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b51b8ce07310615b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 Processor -- start 2023-11-04T01:42:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 -- start start 2023-11-04T01:42:34.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8403c5b0 0x7f0f84050ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f84053c10 0x7f0f8400ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f84053ff0 0x7f0f84188db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8400d380 con 0x7f0f8403c5b0 2023-11-04T01:42:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840516b0 con 0x7f0f84053ff0 2023-11-04T01:42:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f93d6c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84051990 con 0x7f0f84053c10 2023-11-04T01:42:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.975+0000 7f40e9aac640 1 Processor -- start 2023-11-04T01:42:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a006ba90 0x7fb9a0148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fee8dba3640 1 -- 172.21.15.2:0/2577135775 shutdown_connections 2023-11-04T01:42:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fee8dba3640 1 --2- 172.21.15.2:0/2577135775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee880cba80 0x7fee880c8fb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fee8dba3640 1 -- 172.21.15.2:0/2577135775 >> 172.21.15.2:0/2577135775 conn(0x7fee880b0550 msgr2=0x7fee880b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fee8dba3640 1 -- 172.21.15.2:0/2577135775 shutdown_connections 2023-11-04T01:42:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fee8dba3640 1 -- 172.21.15.2:0/2577135775 wait complete. 2023-11-04T01:42:34.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8403c5b0 0x7f0f84050ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8403c5b0 0x7f0f84050ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49680/0 (socket says 172.21.15.2:49680) 2023-11-04T01:42:34.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 -- 172.21.15.2:0/1811949861 learned_addr learned my addr 172.21.15.2:0/1811949861 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9a006f8f0 0x7fb9a014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a0161510 0x7fb9a0150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a01524e0 con 0x7fb9a006f8f0 2023-11-04T01:42:34.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a0152b50 con 0x7fb9a006ba90 2023-11-04T01:42:34.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb9a59f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a0152e30 con 0x7fb9a0161510 2023-11-04T01:42:34.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a006ba90 0x7fb9a0148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a006ba90 0x7fb9a0148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38486/0 (socket says 172.21.15.2:38486) 2023-11-04T01:42:34.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 -- 172.21.15.2:0/1372342591 learned_addr learned my addr 172.21.15.2:0/1372342591 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99f7fe640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a0161510 0x7fb9a0150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99e7fc640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9a006f8f0 0x7fb9a014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 -- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f84053c10 msgr2=0x7f0f8400ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f84053c10 0x7f0f8400ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 -- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f84053ff0 msgr2=0x7f0f84188db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f84053ff0 0x7f0f84188db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f0f91b08640 1 -- 172.21.15.2:0/1811949861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880094d0 con 0x7f0f8403c5b0 2023-11-04T01:42:34.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f0f91b08640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8403c5b0 0x7f0f84050ff0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00c7f0 tx=0x7f0f7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 -- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a0161510 msgr2=0x7fb9a0150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb9a0161510 0x7fb9a0150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 -- 172.21.15.2:0/1372342591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9a006f8f0 msgr2=0x7fb9a014faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9a006f8f0 0x7fb9a014faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fb99effd640 1 -- 172.21.15.2:0/1372342591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009b30 con 0x7fb9a006ba90 2023-11-04T01:42:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c004220 con 0x7f0f8403c5b0 2023-11-04T01:42:34.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7f40e9aac640 1 -- start start 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e9aac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc0080c0 0x7f40dc0d64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e9aac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40dc03b660 0x7f40dc0d8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e9aac640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc17db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e9aac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0d6a30 con 0x7f40dc03b660 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e9aac640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0df060 con 0x7f40dc0080c0 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e9aac640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0df2e0 con 0x7f40dc0e0040 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fa89559a640 1 -- 172.21.15.2:0/2380805301 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88800d2d0 con 0x7fa89003ab50 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fa89559a640 1 -- 172.21.15.2:0/2380805301 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880ad7e0 con 0x7fa89003ab50 2023-11-04T01:42:34.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.979+0000 7fa89559a640 1 -- 172.21.15.2:0/2380805301 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880adb70 con 0x7fa89003ab50 2023-11-04T01:42:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 Processor -- start 2023-11-04T01:42:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc17db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc17db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49204/0 (socket says 172.21.15.2:49204) 2023-11-04T01:42:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 -- 172.21.15.2:0/1188124901 learned_addr learned my addr 172.21.15.2:0/1188124901 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e8aaa640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc0080c0 0x7f40dc0d64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e3fff640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40dc03b660 0x7f40dc0d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 -- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc0080c0 msgr2=0x7f40dc0d64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40dc0080c0 0x7f40dc0d64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 -- 172.21.15.2:0/1188124901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40dc03b660 msgr2=0x7f40dc0d8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40dc03b660 0x7f40dc0d8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 -- 172.21.15.2:0/1188124901 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80094d0 con 0x7f40dc0e0040 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f716c007070 con 0x7f71740caf10 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f71717fa640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71600664d0 0x7f7160068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f716c0844b0 con 0x7f71740caf10 2023-11-04T01:42:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f71717fa640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:6821/3669990359,v1:172.21.15.2:6823/3669990359] conn(0x7f716006e6f0 0x7f7160070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 --> [v2:172.21.15.2:6821/3669990359,v1:172.21.15.2:6823/3669990359] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71600711c0 con 0x7f716006e6f0 2023-11-04T01:42:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f716c084860 con 0x7f71740caf10 2023-11-04T01:42:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f84051c70 con 0x7f0f8403c5b0 2023-11-04T01:42:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84052230 con 0x7f0f8403c5b0 2023-11-04T01:42:34.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e92ab640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc17db30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f40e4079b70 tx=0x7f40e4067570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c0043a0 con 0x7f0f8403c5b0 2023-11-04T01:42:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f7179344640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:6821/3669990359,v1:172.21.15.2:6823/3669990359] conn(0x7f716006e6f0 0x7f7160070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f7173fff640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71600664d0 0x7f7160068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fb99effd640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a006ba90 0x7fb9a0148060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb99001c7f0 tx=0x7fb990019760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f7179344640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:6821/3669990359,v1:172.21.15.2:6823/3669990359] conn(0x7f716006e6f0 0x7f7160070b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 -- 172.21.15.2:0/2380805301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89003ab50 msgr2=0x7fa8900548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 --2- 172.21.15.2:0/2380805301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89003ab50 0x7fa8900548c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa89000e0e0 tx=0x7fa888024b10 comp rx=0 tx=0).stop 2023-11-04T01:42:34.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 -- 172.21.15.2:0/2380805301 shutdown_connections 2023-11-04T01:42:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 --2- 172.21.15.2:0/2380805301 >> v2:172.21.15.2:3300/0 conn(0x7fa8900df190 0x7fa890007320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 --2- 172.21.15.2:0/2380805301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa89003ab50 0x7fa8900548c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 -- 172.21.15.2:0/2380805301 >> 172.21.15.2:0/2380805301 conn(0x7fa89000a3f0 msgr2=0x7fa89000a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 -- start start 2023-11-04T01:42:34.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee880cba80 0x7fee880714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88156ab0 0x7fee88155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee8815a220 0x7fee880c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88071080 con 0x7fee88156ab0 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88156430 con 0x7fee880cba80 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8dba3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee880c7230 con 0x7fee8815a220 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8cba1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee880cba80 0x7fee880714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8cba1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee880cba80 0x7fee880714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38506/0 (socket says 172.21.15.2:38506) 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8cba1640 1 -- 172.21.15.2:0/4198646954 learned_addr learned my addr 172.21.15.2:0/4198646954 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee8d3a2640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee8815a220 0x7fee880c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c003860 con 0x7f0f8403c5b0 2023-11-04T01:42:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee87fff640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88156ab0 0x7fee88155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 -- 172.21.15.2:0/2380805301 shutdown_connections 2023-11-04T01:42:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fa89759e640 1 -- 172.21.15.2:0/2380805301 wait complete. 2023-11-04T01:42:34.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e4072360 con 0x7f40dc0e0040 2023-11-04T01:42:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40724e0 con 0x7f40dc0e0040 2023-11-04T01:42:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900bd070 con 0x7fb9a006ba90 2023-11-04T01:42:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9900b8470 con 0x7fb9a006ba90 2023-11-04T01:42:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900b8820 con 0x7fb9a006ba90 2023-11-04T01:42:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a0153110 con 0x7fb9a006ba90 2023-11-04T01:42:34.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a0150930 con 0x7fb9a006ba90 2023-11-04T01:42:34.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee87fff640 1 -- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee8815a220 msgr2=0x7fee880c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee87fff640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fee8815a220 0x7fee880c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee87fff640 1 -- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee880cba80 msgr2=0x7fee880714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee87fff640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fee880cba80 0x7fee880714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.983+0000 7fee87fff640 1 -- 172.21.15.2:0/4198646954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80009420 con 0x7fee88156ab0 2023-11-04T01:42:34.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f7c003a80 con 0x7f0f8403c5b0 2023-11-04T01:42:34.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9a0160df0 con 0x7fb9a006ba90 2023-11-04T01:42:34.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee87fff640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88156ab0 0x7fee88155ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee7800bdf0 tx=0x7fee78009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== osd.2 v2:172.21.15.2:6821/3669990359 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f71600711c0 con 0x7f716006e6f0 2023-11-04T01:42:34.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40923b0 con 0x7f40dc0e0040 2023-11-04T01:42:34.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78014440 con 0x7fee88156ab0 2023-11-04T01:42:34.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 Processor -- start 2023-11-04T01:42:34.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f74000fd0 con 0x7f0f8403c5b0 2023-11-04T01:42:34.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc0df860 con 0x7f40dc0e0040 2023-11-04T01:42:34.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc0d6c50 con 0x7f40dc0e0040 2023-11-04T01:42:34.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f7173fff640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71600664d0 0x7f7160068990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71680b1000 tx=0x7f7168008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee780145c0 con 0x7fee88156ab0 2023-11-04T01:42:34.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78014970 con 0x7fee88156ab0 2023-11-04T01:42:34.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee880c6f50 con 0x7fee88156ab0 2023-11-04T01:42:34.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee88070ca0 con 0x7fee88156ab0 2023-11-04T01:42:34.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee880ae220 con 0x7fee88156ab0 2023-11-04T01:42:34.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40dc006a70 con 0x7f40dc0e0040 2023-11-04T01:42:34.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f0f827fc640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f70066570 0x7f0f70068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 -- start start 2023-11-04T01:42:34.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8900049f0 0x7fa8900d5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89003ab50 0x7fa8900d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f0f91307640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f70066570 0x7f0f70068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8900df190 0x7fa8900da2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8900049f0 0x7fa8900d5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89003ab50 0x7fa8900d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89004d7a0 con 0x7fa89003ab50 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89003ab50 0x7fa8900d9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49724/0 (socket says 172.21.15.2:49724) 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900e4430 con 0x7fa8900049f0 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 -- 172.21.15.2:0/2077204138 learned_addr learned my addr 172.21.15.2:0/2077204138 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900e38b0 con 0x7fa8900df190 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa896d9d640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8900df190 0x7fa8900da2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 -- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8900df190 msgr2=0x7fa8900da2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8900df190 0x7fa8900da2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 -- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8900049f0 msgr2=0x7fa8900d5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8900049f0 0x7fa8900d5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 -- 172.21.15.2:0/2077204138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88800d8c0 con 0x7fa89003ab50 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fa895d9b640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89003ab50 0x7fa8900d9d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa8880231c0 tx=0x7fa8880218b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee78014ad0 con 0x7fee88156ab0 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee740664a0 0x7fee74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee78084a70 con 0x7fee88156ab0 2023-11-04T01:42:34.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6808/151665990,v1:172.21.15.90:6809/151665990] conn(0x7fee7406e640 0x7fee74070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 --> [v2:172.21.15.90:6808/151665990,v1:172.21.15.90:6809/151665990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee74071110 con 0x7fee7406e640 2023-11-04T01:42:34.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee78084ec0 con 0x7fee88156ab0 2023-11-04T01:42:34.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9900b8980 con 0x7fb9a006ba90 2023-11-04T01:42:34.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40e4071040 con 0x7f40dc0e0040 2023-11-04T01:42:34.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fb987fff640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb98c0664a0 0x7fb98c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880be680 con 0x7fa89003ab50 2023-11-04T01:42:34.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f7c083b20 con 0x7f0f8403c5b0 2023-11-04T01:42:34.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.987+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb99011f630 con 0x7fb9a006ba90 2023-11-04T01:42:34.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fb987fff640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6800/3369299530,v1:172.21.15.90:6801/3369299530] conn(0x7fb98c06e640 0x7fb98c070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 --> [v2:172.21.15.90:6800/3369299530,v1:172.21.15.90:6801/3369299530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb98c071110 con 0x7fb98c06e640 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb99011fa80 con 0x7fb9a006ba90 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fee8cba1640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee740664a0 0x7fee74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f91307640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f70066570 0x7f0f70068a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c04fe40 tx=0x7f0f8c069fd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900e3b90 con 0x7fa89003ab50 2023-11-04T01:42:34.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900e4150 con 0x7fa89003ab50 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e17fa640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c8066570 0x7f40c8068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880be820 con 0x7fa89003ab50 2023-11-04T01:42:34.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40e40fe490 con 0x7f40dc0e0040 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fb99e7fc640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb98c0664a0 0x7fb98c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fb99f7fe640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6800/3369299530,v1:172.21.15.90:6801/3369299530] conn(0x7fb98c06e640 0x7fb98c070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fee8d3a2640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6808/151665990,v1:172.21.15.90:6809/151665990] conn(0x7fee7406e640 0x7fee74070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e8aaa640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c8066570 0x7f40c8068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e17fa640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6824/1846736802,v1:172.21.15.90:6825/1846736802] conn(0x7f40c806e620 0x7f40c8070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 --> [v2:172.21.15.90:6824/1846736802,v1:172.21.15.90:6825/1846736802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40c80710f0 con 0x7f40c806e620 2023-11-04T01:42:34.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40e40fe840 con 0x7f40dc0e0040 2023-11-04T01:42:34.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f827fc640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:6808/1112677023,v1:172.21.15.2:6809/1112677023] conn(0x7f0f7006e620 0x7f0f70070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 --> [v2:172.21.15.2:6808/1112677023,v1:172.21.15.2:6809/1112677023] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f700710f0 con 0x7f0f7006e620 2023-11-04T01:42:34.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f92309640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:6808/1112677023,v1:172.21.15.2:6809/1112677023] conn(0x7f0f7006e620 0x7f0f70070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e3fff640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6824/1846736802,v1:172.21.15.90:6825/1846736802] conn(0x7f40c806e620 0x7f40c8070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f92309640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:6808/1112677023,v1:172.21.15.2:6809/1112677023] conn(0x7f0f7006e620 0x7f0f70070a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880bebd0 con 0x7fa89003ab50 2023-11-04T01:42:34.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e8aaa640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c8066570 0x7f40c8068a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f40d0006fd0 tx=0x7f40d0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fee8d3a2640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6808/151665990,v1:172.21.15.90:6809/151665990] conn(0x7fee7406e640 0x7fee74070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f40e3fff640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6824/1846736802,v1:172.21.15.90:6825/1846736802] conn(0x7f40c806e620 0x7f40c8070a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fee8cba1640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee740664a0 0x7fee74068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0011f0 tx=0x7fee7c005dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fb99f7fe640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6800/3369299530,v1:172.21.15.90:6801/3369299530] conn(0x7fb98c06e640 0x7fb98c070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f7c0892e0 con 0x7f0f8403c5b0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa88800b450 con 0x7fa89003ab50 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa87c000fd0 con 0x7fa89003ab50 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fb99e7fc640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb98c0664a0 0x7fb98c068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0152150 tx=0x7fb994009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== osd.0 v2:172.21.15.2:6808/1112677023 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f0f700710f0 con 0x7f0f7006e620 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa888126df0 con 0x7fa89003ab50 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa89659c640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:6800/4067471271,v1:172.21.15.2:6801/4067471271] conn(0x7fa87806e500 0x7fa878070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa896d9d640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:6800/4067471271,v1:172.21.15.2:6801/4067471271] conn(0x7fa87806e500 0x7fa878070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa89659c640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa898000b70 tx=0x7fa898061e60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa896d9d640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:6800/4067471271,v1:172.21.15.2:6801/4067471271] conn(0x7fa87806e500 0x7fa878070920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.991+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 --> [v2:172.21.15.2:6800/4067471271,v1:172.21.15.2:6801/4067471271] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa878070fd0 con 0x7fa87806e500 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.995+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa88812c480 con 0x7fa89003ab50 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.995+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== osd.3 v2:172.21.15.2:6800/4067471271 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fa878070fd0 con 0x7fa87806e500 2023-11-04T01:42:34.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.995+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== osd.4 v2:172.21.15.90:6808/151665990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fee74071110 con 0x7fee7406e640 2023-11-04T01:42:34.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.995+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== osd.7 v2:172.21.15.90:6800/3369299530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7fb98c071110 con 0x7fb98c06e640 2023-11-04T01:42:34.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:33.995+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== osd.6 v2:172.21.15.90:6824/1846736802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f40c80710f0 con 0x7f40c806e620 2023-11-04T01:42:34.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.003+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 --> [v2:172.21.15.90:6816/315309868,v1:172.21.15.90:6817/315309868] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc3a0002cf0 con 0x7fc3ac06e640 2023-11-04T01:42:34.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.003+0000 7fc3a77fe640 1 -- 172.21.15.2:0/2291219765 <== osd.5 v2:172.21.15.90:6816/315309868 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc3a0002cf0 con 0x7fc3ac06e640 2023-11-04T01:42:34.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.003+0000 7f491f59e640 1 Processor -- start 2023-11-04T01:42:34.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.003+0000 7f491f59e640 1 -- start start 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491f59e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49180e7c10 0x7f4918056b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491f59e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4918055890 con 0x7f4918053590 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491f59e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4918057210 con 0x7f4918006160 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491f59e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49180574f0 con 0x7f49180e7c10 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491e59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4918053590 0x7f4918053970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52014/0 (socket says 172.21.15.2:52014) 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491e59c640 1 -- 172.21.15.2:0/3959877186 learned_addr learned my addr 172.21.15.2:0/3959877186 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491dd9b640 1 --2- 172.21.15.2:0/3959877186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49180e7c10 0x7f4918056b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6816/315309868,v1:172.21.15.90:6817/315309868] conn(0x7fc3ac06e640 msgr2=0x7fc3ac070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491d59a640 1 -- 172.21.15.2:0/3959877186 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962184553 0 0) 0x7f4918055890 con 0x7f4918053590 2023-11-04T01:42:34.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6816/315309868,v1:172.21.15.90:6817/315309868] conn(0x7fc3ac06e640 0x7fc3ac070a60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3ac0664a0 msgr2=0x7fc3ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3ac0664a0 0x7fc3ac068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00049e0 tx=0x7fc3b000b2a0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3c00cb830 msgr2=0x7fc3c01458e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 --2- 172.21.15.2:0/2291219765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3c00cb830 0x7fc3c01458e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400d800 tx=0x7fc3b400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3bf7fe640 1 -- 172.21.15.2:0/2291219765 reap_dead start 2023-11-04T01:42:34.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491dd9b640 1 -- 172.21.15.2:0/3959877186 >> v1:172.21.15.90:6789/0 conn(0x7f4918006160 legacy=0x7f49180065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491dd9b640 1 -- 172.21.15.2:0/3959877186 >> v1:172.21.15.2:6789/0 conn(0x7f4918053590 legacy=0x7f4918053970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7f491dd9b640 1 -- 172.21.15.2:0/3959877186 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49180577d0 con 0x7f49180e7c10 2023-11-04T01:42:34.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 shutdown_connections 2023-11-04T01:42:34.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 >> 172.21.15.2:0/2291219765 conn(0x7fc3c00b0550 msgr2=0x7fc3c006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 shutdown_connections 2023-11-04T01:42:34.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.007+0000 7fc3c577e640 1 -- 172.21.15.2:0/2291219765 wait complete. 2023-11-04T01:42:34.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491dd9b640 1 --2- 172.21.15.2:0/3959877186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49180e7c10 0x7f4918056b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f492002ccf0 tx=0x7f491001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db293fe775a360b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491d59a640 1 -- 172.21.15.2:0/3959877186 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49100ab600 con 0x7f49180e7c10 2023-11-04T01:42:34.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491d59a640 1 -- 172.21.15.2:0/3959877186 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49100a7050 con 0x7f49180e7c10 2023-11-04T01:42:34.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f717ada7640 1 -- 172.21.15.2:0/2621345217 --> [v2:172.21.15.2:6821/3669990359,v1:172.21.15.2:6823/3669990359] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7154002cc0 con 0x7f716006e6f0 2023-11-04T01:42:34.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491f59e640 1 -- 172.21.15.2:0/3959877186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49180e7c10 msgr2=0x7f4918056b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491f59e640 1 --2- 172.21.15.2:0/3959877186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49180e7c10 0x7f4918056b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f492002ccf0 tx=0x7f491001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f71717fa640 1 -- 172.21.15.2:0/2621345217 <== osd.2 v2:172.21.15.2:6821/3669990359 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7154002cc0 con 0x7f716006e6f0 2023-11-04T01:42:34.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491f59e640 1 -- 172.21.15.2:0/3959877186 shutdown_connections 2023-11-04T01:42:34.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491f59e640 1 --2- 172.21.15.2:0/3959877186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f49180e7c10 0x7f4918056b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491f59e640 1 -- 172.21.15.2:0/3959877186 >> 172.21.15.2:0/3959877186 conn(0x7f491800e5b0 msgr2=0x7f491800e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491f59e640 1 -- 172.21.15.2:0/3959877186 shutdown_connections 2023-11-04T01:42:34.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 --> [v2:172.21.15.2:6808/1112677023,v1:172.21.15.2:6809/1112677023] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f74002cb0 con 0x7f0f7006e620 2023-11-04T01:42:34.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 --> [v2:172.21.15.90:6808/151665990,v1:172.21.15.90:6809/151665990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee8815d990 con 0x7fee7406e640 2023-11-04T01:42:34.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f827fc640 1 -- 172.21.15.2:0/1811949861 <== osd.0 v2:172.21.15.2:6808/1112677023 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f74002cb0 con 0x7f0f7006e620 2023-11-04T01:42:34.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.011+0000 7f491f59e640 1 -- 172.21.15.2:0/3959877186 wait complete. 2023-11-04T01:42:34.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 -- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:6821/3669990359,v1:172.21.15.2:6823/3669990359] conn(0x7f716006e6f0 msgr2=0x7f7160070b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.2:6821/3669990359,v1:172.21.15.2:6823/3669990359] conn(0x7f716006e6f0 0x7f7160070b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee857fa640 1 -- 172.21.15.2:0/4198646954 <== osd.4 v2:172.21.15.90:6808/151665990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee80004230 con 0x7fee7406e640 2023-11-04T01:42:34.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 -- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71600664d0 msgr2=0x7f7160068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71600664d0 0x7f7160068990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f71680b1000 tx=0x7f7168008040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 Processor -- start 2023-11-04T01:42:34.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 -- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71740caf10 msgr2=0x7f71741ee290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 --2- 172.21.15.2:0/2621345217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71740caf10 0x7f71741ee290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f716c00cbc0 tx=0x7f716c00a060 comp rx=0 tx=0).stop 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f7179344640 1 -- 172.21.15.2:0/2621345217 reap_dead start 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 -- 172.21.15.2:0/2621345217 shutdown_connections 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 -- 172.21.15.2:0/2621345217 >> 172.21.15.2:0/2621345217 conn(0x7f717406e760 msgr2=0x7f71740cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 -- 172.21.15.2:0/2621345217 shutdown_connections 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f715affd640 1 -- 172.21.15.2:0/2621345217 wait complete. 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6808/151665990,v1:172.21.15.90:6809/151665990] conn(0x7fee7406e640 msgr2=0x7fee74070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6808/151665990,v1:172.21.15.90:6809/151665990] conn(0x7fee7406e640 0x7fee74070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee740664a0 msgr2=0x7fee74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee740664a0 0x7fee74068960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee7c0011f0 tx=0x7fee7c005dc0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88156ab0 msgr2=0x7fee88155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 --2- 172.21.15.2:0/4198646954 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee88156ab0 0x7fee88155ef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fee7800bdf0 tx=0x7fee78009f70 comp rx=0 tx=0).stop 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8d3a2640 1 -- 172.21.15.2:0/4198646954 reap_dead start 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 shutdown_connections 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 >> 172.21.15.2:0/4198646954 conn(0x7fee880b0550 msgr2=0x7fee8815bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 -- start start 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:6808/1112677023,v1:172.21.15.2:6809/1112677023] conn(0x7f0f7006e620 msgr2=0x7f0f70070a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:6808/1112677023,v1:172.21.15.2:6809/1112677023] conn(0x7f0f7006e620 0x7f0f70070a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 shutdown_connections 2023-11-04T01:42:34.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7fee8dba3640 1 -- 172.21.15.2:0/4198646954 wait complete. 2023-11-04T01:42:34.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f70066570 msgr2=0x7f0f70068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f70066570 0x7f0f70068a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c04fe40 tx=0x7f0f8c069fd0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8403c5b0 msgr2=0x7f0f84050ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 --2- 172.21.15.2:0/1811949861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8403c5b0 0x7f0f84050ff0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00c7f0 tx=0x7f0f7c00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f92309640 1 -- 172.21.15.2:0/1811949861 reap_dead start 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4918006160 0x7f49180dc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4918053590 0x7f49180dcff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49180e7c10 0x7f49180dd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180e9940 con 0x7f4918053590 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180e9dd0 con 0x7f49180e7c10 2023-11-04T01:42:34.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491f59e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49180e8d30 con 0x7f4918006160 2023-11-04T01:42:34.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 shutdown_connections 2023-11-04T01:42:34.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 >> 172.21.15.2:0/1811949861 conn(0x7f0f840559e0 msgr2=0x7f0f840e5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 shutdown_connections 2023-11-04T01:42:34.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f0f93d6c640 1 -- 172.21.15.2:0/1811949861 wait complete. 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4918053590 0x7f49180dcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4918053590 0x7f49180dcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49726/0 (socket says 172.21.15.2:49726) 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491dd9b640 1 -- 172.21.15.2:0/1484027745 learned_addr learned my addr 172.21.15.2:0/1484027745 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491e59c640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4918006160 0x7f49180dc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.015+0000 7f491ed9d640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49180e7c10 0x7f49180dd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491e59c640 1 -- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49180e7c10 msgr2=0x7f49180dd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491e59c640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f49180e7c10 0x7f49180dd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491e59c640 1 -- 172.21.15.2:0/1484027745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4918053590 msgr2=0x7f49180dcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491e59c640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4918053590 0x7f49180dcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491e59c640 1 -- 172.21.15.2:0/1484027745 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910009420 con 0x7f4918006160 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491e59c640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4918006160 0x7f49180dc020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f491400c410 tx=0x7f491400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f490effd640 1 -- 172.21.15.2:0/1484027745 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140074e0 con 0x7f4918006160 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f490effd640 1 -- 172.21.15.2:0/1484027745 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914007640 con 0x7f4918006160 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49180e9010 con 0x7f4918006160 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f490effd640 1 -- 172.21.15.2:0/1484027745 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914004a30 con 0x7f4918006160 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49180e95d0 con 0x7f4918006160 2023-11-04T01:42:34.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.019+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 --> [v2:172.21.15.90:6800/3369299530,v1:172.21.15.90:6801/3369299530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9a00c8e30 con 0x7fb98c06e640 2023-11-04T01:42:34.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7f490effd640 1 -- 172.21.15.2:0/1484027745 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4914004b90 con 0x7f4918006160 2023-11-04T01:42:34.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7f490effd640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49000664a0 0x7f4900068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7f490effd640 1 -- 172.21.15.2:0/1484027745 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4914083c30 con 0x7f4918006160 2023-11-04T01:42:34.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7f491dd9b640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49000664a0 0x7f4900068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7f491dd9b640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49000664a0 0x7f4900068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f491001c400 tx=0x7f49100a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 --> [v2:172.21.15.2:6800/4067471271,v1:172.21.15.2:6801/4067471271] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa87c002cc0 con 0x7fa87806e500 2023-11-04T01:42:34.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7fa886ffd640 1 -- 172.21.15.2:0/2077204138 <== osd.3 v2:172.21.15.2:6800/4067471271 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa87c002cc0 con 0x7fa87806e500 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:6800/4067471271,v1:172.21.15.2:6801/4067471271] conn(0x7fa87806e500 msgr2=0x7fa878070920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7fa89759e640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:6800/4067471271,v1:172.21.15.2:6801/4067471271] conn(0x7fa87806e500 0x7fa878070920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 msgr2=0x7fa878068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.023+0000 7fa89759e640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa898000b70 tx=0x7fa898061e60 comp rx=0 tx=0).stop 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89003ab50 msgr2=0x7fa8900d9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7fa89759e640 1 --2- 172.21.15.2:0/2077204138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa89003ab50 0x7fa8900d9d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa8880231c0 tx=0x7fa8880218b0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7fa896d9d640 1 -- 172.21.15.2:0/2077204138 reap_dead start 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 shutdown_connections 2023-11-04T01:42:34.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 >> 172.21.15.2:0/2077204138 conn(0x7fa89000a3f0 msgr2=0x7fa8900de100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7f491f59e640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.2:6816/1987543960,v1:172.21.15.2:6817/1987543960] conn(0x7f49180eaa50 0x7f49180eae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 --> [v2:172.21.15.2:6816/1987543960,v1:172.21.15.2:6817/1987543960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49180057e0 con 0x7f49180eaa50 2023-11-04T01:42:34.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7f491ed9d640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.2:6816/1987543960,v1:172.21.15.2:6817/1987543960] conn(0x7f49180eaa50 0x7f49180eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7f491ed9d640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.2:6816/1987543960,v1:172.21.15.2:6817/1987543960] conn(0x7f49180eaa50 0x7f49180eae30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 shutdown_connections 2023-11-04T01:42:34.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7fa89759e640 1 -- 172.21.15.2:0/2077204138 wait complete. 2023-11-04T01:42:34.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.027+0000 7f490effd640 1 -- 172.21.15.2:0/1484027745 <== osd.1 v2:172.21.15.2:6816/1987543960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26745 (crc 0 0 0) 0x7f49180057e0 con 0x7f49180eaa50 2023-11-04T01:42:34.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb987fff640 1 -- 172.21.15.2:0/1372342591 <== osd.7 v2:172.21.15.90:6800/3369299530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9a00c8e30 con 0x7fb98c06e640 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6800/3369299530,v1:172.21.15.90:6801/3369299530] conn(0x7fb98c06e640 msgr2=0x7fb98c070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6800/3369299530,v1:172.21.15.90:6801/3369299530] conn(0x7fb98c06e640 0x7fb98c070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb98c0664a0 msgr2=0x7fb98c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb98c0664a0 0x7fb98c068960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0152150 tx=0x7fb994009040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a006ba90 msgr2=0x7fb9a0148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 --2- 172.21.15.2:0/1372342591 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9a006ba90 0x7fb9a0148060 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb99001c7f0 tx=0x7fb990019760 comp rx=0 tx=0).stop 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb99f7fe640 1 -- 172.21.15.2:0/1372342591 reap_dead start 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 shutdown_connections 2023-11-04T01:42:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 >> 172.21.15.2:0/1372342591 conn(0x7fb9a00cebb0 msgr2=0x7fb9a00cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 --> [v2:172.21.15.90:6824/1846736802,v1:172.21.15.90:6825/1846736802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40dc0057e0 con 0x7f40c806e620 2023-11-04T01:42:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 shutdown_connections 2023-11-04T01:42:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7fb9a59f8640 1 -- 172.21.15.2:0/1372342591 wait complete. 2023-11-04T01:42:34.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e17fa640 1 -- 172.21.15.2:0/1188124901 <== osd.6 v2:172.21.15.90:6824/1846736802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f40dc0057e0 con 0x7f40c806e620 2023-11-04T01:42:34.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6824/1846736802,v1:172.21.15.90:6825/1846736802] conn(0x7f40c806e620 msgr2=0x7f40c8070a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6824/1846736802,v1:172.21.15.90:6825/1846736802] conn(0x7f40c806e620 0x7f40c8070a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c8066570 msgr2=0x7f40c8068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c8066570 0x7f40c8068a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f40d0006fd0 tx=0x7f40d0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 msgr2=0x7f40dc17db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 --2- 172.21.15.2:0/1188124901 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40dc0e0040 0x7f40dc17db30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f40e4079b70 tx=0x7f40e4067570 comp rx=0 tx=0).stop 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e92ab640 1 -- 172.21.15.2:0/1188124901 reap_dead start 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 shutdown_connections 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.031+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 >> 172.21.15.2:0/1188124901 conn(0x7f40dc055cd0 msgr2=0x7f40dc036d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.035+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 shutdown_connections 2023-11-04T01:42:34.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.035+0000 7f40e9aac640 1 -- 172.21.15.2:0/1188124901 wait complete. 2023-11-04T01:42:34.072 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:34.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:42:34.073 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2023-11-04T01:42:34.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:42:34.074 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:34.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:42:34.075 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:34.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:42:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 --> [v2:172.21.15.2:6816/1987543960,v1:172.21.15.2:6817/1987543960] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f491800df40 con 0x7f49180eaa50 2023-11-04T01:42:34.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f490effd640 1 -- 172.21.15.2:0/1484027745 <== osd.1 v2:172.21.15.2:6816/1987543960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f491800df40 con 0x7f49180eaa50 2023-11-04T01:42:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 >> [v2:172.21.15.2:6816/1987543960,v1:172.21.15.2:6817/1987543960] conn(0x7f49180eaa50 msgr2=0x7f49180eae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.2:6816/1987543960,v1:172.21.15.2:6817/1987543960] conn(0x7f49180eaa50 0x7f49180eae30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49000664a0 msgr2=0x7f4900068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49000664a0 0x7f4900068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f491001c400 tx=0x7f49100a6000 comp rx=0 tx=0).stop 2023-11-04T01:42:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4918006160 msgr2=0x7f49180dc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 --2- 172.21.15.2:0/1484027745 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4918006160 0x7f49180dc020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f491400c410 tx=0x7f491400c810 comp rx=0 tx=0).stop 2023-11-04T01:42:34.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491ed9d640 1 -- 172.21.15.2:0/1484027745 reap_dead start 2023-11-04T01:42:34.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 shutdown_connections 2023-11-04T01:42:34.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 >> 172.21.15.2:0/1484027745 conn(0x7f491800e5b0 msgr2=0x7f49180065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 shutdown_connections 2023-11-04T01:42:34.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.051+0000 7f491f59e640 1 -- 172.21.15.2:0/1484027745 wait complete. 2023-11-04T01:42:34.079 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:34.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:42:34.080 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:34.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:42:34.081 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:34.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:42:34.082 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2023-11-04T01:42:34.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c74e5640 1 Processor -- start 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c74e5640 1 -- start start 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c74e5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff1c00ad990 0x7ff1c006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c74e5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00c9050 0x7ff1c00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c74e5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c006d1e0 con 0x7ff1c00add70 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c74e5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c00ce800 con 0x7ff1c00ad990 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c74e5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00c94f0 con 0x7ff1c00c9050 2023-11-04T01:42:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c5a82640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff1c00add70 0x7ff1c00cc5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52026/0 (socket says 172.21.15.2:52026) 2023-11-04T01:42:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c5a82640 1 -- 172.21.15.2:0/1702870786 learned_addr learned my addr 172.21.15.2:0/1702870786 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c4a80640 1 --2- 172.21.15.2:0/1702870786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00c9050 0x7ff1c00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.267+0000 7ff1c5281640 1 --2- 172.21.15.2:0/1702870786 >> v2:172.21.15.90:3300/0 conn(0x7ff1c00ad990 0x7ff1c006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.271+0000 7ff1c4a80640 1 -- 172.21.15.2:0/1702870786 >> v2:172.21.15.90:3300/0 conn(0x7ff1c00ad990 msgr2=0x7ff1c006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.271+0000 7ff1c4a80640 1 --2- 172.21.15.2:0/1702870786 >> v2:172.21.15.90:3300/0 conn(0x7ff1c00ad990 0x7ff1c006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.271+0000 7ff1c4a80640 1 -- 172.21.15.2:0/1702870786 >> v1:172.21.15.2:6789/0 conn(0x7ff1c00add70 legacy=0x7ff1c00cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.271+0000 7ff1c4a80640 1 -- 172.21.15.2:0/1702870786 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c00cab30 con 0x7ff1c00c9050 2023-11-04T01:42:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.271+0000 7ff1c4a80640 1 --2- 172.21.15.2:0/1702870786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00c9050 0x7ff1c00cb3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00aa30 tx=0x7ff1bc024f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26bc5dc3166e8e66 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.271+0000 7ff1b7fff640 1 -- 172.21.15.2:0/1702870786 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0b6410 con 0x7ff1c00c9050 2023-11-04T01:42:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.271+0000 7ff1b7fff640 1 -- 172.21.15.2:0/1702870786 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc0b0030 con 0x7ff1c00c9050 2023-11-04T01:42:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1b7fff640 1 -- 172.21.15.2:0/1702870786 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0b67b0 con 0x7ff1c00c9050 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 -- 172.21.15.2:0/1702870786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00c9050 msgr2=0x7ff1c00cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/1702870786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00c9050 0x7ff1c00cb3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00aa30 tx=0x7ff1bc024f40 comp rx=0 tx=0).stop 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 -- 172.21.15.2:0/1702870786 shutdown_connections 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/1702870786 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00c9050 0x7ff1c00cb3e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/1702870786 >> v2:172.21.15.90:3300/0 conn(0x7ff1c00ad990 0x7ff1c006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 -- 172.21.15.2:0/1702870786 >> 172.21.15.2:0/1702870786 conn(0x7ff1c00b0550 msgr2=0x7ff1c00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 -- 172.21.15.2:0/1702870786 shutdown_connections 2023-11-04T01:42:34.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 -- 172.21.15.2:0/1702870786 wait complete. 2023-11-04T01:42:34.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 Processor -- start 2023-11-04T01:42:34.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.275+0000 7ff1c74e5640 1 -- start start 2023-11-04T01:42:34.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00ad990 0x7ff1c00c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1c00add70 0x7ff1c0166780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1c00c9050 0x7ff1c00c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00c47e0 con 0x7ff1c00add70 2023-11-04T01:42:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00c3e10 con 0x7ff1c00c9050 2023-11-04T01:42:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c00c2f20 con 0x7ff1c00ad990 2023-11-04T01:42:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1c00add70 0x7ff1c0166780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1c00add70 0x7ff1c0166780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49738/0 (socket says 172.21.15.2:49738) 2023-11-04T01:42:34.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 -- 172.21.15.2:0/812624025 learned_addr learned my addr 172.21.15.2:0/812624025 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c5281640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00ad990 0x7ff1c00c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c5a82640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1c00c9050 0x7ff1c00c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 -- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00ad990 msgr2=0x7ff1c00c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00ad990 0x7ff1c00c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 -- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1c00c9050 msgr2=0x7ff1c00c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1c00c9050 0x7ff1c00c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 -- 172.21.15.2:0/812624025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc00a630 con 0x7ff1c00add70 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c5a82640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1c00c9050 0x7ff1c00c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:34.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c4a80640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1c00add70 0x7ff1c0166780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0235f0 tx=0x7ff1bc00a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1b5ffb640 1 -- 172.21.15.2:0/812624025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc003970 con 0x7ff1c00add70 2023-11-04T01:42:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1b5ffb640 1 -- 172.21.15.2:0/812624025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc003ad0 con 0x7ff1c00add70 2023-11-04T01:42:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1b5ffb640 1 -- 172.21.15.2:0/812624025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc003e40 con 0x7ff1c00add70 2023-11-04T01:42:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c00c3200 con 0x7ff1c00add70 2023-11-04T01:42:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c00c37c0 con 0x7ff1c00add70 2023-11-04T01:42:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.279+0000 7ff1a37fe640 1 -- 172.21.15.2:0/812624025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c005260 con 0x7ff1c00add70 2023-11-04T01:42:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.283+0000 7ff1b5ffb640 1 -- 172.21.15.2:0/812624025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1bc0bd070 con 0x7ff1c00add70 2023-11-04T01:42:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.283+0000 7ff1b5ffb640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1a40664a0 0x7ff1a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.283+0000 7ff1c5281640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1a40664a0 0x7ff1a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.283+0000 7ff1c5281640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1a40664a0 0x7ff1a4068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00b3a20 tx=0x7ff1b800f040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.287+0000 7f27ee527640 1 Processor -- start 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.287+0000 7f1884cb2640 1 Processor -- start 2023-11-04T01:42:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.287+0000 7f27ee527640 1 -- start start 2023-11-04T01:42:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff1b5ffb640 1 -- 172.21.15.2:0/812624025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1bc0f7760 con 0x7ff1c00add70 2023-11-04T01:42:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.287+0000 7f1884cb2640 1 -- start start 2023-11-04T01:42:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f1884cb2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1880161770 0x7f188006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ee527640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27e8159a50 0x7f27e8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f1884cb2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188006d320 con 0x7f18800cdee0 2023-11-04T01:42:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f1884cb2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188006e9d0 con 0x7f18800d0430 2023-11-04T01:42:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f1884cb2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1880161b50 con 0x7f1880161770 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ee527640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e80706a0 con 0x7f27e8071070 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ee527640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e815da30 con 0x7f27e80cba80 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ee527640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e815ad70 con 0x7f27e8159a50 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ed525640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27e8159a50 0x7f27e8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ed525640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27e8159a50 0x7f27e8070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49744/0 (socket says 172.21.15.2:49744) 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ed525640 1 -- 172.21.15.2:0/2349601522 learned_addr learned my addr 172.21.15.2:0/2349601522 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f187ed9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f18800cdee0 0x7f1880165220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52044/0 (socket says 172.21.15.2:52044) 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f187ed9d640 1 -- 172.21.15.2:0/2352034591 learned_addr learned my addr 172.21.15.2:0/2352034591 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f187e59c640 1 --2- 172.21.15.2:0/2352034591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1880161770 0x7f188006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 Processor -- start 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff1b5ffb640 1 -- 172.21.15.2:0/812624025 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff1bc0f3aa0 con 0x7ff1c00add70 2023-11-04T01:42:34.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e9ed640 1 Processor -- start 2023-11-04T01:42:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e9ed640 1 -- start start 2023-11-04T01:42:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 -- start start 2023-11-04T01:42:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ed525640 1 -- 172.21.15.2:0/2349601522 >> v1:172.21.15.90:6789/0 conn(0x7f27e80cba80 legacy=0x7f27e80c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27dffff640 1 -- 172.21.15.2:0/2349601522 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663065061 0 0) 0x7f27e815da30 con 0x7f27e80cba80 2023-11-04T01:42:34.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ed525640 1 -- 172.21.15.2:0/2349601522 >> v1:172.21.15.2:6789/0 conn(0x7f27e8071070 legacy=0x7f27e80cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f27ed525640 1 -- 172.21.15.2:0/2349601522 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e815b050 con 0x7f27e8159a50 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e9ed640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c780ca8a0 0x7f9c7806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e9ed640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c7806bfb0 0x7f9c7816d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e9ed640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780ce7c0 con 0x7f9c7808a3f0 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e9ed640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7808a7d0 con 0x7f9c7806bfb0 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e9ed640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c780c9050 con 0x7f9c780ca8a0 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7d1ea640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c780ca8a0 0x7f9c7806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7d9eb640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9c7808a3f0 0x7f9c78070fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:56216/0 (socket says 172.21.15.2:56216) 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7d9eb640 1 -- 172.21.15.2:0/2059217744 learned_addr learned my addr 172.21.15.2:0/2059217744 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8007f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff5d803a2c0 0x7ff5d803a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5d803ac60 0x7ff5d80e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d8006b20 con 0x7ff5d803ac60 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d803b0b0 con 0x7ff5d803a2c0 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5e51de640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8051c90 con 0x7ff5d8054a60 2023-11-04T01:42:34.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7e1ec640 1 --2- 172.21.15.2:0/2059217744 >> v2:172.21.15.2:3300/0 conn(0x7f9c7806bfb0 0x7f9c7816d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8007f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8007f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49278/0 (socket says 172.21.15.2:49278) 2023-11-04T01:42:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7ff5dffff640 1 -- 172.21.15.2:0/1876950000 learned_addr learned my addr 172.21.15.2:0/1876950000 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7c9e9640 1 -- 172.21.15.2:0/2059217744 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799696321 0 0) 0x7f9c74001120 con 0x7f9c7808a3f0 2023-11-04T01:42:34.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f9c7c9e9640 1 -- 172.21.15.2:0/2059217744 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c64003530 con 0x7f9c7808a3f0 2023-11-04T01:42:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5dffff640 1 -- 172.21.15.2:0/1876950000 >> v2:172.21.15.90:3300/0 conn(0x7ff5d803a2c0 msgr2=0x7ff5d803a720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:42:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5dffff640 1 --2- 172.21.15.2:0/1876950000 >> v2:172.21.15.90:3300/0 conn(0x7ff5d803a2c0 0x7ff5d803a720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5dffff640 1 -- 172.21.15.2:0/1876950000 >> v2:172.21.15.2:3300/0 conn(0x7ff5d803ac60 msgr2=0x7ff5d80e7af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:42:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5e49dd640 1 --2- 172.21.15.2:0/1876950000 >> v2:172.21.15.2:3300/0 conn(0x7ff5d803ac60 0x7ff5d80e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5dffff640 1 --2- 172.21.15.2:0/1876950000 >> v2:172.21.15.2:3300/0 conn(0x7ff5d803ac60 0x7ff5d80e7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5dffff640 1 -- 172.21.15.2:0/1876950000 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8006280 con 0x7ff5d8054a60 2023-11-04T01:42:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27ed525640 1 --2- 172.21.15.2:0/2349601522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8159a50 0x7f27e8070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009870 tx=0x7f27e401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b75ec65084770d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f187e59c640 1 -- 172.21.15.2:0/2352034591 >> v1:172.21.15.90:6789/0 conn(0x7f18800d0430 legacy=0x7f18800cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f187e59c640 1 -- 172.21.15.2:0/2352034591 >> v1:172.21.15.2:6789/0 conn(0x7f18800cdee0 legacy=0x7f1880165220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.291+0000 7f187e59c640 1 -- 172.21.15.2:0/2352034591 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188006cd60 con 0x7f1880161770 2023-11-04T01:42:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5e49dd640 1 --2- 172.21.15.2:0/1876950000 >> v2:172.21.15.2:3300/0 conn(0x7ff5d803ac60 0x7ff5d80e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7d1ea640 1 -- 172.21.15.2:0/2059217744 >> v2:172.21.15.2:3300/0 conn(0x7f9c7806bfb0 msgr2=0x7f9c7816d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7d1ea640 1 --2- 172.21.15.2:0/2059217744 >> v2:172.21.15.2:3300/0 conn(0x7f9c7806bfb0 0x7f9c7816d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7d1ea640 1 -- 172.21.15.2:0/2059217744 >> v1:172.21.15.90:6789/0 conn(0x7f9c7808a3f0 legacy=0x7f9c78070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7d1ea640 1 -- 172.21.15.2:0/2059217744 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780ce200 con 0x7f9c780ca8a0 2023-11-04T01:42:34.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27dffff640 1 -- 172.21.15.2:0/2349601522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40aa670 con 0x7f27e8159a50 2023-11-04T01:42:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f187e59c640 1 --2- 172.21.15.2:0/2352034591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1880161770 0x7f188006e490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1878009dc0 tx=0x7f187801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0c8fdb6f3f1c505 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27dffff640 1 -- 172.21.15.2:0/2349601522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e40aa7d0 con 0x7f27e8159a50 2023-11-04T01:42:34.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27dffff640 1 -- 172.21.15.2:0/2349601522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40aab60 con 0x7f27e8159a50 2023-11-04T01:42:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f187d59a640 1 -- 172.21.15.2:0/2352034591 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18780a5a20 con 0x7f1880161770 2023-11-04T01:42:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f187d59a640 1 -- 172.21.15.2:0/2352034591 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18780a5b80 con 0x7f1880161770 2023-11-04T01:42:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f187d59a640 1 -- 172.21.15.2:0/2352034591 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18780ad440 con 0x7f1880161770 2023-11-04T01:42:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27ee527640 1 -- 172.21.15.2:0/2349601522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8159a50 msgr2=0x7f27e8070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27ee527640 1 --2- 172.21.15.2:0/2349601522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8159a50 0x7f27e8070b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009870 tx=0x7f27e401c510 comp rx=0 tx=0).stop 2023-11-04T01:42:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7d1ea640 1 --2- 172.21.15.2:0/2059217744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 0x7f9c7806ba70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c7806d650 tx=0x7f9c6801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99a772941a0b8595 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7c9e9640 1 -- 172.21.15.2:0/2059217744 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680ab600 con 0x7f9c780ca8a0 2023-11-04T01:42:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f1884cb2640 1 -- 172.21.15.2:0/2352034591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1880161770 msgr2=0x7f188006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f1884cb2640 1 --2- 172.21.15.2:0/2352034591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1880161770 0x7f188006e490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1878009dc0 tx=0x7f187801c980 comp rx=0 tx=0).stop 2023-11-04T01:42:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7c9e9640 1 -- 172.21.15.2:0/2059217744 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c680a7050 con 0x7f9c780ca8a0 2023-11-04T01:42:34.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f9c7c9e9640 1 -- 172.21.15.2:0/2059217744 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680ab980 con 0x7f9c780ca8a0 2023-11-04T01:42:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27ee527640 1 -- 172.21.15.2:0/2349601522 shutdown_connections 2023-11-04T01:42:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27ee527640 1 --2- 172.21.15.2:0/2349601522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8159a50 0x7f27e8070b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f27ee527640 1 -- 172.21.15.2:0/2349601522 >> 172.21.15.2:0/2349601522 conn(0x7f27e80b0550 msgr2=0x7f27e80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f1884cb2640 1 -- 172.21.15.2:0/2352034591 shutdown_connections 2023-11-04T01:42:34.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f1884cb2640 1 --2- 172.21.15.2:0/2352034591 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1880161770 0x7f188006e490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f1884cb2640 1 -- 172.21.15.2:0/2352034591 >> 172.21.15.2:0/2352034591 conn(0x7f18800b28f0 msgr2=0x7f18800b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f1884cb2640 1 -- 172.21.15.2:0/2352034591 shutdown_connections 2023-11-04T01:42:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7ff5dffff640 1 --2- 172.21.15.2:0/1876950000 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8007f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800dee0 tx=0x7ff5d401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d26a086915196b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.295+0000 7f1884cb2640 1 -- 172.21.15.2:0/2352034591 wait complete. 2023-11-04T01:42:34.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5deffd640 1 -- 172.21.15.2:0/1876950000 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40ac630 con 0x7ff5d8054a60 2023-11-04T01:42:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2059217744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 msgr2=0x7f9c7806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2059217744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 0x7f9c7806ba70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c7806d650 tx=0x7f9c6801c450 comp rx=0 tx=0).stop 2023-11-04T01:42:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2059217744 shutdown_connections 2023-11-04T01:42:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2059217744 >> v2:172.21.15.2:3300/0 conn(0x7f9c7806bfb0 0x7f9c7816d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2059217744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 0x7f9c7806ba70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2059217744 >> 172.21.15.2:0/2059217744 conn(0x7f9c780b0550 msgr2=0x7f9c780b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2059217744 shutdown_connections 2023-11-04T01:42:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5deffd640 1 -- 172.21.15.2:0/1876950000 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d40ac790 con 0x7ff5d8054a60 2023-11-04T01:42:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 -- 172.21.15.2:0/1876950000 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 msgr2=0x7ff5d8007f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 --2- 172.21.15.2:0/1876950000 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8007f60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800dee0 tx=0x7ff5d401c520 comp rx=0 tx=0).stop 2023-11-04T01:42:34.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2059217744 wait complete. 2023-11-04T01:42:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f27ee527640 1 -- 172.21.15.2:0/2349601522 shutdown_connections 2023-11-04T01:42:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f27ee527640 1 -- 172.21.15.2:0/2349601522 wait complete. 2023-11-04T01:42:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 Processor -- start 2023-11-04T01:42:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 Processor -- start 2023-11-04T01:42:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 -- start start 2023-11-04T01:42:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 -- 172.21.15.2:0/1876950000 shutdown_connections 2023-11-04T01:42:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 --2- 172.21.15.2:0/1876950000 >> v2:172.21.15.2:3300/0 conn(0x7ff5d803ac60 0x7ff5d80e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 --2- 172.21.15.2:0/1876950000 >> v2:172.21.15.90:3300/0 conn(0x7ff5d803a2c0 0x7ff5d803a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 --2- 172.21.15.2:0/1876950000 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8007f60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 -- 172.21.15.2:0/1876950000 >> 172.21.15.2:0/1876950000 conn(0x7ff5d8055450 msgr2=0x7ff5d8055860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18800cdee0 0x7f188015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- start start 2023-11-04T01:42:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c7806bfb0 0x7f9c780c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c7808a3f0 0x7f9c78213020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 0x7f9c780c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780b25d0 con 0x7f9c7806bfb0 2023-11-04T01:42:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780b28b0 con 0x7f9c780ca8a0 2023-11-04T01:42:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e9ed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780b2c10 con 0x7f9c7808a3f0 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18800d0430 0x7f18800c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1880161770 0x7f18800c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188015d100 con 0x7f1880161770 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c9430 con 0x7f18800cdee0 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f1884cb2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800cc220 con 0x7f18800d0430 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18800cdee0 0x7f188015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18800d0430 0x7f18800c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18800d0430 0x7f18800c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49292/0 (socket says 172.21.15.2:49292) 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 -- 172.21.15.2:0/3558768987 learned_addr learned my addr 172.21.15.2:0/3558768987 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187ed9d640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1880161770 0x7f18800c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7e1ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 0x7f9c780c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d9eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c7806bfb0 0x7f9c780c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d1ea640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c7808a3f0 0x7f9c78213020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d9eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c7806bfb0 0x7f9c780c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49772/0 (socket says 172.21.15.2:49772) 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d9eb640 1 -- 172.21.15.2:0/2939467518 learned_addr learned my addr 172.21.15.2:0/2939467518 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d1ea640 1 -- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 msgr2=0x7f9c780c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d1ea640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 0x7f9c780c2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d1ea640 1 -- 172.21.15.2:0/2939467518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c7806bfb0 msgr2=0x7f9c780c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d1ea640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c7806bfb0 0x7f9c780c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f9c7d1ea640 1 -- 172.21.15.2:0/2939467518 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68009420 con 0x7f9c7808a3f0 2023-11-04T01:42:34.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f27ee527640 1 Processor -- start 2023-11-04T01:42:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 -- 172.21.15.2:0/1876950000 shutdown_connections 2023-11-04T01:42:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 -- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18800cdee0 msgr2=0x7f188015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18800cdee0 0x7f188015cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 -- 172.21.15.2:0/3558768987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1880161770 msgr2=0x7f18800c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1880161770 0x7f18800c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f187dd9b640 1 -- 172.21.15.2:0/3558768987 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1878009a70 con 0x7f18800d0430 2023-11-04T01:42:34.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f187ed9d640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1880161770 0x7f18800c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c7d1ea640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c7808a3f0 0x7f9c78213020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c780c9190 tx=0x7f9c680191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7f27ee527640 1 -- start start 2023-11-04T01:42:34.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.299+0000 7ff5e51de640 1 -- 172.21.15.2:0/1876950000 wait complete. 2023-11-04T01:42:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f187dd9b640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18800d0430 0x7f18800c89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f187000c410 tx=0x7f187000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c6e7fc640 1 -- 172.21.15.2:0/2939467518 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680b5470 con 0x7f9c7808a3f0 2023-11-04T01:42:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c780b2ef0 con 0x7f9c7808a3f0 2023-11-04T01:42:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c780b2280 con 0x7f9c7808a3f0 2023-11-04T01:42:34.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f186effd640 1 -- 172.21.15.2:0/3558768987 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700052d0 con 0x7f18800d0430 2023-11-04T01:42:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 Processor -- start 2023-11-04T01:42:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 -- start start 2023-11-04T01:42:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ee527640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8071070 0x7f27e815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ed525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8071070 0x7f27e815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ed525640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8071070 0x7f27e815c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49792/0 (socket says 172.21.15.2:49792) 2023-11-04T01:42:34.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ed525640 1 -- 172.21.15.2:0/3690082643 learned_addr learned my addr 172.21.15.2:0/3690082643 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c6e7fc640 1 -- 172.21.15.2:0/2939467518 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c680b55d0 con 0x7f9c7808a3f0 2023-11-04T01:42:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c6e7fc640 1 -- 172.21.15.2:0/2939467518 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680b5980 con 0x7f9c7808a3f0 2023-11-04T01:42:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27e80cba80 0x7f27e80c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27e8159a50 0x7f27e806b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f186effd640 1 -- 172.21.15.2:0/3558768987 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870005430 con 0x7f18800d0430 2023-11-04T01:42:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f186effd640 1 -- 172.21.15.2:0/3558768987 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870003840 con 0x7f18800d0430 2023-11-04T01:42:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18800cc500 con 0x7f18800d0430 2023-11-04T01:42:34.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183883d640 1 Processor -- start 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80b14c0 con 0x7f27e8071070 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e80b22e0 con 0x7f27e8159a50 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e815c820 con 0x7f27e80cba80 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ecd24640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27e80cba80 0x7f27e80c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18800ccac0 con 0x7f18800d0430 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c6e7fc640 1 -- 172.21.15.2:0/2939467518 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c680b2040 con 0x7f9c7808a3f0 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c6e7fc640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c5c0664a0 0x7f9c5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c6e7fc640 1 -- 172.21.15.2:0/2939467518 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c6811e160 con 0x7f9c7808a3f0 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183883d640 1 -- start start 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183883d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 0x7f182c038390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183883d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f182c04a590 0x7f182c0e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183883d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c037b30 con 0x7f182c0e5060 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183883d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182c007d60 con 0x7f182c04a590 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183883d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0e8890 con 0x7f182c057c00 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27edd26640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27e8159a50 0x7f27e806b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ecd24640 1 -- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27e8159a50 msgr2=0x7f27e806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ecd24640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27e8159a50 0x7f27e806b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ecd24640 1 -- 172.21.15.2:0/3690082643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8071070 msgr2=0x7f27e815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ecd24640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8071070 0x7f27e815c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ecd24640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40094d0 con 0x7f27e80cba80 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ecd24640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27e80cba80 0x7f27e80c7ea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27d8000f70 tx=0x7f27d800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d803a2c0 0x7ff5d80e4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d803ac60 0x7ff5d804ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8045e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d804e170 con 0x7ff5d803a2c0 2023-11-04T01:42:34.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d804d0d0 con 0x7ff5d803ac60 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5e51de640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d804d3b0 con 0x7ff5d8054a60 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d803a2c0 0x7ff5d80e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d803a2c0 0x7ff5d80e4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49806/0 (socket says 172.21.15.2:49806) 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 -- 172.21.15.2:0/3733104609 learned_addr learned my addr 172.21.15.2:0/3733104609 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d803ac60 0x7ff5d804ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 -- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 msgr2=0x7ff5d8045e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8045e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 -- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d803ac60 msgr2=0x7ff5d804ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d803ac60 0x7ff5d804ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 -- 172.21.15.2:0/3733104609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40094d0 con 0x7ff5d803a2c0 2023-11-04T01:42:34.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c60005260 con 0x7f9c7808a3f0 2023-11-04T01:42:34.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f1832d9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f182c0e5060 0x7f182c049e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:56226/0 (socket says 172.21.15.2:56226) 2023-11-04T01:42:34.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f1832d9d640 1 -- 172.21.15.2:0/2373715697 learned_addr learned my addr 172.21.15.2:0/2373715697 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:34.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f183903e640 1 --2- 172.21.15.2:0/2373715697 >> v2:172.21.15.2:3300/0 conn(0x7f182c04a590 0x7f182c0e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f27ddffb640 1 -- 172.21.15.2:0/3690082643 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80052d0 con 0x7f27e80cba80 2023-11-04T01:42:34.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7ff5dffff640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d803a2c0 0x7ff5d80e4330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5d401cdc0 tx=0x7ff5d40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.303+0000 7f9c7d9eb640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c5c0664a0 0x7f9c5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f27ddffb640 1 -- 172.21.15.2:0/3690082643 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8005430 con 0x7f27e80cba80 2023-11-04T01:42:34.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e80b16d0 con 0x7f27e80cba80 2023-11-04T01:42:34.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f27ddffb640 1 -- 172.21.15.2:0/3690082643 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8003820 con 0x7f27e80cba80 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f183903e640 1 -- 172.21.15.2:0/2373715697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 msgr2=0x7f182c038390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f183903e640 1 --2- 172.21.15.2:0/2373715697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 0x7f182c038390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f183903e640 1 -- 172.21.15.2:0/2373715697 >> v1:172.21.15.90:6789/0 conn(0x7f182c0e5060 legacy=0x7f182c049e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f183903e640 1 -- 172.21.15.2:0/2373715697 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c037d80 con 0x7f182c04a590 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f186effd640 1 -- 172.21.15.2:0/3558768987 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f18700039a0 con 0x7f18800d0430 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800b6d60 con 0x7f18800d0430 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f186effd640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18600664f0 0x7f18600689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f186effd640 1 -- 172.21.15.2:0/3558768987 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18700834d0 con 0x7f18800d0430 2023-11-04T01:42:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f187e59c640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18600664f0 0x7f18600689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f9c7d9eb640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c5c0664a0 0x7f9c5c068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007fd0 tx=0x7f9c74007c80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e80b1c90 con 0x7f27e80cba80 2023-11-04T01:42:34.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e80744a0 con 0x7f27e80cba80 2023-11-04T01:42:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7ff5dcff9640 1 -- 172.21.15.2:0/3733104609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40abb00 con 0x7ff5d803a2c0 2023-11-04T01:42:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7ff5dcff9640 1 -- 172.21.15.2:0/3733104609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d40abc60 con 0x7ff5d803a2c0 2023-11-04T01:42:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7ff5dcff9640 1 -- 172.21.15.2:0/3733104609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40bf410 con 0x7ff5d803a2c0 2023-11-04T01:42:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d804d690 con 0x7ff5d803a2c0 2023-11-04T01:42:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d804dc50 con 0x7ff5d803a2c0 2023-11-04T01:42:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0005260 con 0x7ff5d803a2c0 2023-11-04T01:42:34.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef8c8bb640 1 Processor -- start 2023-11-04T01:42:34.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7f187e59c640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18600664f0 0x7f18600689b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18780af000 tx=0x7f18780a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef8c8bb640 1 -- start start 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef8c8bb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef881505a0 0x7fef8806d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef8c8bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef880c9c50 0x7fef880ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef8c8bb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8806ddf0 con 0x7fef8806d9d0 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef8c8bb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef880ca0e0 con 0x7fef880c9c50 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef8c8bb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef88150980 con 0x7fef881505a0 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef86d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef880c9c50 0x7fef880ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef86d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fef880c9c50 0x7fef880ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49834/0 (socket says 172.21.15.2:49834) 2023-11-04T01:42:34.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.307+0000 7fef86d9d640 1 -- 172.21.15.2:0/908696889 learned_addr learned my addr 172.21.15.2:0/908696889 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7fef8659c640 1 --2- 172.21.15.2:0/908696889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef881505a0 0x7fef8806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7fef86d9d640 1 -- 172.21.15.2:0/908696889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef881505a0 msgr2=0x7fef8806d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7fef86d9d640 1 --2- 172.21.15.2:0/908696889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef881505a0 0x7fef8806d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7fef86d9d640 1 -- 172.21.15.2:0/908696889 >> v1:172.21.15.90:6789/0 conn(0x7fef8806d9d0 legacy=0x7fef880c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7fef86d9d640 1 -- 172.21.15.2:0/908696889 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8806bbc0 con 0x7fef880c9c50 2023-11-04T01:42:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7ff5dcff9640 1 -- 172.21.15.2:0/3733104609 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5d40b3070 con 0x7ff5d803a2c0 2023-11-04T01:42:34.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7f183903e640 1 --2- 172.21.15.2:0/2373715697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c04a590 0x7f182c0e8c80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1834000b70 tx=0x7f1834096ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cb126755211329 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7ff5dcff9640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5c40665a0 0x7ff5c4068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7fef86d9d640 1 --2- 172.21.15.2:0/908696889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef880c9c50 0x7fef880ccd20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef8000c770 tx=0x7fef8001d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f378eea44316f4ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7ff5dcff9640 1 -- 172.21.15.2:0/3733104609 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5d411e490 con 0x7ff5d803a2c0 2023-11-04T01:42:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5c40665a0 0x7ff5c4068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.311+0000 7ff5df7fe640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5c40665a0 0x7ff5c4068a60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009980 tx=0x7ff5cc0090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7ff5dcff9640 1 -- 172.21.15.2:0/3733104609 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5d40eb980 con 0x7ff5d803a2c0 2023-11-04T01:42:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f1831d9b640 1 -- 172.21.15.2:0/2373715697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183411fb70 con 0x7f182c04a590 2023-11-04T01:42:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8559a640 1 -- 172.21.15.2:0/908696889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef800aa410 con 0x7fef880c9c50 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8559a640 1 -- 172.21.15.2:0/908696889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef800aa570 con 0x7fef880c9c50 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8559a640 1 -- 172.21.15.2:0/908696889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef800aa900 con 0x7fef880c9c50 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f1831d9b640 1 -- 172.21.15.2:0/2373715697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183411fcd0 con 0x7f182c04a590 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f1831d9b640 1 -- 172.21.15.2:0/2373715697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183411fb70 con 0x7f182c04a590 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8c8bb640 1 -- 172.21.15.2:0/908696889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef880c9c50 msgr2=0x7fef880ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/908696889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef880c9c50 0x7fef880ccd20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef8000c770 tx=0x7fef8001d490 comp rx=0 tx=0).stop 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 -- 172.21.15.2:0/2373715697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c04a590 msgr2=0x7f182c0e8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 --2- 172.21.15.2:0/2373715697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c04a590 0x7f182c0e8c80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1834000b70 tx=0x7f1834096ba0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8c8bb640 1 -- 172.21.15.2:0/908696889 shutdown_connections 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/908696889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef880c9c50 0x7fef880ccd20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/908696889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef881505a0 0x7fef8806d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7fef8c8bb640 1 -- 172.21.15.2:0/908696889 >> 172.21.15.2:0/908696889 conn(0x7fef880cb630 msgr2=0x7fef880cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 -- 172.21.15.2:0/2373715697 shutdown_connections 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 --2- 172.21.15.2:0/2373715697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c04a590 0x7f182c0e8c80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 --2- 172.21.15.2:0/2373715697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 0x7f182c038390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 -- 172.21.15.2:0/2373715697 >> 172.21.15.2:0/2373715697 conn(0x7f182c056eb0 msgr2=0x7f182c0572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 -- 172.21.15.2:0/2373715697 shutdown_connections 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.315+0000 7f183883d640 1 -- 172.21.15.2:0/2373715697 wait complete. 2023-11-04T01:42:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 -- 172.21.15.2:0/908696889 shutdown_connections 2023-11-04T01:42:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 Processor -- start 2023-11-04T01:42:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 -- 172.21.15.2:0/908696889 wait complete. 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 -- start start 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f182c04a590 0x7f182c0de660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 0x7f182c0dc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c0e5060 0x7f182c0342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0356c0 con 0x7f182c0e5060 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c04c150 con 0x7f182c04a590 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c033ed0 con 0x7f182c057c00 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c0e5060 0x7f182c0342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c0e5060 0x7f182c0342f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49838/0 (socket says 172.21.15.2:49838) 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 -- 172.21.15.2:0/1068289222 learned_addr learned my addr 172.21.15.2:0/1068289222 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f1832d9d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f182c04a590 0x7f182c0de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 Processor -- start 2023-11-04T01:42:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 -- start start 2023-11-04T01:42:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183259c640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 0x7f182c0dc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 -- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 msgr2=0x7f182c0dc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f9c6e7fc640 1 -- 172.21.15.2:0/2939467518 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c680b0080 con 0x7f9c7808a3f0 2023-11-04T01:42:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 0x7f182c0dc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 -- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f182c04a590 msgr2=0x7f182c0de660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f182c04a590 0x7f182c0de660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 -- 172.21.15.2:0/1068289222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c035100 con 0x7f182c0e5060 2023-11-04T01:42:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183903e640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c0e5060 0x7f182c0342f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18340698b0 tx=0x7f18340939e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f181b7fe640 1 -- 172.21.15.2:0/1068289222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834127ba0 con 0x7f182c0e5060 2023-11-04T01:42:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f181b7fe640 1 -- 172.21.15.2:0/1068289222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834127d00 con 0x7f182c0e5060 2023-11-04T01:42:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f181b7fe640 1 -- 172.21.15.2:0/1068289222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834130600 con 0x7f182c0e5060 2023-11-04T01:42:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8806d9d0 0x7fef880c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef880c9c50 0x7fef880c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c0353e0 con 0x7f182c0e5060 2023-11-04T01:42:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c033b60 con 0x7f182c0e5060 2023-11-04T01:42:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c0058a0 con 0x7f182c0e5060 2023-11-04T01:42:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef881505a0 0x7fef881586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef880c53f0 con 0x7fef881505a0 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8806d9d0 0x7fef880c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8806d9d0 0x7fef880c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38608/0 (socket says 172.21.15.2:38608) 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8659c640 1 -- 172.21.15.2:0/1648408797 learned_addr learned my addr 172.21.15.2:0/1648408797 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef880c61d0 con 0x7fef8806d9d0 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef880c4840 con 0x7fef880c9c50 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.319+0000 7fef86d9d640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef881505a0 0x7fef881586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7fef85d9b640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef880c9c50 0x7fef880c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7fef86d9d640 1 -- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef880c9c50 msgr2=0x7fef880c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7fef86d9d640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef880c9c50 0x7fef880c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7fef86d9d640 1 -- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8806d9d0 msgr2=0x7fef880c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7fef86d9d640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8806d9d0 0x7fef880c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7fef86d9d640 1 -- 172.21.15.2:0/1648408797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8000c3d0 con 0x7fef881505a0 2023-11-04T01:42:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7fef86d9d640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef881505a0 0x7fef881586e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef800ab000 tx=0x7fef8001a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7f181b7fe640 1 -- 172.21.15.2:0/1068289222 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f183412e040 con 0x7f182c0e5060 2023-11-04T01:42:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7f181b7fe640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18200664a0 0x7f1820068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7f181b7fe640 1 -- 172.21.15.2:0/1068289222 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f183411fe40 con 0x7f182c0e5060 2023-11-04T01:42:34.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7f1832d9d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18200664a0 0x7f1820068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.323+0000 7f1832d9d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18200664a0 0x7f1820068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1824005890 tx=0x7f1824009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7fef76ffd640 1 -- 172.21.15.2:0/1648408797 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef800aaa20 con 0x7fef881505a0 2023-11-04T01:42:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7fef76ffd640 1 -- 172.21.15.2:0/1648408797 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef800b7070 con 0x7fef881505a0 2023-11-04T01:42:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef880c4a50 con 0x7fef881505a0 2023-11-04T01:42:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef880c5010 con 0x7fef881505a0 2023-11-04T01:42:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7f27ddffb640 1 -- 172.21.15.2:0/3690082643 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27d8003980 con 0x7f27e80cba80 2023-11-04T01:42:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7f27ddffb640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27cc0664d0 0x7f27cc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7f181b7fe640 1 -- 172.21.15.2:0/1068289222 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18341661d0 con 0x7f182c0e5060 2023-11-04T01:42:34.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7f27ed525640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27cc0664d0 0x7f27cc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef880c59b0 con 0x7fef881505a0 2023-11-04T01:42:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7fef76ffd640 1 -- 172.21.15.2:0/1648408797 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef800aad80 con 0x7fef881505a0 2023-11-04T01:42:34.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7f27ed525640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27cc0664d0 0x7f27cc068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f27e401c550 tx=0x7f27e40b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.327+0000 7fef76ffd640 1 -- 172.21.15.2:0/1648408797 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fef80009510 con 0x7fef881505a0 2023-11-04T01:42:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7fef76ffd640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fef680664f0 0x7fef680689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7fef76ffd640 1 -- 172.21.15.2:0/1648408797 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef8011e750 con 0x7fef881505a0 2023-11-04T01:42:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7fef8659c640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fef680664f0 0x7fef680689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b2fb7640 1 Processor -- start 2023-11-04T01:42:34.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b2fb7640 1 -- start start 2023-11-04T01:42:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7fef8659c640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fef680664f0 0x7fef680689b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef78007a70 tx=0x7fef78008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b2fb7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff7ac15b090 0x7ff7ac15f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b2fb7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff7ac06a870 0x7ff7ac0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b2fb7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac0cbe40 con 0x7ff7ac15b470 2023-11-04T01:42:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b2fb7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac15fca0 con 0x7ff7ac06a870 2023-11-04T01:42:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b2fb7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac0cc120 con 0x7ff7ac15b090 2023-11-04T01:42:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7f27ddffb640 1 -- 172.21.15.2:0/3690082643 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27d8054c70 con 0x7f27e80cba80 2023-11-04T01:42:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b0d53640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff7ac15b090 0x7ff7ac15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b0d53640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff7ac15b090 0x7ff7ac15f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38612/0 (socket says 172.21.15.2:38612) 2023-11-04T01:42:34.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7b0d53640 1 -- 172.21.15.2:0/2388210724 learned_addr learned my addr 172.21.15.2:0/2388210724 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7abfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff7ac15b470 0x7ff7ac06a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:56236/0 (socket says 172.21.15.2:56236) 2023-11-04T01:42:34.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7f186effd640 1 -- 172.21.15.2:0/3558768987 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1870050930 con 0x7f18800d0430 2023-11-04T01:42:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7ab7fe640 1 -- 172.21.15.2:0/2388210724 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648468195 0 0) 0x7ff7ac0cbe40 con 0x7ff7ac15b470 2023-11-04T01:42:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.331+0000 7ff7ab7fe640 1 -- 172.21.15.2:0/2388210724 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff79c003530 con 0x7ff7ac15b470 2023-11-04T01:42:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.335+0000 7ff7b1554640 1 --2- 172.21.15.2:0/2388210724 >> v2:172.21.15.2:3300/0 conn(0x7ff7ac06a870 0x7ff7ac0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.335+0000 7ff7b0d53640 1 -- 172.21.15.2:0/2388210724 >> v2:172.21.15.2:3300/0 conn(0x7ff7ac06a870 msgr2=0x7ff7ac0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:34.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.335+0000 7ff7b0d53640 1 --2- 172.21.15.2:0/2388210724 >> v2:172.21.15.2:3300/0 conn(0x7ff7ac06a870 0x7ff7ac0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.335+0000 7ff7b0d53640 1 -- 172.21.15.2:0/2388210724 >> v1:172.21.15.90:6789/0 conn(0x7ff7ac15b470 legacy=0x7ff7ac06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.335+0000 7ff7ab7fe640 1 -- 172.21.15.2:0/2388210724 <== mon.1 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 792716435 0 0) 0x7ff79c003530 con 0x7ff7ac15b470 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.335+0000 7ff7b0d53640 1 -- 172.21.15.2:0/2388210724 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0cc400 con 0x7ff7ac15b090 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b0d53640 1 --2- 172.21.15.2:0/2388210724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac15f760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac072760 tx=0x7ff7a001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a2d6d136ff330b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7ab7fe640 1 -- 172.21.15.2:0/2388210724 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798001680 con 0x7ff7ac15b090 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7ab7fe640 1 -- 172.21.15.2:0/2388210724 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a00ad440 con 0x7ff7ac15b090 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7ab7fe640 1 -- 172.21.15.2:0/2388210724 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a00ad810 con 0x7ff7ac15b090 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/2388210724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 msgr2=0x7ff7ac15f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/2388210724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac15f760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac072760 tx=0x7ff7a001c410 comp rx=0 tx=0).stop 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/2388210724 shutdown_connections 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/2388210724 >> v2:172.21.15.2:3300/0 conn(0x7ff7ac06a870 0x7ff7ac0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/2388210724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac15f760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/2388210724 >> 172.21.15.2:0/2388210724 conn(0x7ff7ac0716a0 msgr2=0x7ff7ac071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/2388210724 shutdown_connections 2023-11-04T01:42:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.339+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/2388210724 wait complete. 2023-11-04T01:42:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7ff7b2fb7640 1 Processor -- start 2023-11-04T01:42:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7ff7b2fb7640 1 -- start start 2023-11-04T01:42:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7fef76ffd640 1 -- 172.21.15.2:0/1648408797 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fef800ef460 con 0x7fef881505a0 2023-11-04T01:42:34.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7ff7b2fb7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7ac06a870 0x7ff7ac15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7f27ddffb640 1 -- 172.21.15.2:0/3690082643 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27d8050fb0 con 0x7f27e80cba80 2023-11-04T01:42:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7ff7b2fb7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7ff7b2fb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ac15b470 0x7ff7ac154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7ff7b0d53640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7ac06a870 0x7ff7ac15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.343+0000 7ff7b0d53640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7ac06a870 0x7ff7ac15da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49350/0 (socket says 172.21.15.2:49350) 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac0b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38620/0 (socket says 172.21.15.2:38620) 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b1554640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ac15b470 0x7ff7ac154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b1554640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ac15b470 0x7ff7ac154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49858/0 (socket says 172.21.15.2:49858) 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b0d53640 1 -- 172.21.15.2:0/571219984 learned_addr learned my addr 172.21.15.2:0/571219984 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac154d80 con 0x7ff7ac15b470 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac155020 con 0x7ff7ac15b090 2023-11-04T01:42:34.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac155300 con 0x7ff7ac06a870 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b0d53640 1 -- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 msgr2=0x7ff7ac0b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b0d53640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac0b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b0d53640 1 -- 172.21.15.2:0/571219984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ac15b470 msgr2=0x7ff7ac154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b0d53640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ac15b470 0x7ff7ac154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b0d53640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00094d0 con 0x7ff7ac06a870 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7abfff640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac0b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b1554640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ac15b470 0x7ff7ac154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b0d53640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7ac06a870 0x7ff7ac15da70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00b0040 tx=0x7ff7a00191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7a97fa640 1 -- 172.21.15.2:0/571219984 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a00b6850 con 0x7ff7ac06a870 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac1555e0 con 0x7ff7ac06a870 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac1564d0 con 0x7ff7ac06a870 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7a97fa640 1 -- 172.21.15.2:0/571219984 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a00a6040 con 0x7ff7ac06a870 2023-11-04T01:42:34.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.347+0000 7ff7a97fa640 1 -- 172.21.15.2:0/571219984 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a00b6bf0 con 0x7ff7ac06a870 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.351+0000 7ff7a97fa640 1 -- 172.21.15.2:0/571219984 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7a00b4070 con 0x7ff7ac06a870 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.351+0000 7ff7a97fa640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7900664a0 0x7ff790068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.351+0000 7ff7a97fa640 1 -- 172.21.15.2:0/571219984 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7a011de00 con 0x7ff7ac06a870 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.351+0000 7ff7abfff640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7900664a0 0x7ff790068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.351+0000 7ff7abfff640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7900664a0 0x7ff790068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff798001ec0 tx=0x7ff798009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:34.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.355+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c005260 con 0x7ff7ac06a870 2023-11-04T01:42:34.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.367+0000 7ff7a97fa640 1 -- 172.21.15.2:0/571219984 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7a00eb280 con 0x7ff7ac06a870 2023-11-04T01:42:34.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.591+0000 7ff1a37fe640 1 -- 172.21.15.2:0/812624025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff19c0057e0 con 0x7ff1c00add70 2023-11-04T01:42:34.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.591+0000 7ff1b5ffb640 1 -- 172.21.15.2:0/812624025 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1bc0c7070 con 0x7ff1c00add70 2023-11-04T01:42:34.600 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1a40664a0 msgr2=0x7ff1a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1a40664a0 0x7ff1a4068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00b3a20 tx=0x7ff1b800f040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1c00add70 msgr2=0x7ff1c0166780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1c00add70 0x7ff1c0166780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0235f0 tx=0x7ff1bc00a370 comp rx=0 tx=0).stop 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 shutdown_connections 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1a40664a0 0x7ff1a4068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1c00c9050 0x7ff1c00c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1c00add70 0x7ff1c0166780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 --2- 172.21.15.2:0/812624025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1c00ad990 0x7ff1c00c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 >> 172.21.15.2:0/812624025 conn(0x7ff1c00b0550 msgr2=0x7ff1c006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 shutdown_connections 2023-11-04T01:42:34.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.595+0000 7ff1c74e5640 1 -- 172.21.15.2:0/812624025 wait complete. 2023-11-04T01:42:34.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2023-11-04T01:42:34.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.619+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9c60005510 con 0x7f9c7808a3f0 2023-11-04T01:42:34.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c6e7fc640 1 -- 172.21.15.2:0/2939467518 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c680bc090 con 0x7f9c7808a3f0 2023-11-04T01:42:34.626 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c5c0664a0 msgr2=0x7f9c5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c5c0664a0 0x7f9c5c068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007fd0 tx=0x7f9c74007c80 comp rx=0 tx=0).stop 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c7808a3f0 msgr2=0x7f9c78213020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c7808a3f0 0x7f9c78213020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c780c9190 tx=0x7f9c680191f0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 shutdown_connections 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c5c0664a0 0x7f9c5c068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c780ca8a0 0x7f9c780c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c7808a3f0 0x7f9c78213020 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 --2- 172.21.15.2:0/2939467518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c7806bfb0 0x7f9c780c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 >> 172.21.15.2:0/2939467518 conn(0x7f9c780b0550 msgr2=0x7f9c780cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 shutdown_connections 2023-11-04T01:42:34.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.623+0000 7f9c7e9ed640 1 -- 172.21.15.2:0/2939467518 wait complete. 2023-11-04T01:42:34.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff5c0005510 con 0x7ff5d803a2c0 2023-11-04T01:42:34.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5dcff9640 1 -- 172.21.15.2:0/3733104609 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5d40b1090 con 0x7ff5d803a2c0 2023-11-04T01:42:34.632 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5c40665a0 msgr2=0x7ff5c4068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5c40665a0 0x7ff5c4068a60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009980 tx=0x7ff5cc0090e0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d803a2c0 msgr2=0x7ff5d80e4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d803a2c0 0x7ff5d80e4330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5d401cdc0 tx=0x7ff5d40192c0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 shutdown_connections 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5c40665a0 0x7ff5c4068a60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d8054a60 0x7ff5d8045e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d803ac60 0x7ff5d804ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 --2- 172.21.15.2:0/3733104609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d803a2c0 0x7ff5d80e4330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 >> 172.21.15.2:0/3733104609 conn(0x7ff5d8055450 msgr2=0x7ff5d80eb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 shutdown_connections 2023-11-04T01:42:34.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.627+0000 7ff5e51de640 1 -- 172.21.15.2:0/3733104609 wait complete. 2023-11-04T01:42:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.643+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef880744a0 con 0x7fef881505a0 2023-11-04T01:42:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.643+0000 7fef76ffd640 1 -- 172.21.15.2:0/1648408797 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef800ef280 con 0x7fef881505a0 2023-11-04T01:42:34.649 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fef680664f0 msgr2=0x7fef680689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fef680664f0 0x7fef680689b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef78007a70 tx=0x7fef78008040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef881505a0 msgr2=0x7fef881586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef881505a0 0x7fef881586e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fef800ab000 tx=0x7fef8001a230 comp rx=0 tx=0).stop 2023-11-04T01:42:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 shutdown_connections 2023-11-04T01:42:34.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2023-11-04T01:42:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fef680664f0 0x7fef680689b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f182c0e8fa0 con 0x7f182c0e5060 2023-11-04T01:42:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef881505a0 0x7fef881586e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7f181b7fe640 1 -- 172.21.15.2:0/1068289222 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f183412c090 con 0x7f182c0e5060 2023-11-04T01:42:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fef880c9c50 0x7fef880c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.655 INFO:teuthology.orchestra.run.smithi002.stdout:60129542149 2023-11-04T01:42:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 --2- 172.21.15.2:0/1648408797 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef8806d9d0 0x7fef880c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 >> 172.21.15.2:0/1648408797 conn(0x7fef880cb630 msgr2=0x7fef880b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 shutdown_connections 2023-11-04T01:42:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.647+0000 7fef8c8bb640 1 -- 172.21.15.2:0/1648408797 wait complete. 2023-11-04T01:42:34.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18200664a0 msgr2=0x7f1820068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18200664a0 0x7f1820068960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1824005890 tx=0x7f1824009040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c0e5060 msgr2=0x7f182c0342f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c0e5060 0x7f182c0342f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f18340698b0 tx=0x7f18340939e0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 shutdown_connections 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18200664a0 0x7f1820068960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f182c0e5060 0x7f182c0342f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f182c057c00 0x7f182c0dc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 --2- 172.21.15.2:0/1068289222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f182c04a590 0x7f182c0de660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 >> 172.21.15.2:0/1068289222 conn(0x7f182c056eb0 msgr2=0x7f182c049e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 shutdown_connections 2023-11-04T01:42:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.651+0000 7f183883d640 1 -- 172.21.15.2:0/1068289222 wait complete. 2023-11-04T01:42:34.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f27e80ae1a0 con 0x7f27e80cba80 2023-11-04T01:42:34.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ddffb640 1 -- 172.21.15.2:0/3690082643 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27d8021020 con 0x7f27e80cba80 2023-11-04T01:42:34.663 INFO:teuthology.orchestra.run.smithi002.stdout:60129542149 2023-11-04T01:42:34.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27cc0664d0 msgr2=0x7f27cc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27cc0664d0 0x7f27cc068990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f27e401c550 tx=0x7f27e40b5040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27e80cba80 msgr2=0x7f27e80c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27e80cba80 0x7f27e80c7ea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27d8000f70 tx=0x7f27d800c890 comp rx=0 tx=0).stop 2023-11-04T01:42:34.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 shutdown_connections 2023-11-04T01:42:34.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27cc0664d0 0x7f27cc068990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18800cc360 con 0x7f18800d0430 2023-11-04T01:42:34.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27e8159a50 0x7f27e806b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27e80cba80 0x7f27e80c7ea0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 --2- 172.21.15.2:0/3690082643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27e8071070 0x7f27e815c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 >> 172.21.15.2:0/3690082643 conn(0x7f27e80b0550 msgr2=0x7f27e80cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 shutdown_connections 2023-11-04T01:42:34.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.659+0000 7f27ee527640 1 -- 172.21.15.2:0/3690082643 wait complete. 2023-11-04T01:42:34.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f186effd640 1 -- 172.21.15.2:0/3558768987 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18800cc360 con 0x7f18800d0430 2023-11-04T01:42:34.667 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2023-11-04T01:42:34.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff78c0057e0 con 0x7ff7ac06a870 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18600664f0 msgr2=0x7f18600689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18600664f0 0x7f18600689b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18780af000 tx=0x7f18780a7070 comp rx=0 tx=0).stop 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18800d0430 msgr2=0x7f18800c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18800d0430 0x7f18800c89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f187000c410 tx=0x7f187000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 shutdown_connections 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f18600664f0 0x7f18600689b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1880161770 0x7f18800c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18800d0430 0x7f18800c89e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 --2- 172.21.15.2:0/3558768987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18800cdee0 0x7f188015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 >> 172.21.15.2:0/3558768987 conn(0x7f18800b28f0 msgr2=0x7f188006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 shutdown_connections 2023-11-04T01:42:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.663+0000 7f1884cb2640 1 -- 172.21.15.2:0/3558768987 wait complete. 2023-11-04T01:42:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7a97fa640 1 -- 172.21.15.2:0/571219984 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7a00ee8a0 con 0x7ff7ac06a870 2023-11-04T01:42:34.671 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2023-11-04T01:42:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7900664a0 msgr2=0x7ff790068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7900664a0 0x7ff790068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff798001ec0 tx=0x7ff798009040 comp rx=0 tx=0).stop 2023-11-04T01:42:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7ac06a870 msgr2=0x7ff7ac15da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7ac06a870 0x7ff7ac15da70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00b0040 tx=0x7ff7a00191b0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 shutdown_connections 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7900664a0 0x7ff790068960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7ac15b470 0x7ff7ac154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7ac15b090 0x7ff7ac0b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 --2- 172.21.15.2:0/571219984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7ac06a870 0x7ff7ac15da70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 >> 172.21.15.2:0/571219984 conn(0x7ff7ac0716a0 msgr2=0x7ff7ac0ad780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 shutdown_connections 2023-11-04T01:42:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:34.667+0000 7ff7b2fb7640 1 -- 172.21.15.2:0/571219984 wait complete. 2023-11-04T01:42:34.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2023-11-04T01:42:34.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2023-11-04T01:42:34.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2023-11-04T01:42:34.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2023-11-04T01:42:34.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2023-11-04T01:42:35.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-04T01:42:35.654 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-04T01:42:35.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-04T01:42:35.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-04T01:42:35.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-04T01:42:35.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-04T01:42:35.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-04T01:42:35.695 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-04T01:42:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d26a6640 1 Processor -- start 2023-11-04T01:42:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d26a6640 1 -- start start 2023-11-04T01:42:35.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d26a6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc06d000 0x7fb6cc0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d26a6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6cc0cb830 0x7fb6cc0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d26a6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc0ce230 con 0x7fb6cc158fc0 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d26a6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc15da50 con 0x7fb6cc0cb830 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d26a6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0cc200 con 0x7fb6cc06d000 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6d0c43640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6cc0cb830 0x7fb6cc0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6cb7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc06d000 0x7fb6cc0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6cb7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc06d000 0x7fb6cc0cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49364/0 (socket says 172.21.15.2:49364) 2023-11-04T01:42:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6cb7fe640 1 -- 172.21.15.2:0/608689122 learned_addr learned my addr 172.21.15.2:0/608689122 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6cb7fe640 1 -- 172.21.15.2:0/608689122 >> v2:172.21.15.2:3300/0 conn(0x7fb6cc0cb830 msgr2=0x7fb6cc0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6cb7fe640 1 --2- 172.21.15.2:0/608689122 >> v2:172.21.15.2:3300/0 conn(0x7fb6cc0cb830 0x7fb6cc0cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6cb7fe640 1 -- 172.21.15.2:0/608689122 >> v1:172.21.15.90:6789/0 conn(0x7fb6cc158fc0 legacy=0x7fb6cc15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.779+0000 7fb6cb7fe640 1 -- 172.21.15.2:0/608689122 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc15ceb0 con 0x7fb6cc06d000 2023-11-04T01:42:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.783+0000 7fb6cb7fe640 1 --2- 172.21.15.2:0/608689122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc06d000 0x7fb6cc0cada0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400d370 tx=0x7fb6c401ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b550359c74a11a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.783+0000 7fb6caffd640 1 -- 172.21.15.2:0/608689122 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40a7c60 con 0x7fb6cc06d000 2023-11-04T01:42:35.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.783+0000 7fb6caffd640 1 -- 172.21.15.2:0/608689122 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c40ab070 con 0x7fb6cc06d000 2023-11-04T01:42:35.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 -- 172.21.15.2:0/608689122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc06d000 msgr2=0x7fb6cc0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 --2- 172.21.15.2:0/608689122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc06d000 0x7fb6cc0cada0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400d370 tx=0x7fb6c401ed90 comp rx=0 tx=0).stop 2023-11-04T01:42:35.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 -- 172.21.15.2:0/608689122 shutdown_connections 2023-11-04T01:42:35.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 --2- 172.21.15.2:0/608689122 >> v2:172.21.15.2:3300/0 conn(0x7fb6cc0cb830 0x7fb6cc0cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 --2- 172.21.15.2:0/608689122 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc06d000 0x7fb6cc0cada0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 -- 172.21.15.2:0/608689122 >> 172.21.15.2:0/608689122 conn(0x7fb6cc0b0550 msgr2=0x7fb6cc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 -- 172.21.15.2:0/608689122 shutdown_connections 2023-11-04T01:42:35.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 -- 172.21.15.2:0/608689122 wait complete. 2023-11-04T01:42:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 Processor -- start 2023-11-04T01:42:35.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.787+0000 7fb6d26a6640 1 -- start start 2023-11-04T01:42:35.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6cc0cb830 0x7fb6cc147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc158fc0 0x7fb6cc0b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc0b1b40 0x7fb6cc0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6cc0cb830 0x7fb6cc147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6cc0cb830 0x7fb6cc147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49880/0 (socket says 172.21.15.2:49880) 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc148460 con 0x7fb6cc0cb830 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1568c0 con 0x7fb6cc0b1b40 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc157160 con 0x7fb6cc158fc0 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cbfff640 1 -- 172.21.15.2:0/837124713 learned_addr learned my addr 172.21.15.2:0/837124713 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cb7fe640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc158fc0 0x7fb6cc0b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d0c43640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc0b1b40 0x7fb6cc0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cb7fe640 1 -- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc0b1b40 msgr2=0x7fb6cc0b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cb7fe640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc0b1b40 0x7fb6cc0b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cb7fe640 1 -- 172.21.15.2:0/837124713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6cc0cb830 msgr2=0x7fb6cc147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cb7fe640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6cc0cb830 0x7fb6cc147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cb7fe640 1 -- 172.21.15.2:0/837124713 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c400d050 con 0x7fb6cc158fc0 2023-11-04T01:42:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cbfff640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6cc0cb830 0x7fb6cc147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6cb7fe640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc158fc0 0x7fb6cc0b1600 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40af000 tx=0x7fb6c401d5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6c8ff9640 1 -- 172.21.15.2:0/837124713 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40bb630 con 0x7fb6cc158fc0 2023-11-04T01:42:35.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 -- 172.21.15.2:0/837124713 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc0b2050 con 0x7fb6cc158fc0 2023-11-04T01:42:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6d26a6640 1 -- 172.21.15.2:0/837124713 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc156df0 con 0x7fb6cc158fc0 2023-11-04T01:42:35.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.791+0000 7fb6c8ff9640 1 -- 172.21.15.2:0/837124713 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c40ab040 con 0x7fb6cc158fc0 2023-11-04T01:42:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.795+0000 7fb6c8ff9640 1 -- 172.21.15.2:0/837124713 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40bb9f0 con 0x7fb6cc158fc0 2023-11-04T01:42:35.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.795+0000 7fb6c8ff9640 1 -- 172.21.15.2:0/837124713 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6c40ba390 con 0x7fb6cc158fc0 2023-11-04T01:42:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.795+0000 7fb6c8ff9640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6b80664d0 0x7fb6b8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.795+0000 7fb6c8ff9640 1 -- 172.21.15.2:0/837124713 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6c411e580 con 0x7fb6cc158fc0 2023-11-04T01:42:35.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.795+0000 7fb6cbfff640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6b80664d0 0x7fb6b8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.795+0000 7fb6d26a6640 1 -- 172.21.15.2:0/837124713 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac005260 con 0x7fb6cc158fc0 2023-11-04T01:42:35.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.799+0000 7fb6cbfff640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6b80664d0 0x7fb6b8068990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0001c00 tx=0x7fb6c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.811+0000 7fb6c8ff9640 1 -- 172.21.15.2:0/837124713 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6c40ebb10 con 0x7fb6cc158fc0 2023-11-04T01:42:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed56e9640 1 Processor -- start 2023-11-04T01:42:35.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed56e9640 1 -- start start 2023-11-04T01:42:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed56e9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed0158d60 0x7f6ed00c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed56e9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed00ce310 con 0x7f6ed00cba50 2023-11-04T01:42:35.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed56e9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed006c460 con 0x7f6ed0159140 2023-11-04T01:42:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed56e9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c8fb0 con 0x7f6ed0158d60 2023-11-04T01:42:35.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed4ee8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6ed00cba50 0x7f6ed00cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52058/0 (socket says 172.21.15.2:52058) 2023-11-04T01:42:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.823+0000 7f6ed4ee8640 1 -- 172.21.15.2:0/3707788934 learned_addr learned my addr 172.21.15.2:0/3707788934 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f6ecffff640 1 --2- 172.21.15.2:0/3707788934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed0158d60 0x7f6ed00c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f6eceffd640 1 -- 172.21.15.2:0/3707788934 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555942390 0 0) 0x7f6ed00ce310 con 0x7f6ed00cba50 2023-11-04T01:42:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f6eceffd640 1 -- 172.21.15.2:0/3707788934 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb8003530 con 0x7f6ed00cba50 2023-11-04T01:42:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44ffd48640 1 Processor -- start 2023-11-04T01:42:35.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44ffd48640 1 -- start start 2023-11-04T01:42:35.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f6ecffff640 1 -- 172.21.15.2:0/3707788934 >> v1:172.21.15.90:6789/0 conn(0x7f6ed0159140 legacy=0x7f6ed00cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f6ecffff640 1 -- 172.21.15.2:0/3707788934 >> v1:172.21.15.2:6789/0 conn(0x7f6ed00cba50 legacy=0x7f6ed00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f6ecffff640 1 -- 172.21.15.2:0/3707788934 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00ce5d0 con 0x7f6ed0158d60 2023-11-04T01:42:35.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44ffd48640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f80cd230 0x7f44f80adff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44ffd48640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f806d630 con 0x7f44f80cb030 2023-11-04T01:42:35.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fe2e5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f44f80cb030 0x7f44f806ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52068/0 (socket says 172.21.15.2:52068) 2023-11-04T01:42:35.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fe2e5640 1 -- 172.21.15.2:0/2742085601 learned_addr learned my addr 172.21.15.2:0/2742085601 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:35.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44ffd48640 1 -- 172.21.15.2:0/2742085601 --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f8160ca0 con 0x7f44f81608c0 2023-11-04T01:42:35.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44ffd48640 1 -- 172.21.15.2:0/2742085601 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f806dcb0 con 0x7f44f80cd230 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724873557 0 0) 0x7f44f806d630 con 0x7f44f80cb030 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e4003530 con 0x7f44f80cb030 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1181127342 0 0) 0x7f44e4003530 con 0x7f44f80cb030 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f80cd230 msgr2=0x7f44f80adff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f80cd230 0x7f44f80adff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 >> v1:172.21.15.90:6789/0 conn(0x7f44f81608c0 legacy=0x7f44f80ccb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8161930 con 0x7f44f80cb030 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.827+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f44f0001a00 con 0x7f44f80cb030 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 >> v1:172.21.15.2:6789/0 conn(0x7f44f80cb030 legacy=0x7f44f806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fcae2640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f80cd230 0x7f44e40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f6ecffff640 1 --2- 172.21.15.2:0/3707788934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed0158d60 0x7f6ed00c9400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009dc0 tx=0x7f6ec801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c94379da34df25f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fcae2640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e40040a0 0x7f44e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fcae2640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e4004d60 0x7f44e40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f6eceffd640 1 -- 172.21.15.2:0/3707788934 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80a5940 con 0x7f6ed0158d60 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f806dcb0 con 0x7f44e4004d60 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e400bba0 con 0x7f44e40040a0 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fdae4640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f80cd230 0x7f44e40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e400bd60 con 0x7f44f80cd230 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fe2e5640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e4004d60 0x7f44e40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fe2e5640 1 -- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f80cd230 msgr2=0x7f44e40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fe2e5640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f80cd230 0x7f44e40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fe2e5640 1 -- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e40040a0 msgr2=0x7f44e40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fe2e5640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44e40040a0 0x7f44e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f44fe2e5640 1 -- 172.21.15.2:0/2742085601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4003530 con 0x7f44e4004d60 2023-11-04T01:42:35.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f6eceffd640 1 -- 172.21.15.2:0/3707788934 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec80a5aa0 con 0x7f6ed0158d60 2023-11-04T01:42:35.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f6eceffd640 1 -- 172.21.15.2:0/3707788934 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80a5e10 con 0x7f6ed0158d60 2023-11-04T01:42:35.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3707788934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed0158d60 msgr2=0x7f6ed00c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.831+0000 7f6ed56e9640 1 --2- 172.21.15.2:0/3707788934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed0158d60 0x7f6ed00c9400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009dc0 tx=0x7f6ec801c990 comp rx=0 tx=0).stop 2023-11-04T01:42:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3707788934 shutdown_connections 2023-11-04T01:42:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 --2- 172.21.15.2:0/3707788934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed0158d60 0x7f6ed00c9400 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3707788934 >> 172.21.15.2:0/3707788934 conn(0x7f6ed00b0550 msgr2=0x7f6ed00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3707788934 shutdown_connections 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44fe2e5640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e4004d60 0x7f44e40051e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44f0005a40 tx=0x7f44f001d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90caeb1630f6966c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00a67c0 con 0x7f44e4004d60 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44fcae2640 1 -- 172.21.15.2:0/2742085601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f00a6920 con 0x7f44e4004d60 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44ffd48640 1 -- 172.21.15.2:0/2742085601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e4004d60 msgr2=0x7f44e40051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44ffd48640 1 --2- 172.21.15.2:0/2742085601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44e4004d60 0x7f44e40051e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44f0005a40 tx=0x7f44f001d8c0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44fe2e5640 1 -- 172.21.15.2:0/2742085601 reap_dead start 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44ffd48640 1 -- 172.21.15.2:0/2742085601 shutdown_connections 2023-11-04T01:42:35.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f44ffd48640 1 -- 172.21.15.2:0/2742085601 >> 172.21.15.2:0/2742085601 conn(0x7f44f80cb630 msgr2=0x7f44f80cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3707788934 wait complete. 2023-11-04T01:42:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 Processor -- start 2023-11-04T01:42:35.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 -- start start 2023-11-04T01:42:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed00cba50 0x7f6ed01f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.835+0000 7f6ed56e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ed0158d60 0x7f6ed01f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 -- 172.21.15.2:0/2742085601 shutdown_connections 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ed0158d60 0x7f6ed01f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ed0158d60 0x7f6ed01f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49892/0 (socket says 172.21.15.2:49892) 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed00cba50 0x7f6ed01f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecf7fe640 1 -- 172.21.15.2:0/3318337200 learned_addr learned my addr 172.21.15.2:0/3318337200 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed56e9640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed0159140 0x7f6ed0159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0168590 con 0x7f6ed0158d60 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0202950 con 0x7f6ed0159140 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0153f20 con 0x7f6ed00cba50 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed4ee8640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed0159140 0x7f6ed0159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecffff640 1 -- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed0159140 msgr2=0x7f6ed0159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecffff640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed0159140 0x7f6ed0159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecffff640 1 -- 172.21.15.2:0/3318337200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ed0158d60 msgr2=0x7f6ed01f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecffff640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ed0158d60 0x7f6ed01f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecffff640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8009a70 con 0x7f6ed00cba50 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecf7fe640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ed0158d60 0x7f6ed01f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ecffff640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed00cba50 0x7f6ed01f8150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80ac000 tx=0x7f6ec8019730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 -- 172.21.15.2:0/2742085601 wait complete. 2023-11-04T01:42:35.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 Processor -- start 2023-11-04T01:42:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6eccff9640 1 -- 172.21.15.2:0/3318337200 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8003bb0 con 0x7f6ed00cba50 2023-11-04T01:42:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed01580f0 con 0x7f6ed00cba50 2023-11-04T01:42:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed0157e10 con 0x7f6ed00cba50 2023-11-04T01:42:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6eccff9640 1 -- 172.21.15.2:0/3318337200 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec8003d10 con 0x7f6ed00cba50 2023-11-04T01:42:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6eccff9640 1 -- 172.21.15.2:0/3318337200 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8004280 con 0x7f6ed00cba50 2023-11-04T01:42:35.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb0005260 con 0x7f6ed00cba50 2023-11-04T01:42:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 -- start start 2023-11-04T01:42:35.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f81f6500 0x7f44f80b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f80b0c10 0x7f44f80c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f80c7690 0x7f44f81f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80c7b10 con 0x7f44f80b0c10 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f81f7d80 con 0x7f44f80c7690 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44ffd48640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80b3250 con 0x7f44f81f6500 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44fe2e5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f80c7690 0x7f44f81f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44fe2e5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f80c7690 0x7f44f81f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38648/0 (socket says 172.21.15.2:38648) 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.839+0000 7f44fe2e5640 1 -- 172.21.15.2:0/3690037878 learned_addr learned my addr 172.21.15.2:0/3690037878 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fd2e3640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f80b0c10 0x7f44f80c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fdae4640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f81f6500 0x7f44f80b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fe2e5640 1 -- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f81f6500 msgr2=0x7f44f80b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fe2e5640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f81f6500 0x7f44f80b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fe2e5640 1 -- 172.21.15.2:0/3690037878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f80b0c10 msgr2=0x7f44f80c7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fe2e5640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f80b0c10 0x7f44f80c7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fe2e5640 1 -- 172.21.15.2:0/3690037878 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80b3530 con 0x7f44f80c7690 2023-11-04T01:42:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fdae4640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f81f6500 0x7f44f80b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fd2e3640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f80b0c10 0x7f44f80c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f44fe2e5640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f80c7690 0x7f44f81f68e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44f001d6f0 tx=0x7f44e4005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f6eccff9640 1 -- 172.21.15.2:0/3318337200 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ec80043e0 con 0x7f6ed00cba50 2023-11-04T01:42:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f6eccff9640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ebc0664d0 0x7f6ebc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f6eccff9640 1 -- 172.21.15.2:0/3318337200 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ec811f300 con 0x7f6ed00cba50 2023-11-04T01:42:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f6ecf7fe640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ebc0664d0 0x7f6ebc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.843+0000 7f6ecf7fe640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ebc0664d0 0x7f6ebc068990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6ed006bb70 tx=0x7f6ec0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ee7fc640 1 -- 172.21.15.2:0/3690037878 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00b4070 con 0x7f44f80c7690 2023-11-04T01:42:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ee7fc640 1 -- 172.21.15.2:0/3690037878 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f00019f0 con 0x7f44f80c7690 2023-11-04T01:42:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f80b3810 con 0x7f44f80c7690 2023-11-04T01:42:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ee7fc640 1 -- 172.21.15.2:0/3690037878 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0002030 con 0x7f44f80c7690 2023-11-04T01:42:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f80b2e90 con 0x7f44f80c7690 2023-11-04T01:42:35.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f80b3cc0 con 0x7f44f80c7690 2023-11-04T01:42:35.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ee7fc640 1 -- 172.21.15.2:0/3690037878 <== mon.1 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44f0008140 con 0x7f44f80c7690 2023-11-04T01:42:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ee7fc640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44dc0664f0 0x7f44dc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44ee7fc640 1 -- 172.21.15.2:0/3690037878 <== mon.1 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44f011e6e0 con 0x7f44f80c7690 2023-11-04T01:42:35.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.847+0000 7f44fdae4640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44dc0664f0 0x7f44dc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.851+0000 7f44fdae4640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44dc0664f0 0x7f44dc0689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44f81fa110 tx=0x7f44f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.855+0000 7f6eccff9640 1 -- 172.21.15.2:0/3318337200 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ec80ec8a0 con 0x7f6ed00cba50 2023-11-04T01:42:35.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.859+0000 7f44ee7fc640 1 -- 172.21.15.2:0/3690037878 <== mon.1 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44f00ebbf0 con 0x7f44f80c7690 2023-11-04T01:42:35.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c540f1640 1 Processor -- start 2023-11-04T01:42:35.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c540f1640 1 -- start start 2023-11-04T01:42:35.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c540f1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c161510 0x7f0c4c1618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c540f1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0cc6f0 con 0x7f0c4c06ba90 2023-11-04T01:42:35.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c540f1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c06bf90 con 0x7f0c4c06f8f0 2023-11-04T01:42:35.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c540f1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b10d0 con 0x7f0c4c161510 2023-11-04T01:42:35.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c5268e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0c4c06ba90 0x7f0c4c0c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52082/0 (socket says 172.21.15.2:52082) 2023-11-04T01:42:35.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c5268e640 1 -- 172.21.15.2:0/2248166931 learned_addr learned my addr 172.21.15.2:0/2248166931 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:35.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.883+0000 7f0c51e8d640 1 --2- 172.21.15.2:0/2248166931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c161510 0x7f0c4c1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.887+0000 7f0c50e8b640 1 -- 172.21.15.2:0/2248166931 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845983540 0 0) 0x7f0c4c0cc6f0 con 0x7f0c4c06ba90 2023-11-04T01:42:35.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.887+0000 7f0c50e8b640 1 -- 172.21.15.2:0/2248166931 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c38003530 con 0x7f0c4c06ba90 2023-11-04T01:42:35.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.887+0000 7f0c50e8b640 1 -- 172.21.15.2:0/2248166931 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247741970 0 0) 0x7f0c4c06bf90 con 0x7f0c4c06f8f0 2023-11-04T01:42:35.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.887+0000 7f0c51e8d640 1 -- 172.21.15.2:0/2248166931 >> v1:172.21.15.90:6789/0 conn(0x7f0c4c06f8f0 legacy=0x7f0c4c0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.887+0000 7f0c51e8d640 1 -- 172.21.15.2:0/2248166931 >> v1:172.21.15.2:6789/0 conn(0x7f0c4c06ba90 legacy=0x7f0c4c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.887+0000 7f0c51e8d640 1 -- 172.21.15.2:0/2248166931 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c06c270 con 0x7f0c4c161510 2023-11-04T01:42:35.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.887+0000 7f0c51e8d640 1 --2- 172.21.15.2:0/2248166931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c161510 0x7f0c4c1618f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0c480097f0 tx=0x7f0c4801c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=100aa7f797088626 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c50e8b640 1 -- 172.21.15.2:0/2248166931 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44001980 con 0x7f0c4c161510 2023-11-04T01:42:35.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c50e8b640 1 -- 172.21.15.2:0/2248166931 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480a7050 con 0x7f0c4c161510 2023-11-04T01:42:35.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 -- 172.21.15.2:0/2248166931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c161510 msgr2=0x7f0c4c1618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2248166931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c161510 0x7f0c4c1618f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0c480097f0 tx=0x7f0c4801c2d0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 -- 172.21.15.2:0/2248166931 shutdown_connections 2023-11-04T01:42:35.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2248166931 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c161510 0x7f0c4c1618f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 -- 172.21.15.2:0/2248166931 >> 172.21.15.2:0/2248166931 conn(0x7f0c4c0cebb0 msgr2=0x7f0c4c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 -- 172.21.15.2:0/2248166931 shutdown_connections 2023-11-04T01:42:35.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 -- 172.21.15.2:0/2248166931 wait complete. 2023-11-04T01:42:35.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 Processor -- start 2023-11-04T01:42:35.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.891+0000 7f0c540f1640 1 -- start start 2023-11-04T01:42:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c06ba90 0x7f0c4c14bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c06f8f0 0x7f0c4c164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c161510 0x7f0c4c164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14c310 con 0x7f0c4c06f8f0 2023-11-04T01:42:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14f8e0 con 0x7f0c4c161510 2023-11-04T01:42:35.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c14fbc0 con 0x7f0c4c06ba90 2023-11-04T01:42:35.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c5168c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c06f8f0 0x7f0c4c164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c5168c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c06f8f0 0x7f0c4c164140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49910/0 (socket says 172.21.15.2:49910) 2023-11-04T01:42:35.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c5168c640 1 -- 172.21.15.2:0/2055650342 learned_addr learned my addr 172.21.15.2:0/2055650342 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c5268e640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c161510 0x7f0c4c164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c51e8d640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c06ba90 0x7f0c4c14bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c51e8d640 1 -- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c161510 msgr2=0x7f0c4c164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c51e8d640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c161510 0x7f0c4c164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c51e8d640 1 -- 172.21.15.2:0/2055650342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c06f8f0 msgr2=0x7f0c4c164140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c51e8d640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c06f8f0 0x7f0c4c164140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c51e8d640 1 -- 172.21.15.2:0/2055650342 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009420 con 0x7f0c4c06ba90 2023-11-04T01:42:35.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c51e8d640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c06ba90 0x7f0c4c14bdd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ab000 tx=0x7f0c48019070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c427fc640 1 -- 172.21.15.2:0/2055650342 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480ba070 con 0x7f0c4c06ba90 2023-11-04T01:42:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c427fc640 1 -- 172.21.15.2:0/2055650342 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480a7050 con 0x7f0c4c06ba90 2023-11-04T01:42:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c427fc640 1 -- 172.21.15.2:0/2055650342 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b4920 con 0x7f0c4c06ba90 2023-11-04T01:42:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c0c6340 con 0x7f0c4c06ba90 2023-11-04T01:42:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c14fea0 con 0x7f0c4c06ba90 2023-11-04T01:42:35.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.895+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c0744a0 con 0x7f0c4c06ba90 2023-11-04T01:42:35.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.899+0000 7f0c427fc640 1 -- 172.21.15.2:0/2055650342 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c480b2040 con 0x7f0c4c06ba90 2023-11-04T01:42:35.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.899+0000 7f0c427fc640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c300664d0 0x7f0c30068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.899+0000 7f0c427fc640 1 -- 172.21.15.2:0/2055650342 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c4811d980 con 0x7f0c4c06ba90 2023-11-04T01:42:35.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.899+0000 7f0c5168c640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c300664d0 0x7f0c30068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.899+0000 7f0c5168c640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c300664d0 0x7f0c30068990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0c61f0 tx=0x7f0c3c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.899+0000 7f985759e640 1 Processor -- start 2023-11-04T01:42:35.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.899+0000 7f985759e640 1 -- start start 2023-11-04T01:42:35.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 Processor -- start 2023-11-04T01:42:35.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 -- start start 2023-11-04T01:42:35.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985759e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f985806d1d0 0x7f98580cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985759e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f985815f190 0x7f98580c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985759e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580cbf10 con 0x7f98580710d0 2023-11-04T01:42:35.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985759e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98580cb950 con 0x7f985815f190 2023-11-04T01:42:35.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985759e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98580cbc30 con 0x7f985806d1d0 2023-11-04T01:42:35.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f98580710d0 0x7f98580714b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52084/0 (socket says 172.21.15.2:52084) 2023-11-04T01:42:35.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985659c640 1 -- 172.21.15.2:0/430094093 learned_addr learned my addr 172.21.15.2:0/430094093 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:35.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f9855d9b640 1 --2- 172.21.15.2:0/430094093 >> v2:172.21.15.90:3300/0 conn(0x7f985806d1d0 0x7f98580cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985559a640 1 -- 172.21.15.2:0/430094093 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769200488 0 0) 0x7f98580cbf10 con 0x7f98580710d0 2023-11-04T01:42:35.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50c40ae650 0x7f50c40ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c4072350 0x7f50c4065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f50c40aea30 0x7f50c40ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40cc6b0 con 0x7f50c40ae650 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40cf4c0 con 0x7f50c40aea30 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50cade4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c40cc900 con 0x7f50c4072350 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50c40ae650 0x7f50c40ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f985559a640 1 -- 172.21.15.2:0/430094093 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9840003530 con 0x7f98580710d0 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f9855d9b640 1 -- 172.21.15.2:0/430094093 >> v2:172.21.15.2:3300/0 conn(0x7f985815f190 msgr2=0x7f98580c8fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f9855d9b640 1 --2- 172.21.15.2:0/430094093 >> v2:172.21.15.2:3300/0 conn(0x7f985815f190 0x7f98580c8fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f9855d9b640 1 -- 172.21.15.2:0/430094093 >> v1:172.21.15.2:6789/0 conn(0x7f98580710d0 legacy=0x7f98580714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f9855d9b640 1 -- 172.21.15.2:0/430094093 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985815e990 con 0x7f985806d1d0 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 Processor -- start 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 -- start start 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f46040cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f460406d000 0x7f460415d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f46040cb830 0x7f46040cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46040cc200 con 0x7f460406d000 2023-11-04T01:42:35.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46040ce230 con 0x7f46040cb830 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46096ea640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460415ceb0 con 0x7f4604158fc0 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f46027fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f460406d000 0x7f460415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f4602ffd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f46040cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50c40ae650 0x7f50c40ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49914/0 (socket says 172.21.15.2:49914) 2023-11-04T01:42:35.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 -- 172.21.15.2:0/2629450533 learned_addr learned my addr 172.21.15.2:0/2629450533 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f460406d000 0x7f460415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49926/0 (socket says 172.21.15.2:49926) 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46037fe640 1 --2- 172.21.15.2:0/3223918681 >> v2:172.21.15.90:3300/0 conn(0x7f46040cb830 0x7f46040cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 -- 172.21.15.2:0/3223918681 learned_addr learned my addr 172.21.15.2:0/3223918681 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 -- 172.21.15.2:0/3223918681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 msgr2=0x7f46040cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 --2- 172.21.15.2:0/3223918681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f46040cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 -- 172.21.15.2:0/3223918681 >> v2:172.21.15.90:3300/0 conn(0x7f46040cb830 msgr2=0x7f46040cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 --2- 172.21.15.2:0/3223918681 >> v2:172.21.15.90:3300/0 conn(0x7f46040cb830 0x7f46040cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 -- 172.21.15.2:0/3223918681 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46041593a0 con 0x7f460406d000 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c9381640 1 --2- 172.21.15.2:0/2629450533 >> v2:172.21.15.90:3300/0 conn(0x7f50c40aea30 0x7f50c40ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c3fff640 1 --2- 172.21.15.2:0/2629450533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c4072350 0x7f50c4065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 -- 172.21.15.2:0/2629450533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c4072350 msgr2=0x7f50c4065dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 --2- 172.21.15.2:0/2629450533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c4072350 0x7f50c4065dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 -- 172.21.15.2:0/2629450533 >> v2:172.21.15.90:3300/0 conn(0x7f50c40aea30 msgr2=0x7f50c40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 --2- 172.21.15.2:0/2629450533 >> v2:172.21.15.90:3300/0 conn(0x7f50c40aea30 0x7f50c40ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c8b80640 1 -- 172.21.15.2:0/2629450533 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40cf150 con 0x7f50c40ae650 2023-11-04T01:42:35.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.903+0000 7f50c3fff640 1 --2- 172.21.15.2:0/2629450533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c4072350 0x7f50c4065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:35.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f9855d9b640 1 --2- 172.21.15.2:0/430094093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580cb2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98580b44d0 tx=0x7f985001c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df42295b644d3c72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985559a640 1 -- 172.21.15.2:0/430094093 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500a66e0 con 0x7f985806d1d0 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985559a640 1 -- 172.21.15.2:0/430094093 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98500a6840 con 0x7f985806d1d0 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985559a640 1 -- 172.21.15.2:0/430094093 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98500a6bb0 con 0x7f985806d1d0 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 -- 172.21.15.2:0/430094093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 msgr2=0x7f98580cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 --2- 172.21.15.2:0/430094093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580cb2f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f98580b44d0 tx=0x7f985001c810 comp rx=0 tx=0).stop 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 -- 172.21.15.2:0/430094093 shutdown_connections 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 --2- 172.21.15.2:0/430094093 >> v2:172.21.15.2:3300/0 conn(0x7f985815f190 0x7f98580c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 --2- 172.21.15.2:0/430094093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580cb2f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 -- 172.21.15.2:0/430094093 >> 172.21.15.2:0/430094093 conn(0x7f98580b0550 msgr2=0x7f98580b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 -- 172.21.15.2:0/430094093 shutdown_connections 2023-11-04T01:42:35.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f50c8b80640 1 --2- 172.21.15.2:0/2629450533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c40ae650 0x7f50c40ceb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50c40ccfa0 tx=0x7f50b801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab86c4628b75e91b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f985759e640 1 -- 172.21.15.2:0/430094093 wait complete. 2023-11-04T01:42:35.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f46027fc640 1 --2- 172.21.15.2:0/3223918681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415d340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f46040c8fe0 tx=0x7f45f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdb5ca395d439ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f50c37fe640 1 -- 172.21.15.2:0/2629450533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b80ab600 con 0x7f50c40ae650 2023-11-04T01:42:35.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f50c37fe640 1 -- 172.21.15.2:0/2629450533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b80a7050 con 0x7f50c40ae650 2023-11-04T01:42:35.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f50c37fe640 1 -- 172.21.15.2:0/2629450533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b80ab980 con 0x7f50c40ae650 2023-11-04T01:42:35.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.907+0000 7f4601ffb640 1 -- 172.21.15.2:0/3223918681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40ac410 con 0x7f460406d000 2023-11-04T01:42:35.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f4601ffb640 1 -- 172.21.15.2:0/3223918681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f40ac570 con 0x7f460406d000 2023-11-04T01:42:35.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f4601ffb640 1 -- 172.21.15.2:0/3223918681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40ac900 con 0x7f460406d000 2023-11-04T01:42:35.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 Processor -- start 2023-11-04T01:42:35.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 -- 172.21.15.2:0/2629450533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c40ae650 msgr2=0x7f50c40ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 --2- 172.21.15.2:0/2629450533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c40ae650 0x7f50c40ceb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f50c40ccfa0 tx=0x7f50b801c320 comp rx=0 tx=0).stop 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 -- 172.21.15.2:0/3223918681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 msgr2=0x7f460415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 --2- 172.21.15.2:0/3223918681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415d340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f46040c8fe0 tx=0x7f45f401c500 comp rx=0 tx=0).stop 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 -- 172.21.15.2:0/3223918681 shutdown_connections 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 --2- 172.21.15.2:0/3223918681 >> v2:172.21.15.90:3300/0 conn(0x7f46040cb830 0x7f46040cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 --2- 172.21.15.2:0/3223918681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415d340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 --2- 172.21.15.2:0/3223918681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f46040cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 -- 172.21.15.2:0/3223918681 >> 172.21.15.2:0/3223918681 conn(0x7f46040b0550 msgr2=0x7f46040b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 -- 172.21.15.2:0/3223918681 shutdown_connections 2023-11-04T01:42:35.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 -- 172.21.15.2:0/2629450533 shutdown_connections 2023-11-04T01:42:35.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 --2- 172.21.15.2:0/2629450533 >> v2:172.21.15.90:3300/0 conn(0x7f50c40aea30 0x7f50c40ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 --2- 172.21.15.2:0/2629450533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c4072350 0x7f50c4065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 --2- 172.21.15.2:0/2629450533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c40ae650 0x7f50c40ceb40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 -- start start 2023-11-04T01:42:35.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff18159d00 0x7eff180ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff180711f0 0x7eff180cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 -- 172.21.15.2:0/2629450533 >> 172.21.15.2:0/2629450533 conn(0x7f50c40716a0 msgr2=0x7f50c4071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7eff180ce4b0 0x7eff180cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180ce940 con 0x7eff18159d00 2023-11-04T01:42:35.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180cabb0 con 0x7eff180ce4b0 2023-11-04T01:42:35.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff20529640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff180cae90 con 0x7eff180711f0 2023-11-04T01:42:35.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f985759e640 1 Processor -- start 2023-11-04T01:42:35.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7eff180ce4b0 0x7eff180cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f0c427fc640 1 -- 172.21.15.2:0/2055650342 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c480eb020 con 0x7f0c4c06ba90 2023-11-04T01:42:35.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7eff180ce4b0 0x7eff180cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38690/0 (socket says 172.21.15.2:38690) 2023-11-04T01:42:35.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 -- 172.21.15.2:0/1520121922 learned_addr learned my addr 172.21.15.2:0/1520121922 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 -- 172.21.15.2:0/2629450533 shutdown_connections 2023-11-04T01:42:35.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1dac4640 1 --2- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff180711f0 0x7eff180cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 -- 172.21.15.2:0/2629450533 wait complete. 2023-11-04T01:42:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 -- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff180711f0 msgr2=0x7eff180cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 --2- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff180711f0 0x7eff180cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 -- 172.21.15.2:0/1520121922 >> v2:172.21.15.2:3300/0 conn(0x7eff18159d00 msgr2=0x7eff180ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 --2- 172.21.15.2:0/1520121922 >> v2:172.21.15.2:3300/0 conn(0x7eff18159d00 0x7eff180ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7eff1eac6640 1 -- 172.21.15.2:0/1520121922 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180cb170 con 0x7eff180ce4b0 2023-11-04T01:42:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 Processor -- start 2023-11-04T01:42:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f50cade4640 1 -- start start 2023-11-04T01:42:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50cade4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c4072350 0x7f50c4146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f985759e640 1 -- start start 2023-11-04T01:42:35.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98580710d0 0x7f9858159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f985815f190 0x7f98580c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98581595b0 con 0x7f985815f190 2023-11-04T01:42:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98582068f0 con 0x7f985806d1d0 2023-11-04T01:42:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9858206bd0 con 0x7f98580710d0 2023-11-04T01:42:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50cade4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50c40ae650 0x7f50c40acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50cade4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c40aea30 0x7f50c406b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 -- 172.21.15.2:0/3223918681 wait complete. 2023-11-04T01:42:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 Processor -- start 2023-11-04T01:42:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.911+0000 7f46096ea640 1 -- start start 2023-11-04T01:42:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46040cb830 0x7f460415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f4604146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040b4680 con 0x7f460406d000 2023-11-04T01:42:35.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46040b3a00 con 0x7f46040cb830 2023-11-04T01:42:35.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46040b3ce0 con 0x7f4604158fc0 2023-11-04T01:42:35.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50cade4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4153ba0 con 0x7f50c4072350 2023-11-04T01:42:35.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50cade4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4153e80 con 0x7f50c40ae650 2023-11-04T01:42:35.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50cade4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4154160 con 0x7f50c40aea30 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c8b80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c4072350 0x7f50c4146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c9381640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c40aea30 0x7f50c406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c8b80640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c4072350 0x7f50c4146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49958/0 (socket says 172.21.15.2:49958) 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c8b80640 1 -- 172.21.15.2:0/4067612339 learned_addr learned my addr 172.21.15.2:0/4067612339 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38706/0 (socket says 172.21.15.2:38706) 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985659c640 1 -- 172.21.15.2:0/294143143 learned_addr learned my addr 172.21.15.2:0/294143143 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9856d9d640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f985815f190 0x7f98580c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7eff1dac4640 1 --2- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff180711f0 0x7eff180cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46037fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f4604146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49946/0 (socket says 172.21.15.2:49946) 2023-11-04T01:42:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 -- 172.21.15.2:0/3051092332 learned_addr learned my addr 172.21.15.2:0/3051092332 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46037fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f4604146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:49434/0 (socket says 172.21.15.2:49434) 2023-11-04T01:42:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7eff1eac6640 1 --2- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180ce4b0 0x7eff180cbfa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff180c6990 tx=0x7eff1001c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250d41b8fe7753c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c9381640 1 -- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50c40ae650 msgr2=0x7f50c40acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c9381640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50c40ae650 0x7f50c40acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c9381640 1 -- 172.21.15.2:0/4067612339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c4072350 msgr2=0x7f50c4146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c9381640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c4072350 0x7f50c4146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9856d9d640 1 -- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98580710d0 msgr2=0x7f9858159070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-04T01:42:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9856d9d640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98580710d0 0x7f9858159070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9856d9d640 1 -- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 msgr2=0x7f98580c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c9381640 1 -- 172.21.15.2:0/4067612339 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b80094d0 con 0x7f50c40aea30 2023-11-04T01:42:35.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c8b80640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c4072350 0x7f50c4146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9856d9d640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9856d9d640 1 -- 172.21.15.2:0/294143143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009a70 con 0x7f985815f190 2023-11-04T01:42:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985659c640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:42:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9856d9d640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f985815f190 0x7f98580c67f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f984c00b410 tx=0x7f984c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f50c9381640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c40aea30 0x7f50c406b120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50c4070090 tx=0x7f50bc00ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9846ffd640 1 -- 172.21.15.2:0/294143143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c011830 con 0x7f985815f190 2023-11-04T01:42:35.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9846ffd640 1 -- 172.21.15.2:0/294143143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c011990 con 0x7f985815f190 2023-11-04T01:42:35.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9858206eb0 con 0x7f985815f190 2023-11-04T01:42:35.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f9846ffd640 1 -- 172.21.15.2:0/294143143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c011d40 con 0x7f985815f190 2023-11-04T01:42:35.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9858206530 con 0x7f985815f190 2023-11-04T01:42:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 -- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 msgr2=0x7f4604146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f4604146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 -- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46040cb830 msgr2=0x7f460415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46040cb830 0x7f460415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 -- 172.21.15.2:0/3051092332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40094d0 con 0x7f460406d000 2023-11-04T01:42:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f4602ffd640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415b410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f45f800ea50 tx=0x7f45f800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f45eb7fe640 1 -- 172.21.15.2:0/3051092332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f801a850 con 0x7f460406d000 2023-11-04T01:42:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f45eb7fe640 1 -- 172.21.15.2:0/3051092332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f801a9b0 con 0x7f460406d000 2023-11-04T01:42:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46040b3fc0 con 0x7f460406d000 2023-11-04T01:42:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f45eb7fe640 1 -- 172.21.15.2:0/3051092332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f801ad20 con 0x7f460406d000 2023-11-04T01:42:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.915+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460415b950 con 0x7f460406d000 2023-11-04T01:42:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46040b47c0 con 0x7f460406d000 2023-11-04T01:42:35.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f9846ffd640 1 -- 172.21.15.2:0/294143143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f984c01a400 con 0x7f985815f190 2023-11-04T01:42:35.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f9846ffd640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f98380664a0 0x7f9838068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f9846ffd640 1 -- 172.21.15.2:0/294143143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f984c083d20 con 0x7f985815f190 2023-11-04T01:42:35.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f985659c640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f98380664a0 0x7f9838068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f45eb7fe640 1 -- 172.21.15.2:0/3051092332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45f800a430 con 0x7f460406d000 2023-11-04T01:42:35.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f985659c640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f98380664a0 0x7f9838068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98480011f0 tx=0x7f9848009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1d2c3640 1 -- 172.21.15.2:0/1520121922 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100a5790 con 0x7eff180ce4b0 2023-11-04T01:42:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1d2c3640 1 -- 172.21.15.2:0/1520121922 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff100a58f0 con 0x7eff180ce4b0 2023-11-04T01:42:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1d2c3640 1 -- 172.21.15.2:0/1520121922 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100a5d00 con 0x7eff180ce4b0 2023-11-04T01:42:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180ce4b0 msgr2=0x7eff180cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 --2- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180ce4b0 0x7eff180cbfa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7eff180c6990 tx=0x7eff1001c710 comp rx=0 tx=0).stop 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- 172.21.15.2:0/1520121922 shutdown_connections 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 --2- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180ce4b0 0x7eff180cbfa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 --2- 172.21.15.2:0/1520121922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff180711f0 0x7eff180cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 --2- 172.21.15.2:0/1520121922 >> v2:172.21.15.2:3300/0 conn(0x7eff18159d00 0x7eff180ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- 172.21.15.2:0/1520121922 >> 172.21.15.2:0/1520121922 conn(0x7eff180cf990 msgr2=0x7eff180cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- 172.21.15.2:0/1520121922 shutdown_connections 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- 172.21.15.2:0/1520121922 wait complete. 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 Processor -- start 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- start start 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180711f0 0x7eff18152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180ce4b0 0x7eff181f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff18159d00 0x7eff181521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18153370 con 0x7eff180ce4b0 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18153d90 con 0x7eff180711f0 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff20529640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff18154070 con 0x7eff18159d00 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180ce4b0 0x7eff181f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180ce4b0 0x7eff181f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49970/0 (socket says 172.21.15.2:49970) 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 -- 172.21.15.2:0/1937516098 learned_addr learned my addr 172.21.15.2:0/1937516098 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1e2c5640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180711f0 0x7eff18152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1eac6640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff18159d00 0x7eff181521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 -- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff18159d00 msgr2=0x7eff181521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff18159d00 0x7eff181521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 -- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180711f0 msgr2=0x7eff18152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:35.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180711f0 0x7eff18152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:35.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50c17fa640 1 -- 172.21.15.2:0/4067612339 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc00ce90 con 0x7f50c40aea30 2023-11-04T01:42:35.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f45eb7fe640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45f00664a0 0x7f45f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f45eb7fe640 1 -- 172.21.15.2:0/3051092332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45f808cf60 con 0x7f460406d000 2023-11-04T01:42:35.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.923+0000 7eff1dac4640 1 -- 172.21.15.2:0/1937516098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff08009420 con 0x7eff180ce4b0 2023-11-04T01:42:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f46027fc640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45f00664a0 0x7f45f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.919+0000 7f46027fc640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45f00664a0 0x7f45f0068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45f40ae000 tx=0x7f45f4004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c4154440 con 0x7f50c40aea30 2023-11-04T01:42:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c4147080 con 0x7f50c40aea30 2023-11-04T01:42:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50c17fa640 1 -- 172.21.15.2:0/4067612339 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc00f040 con 0x7f50c40aea30 2023-11-04T01:42:35.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50c17fa640 1 -- 172.21.15.2:0/4067612339 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0146a0 con 0x7f50c40aea30 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7eff1dac4640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180ce4b0 0x7eff181f34e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff0800ebe0 tx=0x7eff0800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c005260 con 0x7f985815f190 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a4005260 con 0x7f50c40aea30 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50c17fa640 1 -- 172.21.15.2:0/4067612339 <== mon.2 v2:172.21.15.90:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50bc014800 con 0x7f50c40aea30 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50c17fa640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50a80664f0 0x7f50a80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50c17fa640 1 -- 172.21.15.2:0/4067612339 <== mon.2 v2:172.21.15.90:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50bc085140 con 0x7f50c40aea30 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.927+0000 7f50c8b80640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50a80664f0 0x7f50a80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.931+0000 7f50c8b80640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50a80664f0 0x7f50a80689b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50b801c360 tx=0x7f50b80a4f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.931+0000 7f45eb7fe640 1 -- 172.21.15.2:0/3051092332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46040b47c0 con 0x7f460406d000 2023-11-04T01:42:35.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.931+0000 7eff0effd640 1 -- 172.21.15.2:0/1937516098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800eee0 con 0x7eff180ce4b0 2023-11-04T01:42:35.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.931+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff10009af0 con 0x7eff180ce4b0 2023-11-04T01:42:35.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.931+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff18154630 con 0x7eff180ce4b0 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.931+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1804ecf0 con 0x7eff180ce4b0 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.939+0000 7eff0effd640 1 -- 172.21.15.2:0/1937516098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800cc30 con 0x7eff180ce4b0 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.939+0000 7eff0effd640 1 -- 172.21.15.2:0/1937516098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff08004020 con 0x7eff180ce4b0 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.939+0000 7f9846ffd640 1 -- 172.21.15.2:0/294143143 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f984c051230 con 0x7f985815f190 2023-11-04T01:42:35.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.939+0000 7f50c17fa640 1 -- 172.21.15.2:0/4067612339 <== mon.2 v2:172.21.15.90:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f50bc052610 con 0x7f50c40aea30 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.943+0000 7eff0effd640 1 -- 172.21.15.2:0/1937516098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff08004180 con 0x7eff180ce4b0 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.943+0000 7eff0effd640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.943+0000 7eff1e2c5640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.943+0000 7eff0effd640 1 -- 172.21.15.2:0/1937516098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff08055340 con 0x7eff180ce4b0 2023-11-04T01:42:35.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.943+0000 7eff1e2c5640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff180b32e0 tx=0x7eff14006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:35.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:35.951+0000 7eff0effd640 1 -- 172.21.15.2:0/1937516098 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff08051680 con 0x7eff180ce4b0 2023-11-04T01:42:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.131+0000 7fb6d26a6640 1 -- 172.21.15.2:0/837124713 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb6ac005510 con 0x7fb6cc158fc0 2023-11-04T01:42:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.131+0000 7fb6c8ff9640 1 -- 172.21.15.2:0/837124713 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6c40bf090 con 0x7fb6cc158fc0 2023-11-04T01:42:36.140 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:36.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 -- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6b80664d0 msgr2=0x7fb6b8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6b80664d0 0x7fb6b8068990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0001c00 tx=0x7fb6c0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 -- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc158fc0 msgr2=0x7fb6cc0b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc158fc0 0x7fb6cc0b1600 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40af000 tx=0x7fb6c401d5d0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 -- 172.21.15.2:0/837124713 shutdown_connections 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6b80664d0 0x7fb6b8068990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6cc0b1b40 0x7fb6cc0b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6cc158fc0 0x7fb6cc0b1600 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 --2- 172.21.15.2:0/837124713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6cc0cb830 0x7fb6cc147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 -- 172.21.15.2:0/837124713 >> 172.21.15.2:0/837124713 conn(0x7fb6cc0b0550 msgr2=0x7fb6cc0c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 -- 172.21.15.2:0/837124713 shutdown_connections 2023-11-04T01:42:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.135+0000 7fb6b27fc640 1 -- 172.21.15.2:0/837124713 wait complete. 2023-11-04T01:42:36.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.147+0000 7f6ed56e9640 1 -- 172.21.15.2:0/3318337200 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6eb00057e0 con 0x7f6ed00cba50 2023-11-04T01:42:36.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.147+0000 7f6eccff9640 1 -- 172.21.15.2:0/3318337200 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ec80c6020 con 0x7f6ed00cba50 2023-11-04T01:42:36.155 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 -- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ebc0664d0 msgr2=0x7f6ebc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ebc0664d0 0x7f6ebc068990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6ed006bb70 tx=0x7f6ec0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 -- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed00cba50 msgr2=0x7f6ed01f8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed00cba50 0x7f6ed01f8150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80ac000 tx=0x7f6ec8019730 comp rx=0 tx=0).stop 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 -- 172.21.15.2:0/3318337200 shutdown_connections 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ebc0664d0 0x7f6ebc068990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed0159140 0x7f6ed0159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ed0158d60 0x7f6ed01f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 --2- 172.21.15.2:0/3318337200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ed00cba50 0x7f6ed01f8150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 -- 172.21.15.2:0/3318337200 >> 172.21.15.2:0/3318337200 conn(0x7f6ed00b0550 msgr2=0x7f6ed0073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 -- 172.21.15.2:0/3318337200 shutdown_connections 2023-11-04T01:42:36.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.151+0000 7f6eb67fc640 1 -- 172.21.15.2:0/3318337200 wait complete. 2023-11-04T01:42:36.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2023-11-04T01:42:36.165 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.163+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f44f81f7f30 con 0x7f44f80c7690 2023-11-04T01:42:36.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.163+0000 7f44ee7fc640 1 -- 172.21.15.2:0/3690037878 <== mon.1 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44f81f7f30 con 0x7f44f80c7690 2023-11-04T01:42:36.168 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44dc0664f0 msgr2=0x7f44dc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44dc0664f0 0x7f44dc0689b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44f81fa110 tx=0x7f44f4008040 comp rx=0 tx=0).stop 2023-11-04T01:42:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f80c7690 msgr2=0x7f44f81f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f80c7690 0x7f44f81f68e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f44f001d6f0 tx=0x7f44e4005800 comp rx=0 tx=0).stop 2023-11-04T01:42:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 shutdown_connections 2023-11-04T01:42:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44dc0664f0 0x7f44dc0689b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44f80c7690 0x7f44f81f68e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44f80b0c10 0x7f44f80c7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 --2- 172.21.15.2:0/3690037878 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44f81f6500 0x7f44f80b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 >> 172.21.15.2:0/3690037878 conn(0x7f44f80cb630 msgr2=0x7f44f815f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 shutdown_connections 2023-11-04T01:42:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.167+0000 7f44ffd48640 1 -- 172.21.15.2:0/3690037878 wait complete. 2023-11-04T01:42:36.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2023-11-04T01:42:36.180 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2023-11-04T01:42:36.188 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0c4c14fd00 con 0x7f0c4c06ba90 2023-11-04T01:42:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c427fc640 1 -- 172.21.15.2:0/2055650342 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c4c14fd00 con 0x7f0c4c06ba90 2023-11-04T01:42:36.207 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c300664d0 msgr2=0x7f0c30068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c300664d0 0x7f0c30068990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0c61f0 tx=0x7f0c3c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c06ba90 msgr2=0x7f0c4c14bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c06ba90 0x7f0c4c14bdd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ab000 tx=0x7f0c48019070 comp rx=0 tx=0).stop 2023-11-04T01:42:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 shutdown_connections 2023-11-04T01:42:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c300664d0 0x7f0c30068990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c161510 0x7f0c4c164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c06f8f0 0x7f0c4c164140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 --2- 172.21.15.2:0/2055650342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c06ba90 0x7f0c4c14bdd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 >> 172.21.15.2:0/2055650342 conn(0x7f0c4c0cebb0 msgr2=0x7f0c4c163030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 shutdown_connections 2023-11-04T01:42:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.203+0000 7f0c540f1640 1 -- 172.21.15.2:0/2055650342 wait complete. 2023-11-04T01:42:36.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2023-11-04T01:42:36.224 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46040b47c0 con 0x7f460406d000 2023-11-04T01:42:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f45eb7fe640 1 -- 172.21.15.2:0/3051092332 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46040b47c0 con 0x7f460406d000 2023-11-04T01:42:36.242 INFO:teuthology.orchestra.run.smithi002.stdout:60129542150 2023-11-04T01:42:36.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45f00664a0 msgr2=0x7f45f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45f00664a0 0x7f45f0068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45f40ae000 tx=0x7f45f4004740 comp rx=0 tx=0).stop 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 msgr2=0x7f460415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415b410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f45f800ea50 tx=0x7f45f800ef10 comp rx=0 tx=0).stop 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 shutdown_connections 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45f00664a0 0x7f45f0068960 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45f40ae000 tx=0x7f45f4004740 comp rx=0 tx=0).stop 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4604158fc0 0x7f4604146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46040cb830 0x7f460415bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 --2- 172.21.15.2:0/3051092332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f460406d000 0x7f460415b410 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 >> 172.21.15.2:0/3051092332 conn(0x7f46040b0550 msgr2=0x7f4604073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 shutdown_connections 2023-11-04T01:42:36.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.239+0000 7f46096ea640 1 -- 172.21.15.2:0/3051092332 wait complete. 2023-11-04T01:42:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.247+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50a40057e0 con 0x7f50c40aea30 2023-11-04T01:42:36.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.247+0000 7f50c17fa640 1 -- 172.21.15.2:0/4067612339 <== mon.2 v2:172.21.15.90:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50bc018090 con 0x7f50c40aea30 2023-11-04T01:42:36.252 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50a80664f0 msgr2=0x7f50a80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50a80664f0 0x7f50a80689b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50b801c360 tx=0x7f50b80a4f90 comp rx=0 tx=0).stop 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c40aea30 msgr2=0x7f50c406b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c40aea30 0x7f50c406b120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50c4070090 tx=0x7f50bc00ef90 comp rx=0 tx=0).stop 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 shutdown_connections 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50a80664f0 0x7f50a80689b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50c40aea30 0x7f50c406b120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50c40ae650 0x7f50c40acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 --2- 172.21.15.2:0/4067612339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50c4072350 0x7f50c4146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 >> 172.21.15.2:0/4067612339 conn(0x7f50c40716a0 msgr2=0x7f50c40cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 shutdown_connections 2023-11-04T01:42:36.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.251+0000 7f50cade4640 1 -- 172.21.15.2:0/4067612339 wait complete. 2023-11-04T01:42:36.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.255+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f983c0057e0 con 0x7f985815f190 2023-11-04T01:42:36.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.255+0000 7f9846ffd640 1 -- 172.21.15.2:0/294143143 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f984c015030 con 0x7f985815f190 2023-11-04T01:42:36.261 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2023-11-04T01:42:36.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f98380664a0 msgr2=0x7f9838068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f98380664a0 0x7f9838068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98480011f0 tx=0x7f9848009040 comp rx=0 tx=0).stop 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f985815f190 msgr2=0x7f98580c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f985815f190 0x7f98580c67f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f984c00b410 tx=0x7f984c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 shutdown_connections 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f98380664a0 0x7f9838068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f985815f190 0x7f98580c67f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f98580710d0 0x7f9858159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 --2- 172.21.15.2:0/294143143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f985806d1d0 0x7f98580c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 >> 172.21.15.2:0/294143143 conn(0x7f98580b0550 msgr2=0x7f98580ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 shutdown_connections 2023-11-04T01:42:36.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.259+0000 7f985759e640 1 -- 172.21.15.2:0/294143143 wait complete. 2023-11-04T01:42:36.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2023-11-04T01:42:36.267 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.267+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7eff180cd2f0 con 0x7eff180ce4b0 2023-11-04T01:42:36.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff0effd640 1 -- 172.21.15.2:0/1937516098 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff08017090 con 0x7eff180ce4b0 2023-11-04T01:42:36.274 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2023-11-04T01:42:36.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-11-04T01:42:36.275 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 msgr2=0x7efefc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff180b32e0 tx=0x7eff14006f90 comp rx=0 tx=0).stop 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180ce4b0 msgr2=0x7eff181f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180ce4b0 0x7eff181f34e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7eff0800ebe0 tx=0x7eff0800c520 comp rx=0 tx=0).stop 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 shutdown_connections 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff18159d00 0x7eff181521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff180ce4b0 0x7eff181f34e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 --2- 172.21.15.2:0/1937516098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff180711f0 0x7eff18152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 >> 172.21.15.2:0/1937516098 conn(0x7eff180cf990 msgr2=0x7eff180cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 shutdown_connections 2023-11-04T01:42:36.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.271+0000 7eff20529640 1 -- 172.21.15.2:0/1937516098 wait complete. 2023-11-04T01:42:36.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2023-11-04T01:42:36.288 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2023-11-04T01:42:36.295 DEBUG:teuthology.parallel:result is None 2023-11-04T01:42:36.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:42:36.295 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb77a569640 1 Processor -- start 2023-11-04T01:42:36.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb77a569640 1 -- start start 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb77a569640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415a080 0x7fb774065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb77a569640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb77415e7f0 0x7fb77415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb77a569640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7740cc740 con 0x7fb77415e170 2023-11-04T01:42:36.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb77a569640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb774066510 con 0x7fb77415e7f0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb77a569640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77406b170 con 0x7fb77415a080 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb7737fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb77415e7f0 0x7fb77415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb7737fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb77415e7f0 0x7fb77415dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49972/0 (socket says 172.21.15.2:49972) 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb7737fe640 1 -- 172.21.15.2:0/1856433271 learned_addr learned my addr 172.21.15.2:0/1856433271 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb773fff640 1 --2- 172.21.15.2:0/1856433271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415a080 0x7fb774065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb7737fe640 1 -- 172.21.15.2:0/1856433271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415a080 msgr2=0x7fb774065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb7737fe640 1 --2- 172.21.15.2:0/1856433271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415a080 0x7fb774065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb7737fe640 1 -- 172.21.15.2:0/1856433271 >> v1:172.21.15.90:6789/0 conn(0x7fb77415e170 legacy=0x7fb7740b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb7737fe640 1 -- 172.21.15.2:0/1856433271 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77415e590 con 0x7fb77415e7f0 2023-11-04T01:42:36.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.439+0000 7fb773fff640 1 --2- 172.21.15.2:0/1856433271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415a080 0x7fb774065fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb7737fe640 1 --2- 172.21.15.2:0/1856433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb77415dc30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb76800bb10 tx=0x7fb76801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cf2aad68bce8d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb772ffd640 1 -- 172.21.15.2:0/1856433271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680a7b60 con 0x7fb77415e7f0 2023-11-04T01:42:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb772ffd640 1 -- 172.21.15.2:0/1856433271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680a7cc0 con 0x7fb77415e7f0 2023-11-04T01:42:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb772ffd640 1 -- 172.21.15.2:0/1856433271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680af660 con 0x7fb77415e7f0 2023-11-04T01:42:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- 172.21.15.2:0/1856433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 msgr2=0x7fb77415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 --2- 172.21.15.2:0/1856433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb77415dc30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb76800bb10 tx=0x7fb76801ebb0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- 172.21.15.2:0/1856433271 shutdown_connections 2023-11-04T01:42:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 --2- 172.21.15.2:0/1856433271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb77415dc30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 --2- 172.21.15.2:0/1856433271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415a080 0x7fb774065fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- 172.21.15.2:0/1856433271 >> 172.21.15.2:0/1856433271 conn(0x7fb7740716a0 msgr2=0x7fb774071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- 172.21.15.2:0/1856433271 shutdown_connections 2023-11-04T01:42:36.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- 172.21.15.2:0/1856433271 wait complete. 2023-11-04T01:42:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 Processor -- start 2023-11-04T01:42:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- start start 2023-11-04T01:42:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb77415a080 0x7fb77415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415e170 0x7fb77414b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb774159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740ce690 con 0x7fb77415e7f0 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740cda80 con 0x7fb77415a080 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb77a569640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740cdd60 con 0x7fb77415e170 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb774159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb774159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49980/0 (socket says 172.21.15.2:49980) 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 -- 172.21.15.2:0/2912683165 learned_addr learned my addr 172.21.15.2:0/2912683165 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb7737fe640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415e170 0x7fb77414b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb773fff640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb77415a080 0x7fb77415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 -- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415e170 msgr2=0x7fb77414b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415e170 0x7fb77414b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 -- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb77415a080 msgr2=0x7fb77415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb77415a080 0x7fb77415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 -- 172.21.15.2:0/2912683165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76800b770 con 0x7fb77415e7f0 2023-11-04T01:42:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb773fff640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb77415a080 0x7fb77415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb778b06640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb774159510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c780 tx=0x7fb76c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.443+0000 7fb770ff9640 1 -- 172.21.15.2:0/2912683165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c004b70 con 0x7fb77415e7f0 2023-11-04T01:42:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb770ff9640 1 -- 172.21.15.2:0/2912683165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00ce90 con 0x7fb77415e7f0 2023-11-04T01:42:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb770ff9640 1 -- 172.21.15.2:0/2912683165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00a850 con 0x7fb77415e7f0 2023-11-04T01:42:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7740ce040 con 0x7fb77415e7f0 2023-11-04T01:42:36.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77415d3b0 con 0x7fb77415e7f0 2023-11-04T01:42:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7740ce800 con 0x7fb77415e7f0 2023-11-04T01:42:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb770ff9640 1 -- 172.21.15.2:0/2912683165 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb76c00a9b0 con 0x7fb77415e7f0 2023-11-04T01:42:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb770ff9640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb7600664a0 0x7fb760068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb770ff9640 1 -- 172.21.15.2:0/2912683165 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb76c084090 con 0x7fb77415e7f0 2023-11-04T01:42:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb773fff640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb7600664a0 0x7fb760068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.447+0000 7fb773fff640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb7600664a0 0x7fb760068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb764008890 tx=0x7fb764008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.451+0000 7fb770ff9640 1 -- 172.21.15.2:0/2912683165 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb76c051470 con 0x7fb77415e7f0 2023-11-04T01:42:36.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.599+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb77406dcd0 con 0x7fb7600664a0 2023-11-04T01:42:36.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb770ff9640 1 -- 172.21.15.2:0/2912683165 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264450 (secure 0 0 0) 0x7fb76400c040 con 0x7fb7600664a0 2023-11-04T01:42:36.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb7600664a0 msgr2=0x7fb760068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb7600664a0 0x7fb760068960 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb764008890 tx=0x7fb764008040 comp rx=0 tx=0).stop 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 msgr2=0x7fb774159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb774159510 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c780 tx=0x7fb76c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 shutdown_connections 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb7600664a0 0x7fb760068960 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb77415e7f0 0x7fb774159510 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb77415e170 0x7fb77414b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 --2- 172.21.15.2:0/2912683165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb77415a080 0x7fb77415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 >> 172.21.15.2:0/2912683165 conn(0x7fb7740716a0 msgr2=0x7fb7740cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 shutdown_connections 2023-11-04T01:42:36.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.623+0000 7fb77a569640 1 -- 172.21.15.2:0/2912683165 wait complete. 2023-11-04T01:42:36.644 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-04T01:42:34.762465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235668,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2924544,"data_stored":1769996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003503"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508406+0000","last_change":"2023-11-04T01:42:24.537942+0000","last_active":"2023-11-04T01:42:25.508406+0000","last_peered":"2023-11-04T01:42:25.508406+0000","last_clean":"2023-11-04T01:42:25.508406+0000","last_became_active":"2023-11-04T01:42:24.537165+0000","last_became_peered":"2023-11-04T01:42:24.537165+0000","last_unstale":"2023-11-04T01:42:25.508406+0000","last_undegraded":"2023-11-04T01:42:25.508406+0000","last_fullsized":"2023-11-04T01:42:25.508406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:27.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677665+0000","last_change":"2023-11-04T01:42:24.526074+0000","last_active":"2023-11-04T01:42:26.677665+0000","last_peered":"2023-11-04T01:42:26.677665+0000","last_clean":"2023-11-04T01:42:26.677665+0000","last_became_active":"2023-11-04T01:42:24.525339+0000","last_became_peered":"2023-11-04T01:42:24.525339+0000","last_unstale":"2023-11-04T01:42:26.677665+0000","last_undegraded":"2023-11-04T01:42:26.677665+0000","last_fullsized":"2023-11-04T01:42:26.677665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:30.235988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677398+0000","last_change":"2023-11-04T01:42:24.532853+0000","last_active":"2023-11-04T01:42:26.677398+0000","last_peered":"2023-11-04T01:42:26.677398+0000","last_clean":"2023-11-04T01:42:26.677398+0000","last_became_active":"2023-11-04T01:42:24.531811+0000","last_became_peered":"2023-11-04T01:42:24.531811+0000","last_unstale":"2023-11-04T01:42:26.677398+0000","last_undegraded":"2023-11-04T01:42:26.677398+0000","last_fullsized":"2023-11-04T01:42:26.677398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:10.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181236+0000","last_change":"2023-11-04T01:42:24.532090+0000","last_active":"2023-11-04T01:42:27.181236+0000","last_peered":"2023-11-04T01:42:27.181236+0000","last_clean":"2023-11-04T01:42:27.181236+0000","last_became_active":"2023-11-04T01:42:24.531252+0000","last_became_peered":"2023-11-04T01:42:24.531252+0000","last_unstale":"2023-11-04T01:42:27.181236+0000","last_undegraded":"2023-11-04T01:42:27.181236+0000","last_fullsized":"2023-11-04T01:42:27.181236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508158+0000","last_change":"2023-11-04T01:42:24.555465+0000","last_active":"2023-11-04T01:42:25.508158+0000","last_peered":"2023-11-04T01:42:25.508158+0000","last_clean":"2023-11-04T01:42:25.508158+0000","last_became_active":"2023-11-04T01:42:24.554690+0000","last_became_peered":"2023-11-04T01:42:24.554690+0000","last_unstale":"2023-11-04T01:42:25.508158+0000","last_undegraded":"2023-11-04T01:42:25.508158+0000","last_fullsized":"2023-11-04T01:42:25.508158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:50.998381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.180984+0000","last_change":"2023-11-04T01:42:24.532641+0000","last_active":"2023-11-04T01:42:27.180984+0000","last_peered":"2023-11-04T01:42:27.180984+0000","last_clean":"2023-11-04T01:42:27.180984+0000","last_became_active":"2023-11-04T01:42:24.531903+0000","last_became_peered":"2023-11-04T01:42:24.531903+0000","last_unstale":"2023-11-04T01:42:27.180984+0000","last_undegraded":"2023-11-04T01:42:27.180984+0000","last_fullsized":"2023-11-04T01:42:27.180984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508004+0000","last_change":"2023-11-04T01:42:24.534979+0000","last_active":"2023-11-04T01:42:25.508004+0000","last_peered":"2023-11-04T01:42:25.508004+0000","last_clean":"2023-11-04T01:42:25.508004+0000","last_became_active":"2023-11-04T01:42:24.534228+0000","last_became_peered":"2023-11-04T01:42:24.534228+0000","last_unstale":"2023-11-04T01:42:25.508004+0000","last_undegraded":"2023-11-04T01:42:25.508004+0000","last_fullsized":"2023-11-04T01:42:25.508004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:22.475674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677059+0000","last_change":"2023-11-04T01:42:24.532676+0000","last_active":"2023-11-04T01:42:26.677059+0000","last_peered":"2023-11-04T01:42:26.677059+0000","last_clean":"2023-11-04T01:42:26.677059+0000","last_became_active":"2023-11-04T01:42:24.531878+0000","last_became_peered":"2023-11-04T01:42:24.531878+0000","last_unstale":"2023-11-04T01:42:26.677059+0000","last_undegraded":"2023-11-04T01:42:26.677059+0000","last_fullsized":"2023-11-04T01:42:26.677059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:22.689923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.179495+0000","last_change":"2023-11-04T01:42:24.535521+0000","last_active":"2023-11-04T01:42:27.179495+0000","last_peered":"2023-11-04T01:42:27.179495+0000","last_clean":"2023-11-04T01:42:27.179495+0000","last_became_active":"2023-11-04T01:42:24.534783+0000","last_became_peered":"2023-11-04T01:42:24.534783+0000","last_unstale":"2023-11-04T01:42:27.179495+0000","last_undegraded":"2023-11-04T01:42:27.179495+0000","last_fullsized":"2023-11-04T01:42:27.179495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507864+0000","last_change":"2023-11-04T01:42:24.545554+0000","last_active":"2023-11-04T01:42:25.507864+0000","last_peered":"2023-11-04T01:42:25.507864+0000","last_clean":"2023-11-04T01:42:25.507864+0000","last_became_active":"2023-11-04T01:42:24.544913+0000","last_became_peered":"2023-11-04T01:42:24.544913+0000","last_unstale":"2023-11-04T01:42:25.507864+0000","last_undegraded":"2023-11-04T01:42:25.507864+0000","last_fullsized":"2023-11-04T01:42:25.507864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:10.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508181+0000","last_change":"2023-11-04T01:42:24.549621+0000","last_active":"2023-11-04T01:42:25.508181+0000","last_peered":"2023-11-04T01:42:25.508181+0000","last_clean":"2023-11-04T01:42:25.508181+0000","last_became_active":"2023-11-04T01:42:24.548804+0000","last_became_peered":"2023-11-04T01:42:24.548804+0000","last_unstale":"2023-11-04T01:42:25.508181+0000","last_undegraded":"2023-11-04T01:42:25.508181+0000","last_fullsized":"2023-11-04T01:42:25.508181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:36.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508310+0000","last_change":"2023-11-04T01:42:24.545059+0000","last_active":"2023-11-04T01:42:25.508310+0000","last_peered":"2023-11-04T01:42:25.508310+0000","last_clean":"2023-11-04T01:42:25.508310+0000","last_became_active":"2023-11-04T01:42:24.544341+0000","last_became_peered":"2023-11-04T01:42:24.544341+0000","last_unstale":"2023-11-04T01:42:25.508310+0000","last_undegraded":"2023-11-04T01:42:25.508310+0000","last_fullsized":"2023-11-04T01:42:25.508310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.705964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573452+0000","last_change":"2023-11-04T01:42:24.555198+0000","last_active":"2023-11-04T01:42:25.573452+0000","last_peered":"2023-11-04T01:42:25.573452+0000","last_clean":"2023-11-04T01:42:25.573452+0000","last_became_active":"2023-11-04T01:42:24.554517+0000","last_became_peered":"2023-11-04T01:42:24.554517+0000","last_unstale":"2023-11-04T01:42:25.573452+0000","last_undegraded":"2023-11-04T01:42:25.573452+0000","last_fullsized":"2023-11-04T01:42:25.573452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572931+0000","last_change":"2023-11-04T01:42:24.537075+0000","last_active":"2023-11-04T01:42:25.572931+0000","last_peered":"2023-11-04T01:42:25.572931+0000","last_clean":"2023-11-04T01:42:25.572931+0000","last_became_active":"2023-11-04T01:42:24.536346+0000","last_became_peered":"2023-11-04T01:42:24.536346+0000","last_unstale":"2023-11-04T01:42:25.572931+0000","last_undegraded":"2023-11-04T01:42:25.572931+0000","last_fullsized":"2023-11-04T01:42:25.572931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.676983+0000","last_change":"2023-11-04T01:42:24.526411+0000","last_active":"2023-11-04T01:42:26.676983+0000","last_peered":"2023-11-04T01:42:26.676983+0000","last_clean":"2023-11-04T01:42:26.676983+0000","last_became_active":"2023-11-04T01:42:24.525610+0000","last_became_peered":"2023-11-04T01:42:24.525610+0000","last_unstale":"2023-11-04T01:42:26.676983+0000","last_undegraded":"2023-11-04T01:42:26.676983+0000","last_fullsized":"2023-11-04T01:42:26.676983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:26.640689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505513+0000","last_change":"2023-11-04T01:42:24.551036+0000","last_active":"2023-11-04T01:42:25.505513+0000","last_peered":"2023-11-04T01:42:25.505513+0000","last_clean":"2023-11-04T01:42:25.505513+0000","last_became_active":"2023-11-04T01:42:24.550386+0000","last_became_peered":"2023-11-04T01:42:24.550386+0000","last_unstale":"2023-11-04T01:42:25.505513+0000","last_undegraded":"2023-11-04T01:42:25.505513+0000","last_fullsized":"2023-11-04T01:42:25.505513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506769+0000","last_change":"2023-11-04T01:42:24.559164+0000","last_active":"2023-11-04T01:42:25.506769+0000","last_peered":"2023-11-04T01:42:25.506769+0000","last_clean":"2023-11-04T01:42:25.506769+0000","last_became_active":"2023-11-04T01:42:24.558452+0000","last_became_peered":"2023-11-04T01:42:24.558452+0000","last_unstale":"2023-11-04T01:42:25.506769+0000","last_undegraded":"2023-11-04T01:42:25.506769+0000","last_fullsized":"2023-11-04T01:42:25.506769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:31.294438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178817+0000","last_change":"2023-11-04T01:42:24.542766+0000","last_active":"2023-11-04T01:42:27.178817+0000","last_peered":"2023-11-04T01:42:27.178817+0000","last_clean":"2023-11-04T01:42:27.178817+0000","last_became_active":"2023-11-04T01:42:24.542209+0000","last_became_peered":"2023-11-04T01:42:24.542209+0000","last_unstale":"2023-11-04T01:42:27.178817+0000","last_undegraded":"2023-11-04T01:42:27.178817+0000","last_fullsized":"2023-11-04T01:42:27.178817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:53.449814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507069+0000","last_change":"2023-11-04T01:42:24.533283+0000","last_active":"2023-11-04T01:42:25.507069+0000","last_peered":"2023-11-04T01:42:25.507069+0000","last_clean":"2023-11-04T01:42:25.507069+0000","last_became_active":"2023-11-04T01:42:24.530651+0000","last_became_peered":"2023-11-04T01:42:24.530651+0000","last_unstale":"2023-11-04T01:42:25.507069+0000","last_undegraded":"2023-11-04T01:42:25.507069+0000","last_fullsized":"2023-11-04T01:42:25.507069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:51.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508171+0000","last_change":"2023-11-04T01:42:24.545087+0000","last_active":"2023-11-04T01:42:25.508171+0000","last_peered":"2023-11-04T01:42:25.508171+0000","last_clean":"2023-11-04T01:42:25.508171+0000","last_became_active":"2023-11-04T01:42:24.544372+0000","last_became_peered":"2023-11-04T01:42:24.544372+0000","last_unstale":"2023-11-04T01:42:25.508171+0000","last_undegraded":"2023-11-04T01:42:25.508171+0000","last_fullsized":"2023-11-04T01:42:25.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:30.235988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504099+0000","last_change":"2023-11-04T01:42:24.528107+0000","last_active":"2023-11-04T01:42:25.504099+0000","last_peered":"2023-11-04T01:42:25.504099+0000","last_clean":"2023-11-04T01:42:25.504099+0000","last_became_active":"2023-11-04T01:42:24.527344+0000","last_became_peered":"2023-11-04T01:42:24.527344+0000","last_unstale":"2023-11-04T01:42:25.504099+0000","last_undegraded":"2023-11-04T01:42:25.504099+0000","last_fullsized":"2023-11-04T01:42:25.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:48.101766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.179302+0000","last_change":"2023-11-04T01:42:24.516917+0000","last_active":"2023-11-04T01:42:27.179302+0000","last_peered":"2023-11-04T01:42:27.179302+0000","last_clean":"2023-11-04T01:42:27.179302+0000","last_became_active":"2023-11-04T01:42:24.516072+0000","last_became_peered":"2023-11-04T01:42:24.516072+0000","last_unstale":"2023-11-04T01:42:27.179302+0000","last_undegraded":"2023-11-04T01:42:27.179302+0000","last_fullsized":"2023-11-04T01:42:27.179302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677186+0000","last_change":"2023-11-04T01:42:24.544709+0000","last_active":"2023-11-04T01:42:26.677186+0000","last_peered":"2023-11-04T01:42:26.677186+0000","last_clean":"2023-11-04T01:42:26.677186+0000","last_became_active":"2023-11-04T01:42:24.543976+0000","last_became_peered":"2023-11-04T01:42:24.543976+0000","last_unstale":"2023-11-04T01:42:26.677186+0000","last_undegraded":"2023-11-04T01:42:26.677186+0000","last_fullsized":"2023-11-04T01:42:26.677186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:15.212905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505748+0000","last_change":"2023-11-04T01:42:24.532616+0000","last_active":"2023-11-04T01:42:25.505748+0000","last_peered":"2023-11-04T01:42:25.505748+0000","last_clean":"2023-11-04T01:42:25.505748+0000","last_became_active":"2023-11-04T01:42:24.529894+0000","last_became_peered":"2023-11-04T01:42:24.529894+0000","last_unstale":"2023-11-04T01:42:25.505748+0000","last_undegraded":"2023-11-04T01:42:25.505748+0000","last_fullsized":"2023-11-04T01:42:25.505748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677675+0000","last_change":"2023-11-04T01:42:24.540137+0000","last_active":"2023-11-04T01:42:26.677675+0000","last_peered":"2023-11-04T01:42:26.677675+0000","last_clean":"2023-11-04T01:42:26.677675+0000","last_became_active":"2023-11-04T01:42:24.539303+0000","last_became_peered":"2023-11-04T01:42:24.539303+0000","last_unstale":"2023-11-04T01:42:26.677675+0000","last_undegraded":"2023-11-04T01:42:26.677675+0000","last_fullsized":"2023-11-04T01:42:26.677675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:50.998381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181688+0000","last_change":"2023-11-04T01:42:24.537992+0000","last_active":"2023-11-04T01:42:27.181688+0000","last_peered":"2023-11-04T01:42:27.181688+0000","last_clean":"2023-11-04T01:42:27.181688+0000","last_became_active":"2023-11-04T01:42:24.537129+0000","last_became_peered":"2023-11-04T01:42:24.537129+0000","last_unstale":"2023-11-04T01:42:27.181688+0000","last_undegraded":"2023-11-04T01:42:27.181688+0000","last_fullsized":"2023-11-04T01:42:27.181688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573347+0000","last_change":"2023-11-04T01:42:24.530582+0000","last_active":"2023-11-04T01:42:25.573347+0000","last_peered":"2023-11-04T01:42:25.573347+0000","last_clean":"2023-11-04T01:42:25.573347+0000","last_became_active":"2023-11-04T01:42:24.529891+0000","last_became_peered":"2023-11-04T01:42:24.529891+0000","last_unstale":"2023-11-04T01:42:25.573347+0000","last_undegraded":"2023-11-04T01:42:25.573347+0000","last_fullsized":"2023-11-04T01:42:25.573347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573474+0000","last_change":"2023-11-04T01:42:24.554452+0000","last_active":"2023-11-04T01:42:25.573474+0000","last_peered":"2023-11-04T01:42:25.573474+0000","last_clean":"2023-11-04T01:42:25.573474+0000","last_became_active":"2023-11-04T01:42:24.553857+0000","last_became_peered":"2023-11-04T01:42:24.553857+0000","last_unstale":"2023-11-04T01:42:25.573474+0000","last_undegraded":"2023-11-04T01:42:25.573474+0000","last_fullsized":"2023-11-04T01:42:25.573474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:48.459289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.678127+0000","last_change":"2023-11-04T01:42:24.532888+0000","last_active":"2023-11-04T01:42:26.678127+0000","last_peered":"2023-11-04T01:42:26.678127+0000","last_clean":"2023-11-04T01:42:26.678127+0000","last_became_active":"2023-11-04T01:42:24.532172+0000","last_became_peered":"2023-11-04T01:42:24.532172+0000","last_unstale":"2023-11-04T01:42:26.678127+0000","last_undegraded":"2023-11-04T01:42:26.678127+0000","last_fullsized":"2023-11-04T01:42:26.678127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505919+0000","last_change":"2023-11-04T01:42:24.532118+0000","last_active":"2023-11-04T01:42:25.505919+0000","last_peered":"2023-11-04T01:42:25.505919+0000","last_clean":"2023-11-04T01:42:25.505919+0000","last_became_active":"2023-11-04T01:42:24.530531+0000","last_became_peered":"2023-11-04T01:42:24.530531+0000","last_unstale":"2023-11-04T01:42:25.505919+0000","last_undegraded":"2023-11-04T01:42:25.505919+0000","last_fullsized":"2023-11-04T01:42:25.505919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178006+0000","last_change":"2023-11-04T01:42:24.541439+0000","last_active":"2023-11-04T01:42:27.178006+0000","last_peered":"2023-11-04T01:42:27.178006+0000","last_clean":"2023-11-04T01:42:27.178006+0000","last_became_active":"2023-11-04T01:42:24.540727+0000","last_became_peered":"2023-11-04T01:42:24.540727+0000","last_unstale":"2023-11-04T01:42:27.178006+0000","last_undegraded":"2023-11-04T01:42:27.178006+0000","last_fullsized":"2023-11-04T01:42:27.178006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:23:49.750746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.180790+0000","last_change":"2023-11-04T01:42:24.521552+0000","last_active":"2023-11-04T01:42:27.180790+0000","last_peered":"2023-11-04T01:42:27.180790+0000","last_clean":"2023-11-04T01:42:27.180790+0000","last_became_active":"2023-11-04T01:42:24.520794+0000","last_became_peered":"2023-11-04T01:42:24.520794+0000","last_unstale":"2023-11-04T01:42:27.180790+0000","last_undegraded":"2023-11-04T01:42:27.180790+0000","last_fullsized":"2023-11-04T01:42:27.180790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178897+0000","last_change":"2023-11-04T01:42:24.530960+0000","last_active":"2023-11-04T01:42:27.178897+0000","last_peered":"2023-11-04T01:42:27.178897+0000","last_clean":"2023-11-04T01:42:27.178897+0000","last_became_active":"2023-11-04T01:42:24.530166+0000","last_became_peered":"2023-11-04T01:42:24.530166+0000","last_unstale":"2023-11-04T01:42:27.178897+0000","last_undegraded":"2023-11-04T01:42:27.178897+0000","last_fullsized":"2023-11-04T01:42:27.178897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:50.563897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783828+0000","last_change":"2023-11-04T01:42:23.881752+0000","last_active":"2023-11-04T01:42:25.783828+0000","last_peered":"2023-11-04T01:42:25.783828+0000","last_clean":"2023-11-04T01:42:25.783828+0000","last_became_active":"2023-11-04T01:42:23.871460+0000","last_became_peered":"2023-11-04T01:42:23.871460+0000","last_unstale":"2023-11-04T01:42:25.783828+0000","last_undegraded":"2023-11-04T01:42:25.783828+0000","last_fullsized":"2023-11-04T01:42:25.783828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504494+0000","last_change":"2023-11-04T01:42:24.536354+0000","last_active":"2023-11-04T01:42:25.504494+0000","last_peered":"2023-11-04T01:42:25.504494+0000","last_clean":"2023-11-04T01:42:25.504494+0000","last_became_active":"2023-11-04T01:42:24.535597+0000","last_became_peered":"2023-11-04T01:42:24.535597+0000","last_unstale":"2023-11-04T01:42:25.504494+0000","last_undegraded":"2023-11-04T01:42:25.504494+0000","last_fullsized":"2023-11-04T01:42:25.504494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:09.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507312+0000","last_change":"2023-11-04T01:42:23.854629+0000","last_active":"2023-11-04T01:42:25.507312+0000","last_peered":"2023-11-04T01:42:25.507312+0000","last_clean":"2023-11-04T01:42:25.507312+0000","last_became_active":"2023-11-04T01:42:23.854209+0000","last_became_peered":"2023-11-04T01:42:23.854209+0000","last_unstale":"2023-11-04T01:42:25.507312+0000","last_undegraded":"2023-11-04T01:42:25.507312+0000","last_fullsized":"2023-11-04T01:42:25.507312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572788+0000","last_change":"2023-11-04T01:42:23.871583+0000","last_active":"2023-11-04T01:42:25.572788+0000","last_peered":"2023-11-04T01:42:25.572788+0000","last_clean":"2023-11-04T01:42:25.572788+0000","last_became_active":"2023-11-04T01:42:23.870753+0000","last_became_peered":"2023-11-04T01:42:23.870753+0000","last_unstale":"2023-11-04T01:42:25.572788+0000","last_undegraded":"2023-11-04T01:42:25.572788+0000","last_fullsized":"2023-11-04T01:42:25.572788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:45.998097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677453+0000","last_change":"2023-11-04T01:42:24.527244+0000","last_active":"2023-11-04T01:42:26.677453+0000","last_peered":"2023-11-04T01:42:26.677453+0000","last_clean":"2023-11-04T01:42:26.677453+0000","last_became_active":"2023-11-04T01:42:24.526519+0000","last_became_peered":"2023-11-04T01:42:24.526519+0000","last_unstale":"2023-11-04T01:42:26.677453+0000","last_undegraded":"2023-11-04T01:42:26.677453+0000","last_fullsized":"2023-11-04T01:42:26.677453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:22.475674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505615+0000","last_change":"2023-11-04T01:42:23.861230+0000","last_active":"2023-11-04T01:42:25.505615+0000","last_peered":"2023-11-04T01:42:25.505615+0000","last_clean":"2023-11-04T01:42:25.505615+0000","last_became_active":"2023-11-04T01:42:23.859784+0000","last_became_peered":"2023-11-04T01:42:23.859784+0000","last_unstale":"2023-11-04T01:42:25.505615+0000","last_undegraded":"2023-11-04T01:42:25.505615+0000","last_fullsized":"2023-11-04T01:42:25.505615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:43.619572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504003+0000","last_change":"2023-11-04T01:42:24.524254+0000","last_active":"2023-11-04T01:42:25.504003+0000","last_peered":"2023-11-04T01:42:25.504003+0000","last_clean":"2023-11-04T01:42:25.504003+0000","last_became_active":"2023-11-04T01:42:24.523478+0000","last_became_peered":"2023-11-04T01:42:24.523478+0000","last_unstale":"2023-11-04T01:42:25.504003+0000","last_undegraded":"2023-11-04T01:42:25.504003+0000","last_fullsized":"2023-11-04T01:42:25.504003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:49.878595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.787258+0000","last_change":"2023-11-04T01:42:23.872649+0000","last_active":"2023-11-04T01:42:26.787258+0000","last_peered":"2023-11-04T01:42:26.787258+0000","last_clean":"2023-11-04T01:42:26.787258+0000","last_became_active":"2023-11-04T01:42:23.872297+0000","last_became_peered":"2023-11-04T01:42:23.872297+0000","last_unstale":"2023-11-04T01:42:26.787258+0000","last_undegraded":"2023-11-04T01:42:26.787258+0000","last_fullsized":"2023-11-04T01:42:26.787258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181818+0000","last_change":"2023-11-04T01:42:24.530263+0000","last_active":"2023-11-04T01:42:27.181818+0000","last_peered":"2023-11-04T01:42:27.181818+0000","last_clean":"2023-11-04T01:42:27.181818+0000","last_became_active":"2023-11-04T01:42:24.529507+0000","last_became_peered":"2023-11-04T01:42:24.529507+0000","last_unstale":"2023-11-04T01:42:27.181818+0000","last_undegraded":"2023-11-04T01:42:27.181818+0000","last_fullsized":"2023-11-04T01:42:27.181818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508023+0000","last_change":"2023-11-04T01:42:23.873814+0000","last_active":"2023-11-04T01:42:25.508023+0000","last_peered":"2023-11-04T01:42:25.508023+0000","last_clean":"2023-11-04T01:42:25.508023+0000","last_became_active":"2023-11-04T01:42:23.873404+0000","last_became_peered":"2023-11-04T01:42:23.873404+0000","last_unstale":"2023-11-04T01:42:25.508023+0000","last_undegraded":"2023-11-04T01:42:25.508023+0000","last_fullsized":"2023-11-04T01:42:25.508023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:21.679291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677860+0000","last_change":"2023-11-04T01:42:24.534026+0000","last_active":"2023-11-04T01:42:26.677860+0000","last_peered":"2023-11-04T01:42:26.677860+0000","last_clean":"2023-11-04T01:42:26.677860+0000","last_became_active":"2023-11-04T01:42:24.533338+0000","last_became_peered":"2023-11-04T01:42:24.533338+0000","last_unstale":"2023-11-04T01:42:26.677860+0000","last_undegraded":"2023-11-04T01:42:26.677860+0000","last_fullsized":"2023-11-04T01:42:26.677860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:36.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.778911+0000","last_change":"2023-11-04T01:42:23.872021+0000","last_active":"2023-11-04T01:42:25.778911+0000","last_peered":"2023-11-04T01:42:25.778911+0000","last_clean":"2023-11-04T01:42:25.778911+0000","last_became_active":"2023-11-04T01:42:23.870751+0000","last_became_peered":"2023-11-04T01:42:23.870751+0000","last_unstale":"2023-11-04T01:42:25.778911+0000","last_undegraded":"2023-11-04T01:42:25.778911+0000","last_fullsized":"2023-11-04T01:42:25.778911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.620945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506411+0000","last_change":"2023-11-04T01:42:24.546924+0000","last_active":"2023-11-04T01:42:25.506411+0000","last_peered":"2023-11-04T01:42:25.506411+0000","last_clean":"2023-11-04T01:42:25.506411+0000","last_became_active":"2023-11-04T01:42:24.546318+0000","last_became_peered":"2023-11-04T01:42:24.546318+0000","last_unstale":"2023-11-04T01:42:25.506411+0000","last_undegraded":"2023-11-04T01:42:25.506411+0000","last_fullsized":"2023-11-04T01:42:25.506411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:48.887573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.786748+0000","last_change":"2023-11-04T01:42:23.872849+0000","last_active":"2023-11-04T01:42:25.786748+0000","last_peered":"2023-11-04T01:42:25.786748+0000","last_clean":"2023-11-04T01:42:25.786748+0000","last_became_active":"2023-11-04T01:42:23.872394+0000","last_became_peered":"2023-11-04T01:42:23.872394+0000","last_unstale":"2023-11-04T01:42:25.786748+0000","last_undegraded":"2023-11-04T01:42:25.786748+0000","last_fullsized":"2023-11-04T01:42:25.786748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508459+0000","last_change":"2023-11-04T01:42:24.525307+0000","last_active":"2023-11-04T01:42:25.508459+0000","last_peered":"2023-11-04T01:42:25.508459+0000","last_clean":"2023-11-04T01:42:25.508459+0000","last_became_active":"2023-11-04T01:42:24.522877+0000","last_became_peered":"2023-11-04T01:42:24.522877+0000","last_unstale":"2023-11-04T01:42:25.508459+0000","last_undegraded":"2023-11-04T01:42:25.508459+0000","last_fullsized":"2023-11-04T01:42:25.508459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.778882+0000","last_change":"2023-11-04T01:42:23.878097+0000","last_active":"2023-11-04T01:42:25.778882+0000","last_peered":"2023-11-04T01:42:25.778882+0000","last_clean":"2023-11-04T01:42:25.778882+0000","last_became_active":"2023-11-04T01:42:23.877265+0000","last_became_peered":"2023-11-04T01:42:23.877265+0000","last_unstale":"2023-11-04T01:42:25.778882+0000","last_undegraded":"2023-11-04T01:42:25.778882+0000","last_fullsized":"2023-11-04T01:42:25.778882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:22.344804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573080+0000","last_change":"2023-11-04T01:42:24.546728+0000","last_active":"2023-11-04T01:42:25.573080+0000","last_peered":"2023-11-04T01:42:25.573080+0000","last_clean":"2023-11-04T01:42:25.573080+0000","last_became_active":"2023-11-04T01:42:24.545946+0000","last_became_peered":"2023-11-04T01:42:24.545946+0000","last_unstale":"2023-11-04T01:42:25.573080+0000","last_undegraded":"2023-11-04T01:42:25.573080+0000","last_fullsized":"2023-11-04T01:42:25.573080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506789+0000","last_change":"2023-11-04T01:42:23.875211+0000","last_active":"2023-11-04T01:42:25.506789+0000","last_peered":"2023-11-04T01:42:25.506789+0000","last_clean":"2023-11-04T01:42:25.506789+0000","last_became_active":"2023-11-04T01:42:23.874649+0000","last_became_peered":"2023-11-04T01:42:23.874649+0000","last_unstale":"2023-11-04T01:42:25.506789+0000","last_undegraded":"2023-11-04T01:42:25.506789+0000","last_fullsized":"2023-11-04T01:42:25.506789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506005+0000","last_change":"2023-11-04T01:42:24.557710+0000","last_active":"2023-11-04T01:42:25.506005+0000","last_peered":"2023-11-04T01:42:25.506005+0000","last_clean":"2023-11-04T01:42:25.506005+0000","last_became_active":"2023-11-04T01:42:24.557097+0000","last_became_peered":"2023-11-04T01:42:24.557097+0000","last_unstale":"2023-11-04T01:42:25.506005+0000","last_undegraded":"2023-11-04T01:42:25.506005+0000","last_fullsized":"2023-11-04T01:42:25.506005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:07.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507961+0000","last_change":"2023-11-04T01:42:23.858376+0000","last_active":"2023-11-04T01:42:25.507961+0000","last_peered":"2023-11-04T01:42:25.507961+0000","last_clean":"2023-11-04T01:42:25.507961+0000","last_became_active":"2023-11-04T01:42:23.856424+0000","last_became_peered":"2023-11-04T01:42:23.856424+0000","last_unstale":"2023-11-04T01:42:25.507961+0000","last_undegraded":"2023-11-04T01:42:25.507961+0000","last_fullsized":"2023-11-04T01:42:25.507961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:49.553266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178654+0000","last_change":"2023-11-04T01:42:24.529593+0000","last_active":"2023-11-04T01:42:27.178654+0000","last_peered":"2023-11-04T01:42:27.178654+0000","last_clean":"2023-11-04T01:42:27.178654+0000","last_became_active":"2023-11-04T01:42:24.528834+0000","last_became_peered":"2023-11-04T01:42:24.528834+0000","last_unstale":"2023-11-04T01:42:27.178654+0000","last_undegraded":"2023-11-04T01:42:27.178654+0000","last_fullsized":"2023-11-04T01:42:27.178654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503660+0000","last_change":"2023-11-04T01:42:23.878725+0000","last_active":"2023-11-04T01:42:25.503660+0000","last_peered":"2023-11-04T01:42:25.503660+0000","last_clean":"2023-11-04T01:42:25.503660+0000","last_became_active":"2023-11-04T01:42:23.877930+0000","last_became_peered":"2023-11-04T01:42:23.877930+0000","last_unstale":"2023-11-04T01:42:25.503660+0000","last_undegraded":"2023-11-04T01:42:25.503660+0000","last_fullsized":"2023-11-04T01:42:25.503660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:52.439183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505874+0000","last_change":"2023-11-04T01:42:24.545238+0000","last_active":"2023-11-04T01:42:25.505874+0000","last_peered":"2023-11-04T01:42:25.505874+0000","last_clean":"2023-11-04T01:42:25.505874+0000","last_became_active":"2023-11-04T01:42:24.544606+0000","last_became_peered":"2023-11-04T01:42:24.544606+0000","last_unstale":"2023-11-04T01:42:25.505874+0000","last_undegraded":"2023-11-04T01:42:25.505874+0000","last_fullsized":"2023-11-04T01:42:25.505874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.509259+0000","last_change":"2023-11-04T01:42:23.889452+0000","last_active":"2023-11-04T01:42:25.509259+0000","last_peered":"2023-11-04T01:42:25.509259+0000","last_clean":"2023-11-04T01:42:25.509259+0000","last_became_active":"2023-11-04T01:42:23.889046+0000","last_became_peered":"2023-11-04T01:42:23.889046+0000","last_unstale":"2023-11-04T01:42:25.509259+0000","last_undegraded":"2023-11-04T01:42:25.509259+0000","last_fullsized":"2023-11-04T01:42:25.509259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181971+0000","last_change":"2023-11-04T01:42:24.560710+0000","last_active":"2023-11-04T01:42:27.181971+0000","last_peered":"2023-11-04T01:42:27.181971+0000","last_clean":"2023-11-04T01:42:27.181971+0000","last_became_active":"2023-11-04T01:42:24.560051+0000","last_became_peered":"2023-11-04T01:42:24.560051+0000","last_unstale":"2023-11-04T01:42:27.181971+0000","last_undegraded":"2023-11-04T01:42:27.181971+0000","last_fullsized":"2023-11-04T01:42:27.181971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504630+0000","last_change":"2023-11-04T01:42:23.892535+0000","last_active":"2023-11-04T01:42:25.504630+0000","last_peered":"2023-11-04T01:42:25.504630+0000","last_clean":"2023-11-04T01:42:25.504630+0000","last_became_active":"2023-11-04T01:42:23.891942+0000","last_became_peered":"2023-11-04T01:42:23.891942+0000","last_unstale":"2023-11-04T01:42:25.504630+0000","last_undegraded":"2023-11-04T01:42:25.504630+0000","last_fullsized":"2023-11-04T01:42:25.504630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:28.817061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508895+0000","last_change":"2023-11-04T01:42:24.555641+0000","last_active":"2023-11-04T01:42:25.508895+0000","last_peered":"2023-11-04T01:42:25.508895+0000","last_clean":"2023-11-04T01:42:25.508895+0000","last_became_active":"2023-11-04T01:42:24.554641+0000","last_became_peered":"2023-11-04T01:42:24.554641+0000","last_unstale":"2023-11-04T01:42:25.508895+0000","last_undegraded":"2023-11-04T01:42:25.508895+0000","last_fullsized":"2023-11-04T01:42:25.508895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783901+0000","last_change":"2023-11-04T01:42:23.879946+0000","last_active":"2023-11-04T01:42:25.783901+0000","last_peered":"2023-11-04T01:42:25.783901+0000","last_clean":"2023-11-04T01:42:25.783901+0000","last_became_active":"2023-11-04T01:42:23.879106+0000","last_became_peered":"2023-11-04T01:42:23.879106+0000","last_unstale":"2023-11-04T01:42:25.783901+0000","last_undegraded":"2023-11-04T01:42:25.783901+0000","last_fullsized":"2023-11-04T01:42:25.783901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:56.805776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508541+0000","last_change":"2023-11-04T01:42:24.535305+0000","last_active":"2023-11-04T01:42:25.508541+0000","last_peered":"2023-11-04T01:42:25.508541+0000","last_clean":"2023-11-04T01:42:25.508541+0000","last_became_active":"2023-11-04T01:42:24.534392+0000","last_became_peered":"2023-11-04T01:42:24.534392+0000","last_unstale":"2023-11-04T01:42:25.508541+0000","last_undegraded":"2023-11-04T01:42:25.508541+0000","last_fullsized":"2023-11-04T01:42:25.508541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573731+0000","last_change":"2023-11-04T01:42:23.859651+0000","last_active":"2023-11-04T01:42:25.573731+0000","last_peered":"2023-11-04T01:42:25.573731+0000","last_clean":"2023-11-04T01:42:25.573731+0000","last_became_active":"2023-11-04T01:42:23.858848+0000","last_became_peered":"2023-11-04T01:42:23.858848+0000","last_unstale":"2023-11-04T01:42:25.573731+0000","last_undegraded":"2023-11-04T01:42:25.573731+0000","last_fullsized":"2023-11-04T01:42:25.573731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506723+0000","last_change":"2023-11-04T01:42:24.542701+0000","last_active":"2023-11-04T01:42:25.506723+0000","last_peered":"2023-11-04T01:42:25.506723+0000","last_clean":"2023-11-04T01:42:25.506723+0000","last_became_active":"2023-11-04T01:42:24.541785+0000","last_became_peered":"2023-11-04T01:42:24.541785+0000","last_unstale":"2023-11-04T01:42:25.506723+0000","last_undegraded":"2023-11-04T01:42:25.506723+0000","last_fullsized":"2023-11-04T01:42:25.506723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:54.044840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.496361+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:42:24.496361+0000","last_peered":"2023-11-04T01:42:24.496361+0000","last_clean":"2023-11-04T01:42:24.496361+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:42:24.496361+0000","last_undegraded":"2023-11-04T01:42:24.496361+0000","last_fullsized":"2023-11-04T01:42:24.496361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506303+0000","last_change":"2023-11-04T01:42:23.870050+0000","last_active":"2023-11-04T01:42:25.506303+0000","last_peered":"2023-11-04T01:42:25.506303+0000","last_clean":"2023-11-04T01:42:25.506303+0000","last_became_active":"2023-11-04T01:42:23.868558+0000","last_became_peered":"2023-11-04T01:42:23.868558+0000","last_unstale":"2023-11-04T01:42:25.506303+0000","last_undegraded":"2023-11-04T01:42:25.506303+0000","last_fullsized":"2023-11-04T01:42:25.506303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504592+0000","last_change":"2023-11-04T01:42:24.515619+0000","last_active":"2023-11-04T01:42:25.504592+0000","last_peered":"2023-11-04T01:42:25.504592+0000","last_clean":"2023-11-04T01:42:25.504592+0000","last_became_active":"2023-11-04T01:42:24.514861+0000","last_became_peered":"2023-11-04T01:42:24.514861+0000","last_unstale":"2023-11-04T01:42:25.504592+0000","last_undegraded":"2023-11-04T01:42:25.504592+0000","last_fullsized":"2023-11-04T01:42:25.504592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:12.327963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505707+0000","last_change":"2023-11-04T01:42:23.889363+0000","last_active":"2023-11-04T01:42:25.505707+0000","last_peered":"2023-11-04T01:42:25.505707+0000","last_clean":"2023-11-04T01:42:25.505707+0000","last_became_active":"2023-11-04T01:42:23.888990+0000","last_became_peered":"2023-11-04T01:42:23.888990+0000","last_unstale":"2023-11-04T01:42:25.505707+0000","last_undegraded":"2023-11-04T01:42:25.505707+0000","last_fullsized":"2023-11-04T01:42:25.505707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572945+0000","last_change":"2023-11-04T01:42:24.544491+0000","last_active":"2023-11-04T01:42:25.572945+0000","last_peered":"2023-11-04T01:42:25.572945+0000","last_clean":"2023-11-04T01:42:25.572945+0000","last_became_active":"2023-11-04T01:42:24.543670+0000","last_became_peered":"2023-11-04T01:42:24.543670+0000","last_unstale":"2023-11-04T01:42:25.572945+0000","last_undegraded":"2023-11-04T01:42:25.572945+0000","last_fullsized":"2023-11-04T01:42:25.572945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.778828+0000","last_change":"2023-11-04T01:42:23.887645+0000","last_active":"2023-11-04T01:42:25.778828+0000","last_peered":"2023-11-04T01:42:25.778828+0000","last_clean":"2023-11-04T01:42:25.778828+0000","last_became_active":"2023-11-04T01:42:23.887066+0000","last_became_peered":"2023-11-04T01:42:23.887066+0000","last_unstale":"2023-11-04T01:42:25.778828+0000","last_undegraded":"2023-11-04T01:42:25.778828+0000","last_fullsized":"2023-11-04T01:42:25.778828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:14.860163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677132+0000","last_change":"2023-11-04T01:42:24.530872+0000","last_active":"2023-11-04T01:42:26.677132+0000","last_peered":"2023-11-04T01:42:26.677132+0000","last_clean":"2023-11-04T01:42:26.677132+0000","last_became_active":"2023-11-04T01:42:24.529785+0000","last_became_peered":"2023-11-04T01:42:24.529785+0000","last_unstale":"2023-11-04T01:42:26.677132+0000","last_undegraded":"2023-11-04T01:42:26.677132+0000","last_fullsized":"2023-11-04T01:42:26.677132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:48.657564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507010+0000","last_change":"2023-11-04T01:42:23.864470+0000","last_active":"2023-11-04T01:42:25.507010+0000","last_peered":"2023-11-04T01:42:25.507010+0000","last_clean":"2023-11-04T01:42:25.507010+0000","last_became_active":"2023-11-04T01:42:23.864049+0000","last_became_peered":"2023-11-04T01:42:23.864049+0000","last_unstale":"2023-11-04T01:42:25.507010+0000","last_undegraded":"2023-11-04T01:42:25.507010+0000","last_fullsized":"2023-11-04T01:42:25.507010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508539+0000","last_change":"2023-11-04T01:42:24.547297+0000","last_active":"2023-11-04T01:42:25.508539+0000","last_peered":"2023-11-04T01:42:25.508539+0000","last_clean":"2023-11-04T01:42:25.508539+0000","last_became_active":"2023-11-04T01:42:24.546593+0000","last_became_peered":"2023-11-04T01:42:24.546593+0000","last_unstale":"2023-11-04T01:42:25.508539+0000","last_undegraded":"2023-11-04T01:42:25.508539+0000","last_fullsized":"2023-11-04T01:42:25.508539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783855+0000","last_change":"2023-11-04T01:42:23.881220+0000","last_active":"2023-11-04T01:42:25.783855+0000","last_peered":"2023-11-04T01:42:25.783855+0000","last_clean":"2023-11-04T01:42:25.783855+0000","last_became_active":"2023-11-04T01:42:23.880569+0000","last_became_peered":"2023-11-04T01:42:23.880569+0000","last_unstale":"2023-11-04T01:42:25.783855+0000","last_undegraded":"2023-11-04T01:42:25.783855+0000","last_fullsized":"2023-11-04T01:42:25.783855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181148+0000","last_change":"2023-11-04T01:42:24.544821+0000","last_active":"2023-11-04T01:42:27.181148+0000","last_peered":"2023-11-04T01:42:27.181148+0000","last_clean":"2023-11-04T01:42:27.181148+0000","last_became_active":"2023-11-04T01:42:24.544158+0000","last_became_peered":"2023-11-04T01:42:24.544158+0000","last_unstale":"2023-11-04T01:42:27.181148+0000","last_undegraded":"2023-11-04T01:42:27.181148+0000","last_fullsized":"2023-11-04T01:42:27.181148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507284+0000","last_change":"2023-11-04T01:42:23.867710+0000","last_active":"2023-11-04T01:42:25.507284+0000","last_peered":"2023-11-04T01:42:25.507284+0000","last_clean":"2023-11-04T01:42:25.507284+0000","last_became_active":"2023-11-04T01:42:23.867162+0000","last_became_peered":"2023-11-04T01:42:23.867162+0000","last_unstale":"2023-11-04T01:42:25.507284+0000","last_undegraded":"2023-11-04T01:42:25.507284+0000","last_fullsized":"2023-11-04T01:42:25.507284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:48.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573619+0000","last_change":"2023-11-04T01:42:24.529944+0000","last_active":"2023-11-04T01:42:25.573619+0000","last_peered":"2023-11-04T01:42:25.573619+0000","last_clean":"2023-11-04T01:42:25.573619+0000","last_became_active":"2023-11-04T01:42:24.528837+0000","last_became_peered":"2023-11-04T01:42:24.528837+0000","last_unstale":"2023-11-04T01:42:25.573619+0000","last_undegraded":"2023-11-04T01:42:25.573619+0000","last_fullsized":"2023-11-04T01:42:25.573619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.261927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.784857+0000","last_change":"2023-11-04T01:42:23.871604+0000","last_active":"2023-11-04T01:42:25.784857+0000","last_peered":"2023-11-04T01:42:25.784857+0000","last_clean":"2023-11-04T01:42:25.784857+0000","last_became_active":"2023-11-04T01:42:23.870746+0000","last_became_peered":"2023-11-04T01:42:23.870746+0000","last_unstale":"2023-11-04T01:42:25.784857+0000","last_undegraded":"2023-11-04T01:42:25.784857+0000","last_fullsized":"2023-11-04T01:42:25.784857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:22.043685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504543+0000","last_change":"2023-11-04T01:42:24.520352+0000","last_active":"2023-11-04T01:42:25.504543+0000","last_peered":"2023-11-04T01:42:25.504543+0000","last_clean":"2023-11-04T01:42:25.504543+0000","last_became_active":"2023-11-04T01:42:24.519515+0000","last_became_peered":"2023-11-04T01:42:24.519515+0000","last_unstale":"2023-11-04T01:42:25.504543+0000","last_undegraded":"2023-11-04T01:42:25.504543+0000","last_fullsized":"2023-11-04T01:42:25.504543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:31.963568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506869+0000","last_change":"2023-11-04T01:42:23.856440+0000","last_active":"2023-11-04T01:42:25.506869+0000","last_peered":"2023-11-04T01:42:25.506869+0000","last_clean":"2023-11-04T01:42:25.506869+0000","last_became_active":"2023-11-04T01:42:23.856067+0000","last_became_peered":"2023-11-04T01:42:23.856067+0000","last_unstale":"2023-11-04T01:42:25.506869+0000","last_undegraded":"2023-11-04T01:42:25.506869+0000","last_fullsized":"2023-11-04T01:42:25.506869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:21.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504391+0000","last_change":"2023-11-04T01:42:24.530290+0000","last_active":"2023-11-04T01:42:25.504391+0000","last_peered":"2023-11-04T01:42:25.504391+0000","last_clean":"2023-11-04T01:42:25.504391+0000","last_became_active":"2023-11-04T01:42:24.529568+0000","last_became_peered":"2023-11-04T01:42:24.529568+0000","last_unstale":"2023-11-04T01:42:25.504391+0000","last_undegraded":"2023-11-04T01:42:25.504391+0000","last_fullsized":"2023-11-04T01:42:25.504391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:42.384938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508823+0000","last_change":"2023-11-04T01:42:23.867463+0000","last_active":"2023-11-04T01:42:25.508823+0000","last_peered":"2023-11-04T01:42:25.508823+0000","last_clean":"2023-11-04T01:42:25.508823+0000","last_became_active":"2023-11-04T01:42:23.865925+0000","last_became_peered":"2023-11-04T01:42:23.865925+0000","last_unstale":"2023-11-04T01:42:25.508823+0000","last_undegraded":"2023-11-04T01:42:25.508823+0000","last_fullsized":"2023-11-04T01:42:25.508823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:29.802796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506042+0000","last_change":"2023-11-04T01:42:24.532587+0000","last_active":"2023-11-04T01:42:25.506042+0000","last_peered":"2023-11-04T01:42:25.506042+0000","last_clean":"2023-11-04T01:42:25.506042+0000","last_became_active":"2023-11-04T01:42:24.531827+0000","last_became_peered":"2023-11-04T01:42:24.531827+0000","last_unstale":"2023-11-04T01:42:25.506042+0000","last_undegraded":"2023-11-04T01:42:25.506042+0000","last_fullsized":"2023-11-04T01:42:25.506042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:09.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504135+0000","last_change":"2023-11-04T01:42:23.871960+0000","last_active":"2023-11-04T01:42:25.504135+0000","last_peered":"2023-11-04T01:42:25.504135+0000","last_clean":"2023-11-04T01:42:25.504135+0000","last_became_active":"2023-11-04T01:42:23.871205+0000","last_became_peered":"2023-11-04T01:42:23.871205+0000","last_unstale":"2023-11-04T01:42:25.504135+0000","last_undegraded":"2023-11-04T01:42:25.504135+0000","last_fullsized":"2023-11-04T01:42:25.504135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:33:54.986696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503773+0000","last_change":"2023-11-04T01:42:24.531520+0000","last_active":"2023-11-04T01:42:25.503773+0000","last_peered":"2023-11-04T01:42:25.503773+0000","last_clean":"2023-11-04T01:42:25.503773+0000","last_became_active":"2023-11-04T01:42:24.530762+0000","last_became_peered":"2023-11-04T01:42:24.530762+0000","last_unstale":"2023-11-04T01:42:25.503773+0000","last_undegraded":"2023-11-04T01:42:25.503773+0000","last_fullsized":"2023-11-04T01:42:25.503773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.137518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573320+0000","last_change":"2023-11-04T01:42:23.887853+0000","last_active":"2023-11-04T01:42:25.573320+0000","last_peered":"2023-11-04T01:42:25.573320+0000","last_clean":"2023-11-04T01:42:25.573320+0000","last_became_active":"2023-11-04T01:42:23.886915+0000","last_became_peered":"2023-11-04T01:42:23.886915+0000","last_unstale":"2023-11-04T01:42:25.573320+0000","last_undegraded":"2023-11-04T01:42:25.573320+0000","last_fullsized":"2023-11-04T01:42:25.573320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:25.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178265+0000","last_change":"2023-11-04T01:42:24.528548+0000","last_active":"2023-11-04T01:42:27.178265+0000","last_peered":"2023-11-04T01:42:27.178265+0000","last_clean":"2023-11-04T01:42:27.178265+0000","last_became_active":"2023-11-04T01:42:24.527750+0000","last_became_peered":"2023-11-04T01:42:24.527750+0000","last_unstale":"2023-11-04T01:42:27.178265+0000","last_undegraded":"2023-11-04T01:42:27.178265+0000","last_fullsized":"2023-11-04T01:42:27.178265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:31.542707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506105+0000","last_change":"2023-11-04T01:42:23.865890+0000","last_active":"2023-11-04T01:42:25.506105+0000","last_peered":"2023-11-04T01:42:25.506105+0000","last_clean":"2023-11-04T01:42:25.506105+0000","last_became_active":"2023-11-04T01:42:23.865503+0000","last_became_peered":"2023-11-04T01:42:23.865503+0000","last_unstale":"2023-11-04T01:42:25.506105+0000","last_undegraded":"2023-11-04T01:42:25.506105+0000","last_fullsized":"2023-11-04T01:42:25.506105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:05.380495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506285+0000","last_change":"2023-11-04T01:42:24.527953+0000","last_active":"2023-11-04T01:42:25.506285+0000","last_peered":"2023-11-04T01:42:25.506285+0000","last_clean":"2023-11-04T01:42:25.506285+0000","last_became_active":"2023-11-04T01:42:24.527112+0000","last_became_peered":"2023-11-04T01:42:24.527112+0000","last_unstale":"2023-11-04T01:42:25.506285+0000","last_undegraded":"2023-11-04T01:42:25.506285+0000","last_fullsized":"2023-11-04T01:42:25.506285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:04.559600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507122+0000","last_change":"2023-11-04T01:42:24.560200+0000","last_active":"2023-11-04T01:42:25.507122+0000","last_peered":"2023-11-04T01:42:25.507122+0000","last_clean":"2023-11-04T01:42:25.507122+0000","last_became_active":"2023-11-04T01:42:24.559286+0000","last_became_peered":"2023-11-04T01:42:24.559286+0000","last_unstale":"2023-11-04T01:42:25.507122+0000","last_undegraded":"2023-11-04T01:42:25.507122+0000","last_fullsized":"2023-11-04T01:42:25.507122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:48.678049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508726+0000","last_change":"2023-11-04T01:42:23.875613+0000","last_active":"2023-11-04T01:42:25.508726+0000","last_peered":"2023-11-04T01:42:25.508726+0000","last_clean":"2023-11-04T01:42:25.508726+0000","last_became_active":"2023-11-04T01:42:23.875339+0000","last_became_peered":"2023-11-04T01:42:23.875339+0000","last_unstale":"2023-11-04T01:42:25.508726+0000","last_undegraded":"2023-11-04T01:42:25.508726+0000","last_fullsized":"2023-11-04T01:42:25.508726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.179237+0000","last_change":"2023-11-04T01:42:24.541588+0000","last_active":"2023-11-04T01:42:27.179237+0000","last_peered":"2023-11-04T01:42:27.179237+0000","last_clean":"2023-11-04T01:42:27.179237+0000","last_became_active":"2023-11-04T01:42:24.536601+0000","last_became_peered":"2023-11-04T01:42:24.536601+0000","last_unstale":"2023-11-04T01:42:27.179237+0000","last_undegraded":"2023-11-04T01:42:27.179237+0000","last_fullsized":"2023-11-04T01:42:27.179237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508450+0000","last_change":"2023-11-04T01:42:23.873370+0000","last_active":"2023-11-04T01:42:25.508450+0000","last_peered":"2023-11-04T01:42:25.508450+0000","last_clean":"2023-11-04T01:42:25.508450+0000","last_became_active":"2023-11-04T01:42:23.873081+0000","last_became_peered":"2023-11-04T01:42:23.873081+0000","last_unstale":"2023-11-04T01:42:25.508450+0000","last_undegraded":"2023-11-04T01:42:25.508450+0000","last_fullsized":"2023-11-04T01:42:25.508450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677875+0000","last_change":"2023-11-04T01:42:24.540046+0000","last_active":"2023-11-04T01:42:26.677875+0000","last_peered":"2023-11-04T01:42:26.677875+0000","last_clean":"2023-11-04T01:42:26.677875+0000","last_became_active":"2023-11-04T01:42:24.539286+0000","last_became_peered":"2023-11-04T01:42:24.539286+0000","last_unstale":"2023-11-04T01:42:26.677875+0000","last_undegraded":"2023-11-04T01:42:26.677875+0000","last_fullsized":"2023-11-04T01:42:26.677875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.705964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783994+0000","last_change":"2023-11-04T01:42:23.879421+0000","last_active":"2023-11-04T01:42:25.783994+0000","last_peered":"2023-11-04T01:42:25.783994+0000","last_clean":"2023-11-04T01:42:25.783994+0000","last_became_active":"2023-11-04T01:42:23.874688+0000","last_became_peered":"2023-11-04T01:42:23.874688+0000","last_unstale":"2023-11-04T01:42:25.783994+0000","last_undegraded":"2023-11-04T01:42:25.783994+0000","last_fullsized":"2023-11-04T01:42:25.783994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.678125+0000","last_change":"2023-11-04T01:42:24.544559+0000","last_active":"2023-11-04T01:42:26.678125+0000","last_peered":"2023-11-04T01:42:26.678125+0000","last_clean":"2023-11-04T01:42:26.678125+0000","last_became_active":"2023-11-04T01:42:24.543895+0000","last_became_peered":"2023-11-04T01:42:24.543895+0000","last_unstale":"2023-11-04T01:42:26.678125+0000","last_undegraded":"2023-11-04T01:42:26.678125+0000","last_fullsized":"2023-11-04T01:42:26.678125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:27.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504779+0000","last_change":"2023-11-04T01:42:23.868589+0000","last_active":"2023-11-04T01:42:25.504779+0000","last_peered":"2023-11-04T01:42:25.504779+0000","last_clean":"2023-11-04T01:42:25.504779+0000","last_became_active":"2023-11-04T01:42:23.867572+0000","last_became_peered":"2023-11-04T01:42:23.867572+0000","last_unstale":"2023-11-04T01:42:25.504779+0000","last_undegraded":"2023-11-04T01:42:25.504779+0000","last_fullsized":"2023-11-04T01:42:25.504779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:13.960345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":663493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":73111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1240000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":73637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:36.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:42:36.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa4445b7640 1 Processor -- start 2023-11-04T01:42:36.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa4445b7640 1 -- start start 2023-11-04T01:42:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa4445b7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa43c15a1f0 0x7fa43c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa4445b7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0cdea0 0x7fa43c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa4445b7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43c0ccee0 con 0x7fa43c0ca400 2023-11-04T01:42:36.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa4445b7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c15a5d0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa4445b7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0ca900 con 0x7fa43c0cdea0 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa442353640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa43c15a1f0 0x7fa43c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa442353640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa43c15a1f0 0x7fa43c0cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49996/0 (socket says 172.21.15.2:49996) 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa442353640 1 -- 172.21.15.2:0/248982093 learned_addr learned my addr 172.21.15.2:0/248982093 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa442353640 1 -- 172.21.15.2:0/248982093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0cdea0 msgr2=0x7fa43c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa442353640 1 --2- 172.21.15.2:0/248982093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0cdea0 0x7fa43c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa442353640 1 -- 172.21.15.2:0/248982093 >> v1:172.21.15.2:6789/0 conn(0x7fa43c0ca400 legacy=0x7fa43c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.799+0000 7fa442353640 1 -- 172.21.15.2:0/248982093 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0cabe0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa442353640 1 --2- 172.21.15.2:0/248982093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c0cd370 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa438009870 tx=0x7fa43801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6c98f4d3ac6550 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa441351640 1 -- 172.21.15.2:0/248982093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380aa670 con 0x7fa43c15a1f0 2023-11-04T01:42:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa441351640 1 -- 172.21.15.2:0/248982093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4380aa7d0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa441351640 1 -- 172.21.15.2:0/248982093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380aab60 con 0x7fa43c15a1f0 2023-11-04T01:42:36.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 -- 172.21.15.2:0/248982093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 msgr2=0x7fa43c0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 --2- 172.21.15.2:0/248982093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c0cd370 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa438009870 tx=0x7fa43801c510 comp rx=0 tx=0).stop 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 -- 172.21.15.2:0/248982093 shutdown_connections 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 --2- 172.21.15.2:0/248982093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0cdea0 0x7fa43c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 --2- 172.21.15.2:0/248982093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c0cd370 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 -- 172.21.15.2:0/248982093 >> 172.21.15.2:0/248982093 conn(0x7fa43c0cebb0 msgr2=0x7fa43c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 -- 172.21.15.2:0/248982093 shutdown_connections 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 -- 172.21.15.2:0/248982093 wait complete. 2023-11-04T01:42:36.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 Processor -- start 2023-11-04T01:42:36.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.803+0000 7fa4445b7640 1 -- start start 2023-11-04T01:42:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0ca400 0x7fa43c154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa43c0cdea0 0x7fa43c1f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c157ce0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c158230 con 0x7fa43c0cdea0 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c154f60 con 0x7fa43c0ca400 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c1586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50012/0 (socket says 172.21.15.2:50012) 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 -- 172.21.15.2:0/98796080 learned_addr learned my addr 172.21.15.2:0/98796080 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 -- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0ca400 msgr2=0x7fa43c154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0ca400 0x7fa43c154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 -- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa43c0cdea0 msgr2=0x7fa43c1f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa43c0cdea0 0x7fa43c1f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 -- 172.21.15.2:0/98796080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4380094d0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442b54640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c1586c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c770 tx=0x7fa43400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa432ffd640 1 -- 172.21.15.2:0/98796080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434003b80 con 0x7fa43c15a1f0 2023-11-04T01:42:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa432ffd640 1 -- 172.21.15.2:0/98796080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434003ce0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c154ca0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa432ffd640 1 -- 172.21.15.2:0/98796080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400aa90 con 0x7fa43c15a1f0 2023-11-04T01:42:36.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c1503e0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c0744a0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa432ffd640 1 -- 172.21.15.2:0/98796080 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa43400abf0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa432ffd640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa4200664a0 0x7fa420068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa432ffd640 1 -- 172.21.15.2:0/98796080 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa434083cf0 con 0x7fa43c15a1f0 2023-11-04T01:42:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.807+0000 7fa442353640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa4200664a0 0x7fa420068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:36.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.811+0000 7fa442353640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa4200664a0 0x7fa420068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4380ae000 tx=0x7fa438008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:36.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.811+0000 7fa432ffd640 1 -- 172.21.15.2:0/98796080 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa434051160 con 0x7fa43c15a1f0 2023-11-04T01:42:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.959+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa43c0b0f80 con 0x7fa4200664a0 2023-11-04T01:42:36.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.979+0000 7fa432ffd640 1 -- 172.21.15.2:0/98796080 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264503 (secure 0 0 0) 0x7fa4380aa650 con 0x7fa4200664a0 2023-11-04T01:42:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:36.987 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:42:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa4200664a0 msgr2=0x7fa420068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa4200664a0 0x7fa420068960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa4380ae000 tx=0x7fa438008040 comp rx=0 tx=0).stop 2023-11-04T01:42:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 msgr2=0x7fa43c1586c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c1586c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c770 tx=0x7fa43400cc30 comp rx=0 tx=0).stop 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 shutdown_connections 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa4200664a0 0x7fa420068960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa43c15a1f0 0x7fa43c1586c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa43c0cdea0 0x7fa43c1f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 --2- 172.21.15.2:0/98796080 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa43c0ca400 0x7fa43c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 >> 172.21.15.2:0/98796080 conn(0x7fa43c0cebb0 msgr2=0x7fa43c157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 shutdown_connections 2023-11-04T01:42:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:36.983+0000 7fa4445b7640 1 -- 172.21.15.2:0/98796080 wait complete. 2023-11-04T01:42:37.002 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-11-04T01:42:36.763372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235668,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739052,"statfs":{"total":773094113280,"available":772852789248,"internally_reserved":0,"allocated":2924544,"data_stored":1769996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.262823"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508406+0000","last_change":"2023-11-04T01:42:24.537942+0000","last_active":"2023-11-04T01:42:25.508406+0000","last_peered":"2023-11-04T01:42:25.508406+0000","last_clean":"2023-11-04T01:42:25.508406+0000","last_became_active":"2023-11-04T01:42:24.537165+0000","last_became_peered":"2023-11-04T01:42:24.537165+0000","last_unstale":"2023-11-04T01:42:25.508406+0000","last_undegraded":"2023-11-04T01:42:25.508406+0000","last_fullsized":"2023-11-04T01:42:25.508406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:27.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677665+0000","last_change":"2023-11-04T01:42:24.526074+0000","last_active":"2023-11-04T01:42:26.677665+0000","last_peered":"2023-11-04T01:42:26.677665+0000","last_clean":"2023-11-04T01:42:26.677665+0000","last_became_active":"2023-11-04T01:42:24.525339+0000","last_became_peered":"2023-11-04T01:42:24.525339+0000","last_unstale":"2023-11-04T01:42:26.677665+0000","last_undegraded":"2023-11-04T01:42:26.677665+0000","last_fullsized":"2023-11-04T01:42:26.677665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:30.235988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677398+0000","last_change":"2023-11-04T01:42:24.532853+0000","last_active":"2023-11-04T01:42:26.677398+0000","last_peered":"2023-11-04T01:42:26.677398+0000","last_clean":"2023-11-04T01:42:26.677398+0000","last_became_active":"2023-11-04T01:42:24.531811+0000","last_became_peered":"2023-11-04T01:42:24.531811+0000","last_unstale":"2023-11-04T01:42:26.677398+0000","last_undegraded":"2023-11-04T01:42:26.677398+0000","last_fullsized":"2023-11-04T01:42:26.677398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:10.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181236+0000","last_change":"2023-11-04T01:42:24.532090+0000","last_active":"2023-11-04T01:42:27.181236+0000","last_peered":"2023-11-04T01:42:27.181236+0000","last_clean":"2023-11-04T01:42:27.181236+0000","last_became_active":"2023-11-04T01:42:24.531252+0000","last_became_peered":"2023-11-04T01:42:24.531252+0000","last_unstale":"2023-11-04T01:42:27.181236+0000","last_undegraded":"2023-11-04T01:42:27.181236+0000","last_fullsized":"2023-11-04T01:42:27.181236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508158+0000","last_change":"2023-11-04T01:42:24.555465+0000","last_active":"2023-11-04T01:42:25.508158+0000","last_peered":"2023-11-04T01:42:25.508158+0000","last_clean":"2023-11-04T01:42:25.508158+0000","last_became_active":"2023-11-04T01:42:24.554690+0000","last_became_peered":"2023-11-04T01:42:24.554690+0000","last_unstale":"2023-11-04T01:42:25.508158+0000","last_undegraded":"2023-11-04T01:42:25.508158+0000","last_fullsized":"2023-11-04T01:42:25.508158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:50.998381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.180984+0000","last_change":"2023-11-04T01:42:24.532641+0000","last_active":"2023-11-04T01:42:27.180984+0000","last_peered":"2023-11-04T01:42:27.180984+0000","last_clean":"2023-11-04T01:42:27.180984+0000","last_became_active":"2023-11-04T01:42:24.531903+0000","last_became_peered":"2023-11-04T01:42:24.531903+0000","last_unstale":"2023-11-04T01:42:27.180984+0000","last_undegraded":"2023-11-04T01:42:27.180984+0000","last_fullsized":"2023-11-04T01:42:27.180984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508004+0000","last_change":"2023-11-04T01:42:24.534979+0000","last_active":"2023-11-04T01:42:25.508004+0000","last_peered":"2023-11-04T01:42:25.508004+0000","last_clean":"2023-11-04T01:42:25.508004+0000","last_became_active":"2023-11-04T01:42:24.534228+0000","last_became_peered":"2023-11-04T01:42:24.534228+0000","last_unstale":"2023-11-04T01:42:25.508004+0000","last_undegraded":"2023-11-04T01:42:25.508004+0000","last_fullsized":"2023-11-04T01:42:25.508004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:22.475674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677059+0000","last_change":"2023-11-04T01:42:24.532676+0000","last_active":"2023-11-04T01:42:26.677059+0000","last_peered":"2023-11-04T01:42:26.677059+0000","last_clean":"2023-11-04T01:42:26.677059+0000","last_became_active":"2023-11-04T01:42:24.531878+0000","last_became_peered":"2023-11-04T01:42:24.531878+0000","last_unstale":"2023-11-04T01:42:26.677059+0000","last_undegraded":"2023-11-04T01:42:26.677059+0000","last_fullsized":"2023-11-04T01:42:26.677059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:22.689923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.179495+0000","last_change":"2023-11-04T01:42:24.535521+0000","last_active":"2023-11-04T01:42:27.179495+0000","last_peered":"2023-11-04T01:42:27.179495+0000","last_clean":"2023-11-04T01:42:27.179495+0000","last_became_active":"2023-11-04T01:42:24.534783+0000","last_became_peered":"2023-11-04T01:42:24.534783+0000","last_unstale":"2023-11-04T01:42:27.179495+0000","last_undegraded":"2023-11-04T01:42:27.179495+0000","last_fullsized":"2023-11-04T01:42:27.179495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507864+0000","last_change":"2023-11-04T01:42:24.545554+0000","last_active":"2023-11-04T01:42:25.507864+0000","last_peered":"2023-11-04T01:42:25.507864+0000","last_clean":"2023-11-04T01:42:25.507864+0000","last_became_active":"2023-11-04T01:42:24.544913+0000","last_became_peered":"2023-11-04T01:42:24.544913+0000","last_unstale":"2023-11-04T01:42:25.507864+0000","last_undegraded":"2023-11-04T01:42:25.507864+0000","last_fullsized":"2023-11-04T01:42:25.507864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:41:10.465442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508181+0000","last_change":"2023-11-04T01:42:24.549621+0000","last_active":"2023-11-04T01:42:25.508181+0000","last_peered":"2023-11-04T01:42:25.508181+0000","last_clean":"2023-11-04T01:42:25.508181+0000","last_became_active":"2023-11-04T01:42:24.548804+0000","last_became_peered":"2023-11-04T01:42:24.548804+0000","last_unstale":"2023-11-04T01:42:25.508181+0000","last_undegraded":"2023-11-04T01:42:25.508181+0000","last_fullsized":"2023-11-04T01:42:25.508181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:36.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508310+0000","last_change":"2023-11-04T01:42:24.545059+0000","last_active":"2023-11-04T01:42:25.508310+0000","last_peered":"2023-11-04T01:42:25.508310+0000","last_clean":"2023-11-04T01:42:25.508310+0000","last_became_active":"2023-11-04T01:42:24.544341+0000","last_became_peered":"2023-11-04T01:42:24.544341+0000","last_unstale":"2023-11-04T01:42:25.508310+0000","last_undegraded":"2023-11-04T01:42:25.508310+0000","last_fullsized":"2023-11-04T01:42:25.508310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.705964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573452+0000","last_change":"2023-11-04T01:42:24.555198+0000","last_active":"2023-11-04T01:42:25.573452+0000","last_peered":"2023-11-04T01:42:25.573452+0000","last_clean":"2023-11-04T01:42:25.573452+0000","last_became_active":"2023-11-04T01:42:24.554517+0000","last_became_peered":"2023-11-04T01:42:24.554517+0000","last_unstale":"2023-11-04T01:42:25.573452+0000","last_undegraded":"2023-11-04T01:42:25.573452+0000","last_fullsized":"2023-11-04T01:42:25.573452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572931+0000","last_change":"2023-11-04T01:42:24.537075+0000","last_active":"2023-11-04T01:42:25.572931+0000","last_peered":"2023-11-04T01:42:25.572931+0000","last_clean":"2023-11-04T01:42:25.572931+0000","last_became_active":"2023-11-04T01:42:24.536346+0000","last_became_peered":"2023-11-04T01:42:24.536346+0000","last_unstale":"2023-11-04T01:42:25.572931+0000","last_undegraded":"2023-11-04T01:42:25.572931+0000","last_fullsized":"2023-11-04T01:42:25.572931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.676983+0000","last_change":"2023-11-04T01:42:24.526411+0000","last_active":"2023-11-04T01:42:26.676983+0000","last_peered":"2023-11-04T01:42:26.676983+0000","last_clean":"2023-11-04T01:42:26.676983+0000","last_became_active":"2023-11-04T01:42:24.525610+0000","last_became_peered":"2023-11-04T01:42:24.525610+0000","last_unstale":"2023-11-04T01:42:26.676983+0000","last_undegraded":"2023-11-04T01:42:26.676983+0000","last_fullsized":"2023-11-04T01:42:26.676983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:26.640689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505513+0000","last_change":"2023-11-04T01:42:24.551036+0000","last_active":"2023-11-04T01:42:25.505513+0000","last_peered":"2023-11-04T01:42:25.505513+0000","last_clean":"2023-11-04T01:42:25.505513+0000","last_became_active":"2023-11-04T01:42:24.550386+0000","last_became_peered":"2023-11-04T01:42:24.550386+0000","last_unstale":"2023-11-04T01:42:25.505513+0000","last_undegraded":"2023-11-04T01:42:25.505513+0000","last_fullsized":"2023-11-04T01:42:25.505513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506769+0000","last_change":"2023-11-04T01:42:24.559164+0000","last_active":"2023-11-04T01:42:25.506769+0000","last_peered":"2023-11-04T01:42:25.506769+0000","last_clean":"2023-11-04T01:42:25.506769+0000","last_became_active":"2023-11-04T01:42:24.558452+0000","last_became_peered":"2023-11-04T01:42:24.558452+0000","last_unstale":"2023-11-04T01:42:25.506769+0000","last_undegraded":"2023-11-04T01:42:25.506769+0000","last_fullsized":"2023-11-04T01:42:25.506769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:31.294438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178817+0000","last_change":"2023-11-04T01:42:24.542766+0000","last_active":"2023-11-04T01:42:27.178817+0000","last_peered":"2023-11-04T01:42:27.178817+0000","last_clean":"2023-11-04T01:42:27.178817+0000","last_became_active":"2023-11-04T01:42:24.542209+0000","last_became_peered":"2023-11-04T01:42:24.542209+0000","last_unstale":"2023-11-04T01:42:27.178817+0000","last_undegraded":"2023-11-04T01:42:27.178817+0000","last_fullsized":"2023-11-04T01:42:27.178817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:53.449814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507069+0000","last_change":"2023-11-04T01:42:24.533283+0000","last_active":"2023-11-04T01:42:25.507069+0000","last_peered":"2023-11-04T01:42:25.507069+0000","last_clean":"2023-11-04T01:42:25.507069+0000","last_became_active":"2023-11-04T01:42:24.530651+0000","last_became_peered":"2023-11-04T01:42:24.530651+0000","last_unstale":"2023-11-04T01:42:25.507069+0000","last_undegraded":"2023-11-04T01:42:25.507069+0000","last_fullsized":"2023-11-04T01:42:25.507069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:50:51.772928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508171+0000","last_change":"2023-11-04T01:42:24.545087+0000","last_active":"2023-11-04T01:42:25.508171+0000","last_peered":"2023-11-04T01:42:25.508171+0000","last_clean":"2023-11-04T01:42:25.508171+0000","last_became_active":"2023-11-04T01:42:24.544372+0000","last_became_peered":"2023-11-04T01:42:24.544372+0000","last_unstale":"2023-11-04T01:42:25.508171+0000","last_undegraded":"2023-11-04T01:42:25.508171+0000","last_fullsized":"2023-11-04T01:42:25.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:30.235988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504099+0000","last_change":"2023-11-04T01:42:24.528107+0000","last_active":"2023-11-04T01:42:25.504099+0000","last_peered":"2023-11-04T01:42:25.504099+0000","last_clean":"2023-11-04T01:42:25.504099+0000","last_became_active":"2023-11-04T01:42:24.527344+0000","last_became_peered":"2023-11-04T01:42:24.527344+0000","last_unstale":"2023-11-04T01:42:25.504099+0000","last_undegraded":"2023-11-04T01:42:25.504099+0000","last_fullsized":"2023-11-04T01:42:25.504099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:00:48.101766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.179302+0000","last_change":"2023-11-04T01:42:24.516917+0000","last_active":"2023-11-04T01:42:27.179302+0000","last_peered":"2023-11-04T01:42:27.179302+0000","last_clean":"2023-11-04T01:42:27.179302+0000","last_became_active":"2023-11-04T01:42:24.516072+0000","last_became_peered":"2023-11-04T01:42:24.516072+0000","last_unstale":"2023-11-04T01:42:27.179302+0000","last_undegraded":"2023-11-04T01:42:27.179302+0000","last_fullsized":"2023-11-04T01:42:27.179302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:39:18.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677186+0000","last_change":"2023-11-04T01:42:24.544709+0000","last_active":"2023-11-04T01:42:26.677186+0000","last_peered":"2023-11-04T01:42:26.677186+0000","last_clean":"2023-11-04T01:42:26.677186+0000","last_became_active":"2023-11-04T01:42:24.543976+0000","last_became_peered":"2023-11-04T01:42:24.543976+0000","last_unstale":"2023-11-04T01:42:26.677186+0000","last_undegraded":"2023-11-04T01:42:26.677186+0000","last_fullsized":"2023-11-04T01:42:26.677186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:15.212905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505748+0000","last_change":"2023-11-04T01:42:24.532616+0000","last_active":"2023-11-04T01:42:25.505748+0000","last_peered":"2023-11-04T01:42:25.505748+0000","last_clean":"2023-11-04T01:42:25.505748+0000","last_became_active":"2023-11-04T01:42:24.529894+0000","last_became_peered":"2023-11-04T01:42:24.529894+0000","last_unstale":"2023-11-04T01:42:25.505748+0000","last_undegraded":"2023-11-04T01:42:25.505748+0000","last_fullsized":"2023-11-04T01:42:25.505748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677675+0000","last_change":"2023-11-04T01:42:24.540137+0000","last_active":"2023-11-04T01:42:26.677675+0000","last_peered":"2023-11-04T01:42:26.677675+0000","last_clean":"2023-11-04T01:42:26.677675+0000","last_became_active":"2023-11-04T01:42:24.539303+0000","last_became_peered":"2023-11-04T01:42:24.539303+0000","last_unstale":"2023-11-04T01:42:26.677675+0000","last_undegraded":"2023-11-04T01:42:26.677675+0000","last_fullsized":"2023-11-04T01:42:26.677675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:17:50.998381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181688+0000","last_change":"2023-11-04T01:42:24.537992+0000","last_active":"2023-11-04T01:42:27.181688+0000","last_peered":"2023-11-04T01:42:27.181688+0000","last_clean":"2023-11-04T01:42:27.181688+0000","last_became_active":"2023-11-04T01:42:24.537129+0000","last_became_peered":"2023-11-04T01:42:24.537129+0000","last_unstale":"2023-11-04T01:42:27.181688+0000","last_undegraded":"2023-11-04T01:42:27.181688+0000","last_fullsized":"2023-11-04T01:42:27.181688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573347+0000","last_change":"2023-11-04T01:42:24.530582+0000","last_active":"2023-11-04T01:42:25.573347+0000","last_peered":"2023-11-04T01:42:25.573347+0000","last_clean":"2023-11-04T01:42:25.573347+0000","last_became_active":"2023-11-04T01:42:24.529891+0000","last_became_peered":"2023-11-04T01:42:24.529891+0000","last_unstale":"2023-11-04T01:42:25.573347+0000","last_undegraded":"2023-11-04T01:42:25.573347+0000","last_fullsized":"2023-11-04T01:42:25.573347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573474+0000","last_change":"2023-11-04T01:42:24.554452+0000","last_active":"2023-11-04T01:42:25.573474+0000","last_peered":"2023-11-04T01:42:25.573474+0000","last_clean":"2023-11-04T01:42:25.573474+0000","last_became_active":"2023-11-04T01:42:24.553857+0000","last_became_peered":"2023-11-04T01:42:24.553857+0000","last_unstale":"2023-11-04T01:42:25.573474+0000","last_undegraded":"2023-11-04T01:42:25.573474+0000","last_fullsized":"2023-11-04T01:42:25.573474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:48.459289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.678127+0000","last_change":"2023-11-04T01:42:24.532888+0000","last_active":"2023-11-04T01:42:26.678127+0000","last_peered":"2023-11-04T01:42:26.678127+0000","last_clean":"2023-11-04T01:42:26.678127+0000","last_became_active":"2023-11-04T01:42:24.532172+0000","last_became_peered":"2023-11-04T01:42:24.532172+0000","last_unstale":"2023-11-04T01:42:26.678127+0000","last_undegraded":"2023-11-04T01:42:26.678127+0000","last_fullsized":"2023-11-04T01:42:26.678127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505919+0000","last_change":"2023-11-04T01:42:24.532118+0000","last_active":"2023-11-04T01:42:25.505919+0000","last_peered":"2023-11-04T01:42:25.505919+0000","last_clean":"2023-11-04T01:42:25.505919+0000","last_became_active":"2023-11-04T01:42:24.530531+0000","last_became_peered":"2023-11-04T01:42:24.530531+0000","last_unstale":"2023-11-04T01:42:25.505919+0000","last_undegraded":"2023-11-04T01:42:25.505919+0000","last_fullsized":"2023-11-04T01:42:25.505919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178006+0000","last_change":"2023-11-04T01:42:24.541439+0000","last_active":"2023-11-04T01:42:27.178006+0000","last_peered":"2023-11-04T01:42:27.178006+0000","last_clean":"2023-11-04T01:42:27.178006+0000","last_became_active":"2023-11-04T01:42:24.540727+0000","last_became_peered":"2023-11-04T01:42:24.540727+0000","last_unstale":"2023-11-04T01:42:27.178006+0000","last_undegraded":"2023-11-04T01:42:27.178006+0000","last_fullsized":"2023-11-04T01:42:27.178006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:23:49.750746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.180790+0000","last_change":"2023-11-04T01:42:24.521552+0000","last_active":"2023-11-04T01:42:27.180790+0000","last_peered":"2023-11-04T01:42:27.180790+0000","last_clean":"2023-11-04T01:42:27.180790+0000","last_became_active":"2023-11-04T01:42:24.520794+0000","last_became_peered":"2023-11-04T01:42:24.520794+0000","last_unstale":"2023-11-04T01:42:27.180790+0000","last_undegraded":"2023-11-04T01:42:27.180790+0000","last_fullsized":"2023-11-04T01:42:27.180790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178897+0000","last_change":"2023-11-04T01:42:24.530960+0000","last_active":"2023-11-04T01:42:27.178897+0000","last_peered":"2023-11-04T01:42:27.178897+0000","last_clean":"2023-11-04T01:42:27.178897+0000","last_became_active":"2023-11-04T01:42:24.530166+0000","last_became_peered":"2023-11-04T01:42:24.530166+0000","last_unstale":"2023-11-04T01:42:27.178897+0000","last_undegraded":"2023-11-04T01:42:27.178897+0000","last_fullsized":"2023-11-04T01:42:27.178897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:50.563897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783828+0000","last_change":"2023-11-04T01:42:23.881752+0000","last_active":"2023-11-04T01:42:25.783828+0000","last_peered":"2023-11-04T01:42:25.783828+0000","last_clean":"2023-11-04T01:42:25.783828+0000","last_became_active":"2023-11-04T01:42:23.871460+0000","last_became_peered":"2023-11-04T01:42:23.871460+0000","last_unstale":"2023-11-04T01:42:25.783828+0000","last_undegraded":"2023-11-04T01:42:25.783828+0000","last_fullsized":"2023-11-04T01:42:25.783828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504494+0000","last_change":"2023-11-04T01:42:24.536354+0000","last_active":"2023-11-04T01:42:25.504494+0000","last_peered":"2023-11-04T01:42:25.504494+0000","last_clean":"2023-11-04T01:42:25.504494+0000","last_became_active":"2023-11-04T01:42:24.535597+0000","last_became_peered":"2023-11-04T01:42:24.535597+0000","last_unstale":"2023-11-04T01:42:25.504494+0000","last_undegraded":"2023-11-04T01:42:25.504494+0000","last_fullsized":"2023-11-04T01:42:25.504494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:09.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507312+0000","last_change":"2023-11-04T01:42:23.854629+0000","last_active":"2023-11-04T01:42:25.507312+0000","last_peered":"2023-11-04T01:42:25.507312+0000","last_clean":"2023-11-04T01:42:25.507312+0000","last_became_active":"2023-11-04T01:42:23.854209+0000","last_became_peered":"2023-11-04T01:42:23.854209+0000","last_unstale":"2023-11-04T01:42:25.507312+0000","last_undegraded":"2023-11-04T01:42:25.507312+0000","last_fullsized":"2023-11-04T01:42:25.507312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572788+0000","last_change":"2023-11-04T01:42:23.871583+0000","last_active":"2023-11-04T01:42:25.572788+0000","last_peered":"2023-11-04T01:42:25.572788+0000","last_clean":"2023-11-04T01:42:25.572788+0000","last_became_active":"2023-11-04T01:42:23.870753+0000","last_became_peered":"2023-11-04T01:42:23.870753+0000","last_unstale":"2023-11-04T01:42:25.572788+0000","last_undegraded":"2023-11-04T01:42:25.572788+0000","last_fullsized":"2023-11-04T01:42:25.572788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:04:45.998097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677453+0000","last_change":"2023-11-04T01:42:24.527244+0000","last_active":"2023-11-04T01:42:26.677453+0000","last_peered":"2023-11-04T01:42:26.677453+0000","last_clean":"2023-11-04T01:42:26.677453+0000","last_became_active":"2023-11-04T01:42:24.526519+0000","last_became_peered":"2023-11-04T01:42:24.526519+0000","last_unstale":"2023-11-04T01:42:26.677453+0000","last_undegraded":"2023-11-04T01:42:26.677453+0000","last_fullsized":"2023-11-04T01:42:26.677453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:22.475674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505615+0000","last_change":"2023-11-04T01:42:23.861230+0000","last_active":"2023-11-04T01:42:25.505615+0000","last_peered":"2023-11-04T01:42:25.505615+0000","last_clean":"2023-11-04T01:42:25.505615+0000","last_became_active":"2023-11-04T01:42:23.859784+0000","last_became_peered":"2023-11-04T01:42:23.859784+0000","last_unstale":"2023-11-04T01:42:25.505615+0000","last_undegraded":"2023-11-04T01:42:25.505615+0000","last_fullsized":"2023-11-04T01:42:25.505615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:43.619572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504003+0000","last_change":"2023-11-04T01:42:24.524254+0000","last_active":"2023-11-04T01:42:25.504003+0000","last_peered":"2023-11-04T01:42:25.504003+0000","last_clean":"2023-11-04T01:42:25.504003+0000","last_became_active":"2023-11-04T01:42:24.523478+0000","last_became_peered":"2023-11-04T01:42:24.523478+0000","last_unstale":"2023-11-04T01:42:25.504003+0000","last_undegraded":"2023-11-04T01:42:25.504003+0000","last_fullsized":"2023-11-04T01:42:25.504003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:49.878595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.787258+0000","last_change":"2023-11-04T01:42:23.872649+0000","last_active":"2023-11-04T01:42:26.787258+0000","last_peered":"2023-11-04T01:42:26.787258+0000","last_clean":"2023-11-04T01:42:26.787258+0000","last_became_active":"2023-11-04T01:42:23.872297+0000","last_became_peered":"2023-11-04T01:42:23.872297+0000","last_unstale":"2023-11-04T01:42:26.787258+0000","last_undegraded":"2023-11-04T01:42:26.787258+0000","last_fullsized":"2023-11-04T01:42:26.787258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181818+0000","last_change":"2023-11-04T01:42:24.530263+0000","last_active":"2023-11-04T01:42:27.181818+0000","last_peered":"2023-11-04T01:42:27.181818+0000","last_clean":"2023-11-04T01:42:27.181818+0000","last_became_active":"2023-11-04T01:42:24.529507+0000","last_became_peered":"2023-11-04T01:42:24.529507+0000","last_unstale":"2023-11-04T01:42:27.181818+0000","last_undegraded":"2023-11-04T01:42:27.181818+0000","last_fullsized":"2023-11-04T01:42:27.181818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:57.816407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508023+0000","last_change":"2023-11-04T01:42:23.873814+0000","last_active":"2023-11-04T01:42:25.508023+0000","last_peered":"2023-11-04T01:42:25.508023+0000","last_clean":"2023-11-04T01:42:25.508023+0000","last_became_active":"2023-11-04T01:42:23.873404+0000","last_became_peered":"2023-11-04T01:42:23.873404+0000","last_unstale":"2023-11-04T01:42:25.508023+0000","last_undegraded":"2023-11-04T01:42:25.508023+0000","last_fullsized":"2023-11-04T01:42:25.508023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:21.679291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677860+0000","last_change":"2023-11-04T01:42:24.534026+0000","last_active":"2023-11-04T01:42:26.677860+0000","last_peered":"2023-11-04T01:42:26.677860+0000","last_clean":"2023-11-04T01:42:26.677860+0000","last_became_active":"2023-11-04T01:42:24.533338+0000","last_became_peered":"2023-11-04T01:42:24.533338+0000","last_unstale":"2023-11-04T01:42:26.677860+0000","last_undegraded":"2023-11-04T01:42:26.677860+0000","last_fullsized":"2023-11-04T01:42:26.677860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:36.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.778911+0000","last_change":"2023-11-04T01:42:23.872021+0000","last_active":"2023-11-04T01:42:25.778911+0000","last_peered":"2023-11-04T01:42:25.778911+0000","last_clean":"2023-11-04T01:42:25.778911+0000","last_became_active":"2023-11-04T01:42:23.870751+0000","last_became_peered":"2023-11-04T01:42:23.870751+0000","last_unstale":"2023-11-04T01:42:25.778911+0000","last_undegraded":"2023-11-04T01:42:25.778911+0000","last_fullsized":"2023-11-04T01:42:25.778911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:57.620945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506411+0000","last_change":"2023-11-04T01:42:24.546924+0000","last_active":"2023-11-04T01:42:25.506411+0000","last_peered":"2023-11-04T01:42:25.506411+0000","last_clean":"2023-11-04T01:42:25.506411+0000","last_became_active":"2023-11-04T01:42:24.546318+0000","last_became_peered":"2023-11-04T01:42:24.546318+0000","last_unstale":"2023-11-04T01:42:25.506411+0000","last_undegraded":"2023-11-04T01:42:25.506411+0000","last_fullsized":"2023-11-04T01:42:25.506411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:25:48.887573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.786748+0000","last_change":"2023-11-04T01:42:23.872849+0000","last_active":"2023-11-04T01:42:25.786748+0000","last_peered":"2023-11-04T01:42:25.786748+0000","last_clean":"2023-11-04T01:42:25.786748+0000","last_became_active":"2023-11-04T01:42:23.872394+0000","last_became_peered":"2023-11-04T01:42:23.872394+0000","last_unstale":"2023-11-04T01:42:25.786748+0000","last_undegraded":"2023-11-04T01:42:25.786748+0000","last_fullsized":"2023-11-04T01:42:25.786748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508459+0000","last_change":"2023-11-04T01:42:24.525307+0000","last_active":"2023-11-04T01:42:25.508459+0000","last_peered":"2023-11-04T01:42:25.508459+0000","last_clean":"2023-11-04T01:42:25.508459+0000","last_became_active":"2023-11-04T01:42:24.522877+0000","last_became_peered":"2023-11-04T01:42:24.522877+0000","last_unstale":"2023-11-04T01:42:25.508459+0000","last_undegraded":"2023-11-04T01:42:25.508459+0000","last_fullsized":"2023-11-04T01:42:25.508459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:51.259516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.778882+0000","last_change":"2023-11-04T01:42:23.878097+0000","last_active":"2023-11-04T01:42:25.778882+0000","last_peered":"2023-11-04T01:42:25.778882+0000","last_clean":"2023-11-04T01:42:25.778882+0000","last_became_active":"2023-11-04T01:42:23.877265+0000","last_became_peered":"2023-11-04T01:42:23.877265+0000","last_unstale":"2023-11-04T01:42:25.778882+0000","last_undegraded":"2023-11-04T01:42:25.778882+0000","last_fullsized":"2023-11-04T01:42:25.778882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:24:22.344804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573080+0000","last_change":"2023-11-04T01:42:24.546728+0000","last_active":"2023-11-04T01:42:25.573080+0000","last_peered":"2023-11-04T01:42:25.573080+0000","last_clean":"2023-11-04T01:42:25.573080+0000","last_became_active":"2023-11-04T01:42:24.545946+0000","last_became_peered":"2023-11-04T01:42:24.545946+0000","last_unstale":"2023-11-04T01:42:25.573080+0000","last_undegraded":"2023-11-04T01:42:25.573080+0000","last_fullsized":"2023-11-04T01:42:25.573080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:59.678243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506789+0000","last_change":"2023-11-04T01:42:23.875211+0000","last_active":"2023-11-04T01:42:25.506789+0000","last_peered":"2023-11-04T01:42:25.506789+0000","last_clean":"2023-11-04T01:42:25.506789+0000","last_became_active":"2023-11-04T01:42:23.874649+0000","last_became_peered":"2023-11-04T01:42:23.874649+0000","last_unstale":"2023-11-04T01:42:25.506789+0000","last_undegraded":"2023-11-04T01:42:25.506789+0000","last_fullsized":"2023-11-04T01:42:25.506789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506005+0000","last_change":"2023-11-04T01:42:24.557710+0000","last_active":"2023-11-04T01:42:25.506005+0000","last_peered":"2023-11-04T01:42:25.506005+0000","last_clean":"2023-11-04T01:42:25.506005+0000","last_became_active":"2023-11-04T01:42:24.557097+0000","last_became_peered":"2023-11-04T01:42:24.557097+0000","last_unstale":"2023-11-04T01:42:25.506005+0000","last_undegraded":"2023-11-04T01:42:25.506005+0000","last_fullsized":"2023-11-04T01:42:25.506005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:02:07.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507961+0000","last_change":"2023-11-04T01:42:23.858376+0000","last_active":"2023-11-04T01:42:25.507961+0000","last_peered":"2023-11-04T01:42:25.507961+0000","last_clean":"2023-11-04T01:42:25.507961+0000","last_became_active":"2023-11-04T01:42:23.856424+0000","last_became_peered":"2023-11-04T01:42:23.856424+0000","last_unstale":"2023-11-04T01:42:25.507961+0000","last_undegraded":"2023-11-04T01:42:25.507961+0000","last_fullsized":"2023-11-04T01:42:25.507961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:50:49.553266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178654+0000","last_change":"2023-11-04T01:42:24.529593+0000","last_active":"2023-11-04T01:42:27.178654+0000","last_peered":"2023-11-04T01:42:27.178654+0000","last_clean":"2023-11-04T01:42:27.178654+0000","last_became_active":"2023-11-04T01:42:24.528834+0000","last_became_peered":"2023-11-04T01:42:24.528834+0000","last_unstale":"2023-11-04T01:42:27.178654+0000","last_undegraded":"2023-11-04T01:42:27.178654+0000","last_fullsized":"2023-11-04T01:42:27.178654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:08.788707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503660+0000","last_change":"2023-11-04T01:42:23.878725+0000","last_active":"2023-11-04T01:42:25.503660+0000","last_peered":"2023-11-04T01:42:25.503660+0000","last_clean":"2023-11-04T01:42:25.503660+0000","last_became_active":"2023-11-04T01:42:23.877930+0000","last_became_peered":"2023-11-04T01:42:23.877930+0000","last_unstale":"2023-11-04T01:42:25.503660+0000","last_undegraded":"2023-11-04T01:42:25.503660+0000","last_fullsized":"2023-11-04T01:42:25.503660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:20:52.439183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505874+0000","last_change":"2023-11-04T01:42:24.545238+0000","last_active":"2023-11-04T01:42:25.505874+0000","last_peered":"2023-11-04T01:42:25.505874+0000","last_clean":"2023-11-04T01:42:25.505874+0000","last_became_active":"2023-11-04T01:42:24.544606+0000","last_became_peered":"2023-11-04T01:42:24.544606+0000","last_unstale":"2023-11-04T01:42:25.505874+0000","last_undegraded":"2023-11-04T01:42:25.505874+0000","last_fullsized":"2023-11-04T01:42:25.505874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.509259+0000","last_change":"2023-11-04T01:42:23.889452+0000","last_active":"2023-11-04T01:42:25.509259+0000","last_peered":"2023-11-04T01:42:25.509259+0000","last_clean":"2023-11-04T01:42:25.509259+0000","last_became_active":"2023-11-04T01:42:23.889046+0000","last_became_peered":"2023-11-04T01:42:23.889046+0000","last_unstale":"2023-11-04T01:42:25.509259+0000","last_undegraded":"2023-11-04T01:42:25.509259+0000","last_fullsized":"2023-11-04T01:42:25.509259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181971+0000","last_change":"2023-11-04T01:42:24.560710+0000","last_active":"2023-11-04T01:42:27.181971+0000","last_peered":"2023-11-04T01:42:27.181971+0000","last_clean":"2023-11-04T01:42:27.181971+0000","last_became_active":"2023-11-04T01:42:24.560051+0000","last_became_peered":"2023-11-04T01:42:24.560051+0000","last_unstale":"2023-11-04T01:42:27.181971+0000","last_undegraded":"2023-11-04T01:42:27.181971+0000","last_fullsized":"2023-11-04T01:42:27.181971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.909247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504630+0000","last_change":"2023-11-04T01:42:23.892535+0000","last_active":"2023-11-04T01:42:25.504630+0000","last_peered":"2023-11-04T01:42:25.504630+0000","last_clean":"2023-11-04T01:42:25.504630+0000","last_became_active":"2023-11-04T01:42:23.891942+0000","last_became_peered":"2023-11-04T01:42:23.891942+0000","last_unstale":"2023-11-04T01:42:25.504630+0000","last_undegraded":"2023-11-04T01:42:25.504630+0000","last_fullsized":"2023-11-04T01:42:25.504630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:28.817061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508895+0000","last_change":"2023-11-04T01:42:24.555641+0000","last_active":"2023-11-04T01:42:25.508895+0000","last_peered":"2023-11-04T01:42:25.508895+0000","last_clean":"2023-11-04T01:42:25.508895+0000","last_became_active":"2023-11-04T01:42:24.554641+0000","last_became_peered":"2023-11-04T01:42:24.554641+0000","last_unstale":"2023-11-04T01:42:25.508895+0000","last_undegraded":"2023-11-04T01:42:25.508895+0000","last_fullsized":"2023-11-04T01:42:25.508895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:52:57.575211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783901+0000","last_change":"2023-11-04T01:42:23.879946+0000","last_active":"2023-11-04T01:42:25.783901+0000","last_peered":"2023-11-04T01:42:25.783901+0000","last_clean":"2023-11-04T01:42:25.783901+0000","last_became_active":"2023-11-04T01:42:23.879106+0000","last_became_peered":"2023-11-04T01:42:23.879106+0000","last_unstale":"2023-11-04T01:42:25.783901+0000","last_undegraded":"2023-11-04T01:42:25.783901+0000","last_fullsized":"2023-11-04T01:42:25.783901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:51:56.805776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508541+0000","last_change":"2023-11-04T01:42:24.535305+0000","last_active":"2023-11-04T01:42:25.508541+0000","last_peered":"2023-11-04T01:42:25.508541+0000","last_clean":"2023-11-04T01:42:25.508541+0000","last_became_active":"2023-11-04T01:42:24.534392+0000","last_became_peered":"2023-11-04T01:42:24.534392+0000","last_unstale":"2023-11-04T01:42:25.508541+0000","last_undegraded":"2023-11-04T01:42:25.508541+0000","last_fullsized":"2023-11-04T01:42:25.508541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:18.363162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573731+0000","last_change":"2023-11-04T01:42:23.859651+0000","last_active":"2023-11-04T01:42:25.573731+0000","last_peered":"2023-11-04T01:42:25.573731+0000","last_clean":"2023-11-04T01:42:25.573731+0000","last_became_active":"2023-11-04T01:42:23.858848+0000","last_became_peered":"2023-11-04T01:42:23.858848+0000","last_unstale":"2023-11-04T01:42:25.573731+0000","last_undegraded":"2023-11-04T01:42:25.573731+0000","last_fullsized":"2023-11-04T01:42:25.573731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:06:04.395748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506723+0000","last_change":"2023-11-04T01:42:24.542701+0000","last_active":"2023-11-04T01:42:25.506723+0000","last_peered":"2023-11-04T01:42:25.506723+0000","last_clean":"2023-11-04T01:42:25.506723+0000","last_became_active":"2023-11-04T01:42:24.541785+0000","last_became_peered":"2023-11-04T01:42:24.541785+0000","last_unstale":"2023-11-04T01:42:25.506723+0000","last_undegraded":"2023-11-04T01:42:25.506723+0000","last_fullsized":"2023-11-04T01:42:25.506723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:28:54.044840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:24.496361+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:42:24.496361+0000","last_peered":"2023-11-04T01:42:24.496361+0000","last_clean":"2023-11-04T01:42:24.496361+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:42:24.496361+0000","last_undegraded":"2023-11-04T01:42:24.496361+0000","last_fullsized":"2023-11-04T01:42:24.496361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506303+0000","last_change":"2023-11-04T01:42:23.870050+0000","last_active":"2023-11-04T01:42:25.506303+0000","last_peered":"2023-11-04T01:42:25.506303+0000","last_clean":"2023-11-04T01:42:25.506303+0000","last_became_active":"2023-11-04T01:42:23.868558+0000","last_became_peered":"2023-11-04T01:42:23.868558+0000","last_unstale":"2023-11-04T01:42:25.506303+0000","last_undegraded":"2023-11-04T01:42:25.506303+0000","last_fullsized":"2023-11-04T01:42:25.506303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:25.630058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504592+0000","last_change":"2023-11-04T01:42:24.515619+0000","last_active":"2023-11-04T01:42:25.504592+0000","last_peered":"2023-11-04T01:42:25.504592+0000","last_clean":"2023-11-04T01:42:25.504592+0000","last_became_active":"2023-11-04T01:42:24.514861+0000","last_became_peered":"2023-11-04T01:42:24.514861+0000","last_unstale":"2023-11-04T01:42:25.504592+0000","last_undegraded":"2023-11-04T01:42:25.504592+0000","last_fullsized":"2023-11-04T01:42:25.504592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:12.327963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.505707+0000","last_change":"2023-11-04T01:42:23.889363+0000","last_active":"2023-11-04T01:42:25.505707+0000","last_peered":"2023-11-04T01:42:25.505707+0000","last_clean":"2023-11-04T01:42:25.505707+0000","last_became_active":"2023-11-04T01:42:23.888990+0000","last_became_peered":"2023-11-04T01:42:23.888990+0000","last_unstale":"2023-11-04T01:42:25.505707+0000","last_undegraded":"2023-11-04T01:42:25.505707+0000","last_fullsized":"2023-11-04T01:42:25.505707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.572945+0000","last_change":"2023-11-04T01:42:24.544491+0000","last_active":"2023-11-04T01:42:25.572945+0000","last_peered":"2023-11-04T01:42:25.572945+0000","last_clean":"2023-11-04T01:42:25.572945+0000","last_became_active":"2023-11-04T01:42:24.543670+0000","last_became_peered":"2023-11-04T01:42:24.543670+0000","last_unstale":"2023-11-04T01:42:25.572945+0000","last_undegraded":"2023-11-04T01:42:25.572945+0000","last_fullsized":"2023-11-04T01:42:25.572945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:51.647935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.778828+0000","last_change":"2023-11-04T01:42:23.887645+0000","last_active":"2023-11-04T01:42:25.778828+0000","last_peered":"2023-11-04T01:42:25.778828+0000","last_clean":"2023-11-04T01:42:25.778828+0000","last_became_active":"2023-11-04T01:42:23.887066+0000","last_became_peered":"2023-11-04T01:42:23.887066+0000","last_unstale":"2023-11-04T01:42:25.778828+0000","last_undegraded":"2023-11-04T01:42:25.778828+0000","last_fullsized":"2023-11-04T01:42:25.778828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:14.860163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677132+0000","last_change":"2023-11-04T01:42:24.530872+0000","last_active":"2023-11-04T01:42:26.677132+0000","last_peered":"2023-11-04T01:42:26.677132+0000","last_clean":"2023-11-04T01:42:26.677132+0000","last_became_active":"2023-11-04T01:42:24.529785+0000","last_became_peered":"2023-11-04T01:42:24.529785+0000","last_unstale":"2023-11-04T01:42:26.677132+0000","last_undegraded":"2023-11-04T01:42:26.677132+0000","last_fullsized":"2023-11-04T01:42:26.677132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:48.657564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507010+0000","last_change":"2023-11-04T01:42:23.864470+0000","last_active":"2023-11-04T01:42:25.507010+0000","last_peered":"2023-11-04T01:42:25.507010+0000","last_clean":"2023-11-04T01:42:25.507010+0000","last_became_active":"2023-11-04T01:42:23.864049+0000","last_became_peered":"2023-11-04T01:42:23.864049+0000","last_unstale":"2023-11-04T01:42:25.507010+0000","last_undegraded":"2023-11-04T01:42:25.507010+0000","last_fullsized":"2023-11-04T01:42:25.507010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:47.646933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508539+0000","last_change":"2023-11-04T01:42:24.547297+0000","last_active":"2023-11-04T01:42:25.508539+0000","last_peered":"2023-11-04T01:42:25.508539+0000","last_clean":"2023-11-04T01:42:25.508539+0000","last_became_active":"2023-11-04T01:42:24.546593+0000","last_became_peered":"2023-11-04T01:42:24.546593+0000","last_unstale":"2023-11-04T01:42:25.508539+0000","last_undegraded":"2023-11-04T01:42:25.508539+0000","last_fullsized":"2023-11-04T01:42:25.508539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:44.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783855+0000","last_change":"2023-11-04T01:42:23.881220+0000","last_active":"2023-11-04T01:42:25.783855+0000","last_peered":"2023-11-04T01:42:25.783855+0000","last_clean":"2023-11-04T01:42:25.783855+0000","last_became_active":"2023-11-04T01:42:23.880569+0000","last_became_peered":"2023-11-04T01:42:23.880569+0000","last_unstale":"2023-11-04T01:42:25.783855+0000","last_undegraded":"2023-11-04T01:42:25.783855+0000","last_fullsized":"2023-11-04T01:42:25.783855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:58.667612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.181148+0000","last_change":"2023-11-04T01:42:24.544821+0000","last_active":"2023-11-04T01:42:27.181148+0000","last_peered":"2023-11-04T01:42:27.181148+0000","last_clean":"2023-11-04T01:42:27.181148+0000","last_became_active":"2023-11-04T01:42:24.544158+0000","last_became_peered":"2023-11-04T01:42:24.544158+0000","last_unstale":"2023-11-04T01:42:27.181148+0000","last_undegraded":"2023-11-04T01:42:27.181148+0000","last_fullsized":"2023-11-04T01:42:27.181148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:44.630203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507284+0000","last_change":"2023-11-04T01:42:23.867710+0000","last_active":"2023-11-04T01:42:25.507284+0000","last_peered":"2023-11-04T01:42:25.507284+0000","last_clean":"2023-11-04T01:42:25.507284+0000","last_became_active":"2023-11-04T01:42:23.867162+0000","last_became_peered":"2023-11-04T01:42:23.867162+0000","last_unstale":"2023-11-04T01:42:25.507284+0000","last_undegraded":"2023-11-04T01:42:25.507284+0000","last_fullsized":"2023-11-04T01:42:25.507284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:48.695333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573619+0000","last_change":"2023-11-04T01:42:24.529944+0000","last_active":"2023-11-04T01:42:25.573619+0000","last_peered":"2023-11-04T01:42:25.573619+0000","last_clean":"2023-11-04T01:42:25.573619+0000","last_became_active":"2023-11-04T01:42:24.528837+0000","last_became_peered":"2023-11-04T01:42:24.528837+0000","last_unstale":"2023-11-04T01:42:25.573619+0000","last_undegraded":"2023-11-04T01:42:25.573619+0000","last_fullsized":"2023-11-04T01:42:25.573619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.261927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.784857+0000","last_change":"2023-11-04T01:42:23.871604+0000","last_active":"2023-11-04T01:42:25.784857+0000","last_peered":"2023-11-04T01:42:25.784857+0000","last_clean":"2023-11-04T01:42:25.784857+0000","last_became_active":"2023-11-04T01:42:23.870746+0000","last_became_peered":"2023-11-04T01:42:23.870746+0000","last_unstale":"2023-11-04T01:42:25.784857+0000","last_undegraded":"2023-11-04T01:42:25.784857+0000","last_fullsized":"2023-11-04T01:42:25.784857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:44:22.043685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504543+0000","last_change":"2023-11-04T01:42:24.520352+0000","last_active":"2023-11-04T01:42:25.504543+0000","last_peered":"2023-11-04T01:42:25.504543+0000","last_clean":"2023-11-04T01:42:25.504543+0000","last_became_active":"2023-11-04T01:42:24.519515+0000","last_became_peered":"2023-11-04T01:42:24.519515+0000","last_unstale":"2023-11-04T01:42:25.504543+0000","last_undegraded":"2023-11-04T01:42:25.504543+0000","last_fullsized":"2023-11-04T01:42:25.504543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:31.963568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506869+0000","last_change":"2023-11-04T01:42:23.856440+0000","last_active":"2023-11-04T01:42:25.506869+0000","last_peered":"2023-11-04T01:42:25.506869+0000","last_clean":"2023-11-04T01:42:25.506869+0000","last_became_active":"2023-11-04T01:42:23.856067+0000","last_became_peered":"2023-11-04T01:42:23.856067+0000","last_unstale":"2023-11-04T01:42:25.506869+0000","last_undegraded":"2023-11-04T01:42:25.506869+0000","last_fullsized":"2023-11-04T01:42:25.506869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:37:21.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504391+0000","last_change":"2023-11-04T01:42:24.530290+0000","last_active":"2023-11-04T01:42:25.504391+0000","last_peered":"2023-11-04T01:42:25.504391+0000","last_clean":"2023-11-04T01:42:25.504391+0000","last_became_active":"2023-11-04T01:42:24.529568+0000","last_became_peered":"2023-11-04T01:42:24.529568+0000","last_unstale":"2023-11-04T01:42:25.504391+0000","last_undegraded":"2023-11-04T01:42:25.504391+0000","last_fullsized":"2023-11-04T01:42:25.504391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:50:42.384938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508823+0000","last_change":"2023-11-04T01:42:23.867463+0000","last_active":"2023-11-04T01:42:25.508823+0000","last_peered":"2023-11-04T01:42:25.508823+0000","last_clean":"2023-11-04T01:42:25.508823+0000","last_became_active":"2023-11-04T01:42:23.865925+0000","last_became_peered":"2023-11-04T01:42:23.865925+0000","last_unstale":"2023-11-04T01:42:25.508823+0000","last_undegraded":"2023-11-04T01:42:25.508823+0000","last_fullsized":"2023-11-04T01:42:25.508823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:34:29.802796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506042+0000","last_change":"2023-11-04T01:42:24.532587+0000","last_active":"2023-11-04T01:42:25.506042+0000","last_peered":"2023-11-04T01:42:25.506042+0000","last_clean":"2023-11-04T01:42:25.506042+0000","last_became_active":"2023-11-04T01:42:24.531827+0000","last_became_peered":"2023-11-04T01:42:24.531827+0000","last_unstale":"2023-11-04T01:42:25.506042+0000","last_undegraded":"2023-11-04T01:42:25.506042+0000","last_fullsized":"2023-11-04T01:42:25.506042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:17:09.085213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504135+0000","last_change":"2023-11-04T01:42:23.871960+0000","last_active":"2023-11-04T01:42:25.504135+0000","last_peered":"2023-11-04T01:42:25.504135+0000","last_clean":"2023-11-04T01:42:25.504135+0000","last_became_active":"2023-11-04T01:42:23.871205+0000","last_became_peered":"2023-11-04T01:42:23.871205+0000","last_unstale":"2023-11-04T01:42:25.504135+0000","last_undegraded":"2023-11-04T01:42:25.504135+0000","last_fullsized":"2023-11-04T01:42:25.504135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:33:54.986696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.503773+0000","last_change":"2023-11-04T01:42:24.531520+0000","last_active":"2023-11-04T01:42:25.503773+0000","last_peered":"2023-11-04T01:42:25.503773+0000","last_clean":"2023-11-04T01:42:25.503773+0000","last_became_active":"2023-11-04T01:42:24.530762+0000","last_became_peered":"2023-11-04T01:42:24.530762+0000","last_unstale":"2023-11-04T01:42:25.503773+0000","last_undegraded":"2023-11-04T01:42:25.503773+0000","last_fullsized":"2023-11-04T01:42:25.503773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:03.137518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.573320+0000","last_change":"2023-11-04T01:42:23.887853+0000","last_active":"2023-11-04T01:42:25.573320+0000","last_peered":"2023-11-04T01:42:25.573320+0000","last_clean":"2023-11-04T01:42:25.573320+0000","last_became_active":"2023-11-04T01:42:23.886915+0000","last_became_peered":"2023-11-04T01:42:23.886915+0000","last_unstale":"2023-11-04T01:42:25.573320+0000","last_undegraded":"2023-11-04T01:42:25.573320+0000","last_fullsized":"2023-11-04T01:42:25.573320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:25.703783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.178265+0000","last_change":"2023-11-04T01:42:24.528548+0000","last_active":"2023-11-04T01:42:27.178265+0000","last_peered":"2023-11-04T01:42:27.178265+0000","last_clean":"2023-11-04T01:42:27.178265+0000","last_became_active":"2023-11-04T01:42:24.527750+0000","last_became_peered":"2023-11-04T01:42:24.527750+0000","last_unstale":"2023-11-04T01:42:27.178265+0000","last_undegraded":"2023-11-04T01:42:27.178265+0000","last_fullsized":"2023-11-04T01:42:27.178265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:43:31.542707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506105+0000","last_change":"2023-11-04T01:42:23.865890+0000","last_active":"2023-11-04T01:42:25.506105+0000","last_peered":"2023-11-04T01:42:25.506105+0000","last_clean":"2023-11-04T01:42:25.506105+0000","last_became_active":"2023-11-04T01:42:23.865503+0000","last_became_peered":"2023-11-04T01:42:23.865503+0000","last_unstale":"2023-11-04T01:42:25.506105+0000","last_undegraded":"2023-11-04T01:42:25.506105+0000","last_fullsized":"2023-11-04T01:42:25.506105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:37:05.380495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.506285+0000","last_change":"2023-11-04T01:42:24.527953+0000","last_active":"2023-11-04T01:42:25.506285+0000","last_peered":"2023-11-04T01:42:25.506285+0000","last_clean":"2023-11-04T01:42:25.506285+0000","last_became_active":"2023-11-04T01:42:24.527112+0000","last_became_peered":"2023-11-04T01:42:24.527112+0000","last_unstale":"2023-11-04T01:42:25.506285+0000","last_undegraded":"2023-11-04T01:42:25.506285+0000","last_fullsized":"2023-11-04T01:42:25.506285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:45:04.559600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.507122+0000","last_change":"2023-11-04T01:42:24.560200+0000","last_active":"2023-11-04T01:42:25.507122+0000","last_peered":"2023-11-04T01:42:25.507122+0000","last_clean":"2023-11-04T01:42:25.507122+0000","last_became_active":"2023-11-04T01:42:24.559286+0000","last_became_peered":"2023-11-04T01:42:24.559286+0000","last_unstale":"2023-11-04T01:42:25.507122+0000","last_undegraded":"2023-11-04T01:42:25.507122+0000","last_fullsized":"2023-11-04T01:42:25.507122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:25:48.678049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508726+0000","last_change":"2023-11-04T01:42:23.875613+0000","last_active":"2023-11-04T01:42:25.508726+0000","last_peered":"2023-11-04T01:42:25.508726+0000","last_clean":"2023-11-04T01:42:25.508726+0000","last_became_active":"2023-11-04T01:42:23.875339+0000","last_became_peered":"2023-11-04T01:42:23.875339+0000","last_unstale":"2023-11-04T01:42:25.508726+0000","last_undegraded":"2023-11-04T01:42:25.508726+0000","last_fullsized":"2023-11-04T01:42:25.508726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:27.179237+0000","last_change":"2023-11-04T01:42:24.541588+0000","last_active":"2023-11-04T01:42:27.179237+0000","last_peered":"2023-11-04T01:42:27.179237+0000","last_clean":"2023-11-04T01:42:27.179237+0000","last_became_active":"2023-11-04T01:42:24.536601+0000","last_became_peered":"2023-11-04T01:42:24.536601+0000","last_unstale":"2023-11-04T01:42:27.179237+0000","last_undegraded":"2023-11-04T01:42:27.179237+0000","last_fullsized":"2023-11-04T01:42:27.179237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:07:26.714414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.508450+0000","last_change":"2023-11-04T01:42:23.873370+0000","last_active":"2023-11-04T01:42:25.508450+0000","last_peered":"2023-11-04T01:42:25.508450+0000","last_clean":"2023-11-04T01:42:25.508450+0000","last_became_active":"2023-11-04T01:42:23.873081+0000","last_became_peered":"2023-11-04T01:42:23.873081+0000","last_unstale":"2023-11-04T01:42:25.508450+0000","last_undegraded":"2023-11-04T01:42:25.508450+0000","last_fullsized":"2023-11-04T01:42:25.508450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:12.251296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.677875+0000","last_change":"2023-11-04T01:42:24.540046+0000","last_active":"2023-11-04T01:42:26.677875+0000","last_peered":"2023-11-04T01:42:26.677875+0000","last_clean":"2023-11-04T01:42:26.677875+0000","last_became_active":"2023-11-04T01:42:24.539286+0000","last_became_peered":"2023-11-04T01:42:24.539286+0000","last_unstale":"2023-11-04T01:42:26.677875+0000","last_undegraded":"2023-11-04T01:42:26.677875+0000","last_fullsized":"2023-11-04T01:42:26.677875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:49.705964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.783994+0000","last_change":"2023-11-04T01:42:23.879421+0000","last_active":"2023-11-04T01:42:25.783994+0000","last_peered":"2023-11-04T01:42:25.783994+0000","last_clean":"2023-11-04T01:42:25.783994+0000","last_became_active":"2023-11-04T01:42:23.874688+0000","last_became_peered":"2023-11-04T01:42:23.874688+0000","last_unstale":"2023-11-04T01:42:25.783994+0000","last_undegraded":"2023-11-04T01:42:25.783994+0000","last_fullsized":"2023-11-04T01:42:25.783994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:46:47.448658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:26.678125+0000","last_change":"2023-11-04T01:42:24.544559+0000","last_active":"2023-11-04T01:42:26.678125+0000","last_peered":"2023-11-04T01:42:26.678125+0000","last_clean":"2023-11-04T01:42:26.678125+0000","last_became_active":"2023-11-04T01:42:24.543895+0000","last_became_peered":"2023-11-04T01:42:24.543895+0000","last_unstale":"2023-11-04T01:42:26.678125+0000","last_undegraded":"2023-11-04T01:42:26.678125+0000","last_fullsized":"2023-11-04T01:42:26.678125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:23.829059+0000","last_clean_scrub_stamp":"2023-11-04T01:42:23.829059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:27.568295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-04T01:42:25.504779+0000","last_change":"2023-11-04T01:42:23.868589+0000","last_active":"2023-11-04T01:42:25.504779+0000","last_peered":"2023-11-04T01:42:25.504779+0000","last_clean":"2023-11-04T01:42:25.504779+0000","last_became_active":"2023-11-04T01:42:23.867572+0000","last_became_peered":"2023-11-04T01:42:23.867572+0000","last_unstale":"2023-11-04T01:42:25.504779+0000","last_undegraded":"2023-11-04T01:42:25.504779+0000","last_fullsized":"2023-11-04T01:42:25.504779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:22.818428+0000","last_clean_scrub_stamp":"2023-11-04T01:42:22.818428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:04:13.960345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":806912,"data_stored":663493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":73111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":73637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:42:37.007 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-04T01:42:37.007 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-04T01:42:37.007 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-04T01:42:37.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-04T01:42:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.151+0000 7f6c813cb640 1 Processor -- start 2023-11-04T01:42:37.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.151+0000 7f6c813cb640 1 -- start start 2023-11-04T01:42:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.151+0000 7f6c813cb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6c7c0b4b50 0x7f6c7c070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.151+0000 7f6c813cb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c7c15eae0 0x7f6c7c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.151+0000 7f6c813cb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c15b3d0 con 0x7f6c7c0c99f0 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.151+0000 7f6c813cb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c070790 con 0x7f6c7c15eae0 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.151+0000 7f6c813cb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0cada0 con 0x7f6c7c0b4b50 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7a7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c7c15eae0 0x7f6c7c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c7c0c99f0 0x7f6c7c0c9e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52106/0 (socket says 172.21.15.2:52106) 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7b7fe640 1 -- 172.21.15.2:0/3340273169 learned_addr learned my addr 172.21.15.2:0/3340273169 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7affd640 1 --2- 172.21.15.2:0/3340273169 >> v2:172.21.15.90:3300/0 conn(0x7f6c7c0b4b50 0x7f6c7c070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7a7fc640 1 -- 172.21.15.2:0/3340273169 >> v2:172.21.15.90:3300/0 conn(0x7f6c7c0b4b50 msgr2=0x7f6c7c070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7a7fc640 1 --2- 172.21.15.2:0/3340273169 >> v2:172.21.15.90:3300/0 conn(0x7f6c7c0b4b50 0x7f6c7c070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7a7fc640 1 -- 172.21.15.2:0/3340273169 >> v1:172.21.15.2:6789/0 conn(0x7f6c7c0c99f0 legacy=0x7f6c7c0c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7a7fc640 1 -- 172.21.15.2:0/3340273169 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c15f480 con 0x7f6c7c15eae0 2023-11-04T01:42:37.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c79ffb640 1 -- 172.21.15.2:0/3340273169 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647791948 0 0) 0x7f6c7c15b3d0 con 0x7f6c7c0c99f0 2023-11-04T01:42:37.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c7a7fc640 1 --2- 172.21.15.2:0/3340273169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c15ef40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0686d0 tx=0x7f6c6401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f4f5b24a8b1a3c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c79ffb640 1 -- 172.21.15.2:0/3340273169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ac600 con 0x7f6c7c15eae0 2023-11-04T01:42:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c79ffb640 1 -- 172.21.15.2:0/3340273169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640a8050 con 0x7f6c7c15eae0 2023-11-04T01:42:37.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c79ffb640 1 -- 172.21.15.2:0/3340273169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ac980 con 0x7f6c7c15eae0 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 -- 172.21.15.2:0/3340273169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 msgr2=0x7f6c7c15ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 --2- 172.21.15.2:0/3340273169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c15ef40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0686d0 tx=0x7f6c6401c3a0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 -- 172.21.15.2:0/3340273169 shutdown_connections 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 --2- 172.21.15.2:0/3340273169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c15ef40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 --2- 172.21.15.2:0/3340273169 >> v2:172.21.15.90:3300/0 conn(0x7f6c7c0b4b50 0x7f6c7c070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 -- 172.21.15.2:0/3340273169 >> 172.21.15.2:0/3340273169 conn(0x7f6c7c0b0e90 msgr2=0x7f6c7c0b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 -- 172.21.15.2:0/3340273169 shutdown_connections 2023-11-04T01:42:37.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.155+0000 7f6c813cb640 1 -- 172.21.15.2:0/3340273169 wait complete. 2023-11-04T01:42:37.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 Processor -- start 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 -- start start 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c7c0b4b50 0x7f6c7c15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7c0c99f0 0x7f6c7c159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c1647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c158ec0 con 0x7f6c7c15eae0 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c1585d0 con 0x7f6c7c0b4b50 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c1f6eb0 con 0x7f6c7c0c99f0 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c1647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c1647e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50032/0 (socket says 172.21.15.2:50032) 2023-11-04T01:42:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 -- 172.21.15.2:0/1605436973 learned_addr learned my addr 172.21.15.2:0/1605436973 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 -- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7c0c99f0 msgr2=0x7f6c7c159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7c0c99f0 0x7f6c7c159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 -- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c7c0b4b50 msgr2=0x7f6c7c15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7affd640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c7c0b4b50 0x7f6c7c15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c7c0b4b50 0x7f6c7c15dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 -- 172.21.15.2:0/1605436973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64009420 con 0x7f6c7c15eae0 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c7b7fe640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c1647e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400c470 tx=0x7f6c7400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c737fe640 1 -- 172.21.15.2:0/1605436973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740074e0 con 0x7f6c7c15eae0 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c737fe640 1 -- 172.21.15.2:0/1605436973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74007640 con 0x7f6c7c15eae0 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c158870 con 0x7f6c7c15eae0 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c737fe640 1 -- 172.21.15.2:0/1605436973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74004a30 con 0x7f6c7c15eae0 2023-11-04T01:42:37.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c159890 con 0x7f6c7c15eae0 2023-11-04T01:42:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c159030 con 0x7f6c7c15eae0 2023-11-04T01:42:37.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c737fe640 1 -- 172.21.15.2:0/1605436973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c74004b90 con 0x7f6c7c15eae0 2023-11-04T01:42:37.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c737fe640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c5c0664d0 0x7f6c5c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.159+0000 7f6c737fe640 1 -- 172.21.15.2:0/1605436973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c74083340 con 0x7f6c7c15eae0 2023-11-04T01:42:37.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.163+0000 7f6c7affd640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c5c0664d0 0x7f6c5c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.163+0000 7f6c7affd640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c5c0664d0 0x7f6c5c068990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c158090 tx=0x7f6c6c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.163+0000 7f6c737fe640 1 -- 172.21.15.2:0/1605436973 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c740507c0 con 0x7f6c7c15eae0 2023-11-04T01:42:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.351+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6c7c074510 con 0x7f6c7c15eae0 2023-11-04T01:42:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.351+0000 7f6c737fe640 1 -- 172.21.15.2:0/1605436973 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6c74053de0 con 0x7f6c7c15eae0 2023-11-04T01:42:37.356 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:37.357 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c5c0664d0 msgr2=0x7f6c5c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c5c0664d0 0x7f6c5c068990 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c158090 tx=0x7f6c6c00b040 comp rx=0 tx=0).stop 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 msgr2=0x7f6c7c1647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c1647e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400c470 tx=0x7f6c7400c930 comp rx=0 tx=0).stop 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 shutdown_connections 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c5c0664d0 0x7f6c5c068990 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c7c15eae0 0x7f6c7c1647e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c7c0c99f0 0x7f6c7c159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 --2- 172.21.15.2:0/1605436973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c7c0b4b50 0x7f6c7c15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 >> 172.21.15.2:0/1605436973 conn(0x7f6c7c0b0e90 msgr2=0x7f6c7c0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 shutdown_connections 2023-11-04T01:42:37.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.355+0000 7f6c813cb640 1 -- 172.21.15.2:0/1605436973 wait complete. 2023-11-04T01:42:37.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-04T01:42:37.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:37.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.479+0000 7fc13ad45640 1 Processor -- start 2023-11-04T01:42:37.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.479+0000 7fc13ad45640 1 -- start start 2023-11-04T01:42:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc13ad45640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1340cdee0 0x7fc13406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc13ad45640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc13415d840 0x7fc13406e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc13ad45640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1340ce9b0 con 0x7fc13415aec0 2023-11-04T01:42:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc13ad45640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13415e8a0 con 0x7fc13415d840 2023-11-04T01:42:37.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc13ad45640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13406ea40 con 0x7fc1340cdee0 2023-11-04T01:42:37.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc1392e2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc13415d840 0x7fc13406e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc133fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1340cdee0 0x7fc13406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc1392e2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc13415d840 0x7fc13406e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38794/0 (socket says 172.21.15.2:38794) 2023-11-04T01:42:37.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc1392e2640 1 -- 172.21.15.2:0/3524285608 learned_addr learned my addr 172.21.15.2:0/3524285608 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:37.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc138ae1640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc13415aec0 0x7fc1340cd7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:56296/0 (socket says 172.21.15.2:56296) 2023-11-04T01:42:37.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc1392e2640 1 -- 172.21.15.2:0/3524285608 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1340cdee0 msgr2=0x7fc13406c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc1392e2640 1 --2- 172.21.15.2:0/3524285608 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1340cdee0 0x7fc13406c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc1392e2640 1 -- 172.21.15.2:0/3524285608 >> v1:172.21.15.90:6789/0 conn(0x7fc13415aec0 legacy=0x7fc1340cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.483+0000 7fc1392e2640 1 -- 172.21.15.2:0/3524285608 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340d0940 con 0x7fc13415d840 2023-11-04T01:42:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 --2- 172.21.15.2:0/3524285608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc13415d840 0x7fc13406e500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009e50 tx=0x7fc12c01c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e426e3da59da272d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1337fe640 1 -- 172.21.15.2:0/3524285608 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0a5730 con 0x7fc13415d840 2023-11-04T01:42:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1337fe640 1 -- 172.21.15.2:0/3524285608 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c0a5890 con 0x7fc13415d840 2023-11-04T01:42:37.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1337fe640 1 -- 172.21.15.2:0/3524285608 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0a5c20 con 0x7fc13415d840 2023-11-04T01:42:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- 172.21.15.2:0/3524285608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc13415d840 msgr2=0x7fc13406e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 --2- 172.21.15.2:0/3524285608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc13415d840 0x7fc13406e500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009e50 tx=0x7fc12c01c980 comp rx=0 tx=0).stop 2023-11-04T01:42:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- 172.21.15.2:0/3524285608 shutdown_connections 2023-11-04T01:42:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 --2- 172.21.15.2:0/3524285608 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc13415d840 0x7fc13406e500 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 --2- 172.21.15.2:0/3524285608 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1340cdee0 0x7fc13406c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- 172.21.15.2:0/3524285608 >> 172.21.15.2:0/3524285608 conn(0x7fc1340b28f0 msgr2=0x7fc1340b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- 172.21.15.2:0/3524285608 shutdown_connections 2023-11-04T01:42:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- 172.21.15.2:0/3524285608 wait complete. 2023-11-04T01:42:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 Processor -- start 2023-11-04T01:42:37.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- start start 2023-11-04T01:42:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cdee0 0x7fc1340c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc13415aec0 0x7fc1340b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13415d840 0x7fc13415f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13415f3b0 con 0x7fc13415d840 2023-11-04T01:42:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341514c0 con 0x7fc1340cdee0 2023-11-04T01:42:37.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13415ca70 con 0x7fc13415aec0 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13415d840 0x7fc13415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13415d840 0x7fc13415f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50040/0 (socket says 172.21.15.2:50040) 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 -- 172.21.15.2:0/1683853431 learned_addr learned my addr 172.21.15.2:0/1683853431 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 -- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc13415aec0 msgr2=0x7fc1340b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc133fff640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc13415aec0 0x7fc1340b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc138ae1640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cdee0 0x7fc1340c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc13415aec0 0x7fc1340b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 -- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cdee0 msgr2=0x7fc1340c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cdee0 0x7fc1340c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 -- 172.21.15.2:0/1683853431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c009b30 con 0x7fc13415d840 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc138ae1640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cdee0 0x7fc1340c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:37.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1392e2640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13415d840 0x7fc13415f840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0af040 tx=0x7fc12c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1317fa640 1 -- 172.21.15.2:0/1683853431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0b8670 con 0x7fc13415d840 2023-11-04T01:42:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1317fa640 1 -- 172.21.15.2:0/1683853431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c0b87d0 con 0x7fc13415d840 2023-11-04T01:42:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc1317fa640 1 -- 172.21.15.2:0/1683853431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0b8b60 con 0x7fc13415d840 2023-11-04T01:42:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.487+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13415ea80 con 0x7fc13415d840 2023-11-04T01:42:37.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.491+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13415f040 con 0x7fc13415d840 2023-11-04T01:42:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.491+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13415f1d0 con 0x7fc13415d840 2023-11-04T01:42:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.491+0000 7fc1317fa640 1 -- 172.21.15.2:0/1683853431 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc12c0b8cc0 con 0x7fc13415d840 2023-11-04T01:42:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.491+0000 7fc1317fa640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc1200664a0 0x7fc120068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.491+0000 7fc1317fa640 1 -- 172.21.15.2:0/1683853431 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc12c11f2b0 con 0x7fc13415d840 2023-11-04T01:42:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.491+0000 7fc138ae1640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc1200664a0 0x7fc120068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.491+0000 7fc138ae1640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc1200664a0 0x7fc120068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1340cdd70 tx=0x7fc124009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.495+0000 7fc1317fa640 1 -- 172.21.15.2:0/1683853431 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc12c0ec7e0 con 0x7fc13415d840 2023-11-04T01:42:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.643+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1340b35c0 con 0x7fc13415d840 2023-11-04T01:42:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc1317fa640 1 -- 172.21.15.2:0/1683853431 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7fc12c0efe00 con 0x7fc13415d840 2023-11-04T01:42:37.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:37.651 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc1200664a0 msgr2=0x7fc120068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc1200664a0 0x7fc120068960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc1340cdd70 tx=0x7fc124009040 comp rx=0 tx=0).stop 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13415d840 msgr2=0x7fc13415f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13415d840 0x7fc13415f840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0af040 tx=0x7fc12c019720 comp rx=0 tx=0).stop 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 shutdown_connections 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc1200664a0 0x7fc120068960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc13415d840 0x7fc13415f840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc13415aec0 0x7fc1340b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 --2- 172.21.15.2:0/1683853431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1340cdee0 0x7fc1340c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 >> 172.21.15.2:0/1683853431 conn(0x7fc1340b28f0 msgr2=0x7fc1340cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 shutdown_connections 2023-11-04T01:42:37.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.647+0000 7fc13ad45640 1 -- 172.21.15.2:0/1683853431 wait complete. 2023-11-04T01:42:37.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:37.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42fbca640 1 Processor -- start 2023-11-04T01:42:37.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42fbca640 1 -- start start 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42fbca640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4280b0c20 0x7fe42815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42fbca640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe42815c160 0x7fe4280ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42fbca640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4280cb130 con 0x7fe42815acb0 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42fbca640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42815bd40 con 0x7fe42815c160 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42fbca640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42806fd80 con 0x7fe4280b0c20 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42e167640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe42815c160 0x7fe4280ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42d966640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe42815acb0 0x7fe4280b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52116/0 (socket says 172.21.15.2:52116) 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42d966640 1 -- 172.21.15.2:0/697994619 learned_addr learned my addr 172.21.15.2:0/697994619 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:37.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42d165640 1 --2- 172.21.15.2:0/697994619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4280b0c20 0x7fe42815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42e167640 1 -- 172.21.15.2:0/697994619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4280b0c20 msgr2=0x7fe42815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:37.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42e167640 1 --2- 172.21.15.2:0/697994619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4280b0c20 0x7fe42815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42e167640 1 -- 172.21.15.2:0/697994619 >> v1:172.21.15.2:6789/0 conn(0x7fe42815acb0 legacy=0x7fe4280b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42e167640 1 -- 172.21.15.2:0/697994619 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42815b680 con 0x7fe42815c160 2023-11-04T01:42:37.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42c964640 1 -- 172.21.15.2:0/697994619 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424132121 0 0) 0x7fe4280cb130 con 0x7fe42815acb0 2023-11-04T01:42:37.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.783+0000 7fe42d165640 1 --2- 172.21.15.2:0/697994619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4280b0c20 0x7fe42815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42e167640 1 --2- 172.21.15.2:0/697994619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815c160 0x7fe4280ca490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe420009d90 tx=0x7fe42001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f35f49b61fb6a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42c964640 1 -- 172.21.15.2:0/697994619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200a5a00 con 0x7fe42815c160 2023-11-04T01:42:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42c964640 1 -- 172.21.15.2:0/697994619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4200a5b60 con 0x7fe42815c160 2023-11-04T01:42:37.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42c964640 1 -- 172.21.15.2:0/697994619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200ad440 con 0x7fe42815c160 2023-11-04T01:42:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 -- 172.21.15.2:0/697994619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815c160 msgr2=0x7fe4280ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 --2- 172.21.15.2:0/697994619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815c160 0x7fe4280ca490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe420009d90 tx=0x7fe42001c920 comp rx=0 tx=0).stop 2023-11-04T01:42:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 -- 172.21.15.2:0/697994619 shutdown_connections 2023-11-04T01:42:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 --2- 172.21.15.2:0/697994619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815c160 0x7fe4280ca490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 --2- 172.21.15.2:0/697994619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe4280b0c20 0x7fe42815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 -- 172.21.15.2:0/697994619 >> 172.21.15.2:0/697994619 conn(0x7fe4280cb510 msgr2=0x7fe4280cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 -- 172.21.15.2:0/697994619 shutdown_connections 2023-11-04T01:42:37.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 -- 172.21.15.2:0/697994619 wait complete. 2023-11-04T01:42:37.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 Processor -- start 2023-11-04T01:42:37.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.787+0000 7fe42fbca640 1 -- start start 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4280b0c20 0x7fe4280b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815acb0 0x7fe428153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42815c160 0x7fe4280b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280b27f0 con 0x7fe42815acb0 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280b2a70 con 0x7fe4280b0c20 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280b2d50 con 0x7fe42815c160 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815acb0 0x7fe428153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815acb0 0x7fe428153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50062/0 (socket says 172.21.15.2:50062) 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 -- 172.21.15.2:0/862042789 learned_addr learned my addr 172.21.15.2:0/862042789 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 -- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42815c160 msgr2=0x7fe4280b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42815c160 0x7fe4280b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 -- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4280b0c20 msgr2=0x7fe4280b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4280b0c20 0x7fe4280b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 -- 172.21.15.2:0/862042789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420009a70 con 0x7fe42815acb0 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42d165640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815acb0 0x7fe428153860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c7c0 tx=0x7fe41800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe41e7fc640 1 -- 172.21.15.2:0/862042789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418007a30 con 0x7fe42815acb0 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe41e7fc640 1 -- 172.21.15.2:0/862042789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418007b90 con 0x7fe42815acb0 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe41e7fc640 1 -- 172.21.15.2:0/862042789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41800ce70 con 0x7fe42815acb0 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4280b3030 con 0x7fe42815acb0 2023-11-04T01:42:37.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4280b35f0 con 0x7fe42815acb0 2023-11-04T01:42:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4280b4050 con 0x7fe42815acb0 2023-11-04T01:42:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe41e7fc640 1 -- 172.21.15.2:0/862042789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4180113f0 con 0x7fe42815acb0 2023-11-04T01:42:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.791+0000 7fe41e7fc640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe40c0664a0 0x7fe40c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.795+0000 7fe41e7fc640 1 -- 172.21.15.2:0/862042789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe418084490 con 0x7fe42815acb0 2023-11-04T01:42:37.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.795+0000 7fe42d966640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe40c0664a0 0x7fe40c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:37.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.795+0000 7fe42d966640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe40c0664a0 0x7fe40c068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe4240011f0 tx=0x7fe424007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:37.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.795+0000 7fe41e7fc640 1 -- 172.21.15.2:0/862042789 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4180519f0 con 0x7fe42815acb0 2023-11-04T01:42:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.951+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4280b3810 con 0x7fe42815acb0 2023-11-04T01:42:37.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.951+0000 7fe41e7fc640 1 -- 172.21.15.2:0/862042789 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe418055010 con 0x7fe42815acb0 2023-11-04T01:42:37.957 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe40c0664a0 msgr2=0x7fe40c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe40c0664a0 0x7fe40c068960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe4240011f0 tx=0x7fe424007930 comp rx=0 tx=0).stop 2023-11-04T01:42:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815acb0 msgr2=0x7fe428153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815acb0 0x7fe428153860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c7c0 tx=0x7fe41800cc80 comp rx=0 tx=0).stop 2023-11-04T01:42:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 shutdown_connections 2023-11-04T01:42:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe40c0664a0 0x7fe40c068960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe42815c160 0x7fe4280b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe42815acb0 0x7fe428153860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 --2- 172.21.15.2:0/862042789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4280b0c20 0x7fe4280b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 >> 172.21.15.2:0/862042789 conn(0x7fe4280cb510 msgr2=0x7fe42815da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 shutdown_connections 2023-11-04T01:42:37.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:37.955+0000 7fe42fbca640 1 -- 172.21.15.2:0/862042789 wait complete. 2023-11-04T01:42:37.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb503144640 1 Processor -- start 2023-11-04T01:42:38.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb503144640 1 -- start start 2023-11-04T01:42:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb503144640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc15edb0 0x7fb4fc15f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb503144640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0d0b40 con 0x7fb4fc0cd5c0 2023-11-04T01:42:38.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb503144640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0d0530 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb503144640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0ceb50 con 0x7fb4fc15edb0 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb500ee0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb4fc0cd5c0 0x7fb4fc0cd9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52130/0 (socket says 172.21.15.2:52130) 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb500ee0640 1 -- 172.21.15.2:0/2018960396 learned_addr learned my addr 172.21.15.2:0/2018960396 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:38.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb5016e1640 1 --2- 172.21.15.2:0/2018960396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc15edb0 0x7fb4fc15f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb4fb7fe640 1 -- 172.21.15.2:0/2018960396 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236068271 0 0) 0x7fb4fc0d0b40 con 0x7fb4fc0cd5c0 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb4fb7fe640 1 -- 172.21.15.2:0/2018960396 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e8003530 con 0x7fb4fc0cd5c0 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb5016e1640 1 -- 172.21.15.2:0/2018960396 >> v1:172.21.15.90:6789/0 conn(0x7fb4fc15e4c0 legacy=0x7fb4fc0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb5016e1640 1 -- 172.21.15.2:0/2018960396 >> v1:172.21.15.2:6789/0 conn(0x7fb4fc0cd5c0 legacy=0x7fb4fc0cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb4fb7fe640 1 -- 172.21.15.2:0/2018960396 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369532704 0 0) 0x7fb4e8003530 con 0x7fb4fc0cd5c0 2023-11-04T01:42:38.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.095+0000 7fb5016e1640 1 -- 172.21.15.2:0/2018960396 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0d07d0 con 0x7fb4fc15edb0 2023-11-04T01:42:38.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb5016e1640 1 --2- 172.21.15.2:0/2018960396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc15edb0 0x7fb4fc15f240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097f0 tx=0x7fb4f401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8c70dbf259f70d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb4fb7fe640 1 -- 172.21.15.2:0/2018960396 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec001a00 con 0x7fb4fc15edb0 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb4fb7fe640 1 -- 172.21.15.2:0/2018960396 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f40ad480 con 0x7fb4fc15edb0 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb4fb7fe640 1 -- 172.21.15.2:0/2018960396 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40ad7f0 con 0x7fb4fc15edb0 2023-11-04T01:42:38.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 -- 172.21.15.2:0/2018960396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc15edb0 msgr2=0x7fb4fc15f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 --2- 172.21.15.2:0/2018960396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc15edb0 0x7fb4fc15f240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40097f0 tx=0x7fb4f401c3a0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 -- 172.21.15.2:0/2018960396 shutdown_connections 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 --2- 172.21.15.2:0/2018960396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc15edb0 0x7fb4fc15f240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 -- 172.21.15.2:0/2018960396 >> 172.21.15.2:0/2018960396 conn(0x7fb4fc06dbb0 msgr2=0x7fb4fc06dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 -- 172.21.15.2:0/2018960396 shutdown_connections 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 -- 172.21.15.2:0/2018960396 wait complete. 2023-11-04T01:42:38.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 Processor -- start 2023-11-04T01:42:38.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.099+0000 7fb503144640 1 -- start start 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc0cd5c0 0x7fb4fc14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc15e4c0 0x7fb4fc0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4fc15edb0 0x7fb4fc14fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc14b770 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc14de60 con 0x7fb4fc15edb0 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0b3ad0 con 0x7fb4fc0cd5c0 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc15e4c0 0x7fb4fc0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc15e4c0 0x7fb4fc0b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50074/0 (socket says 172.21.15.2:50074) 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 -- 172.21.15.2:0/15851074 learned_addr learned my addr 172.21.15.2:0/15851074 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:38.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb500ee0640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc0cd5c0 0x7fb4fc14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb5016e1640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4fc15edb0 0x7fb4fc14fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 -- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc0cd5c0 msgr2=0x7fb4fc14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc0cd5c0 0x7fb4fc14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 -- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4fc15edb0 msgr2=0x7fb4fc14fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4fc15edb0 0x7fb4fc14fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 -- 172.21.15.2:0/15851074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f4009420 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb5016e1640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4fc15edb0 0x7fb4fc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4fbfff640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc15e4c0 0x7fb4fc0b4890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c500 tx=0x7fb4e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4f97fa640 1 -- 172.21.15.2:0/15851074 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4005220 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4f97fa640 1 -- 172.21.15.2:0/15851074 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4005380 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc0b3db0 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4f97fa640 1 -- 172.21.15.2:0/15851074 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4007270 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc0b4370 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc0b4560 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4f97fa640 1 -- 172.21.15.2:0/15851074 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb4e40073d0 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4f97fa640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4dc0664a0 0x7fb4dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb4f97fa640 1 -- 172.21.15.2:0/15851074 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e4083760 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.103+0000 7fb500ee0640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4dc0664a0 0x7fb4dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.107+0000 7fb500ee0640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4dc0664a0 0x7fb4dc068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0012f0 tx=0x7fb4ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.107+0000 7fb4f97fa640 1 -- 172.21.15.2:0/15851074 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4e4050bf0 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.259+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4fc0675f0 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.259+0000 7fb4f97fa640 1 -- 172.21.15.2:0/15851074 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4e4054210 con 0x7fb4fc15e4c0 2023-11-04T01:42:38.266 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:42:38.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4dc0664a0 msgr2=0x7fb4dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4dc0664a0 0x7fb4dc068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0012f0 tx=0x7fb4ec009040 comp rx=0 tx=0).stop 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc15e4c0 msgr2=0x7fb4fc0b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc15e4c0 0x7fb4fc0b4890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400c500 tx=0x7fb4e400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 shutdown_connections 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4dc0664a0 0x7fb4dc068960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4fc15edb0 0x7fb4fc14fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4fc15e4c0 0x7fb4fc0b4890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 --2- 172.21.15.2:0/15851074 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4fc0cd5c0 0x7fb4fc14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 >> 172.21.15.2:0/15851074 conn(0x7fb4fc06dbb0 msgr2=0x7fb4fc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 shutdown_connections 2023-11-04T01:42:38.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.263+0000 7fb503144640 1 -- 172.21.15.2:0/15851074 wait complete. 2023-11-04T01:42:38.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8342b78640 1 Processor -- start 2023-11-04T01:42:38.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8342b78640 1 -- start start 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8342b78640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f833c06cfc0 0x7f833c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8342b78640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c160c50 con 0x7f833c0cd670 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8342b78640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c160ef0 con 0x7f833c0cda50 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8342b78640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c1611d0 con 0x7f833c06cfc0 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8340914640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f833c0cd670 0x7f833c0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52146/0 (socket says 172.21.15.2:52146) 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f8340914640 1 -- 172.21.15.2:0/2711891570 learned_addr learned my addr 172.21.15.2:0/2711891570 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f833bfff640 1 --2- 172.21.15.2:0/2711891570 >> v2:172.21.15.2:3300/0 conn(0x7f833c06cfc0 0x7f833c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f833b7fe640 1 -- 172.21.15.2:0/2711891570 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605011473 0 0) 0x7f833c160c50 con 0x7f833c0cd670 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f833b7fe640 1 -- 172.21.15.2:0/2711891570 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8324003530 con 0x7f833c0cd670 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f833bfff640 1 -- 172.21.15.2:0/2711891570 >> v1:172.21.15.90:6789/0 conn(0x7f833c0cda50 legacy=0x7f833c0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f833bfff640 1 -- 172.21.15.2:0/2711891570 >> v1:172.21.15.2:6789/0 conn(0x7f833c0cd670 legacy=0x7f833c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.395+0000 7f833bfff640 1 -- 172.21.15.2:0/2711891570 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c1614b0 con 0x7f833c06cfc0 2023-11-04T01:42:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f833bfff640 1 --2- 172.21.15.2:0/2711891570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c15cb80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83300097c0 tx=0x7f833001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad3163f856ac046 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f833b7fe640 1 -- 172.21.15.2:0/2711891570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300ab650 con 0x7f833c06cfc0 2023-11-04T01:42:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f833b7fe640 1 -- 172.21.15.2:0/2711891570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83300ab7b0 con 0x7f833c06cfc0 2023-11-04T01:42:38.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f833b7fe640 1 -- 172.21.15.2:0/2711891570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300abb40 con 0x7f833c06cfc0 2023-11-04T01:42:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- 172.21.15.2:0/2711891570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 msgr2=0x7f833c15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 --2- 172.21.15.2:0/2711891570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c15cb80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f83300097c0 tx=0x7f833001c450 comp rx=0 tx=0).stop 2023-11-04T01:42:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- 172.21.15.2:0/2711891570 shutdown_connections 2023-11-04T01:42:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 --2- 172.21.15.2:0/2711891570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c15cb80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- 172.21.15.2:0/2711891570 >> 172.21.15.2:0/2711891570 conn(0x7f833c065dc0 msgr2=0x7f833c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- 172.21.15.2:0/2711891570 shutdown_connections 2023-11-04T01:42:38.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- 172.21.15.2:0/2711891570 wait complete. 2023-11-04T01:42:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 Processor -- start 2023-11-04T01:42:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- start start 2023-11-04T01:42:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c0ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f833c0cd670 0x7f833c14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f833c0cda50 0x7f833c14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1563d0 con 0x7f833c06cfc0 2023-11-04T01:42:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1557c0 con 0x7f833c0cda50 2023-11-04T01:42:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8342b78640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c155aa0 con 0x7f833c0cd670 2023-11-04T01:42:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8340914640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c0ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8340914640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c0ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50090/0 (socket says 172.21.15.2:50090) 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.399+0000 7f8340914640 1 -- 172.21.15.2:0/2817388202 learned_addr learned my addr 172.21.15.2:0/2817388202 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f833bfff640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f833c0cd670 0x7f833c14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8340914640 1 -- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f833c0cd670 msgr2=0x7f833c14fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8340914640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f833c0cd670 0x7f833c14fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8341115640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f833c0cda50 0x7f833c14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8340914640 1 -- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f833c0cda50 msgr2=0x7f833c14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8340914640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f833c0cda50 0x7f833c14dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8340914640 1 -- 172.21.15.2:0/2817388202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009420 con 0x7f833c06cfc0 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8340914640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c0ca480 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f832c001270 tx=0x7f832c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f83397fa640 1 -- 172.21.15.2:0/2817388202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c007270 con 0x7f833c06cfc0 2023-11-04T01:42:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f83397fa640 1 -- 172.21.15.2:0/2817388202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c0073d0 con 0x7f833c06cfc0 2023-11-04T01:42:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f83397fa640 1 -- 172.21.15.2:0/2817388202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00ce50 con 0x7f833c06cfc0 2023-11-04T01:42:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c155d80 con 0x7f833c06cfc0 2023-11-04T01:42:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c155400 con 0x7f833c06cfc0 2023-11-04T01:42:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c0675f0 con 0x7f833c06cfc0 2023-11-04T01:42:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f83397fa640 1 -- 172.21.15.2:0/2817388202 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f832c0057b0 con 0x7f833c06cfc0 2023-11-04T01:42:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f83397fa640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83280664a0 0x7f8328068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f83397fa640 1 -- 172.21.15.2:0/2817388202 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f832c0834d0 con 0x7f833c06cfc0 2023-11-04T01:42:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f833bfff640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83280664a0 0x7f8328068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.403+0000 7f833bfff640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83280664a0 0x7f8328068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83300af000 tx=0x7f8330008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.407+0000 7f83397fa640 1 -- 172.21.15.2:0/2817388202 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f832c0543e0 con 0x7f833c06cfc0 2023-11-04T01:42:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.555+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f833c0b6c60 con 0x7f833c06cfc0 2023-11-04T01:42:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f83397fa640 1 -- 172.21.15.2:0/2817388202 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f832c0170a0 con 0x7f833c06cfc0 2023-11-04T01:42:38.563 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:42:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83280664a0 msgr2=0x7f8328068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83280664a0 0x7f8328068960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83300af000 tx=0x7f8330008040 comp rx=0 tx=0).stop 2023-11-04T01:42:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 msgr2=0x7f833c0ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c0ca480 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f832c001270 tx=0x7f832c00cb10 comp rx=0 tx=0).stop 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 shutdown_connections 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83280664a0 0x7f8328068960 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f833c0cda50 0x7f833c14dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f833c0cd670 0x7f833c14fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 --2- 172.21.15.2:0/2817388202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f833c06cfc0 0x7f833c0ca480 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 >> 172.21.15.2:0/2817388202 conn(0x7f833c065dc0 msgr2=0x7f833c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 shutdown_connections 2023-11-04T01:42:38.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.559+0000 7f8342b78640 1 -- 172.21.15.2:0/2817388202 wait complete. 2023-11-04T01:42:38.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 Processor -- start 2023-11-04T01:42:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 -- start start 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d0c15d2b0 0x7f5d0c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d0c15d690 0x7f5d0c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c0ad450 con 0x7f5d0c15d690 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c0cd160 con 0x7f5d0c15d2b0 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d12fbe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0cd400 con 0x7f5d0c06f8f0 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d0c15d690 0x7f5d0c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d0c15d690 0x7f5d0c0ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50096/0 (socket says 172.21.15.2:50096) 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 -- 172.21.15.2:0/4064338097 learned_addr learned my addr 172.21.15.2:0/4064338097 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d10d5a640 1 --2- 172.21.15.2:0/4064338097 >> v2:172.21.15.90:3300/0 conn(0x7f5d0c15d2b0 0x7f5d0c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d1155b640 1 --2- 172.21.15.2:0/4064338097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 -- 172.21.15.2:0/4064338097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 msgr2=0x7f5d0c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 --2- 172.21.15.2:0/4064338097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 -- 172.21.15.2:0/4064338097 >> v2:172.21.15.90:3300/0 conn(0x7f5d0c15d2b0 msgr2=0x7f5d0c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 --2- 172.21.15.2:0/4064338097 >> v2:172.21.15.90:3300/0 conn(0x7f5d0c15d2b0 0x7f5d0c06c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.691+0000 7f5d0bfff640 1 -- 172.21.15.2:0/4064338097 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c0cd6e0 con 0x7f5d0c15d690 2023-11-04T01:42:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d0bfff640 1 --2- 172.21.15.2:0/4064338097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c0ccc20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0b16f0 tx=0x7f5cfc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e522c6ab07cad38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d0b7fe640 1 -- 172.21.15.2:0/4064338097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0a56a0 con 0x7f5d0c15d690 2023-11-04T01:42:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d0b7fe640 1 -- 172.21.15.2:0/4064338097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc0a5800 con 0x7f5d0c15d690 2023-11-04T01:42:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d0b7fe640 1 -- 172.21.15.2:0/4064338097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0a5b90 con 0x7f5d0c15d690 2023-11-04T01:42:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- 172.21.15.2:0/4064338097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 msgr2=0x7f5d0c0ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/4064338097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c0ccc20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0b16f0 tx=0x7f5cfc01c910 comp rx=0 tx=0).stop 2023-11-04T01:42:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- 172.21.15.2:0/4064338097 shutdown_connections 2023-11-04T01:42:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/4064338097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/4064338097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c0ccc20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/4064338097 >> v2:172.21.15.90:3300/0 conn(0x7f5d0c15d2b0 0x7f5d0c06c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- 172.21.15.2:0/4064338097 >> 172.21.15.2:0/4064338097 conn(0x7f5d0c0cebb0 msgr2=0x7f5d0c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- 172.21.15.2:0/4064338097 shutdown_connections 2023-11-04T01:42:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- 172.21.15.2:0/4064338097 wait complete. 2023-11-04T01:42:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 Processor -- start 2023-11-04T01:42:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- start start 2023-11-04T01:42:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d0c15d2b0 0x7f5d0c0cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c156000 con 0x7f5d0c15d690 2023-11-04T01:42:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0c2b70 con 0x7f5d0c15d2b0 2023-11-04T01:42:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d12fbe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0c28a0 con 0x7f5d0c06f8f0 2023-11-04T01:42:38.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50104/0 (socket says 172.21.15.2:50104) 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 -- 172.21.15.2:0/533414830 learned_addr learned my addr 172.21.15.2:0/533414830 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d0bfff640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d0c15d2b0 0x7f5d0c0cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d10d5a640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 -- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 msgr2=0x7f5d0c0c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 -- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d0c15d2b0 msgr2=0x7f5d0c0cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d0c15d2b0 0x7f5d0c0cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 -- 172.21.15.2:0/533414830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc009b30 con 0x7f5d0c15d690 2023-11-04T01:42:38.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.695+0000 7f5d1155b640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c141d70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400d830 tx=0x7f5cf400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d097fa640 1 -- 172.21.15.2:0/533414830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40096c0 con 0x7f5d0c15d690 2023-11-04T01:42:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d097fa640 1 -- 172.21.15.2:0/533414830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf4009820 con 0x7f5d0c15d690 2023-11-04T01:42:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c1549a0 con 0x7f5d0c15d690 2023-11-04T01:42:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d097fa640 1 -- 172.21.15.2:0/533414830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4009bd0 con 0x7f5d0c15d690 2023-11-04T01:42:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c154f60 con 0x7f5d0c15d690 2023-11-04T01:42:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c1561b0 con 0x7f5d0c15d690 2023-11-04T01:42:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d097fa640 1 -- 172.21.15.2:0/533414830 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5cf4009d30 con 0x7f5d0c15d690 2023-11-04T01:42:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d097fa640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5cec0664a0 0x7f5cec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:38.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d097fa640 1 -- 172.21.15.2:0/533414830 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cf40844e0 con 0x7f5d0c15d690 2023-11-04T01:42:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d10d5a640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5cec0664a0 0x7f5cec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:38.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.699+0000 7f5d10d5a640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5cec0664a0 0x7f5cec068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400b9d0 tx=0x7f5d04008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:38.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.703+0000 7f5d097fa640 1 -- 172.21.15.2:0/533414830 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5d0c1561b0 con 0x7f5d0c15d690 2023-11-04T01:42:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d0c1561b0 con 0x7f5d0c15d690 2023-11-04T01:42:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d097fa640 1 -- 172.21.15.2:0/533414830 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f5d0c1561b0 con 0x7f5d0c15d690 2023-11-04T01:42:38.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:38.896 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:42:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5cec0664a0 msgr2=0x7f5cec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5cec0664a0 0x7f5cec068960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400b9d0 tx=0x7f5d04008040 comp rx=0 tx=0).stop 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 msgr2=0x7f5d0c141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c141d70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400d830 tx=0x7f5cf400dcf0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 shutdown_connections 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5cec0664a0 0x7f5cec068960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d0c15d690 0x7f5d0c141d70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d0c15d2b0 0x7f5d0c0cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 --2- 172.21.15.2:0/533414830 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d0c06f8f0 0x7f5d0c0c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 >> 172.21.15.2:0/533414830 conn(0x7f5d0c0cebb0 msgr2=0x7f5d0c070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 shutdown_connections 2023-11-04T01:42:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:38.891+0000 7f5d12fbe640 1 -- 172.21.15.2:0/533414830 wait complete. 2023-11-04T01:42:38.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.027+0000 7f1b26e6f640 1 Processor -- start 2023-11-04T01:42:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.027+0000 7f1b26e6f640 1 -- start start 2023-11-04T01:42:39.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b26e6f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 0x7f1b200704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b26e6f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200ccee0 con 0x7f1b200cdea0 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b26e6f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2015a5d0 con 0x7f1b2015a1f0 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b26e6f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200ca900 con 0x7f1b200b0d40 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1b200cdea0 0x7f1b200b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52162/0 (socket says 172.21.15.2:52162) 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1ffff640 1 -- 172.21.15.2:0/2673749255 learned_addr learned my addr 172.21.15.2:0/2673749255 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b2540c640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 0x7f1b200704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882028147 0 0) 0x7f1b200ccee0 con 0x7f1b200cdea0 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b10003530 con 0x7f1b200cdea0 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317561883 0 0) 0x7f1b10003530 con 0x7f1b200cdea0 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 msgr2=0x7f1b200704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 0x7f1b200704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 >> v1:172.21.15.90:6789/0 conn(0x7f1b2015a1f0 legacy=0x7f1b200cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200cabe0 con 0x7f1b200cdea0 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f1b0c001680 con 0x7f1b200cdea0 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 >> v1:172.21.15.2:6789/0 conn(0x7f1b200cdea0 legacy=0x7f1b200b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b100039b0 0x7f1b10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100047d0 0x7f1b10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 0x7f1b10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200ca900 con 0x7f1b100039b0 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1000ba70 con 0x7f1b100047d0 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1000de40 con 0x7f1b200b0d40 2023-11-04T01:42:39.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b24c0b640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b100039b0 0x7f1b10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100047d0 0x7f1b10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b2540c640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 0x7f1b10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b24c0b640 1 -- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 msgr2=0x7f1b10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b24c0b640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b0d40 0x7f1b10005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b24c0b640 1 -- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100047d0 msgr2=0x7f1b10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b24c0b640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100047d0 0x7f1b10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.031+0000 7f1b24c0b640 1 -- 172.21.15.2:0/2673749255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10003530 con 0x7f1b100039b0 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b24c0b640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b100039b0 0x7f1b10003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b14001780 tx=0x7f1b1401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373d8948750a846b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b140a4ea0 con 0x7f1b100039b0 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b140a7050 con 0x7f1b100039b0 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1f7fe640 1 -- 172.21.15.2:0/2673749255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14003600 con 0x7f1b100039b0 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2673749255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b100039b0 msgr2=0x7f1b10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 --2- 172.21.15.2:0/2673749255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b100039b0 0x7f1b10003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1b14001780 tx=0x7f1b1401c400 comp rx=0 tx=0).stop 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b2540c640 1 -- 172.21.15.2:0/2673749255 reap_dead start 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2673749255 shutdown_connections 2023-11-04T01:42:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2673749255 >> 172.21.15.2:0/2673749255 conn(0x7f1b200cebb0 msgr2=0x7f1b200cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2673749255 shutdown_connections 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2673749255 wait complete. 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 Processor -- start 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- start start 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100039b0 0x7f1b200c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b200c5bf0 0x7f1b201554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b1db0 0x7f1b200b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200b2770 con 0x7f1b200c5bf0 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c6160 con 0x7f1b100039b0 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c6440 con 0x7f1b200b1db0 2023-11-04T01:42:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b200c5bf0 0x7f1b201554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b200c5bf0 0x7f1b201554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50120/0 (socket says 172.21.15.2:50120) 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 -- 172.21.15.2:0/2107425589 learned_addr learned my addr 172.21.15.2:0/2107425589 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b24c0b640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100039b0 0x7f1b200c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b2540c640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b1db0 0x7f1b200b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 -- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b1db0 msgr2=0x7f1b200b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b1db0 0x7f1b200b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 -- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100039b0 msgr2=0x7f1b200c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100039b0 0x7f1b200c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 -- 172.21.15.2:0/2107425589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200c6720 con 0x7f1b200c5bf0 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1ffff640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b200c5bf0 0x7f1b201554e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00e780 tx=0x7f1b0c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1d7fa640 1 -- 172.21.15.2:0/2107425589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00c640 con 0x7f1b200c5bf0 2023-11-04T01:42:39.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1d7fa640 1 -- 172.21.15.2:0/2107425589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c00c7c0 con 0x7f1b200c5bf0 2023-11-04T01:42:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200c6a00 con 0x7f1b200c5bf0 2023-11-04T01:42:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b1d7fa640 1 -- 172.21.15.2:0/2107425589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00cb70 con 0x7f1b200c5bf0 2023-11-04T01:42:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.035+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200c7850 con 0x7f1b200c5bf0 2023-11-04T01:42:39.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.039+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b200744a0 con 0x7f1b200c5bf0 2023-11-04T01:42:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.039+0000 7f1b1d7fa640 1 -- 172.21.15.2:0/2107425589 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b0c00ccd0 con 0x7f1b200c5bf0 2023-11-04T01:42:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.039+0000 7f1b1d7fa640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b040664d0 0x7f1b04068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.039+0000 7f1b1d7fa640 1 -- 172.21.15.2:0/2107425589 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b0c083d00 con 0x7f1b200c5bf0 2023-11-04T01:42:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.039+0000 7f1b24c0b640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b040664d0 0x7f1b04068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.039+0000 7f1b24c0b640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b040664d0 0x7f1b04068990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b14001750 tx=0x7f1b140011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.043+0000 7f1b1d7fa640 1 -- 172.21.15.2:0/2107425589 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b0c0510e0 con 0x7f1b200c5bf0 2023-11-04T01:42:39.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.191+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b200744a0 con 0x7f1b200c5bf0 2023-11-04T01:42:39.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.195+0000 7f1b1d7fa640 1 -- 172.21.15.2:0/2107425589 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f1b0c054700 con 0x7f1b200c5bf0 2023-11-04T01:42:39.200 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.195+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b040664d0 msgr2=0x7f1b04068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.195+0000 7f1b26e6f640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b040664d0 0x7f1b04068990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b14001750 tx=0x7f1b140011a0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.195+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b200c5bf0 msgr2=0x7f1b201554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.195+0000 7f1b26e6f640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b200c5bf0 0x7f1b201554e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00e780 tx=0x7f1b0c00ec40 comp rx=0 tx=0).stop 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 shutdown_connections 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b040664d0 0x7f1b04068990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b200b1db0 0x7f1b200b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b200c5bf0 0x7f1b201554e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 --2- 172.21.15.2:0/2107425589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b100039b0 0x7f1b200c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 >> 172.21.15.2:0/2107425589 conn(0x7f1b200cebb0 msgr2=0x7f1b20159390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 shutdown_connections 2023-11-04T01:42:39.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.199+0000 7f1b26e6f640 1 -- 172.21.15.2:0/2107425589 wait complete. 2023-11-04T01:42:39.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:39.218 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e8738640 1 Processor -- start 2023-11-04T01:42:39.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e8738640 1 -- start start 2023-11-04T01:42:39.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e8738640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12e015acb0 0x7f12e015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e8738640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00cb130 con 0x7f12e015c160 2023-11-04T01:42:39.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e8738640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e015b680 con 0x7f12e00b0c20 2023-11-04T01:42:39.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e8738640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e015bd40 con 0x7f12e015acb0 2023-11-04T01:42:39.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e64d4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f12e015acb0 0x7f12e015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e5cd3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f12e015c160 0x7f12e00b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52164/0 (socket says 172.21.15.2:52164) 2023-11-04T01:42:39.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e5cd3640 1 -- 172.21.15.2:0/3089173653 learned_addr learned my addr 172.21.15.2:0/3089173653 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:39.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e64d4640 1 -- 172.21.15.2:0/3089173653 >> v1:172.21.15.90:6789/0 conn(0x7f12e00b0c20 legacy=0x7f12e00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e64d4640 1 -- 172.21.15.2:0/3089173653 >> v1:172.21.15.2:6789/0 conn(0x7f12e015c160 legacy=0x7f12e00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e64d4640 1 -- 172.21.15.2:0/3089173653 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e015b960 con 0x7f12e015acb0 2023-11-04T01:42:39.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.339+0000 7f12e54d2640 1 -- 172.21.15.2:0/3089173653 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815259525 0 0) 0x7f12e00cb130 con 0x7f12e015c160 2023-11-04T01:42:39.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e64d4640 1 --2- 172.21.15.2:0/3089173653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015acb0 0x7f12e015b090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097f0 tx=0x7f12dc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ec6b292f2e984f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e54d2640 1 -- 172.21.15.2:0/3089173653 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc004230 con 0x7f12e015acb0 2023-11-04T01:42:39.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e54d2640 1 -- 172.21.15.2:0/3089173653 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc0a7050 con 0x7f12e015acb0 2023-11-04T01:42:39.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e54d2640 1 -- 172.21.15.2:0/3089173653 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc003620 con 0x7f12e015acb0 2023-11-04T01:42:39.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- 172.21.15.2:0/3089173653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015acb0 msgr2=0x7f12e015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 --2- 172.21.15.2:0/3089173653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015acb0 0x7f12e015b090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0097f0 tx=0x7f12dc01c440 comp rx=0 tx=0).stop 2023-11-04T01:42:39.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- 172.21.15.2:0/3089173653 shutdown_connections 2023-11-04T01:42:39.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 --2- 172.21.15.2:0/3089173653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015acb0 0x7f12e015b090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- 172.21.15.2:0/3089173653 >> 172.21.15.2:0/3089173653 conn(0x7f12e00cb510 msgr2=0x7f12e00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- 172.21.15.2:0/3089173653 shutdown_connections 2023-11-04T01:42:39.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- 172.21.15.2:0/3089173653 wait complete. 2023-11-04T01:42:39.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 Processor -- start 2023-11-04T01:42:39.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- start start 2023-11-04T01:42:39.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f12e00b0c20 0x7f12e0150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e015acb0 0x7f12e00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015c160 0x7f12e00ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e01526d0 con 0x7f12e015c160 2023-11-04T01:42:39.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0152f30 con 0x7f12e015acb0 2023-11-04T01:42:39.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e8738640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e01544b0 con 0x7f12e00b0c20 2023-11-04T01:42:39.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015c160 0x7f12e00ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015c160 0x7f12e00ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50136/0 (socket says 172.21.15.2:50136) 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 -- 172.21.15.2:0/571012466 learned_addr learned my addr 172.21.15.2:0/571012466 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e5cd3640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e015acb0 0x7f12e00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e64d4640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f12e00b0c20 0x7f12e0150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 -- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f12e00b0c20 msgr2=0x7f12e0150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f12e00b0c20 0x7f12e0150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 -- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e015acb0 msgr2=0x7f12e00ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e015acb0 0x7f12e00ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 -- 172.21.15.2:0/571012466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009420 con 0x7f12e015c160 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.343+0000 7f12e6cd5640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015c160 0x7f12e00ace00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12d800be60 tx=0x7f12d800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12d6ffd640 1 -- 172.21.15.2:0/571012466 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8014440 con 0x7f12e015c160 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12d6ffd640 1 -- 172.21.15.2:0/571012466 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d80145a0 con 0x7f12e015c160 2023-11-04T01:42:39.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12d6ffd640 1 -- 172.21.15.2:0/571012466 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8014990 con 0x7f12e015c160 2023-11-04T01:42:39.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12e8738640 1 -- 172.21.15.2:0/571012466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e01528e0 con 0x7f12e015c160 2023-11-04T01:42:39.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12e8738640 1 -- 172.21.15.2:0/571012466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e01533c0 con 0x7f12e015c160 2023-11-04T01:42:39.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc005260 con 0x7f12e015c160 2023-11-04T01:42:39.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12d6ffd640 1 -- 172.21.15.2:0/571012466 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f12d801d3b0 con 0x7f12e015c160 2023-11-04T01:42:39.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12d6ffd640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12c40664a0 0x7f12c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12d6ffd640 1 -- 172.21.15.2:0/571012466 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12d8083f20 con 0x7f12e015c160 2023-11-04T01:42:39.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12e64d4640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12c40664a0 0x7f12c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.347+0000 7f12e64d4640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12c40664a0 0x7f12c4068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ad000 tx=0x7f12dc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.351+0000 7f12d6ffd640 1 -- 172.21.15.2:0/571012466 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12d8051430 con 0x7f12e015c160 2023-11-04T01:42:39.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.515+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12bc005a90 con 0x7f12e015c160 2023-11-04T01:42:39.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.515+0000 7f12d6ffd640 1 -- 172.21.15.2:0/571012466 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12d8054a50 con 0x7f12e015c160 2023-11-04T01:42:39.523 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12c40664a0 msgr2=0x7f12c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12c40664a0 0x7f12c4068960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0ad000 tx=0x7f12dc008040 comp rx=0 tx=0).stop 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015c160 msgr2=0x7f12e00ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015c160 0x7f12e00ace00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f12d800be60 tx=0x7f12d800bf50 comp rx=0 tx=0).stop 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 shutdown_connections 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12c40664a0 0x7f12c4068960 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f12e015c160 0x7f12e00ace00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f12e015acb0 0x7f12e00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 --2- 172.21.15.2:0/571012466 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f12e00b0c20 0x7f12e0150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 >> 172.21.15.2:0/571012466 conn(0x7f12e00cb510 msgr2=0x7f12e00ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 shutdown_connections 2023-11-04T01:42:39.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.519+0000 7f12d4ff9640 1 -- 172.21.15.2:0/571012466 wait complete. 2023-11-04T01:42:39.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.643+0000 7f08b355f640 1 Processor -- start 2023-11-04T01:42:39.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b355f640 1 -- start start 2023-11-04T01:42:39.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b355f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 0x7f08ac15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b355f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac0cb130 con 0x7f08ac15acb0 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b355f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac15b680 con 0x7f08ac15c160 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b355f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac15bd40 con 0x7f08ac0b0c20 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b12fb640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f08ac15acb0 0x7f08ac0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52178/0 (socket says 172.21.15.2:52178) 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b12fb640 1 -- 172.21.15.2:0/2869264275 learned_addr learned my addr 172.21.15.2:0/2869264275 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464022558 0 0) 0x7f08ac0cb130 con 0x7f08ac15acb0 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0898003530 con 0x7f08ac15acb0 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b0afa640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 0x7f08ac15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1517049329 0 0) 0x7f0898003530 con 0x7f08ac15acb0 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 msgr2=0x7f08ac15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 0x7f08ac15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 >> v1:172.21.15.90:6789/0 conn(0x7f08ac15c160 legacy=0x7f08ac0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac15b960 con 0x7f08ac15acb0 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b0afa640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 0x7f08ac15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f089c001680 con 0x7f08ac15acb0 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 >> v1:172.21.15.2:6789/0 conn(0x7f08ac15acb0 legacy=0x7f08ac0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08980039b0 0x7f0898003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 0x7f08980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0898004d10 0x7f0898005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac15bd40 con 0x7f0898004d10 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089800baa0 con 0x7f08980039b0 2023-11-04T01:42:39.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089800bc60 con 0x7f08ac0b0c20 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b1afc640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0898004d10 0x7f0898005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b12fb640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08980039b0 0x7f0898003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b0afa640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 0x7f08980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b1afc640 1 -- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 msgr2=0x7f08980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b1afc640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08ac0b0c20 0x7f08980047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b1afc640 1 -- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08980039b0 msgr2=0x7f0898003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b1afc640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08980039b0 0x7f0898003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b1afc640 1 -- 172.21.15.2:0/2869264275 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0898003530 con 0x7f0898004d10 2023-11-04T01:42:39.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.647+0000 7f08b12fb640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08980039b0 0x7f0898003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b1afc640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0898004d10 0x7f0898005190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f08a4001e40 tx=0x7f08a401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c88984b658e085 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4003b80 con 0x7f0898004d10 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4003ce0 con 0x7f0898004d10 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08a3fff640 1 -- 172.21.15.2:0/2869264275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40052c0 con 0x7f0898004d10 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- 172.21.15.2:0/2869264275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0898004d10 msgr2=0x7f0898005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 --2- 172.21.15.2:0/2869264275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0898004d10 0x7f0898005190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f08a4001e40 tx=0x7f08a401c740 comp rx=0 tx=0).stop 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b1afc640 1 -- 172.21.15.2:0/2869264275 reap_dead start 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- 172.21.15.2:0/2869264275 shutdown_connections 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- 172.21.15.2:0/2869264275 >> 172.21.15.2:0/2869264275 conn(0x7f08ac0cb510 msgr2=0x7f08ac0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- 172.21.15.2:0/2869264275 shutdown_connections 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- 172.21.15.2:0/2869264275 wait complete. 2023-11-04T01:42:39.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 Processor -- start 2023-11-04T01:42:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- start start 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0898004d10 0x7f08ac1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08ac0a84b0 0x7f08ac0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac0c7b20 0x7f08ac15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0abb80 con 0x7f08ac0a84b0 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac159920 con 0x7f08ac0c7b20 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac0c8380 con 0x7f0898004d10 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08ac0a84b0 0x7f08ac0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08ac0a84b0 0x7f08ac0c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50148/0 (socket says 172.21.15.2:50148) 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 -- 172.21.15.2:0/3141473901 learned_addr learned my addr 172.21.15.2:0/3141473901 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 -- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0898004d10 msgr2=0x7f08ac1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0898004d10 0x7f08ac1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 -- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac0c7b20 msgr2=0x7f08ac15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac0c7b20 0x7f08ac15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 -- 172.21.15.2:0/3141473901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac0c8660 con 0x7f08ac0a84b0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b0afa640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08ac0a84b0 0x7f08ac0c75e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f08a800f4e0 tx=0x7f08a800f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08a1ffb640 1 -- 172.21.15.2:0/3141473901 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8014890 con 0x7f08ac0a84b0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08a1ffb640 1 -- 172.21.15.2:0/3141473901 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800c030 con 0x7f08ac0a84b0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac0c8940 con 0x7f08ac0a84b0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08a1ffb640 1 -- 172.21.15.2:0/3141473901 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8014c30 con 0x7f08ac0a84b0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.651+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac0ab750 con 0x7f08ac0a84b0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.655+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac0744a0 con 0x7f08ac0a84b0 2023-11-04T01:42:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.655+0000 7f08a1ffb640 1 -- 172.21.15.2:0/3141473901 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08a80133e0 con 0x7f08ac0a84b0 2023-11-04T01:42:39.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.655+0000 7f08a1ffb640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08900664a0 0x7f0890068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.655+0000 7f08a1ffb640 1 -- 172.21.15.2:0/3141473901 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08a8084100 con 0x7f08ac0a84b0 2023-11-04T01:42:39.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.655+0000 7f08b12fb640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08900664a0 0x7f0890068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.655+0000 7f08b12fb640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08900664a0 0x7f0890068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f089c000c10 tx=0x7f089c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.659+0000 7f08a1ffb640 1 -- 172.21.15.2:0/3141473901 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08a8051570 con 0x7f08ac0a84b0 2023-11-04T01:42:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.815+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08ac0cde30 con 0x7f08ac0a84b0 2023-11-04T01:42:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.815+0000 7f08a1ffb640 1 -- 172.21.15.2:0/3141473901 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08a8054b90 con 0x7f08ac0a84b0 2023-11-04T01:42:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:42:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08900664a0 msgr2=0x7f0890068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08900664a0 0x7f0890068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f089c000c10 tx=0x7f089c009040 comp rx=0 tx=0).stop 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08ac0a84b0 msgr2=0x7f08ac0c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08ac0a84b0 0x7f08ac0c75e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f08a800f4e0 tx=0x7f08a800f9a0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 shutdown_connections 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08900664a0 0x7f0890068960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08ac0c7b20 0x7f08ac15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08ac0a84b0 0x7f08ac0c75e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 --2- 172.21.15.2:0/3141473901 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0898004d10 0x7f08ac1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 >> 172.21.15.2:0/3141473901 conn(0x7f08ac0cb510 msgr2=0x7f08ac15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 shutdown_connections 2023-11-04T01:42:39.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.819+0000 7f08b355f640 1 -- 172.21.15.2:0/3141473901 wait complete. 2023-11-04T01:42:39.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.963+0000 7efcb865a640 1 Processor -- start 2023-11-04T01:42:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb865a640 1 -- start start 2023-11-04T01:42:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb865a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efcb006d160 0x7efcb015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb865a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb006c0c0 con 0x7efcb015af70 2023-11-04T01:42:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb865a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb006c3a0 con 0x7efcb00ce1b0 2023-11-04T01:42:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb865a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb0071200 con 0x7efcb006d160 2023-11-04T01:42:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb6bf7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efcb006d160 0x7efcb015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb63f6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efcb015af70 0x7efcb00cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52192/0 (socket says 172.21.15.2:52192) 2023-11-04T01:42:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb63f6640 1 -- 172.21.15.2:0/2933091705 learned_addr learned my addr 172.21.15.2:0/2933091705 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb6bf7640 1 -- 172.21.15.2:0/2933091705 >> v1:172.21.15.90:6789/0 conn(0x7efcb00ce1b0 legacy=0x7efcb015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb6bf7640 1 -- 172.21.15.2:0/2933091705 >> v1:172.21.15.2:6789/0 conn(0x7efcb015af70 legacy=0x7efcb00cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb53f4640 1 -- 172.21.15.2:0/2933091705 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529772885 0 0) 0x7efcb006c0c0 con 0x7efcb015af70 2023-11-04T01:42:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.967+0000 7efcb6bf7640 1 -- 172.21.15.2:0/2933091705 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb006c680 con 0x7efcb006d160 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb6bf7640 1 --2- 172.21.15.2:0/2933091705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb006d160 0x7efcb015e490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efca80097c0 tx=0x7efca801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af49a006582e565f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb53f4640 1 -- 172.21.15.2:0/2933091705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80ab600 con 0x7efcb006d160 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb53f4640 1 -- 172.21.15.2:0/2933091705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca80a7050 con 0x7efcb006d160 2023-11-04T01:42:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb53f4640 1 -- 172.21.15.2:0/2933091705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80ab980 con 0x7efcb006d160 2023-11-04T01:42:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- 172.21.15.2:0/2933091705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb006d160 msgr2=0x7efcb015e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 --2- 172.21.15.2:0/2933091705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb006d160 0x7efcb015e490 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efca80097c0 tx=0x7efca801c480 comp rx=0 tx=0).stop 2023-11-04T01:42:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- 172.21.15.2:0/2933091705 shutdown_connections 2023-11-04T01:42:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 --2- 172.21.15.2:0/2933091705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb006d160 0x7efcb015e490 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- 172.21.15.2:0/2933091705 >> 172.21.15.2:0/2933091705 conn(0x7efcb00cb510 msgr2=0x7efcb00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- 172.21.15.2:0/2933091705 shutdown_connections 2023-11-04T01:42:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- 172.21.15.2:0/2933091705 wait complete. 2023-11-04T01:42:39.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 Processor -- start 2023-11-04T01:42:39.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- start start 2023-11-04T01:42:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcb006d160 0x7efcb00c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb00ce1b0 0x7efcb00b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcb015af70 0x7efcb0148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00c78f0 con 0x7efcb00ce1b0 2023-11-04T01:42:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00c7bd0 con 0x7efcb006d160 2023-11-04T01:42:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.971+0000 7efcb865a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00c7eb0 con 0x7efcb015af70 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb00ce1b0 0x7efcb00b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb00ce1b0 0x7efcb00b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50168/0 (socket says 172.21.15.2:50168) 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 -- 172.21.15.2:0/2637219731 learned_addr learned my addr 172.21.15.2:0/2637219731 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb63f6640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcb006d160 0x7efcb00c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb6bf7640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcb015af70 0x7efcb0148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 -- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcb015af70 msgr2=0x7efcb0148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcb015af70 0x7efcb0148a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 -- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcb006d160 msgr2=0x7efcb00c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcb006d160 0x7efcb00c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 -- 172.21.15.2:0/2637219731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8009420 con 0x7efcb00ce1b0 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb63f6640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcb006d160 0x7efcb00c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb6bf7640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcb015af70 0x7efcb0148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb5bf5640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb00ce1b0 0x7efcb00b05f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efca000c500 tx=0x7efca000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efca6ffd640 1 -- 172.21.15.2:0/2637219731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005220 con 0x7efcb00ce1b0 2023-11-04T01:42:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efca6ffd640 1 -- 172.21.15.2:0/2637219731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0005380 con 0x7efcb00ce1b0 2023-11-04T01:42:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efca6ffd640 1 -- 172.21.15.2:0/2637219731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0007270 con 0x7efcb00ce1b0 2023-11-04T01:42:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb00c8190 con 0x7efcb00ce1b0 2023-11-04T01:42:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb00b0b30 con 0x7efcb00ce1b0 2023-11-04T01:42:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb00ad6f0 con 0x7efcb00ce1b0 2023-11-04T01:42:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efca6ffd640 1 -- 172.21.15.2:0/2637219731 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efca00073d0 con 0x7efcb00ce1b0 2023-11-04T01:42:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efca6ffd640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc940664a0 0x7efc94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efca6ffd640 1 -- 172.21.15.2:0/2637219731 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efca0083a00 con 0x7efcb00ce1b0 2023-11-04T01:42:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.975+0000 7efcb63f6640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc940664a0 0x7efc94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.979+0000 7efcb63f6640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc940664a0 0x7efc94068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcac0012f0 tx=0x7efcac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:39.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:39.979+0000 7efca6ffd640 1 -- 172.21.15.2:0/2637219731 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efca0050f10 con 0x7efcb00ce1b0 2023-11-04T01:42:40.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcb00cdfe0 con 0x7efcb00ce1b0 2023-11-04T01:42:40.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efca6ffd640 1 -- 172.21.15.2:0/2637219731 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7efca00210a0 con 0x7efcb00ce1b0 2023-11-04T01:42:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc940664a0 msgr2=0x7efc94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc940664a0 0x7efc94068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcac0012f0 tx=0x7efcac009040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb00ce1b0 msgr2=0x7efcb00b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb00ce1b0 0x7efcb00b05f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efca000c500 tx=0x7efca000c9c0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 shutdown_connections 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc940664a0 0x7efc94068960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efcb015af70 0x7efcb0148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcb00ce1b0 0x7efcb00b05f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 --2- 172.21.15.2:0/2637219731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcb006d160 0x7efcb00c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 >> 172.21.15.2:0/2637219731 conn(0x7efcb00cb510 msgr2=0x7efcb00cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 shutdown_connections 2023-11-04T01:42:40.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.131+0000 7efcb865a640 1 -- 172.21.15.2:0/2637219731 wait complete. 2023-11-04T01:42:40.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:40.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba8889640 1 Processor -- start 2023-11-04T01:42:40.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba8889640 1 -- start start 2023-11-04T01:42:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba8889640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba40b4990 0x7f9ba40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba8889640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40b6070 con 0x7f9ba40b74f0 2023-11-04T01:42:40.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba8889640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40b8ed0 con 0x7f9ba40d0690 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba8889640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40ce590 con 0x7f9ba40b4990 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba2d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9ba40b74f0 0x7f9ba40cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52204/0 (socket says 172.21.15.2:52204) 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba2d9d640 1 -- 172.21.15.2:0/3411191120 learned_addr learned my addr 172.21.15.2:0/3411191120 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755733478 0 0) 0x7f9ba40b6070 con 0x7f9ba40b74f0 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba259c640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba40b4990 0x7f9ba40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b8c003530 con 0x7f9ba40b74f0 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426598053 0 0) 0x7f9b8c003530 con 0x7f9ba40b74f0 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba40b4990 msgr2=0x7f9ba40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba40b4990 0x7f9ba40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 >> v1:172.21.15.90:6789/0 conn(0x7f9ba40d0690 legacy=0x7f9ba40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40b52b0 con 0x7f9ba40b74f0 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f9b9c001a00 con 0x7f9ba40b74f0 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 >> v1:172.21.15.2:6789/0 conn(0x7f9ba40b74f0 legacy=0x7f9ba40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8c0039b0 0x7f9b8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b8c0047d0 0x7f9b8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c005190 0x7f9b8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40ce590 con 0x7f9b8c0047d0 2023-11-04T01:42:40.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c00c040 con 0x7f9b8c0039b0 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c00c200 con 0x7f9b8c005190 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba259c640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9ba40b4990 0x7f9ba40b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba1d9b640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b8c0047d0 0x7f9b8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba2d9d640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c005190 0x7f9b8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba1d9b640 1 -- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c005190 msgr2=0x7f9b8c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba1d9b640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c005190 0x7f9b8c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba1d9b640 1 -- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8c0039b0 msgr2=0x7f9b8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba1d9b640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8c0039b0 0x7f9b8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.275+0000 7f9ba1d9b640 1 -- 172.21.15.2:0/3411191120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c003530 con 0x7f9b8c0047d0 2023-11-04T01:42:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba1d9b640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b8c0047d0 0x7f9b8c004c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9b98001750 tx=0x7f9b9801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6055713211a0f983 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b980052d0 con 0x7f9b8c0047d0 2023-11-04T01:42:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b980a7050 con 0x7f9b8c0047d0 2023-11-04T01:42:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba159a640 1 -- 172.21.15.2:0/3411191120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98003600 con 0x7f9b8c0047d0 2023-11-04T01:42:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- 172.21.15.2:0/3411191120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b8c0047d0 msgr2=0x7f9b8c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 --2- 172.21.15.2:0/3411191120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b8c0047d0 0x7f9b8c004c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9b98001750 tx=0x7f9b9801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba2d9d640 1 -- 172.21.15.2:0/3411191120 reap_dead start 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- 172.21.15.2:0/3411191120 shutdown_connections 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- 172.21.15.2:0/3411191120 >> 172.21.15.2:0/3411191120 conn(0x7f9ba40cf990 msgr2=0x7f9ba40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- 172.21.15.2:0/3411191120 shutdown_connections 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- 172.21.15.2:0/3411191120 wait complete. 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 Processor -- start 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- start start 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c0047d0 0x7f9ba41525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba41530a0 0x7f9ba41f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba41f30a0 0x7f9ba41f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba41f3520 con 0x7f9ba41f30a0 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4155980 con 0x7f9ba41530a0 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba8889640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4155c60 con 0x7f9b8c0047d0 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba41f30a0 0x7f9ba41f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba41f30a0 0x7f9ba41f6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50192/0 (socket says 172.21.15.2:50192) 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.279+0000 7f9ba2d9d640 1 -- 172.21.15.2:0/1638109811 learned_addr learned my addr 172.21.15.2:0/1638109811 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba1d9b640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba41530a0 0x7f9ba41f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba259c640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c0047d0 0x7f9ba41525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba2d9d640 1 -- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c0047d0 msgr2=0x7f9ba41525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba2d9d640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c0047d0 0x7f9ba41525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba2d9d640 1 -- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba41530a0 msgr2=0x7f9ba41f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba2d9d640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba41530a0 0x7f9ba41f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba2d9d640 1 -- 172.21.15.2:0/1638109811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4155f40 con 0x7f9ba41f30a0 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba259c640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c0047d0 0x7f9ba41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba2d9d640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba41f30a0 0x7f9ba41f6110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c001590 tx=0x7f9b9c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9b92ffd640 1 -- 172.21.15.2:0/1638109811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00bb80 con 0x7f9ba41f30a0 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9b92ffd640 1 -- 172.21.15.2:0/1638109811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c00bce0 con 0x7f9ba41f30a0 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba4156220 con 0x7f9ba41f30a0 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9b92ffd640 1 -- 172.21.15.2:0/1638109811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0072b0 con 0x7f9ba41f30a0 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba4155610 con 0x7f9ba41f30a0 2023-11-04T01:42:40.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba40744a0 con 0x7f9ba41f30a0 2023-11-04T01:42:40.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9b92ffd640 1 -- 172.21.15.2:0/1638109811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b9c007410 con 0x7f9ba41f30a0 2023-11-04T01:42:40.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9b92ffd640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b840664d0 0x7f9b84068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9b92ffd640 1 -- 172.21.15.2:0/1638109811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b9c084070 con 0x7f9ba41f30a0 2023-11-04T01:42:40.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba259c640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b840664d0 0x7f9b84068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.283+0000 7f9ba259c640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b840664d0 0x7f9b84068990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b94006aa0 tx=0x7f9b94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.287+0000 7f9b92ffd640 1 -- 172.21.15.2:0/1638109811 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b9c051450 con 0x7f9ba41f30a0 2023-11-04T01:42:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.475+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ba40c9850 con 0x7f9ba41f30a0 2023-11-04T01:42:40.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.475+0000 7f9b92ffd640 1 -- 172.21.15.2:0/1638109811 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f9b9c054a70 con 0x7f9ba41f30a0 2023-11-04T01:42:40.482 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:42:40.482 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b840664d0 msgr2=0x7f9b84068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b840664d0 0x7f9b84068990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b94006aa0 tx=0x7f9b94008040 comp rx=0 tx=0).stop 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba41f30a0 msgr2=0x7f9ba41f6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba41f30a0 0x7f9ba41f6110 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c001590 tx=0x7f9b9c00b4a0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 shutdown_connections 2023-11-04T01:42:40.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b840664d0 0x7f9b84068990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ba41f30a0 0x7f9ba41f6110 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ba41530a0 0x7f9ba41f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 --2- 172.21.15.2:0/1638109811 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8c0047d0 0x7f9ba41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 >> 172.21.15.2:0/1638109811 conn(0x7f9ba40cf990 msgr2=0x7f9ba40b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 shutdown_connections 2023-11-04T01:42:40.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.479+0000 7f9ba8889640 1 -- 172.21.15.2:0/1638109811 wait complete. 2023-11-04T01:42:40.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cef51d640 1 Processor -- start 2023-11-04T01:42:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cef51d640 1 -- start start 2023-11-04T01:42:40.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cef51d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ce80cdea0 0x7f6ce80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cef51d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ce80ca400 0x7f6ce80b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cef51d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80ccee0 con 0x7f6ce815a1f0 2023-11-04T01:42:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cef51d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce815a5d0 con 0x7f6ce80ca400 2023-11-04T01:42:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cef51d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80ca900 con 0x7f6ce80cdea0 2023-11-04T01:42:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6ced2b9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6ce815a1f0 0x7f6ce80cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52218/0 (socket says 172.21.15.2:52218) 2023-11-04T01:42:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cedaba640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ce80ca400 0x7f6ce80b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6ced2b9640 1 -- 172.21.15.2:0/2062790493 learned_addr learned my addr 172.21.15.2:0/2062790493 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cecab8640 1 --2- 172.21.15.2:0/2062790493 >> v2:172.21.15.90:3300/0 conn(0x7f6ce80cdea0 0x7f6ce80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cedaba640 1 -- 172.21.15.2:0/2062790493 >> v2:172.21.15.90:3300/0 conn(0x7f6ce80cdea0 msgr2=0x7f6ce80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cedaba640 1 --2- 172.21.15.2:0/2062790493 >> v2:172.21.15.90:3300/0 conn(0x7f6ce80cdea0 0x7f6ce80b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cedaba640 1 -- 172.21.15.2:0/2062790493 >> v1:172.21.15.2:6789/0 conn(0x7f6ce815a1f0 legacy=0x7f6ce80cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cdffff640 1 -- 172.21.15.2:0/2062790493 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843604876 0 0) 0x7f6ce80ccee0 con 0x7f6ce815a1f0 2023-11-04T01:42:40.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.611+0000 7f6cedaba640 1 -- 172.21.15.2:0/2062790493 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80cabe0 con 0x7f6ce80ca400 2023-11-04T01:42:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cedaba640 1 --2- 172.21.15.2:0/2062790493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce80ca400 0x7f6ce80b0b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ce815dc30 tx=0x7f6ce001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a1d8b2faaf0858 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cdffff640 1 -- 172.21.15.2:0/2062790493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0004230 con 0x7f6ce80ca400 2023-11-04T01:42:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cdffff640 1 -- 172.21.15.2:0/2062790493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce00a7050 con 0x7f6ce80ca400 2023-11-04T01:42:40.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cdffff640 1 -- 172.21.15.2:0/2062790493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0003620 con 0x7f6ce80ca400 2023-11-04T01:42:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- 172.21.15.2:0/2062790493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce80ca400 msgr2=0x7f6ce80b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 --2- 172.21.15.2:0/2062790493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce80ca400 0x7f6ce80b0b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ce815dc30 tx=0x7f6ce001c460 comp rx=0 tx=0).stop 2023-11-04T01:42:40.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- 172.21.15.2:0/2062790493 shutdown_connections 2023-11-04T01:42:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 --2- 172.21.15.2:0/2062790493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce80ca400 0x7f6ce80b0b70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 --2- 172.21.15.2:0/2062790493 >> v2:172.21.15.90:3300/0 conn(0x7f6ce80cdea0 0x7f6ce80b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- 172.21.15.2:0/2062790493 >> 172.21.15.2:0/2062790493 conn(0x7f6ce80cebb0 msgr2=0x7f6ce80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- 172.21.15.2:0/2062790493 shutdown_connections 2023-11-04T01:42:40.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- 172.21.15.2:0/2062790493 wait complete. 2023-11-04T01:42:40.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 Processor -- start 2023-11-04T01:42:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- start start 2023-11-04T01:42:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ce80ca400 0x7f6ce80af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce80cdea0 0x7f6ce80ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce815a1f0 0x7f6ce8158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80b0610 con 0x7f6ce815a1f0 2023-11-04T01:42:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80b0050 con 0x7f6ce80cdea0 2023-11-04T01:42:40.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.615+0000 7f6cef51d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80b0330 con 0x7f6ce80ca400 2023-11-04T01:42:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce815a1f0 0x7f6ce8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce815a1f0 0x7f6ce8158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50204/0 (socket says 172.21.15.2:50204) 2023-11-04T01:42:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 -- 172.21.15.2:0/1706990038 learned_addr learned my addr 172.21.15.2:0/1706990038 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cecab8640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce80cdea0 0x7f6ce80ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6ced2b9640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ce80ca400 0x7f6ce80af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 -- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ce80ca400 msgr2=0x7f6ce80af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ce80ca400 0x7f6ce80af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 -- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce80cdea0 msgr2=0x7f6ce80ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce80cdea0 0x7f6ce80ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 -- 172.21.15.2:0/1706990038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0009420 con 0x7f6ce815a1f0 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cedaba640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce815a1f0 0x7f6ce8158200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0019070 tx=0x7f6ce0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cddffb640 1 -- 172.21.15.2:0/1706990038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0003b30 con 0x7f6ce815a1f0 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cddffb640 1 -- 172.21.15.2:0/1706990038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce0003c90 con 0x7f6ce815a1f0 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce8153b70 con 0x7f6ce815a1f0 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cddffb640 1 -- 172.21.15.2:0/1706990038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00ab440 con 0x7f6ce815a1f0 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80ad9f0 con 0x7f6ce815a1f0 2023-11-04T01:42:40.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce81539d0 con 0x7f6ce815a1f0 2023-11-04T01:42:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cddffb640 1 -- 172.21.15.2:0/1706990038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ce00b2040 con 0x7f6ce815a1f0 2023-11-04T01:42:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cddffb640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ccc0664a0 0x7f6ccc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6cddffb640 1 -- 172.21.15.2:0/1706990038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce011de80 con 0x7f6ce815a1f0 2023-11-04T01:42:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.619+0000 7f6ced2b9640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ccc0664a0 0x7f6ccc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.623+0000 7f6ced2b9640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ccc0664a0 0x7f6ccc068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40012f0 tx=0x7f6ce4005ec0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.623+0000 7f6cddffb640 1 -- 172.21.15.2:0/1706990038 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ce81539d0 con 0x7f6ce815a1f0 2023-11-04T01:42:40.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.775+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce8154090 con 0x7f6ce815a1f0 2023-11-04T01:42:40.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.775+0000 7f6cddffb640 1 -- 172.21.15.2:0/1706990038 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f6ce8154090 con 0x7f6ce815a1f0 2023-11-04T01:42:40.781 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ccc0664a0 msgr2=0x7f6ccc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ccc0664a0 0x7f6ccc068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40012f0 tx=0x7f6ce4005ec0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce815a1f0 msgr2=0x7f6ce8158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce815a1f0 0x7f6ce8158200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0019070 tx=0x7f6ce0019200 comp rx=0 tx=0).stop 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 shutdown_connections 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ccc0664a0 0x7f6ccc068960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ce815a1f0 0x7f6ce8158200 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ce80cdea0 0x7f6ce80ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 --2- 172.21.15.2:0/1706990038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ce80ca400 0x7f6ce80af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 >> 172.21.15.2:0/1706990038 conn(0x7f6ce80cebb0 msgr2=0x7f6ce80c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 shutdown_connections 2023-11-04T01:42:40.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.779+0000 7f6cef51d640 1 -- 172.21.15.2:0/1706990038 wait complete. 2023-11-04T01:42:40.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:42:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb4b6d1640 1 Processor -- start 2023-11-04T01:42:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb4b6d1640 1 -- start start 2023-11-04T01:42:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb4b6d1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feb440715d0 0x7feb440b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb4b6d1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb440b0b70 0x7feb4415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb4b6d1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb440c2670 con 0x7feb4415afd0 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb4b6d1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb44070140 con 0x7feb440b0b70 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb4b6d1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb44071a60 con 0x7feb440715d0 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb49c6e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb440b0b70 0x7feb4415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb49c6e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb440b0b70 0x7feb4415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50214/0 (socket says 172.21.15.2:50214) 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb49c6e640 1 -- 172.21.15.2:0/1661702241 learned_addr learned my addr 172.21.15.2:0/1661702241 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb48c6c640 1 --2- 172.21.15.2:0/1661702241 >> v2:172.21.15.90:3300/0 conn(0x7feb440715d0 0x7feb440b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb49c6e640 1 -- 172.21.15.2:0/1661702241 >> v2:172.21.15.90:3300/0 conn(0x7feb440715d0 msgr2=0x7feb440b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb49c6e640 1 --2- 172.21.15.2:0/1661702241 >> v2:172.21.15.90:3300/0 conn(0x7feb440715d0 0x7feb440b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb49c6e640 1 -- 172.21.15.2:0/1661702241 >> v1:172.21.15.90:6789/0 conn(0x7feb4415afd0 legacy=0x7feb4406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.915+0000 7feb49c6e640 1 -- 172.21.15.2:0/1661702241 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4406bc30 con 0x7feb440b0b70 2023-11-04T01:42:40.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb49c6e640 1 --2- 172.21.15.2:0/1661702241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440b0b70 0x7feb4415ec80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feb440ce900 tx=0x7feb3c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e83346bf5c2d95b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb3bfff640 1 -- 172.21.15.2:0/1661702241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0a5690 con 0x7feb440b0b70 2023-11-04T01:42:40.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb3bfff640 1 -- 172.21.15.2:0/1661702241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c0a57f0 con 0x7feb440b0b70 2023-11-04T01:42:40.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb3bfff640 1 -- 172.21.15.2:0/1661702241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0a5b80 con 0x7feb440b0b70 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- 172.21.15.2:0/1661702241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440b0b70 msgr2=0x7feb4415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/1661702241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440b0b70 0x7feb4415ec80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feb440ce900 tx=0x7feb3c01c9d0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- 172.21.15.2:0/1661702241 shutdown_connections 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/1661702241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb440b0b70 0x7feb4415ec80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/1661702241 >> v2:172.21.15.90:3300/0 conn(0x7feb440715d0 0x7feb440b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- 172.21.15.2:0/1661702241 >> 172.21.15.2:0/1661702241 conn(0x7feb440cebb0 msgr2=0x7feb440cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- 172.21.15.2:0/1661702241 shutdown_connections 2023-11-04T01:42:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- 172.21.15.2:0/1661702241 wait complete. 2023-11-04T01:42:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 Processor -- start 2023-11-04T01:42:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- start start 2023-11-04T01:42:40.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb440715d0 0x7feb440b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb440b0b70 0x7feb441519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb4415afd0 0x7feb44159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb440c5bf0 con 0x7feb4415afd0 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb440c5e90 con 0x7feb440715d0 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb4b6d1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb440c6170 con 0x7feb440b0b70 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb49c6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb4415afd0 0x7feb44159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb49c6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb4415afd0 0x7feb44159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50226/0 (socket says 172.21.15.2:50226) 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb49c6e640 1 -- 172.21.15.2:0/2453665884 learned_addr learned my addr 172.21.15.2:0/2453665884 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.919+0000 7feb48c6c640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb440b0b70 0x7feb441519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb4946d640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb440715d0 0x7feb440b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb49c6e640 1 -- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb440b0b70 msgr2=0x7feb441519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb49c6e640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb440b0b70 0x7feb441519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb49c6e640 1 -- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb440715d0 msgr2=0x7feb440b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb49c6e640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb440715d0 0x7feb440b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb49c6e640 1 -- 172.21.15.2:0/2453665884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c009b30 con 0x7feb4415afd0 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb49c6e640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb4415afd0 0x7feb44159410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0195e0 tx=0x7feb3c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb39ffb640 1 -- 172.21.15.2:0/2453665884 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0b8670 con 0x7feb4415afd0 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb39ffb640 1 -- 172.21.15.2:0/2453665884 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c0b87d0 con 0x7feb4415afd0 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb39ffb640 1 -- 172.21.15.2:0/2453665884 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c0b8b80 con 0x7feb4415afd0 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb440c6450 con 0x7feb4415afd0 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb440b1d10 con 0x7feb4415afd0 2023-11-04T01:42:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb44068310 con 0x7feb4415afd0 2023-11-04T01:42:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb39ffb640 1 -- 172.21.15.2:0/2453665884 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb3c0b8ce0 con 0x7feb4415afd0 2023-11-04T01:42:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb39ffb640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb280664a0 0x7feb28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb39ffb640 1 -- 172.21.15.2:0/2453665884 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb3c11f400 con 0x7feb4415afd0 2023-11-04T01:42:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb4946d640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb280664a0 0x7feb28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:40.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.923+0000 7feb4946d640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb280664a0 0x7feb28068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb441f94a0 tx=0x7feb40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:40.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:40.927+0000 7feb39ffb640 1 -- 172.21.15.2:0/2453665884 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb3c0ec9a0 con 0x7feb4415afd0 2023-11-04T01:42:41.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.111+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb440744a0 con 0x7feb4415afd0 2023-11-04T01:42:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.111+0000 7feb39ffb640 1 -- 172.21.15.2:0/2453665884 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7feb3c009510 con 0x7feb4415afd0 2023-11-04T01:42:41.117 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:42:41.117 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:42:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb280664a0 msgr2=0x7feb28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb280664a0 0x7feb28068960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb441f94a0 tx=0x7feb40009040 comp rx=0 tx=0).stop 2023-11-04T01:42:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb4415afd0 msgr2=0x7feb44159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb4415afd0 0x7feb44159410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feb3c0195e0 tx=0x7feb3c019770 comp rx=0 tx=0).stop 2023-11-04T01:42:41.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 shutdown_connections 2023-11-04T01:42:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb280664a0 0x7feb28068960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb4415afd0 0x7feb44159410 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb440b0b70 0x7feb441519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 --2- 172.21.15.2:0/2453665884 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb440715d0 0x7feb440b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 >> 172.21.15.2:0/2453665884 conn(0x7feb440cebb0 msgr2=0x7feb440cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 shutdown_connections 2023-11-04T01:42:41.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.115+0000 7feb4b6d1640 1 -- 172.21.15.2:0/2453665884 wait complete. 2023-11-04T01:42:41.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:42:24.210312+0000', 'modified': '2023-11-04T01:42:26.230136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6837/1515609154', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 1515609154}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 1515609154}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:42:41.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:42:41.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:42:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f7754ab8640 1 Processor -- start 2023-11-04T01:42:41.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f7754ab8640 1 -- start start 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f7754ab8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77500d0690 0x7f77500b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f7754ab8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77500b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f7754ab8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77500b6070 con 0x7f77500b4990 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f7754ab8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500b8ed0 con 0x7f77500d0690 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f7754ab8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500d1ce0 con 0x7f77500d0ae0 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774dd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77500d0690 0x7f77500b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774dd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f77500d0690 0x7f77500b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46842/0 (socket says 172.21.15.2:46842) 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774dd9b640 1 -- 172.21.15.2:0/2905856142 learned_addr learned my addr 172.21.15.2:0/2905856142 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774ed9d640 1 --2- 172.21.15.2:0/2905856142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77500b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774dd9b640 1 -- 172.21.15.2:0/2905856142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 msgr2=0x7f77500b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774dd9b640 1 --2- 172.21.15.2:0/2905856142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77500b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774dd9b640 1 -- 172.21.15.2:0/2905856142 >> v1:172.21.15.90:6789/0 conn(0x7f77500b4990 legacy=0x7f77500b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.667+0000 7f774dd9b640 1 -- 172.21.15.2:0/2905856142 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500d1fc0 con 0x7f77500d0690 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f774dd9b640 1 --2- 172.21.15.2:0/2905856142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77500b64e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7740009870 tx=0x7f774001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6354c0e095345087 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f774d59a640 1 -- 172.21.15.2:0/2905856142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400a89b0 con 0x7f77500d0690 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f774d59a640 1 -- 172.21.15.2:0/2905856142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77400a8b10 con 0x7f77500d0690 2023-11-04T01:42:41.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f774d59a640 1 -- 172.21.15.2:0/2905856142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400a8ea0 con 0x7f77500d0690 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- 172.21.15.2:0/2905856142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 msgr2=0x7f77500b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 --2- 172.21.15.2:0/2905856142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77500b64e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7740009870 tx=0x7f774001ecf0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- 172.21.15.2:0/2905856142 shutdown_connections 2023-11-04T01:42:41.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 --2- 172.21.15.2:0/2905856142 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77500b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 --2- 172.21.15.2:0/2905856142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77500b64e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- 172.21.15.2:0/2905856142 >> 172.21.15.2:0/2905856142 conn(0x7f77500cf990 msgr2=0x7f77500cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- 172.21.15.2:0/2905856142 shutdown_connections 2023-11-04T01:42:41.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- 172.21.15.2:0/2905856142 wait complete. 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 Processor -- start 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- start start 2023-11-04T01:42:41.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77500b4990 0x7f775015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77501f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77501f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750160190 con 0x7f77500d0690 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77501f06b0 con 0x7f77500b4990 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.671+0000 7f7754ab8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500ca210 con 0x7f77500d0ae0 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77501f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77501f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46848/0 (socket says 172.21.15.2:46848) 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 -- 172.21.15.2:0/1057039574 learned_addr learned my addr 172.21.15.2:0/1057039574 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774e59c640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77500b4990 0x7f775015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774ed9d640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77501f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 -- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 msgr2=0x7f77501f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77501f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 -- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77500b4990 msgr2=0x7f775015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77500b4990 0x7f775015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 -- 172.21.15.2:0/1057039574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400094d0 con 0x7f77500d0690 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774e59c640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77500b4990 0x7f775015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774dd9b640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77501f2ee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77400097c0 tx=0x7f774001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7746ffd640 1 -- 172.21.15.2:0/1057039574 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400ba600 con 0x7f77500d0690 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7746ffd640 1 -- 172.21.15.2:0/1057039574 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77400ba760 con 0x7f77500d0690 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7746ffd640 1 -- 172.21.15.2:0/1057039574 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400baaf0 con 0x7f77500d0690 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775015f8f0 con 0x7f77500d0690 2023-11-04T01:42:41.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775015feb0 con 0x7f77500d0690 2023-11-04T01:42:41.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7746ffd640 1 -- 172.21.15.2:0/1057039574 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77400bac50 con 0x7f77500d0690 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7746ffd640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77300664a0 0x7f7730068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7746ffd640 1 -- 172.21.15.2:0/1057039574 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7740122410 con 0x7f77500d0690 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f774e59c640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77300664a0 0x7f7730068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7757be5000 1 Processor -- start 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.675+0000 7f7757be5000 1 -- start start 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77300664a0 0x7f7730068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77501f3d40 tx=0x7f7738009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d089380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d03c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d03cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5cf07460 con 0x55db5d088fa0 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce98690 con 0x55db5d0898c0 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce95bc0 con 0x55db5d03cb40 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d089380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d089380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46862/0 (socket says 172.21.15.2:46862) 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 -- 172.21.15.2:0/3743543585 learned_addr learned my addr 172.21.15.2:0/3743543585 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d03c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774ed9d640 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d03cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 -- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 msgr2=0x55db5d03cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d03cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 -- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 msgr2=0x55db5d03c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d03c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 -- 172.21.15.2:0/3743543585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5cb89890 con 0x55db5d088fa0 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d089380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f773800e810 tx=0x7f7738011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a71d5fde5a67c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f772ffff640 1 -- 172.21.15.2:0/3743543585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738005110 con 0x55db5d088fa0 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f772ffff640 1 -- 172.21.15.2:0/3743543585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738005270 con 0x55db5d088fa0 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f772ffff640 1 -- 172.21.15.2:0/3743543585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380159b0 con 0x55db5d088fa0 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- 172.21.15.2:0/3743543585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 msgr2=0x55db5d089380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d089380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f773800e810 tx=0x7f7738011000 comp rx=0 tx=0).stop 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- 172.21.15.2:0/3743543585 shutdown_connections 2023-11-04T01:42:41.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d03cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d03c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- 172.21.15.2:0/3743543585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d089380 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- 172.21.15.2:0/3743543585 >> 172.21.15.2:0/3743543585 conn(0x55db5d069d40 msgr2=0x55db5d06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- 172.21.15.2:0/3743543585 shutdown_connections 2023-11-04T01:42:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- 172.21.15.2:0/3743543585 wait complete. 2023-11-04T01:42:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- start start 2023-11-04T01:42:41.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 Processor -- start 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d045050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d041ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d042020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce914b0 con 0x55db5d088fa0 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce49aa0 con 0x55db5d0898c0 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce4f940 con 0x55db5d03cb40 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f7757be5000 10 client.0 _ll_register_callbacks cb 0x55db5d02a460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d041ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d041ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46876/0 (socket says 172.21.15.2:46876) 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 -- 172.21.15.2:0/3543846628 learned_addr learned my addr 172.21.15.2:0/3543846628 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774e59c640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d045050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774ed9d640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d042020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 -- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 msgr2=0x55db5d045050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d045050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 -- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 msgr2=0x55db5d042020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d042020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774dd9b640 1 -- 172.21.15.2:0/3543846628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773800f040 con 0x55db5d088fa0 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.679+0000 7f774ed9d640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d042020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f774dd9b640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d041ae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77400f3240 tx=0x7f77400ef9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f973499399fd9125 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 1 -- 172.21.15.2:0/3543846628 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400f7690 con 0x55db5d088fa0 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 1 -- 172.21.15.2:0/3543846628 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77400fb840 con 0x55db5d088fa0 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db5ce4ee10 con 0x55db5d088fa0 2023-11-04T01:42:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 1 -- 172.21.15.2:0/3543846628 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77400f2a30 con 0x55db5d088fa0 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 10 client.4713 fetch_fsmap learned FSMap version 6 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55db5ce521a0 con 0x55db5d088fa0 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 1 -- 172.21.15.2:0/3543846628 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db5ce4ee10 con 0x55db5d088fa0 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 1 -- 172.21.15.2:0/3543846628 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f77400b7030 con 0x55db5d088fa0 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 10 client.4713 fetch_fsmap finished waiting for FSMap version 6 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 10 client.4713 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 20 client.4713 populate_metadata read hostname 'smithi002' 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d042d90 0x55db5d09a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 4 client.4713 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 --> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db5ce8fe00 con 0x55db5d042d90 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f774e59c640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d042d90 0x55db5d09a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f774e59c640 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d042d90 0x55db5d09a250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a88eb650408e5d36 server_cookie=d389a84996ebab38 in_seq=0 out_seq=0 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 10 client.4713 ms_handle_connect on v2:172.21.15.90:6836/1515609154 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 1 -- 172.21.15.2:0/3543846628 <== mds.0 v2:172.21.15.90:6836/1515609154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55db5ce8fe00 con 0x55db5d042d90 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 10 client.4713 handle_command_reply: tid=0 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 client.4713 shutdown 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 msgr2=0x55db5d041ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d041ae0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77400f3240 tx=0x7f77400ef9b0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 shutdown_connections 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d042d90 0x55db5d09a250 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d0898c0 0x55db5d042020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d041ae0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f772d7fa640 0 client.4713 ms_handle_reset on v2:172.21.15.90:6836/1515609154 2023-11-04T01:42:41.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 --2- 172.21.15.2:0/3543846628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d03cb40 0x55db5d045050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 >> 172.21.15.2:0/3543846628 conn(0x55db5d069d40 msgr2=0x55db5d06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 shutdown_connections 2023-11-04T01:42:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 1 -- 172.21.15.2:0/3543846628 wait complete. 2023-11-04T01:42:41.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.683+0000 7f7757be5000 20 client.4713 trim_cache size 0 max 16384 2023-11-04T01:42:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.699+0000 7f7757be5000 1 Processor -- start 2023-11-04T01:42:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.699+0000 7f7757be5000 1 -- start start 2023-11-04T01:42:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d03cb40 0x55db5d041a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d088fa0 0x55db5d041f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 0x55db5d087050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5cb4a940 con 0x55db5d03cb40 2023-11-04T01:42:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce2c750 con 0x55db5d088fa0 2023-11-04T01:42:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db5d09ef40 con 0x55db5d0898c0 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d03cb40 0x55db5d041a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d03cb40 0x55db5d041a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46884/0 (socket says 172.21.15.2:46884) 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 -- 172.21.15.2:0/1296368972 learned_addr learned my addr 172.21.15.2:0/1296368972 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 -- 172.21.15.2:0/1296368972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 msgr2=0x55db5d087050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 --2- 172.21.15.2:0/1296368972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 0x55db5d087050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 -- 172.21.15.2:0/1296368972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d088fa0 msgr2=0x55db5d041f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 --2- 172.21.15.2:0/1296368972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d088fa0 0x55db5d041f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 -- 172.21.15.2:0/1296368972 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5ce384a0 con 0x55db5d03cb40 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 --2- 172.21.15.2:0/1296368972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d03cb40 0x55db5d041a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f773800e530 tx=0x7f7738017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a238471bb4010b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7744ff9640 1 -- 172.21.15.2:0/1296368972 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738027040 con 0x55db5d03cb40 2023-11-04T01:42:41.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7744ff9640 1 -- 172.21.15.2:0/1296368972 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738019070 con 0x55db5d03cb40 2023-11-04T01:42:41.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7744ff9640 1 -- 172.21.15.2:0/1296368972 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738005500 con 0x55db5d03cb40 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- 172.21.15.2:0/1296368972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d03cb40 msgr2=0x55db5d041a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- 172.21.15.2:0/1296368972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d03cb40 0x55db5d041a30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f773800e530 tx=0x7f7738017070 comp rx=0 tx=0).stop 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- 172.21.15.2:0/1296368972 shutdown_connections 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- 172.21.15.2:0/1296368972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 0x55db5d087050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- 172.21.15.2:0/1296368972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d088fa0 0x55db5d041f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- 172.21.15.2:0/1296368972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d03cb40 0x55db5d041a30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- 172.21.15.2:0/1296368972 >> 172.21.15.2:0/1296368972 conn(0x55db5d069d40 msgr2=0x55db5d041320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- 172.21.15.2:0/1296368972 shutdown_connections 2023-11-04T01:42:41.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- 172.21.15.2:0/1296368972 wait complete. 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- start start 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 Processor -- start 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d03cb40 0x55db5d09b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d0e8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 0x55db5d0e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce4f460 con 0x55db5d088fa0 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce8b7b0 con 0x55db5d03cb40 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db5ce14460 con 0x55db5d0898c0 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 10 client.0 _ll_register_callbacks cb 0x7f7738001db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d0e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d0e8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46894/0 (socket says 172.21.15.2:46894) 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 -- 172.21.15.2:0/4185090920 learned_addr learned my addr 172.21.15.2:0/4185090920 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774e59c640 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d03cb40 0x55db5d09b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 -- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 msgr2=0x55db5d0e8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 0x55db5d0e8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 -- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d03cb40 msgr2=0x55db5d09b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d03cb40 0x55db5d09b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 -- 172.21.15.2:0/4185090920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db5cb89890 con 0x55db5d088fa0 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f774dd9b640 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d0e8600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77400ef8a0 tx=0x7f7740000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af25d640fdaf143 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f772d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f772d7fa640 1 -- 172.21.15.2:0/4185090920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400f3310 con 0x55db5d088fa0 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f772d7fa640 1 -- 172.21.15.2:0/4185090920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77400fb840 con 0x55db5d088fa0 2023-11-04T01:42:41.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db5ce5bd10 con 0x55db5d088fa0 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f772d7fa640 1 -- 172.21.15.2:0/4185090920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77400f7690 con 0x55db5d088fa0 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 10 client.4719 fetch_fsmap learned FSMap version 6 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.703+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55db5cb89cc0 con 0x55db5d088fa0 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f772d7fa640 1 -- 172.21.15.2:0/4185090920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db5ce5bd10 con 0x55db5d088fa0 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f772d7fa640 1 -- 172.21.15.2:0/4185090920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 6) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f774011a430 con 0x55db5d088fa0 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 10 client.4719 fetch_fsmap finished waiting for FSMap version 6 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 10 client.4719 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 20 client.4719 populate_metadata read hostname 'smithi002' 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d0a6160 0x55db5d0a6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 4 client.4719 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 --> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55db5ce8a490 con 0x55db5d0a6160 2023-11-04T01:42:41.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f774e59c640 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d0a6160 0x55db5d0a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f772d7fa640 10 client.4719 ms_handle_connect on v2:172.21.15.90:6836/1515609154 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f774e59c640 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d0a6160 0x55db5d0a6540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0f43a7960893f7 server_cookie=2cb8b33b711bf2df in_seq=0 out_seq=0 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f772d7fa640 1 -- 172.21.15.2:0/4185090920 <== mds.0 v2:172.21.15.90:6836/1515609154 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55db5ce8a490 con 0x55db5d0a6160 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f772d7fa640 10 client.4719 handle_command_reply: tid=0 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 client.4719 shutdown 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 msgr2=0x55db5d0e8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d0e8600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77400ef8a0 tx=0x7f7740000bd0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 shutdown_connections 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:6836/1515609154,v1:172.21.15.90:6837/1515609154] conn(0x55db5d0a6160 0x55db5d0a6540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55db5d0898c0 0x55db5d0e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55db5d088fa0 0x55db5d0e8600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 --2- 172.21.15.2:0/4185090920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55db5d03cb40 0x55db5d09b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f772d7fa640 0 client.4719 ms_handle_reset on v2:172.21.15.90:6836/1515609154 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 >> 172.21.15.2:0/4185090920 conn(0x55db5d069d40 msgr2=0x55db5d041320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 shutdown_connections 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 1 -- 172.21.15.2:0/4185090920 wait complete. 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7757be5000 20 client.4719 trim_cache size 0 max 16384 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:42:41.718 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4282, 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 16.838304983, 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 6, 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 21, 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 21, 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 23.805986985000001 2023-11-04T01:42:41.719 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77300664a0 msgr2=0x7f7730068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77300664a0 0x7f7730068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77501f3d40 tx=0x7f7738009040 comp rx=0 tx=0).stop 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 msgr2=0x7f77501f2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77501f2ee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77400097c0 tx=0x7f774001ba90 comp rx=0 tx=0).stop 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 shutdown_connections 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77300664a0 0x7f7730068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f77500d0ae0 0x7f77501f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77500d0690 0x7f77501f2ee0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 --2- 172.21.15.2:0/1057039574 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77500b4990 0x7f775015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 >> 172.21.15.2:0/1057039574 conn(0x7f77500cf990 msgr2=0x7f77500b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 shutdown_connections 2023-11-04T01:42:41.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:41.707+0000 7f7754ab8640 1 -- 172.21.15.2:0/1057039574 wait complete. 2023-11-04T01:42:41.728 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-04T01:42:41.751 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-04T01:42:41.751 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-04T01:42:41.752 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-04T01:42:41.752 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:42:41.752 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:41.752 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-04T01:42:41.752 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:42:41.752 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:41.752 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-04T01:42:41.752 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:42:41.752 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:41.753 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-04T01:42:41.753 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-04T01:42:41.753 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:41.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:41.753 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:42:41.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:41.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-11-04T01:42:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2023-11-04T01:42:41.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:41.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:41.817 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-11-04T01:42:41.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:41.824 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2023-11-04T01:42:41.885 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2023-11-04T01:42:41.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:42:41.887 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-04T01:42:41.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:42.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.011+0000 7fca33088640 1 Processor -- start 2023-11-04T01:42:42.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.011+0000 7fca33088640 1 -- start start 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca2c0b0890 0x7fca2c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fca2c0b0c70 0x7fca2c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0ce320 con 0x7fca2c0c9960 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c06d2f0 con 0x7fca2c0b0890 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0ce110 con 0x7fca2c0b0c70 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca30e24640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca2c0b0890 0x7fca2c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca2bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fca2c0c9960 0x7fca2c0704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58212/0 (socket says 172.21.15.2:58212) 2023-11-04T01:42:42.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca2bfff640 1 -- 172.21.15.2:0/1778006086 learned_addr learned my addr 172.21.15.2:0/1778006086 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca30e24640 1 -- 172.21.15.2:0/1778006086 >> v2:172.21.15.90:3300/0 conn(0x7fca2c0b0c70 msgr2=0x7fca2c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca31625640 1 --2- 172.21.15.2:0/1778006086 >> v2:172.21.15.90:3300/0 conn(0x7fca2c0b0c70 0x7fca2c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca30e24640 1 --2- 172.21.15.2:0/1778006086 >> v2:172.21.15.90:3300/0 conn(0x7fca2c0b0c70 0x7fca2c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca2b7fe640 1 -- 172.21.15.2:0/1778006086 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677882906 0 0) 0x7fca2c0ce320 con 0x7fca2c0c9960 2023-11-04T01:42:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca30e24640 1 -- 172.21.15.2:0/1778006086 >> v1:172.21.15.2:6789/0 conn(0x7fca2c0c9960 legacy=0x7fca2c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca30e24640 1 -- 172.21.15.2:0/1778006086 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0ce600 con 0x7fca2c0b0890 2023-11-04T01:42:42.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca31625640 1 --2- 172.21.15.2:0/1778006086 >> v2:172.21.15.90:3300/0 conn(0x7fca2c0b0c70 0x7fca2c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:42.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca30e24640 1 --2- 172.21.15.2:0/1778006086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0b0890 0x7fca2c0cdbd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca2c06fd70 tx=0x7fca2001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63655dbb9b7b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca2b7fe640 1 -- 172.21.15.2:0/1778006086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200a7070 con 0x7fca2c0b0890 2023-11-04T01:42:42.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca2b7fe640 1 -- 172.21.15.2:0/1778006086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca200ab430 con 0x7fca2c0b0890 2023-11-04T01:42:42.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca2b7fe640 1 -- 172.21.15.2:0/1778006086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca200ab7c0 con 0x7fca2c0b0890 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- 172.21.15.2:0/1778006086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0b0890 msgr2=0x7fca2c0cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 --2- 172.21.15.2:0/1778006086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0b0890 0x7fca2c0cdbd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca2c06fd70 tx=0x7fca2001c430 comp rx=0 tx=0).stop 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- 172.21.15.2:0/1778006086 shutdown_connections 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 --2- 172.21.15.2:0/1778006086 >> v2:172.21.15.90:3300/0 conn(0x7fca2c0b0c70 0x7fca2c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 --2- 172.21.15.2:0/1778006086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0b0890 0x7fca2c0cdbd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- 172.21.15.2:0/1778006086 >> 172.21.15.2:0/1778006086 conn(0x7fca2c0cebb0 msgr2=0x7fca2c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- 172.21.15.2:0/1778006086 shutdown_connections 2023-11-04T01:42:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.015+0000 7fca33088640 1 -- 172.21.15.2:0/1778006086 wait complete. 2023-11-04T01:42:42.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 Processor -- start 2023-11-04T01:42:42.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 -- start start 2023-11-04T01:42:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca2c0b0890 0x7fca2c146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca2c0b0c70 0x7fca2c0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0c9960 0x7fca2c0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c7250 con 0x7fca2c0c9960 2023-11-04T01:42:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c6640 con 0x7fca2c0b0890 2023-11-04T01:42:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c6920 con 0x7fca2c0b0c70 2023-11-04T01:42:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0c9960 0x7fca2c0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0c9960 0x7fca2c0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46908/0 (socket says 172.21.15.2:46908) 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 -- 172.21.15.2:0/4172835658 learned_addr learned my addr 172.21.15.2:0/4172835658 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 -- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca2c0b0c70 msgr2=0x7fca2c0c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca2c0b0c70 0x7fca2c0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 -- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca2c0b0890 msgr2=0x7fca2c146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca2c0b0890 0x7fca2c146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 -- 172.21.15.2:0/4172835658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009420 con 0x7fca2c0c9960 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca31625640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0c9960 0x7fca2c0c5bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca2400cef0 tx=0x7fca2400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca297fa640 1 -- 172.21.15.2:0/4172835658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400d840 con 0x7fca2c0c9960 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca297fa640 1 -- 172.21.15.2:0/4172835658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2400d9c0 con 0x7fca2c0c9960 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c0c6c00 con 0x7fca2c0c9960 2023-11-04T01:42:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca297fa640 1 -- 172.21.15.2:0/4172835658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400dd70 con 0x7fca2c0c9960 2023-11-04T01:42:42.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c147470 con 0x7fca2c0c9960 2023-11-04T01:42:42.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.019+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c0cca50 con 0x7fca2c0c9960 2023-11-04T01:42:42.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.023+0000 7fca297fa640 1 -- 172.21.15.2:0/4172835658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca2401e3b0 con 0x7fca2c0c9960 2023-11-04T01:42:42.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.023+0000 7fca297fa640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca100664d0 0x7fca10068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:42.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.023+0000 7fca297fa640 1 -- 172.21.15.2:0/4172835658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca240848f0 con 0x7fca2c0c9960 2023-11-04T01:42:42.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.023+0000 7fca30e24640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca100664d0 0x7fca10068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:42.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.023+0000 7fca30e24640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca100664d0 0x7fca10068990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca200af000 tx=0x7fca20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:42.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.027+0000 7fca297fa640 1 -- 172.21.15.2:0/4172835658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca2c0cca50 con 0x7fca2c0c9960 2023-11-04T01:42:42.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.215+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fca2c0cca50 con 0x7fca2c0c9960 2023-11-04T01:42:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.215+0000 7fca297fa640 1 -- 172.21.15.2:0/4172835658 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fca2c0cca50 con 0x7fca2c0c9960 2023-11-04T01:42:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca100664d0 msgr2=0x7fca10068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca100664d0 0x7fca10068990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca200af000 tx=0x7fca20008040 comp rx=0 tx=0).stop 2023-11-04T01:42:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0c9960 msgr2=0x7fca2c0c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0c9960 0x7fca2c0c5bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca2400cef0 tx=0x7fca2400a710 comp rx=0 tx=0).stop 2023-11-04T01:42:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 shutdown_connections 2023-11-04T01:42:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca100664d0 0x7fca10068990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca2c0c9960 0x7fca2c0c5bf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca2c0b0c70 0x7fca2c0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 --2- 172.21.15.2:0/4172835658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca2c0b0890 0x7fca2c146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 >> 172.21.15.2:0/4172835658 conn(0x7fca2c0cebb0 msgr2=0x7fca2c15dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 shutdown_connections 2023-11-04T01:42:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:42.219+0000 7fca33088640 1 -- 172.21.15.2:0/4172835658 wait complete. 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:42.241 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:42.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.242 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:42.248 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:42.249 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42182sec preferred_lft 42182sec 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:42:42.250 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:42.251 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:42:42.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.251 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:42.251 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:42.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:42:42.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2023-11-04T01:42:42.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2023-11-04T01:42:42.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:42:42.252 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:42.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.325 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:42:42.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.376 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:42:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:42:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:42:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:42:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:42:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:42.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.443 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:42.443 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:42.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:42:42.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:42:42.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:42:42.443 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:42.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.515 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:42:42.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.563 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2023-11-04T01:42:42.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.611 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:42.611 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:42.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:42.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-04T01:42:42.612 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:42.682 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-04T01:42:42.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-04T01:42:42.683 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:42.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.790 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:42.790 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:42.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:42:42.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:42:42.791 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:42.810 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:42:42.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:42.810 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:42:42.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:42.859 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:42.906 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:42:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:42:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:42.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:42.962 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:42:43.010 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:43.010 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:42:43.056 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:42:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:42:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:42:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:42:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:42:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:42:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:42:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:43.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:43.065 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:42:43.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:42:43.139+0000 7f14528d5580 -1 init, newargv = 0x555a507b5da0 newargc=15 2023-11-04T01:42:43.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[44925]: starting ceph client 2023-11-04T01:42:43.152 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[44925]: starting fuse 2023-11-04T01:42:44.217 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:42:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:42:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:42:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:42:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:42:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:42:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:44.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.230 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:42:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:42:44.279 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:42:44.280 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:42:44.281 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:44.282 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:44.282 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:42:44.282 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:42:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.44925.asok 2023-11-04T01:42:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:44.420 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44925.asok 2023-11-04T01:42:44.420 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:44.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.44925.asok status 2023-11-04T01:42:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:42:44.622 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:42:44.622 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:44.622 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "44925", 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4734, 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:42:44.623 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4734 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1009284909 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1009284909 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:44.624 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4734 192.168.0.1:0/1009284909", 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/1009284909", 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 6, 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 21, 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:42:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:42:44.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:44.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:44.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f7a7a1640 1 Processor -- start 2023-11-04T01:42:44.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f7a7a1640 1 -- start start 2023-11-04T01:42:44.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f7a7a1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cb400 0x7f3f740cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f7a7a1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f740cd6d0 0x7f3f740cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f7a7a1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740d0a60 con 0x7f3f7415afb0 2023-11-04T01:42:44.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f7a7a1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7415b390 con 0x7f3f740cd6d0 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f7a7a1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740d04a0 con 0x7f3f740cb400 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.755+0000 7f3f78d3e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f740cd6d0 0x7f3f740cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f78d3e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f740cd6d0 0x7f3f740cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46920/0 (socket says 172.21.15.2:46920) 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f78d3e640 1 -- 172.21.15.2:0/110556952 learned_addr learned my addr 172.21.15.2:0/110556952 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f6b7fe640 1 --2- 172.21.15.2:0/110556952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cb400 0x7f3f740cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f78d3e640 1 -- 172.21.15.2:0/110556952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cb400 msgr2=0x7f3f740cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f78d3e640 1 --2- 172.21.15.2:0/110556952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cb400 0x7f3f740cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f78d3e640 1 -- 172.21.15.2:0/110556952 >> v1:172.21.15.90:6789/0 conn(0x7f3f7415afb0 legacy=0x7f3f740b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:44.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f78d3e640 1 -- 172.21.15.2:0/110556952 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740d0780 con 0x7f3f740cd6d0 2023-11-04T01:42:44.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.759+0000 7f3f78d3e640 1 --2- 172.21.15.2:0/110556952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cd6d0 0x7f3f740cdae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009e50 tx=0x7f3f6c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd053bded153074 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f737fe640 1 -- 172.21.15.2:0/110556952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a56b0 con 0x7f3f740cd6d0 2023-11-04T01:42:44.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f737fe640 1 -- 172.21.15.2:0/110556952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c0a5810 con 0x7f3f740cd6d0 2023-11-04T01:42:44.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f737fe640 1 -- 172.21.15.2:0/110556952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a5ba0 con 0x7f3f740cd6d0 2023-11-04T01:42:44.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/110556952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cd6d0 msgr2=0x7f3f740cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/110556952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cd6d0 0x7f3f740cdae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009e50 tx=0x7f3f6c01c940 comp rx=0 tx=0).stop 2023-11-04T01:42:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/110556952 shutdown_connections 2023-11-04T01:42:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/110556952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cd6d0 0x7f3f740cdae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/110556952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cb400 0x7f3f740cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/110556952 >> 172.21.15.2:0/110556952 conn(0x7f3f74065dc0 msgr2=0x7f3f740661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/110556952 shutdown_connections 2023-11-04T01:42:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/110556952 wait complete. 2023-11-04T01:42:44.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 Processor -- start 2023-11-04T01:42:44.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- start start 2023-11-04T01:42:44.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cb400 0x7f3f74151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cd6d0 0x7f3f7406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7415afb0 0x7f3f741f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f741525a0 con 0x7f3f740cb400 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74153070 con 0x7f3f7415afb0 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f7a7a1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74154200 con 0x7f3f740cd6d0 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cb400 0x7f3f74151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f73fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cb400 0x7f3f74151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46922/0 (socket says 172.21.15.2:46922) 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f73fff640 1 -- 172.21.15.2:0/1248236696 learned_addr learned my addr 172.21.15.2:0/1248236696 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f78d3e640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7415afb0 0x7f3f741f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f73fff640 1 -- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cd6d0 msgr2=0x7f3f7406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f6b7fe640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cd6d0 0x7f3f7406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f73fff640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cd6d0 0x7f3f7406bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f73fff640 1 -- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7415afb0 msgr2=0x7f3f741f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.763+0000 7f3f73fff640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7415afb0 0x7f3f741f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f73fff640 1 -- 172.21.15.2:0/1248236696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009b30 con 0x7f3f740cb400 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f78d3e640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7415afb0 0x7f3f741f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f73fff640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cb400 0x7f3f74151cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400c450 tx=0x7f3f6400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f717fa640 1 -- 172.21.15.2:0/1248236696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f64012830 con 0x7f3f740cb400 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f717fa640 1 -- 172.21.15.2:0/1248236696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f640129b0 con 0x7f3f740cb400 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f74154420 con 0x7f3f740cb400 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f717fa640 1 -- 172.21.15.2:0/1248236696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f64012d60 con 0x7f3f740cb400 2023-11-04T01:42:44.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f741547b0 con 0x7f3f740cb400 2023-11-04T01:42:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f74154940 con 0x7f3f740cb400 2023-11-04T01:42:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f717fa640 1 -- 172.21.15.2:0/1248236696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f6401c460 con 0x7f3f740cb400 2023-11-04T01:42:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f717fa640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f540664a0 0x7f3f54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:44.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f717fa640 1 -- 172.21.15.2:0/1248236696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f64083c10 con 0x7f3f740cb400 2023-11-04T01:42:44.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f6b7fe640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f540664a0 0x7f3f54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:44.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.767+0000 7f3f6b7fe640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f540664a0 0x7f3f54068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f740b5f90 tx=0x7f3f5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:44.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.771+0000 7f3f717fa640 1 -- 172.21.15.2:0/1248236696 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f64051120 con 0x7f3f740cb400 2023-11-04T01:42:44.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.959+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f7406c690 con 0x7f3f740cb400 2023-11-04T01:42:44.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.959+0000 7f3f717fa640 1 -- 172.21.15.2:0/1248236696 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f7406c690 con 0x7f3f740cb400 2023-11-04T01:42:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:44.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f540664a0 msgr2=0x7f3f54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f540664a0 0x7f3f54068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f740b5f90 tx=0x7f3f5c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:44.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cb400 msgr2=0x7f3f74151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:44.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cb400 0x7f3f74151cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400c450 tx=0x7f3f6400c910 comp rx=0 tx=0).stop 2023-11-04T01:42:44.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 shutdown_connections 2023-11-04T01:42:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f540664a0 0x7f3f54068960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f7415afb0 0x7f3f741f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f740cd6d0 0x7f3f7406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 --2- 172.21.15.2:0/1248236696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f740cb400 0x7f3f74151cc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 >> 172.21.15.2:0/1248236696 conn(0x7f3f74065dc0 msgr2=0x7f3f7406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 shutdown_connections 2023-11-04T01:42:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:44.963+0000 7f3f7a7a1640 1 -- 172.21.15.2:0/1248236696 wait complete. 2023-11-04T01:42:44.983 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:44.983 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:44.983 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:42:44.983 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-04T01:42:44.984 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:44.984 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:44.984 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:44.984 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:44.984 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:42:44.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.984 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:44.990 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42179sec preferred_lft 42179sec 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:44.992 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:44.993 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:42:44.993 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:44.993 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:44.993 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:42:44.993 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:44.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:44.993 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:42:45.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.047 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:42:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:42:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:42:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:42:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:42:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:45.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.101 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:45.101 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:45.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:42:45.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:42:45.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:42:45.101 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:45.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.176 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:42:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:42:45.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.224 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2023-11-04T01:42:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-04T01:42:45.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.273 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:45.273 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:45.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-04T01:42:45.273 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:45.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:42:45.404 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:45.404 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:45.405 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:45.405 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.405 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:45.405 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.405 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:45.405 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3a:2a:ee:0c:52:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:42:45.406 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:42:45.406 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.406 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::382a:eeff:fe0c:521d/64 scope link 2023-11-04T01:42:45.406 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-04T01:42:45.463 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:45.463 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:45.463 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:45.463 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.463 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:45.464 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.464 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:45.464 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 3a:2a:ee:0c:52:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:42:45.464 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:42:45.464 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.464 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::382a:eeff:fe0c:521d/64 scope link 2023-11-04T01:42:45.465 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:45.466 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-04T01:42:45.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-04T01:42:45.467 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:45.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:42:45.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.1 up 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:42:45.569 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:42:45.588 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-04T01:42:45.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:45.588 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:45.634 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-04T01:42:45.635 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:45.635 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:45.682 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:45.731 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:42:45.731 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:45.732 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:45.733 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:42:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.734 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.735 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:42:45.787 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:42:45.787 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-11-04T01:42:45.787 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-04T01:42:45.831 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:42:45.839 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:45.840 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.841 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:45.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:45.842 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:42:45.894 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:42:45.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:2023-11-04T01:42:45.915+0000 7fb648dc1580 -1 init, newargv = 0x55dd269a7730 newargc=15 2023-11-04T01:42:45.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:ceph-fuse[45061]: starting ceph client 2023-11-04T01:42:45.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:ceph-fuse[45061]: starting fuse 2023-11-04T01:42:46.996 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:47.005 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:42:47.005 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:42:47.005 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:42:47.006 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:42:47.007 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:42:47.008 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:47.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:47.009 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:42:47.055 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:42:47.056 INFO:teuthology.orchestra.run.smithi002.stdout:46 2023-11-04T01:42:47.056 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-11-04T01:42:47.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:47.056 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:42:47.057 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:42:47.057 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:42:47.057 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:42:47.057 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:47.057 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:42:47.057 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-04T01:42:47.058 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:42:47.058 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-04T01:42:47.058 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:47.058 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:42:47.058 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.2")) 2023-11-04T01:42:47.059 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:42:47.182 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.2.45061.asok 2023-11-04T01:42:47.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:47.195 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45061.asok 2023-11-04T01:42:47.195 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:47.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.2.45061.asok status 2023-11-04T01:42:47.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:47.390 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "2", 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "45061", 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:47.391 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4749, 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4749 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1314990191 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:42:47.392 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1314990191 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4749 192.168.0.2:0/1314990191", 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.2:0/1314990191", 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 6, 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 21, 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:42:47.393 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:42:47.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:47.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 Processor -- start 2023-11-04T01:42:47.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- start start 2023-11-04T01:42:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc12015a1f0 0x7fc1200cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200b0d40 0x7fc1200704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200ccee0 con 0x7fc1200cdea0 2023-11-04T01:42:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12015a5d0 con 0x7fc12015a1f0 2023-11-04T01:42:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200ca900 con 0x7fc1200b0d40 2023-11-04T01:42:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc12015a1f0 0x7fc1200cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc124c2e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200b0d40 0x7fc1200704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc12015a1f0 0x7fc1200cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:44762/0 (socket says 172.21.15.2:44762) 2023-11-04T01:42:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 -- 172.21.15.2:0/365803368 learned_addr learned my addr 172.21.15.2:0/365803368 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 -- 172.21.15.2:0/365803368 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200b0d40 msgr2=0x7fc1200704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 --2- 172.21.15.2:0/365803368 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200b0d40 0x7fc1200704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 -- 172.21.15.2:0/365803368 >> v1:172.21.15.90:6789/0 conn(0x7fc1200cdea0 legacy=0x7fc1200b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 -- 172.21.15.2:0/365803368 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1200cabe0 con 0x7fc12015a1f0 2023-11-04T01:42:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11ffff640 1 --2- 172.21.15.2:0/365803368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc12015a1f0 0x7fc1200cd370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc110009870 tx=0x7fc11001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379f43f693d1c6d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11effd640 1 -- 172.21.15.2:0/365803368 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1100aa670 con 0x7fc12015a1f0 2023-11-04T01:42:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11effd640 1 -- 172.21.15.2:0/365803368 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1100aa7d0 con 0x7fc12015a1f0 2023-11-04T01:42:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc11effd640 1 -- 172.21.15.2:0/365803368 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1100aab60 con 0x7fc12015a1f0 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- 172.21.15.2:0/365803368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc12015a1f0 msgr2=0x7fc1200cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 --2- 172.21.15.2:0/365803368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc12015a1f0 0x7fc1200cd370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc110009870 tx=0x7fc11001c510 comp rx=0 tx=0).stop 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- 172.21.15.2:0/365803368 shutdown_connections 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 --2- 172.21.15.2:0/365803368 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200b0d40 0x7fc1200704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 --2- 172.21.15.2:0/365803368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc12015a1f0 0x7fc1200cd370 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- 172.21.15.2:0/365803368 >> 172.21.15.2:0/365803368 conn(0x7fc1200cebb0 msgr2=0x7fc1200cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- 172.21.15.2:0/365803368 shutdown_connections 2023-11-04T01:42:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.530+0000 7fc126691640 1 -- 172.21.15.2:0/365803368 wait complete. 2023-11-04T01:42:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 Processor -- start 2023-11-04T01:42:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 -- start start 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1200b0d40 0x7fc1201f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200cdea0 0x7fc1200b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc12015a1f0 0x7fc1200cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200c2270 con 0x7fc12015a1f0 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200c7390 con 0x7fc1200b0d40 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200c6780 con 0x7fc1200cdea0 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc12015a1f0 0x7fc1200cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc12015a1f0 0x7fc1200cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46938/0 (socket says 172.21.15.2:46938) 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 -- 172.21.15.2:0/4208298504 learned_addr learned my addr 172.21.15.2:0/4208298504 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc11ffff640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1200b0d40 0x7fc1201f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc11f7fe640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200cdea0 0x7fc1200b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 -- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200cdea0 msgr2=0x7fc1200b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200cdea0 0x7fc1200b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 -- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1200b0d40 msgr2=0x7fc1201f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1200b0d40 0x7fc1201f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 -- 172.21.15.2:0/4208298504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1100094d0 con 0x7fc12015a1f0 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc11ffff640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1200b0d40 0x7fc1201f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc124c2e640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc12015a1f0 0x7fc1200cb7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc11800ea90 tx=0x7fc11800ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc11cff9640 1 -- 172.21.15.2:0/4208298504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118010440 con 0x7fc12015a1f0 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc11cff9640 1 -- 172.21.15.2:0/4208298504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1180105a0 con 0x7fc12015a1f0 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1200c6a60 con 0x7fc12015a1f0 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc11cff9640 1 -- 172.21.15.2:0/4208298504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118010930 con 0x7fc12015a1f0 2023-11-04T01:42:47.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1200c7020 con 0x7fc12015a1f0 2023-11-04T01:42:47.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.534+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1200744a0 con 0x7fc12015a1f0 2023-11-04T01:42:47.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.538+0000 7fc11cff9640 1 -- 172.21.15.2:0/4208298504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc118010a90 con 0x7fc12015a1f0 2023-11-04T01:42:47.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.538+0000 7fc11cff9640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc10c0664a0 0x7fc10c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:47.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.538+0000 7fc11cff9640 1 -- 172.21.15.2:0/4208298504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc118084790 con 0x7fc12015a1f0 2023-11-04T01:42:47.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.538+0000 7fc11ffff640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc10c0664a0 0x7fc10c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:47.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.538+0000 7fc11ffff640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc10c0664a0 0x7fc10c068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1100ae000 tx=0x7fc1100a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:47.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.542+0000 7fc11cff9640 1 -- 172.21.15.2:0/4208298504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc118051cf0 con 0x7fc12015a1f0 2023-11-04T01:42:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.730+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc1200c74d0 con 0x7fc12015a1f0 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.730+0000 7fc11cff9640 1 -- 172.21.15.2:0/4208298504 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc11801d060 con 0x7fc12015a1f0 2023-11-04T01:42:47.738 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc10c0664a0 msgr2=0x7fc10c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc10c0664a0 0x7fc10c068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1100ae000 tx=0x7fc1100a7000 comp rx=0 tx=0).stop 2023-11-04T01:42:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc12015a1f0 msgr2=0x7fc1200cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc12015a1f0 0x7fc1200cb7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc11800ea90 tx=0x7fc11800ef50 comp rx=0 tx=0).stop 2023-11-04T01:42:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 shutdown_connections 2023-11-04T01:42:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc10c0664a0 0x7fc10c068960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc12015a1f0 0x7fc1200cb7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc1200cdea0 0x7fc1200b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 --2- 172.21.15.2:0/4208298504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1200b0d40 0x7fc1201f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 >> 172.21.15.2:0/4208298504 conn(0x7fc1200cebb0 msgr2=0x7fc120162670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 shutdown_connections 2023-11-04T01:42:47.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:47.734+0000 7fc126691640 1 -- 172.21.15.2:0/4208298504 wait complete. 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:47.757 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:42:47.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:47.758 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2023-11-04T01:42:47.764 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:47.764 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:47.764 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:47.764 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-04T01:42:47.765 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42191sec preferred_lft 42191sec 2023-11-04T01:42:47.766 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2023-11-04T01:42:47.766 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:47.766 INFO:teuthology.orchestra.run.smithi090.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:42:47.766 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 02:42:1a:70:67:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:47.766 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:42:47.766 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:47.766 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-04T01:42:47.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:47.766 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:47.766 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:47.767 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2023-11-04T01:42:47.767 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2023-11-04T01:42:47.767 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2023-11-04T01:42:47.767 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-04T01:42:47.767 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:47.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:47.852 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:47.911 INFO:teuthology.orchestra.run.smithi090.stdout:1 2023-11-04T01:42:47.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:47.914 DEBUG:teuthology.orchestra.run.smithi090:> route 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:42:47.988 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:47.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:47.989 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:47.989 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:47.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:42:47.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:42:47.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:42:47.989 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:48.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.069 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-11-04T01:42:48.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.122 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2023-11-04T01:42:48.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.169 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:48.169 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:48.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:48.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-04T01:42:48.169 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:48.238 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-04T01:42:48.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-04T01:42:48.239 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:48.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.347 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:48.347 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:48.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2023-11-04T01:42:48.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2023-11-04T01:42:48.347 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:48.365 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-04T01:42:48.365 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:48.365 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:48.412 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-04T01:42:48.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:48.412 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:48.460 DEBUG:teuthology.orchestra.run.smithi090:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:/sys 2023-11-04T01:42:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:/proc 2023-11-04T01:42:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:/dev 2023-11-04T01:42:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/pts 2023-11-04T01:42:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:/run 2023-11-04T01:42:48.509 INFO:teuthology.orchestra.run.smithi090.stdout:/ 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/security 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/shm 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/run/lock 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/cgroup 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/pstore 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/bpf 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/hugepages 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/mqueue 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/debug 2023-11-04T01:42:48.510 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/tracing 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/fs/nfsd 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/config 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/run/rpc_pipefs 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/run/user/1000 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:48.511 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:48.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.512 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2023-11-04T01:42:48.561 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:42:48.561 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-04T01:42:48.605 DEBUG:teuthology.orchestra.run.smithi090:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:48.611 INFO:teuthology.orchestra.run.smithi090.stdout:/sys 2023-11-04T01:42:48.611 INFO:teuthology.orchestra.run.smithi090.stdout:/proc 2023-11-04T01:42:48.611 INFO:teuthology.orchestra.run.smithi090.stdout:/dev 2023-11-04T01:42:48.611 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/pts 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/run 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/ 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/security 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/shm 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/run/lock 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/cgroup 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/pstore 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/bpf 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/hugepages 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/mqueue 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/debug 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/tracing 2023-11-04T01:42:48.612 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/fs/nfsd 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/config 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/run/rpc_pipefs 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/run/user/1000 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:42:48.613 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns 2023-11-04T01:42:48.614 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:48.614 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:48.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:48.615 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2023-11-04T01:42:48.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi090.stderr:2023-11-04T01:42:48.696+0000 7fab4453d580 -1 init, newargv = 0x55ccd4fbab00 newargc=15 2023-11-04T01:42:48.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi090.stderr:ceph-fuse[43526]: starting ceph client 2023-11-04T01:42:48.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi090.stderr:ceph-fuse[43526]: starting fuse 2023-11-04T01:42:49.763 DEBUG:teuthology.orchestra.run.smithi090:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:49.772 INFO:teuthology.orchestra.run.smithi090.stdout:/sys 2023-11-04T01:42:49.772 INFO:teuthology.orchestra.run.smithi090.stdout:/proc 2023-11-04T01:42:49.772 INFO:teuthology.orchestra.run.smithi090.stdout:/dev 2023-11-04T01:42:49.772 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/pts 2023-11-04T01:42:49.772 INFO:teuthology.orchestra.run.smithi090.stdout:/run 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/ 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/security 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/shm 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/run/lock 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/cgroup 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/pstore 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/bpf 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/hugepages 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/mqueue 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/debug 2023-11-04T01:42:49.773 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/tracing 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/fs/nfsd 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/config 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/run/rpc_pipefs 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/run/user/1000 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:42:49.774 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns 2023-11-04T01:42:49.775 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:49.775 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:49.775 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:49.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:49.776 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2023-11-04T01:42:49.829 INFO:teuthology.orchestra.run.smithi090.stdout:45 2023-11-04T01:42:49.829 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> import re 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> import os 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> def _find_admin_socket(client_name): 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-04T01:42:49.830 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> contents = proc_f.read() 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> if mountpoint in contents: 2023-11-04T01:42:49.831 DEBUG:teuthology.orchestra.run.smithi090:> return f 2023-11-04T01:42:49.832 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:49.832 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:49.832 DEBUG:teuthology.orchestra.run.smithi090:> print(_find_admin_socket("client.1")) 2023-11-04T01:42:49.832 DEBUG:teuthology.orchestra.run.smithi090:> ' 2023-11-04T01:42:49.958 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.1.43526.asok 2023-11-04T01:42:49.961 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:49.969 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43526.asok 2023-11-04T01:42:49.970 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:49.970 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.1.43526.asok status 2023-11-04T01:42:50.058 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:50.160 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2023-11-04T01:42:50.160 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "1", 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "43526", 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2023-11-04T01:42:50.161 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4472, 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4472 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:50.162 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1185923912 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:42:50.163 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 1185923912 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.4472 192.168.0.1:0/1185923912", 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "192.168.0.1:0/1185923912", 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 6, 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 21, 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "blocklisted": false, 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2023-11-04T01:42:50.164 INFO:teuthology.orchestra.run.smithi090.stdout:} 2023-11-04T01:42:50.174 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:50.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:42:50.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.314+0000 7f93040b4640 1 Processor -- start 2023-11-04T01:42:50.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f93040b4640 1 -- start start 2023-11-04T01:42:50.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f93040b4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 0x7f92fc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f93040b4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0ce9b0 con 0x7f92fc15aec0 2023-11-04T01:42:50.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f93040b4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0d0940 con 0x7f92fc0cdee0 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f93040b4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc15e8a0 con 0x7f92fc15d840 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9301e50640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f92fc15aec0 0x7f92fc0cd7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58228/0 (socket says 172.21.15.2:58228) 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9301e50640 1 -- 172.21.15.2:0/534467311 learned_addr learned my addr 172.21.15.2:0/534467311 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9302651640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 0x7f92fc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276881915 0 0) 0x7f92fc0ce9b0 con 0x7f92fc15aec0 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e8003530 con 0x7f92fc15aec0 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2602840980 0 0) 0x7f92e8003530 con 0x7f92fc15aec0 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 msgr2=0x7f92fc06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 0x7f92fc06c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 >> v1:172.21.15.90:6789/0 conn(0x7f92fc0cdee0 legacy=0x7f92fc0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc15b2a0 con 0x7f92fc15aec0 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f92f4001680 con 0x7f92fc15aec0 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 >> v1:172.21.15.2:6789/0 conn(0x7f92fc15aec0 legacy=0x7f92fc0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 0x7f92e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc15e8a0 con 0x7f92e8004d10 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e800bb50 con 0x7f92e80039b0 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e800bd10 con 0x7f92fc15d840 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9302651640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9301e50640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f930164f640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 0x7f92e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9302651640 1 -- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 msgr2=0x7f92e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9302651640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc15d840 0x7f92e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9302651640 1 -- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e80039b0 msgr2=0x7f92e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:50.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9302651640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9302651640 1 -- 172.21.15.2:0/534467311 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8003530 con 0x7f92e8004d10 2023-11-04T01:42:50.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.318+0000 7f9301e50640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92e80039b0 0x7f92e8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9302651640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92e8005190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009fc0 tx=0x7f92f801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24513f641315abf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80a5b30 con 0x7f92e8004d10 2023-11-04T01:42:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f800f040 con 0x7f92e8004d10 2023-11-04T01:42:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9300e4e640 1 -- 172.21.15.2:0/534467311 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80ad440 con 0x7f92e8004d10 2023-11-04T01:42:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- 172.21.15.2:0/534467311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 msgr2=0x7f92e8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 --2- 172.21.15.2:0/534467311 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92e8005190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009fc0 tx=0x7f92f801cc30 comp rx=0 tx=0).stop 2023-11-04T01:42:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9302651640 1 -- 172.21.15.2:0/534467311 reap_dead start 2023-11-04T01:42:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- 172.21.15.2:0/534467311 shutdown_connections 2023-11-04T01:42:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- 172.21.15.2:0/534467311 >> 172.21.15.2:0/534467311 conn(0x7f92fc0b28f0 msgr2=0x7f92fc0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- 172.21.15.2:0/534467311 shutdown_connections 2023-11-04T01:42:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- 172.21.15.2:0/534467311 wait complete. 2023-11-04T01:42:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 Processor -- start 2023-11-04T01:42:50.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- start start 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92fc153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92fc0ac8c0 0x7f92fc15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc0ae760 0x7f92fc15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0ada40 con 0x7f92e8004d10 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0c9360 con 0x7f92fc0ac8c0 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f93040b4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0acdc0 con 0x7f92fc0ae760 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92fc153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92fc153220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46962/0 (socket says 172.21.15.2:46962) 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 -- 172.21.15.2:0/2571044934 learned_addr learned my addr 172.21.15.2:0/2571044934 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:50.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f930164f640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92fc0ac8c0 0x7f92fc15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9302651640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc0ae760 0x7f92fc15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 -- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc0ae760 msgr2=0x7f92fc15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc0ae760 0x7f92fc15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 -- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92fc0ac8c0 msgr2=0x7f92fc15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92fc0ac8c0 0x7f92fc15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.322+0000 7f9301e50640 1 -- 172.21.15.2:0/2571044934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0ad0a0 con 0x7f92e8004d10 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f9301e50640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92fc153220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92f40010f0 tx=0x7f92f400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f92f27fc640 1 -- 172.21.15.2:0/2571044934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f400eea0 con 0x7f92e8004d10 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f92f27fc640 1 -- 172.21.15.2:0/2571044934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f400c870 con 0x7f92e8004d10 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc0ad380 con 0x7f92e8004d10 2023-11-04T01:42:50.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f92f27fc640 1 -- 172.21.15.2:0/2571044934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f400cbe0 con 0x7f92e8004d10 2023-11-04T01:42:50.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc153760 con 0x7f92e8004d10 2023-11-04T01:42:50.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc0b35c0 con 0x7f92e8004d10 2023-11-04T01:42:50.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f92f27fc640 1 -- 172.21.15.2:0/2571044934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92f400cd40 con 0x7f92e8004d10 2023-11-04T01:42:50.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f92f27fc640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92e00664a0 0x7f92e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:50.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f92f27fc640 1 -- 172.21.15.2:0/2571044934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92f4083ea0 con 0x7f92e8004d10 2023-11-04T01:42:50.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f930164f640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92e00664a0 0x7f92e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:50.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.326+0000 7f930164f640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92e00664a0 0x7f92e0068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0c7fd0 tx=0x7f92ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:50.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.330+0000 7f92f27fc640 1 -- 172.21.15.2:0/2571044934 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92f4051280 con 0x7f92e8004d10 2023-11-04T01:42:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.522+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92fc0b6d60 con 0x7f92e8004d10 2023-11-04T01:42:50.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.522+0000 7f92f27fc640 1 -- 172.21.15.2:0/2571044934 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f92f4001500 con 0x7f92e8004d10 2023-11-04T01:42:50.525 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92e00664a0 msgr2=0x7f92e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92e00664a0 0x7f92e0068960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0c7fd0 tx=0x7f92ec009040 comp rx=0 tx=0).stop 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 msgr2=0x7f92fc153220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92fc153220 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f92f40010f0 tx=0x7f92f400ecb0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 shutdown_connections 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92e00664a0 0x7f92e0068960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92fc0ae760 0x7f92fc15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92fc0ac8c0 0x7f92fc15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 --2- 172.21.15.2:0/2571044934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92e8004d10 0x7f92fc153220 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 >> 172.21.15.2:0/2571044934 conn(0x7f92fc0b28f0 msgr2=0x7f92fc15c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 shutdown_connections 2023-11-04T01:42:50.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:50.526+0000 7f93040b4640 1 -- 172.21.15.2:0/2571044934 wait complete. 2023-11-04T01:42:50.544 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:42:50.544 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:42:50.544 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2023-11-04T01:42:50.545 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-04T01:42:50.545 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:50.545 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:42:50.545 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:42:50.545 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:42:50.545 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:42:50.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.545 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2023-11-04T01:42:50.552 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:50.552 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:50.552 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:50.552 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.552 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.553 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42188sec preferred_lft 42188sec 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::ec4:7aff:fe8f:d767/64 scope link 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 02:42:1a:70:67:d8 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.554 INFO:teuthology.orchestra.run.smithi090.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:42:50.555 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:50.555 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:42:50.555 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.555 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:42:50.608 INFO:teuthology.orchestra.run.smithi090.stdout:1 2023-11-04T01:42:50.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.610 DEBUG:teuthology.orchestra.run.smithi090:> route 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-04T01:42:50.661 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:42:50.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.662 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:50.662 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:50.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-04T01:42:50.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-04T01:42:50.662 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-04T01:42:50.662 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:50.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.736 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-11-04T01:42:50.785 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:42:50.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.786 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2023-11-04T01:42:50.833 INFO:teuthology.orchestra.run.smithi090.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-04T01:42:50.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.834 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:50.834 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:50.834 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:42:50.834 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-04T01:42:50.834 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:50.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.899 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:42:50.955 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:50.955 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:50.955 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether ae:d4:fd:71:d9:5d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::acd4:fdff:fe71:d95d/64 scope link 2023-11-04T01:42:50.956 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:50.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:50.958 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-04T01:42:51.013 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:42:51.013 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether ae:d4:fd:71:d9:5d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::acd4:fdff:fe71:d95d/64 scope link 2023-11-04T01:42:51.014 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:42:51.015 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-04T01:42:51.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-04T01:42:51.016 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:51.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:51.111 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec bash -c ' 2023-11-04T01:42:51.111 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2023-11-04T01:42:51.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.1 up 2023-11-04T01:42:51.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.1 master ceph-brx 2023-11-04T01:42:51.111 DEBUG:teuthology.orchestra.run.smithi090:> ') 2023-11-04T01:42:51.131 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-04T01:42:51.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:51.131 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:51.176 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-04T01:42:51.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:42:51.176 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:51.228 DEBUG:teuthology.orchestra.run.smithi090:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:51.279 INFO:teuthology.orchestra.run.smithi090.stdout:/sys 2023-11-04T01:42:51.280 INFO:teuthology.orchestra.run.smithi090.stdout:/proc 2023-11-04T01:42:51.280 INFO:teuthology.orchestra.run.smithi090.stdout:/dev 2023-11-04T01:42:51.280 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/pts 2023-11-04T01:42:51.280 INFO:teuthology.orchestra.run.smithi090.stdout:/run 2023-11-04T01:42:51.280 INFO:teuthology.orchestra.run.smithi090.stdout:/ 2023-11-04T01:42:51.280 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/security 2023-11-04T01:42:51.281 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/shm 2023-11-04T01:42:51.281 INFO:teuthology.orchestra.run.smithi090.stdout:/run/lock 2023-11-04T01:42:51.281 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/cgroup 2023-11-04T01:42:51.281 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/pstore 2023-11-04T01:42:51.281 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/bpf 2023-11-04T01:42:51.282 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:51.282 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/hugepages 2023-11-04T01:42:51.282 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/mqueue 2023-11-04T01:42:51.282 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/debug 2023-11-04T01:42:51.282 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/tracing 2023-11-04T01:42:51.283 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/fs/nfsd 2023-11-04T01:42:51.283 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:51.283 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/config 2023-11-04T01:42:51.283 INFO:teuthology.orchestra.run.smithi090.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:51.283 INFO:teuthology.orchestra.run.smithi090.stdout:/run/rpc_pipefs 2023-11-04T01:42:51.283 INFO:teuthology.orchestra.run.smithi090.stdout:/run/user/1000 2023-11-04T01:42:51.284 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph 2023-11-04T01:42:51.284 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:42:51.284 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:42:51.284 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:42:51.284 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:42:51.284 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns 2023-11-04T01:42:51.285 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:51.285 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:51.285 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:51.285 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:42:51.285 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:42:51.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:51.287 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2023-11-04T01:42:51.337 INFO:teuthology.orchestra.run.smithi090.stdout:45 2023-11-04T01:42:51.337 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-11-04T01:42:51.337 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-04T01:42:51.382 DEBUG:teuthology.orchestra.run.smithi090:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/sys 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/proc 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/dev 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/pts 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/run 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/ 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/security 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/shm 2023-11-04T01:42:51.389 INFO:teuthology.orchestra.run.smithi090.stdout:/run/lock 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/cgroup 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/pstore 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/bpf 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/hugepages 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/mqueue 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/debug 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/tracing 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/fs/nfsd 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:51.390 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/config 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/run/rpc_pipefs 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/run/user/1000 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:51.391 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:42:51.393 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:42:51.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:51.394 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2023-11-04T01:42:51.441 INFO:teuthology.orchestra.run.smithi090.stdout:45 2023-11-04T01:42:51.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi090.stderr:2023-11-04T01:42:51.460+0000 7f905e2a2580 -1 init, newargv = 0x564e3b452480 newargc=15 2023-11-04T01:42:51.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi090.stderr:ceph-fuse[43636]: starting ceph client 2023-11-04T01:42:51.474 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi090.stderr:ceph-fuse[43636]: starting fuse 2023-11-04T01:42:52.543 DEBUG:teuthology.orchestra.run.smithi090:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:42:52.552 INFO:teuthology.orchestra.run.smithi090.stdout:/sys 2023-11-04T01:42:52.552 INFO:teuthology.orchestra.run.smithi090.stdout:/proc 2023-11-04T01:42:52.552 INFO:teuthology.orchestra.run.smithi090.stdout:/dev 2023-11-04T01:42:52.552 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/pts 2023-11-04T01:42:52.552 INFO:teuthology.orchestra.run.smithi090.stdout:/run 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/ 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/security 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/shm 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/run/lock 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/cgroup 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/pstore 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/bpf 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/hugepages 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/dev/mqueue 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/debug 2023-11-04T01:42:52.553 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/tracing 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/proc/fs/nfsd 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/fs/fuse/connections 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/sys/kernel/config 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/run/rpc_pipefs 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/run/user/1000 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-4 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-5 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-6 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/var/lib/ceph/osd/ceph-7 2023-11-04T01:42:52.554 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns 2023-11-04T01:42:52.555 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:52.555 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:42:52.555 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:52.555 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:42:52.555 INFO:teuthology.orchestra.run.smithi090.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:42:52.555 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:52.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:42:52.556 DEBUG:teuthology.orchestra.run.smithi090:> ls /sys/fs/fuse/connections 2023-11-04T01:42:52.606 INFO:teuthology.orchestra.run.smithi090.stdout:45 2023-11-04T01:42:52.606 INFO:teuthology.orchestra.run.smithi090.stdout:46 2023-11-04T01:42:52.606 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-11-04T01:42:52.606 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:42:52.606 DEBUG:teuthology.orchestra.run.smithi090:> import glob 2023-11-04T01:42:52.606 DEBUG:teuthology.orchestra.run.smithi090:> import re 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> import os 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> import subprocess 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> def _find_admin_socket(client_name): 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> files = glob.glob(asok_path) 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> # Given a non-glob path, it better be there 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> if "*" not in asok_path: 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> assert(len(files) == 1) 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> return files[0] 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi090:> for f in files: 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> contents = proc_f.read() 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> if mountpoint in contents: 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> return f 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> print(_find_admin_socket("client.3")) 2023-11-04T01:42:52.608 DEBUG:teuthology.orchestra.run.smithi090:> ' 2023-11-04T01:42:52.729 INFO:teuthology.orchestra.run.smithi090.stdout:/var/run/ceph/ceph-client.3.43636.asok 2023-11-04T01:42:52.733 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:52.741 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43636.asok 2023-11-04T01:42:52.741 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:52.741 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.3.43636.asok status 2023-11-04T01:42:52.832 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout: "metadata": { 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout: "entity_id": "3", 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout: "hostname": "smithi090", 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-04T01:42:52.937 INFO:teuthology.orchestra.run.smithi090.stdout: "pid": "43636", 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "root": "/" 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_count": 0, 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "dentry_pinned_count": 0, 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4481, 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "inst": { 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "name": { 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "client", 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "num": 4481 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2023-11-04T01:42:52.938 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 3377290613 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: } 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": { 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "type": "v1", 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "addr": "192.168.0.2:0", 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "nonce": 3377290613 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "inst_str": "client.4481 192.168.0.2:0/3377290613", 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "addr_str": "192.168.0.2:0/3377290613", 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "inode_count": 1, 2023-11-04T01:42:52.939 INFO:teuthology.orchestra.run.smithi090.stdout: "mds_epoch": 6, 2023-11-04T01:42:52.940 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch": 21, 2023-11-04T01:42:52.940 INFO:teuthology.orchestra.run.smithi090.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:42:52.940 INFO:teuthology.orchestra.run.smithi090.stdout: "blocklisted": false, 2023-11-04T01:42:52.940 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs" 2023-11-04T01:42:52.940 INFO:teuthology.orchestra.run.smithi090.stdout:} 2023-11-04T01:42:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:52.957 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:52.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:52.957 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:53.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.015 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:42:53.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.024 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:53.024 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:53.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:42:53.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.088 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:53.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:53.089 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.134 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:42:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.141 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:53.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:53.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-04T01:42:53.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.239 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:53.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:53.239 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:53.293 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.295 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2023-11-04T01:42:53.295 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.302 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:53.302 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:53.302 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-04T01:42:53.347 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.347 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.354 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:53.354 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:42:53.354 DEBUG:teuthology.orchestra.run.smithi090:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:53.446 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.447 INFO:teuthology.orchestra.run.smithi090.stdout:fuseblk 2023-11-04T01:42:53.448 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.454 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:53.454 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:42:53.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-04T01:42:53.502 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:42:53.503 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:42:53.510 INFO:teuthology.run_tasks:Running task exec... 2023-11-04T01:42:53.520 INFO:teuthology.task.exec:Executing custom commands... 2023-11-04T01:42:53.520 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:42:53.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/crash/warn_recent_interval 0' 2023-11-04T01:42:53.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 Processor -- start 2023-11-04T01:42:53.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 -- start start 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73f8143510 0x7f73f8070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f80711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f73f80cc170 0x7f73f815d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80cb430 con 0x7f73f8143510 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80cb6b0 con 0x7f73f80cc170 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73ff263640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f815e5b0 con 0x7f73f81438f0 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73f8143510 0x7f73f8070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73f8143510 0x7f73f8070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37618/0 (socket says 172.21.15.2:37618) 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 -- 172.21.15.2:0/3837641553 learned_addr learned my addr 172.21.15.2:0/3837641553 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:53.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73f7fff640 1 --2- 172.21.15.2:0/3837641553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f80711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fd800640 1 --2- 172.21.15.2:0/3837641553 >> v2:172.21.15.90:3300/0 conn(0x7f73f80cc170 0x7f73f815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 -- 172.21.15.2:0/3837641553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 msgr2=0x7f73f80711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 --2- 172.21.15.2:0/3837641553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f80711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 -- 172.21.15.2:0/3837641553 >> v2:172.21.15.90:3300/0 conn(0x7f73f80cc170 msgr2=0x7f73f815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 --2- 172.21.15.2:0/3837641553 >> v2:172.21.15.90:3300/0 conn(0x7f73f80cc170 0x7f73f815d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73fcfff640 1 -- 172.21.15.2:0/3837641553 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80cb970 con 0x7f73f8143510 2023-11-04T01:42:53.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.654+0000 7f73f7fff640 1 --2- 172.21.15.2:0/3837641553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:53.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73fcfff640 1 --2- 172.21.15.2:0/3837641553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8143510 0x7f73f8070c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73f8072440 tx=0x7f73f001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329cc8f65c28f1f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73f77fe640 1 -- 172.21.15.2:0/3837641553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00a5870 con 0x7f73f8143510 2023-11-04T01:42:53.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73f77fe640 1 -- 172.21.15.2:0/3837641553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00a59d0 con 0x7f73f8143510 2023-11-04T01:42:53.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73f77fe640 1 -- 172.21.15.2:0/3837641553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00a5d60 con 0x7f73f8143510 2023-11-04T01:42:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 -- 172.21.15.2:0/3837641553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8143510 msgr2=0x7f73f8070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 --2- 172.21.15.2:0/3837641553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8143510 0x7f73f8070c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f73f8072440 tx=0x7f73f001c9d0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 -- 172.21.15.2:0/3837641553 shutdown_connections 2023-11-04T01:42:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 --2- 172.21.15.2:0/3837641553 >> v2:172.21.15.90:3300/0 conn(0x7f73f80cc170 0x7f73f815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 --2- 172.21.15.2:0/3837641553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f80711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 --2- 172.21.15.2:0/3837641553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f8143510 0x7f73f8070c80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 -- 172.21.15.2:0/3837641553 >> 172.21.15.2:0/3837641553 conn(0x7f73f80cfbf0 msgr2=0x7f73f80d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 -- 172.21.15.2:0/3837641553 shutdown_connections 2023-11-04T01:42:53.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 -- 172.21.15.2:0/3837641553 wait complete. 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 Processor -- start 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.658+0000 7f73ff263640 1 -- start start 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f80cc170 0x7f73f806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8143510 0x7f73f8159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f81641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f813ed60 con 0x7f73f80cc170 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8159750 con 0x7f73f8143510 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f81646e0 con 0x7f73f81438f0 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f80cc170 0x7f73f806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f80cc170 0x7f73f806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37634/0 (socket says 172.21.15.2:37634) 2023-11-04T01:42:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 -- 172.21.15.2:0/2268491823 learned_addr learned my addr 172.21.15.2:0/2268491823 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73f7fff640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8143510 0x7f73f8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fd800640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f81641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 -- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 msgr2=0x7f73f81641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f81641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 -- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8143510 msgr2=0x7f73f8159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8143510 0x7f73f8159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 -- 172.21.15.2:0/2268491823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0009b30 con 0x7f73f80cc170 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73fcfff640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f80cc170 0x7f73f806ab40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73f00af040 tx=0x7f73f0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73f57fa640 1 -- 172.21.15.2:0/2268491823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00b8880 con 0x7f73f80cc170 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73f57fa640 1 -- 172.21.15.2:0/2268491823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f00b8a00 con 0x7f73f80cc170 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73f57fa640 1 -- 172.21.15.2:0/2268491823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f00b8db0 con 0x7f73f80cc170 2023-11-04T01:42:53.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f8165410 con 0x7f73f80cc170 2023-11-04T01:42:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f813e980 con 0x7f73f80cc170 2023-11-04T01:42:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f813eea0 con 0x7f73f80cc170 2023-11-04T01:42:53.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73f57fa640 1 -- 172.21.15.2:0/2268491823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f73f00b6440 con 0x7f73f80cc170 2023-11-04T01:42:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73f57fa640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73d80664a0 0x7f73d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.662+0000 7f73f57fa640 1 -- 172.21.15.2:0/2268491823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73f011f290 con 0x7f73f80cc170 2023-11-04T01:42:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.666+0000 7f73f7fff640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73d80664a0 0x7f73d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.666+0000 7f73f7fff640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73d80664a0 0x7f73d8068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f73f806b260 tx=0x7f73e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.670+0000 7f73f57fa640 1 -- 172.21.15.2:0/2268491823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f73f00ec850 con 0x7f73f80cc170 2023-11-04T01:42:53.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.826+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/crash/warn_recent_interval}] v 0) v1 -- 0x7f73f8074770 con 0x7f73f80cc170 2023-11-04T01:42:53.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.830+0000 7f73f57fa640 1 -- 172.21.15.2:0/2268491823 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/crash/warn_recent_interval}]=0 v10)=0 v10) v1 ==== 128+0+0 (secure 0 0 0) 0x7f73f00efe70 con 0x7f73f80cc170 2023-11-04T01:42:53.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73d80664a0 msgr2=0x7f73d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73d80664a0 0x7f73d8068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f73f806b260 tx=0x7f73e0008040 comp rx=0 tx=0).stop 2023-11-04T01:42:53.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f80cc170 msgr2=0x7f73f806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f80cc170 0x7f73f806ab40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73f00af040 tx=0x7f73f0019770 comp rx=0 tx=0).stop 2023-11-04T01:42:53.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 shutdown_connections 2023-11-04T01:42:53.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73d80664a0 0x7f73d8068960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f73f81438f0 0x7f73f81641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73f8143510 0x7f73f8159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 --2- 172.21.15.2:0/2268491823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73f80cc170 0x7f73f806ab40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 >> 172.21.15.2:0/2268491823 conn(0x7f73f80cfbf0 msgr2=0x7f73f80cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 shutdown_connections 2023-11-04T01:42:53.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.834+0000 7f73ff263640 1 -- 172.21.15.2:0/2268491823 wait complete. 2023-11-04T01:42:53.853 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-04T01:42:53.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61da03f640 1 Processor -- start 2023-11-04T01:42:53.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61da03f640 1 -- start start 2023-11-04T01:42:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61da03f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40b0890 0x7f61d40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61da03f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f61d40c9960 0x7f61d40704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61da03f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d40ce320 con 0x7f61d40b0c70 2023-11-04T01:42:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61da03f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d406d2f0 con 0x7f61d40c9960 2023-11-04T01:42:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61da03f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d40ce110 con 0x7f61d40b0890 2023-11-04T01:42:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d3fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f61d40b0c70 0x7f61d40ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41872/0 (socket says 172.21.15.2:41872) 2023-11-04T01:42:53.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d3fff640 1 -- 172.21.15.2:0/545969893 learned_addr learned my addr 172.21.15.2:0/545969893 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d37fe640 1 --2- 172.21.15.2:0/545969893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40b0890 0x7f61d40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d2ffd640 1 --2- 172.21.15.2:0/545969893 >> v2:172.21.15.90:3300/0 conn(0x7f61d40c9960 0x7f61d40704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d27fc640 1 -- 172.21.15.2:0/545969893 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210021215 0 0) 0x7f61d40ce320 con 0x7f61d40b0c70 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d27fc640 1 -- 172.21.15.2:0/545969893 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61bc003530 con 0x7f61d40b0c70 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d27fc640 1 -- 172.21.15.2:0/545969893 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977894160 0 0) 0x7f61bc003530 con 0x7f61d40b0c70 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d37fe640 1 -- 172.21.15.2:0/545969893 >> v2:172.21.15.90:3300/0 conn(0x7f61d40c9960 msgr2=0x7f61d40704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d37fe640 1 --2- 172.21.15.2:0/545969893 >> v2:172.21.15.90:3300/0 conn(0x7f61d40c9960 0x7f61d40704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d37fe640 1 -- 172.21.15.2:0/545969893 >> v1:172.21.15.2:6789/0 conn(0x7f61d40b0c70 legacy=0x7f61d40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.986+0000 7f61d37fe640 1 -- 172.21.15.2:0/545969893 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d40ce600 con 0x7f61d40b0890 2023-11-04T01:42:53.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61d37fe640 1 --2- 172.21.15.2:0/545969893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40b0890 0x7f61d40cdbd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61c40097c0 tx=0x7f61c401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e416f7e1b2005e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:53.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61d27fc640 1 -- 172.21.15.2:0/545969893 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc001a00 con 0x7f61d40b0890 2023-11-04T01:42:53.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61d27fc640 1 -- 172.21.15.2:0/545969893 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40a7050 con 0x7f61d40b0890 2023-11-04T01:42:53.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61d27fc640 1 -- 172.21.15.2:0/545969893 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40ab600 con 0x7f61d40b0890 2023-11-04T01:42:53.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 -- 172.21.15.2:0/545969893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40b0890 msgr2=0x7f61d40cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 --2- 172.21.15.2:0/545969893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40b0890 0x7f61d40cdbd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f61c40097c0 tx=0x7f61c401c370 comp rx=0 tx=0).stop 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 -- 172.21.15.2:0/545969893 shutdown_connections 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 --2- 172.21.15.2:0/545969893 >> v2:172.21.15.90:3300/0 conn(0x7f61d40c9960 0x7f61d40704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 --2- 172.21.15.2:0/545969893 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40b0890 0x7f61d40cdbd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 -- 172.21.15.2:0/545969893 >> 172.21.15.2:0/545969893 conn(0x7f61d40cebb0 msgr2=0x7f61d40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 -- 172.21.15.2:0/545969893 shutdown_connections 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 -- 172.21.15.2:0/545969893 wait complete. 2023-11-04T01:42:53.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 Processor -- start 2023-11-04T01:42:53.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.990+0000 7f61da03f640 1 -- start start 2023-11-04T01:42:53.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d40b0890 0x7f61d415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61d40b0c70 0x7f61d414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40c9960 0x7f61d40b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d415d210 con 0x7f61d40b0890 2023-11-04T01:42:54.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d415b3f0 con 0x7f61d40b0c70 2023-11-04T01:42:54.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d415b6d0 con 0x7f61d40c9960 2023-11-04T01:42:54.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d40b0890 0x7f61d415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d40b0890 0x7f61d415cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37644/0 (socket says 172.21.15.2:37644) 2023-11-04T01:42:54.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 -- 172.21.15.2:0/758060869 learned_addr learned my addr 172.21.15.2:0/758060869 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:54.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d2ffd640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61d40b0c70 0x7f61d414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d3fff640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40c9960 0x7f61d40b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 -- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40c9960 msgr2=0x7f61d40b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40c9960 0x7f61d40b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 -- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61d40b0c70 msgr2=0x7f61d414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61d40b0c70 0x7f61d414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 -- 172.21.15.2:0/758060869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4009420 con 0x7f61d40b0890 2023-11-04T01:42:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d37fe640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d40b0890 0x7f61d415cc30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61c4000c10 tx=0x7f61c4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61bbfff640 1 -- 172.21.15.2:0/758060869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4003ab0 con 0x7f61d40b0890 2023-11-04T01:42:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61bbfff640 1 -- 172.21.15.2:0/758060869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4003c10 con 0x7f61d40b0890 2023-11-04T01:42:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d415b9b0 con 0x7f61d40b0890 2023-11-04T01:42:54.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61bbfff640 1 -- 172.21.15.2:0/758060869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40b5410 con 0x7f61d40b0890 2023-11-04T01:42:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d415b0c0 con 0x7f61d40b0890 2023-11-04T01:42:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d40744a0 con 0x7f61d40b0890 2023-11-04T01:42:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61bbfff640 1 -- 172.21.15.2:0/758060869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61c40b2050 con 0x7f61d40b0890 2023-11-04T01:42:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61bbfff640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61c00664d0 0x7f61c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61bbfff640 1 -- 172.21.15.2:0/758060869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61c411e130 con 0x7f61d40b0890 2023-11-04T01:42:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.994+0000 7f61d2ffd640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61c00664d0 0x7f61c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.998+0000 7f61d2ffd640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61c00664d0 0x7f61c0068990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61d40b47b0 tx=0x7f61c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:53.998+0000 7f61bbfff640 1 -- 172.21.15.2:0/758060869 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f61c40eb5a0 con 0x7f61d40b0890 2023-11-04T01:42:54.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.154+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d40b4b30 con 0x7f61d40b0890 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61bbfff640 1 -- 172.21.15.2:0/758060869 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f61c40eebc0 con 0x7f61d40b0890 2023-11-04T01:42:54.160 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:54.161 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61c00664d0 msgr2=0x7f61c0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61c00664d0 0x7f61c0068990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f61d40b47b0 tx=0x7f61c8008040 comp rx=0 tx=0).stop 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d40b0890 msgr2=0x7f61d415cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d40b0890 0x7f61d415cc30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f61c4000c10 tx=0x7f61c4019110 comp rx=0 tx=0).stop 2023-11-04T01:42:54.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 shutdown_connections 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f61c00664d0 0x7f61c0068990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61d40c9960 0x7f61d40b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61d40b0c70 0x7f61d414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 --2- 172.21.15.2:0/758060869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61d40b0890 0x7f61d415cc30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 >> 172.21.15.2:0/758060869 conn(0x7f61d40cebb0 msgr2=0x7f61d4164330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 shutdown_connections 2023-11-04T01:42:54.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.158+0000 7f61da03f640 1 -- 172.21.15.2:0/758060869 wait complete. 2023-11-04T01:42:54.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:54.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:54.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b2b964640 1 Processor -- start 2023-11-04T01:42:54.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b2b964640 1 -- start start 2023-11-04T01:42:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b2b964640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6b240b0c20 0x7f6b2406b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b2b964640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b2406b840 0x7f6b24160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b2b964640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2406c010 con 0x7f6b2415d290 2023-11-04T01:42:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b2b964640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240c90e0 con 0x7f6b2406b840 2023-11-04T01:42:54.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b2b964640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b240ac960 con 0x7f6b240b0c20 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b29f01640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b2406b840 0x7f6b24160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b29f01640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b2406b840 0x7f6b24160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37646/0 (socket says 172.21.15.2:37646) 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b29f01640 1 -- 172.21.15.2:0/3375485324 learned_addr learned my addr 172.21.15.2:0/3375485324 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b28eff640 1 --2- 172.21.15.2:0/3375485324 >> v2:172.21.15.90:3300/0 conn(0x7f6b240b0c20 0x7f6b2406b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b29f01640 1 -- 172.21.15.2:0/3375485324 >> v2:172.21.15.90:3300/0 conn(0x7f6b240b0c20 msgr2=0x7f6b2406b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b29f01640 1 --2- 172.21.15.2:0/3375485324 >> v2:172.21.15.90:3300/0 conn(0x7f6b240b0c20 0x7f6b2406b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b29f01640 1 -- 172.21.15.2:0/3375485324 >> v1:172.21.15.90:6789/0 conn(0x7f6b2415d290 legacy=0x7f6b240b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.298+0000 7f6b29f01640 1 -- 172.21.15.2:0/3375485324 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b240acc40 con 0x7f6b2406b840 2023-11-04T01:42:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b29f01640 1 --2- 172.21.15.2:0/3375485324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2406b840 0x7f6b24160cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6b240cc410 tx=0x7f6b1c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d80571233e27aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b1bfff640 1 -- 172.21.15.2:0/3375485324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0a5820 con 0x7f6b2406b840 2023-11-04T01:42:54.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b1bfff640 1 -- 172.21.15.2:0/3375485324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c0a5980 con 0x7f6b2406b840 2023-11-04T01:42:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b1bfff640 1 -- 172.21.15.2:0/3375485324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0a5d10 con 0x7f6b2406b840 2023-11-04T01:42:54.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 -- 172.21.15.2:0/3375485324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2406b840 msgr2=0x7f6b24160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3375485324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2406b840 0x7f6b24160cb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6b240cc410 tx=0x7f6b1c01c960 comp rx=0 tx=0).stop 2023-11-04T01:42:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 -- 172.21.15.2:0/3375485324 shutdown_connections 2023-11-04T01:42:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3375485324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2406b840 0x7f6b24160cb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3375485324 >> v2:172.21.15.90:3300/0 conn(0x7f6b240b0c20 0x7f6b2406b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 -- 172.21.15.2:0/3375485324 >> 172.21.15.2:0/3375485324 conn(0x7f6b240cb510 msgr2=0x7f6b240cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 -- 172.21.15.2:0/3375485324 shutdown_connections 2023-11-04T01:42:54.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 -- 172.21.15.2:0/3375485324 wait complete. 2023-11-04T01:42:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 Processor -- start 2023-11-04T01:42:54.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.302+0000 7f6b2b964640 1 -- start start 2023-11-04T01:42:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2406b840 0x7f6b241493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b240b0c20 0x7f6b24152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2415d290 0x7f6b240ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241498e0 con 0x7f6b2415d290 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24156ca0 con 0x7f6b2406b840 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24156ef0 con 0x7f6b240b0c20 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2415d290 0x7f6b240ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2415d290 0x7f6b240ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37652/0 (socket says 172.21.15.2:37652) 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 -- 172.21.15.2:0/3256420304 learned_addr learned my addr 172.21.15.2:0/3256420304 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29700640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2406b840 0x7f6b241493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b28eff640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b240b0c20 0x7f6b24152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 -- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b240b0c20 msgr2=0x7f6b24152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b240b0c20 0x7f6b24152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 -- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2406b840 msgr2=0x7f6b241493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2406b840 0x7f6b241493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 -- 172.21.15.2:0/3256420304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c009b30 con 0x7f6b2415d290 2023-11-04T01:42:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b29f01640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2415d290 0x7f6b240ae3a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c01a590 tx=0x7f6b1c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b19ffb640 1 -- 172.21.15.2:0/3256420304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0b8670 con 0x7f6b2415d290 2023-11-04T01:42:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b19ffb640 1 -- 172.21.15.2:0/3256420304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c0b8810 con 0x7f6b2415d290 2023-11-04T01:42:54.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b19ffb640 1 -- 172.21.15.2:0/3256420304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0b8bc0 con 0x7f6b2415d290 2023-11-04T01:42:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b241571d0 con 0x7f6b2415d290 2023-11-04T01:42:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b24157790 con 0x7f6b2415d290 2023-11-04T01:42:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b24157980 con 0x7f6b2415d290 2023-11-04T01:42:54.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b19ffb640 1 -- 172.21.15.2:0/3256420304 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b1c0b8d20 con 0x7f6b2415d290 2023-11-04T01:42:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.306+0000 7f6b19ffb640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6b080664a0 0x7f6b08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.310+0000 7f6b19ffb640 1 -- 172.21.15.2:0/3256420304 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b1c11f5d0 con 0x7f6b2415d290 2023-11-04T01:42:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.310+0000 7f6b29700640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6b080664a0 0x7f6b08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.310+0000 7f6b29700640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6b080664a0 0x7f6b08068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b240ca5c0 tx=0x7f6b20009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.314+0000 7f6b19ffb640 1 -- 172.21.15.2:0/3256420304 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6b1c0ecc20 con 0x7f6b2415d290 2023-11-04T01:42:54.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.470+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b24157980 con 0x7f6b2415d290 2023-11-04T01:42:54.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.470+0000 7f6b19ffb640 1 -- 172.21.15.2:0/3256420304 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b1c0f0240 con 0x7f6b2415d290 2023-11-04T01:42:54.472 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6b080664a0 msgr2=0x7f6b08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6b080664a0 0x7f6b08068960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b240ca5c0 tx=0x7f6b20009060 comp rx=0 tx=0).stop 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2415d290 msgr2=0x7f6b240ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2415d290 0x7f6b240ae3a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c01a590 tx=0x7f6b1c019700 comp rx=0 tx=0).stop 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 shutdown_connections 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6b080664a0 0x7f6b08068960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b2415d290 0x7f6b240ae3a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6b240b0c20 0x7f6b24152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 --2- 172.21.15.2:0/3256420304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2406b840 0x7f6b241493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 >> 172.21.15.2:0/3256420304 conn(0x7f6b240cb510 msgr2=0x7f6b2415a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 shutdown_connections 2023-11-04T01:42:54.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.474+0000 7f6b2b964640 1 -- 172.21.15.2:0/3256420304 wait complete. 2023-11-04T01:42:54.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:54.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:54.605 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:42:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc7929b640 1 Processor -- start 2023-11-04T01:42:54.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc7929b640 1 -- start start 2023-11-04T01:42:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc7929b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc740cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc7929b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc74146510 0x7fbc7406cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc7929b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc74161760 con 0x7fbc741438e0 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc7929b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc74161a40 con 0x7fbc74146510 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc7929b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740d0790 con 0x7fbc7406a870 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc737fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc74146510 0x7fbc7406cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc737fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc74146510 0x7fbc7406cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37654/0 (socket says 172.21.15.2:37654) 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc737fe640 1 -- 172.21.15.2:0/254522633 learned_addr learned my addr 172.21.15.2:0/254522633 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc727fc640 1 --2- 172.21.15.2:0/254522633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc740cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc737fe640 1 -- 172.21.15.2:0/254522633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 msgr2=0x7fbc740cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc737fe640 1 --2- 172.21.15.2:0/254522633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc740cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc737fe640 1 -- 172.21.15.2:0/254522633 >> v1:172.21.15.90:6789/0 conn(0x7fbc741438e0 legacy=0x7fbc7406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc737fe640 1 -- 172.21.15.2:0/254522633 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740d0a00 con 0x7fbc74146510 2023-11-04T01:42:54.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.614+0000 7fbc727fc640 1 --2- 172.21.15.2:0/254522633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc740cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc737fe640 1 --2- 172.21.15.2:0/254522633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc74146510 0x7fbc7406cca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009e50 tx=0x7fbc6c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7d0d530ffa1016 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc71ffb640 1 -- 172.21.15.2:0/254522633 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0a5640 con 0x7fbc74146510 2023-11-04T01:42:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc71ffb640 1 -- 172.21.15.2:0/254522633 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0a57a0 con 0x7fbc74146510 2023-11-04T01:42:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc71ffb640 1 -- 172.21.15.2:0/254522633 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0a5b30 con 0x7fbc74146510 2023-11-04T01:42:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 -- 172.21.15.2:0/254522633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc74146510 msgr2=0x7fbc7406cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 --2- 172.21.15.2:0/254522633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc74146510 0x7fbc7406cca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009e50 tx=0x7fbc6c01c980 comp rx=0 tx=0).stop 2023-11-04T01:42:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 -- 172.21.15.2:0/254522633 shutdown_connections 2023-11-04T01:42:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 --2- 172.21.15.2:0/254522633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc74146510 0x7fbc7406cca0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 --2- 172.21.15.2:0/254522633 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc740cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 -- 172.21.15.2:0/254522633 >> 172.21.15.2:0/254522633 conn(0x7fbc740cfc70 msgr2=0x7fbc740d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 -- 172.21.15.2:0/254522633 shutdown_connections 2023-11-04T01:42:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 -- 172.21.15.2:0/254522633 wait complete. 2023-11-04T01:42:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 Processor -- start 2023-11-04T01:42:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.618+0000 7fbc7929b640 1 -- start start 2023-11-04T01:42:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc74160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc741438e0 0x7fbc741609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc74146510 0x7fbc741415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74160870 con 0x7fbc741438e0 2023-11-04T01:42:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74136220 con 0x7fbc74146510 2023-11-04T01:42:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74135450 con 0x7fbc7406a870 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc741438e0 0x7fbc741609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc741438e0 0x7fbc741609e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37656/0 (socket says 172.21.15.2:37656) 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 -- 172.21.15.2:0/3241657021 learned_addr learned my addr 172.21.15.2:0/3241657021 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc72ffd640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc74160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc737fe640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc74146510 0x7fbc741415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 -- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 msgr2=0x7fbc74160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc74160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 -- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc74146510 msgr2=0x7fbc741415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc74146510 0x7fbc741415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 -- 172.21.15.2:0/3241657021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c009b30 con 0x7fbc741438e0 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc727fc640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc741438e0 0x7fbc741609e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800e810 tx=0x7fbc6800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc5b7fe640 1 -- 172.21.15.2:0/3241657021 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6800c870 con 0x7fbc741438e0 2023-11-04T01:42:54.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc5b7fe640 1 -- 172.21.15.2:0/3241657021 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6800c9d0 con 0x7fbc741438e0 2023-11-04T01:42:54.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc5b7fe640 1 -- 172.21.15.2:0/3241657021 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6800cd60 con 0x7fbc741438e0 2023-11-04T01:42:54.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc74133270 con 0x7fbc741438e0 2023-11-04T01:42:54.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc74135980 con 0x7fbc741438e0 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc740675f0 con 0x7fbc741438e0 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc5b7fe640 1 -- 172.21.15.2:0/3241657021 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbc68013410 con 0x7fbc741438e0 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc5b7fe640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbc600664a0 0x7fbc60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc5b7fe640 1 -- 172.21.15.2:0/3241657021 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc68083af0 con 0x7fbc741438e0 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.622+0000 7fbc72ffd640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbc600664a0 0x7fbc60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.626+0000 7fbc72ffd640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbc600664a0 0x7fbc60068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000f70 tx=0x7fbc64009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.630+0000 7fbc5b7fe640 1 -- 172.21.15.2:0/3241657021 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc68051000 con 0x7fbc741438e0 2023-11-04T01:42:54.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc740b35f0 con 0x7fbc741438e0 2023-11-04T01:42:54.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc5b7fe640 1 -- 172.21.15.2:0/3241657021 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc68009480 con 0x7fbc741438e0 2023-11-04T01:42:54.784 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:42:54.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbc600664a0 msgr2=0x7fbc60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbc600664a0 0x7fbc60068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbc64000f70 tx=0x7fbc64009040 comp rx=0 tx=0).stop 2023-11-04T01:42:54.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc741438e0 msgr2=0x7fbc741609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc741438e0 0x7fbc741609e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800e810 tx=0x7fbc6800ecd0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 shutdown_connections 2023-11-04T01:42:54.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbc600664a0 0x7fbc60068960 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc74146510 0x7fbc741415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc741438e0 0x7fbc741609e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 --2- 172.21.15.2:0/3241657021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbc7406a870 0x7fbc74160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 >> 172.21.15.2:0/3241657021 conn(0x7fbc740cfc70 msgr2=0x7fbc740b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 shutdown_connections 2023-11-04T01:42:54.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.782+0000 7fbc7929b640 1 -- 172.21.15.2:0/3241657021 wait complete. 2023-11-04T01:42:54.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.914+0000 7fa886532640 1 Processor -- start 2023-11-04T01:42:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.914+0000 7fa886532640 1 -- start start 2023-11-04T01:42:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa886532640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88015adb0 0x7fa8800cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa886532640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa88015b190 0x7fa88015f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa886532640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8800cb220 con 0x7fa8800cced0 2023-11-04T01:42:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa886532640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88006fcd0 con 0x7fa88015b190 2023-11-04T01:42:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa886532640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800cac60 con 0x7fa88015adb0 2023-11-04T01:42:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa88015b190 0x7fa88015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa88015b190 0x7fa88015f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37672/0 (socket says 172.21.15.2:37672) 2023-11-04T01:42:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 -- 172.21.15.2:0/2274175628 learned_addr learned my addr 172.21.15.2:0/2274175628 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 -- 172.21.15.2:0/2274175628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88015adb0 msgr2=0x7fa8800cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 --2- 172.21.15.2:0/2274175628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88015adb0 0x7fa8800cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 -- 172.21.15.2:0/2274175628 >> v1:172.21.15.2:6789/0 conn(0x7fa8800cced0 legacy=0x7fa8800b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 -- 172.21.15.2:0/2274175628 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800caf40 con 0x7fa88015b190 2023-11-04T01:42:54.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87f7fe640 1 --2- 172.21.15.2:0/2274175628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa88015f030 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa868009e50 tx=0x7fa86801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70eb178570ffd929 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87effd640 1 -- 172.21.15.2:0/2274175628 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680a5870 con 0x7fa88015b190 2023-11-04T01:42:54.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87effd640 1 -- 172.21.15.2:0/2274175628 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8680a59d0 con 0x7fa88015b190 2023-11-04T01:42:54.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.918+0000 7fa87effd640 1 -- 172.21.15.2:0/2274175628 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680a5d60 con 0x7fa88015b190 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- 172.21.15.2:0/2274175628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 msgr2=0x7fa88015f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 --2- 172.21.15.2:0/2274175628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa88015f030 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa868009e50 tx=0x7fa86801c9e0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- 172.21.15.2:0/2274175628 shutdown_connections 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 --2- 172.21.15.2:0/2274175628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa88015f030 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 --2- 172.21.15.2:0/2274175628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88015adb0 0x7fa8800cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- 172.21.15.2:0/2274175628 >> 172.21.15.2:0/2274175628 conn(0x7fa8800cb510 msgr2=0x7fa8800cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- 172.21.15.2:0/2274175628 shutdown_connections 2023-11-04T01:42:54.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- 172.21.15.2:0/2274175628 wait complete. 2023-11-04T01:42:54.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 Processor -- start 2023-11-04T01:42:54.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- start start 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800cced0 0x7fa880152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88015adb0 0x7fa8800c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa8801f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801f6220 con 0x7fa88015b190 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801f53b0 con 0x7fa88015adb0 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801f55a0 con 0x7fa8800cced0 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa8801f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa8801f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37682/0 (socket says 172.21.15.2:37682) 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 -- 172.21.15.2:0/3316912018 learned_addr learned my addr 172.21.15.2:0/3316912018 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa87f7fe640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88015adb0 0x7fa8800c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa87ffff640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800cced0 0x7fa880152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 -- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800cced0 msgr2=0x7fa880152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800cced0 0x7fa880152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 -- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88015adb0 msgr2=0x7fa8800c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88015adb0 0x7fa8800c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 -- 172.21.15.2:0/3316912018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa868009b30 con 0x7fa88015b190 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa87f7fe640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88015adb0 0x7fa8800c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa884acf640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa8801f4e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c3c0 tx=0x7fa87000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa87cff9640 1 -- 172.21.15.2:0/3316912018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700052d0 con 0x7fa88015b190 2023-11-04T01:42:54.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa87cff9640 1 -- 172.21.15.2:0/3316912018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870005430 con 0x7fa88015b190 2023-11-04T01:42:54.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8801f5880 con 0x7fa88015b190 2023-11-04T01:42:54.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa87cff9640 1 -- 172.21.15.2:0/3316912018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870007240 con 0x7fa88015b190 2023-11-04T01:42:54.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.922+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8801f5e40 con 0x7fa88015b190 2023-11-04T01:42:54.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.926+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8801f6360 con 0x7fa88015b190 2023-11-04T01:42:54.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.926+0000 7fa87cff9640 1 -- 172.21.15.2:0/3316912018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8700073a0 con 0x7fa88015b190 2023-11-04T01:42:54.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.926+0000 7fa87cff9640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8600664d0 0x7fa860068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:54.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.926+0000 7fa87cff9640 1 -- 172.21.15.2:0/3316912018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8700831c0 con 0x7fa88015b190 2023-11-04T01:42:54.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.926+0000 7fa87ffff640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8600664d0 0x7fa860068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:54.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.926+0000 7fa87ffff640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8600664d0 0x7fa860068990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa87800a830 tx=0x7fa878008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:54.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:54.930+0000 7fa87cff9640 1 -- 172.21.15.2:0/3316912018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8801f6360 con 0x7fa88015b190 2023-11-04T01:42:55.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.078+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8801f6360 con 0x7fa88015b190 2023-11-04T01:42:55.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.078+0000 7fa87cff9640 1 -- 172.21.15.2:0/3316912018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8801f6360 con 0x7fa88015b190 2023-11-04T01:42:55.081 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:42:55.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8600664d0 msgr2=0x7fa860068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8600664d0 0x7fa860068990 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa87800a830 tx=0x7fa878008040 comp rx=0 tx=0).stop 2023-11-04T01:42:55.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 msgr2=0x7fa8801f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa8801f4e70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c3c0 tx=0x7fa87000c880 comp rx=0 tx=0).stop 2023-11-04T01:42:55.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 shutdown_connections 2023-11-04T01:42:55.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8600664d0 0x7fa860068990 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa88015b190 0x7fa8801f4e70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88015adb0 0x7fa8800c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 --2- 172.21.15.2:0/3316912018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8800cced0 0x7fa880152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 >> 172.21.15.2:0/3316912018 conn(0x7fa8800cb510 msgr2=0x7fa8800ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 shutdown_connections 2023-11-04T01:42:55.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.082+0000 7fa886532640 1 -- 172.21.15.2:0/3316912018 wait complete. 2023-11-04T01:42:55.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.206+0000 7fb020cf0640 1 Processor -- start 2023-11-04T01:42:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.206+0000 7fb020cf0640 1 -- start start 2023-11-04T01:42:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb020cf0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb01c0b0890 0x7fb01c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb020cf0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0c9960 0x7fb01c0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb020cf0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb01c0b0c70 0x7fb01c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb020cf0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c06d2f0 con 0x7fb01c0b0c70 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb020cf0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0ce110 con 0x7fb01c0b0890 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb020cf0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0ce320 con 0x7fb01c0c9960 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb01c0b0c70 0x7fb01c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb01c0b0c70 0x7fb01c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37690/0 (socket says 172.21.15.2:37690) 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 -- 172.21.15.2:0/3687969093 learned_addr learned my addr 172.21.15.2:0/3687969093 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb019d9b640 1 --2- 172.21.15.2:0/3687969093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0c9960 0x7fb01c0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01a59c640 1 --2- 172.21.15.2:0/3687969093 >> v2:172.21.15.90:3300/0 conn(0x7fb01c0b0890 0x7fb01c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 -- 172.21.15.2:0/3687969093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0c9960 msgr2=0x7fb01c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 --2- 172.21.15.2:0/3687969093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0c9960 0x7fb01c0704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 -- 172.21.15.2:0/3687969093 >> v2:172.21.15.90:3300/0 conn(0x7fb01c0b0890 msgr2=0x7fb01c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 --2- 172.21.15.2:0/3687969093 >> v2:172.21.15.90:3300/0 conn(0x7fb01c0b0890 0x7fb01c0cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 -- 172.21.15.2:0/3687969093 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0ce600 con 0x7fb01c0b0c70 2023-11-04T01:42:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01ad9d640 1 --2- 172.21.15.2:0/3687969093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c0ccf90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb01c06df00 tx=0x7fb01401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56af47b0c08536c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01959a640 1 -- 172.21.15.2:0/3687969093 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0140a5840 con 0x7fb01c0b0c70 2023-11-04T01:42:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01959a640 1 -- 172.21.15.2:0/3687969093 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0140a59a0 con 0x7fb01c0b0c70 2023-11-04T01:42:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.210+0000 7fb01959a640 1 -- 172.21.15.2:0/3687969093 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0140a5d30 con 0x7fb01c0b0c70 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- 172.21.15.2:0/3687969093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 msgr2=0x7fb01c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3687969093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c0ccf90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb01c06df00 tx=0x7fb01401c9a0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- 172.21.15.2:0/3687969093 shutdown_connections 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3687969093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c0ccf90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3687969093 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0c9960 0x7fb01c0704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3687969093 >> v2:172.21.15.90:3300/0 conn(0x7fb01c0b0890 0x7fb01c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- 172.21.15.2:0/3687969093 >> 172.21.15.2:0/3687969093 conn(0x7fb01c0cebb0 msgr2=0x7fb01c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- 172.21.15.2:0/3687969093 shutdown_connections 2023-11-04T01:42:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- 172.21.15.2:0/3687969093 wait complete. 2023-11-04T01:42:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 Processor -- start 2023-11-04T01:42:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- start start 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0b0890 0x7fb01c1f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c1645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01c0c9960 0x7fb01c0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c41b0 con 0x7fb01c0b0c70 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c1f67e0 con 0x7fb01c0c9960 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c3570 con 0x7fb01c0b0890 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c1645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c1645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37696/0 (socket says 172.21.15.2:37696) 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 -- 172.21.15.2:0/3590387165 learned_addr learned my addr 172.21.15.2:0/3590387165 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb01a59c640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0b0890 0x7fb01c1f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb01ad9d640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01c0c9960 0x7fb01c0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 -- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0b0890 msgr2=0x7fb01c1f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0b0890 0x7fb01c1f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 -- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01c0c9960 msgr2=0x7fb01c0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01c0c9960 0x7fb01c0c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 -- 172.21.15.2:0/3590387165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009b30 con 0x7fb01c0b0c70 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb019d9b640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c1645a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb01000d5f0 tx=0x7fb01000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb00affd640 1 -- 172.21.15.2:0/3590387165 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100125f0 con 0x7fb01c0b0c70 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb00affd640 1 -- 172.21.15.2:0/3590387165 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010012750 con 0x7fb01c0b0c70 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb00affd640 1 -- 172.21.15.2:0/3590387165 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010012ae0 con 0x7fb01c0b0c70 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c0c3810 con 0x7fb01c0b0c70 2023-11-04T01:42:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.214+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c0c3dd0 con 0x7fb01c0b0c70 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.218+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c0744a0 con 0x7fb01c0b0c70 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.218+0000 7fb00affd640 1 -- 172.21.15.2:0/3590387165 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb010012c40 con 0x7fb01c0b0c70 2023-11-04T01:42:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.218+0000 7fb00affd640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faffc0664a0 0x7faffc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.218+0000 7fb00affd640 1 -- 172.21.15.2:0/3590387165 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb010084220 con 0x7fb01c0b0c70 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.218+0000 7fb01a59c640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faffc0664a0 0x7faffc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.218+0000 7fb01a59c640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faffc0664a0 0x7faffc068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00aaf0 tx=0x7fb00c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.222+0000 7fb00affd640 1 -- 172.21.15.2:0/3590387165 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb010051730 con 0x7fb01c0b0c70 2023-11-04T01:42:55.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.370+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb01c0b4b30 con 0x7fb01c0b0c70 2023-11-04T01:42:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb00affd640 1 -- 172.21.15.2:0/3590387165 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7fb010054d50 con 0x7fb01c0b0c70 2023-11-04T01:42:55.375 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:55.375 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faffc0664a0 msgr2=0x7faffc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faffc0664a0 0x7faffc068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00aaf0 tx=0x7fb00c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 msgr2=0x7fb01c1645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c1645a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb01000d5f0 tx=0x7fb01000dab0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 shutdown_connections 2023-11-04T01:42:55.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faffc0664a0 0x7faffc068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb01c0c9960 0x7fb01c0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01c0b0c70 0x7fb01c1645a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 --2- 172.21.15.2:0/3590387165 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb01c0b0890 0x7fb01c1f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 >> 172.21.15.2:0/3590387165 conn(0x7fb01c0cebb0 msgr2=0x7fb01c158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 shutdown_connections 2023-11-04T01:42:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.374+0000 7fb020cf0640 1 -- 172.21.15.2:0/3590387165 wait complete. 2023-11-04T01:42:55.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:55.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:55.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.514+0000 7f64669d1640 1 Processor -- start 2023-11-04T01:42:55.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.514+0000 7f64669d1640 1 -- start start 2023-11-04T01:42:55.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f64669d1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 0x7f64600cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f64669d1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646015abd0 con 0x7f64600cdfe0 2023-11-04T01:42:55.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f64669d1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646015aeb0 con 0x7f6460159c10 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f64669d1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600ce450 con 0x7f64600b1040 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f64600cdfe0 0x7f6460159ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41894/0 (socket says 172.21.15.2:41894) 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 -- 172.21.15.2:0/3952145375 learned_addr learned my addr 172.21.15.2:0/3952145375 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645f7fe640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 0x7f64600cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062650522 0 0) 0x7f646015abd0 con 0x7f64600cdfe0 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6448003530 con 0x7f64600cdfe0 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 560884636 0 0) 0x7f6448003530 con 0x7f64600cdfe0 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 msgr2=0x7f64600cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 0x7f64600cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 >> v1:172.21.15.90:6789/0 conn(0x7f6460159c10 legacy=0x7f646015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646015b190 con 0x7f64600cdfe0 2023-11-04T01:42:55.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f6458001a00 con 0x7f64600cdfe0 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 >> v1:172.21.15.2:6789/0 conn(0x7f64600cdfe0 legacy=0x7f6460159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64480039b0 0x7f6448003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 0x7f64480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6448004d10 0x7f6448005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600ce450 con 0x7f6448004d10 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644800ba70 con 0x7f64480039b0 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644800de40 con 0x7f64600b1040 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6448004d10 0x7f6448005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645ffff640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64480039b0 0x7f6448003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645f7fe640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 0x7f64480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 -- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 msgr2=0x7f64480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 0x7f64480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 -- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64480039b0 msgr2=0x7f6448003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64480039b0 0x7f6448003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 -- 172.21.15.2:0/3952145375 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448003530 con 0x7f6448004d10 2023-11-04T01:42:55.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645f7fe640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64600b1040 0x7f64480047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:55.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f6464f6e640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6448004d10 0x7f6448005190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f645800a800 tx=0x7f645801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e920726afdf77b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580072d0 con 0x7f6448004d10 2023-11-04T01:42:55.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64580a8070 con 0x7f6448004d10 2023-11-04T01:42:55.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.518+0000 7f645effd640 1 -- 172.21.15.2:0/3952145375 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580076b0 con 0x7f6448004d10 2023-11-04T01:42:55.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/3952145375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6448004d10 msgr2=0x7f6448005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 --2- 172.21.15.2:0/3952145375 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6448004d10 0x7f6448005190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f645800a800 tx=0x7f645801d300 comp rx=0 tx=0).stop 2023-11-04T01:42:55.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f6464f6e640 1 -- 172.21.15.2:0/3952145375 reap_dead start 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/3952145375 shutdown_connections 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/3952145375 >> 172.21.15.2:0/3952145375 conn(0x7f64600cb510 msgr2=0x7f64600cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/3952145375 shutdown_connections 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/3952145375 wait complete. 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 Processor -- start 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- start start 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f646014efb0 0x7f6460156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646014f390 0x7f64601567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6460157fd0 0x7f6460158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600aa6b0 con 0x7f646014f390 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64601589c0 con 0x7f6460157fd0 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600b18e0 con 0x7f646014efb0 2023-11-04T01:42:55.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646014f390 0x7f64601567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646014f390 0x7f64601567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37728/0 (socket says 172.21.15.2:37728) 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 -- 172.21.15.2:0/2944675867 learned_addr learned my addr 172.21.15.2:0/2944675867 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645ffff640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f646014efb0 0x7f6460156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f6464f6e640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6460157fd0 0x7f6460158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 -- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f646014efb0 msgr2=0x7f6460156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f646014efb0 0x7f6460156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 -- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6460157fd0 msgr2=0x7f6460158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6460157fd0 0x7f6460158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 -- 172.21.15.2:0/2944675867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600b0920 con 0x7f646014f390 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645f7fe640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646014f390 0x7f64601567b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f64540108d0 tx=0x7f6454010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645cff9640 1 -- 172.21.15.2:0/2944675867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454004220 con 0x7f646014f390 2023-11-04T01:42:55.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645cff9640 1 -- 172.21.15.2:0/2944675867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454004380 con 0x7f646014f390 2023-11-04T01:42:55.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f645cff9640 1 -- 172.21.15.2:0/2944675867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645400eba0 con 0x7f646014f390 2023-11-04T01:42:55.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6460156de0 con 0x7f646014f390 2023-11-04T01:42:55.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64601573a0 con 0x7f646014f390 2023-11-04T01:42:55.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.522+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64600744a0 con 0x7f646014f390 2023-11-04T01:42:55.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.526+0000 7f645cff9640 1 -- 172.21.15.2:0/2944675867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f645400ed00 con 0x7f646014f390 2023-11-04T01:42:55.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.526+0000 7f645cff9640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f644c0664a0 0x7f644c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.526+0000 7f645cff9640 1 -- 172.21.15.2:0/2944675867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6454083de0 con 0x7f646014f390 2023-11-04T01:42:55.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.526+0000 7f645ffff640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f644c0664a0 0x7f644c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.526+0000 7f645ffff640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f644c0664a0 0x7f644c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6460156220 tx=0x7f6450009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.530+0000 7f645cff9640 1 -- 172.21.15.2:0/2944675867 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64540512f0 con 0x7f646014f390 2023-11-04T01:42:55.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.682+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f646006b910 con 0x7f646014f390 2023-11-04T01:42:55.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.682+0000 7f645cff9640 1 -- 172.21.15.2:0/2944675867 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6454054910 con 0x7f646014f390 2023-11-04T01:42:55.686 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f644c0664a0 msgr2=0x7f644c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f644c0664a0 0x7f644c068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6460156220 tx=0x7f6450009040 comp rx=0 tx=0).stop 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646014f390 msgr2=0x7f64601567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646014f390 0x7f64601567b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f64540108d0 tx=0x7f6454010d90 comp rx=0 tx=0).stop 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 shutdown_connections 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f644c0664a0 0x7f644c068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6460157fd0 0x7f6460158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f646014f390 0x7f64601567b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 --2- 172.21.15.2:0/2944675867 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f646014efb0 0x7f6460156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 >> 172.21.15.2:0/2944675867 conn(0x7f64600cb510 msgr2=0x7f64600ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 shutdown_connections 2023-11-04T01:42:55.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.686+0000 7f64669d1640 1 -- 172.21.15.2:0/2944675867 wait complete. 2023-11-04T01:42:55.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a243f640 1 Processor -- start 2023-11-04T01:42:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a243f640 1 -- start start 2023-11-04T01:42:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a243f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a243f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f329c0b0c20 0x7f329c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a243f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c0cb130 con 0x7f329c15c160 2023-11-04T01:42:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a243f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c15bd40 con 0x7f329c0b0c20 2023-11-04T01:42:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a243f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c06fd80 con 0x7f329c15acb0 2023-11-04T01:42:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f329bfff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a09dc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f329c0b0c20 0x7f329c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a09dc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f329c0b0c20 0x7f329c0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:59656/0 (socket says 172.21.15.2:59656) 2023-11-04T01:42:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a09dc640 1 -- 172.21.15.2:0/748864545 learned_addr learned my addr 172.21.15.2:0/748864545 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f329bfff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:41530/0 (socket says 172.21.15.2:41530) 2023-11-04T01:42:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a09dc640 1 -- 172.21.15.2:0/748864545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 msgr2=0x7f329c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a09dc640 1 --2- 172.21.15.2:0/748864545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a09dc640 1 -- 172.21.15.2:0/748864545 >> v1:172.21.15.90:6789/0 conn(0x7f329c15c160 legacy=0x7f329c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.826+0000 7f32a09dc640 1 -- 172.21.15.2:0/748864545 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c15b680 con 0x7f329c0b0c20 2023-11-04T01:42:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a09dc640 1 --2- 172.21.15.2:0/748864545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c0b0c20 0x7f329c0ca490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3294009870 tx=0x7f329401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db1528e1a80ce88b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f329affd640 1 -- 172.21.15.2:0/748864545 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940a95f0 con 0x7f329c0b0c20 2023-11-04T01:42:55.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f329affd640 1 -- 172.21.15.2:0/748864545 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32940a9750 con 0x7f329c0b0c20 2023-11-04T01:42:55.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f329affd640 1 -- 172.21.15.2:0/748864545 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940a9ae0 con 0x7f329c0b0c20 2023-11-04T01:42:55.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 -- 172.21.15.2:0/748864545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c0b0c20 msgr2=0x7f329c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 --2- 172.21.15.2:0/748864545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c0b0c20 0x7f329c0ca490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3294009870 tx=0x7f329401c510 comp rx=0 tx=0).stop 2023-11-04T01:42:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 -- 172.21.15.2:0/748864545 shutdown_connections 2023-11-04T01:42:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 --2- 172.21.15.2:0/748864545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c0b0c20 0x7f329c0ca490 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 --2- 172.21.15.2:0/748864545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 -- 172.21.15.2:0/748864545 >> 172.21.15.2:0/748864545 conn(0x7f329c0cb510 msgr2=0x7f329c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 -- 172.21.15.2:0/748864545 shutdown_connections 2023-11-04T01:42:55.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 -- 172.21.15.2:0/748864545 wait complete. 2023-11-04T01:42:55.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 Processor -- start 2023-11-04T01:42:55.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 -- start start 2023-11-04T01:42:55.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c0b0c20 0x7f329c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.830+0000 7f32a243f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c14efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a243f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c15c160 0x7f329c0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a243f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b27d0 con 0x7f329c0b0c20 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a243f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c14f4f0 con 0x7f329c15c160 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a243f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b18e0 con 0x7f329c15acb0 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c0b0c20 0x7f329c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c0b0c20 0x7f329c15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37730/0 (socket says 172.21.15.2:37730) 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 -- 172.21.15.2:0/2253905720 learned_addr learned my addr 172.21.15.2:0/2253905720 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a09dc640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c15c160 0x7f329c0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329b7fe640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c14efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 -- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 msgr2=0x7f329c14efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c14efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 -- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c15c160 msgr2=0x7f329c0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c15c160 0x7f329c0af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 -- 172.21.15.2:0/2253905720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940094d0 con 0x7f329c0b0c20 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329bfff640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c0b0c20 0x7f329c15a1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f328c009db0 tx=0x7f328c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f3298ff9640 1 -- 172.21.15.2:0/2253905720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c014480 con 0x7f329c0b0c20 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f3298ff9640 1 -- 172.21.15.2:0/2253905720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c00f040 con 0x7f329c0b0c20 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f3298ff9640 1 -- 172.21.15.2:0/2253905720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c014800 con 0x7f329c0b0c20 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c0b1bc0 con 0x7f329c0b0c20 2023-11-04T01:42:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c0b2180 con 0x7f329c0b0c20 2023-11-04T01:42:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c0744a0 con 0x7f329c0b0c20 2023-11-04T01:42:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f3298ff9640 1 -- 172.21.15.2:0/2253905720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f328c014960 con 0x7f329c0b0c20 2023-11-04T01:42:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f3298ff9640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32880664a0 0x7f3288068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f3298ff9640 1 -- 172.21.15.2:0/2253905720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f328c084a70 con 0x7f329c0b0c20 2023-11-04T01:42:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.834+0000 7f329b7fe640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32880664a0 0x7f3288068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.838+0000 7f329b7fe640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32880664a0 0x7f3288068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f329c0c5b10 tx=0x7f3290009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:55.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.838+0000 7f3298ff9640 1 -- 172.21.15.2:0/2253905720 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f328c051ef0 con 0x7f329c0b0c20 2023-11-04T01:42:55.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f329c0ce5a0 con 0x7f329c0b0c20 2023-11-04T01:42:55.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f3298ff9640 1 -- 172.21.15.2:0/2253905720 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f328c055510 con 0x7f329c0b0c20 2023-11-04T01:42:55.992 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:42:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32880664a0 msgr2=0x7f3288068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32880664a0 0x7f3288068960 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f329c0c5b10 tx=0x7f3290009040 comp rx=0 tx=0).stop 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c0b0c20 msgr2=0x7f329c15a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c0b0c20 0x7f329c15a1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f328c009db0 tx=0x7f328c00c490 comp rx=0 tx=0).stop 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 shutdown_connections 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32880664a0 0x7f3288068960 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f329c15c160 0x7f329c0af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f329c15acb0 0x7f329c14efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 --2- 172.21.15.2:0/2253905720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f329c0b0c20 0x7f329c15a1d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 >> 172.21.15.2:0/2253905720 conn(0x7f329c0cb510 msgr2=0x7f329c15d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 shutdown_connections 2023-11-04T01:42:55.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:55.990+0000 7f32a243f640 1 -- 172.21.15.2:0/2253905720 wait complete. 2023-11-04T01:42:56.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0656a39640 1 Processor -- start 2023-11-04T01:42:56.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0656a39640 1 -- start start 2023-11-04T01:42:56.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0656a39640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f06501438e0 0x7f06500cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0656a39640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 0x7f065006cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0656a39640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0650161760 con 0x7f0650146510 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0656a39640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650161a40 con 0x7f06501438e0 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0656a39640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500d0790 con 0x7f065006a870 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f064f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0650146510 0x7f065006a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41902/0 (socket says 172.21.15.2:41902) 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f064f7fe640 1 -- 172.21.15.2:0/1776083086 learned_addr learned my addr 172.21.15.2:0/1776083086 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f0654fd6640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 0x7f065006cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f064ffff640 1 --2- 172.21.15.2:0/1776083086 >> v2:172.21.15.90:3300/0 conn(0x7f06501438e0 0x7f06500cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.122+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698577405 0 0) 0x7f0650161760 con 0x7f0650146510 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f063c003530 con 0x7f0650146510 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829428853 0 0) 0x7f063c003530 con 0x7f0650146510 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 msgr2=0x7f065006cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 0x7f065006cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 >> v2:172.21.15.90:3300/0 conn(0x7f06501438e0 msgr2=0x7f06500cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 --2- 172.21.15.2:0/1776083086 >> v2:172.21.15.90:3300/0 conn(0x7f06501438e0 0x7f06500cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500d0a00 con 0x7f0650146510 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f0638001680 con 0x7f0650146510 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 >> v1:172.21.15.2:6789/0 conn(0x7f0650146510 legacy=0x7f065006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 0x7f063c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f063c003f00 0x7f063c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c004d10 0x7f063c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0650161a40 con 0x7f063c003f00 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500d0790 con 0x7f063c004d10 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c00b9e0 con 0x7f065006a870 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064f7fe640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f063c003f00 0x7f063c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064ffff640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 0x7f063c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0654fd6640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c004d10 0x7f063c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064f7fe640 1 -- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 msgr2=0x7f063c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064f7fe640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 0x7f063c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064f7fe640 1 -- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c004d10 msgr2=0x7f063c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064f7fe640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c004d10 0x7f063c005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064f7fe640 1 -- 172.21.15.2:0/1776083086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c003530 con 0x7f063c003f00 2023-11-04T01:42:56.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064ffff640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f065006a870 0x7f063c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064f7fe640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f063c003f00 0x7f063c0047d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f063800c270 tx=0x7f063801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f89120921dc3060 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380058e0 con 0x7f063c003f00 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638005a40 con 0x7f063c003f00 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f064effd640 1 -- 172.21.15.2:0/1776083086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638005e70 con 0x7f063c003f00 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0656a39640 1 -- 172.21.15.2:0/1776083086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f063c003f00 msgr2=0x7f063c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0656a39640 1 --2- 172.21.15.2:0/1776083086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f063c003f00 0x7f063c0047d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f063800c270 tx=0x7f063801cc60 comp rx=0 tx=0).stop 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0654fd6640 1 -- 172.21.15.2:0/1776083086 reap_dead start 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0656a39640 1 -- 172.21.15.2:0/1776083086 shutdown_connections 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0656a39640 1 -- 172.21.15.2:0/1776083086 >> 172.21.15.2:0/1776083086 conn(0x7f06500cfc70 msgr2=0x7f06500d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0656a39640 1 -- 172.21.15.2:0/1776083086 shutdown_connections 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.126+0000 7f0656a39640 1 -- 172.21.15.2:0/1776083086 wait complete. 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 Processor -- start 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 -- start start 2023-11-04T01:42:56.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c003f00 0x7f065015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0650160b50 0x7f06501400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650160600 0x7f0650140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0650138980 con 0x7f0650160600 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0650160410 con 0x7f063c003f00 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500b46e0 con 0x7f0650160b50 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650160600 0x7f0650140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650160600 0x7f0650140630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37748/0 (socket says 172.21.15.2:37748) 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 -- 172.21.15.2:0/1854791070 learned_addr learned my addr 172.21.15.2:0/1854791070 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f064ffff640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c003f00 0x7f065015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f064f7fe640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0650160b50 0x7f06501400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 -- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0650160b50 msgr2=0x7f06501400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0650160b50 0x7f06501400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 -- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c003f00 msgr2=0x7f065015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c003f00 0x7f065015fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 -- 172.21.15.2:0/1854791070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500b3ad0 con 0x7f0650160600 2023-11-04T01:42:56.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0654fd6640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650160600 0x7f0650140630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0648009fd0 tx=0x7f064800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f064cff9640 1 -- 172.21.15.2:0/1854791070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648017400 con 0x7f0650160600 2023-11-04T01:42:56.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f064cff9640 1 -- 172.21.15.2:0/1854791070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648011040 con 0x7f0650160600 2023-11-04T01:42:56.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f064cff9640 1 -- 172.21.15.2:0/1854791070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480177c0 con 0x7f0650160600 2023-11-04T01:42:56.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06500b3db0 con 0x7f0650160600 2023-11-04T01:42:56.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06500b4370 con 0x7f0650160600 2023-11-04T01:42:56.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.130+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06500b4530 con 0x7f0650160600 2023-11-04T01:42:56.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.134+0000 7f064cff9640 1 -- 172.21.15.2:0/1854791070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0648021440 con 0x7f0650160600 2023-11-04T01:42:56.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.134+0000 7f064cff9640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06300664d0 0x7f0630068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.134+0000 7f064cff9640 1 -- 172.21.15.2:0/1854791070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06480840c0 con 0x7f0650160600 2023-11-04T01:42:56.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.134+0000 7f064ffff640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06300664d0 0x7f0630068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.134+0000 7f064ffff640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06300664d0 0x7f0630068990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0640009b40 tx=0x7f0640008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.138+0000 7f064cff9640 1 -- 172.21.15.2:0/1854791070 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0648051410 con 0x7f0650160600 2023-11-04T01:42:56.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.286+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0650135020 con 0x7f0650160600 2023-11-04T01:42:56.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.286+0000 7f064cff9640 1 -- 172.21.15.2:0/1854791070 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0650135020 con 0x7f0650160600 2023-11-04T01:42:56.289 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06300664d0 msgr2=0x7f0630068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06300664d0 0x7f0630068990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0640009b40 tx=0x7f0640008040 comp rx=0 tx=0).stop 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650160600 msgr2=0x7f0650140630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650160600 0x7f0650140630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0648009fd0 tx=0x7f064800f4a0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 shutdown_connections 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06300664d0 0x7f0630068990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0650160600 0x7f0650140630 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0650160b50 0x7f06501400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 --2- 172.21.15.2:0/1854791070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f063c003f00 0x7f065015fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 >> 172.21.15.2:0/1854791070 conn(0x7f06500cfc70 msgr2=0x7f0650141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 shutdown_connections 2023-11-04T01:42:56.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.290+0000 7f0656a39640 1 -- 172.21.15.2:0/1854791070 wait complete. 2023-11-04T01:42:56.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.414+0000 7f10bbf66640 1 Processor -- start 2023-11-04T01:42:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.414+0000 7f10bbf66640 1 -- start start 2023-11-04T01:42:56.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10bbf66640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40b4990 0x7f10b40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10bbf66640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f10b40d0690 0x7f10b40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10bbf66640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10b40d0ae0 0x7f10b40cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10bbf66640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40b6070 con 0x7f10b40d0ae0 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10bbf66640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40b8ed0 con 0x7f10b40d0690 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10bbf66640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40b52b0 con 0x7f10b40b4990 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10b40d0ae0 0x7f10b40cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f10b40d0ae0 0x7f10b40cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37756/0 (socket says 172.21.15.2:37756) 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 -- 172.21.15.2:0/3034772593 learned_addr learned my addr 172.21.15.2:0/3034772593 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10b9d02640 1 --2- 172.21.15.2:0/3034772593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40b4990 0x7f10b40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10b9501640 1 --2- 172.21.15.2:0/3034772593 >> v2:172.21.15.90:3300/0 conn(0x7f10b40d0690 0x7f10b40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 -- 172.21.15.2:0/3034772593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40b4990 msgr2=0x7f10b40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 --2- 172.21.15.2:0/3034772593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40b4990 0x7f10b40b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 -- 172.21.15.2:0/3034772593 >> v2:172.21.15.90:3300/0 conn(0x7f10b40d0690 msgr2=0x7f10b40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 --2- 172.21.15.2:0/3034772593 >> v2:172.21.15.90:3300/0 conn(0x7f10b40d0690 0x7f10b40cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 -- 172.21.15.2:0/3034772593 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40d1ce0 con 0x7f10b40d0ae0 2023-11-04T01:42:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10b9501640 1 --2- 172.21.15.2:0/3034772593 >> v2:172.21.15.90:3300/0 conn(0x7f10b40d0690 0x7f10b40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10ba503640 1 --2- 172.21.15.2:0/3034772593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0ae0 0x7f10b40cdcb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10b4066d30 tx=0x7f10a401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e32bd1cb192fd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10b8d00640 1 -- 172.21.15.2:0/3034772593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40a89b0 con 0x7f10b40d0ae0 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10b8d00640 1 -- 172.21.15.2:0/3034772593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a40a8b10 con 0x7f10b40d0ae0 2023-11-04T01:42:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.418+0000 7f10b8d00640 1 -- 172.21.15.2:0/3034772593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40a8ea0 con 0x7f10b40d0ae0 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- 172.21.15.2:0/3034772593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0ae0 msgr2=0x7f10b40cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3034772593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0ae0 0x7f10b40cdcb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10b4066d30 tx=0x7f10a401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- 172.21.15.2:0/3034772593 shutdown_connections 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3034772593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0ae0 0x7f10b40cdcb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3034772593 >> v2:172.21.15.90:3300/0 conn(0x7f10b40d0690 0x7f10b40cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3034772593 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40b4990 0x7f10b40b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- 172.21.15.2:0/3034772593 >> 172.21.15.2:0/3034772593 conn(0x7f10b40cf990 msgr2=0x7f10b40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- 172.21.15.2:0/3034772593 shutdown_connections 2023-11-04T01:42:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- 172.21.15.2:0/3034772593 wait complete. 2023-11-04T01:42:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 Processor -- start 2023-11-04T01:42:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- start start 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10b40b4990 0x7f10b41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0690 0x7f10b41f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40d0ae0 0x7f10b40b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4151930 con 0x7f10b40d0690 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40ccb90 con 0x7f10b40b4990 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40cbc10 con 0x7f10b40d0ae0 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0690 0x7f10b41f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0690 0x7f10b41f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37764/0 (socket says 172.21.15.2:37764) 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 -- 172.21.15.2:0/3555385685 learned_addr learned my addr 172.21.15.2:0/3555385685 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10ba503640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40d0ae0 0x7f10b40b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9d02640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10b40b4990 0x7f10b41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 -- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40d0ae0 msgr2=0x7f10b40b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40d0ae0 0x7f10b40b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 -- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10b40b4990 msgr2=0x7f10b41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10b40b4990 0x7f10b41513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 -- 172.21.15.2:0/3555385685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a40094d0 con 0x7f10b40d0690 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b9501640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0690 0x7f10b41f39d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c7f0 tx=0x7f10a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b27fc640 1 -- 172.21.15.2:0/3555385685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a8004220 con 0x7f10b40d0690 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b27fc640 1 -- 172.21.15.2:0/3555385685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a8004380 con 0x7f10b40d0690 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b40cbef0 con 0x7f10b40d0690 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10b27fc640 1 -- 172.21.15.2:0/3555385685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a8003840 con 0x7f10b40d0690 2023-11-04T01:42:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.422+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b40a9c80 con 0x7f10b40d0690 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.426+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b40744a0 con 0x7f10b40d0690 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.426+0000 7f10b27fc640 1 -- 172.21.15.2:0/3555385685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10a8003bb0 con 0x7f10b40d0690 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.426+0000 7f10b27fc640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10a00664a0 0x7f10a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.426+0000 7f10b27fc640 1 -- 172.21.15.2:0/3555385685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10a8083e50 con 0x7f10b40d0690 2023-11-04T01:42:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.426+0000 7f10b9d02640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10a00664a0 0x7f10a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.426+0000 7f10b9d02640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10a00664a0 0x7f10a0068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10b40cc7f0 tx=0x7f10ac0077f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.430+0000 7f10b27fc640 1 -- 172.21.15.2:0/3555385685 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10a8051230 con 0x7f10b40d0690 2023-11-04T01:42:56.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.590+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10b40d35c0 con 0x7f10b40d0690 2023-11-04T01:42:56.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.590+0000 7f10b27fc640 1 -- 172.21.15.2:0/3555385685 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f10a8003e60 con 0x7f10b40d0690 2023-11-04T01:42:56.593 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:56.593 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10a00664a0 msgr2=0x7f10a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10a00664a0 0x7f10a0068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10b40cc7f0 tx=0x7f10ac0077f0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0690 msgr2=0x7f10b41f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0690 0x7f10b41f39d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c7f0 tx=0x7f10a800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 shutdown_connections 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10a00664a0 0x7f10a0068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10b40d0ae0 0x7f10b40b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10b40d0690 0x7f10b41f39d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 --2- 172.21.15.2:0/3555385685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10b40b4990 0x7f10b41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 >> 172.21.15.2:0/3555385685 conn(0x7f10b40cf990 msgr2=0x7f10b40b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 shutdown_connections 2023-11-04T01:42:56.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.594+0000 7f10bbf66640 1 -- 172.21.15.2:0/3555385685 wait complete. 2023-11-04T01:42:56.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:56.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.730+0000 7f4a35638640 1 Processor -- start 2023-11-04T01:42:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.730+0000 7f4a35638640 1 -- start start 2023-11-04T01:42:56.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a35638640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a300b0c20 0x7f4a3015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a35638640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a3015c160 0x7f4a300ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a35638640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300cb130 con 0x7f4a3015acb0 2023-11-04T01:42:56.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a35638640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3015bd40 con 0x7f4a3015c160 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a35638640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3006fd80 con 0x7f4a300b0c20 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a3015c160 0x7f4a300ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a3015c160 0x7f4a300ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37776/0 (socket says 172.21.15.2:37776) 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 -- 172.21.15.2:0/1702405634 learned_addr learned my addr 172.21.15.2:0/1702405634 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2e7fc640 1 --2- 172.21.15.2:0/1702405634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a300b0c20 0x7f4a3015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 -- 172.21.15.2:0/1702405634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a300b0c20 msgr2=0x7f4a3015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 --2- 172.21.15.2:0/1702405634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a300b0c20 0x7f4a3015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 -- 172.21.15.2:0/1702405634 >> v1:172.21.15.90:6789/0 conn(0x7f4a3015acb0 legacy=0x7f4a300b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 -- 172.21.15.2:0/1702405634 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3015b680 con 0x7f4a3015c160 2023-11-04T01:42:56.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2f7fe640 1 --2- 172.21.15.2:0/1702405634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015c160 0x7f4a300ca490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009e50 tx=0x7f4a2801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c5448605191c11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2dffb640 1 -- 172.21.15.2:0/1702405634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280a5840 con 0x7f4a3015c160 2023-11-04T01:42:56.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2dffb640 1 -- 172.21.15.2:0/1702405634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280a59a0 con 0x7f4a3015c160 2023-11-04T01:42:56.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.734+0000 7f4a2dffb640 1 -- 172.21.15.2:0/1702405634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280a5d30 con 0x7f4a3015c160 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- 172.21.15.2:0/1702405634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015c160 msgr2=0x7f4a300ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 --2- 172.21.15.2:0/1702405634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015c160 0x7f4a300ca490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009e50 tx=0x7f4a2801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- 172.21.15.2:0/1702405634 shutdown_connections 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 --2- 172.21.15.2:0/1702405634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015c160 0x7f4a300ca490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 --2- 172.21.15.2:0/1702405634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a300b0c20 0x7f4a3015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- 172.21.15.2:0/1702405634 >> 172.21.15.2:0/1702405634 conn(0x7f4a300cb510 msgr2=0x7f4a300cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- 172.21.15.2:0/1702405634 shutdown_connections 2023-11-04T01:42:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- 172.21.15.2:0/1702405634 wait complete. 2023-11-04T01:42:56.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 Processor -- start 2023-11-04T01:42:56.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- start start 2023-11-04T01:42:56.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a300b0c20 0x7f4a30154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015acb0 0x7f4a300b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a3015c160 0x7f4a30151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30153b50 con 0x7f4a3015acb0 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30155bc0 con 0x7f4a300b0c20 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b3d70 con 0x7f4a3015c160 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015acb0 0x7f4a300b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015acb0 0x7f4a300b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37784/0 (socket says 172.21.15.2:37784) 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 -- 172.21.15.2:0/587446890 learned_addr learned my addr 172.21.15.2:0/587446890 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2effd640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a300b0c20 0x7f4a30154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2f7fe640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a3015c160 0x7f4a30151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 -- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a3015c160 msgr2=0x7f4a30151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a3015c160 0x7f4a30151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 -- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a300b0c20 msgr2=0x7f4a30154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a300b0c20 0x7f4a30154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 -- 172.21.15.2:0/587446890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009b30 con 0x7f4a3015acb0 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2f7fe640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a3015c160 0x7f4a30151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a2e7fc640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015acb0 0x7f4a300b3830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400d800 tx=0x7f4a2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a177fe640 1 -- 172.21.15.2:0/587446890 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400b6c0 con 0x7f4a3015acb0 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a177fe640 1 -- 172.21.15.2:0/587446890 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2400b820 con 0x7f4a3015acb0 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a177fe640 1 -- 172.21.15.2:0/587446890 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400bb90 con 0x7f4a3015acb0 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a301522d0 con 0x7f4a3015acb0 2023-11-04T01:42:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.738+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a30155600 con 0x7f4a3015acb0 2023-11-04T01:42:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.742+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a30153d00 con 0x7f4a3015acb0 2023-11-04T01:42:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.742+0000 7f4a177fe640 1 -- 172.21.15.2:0/587446890 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a2400bcf0 con 0x7f4a3015acb0 2023-11-04T01:42:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.742+0000 7f4a177fe640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a1c0664d0 0x7f4a1c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.742+0000 7f4a177fe640 1 -- 172.21.15.2:0/587446890 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a240843a0 con 0x7f4a3015acb0 2023-11-04T01:42:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.742+0000 7f4a2effd640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a1c0664d0 0x7f4a1c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:56.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.742+0000 7f4a2effd640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a1c0664d0 0x7f4a1c068990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a30166d80 tx=0x7f4a20009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:56.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.746+0000 7f4a177fe640 1 -- 172.21.15.2:0/587446890 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4a24051820 con 0x7f4a3015acb0 2023-11-04T01:42:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.902+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a300744a0 con 0x7f4a3015acb0 2023-11-04T01:42:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.902+0000 7f4a177fe640 1 -- 172.21.15.2:0/587446890 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a24054e40 con 0x7f4a3015acb0 2023-11-04T01:42:56.905 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a1c0664d0 msgr2=0x7f4a1c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a1c0664d0 0x7f4a1c068990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a30166d80 tx=0x7f4a20009040 comp rx=0 tx=0).stop 2023-11-04T01:42:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015acb0 msgr2=0x7f4a300b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:56.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015acb0 0x7f4a300b3830 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400d800 tx=0x7f4a2400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 shutdown_connections 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a1c0664d0 0x7f4a1c068990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a3015c160 0x7f4a30151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a3015acb0 0x7f4a300b3830 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 --2- 172.21.15.2:0/587446890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a300b0c20 0x7f4a30154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 >> 172.21.15.2:0/587446890 conn(0x7f4a300cb510 msgr2=0x7f4a3015cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 shutdown_connections 2023-11-04T01:42:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:56.906+0000 7f4a35638640 1 -- 172.21.15.2:0/587446890 wait complete. 2023-11-04T01:42:56.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9042b76640 1 Processor -- start 2023-11-04T01:42:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9042b76640 1 -- start start 2023-11-04T01:42:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9042b76640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f903c15d6c0 0x7f903c0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9042b76640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f903c0d0ad0 0x7f903c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9042b76640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0d08e0 con 0x7f903c0b4ec0 2023-11-04T01:42:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9042b76640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0b5350 con 0x7f903c15d6c0 2023-11-04T01:42:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9042b76640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0d2080 con 0x7f903c0d0ad0 2023-11-04T01:42:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9041113640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f903c0b4ec0 0x7f903c0cda80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41904/0 (socket says 172.21.15.2:41904) 2023-11-04T01:42:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9040912640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f903c15d6c0 0x7f903c0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9041113640 1 -- 172.21.15.2:0/2788064684 learned_addr learned my addr 172.21.15.2:0/2788064684 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f903bfff640 1 --2- 172.21.15.2:0/2788064684 >> v2:172.21.15.90:3300/0 conn(0x7f903c0d0ad0 0x7f903c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9040912640 1 -- 172.21.15.2:0/2788064684 >> v2:172.21.15.90:3300/0 conn(0x7f903c0d0ad0 msgr2=0x7f903c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9040912640 1 --2- 172.21.15.2:0/2788064684 >> v2:172.21.15.90:3300/0 conn(0x7f903c0d0ad0 0x7f903c0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9040912640 1 -- 172.21.15.2:0/2788064684 >> v1:172.21.15.2:6789/0 conn(0x7f903c0b4ec0 legacy=0x7f903c0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.046+0000 7f9040912640 1 -- 172.21.15.2:0/2788064684 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0d2360 con 0x7f903c15d6c0 2023-11-04T01:42:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9040912640 1 --2- 172.21.15.2:0/2788064684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c0d19c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f903c08c0d0 tx=0x7f903001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5373746033ee6198 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f903b7fe640 1 -- 172.21.15.2:0/2788064684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90300a8950 con 0x7f903c15d6c0 2023-11-04T01:42:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f903b7fe640 1 -- 172.21.15.2:0/2788064684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90300a8ab0 con 0x7f903c15d6c0 2023-11-04T01:42:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f903b7fe640 1 -- 172.21.15.2:0/2788064684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90300a8e40 con 0x7f903c15d6c0 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- 172.21.15.2:0/2788064684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 msgr2=0x7f903c0d19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 --2- 172.21.15.2:0/2788064684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c0d19c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f903c08c0d0 tx=0x7f903001ec50 comp rx=0 tx=0).stop 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- 172.21.15.2:0/2788064684 shutdown_connections 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 --2- 172.21.15.2:0/2788064684 >> v2:172.21.15.90:3300/0 conn(0x7f903c0d0ad0 0x7f903c0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 --2- 172.21.15.2:0/2788064684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c0d19c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- 172.21.15.2:0/2788064684 >> 172.21.15.2:0/2788064684 conn(0x7f903c0cf980 msgr2=0x7f903c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- 172.21.15.2:0/2788064684 shutdown_connections 2023-11-04T01:42:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- 172.21.15.2:0/2788064684 wait complete. 2023-11-04T01:42:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 Processor -- start 2023-11-04T01:42:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- start start 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f903c0b4ec0 0x7f903c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c0d0ad0 0x7f903c0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c1f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0cc920 con 0x7f903c15d6c0 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0cb410 con 0x7f903c0d0ad0 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9042b76640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0cb620 con 0x7f903c0b4ec0 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9041113640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c1f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9041113640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c1f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37798/0 (socket says 172.21.15.2:37798) 2023-11-04T01:42:57.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9041113640 1 -- 172.21.15.2:0/2066676497 learned_addr learned my addr 172.21.15.2:0/2066676497 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:57.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f9040912640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f903c0b4ec0 0x7f903c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.050+0000 7f903bfff640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c0d0ad0 0x7f903c0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9041113640 1 -- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f903c0b4ec0 msgr2=0x7f903c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9041113640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f903c0b4ec0 0x7f903c150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9041113640 1 -- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c0d0ad0 msgr2=0x7f903c0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9041113640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c0d0ad0 0x7f903c0cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9041113640 1 -- 172.21.15.2:0/2066676497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009420 con 0x7f903c15d6c0 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9041113640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c1f3700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f903400ca80 tx=0x7f903400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f90397fa640 1 -- 172.21.15.2:0/2066676497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400ac30 con 0x7f903c15d6c0 2023-11-04T01:42:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f90397fa640 1 -- 172.21.15.2:0/2066676497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903400ad90 con 0x7f903c15d6c0 2023-11-04T01:42:57.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c0cb900 con 0x7f903c15d6c0 2023-11-04T01:42:57.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f90397fa640 1 -- 172.21.15.2:0/2066676497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034012600 con 0x7f903c15d6c0 2023-11-04T01:42:57.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c0cbec0 con 0x7f903c15d6c0 2023-11-04T01:42:57.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c0cc0e0 con 0x7f903c15d6c0 2023-11-04T01:42:57.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f90397fa640 1 -- 172.21.15.2:0/2066676497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9034007070 con 0x7f903c15d6c0 2023-11-04T01:42:57.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f90397fa640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90280664a0 0x7f9028068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f90397fa640 1 -- 172.21.15.2:0/2066676497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9034083c60 con 0x7f903c15d6c0 2023-11-04T01:42:57.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9040912640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90280664a0 0x7f9028068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.054+0000 7f9040912640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90280664a0 0x7f9028068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f90300b2000 tx=0x7f9030008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.058+0000 7f90397fa640 1 -- 172.21.15.2:0/2066676497 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9034051180 con 0x7f903c15d6c0 2023-11-04T01:42:57.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.214+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f903c0675f0 con 0x7f903c15d6c0 2023-11-04T01:42:57.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.214+0000 7f90397fa640 1 -- 172.21.15.2:0/2066676497 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9034017020 con 0x7f903c15d6c0 2023-11-04T01:42:57.217 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:42:57.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90280664a0 msgr2=0x7f9028068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90280664a0 0x7f9028068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f90300b2000 tx=0x7f9030008040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 msgr2=0x7f903c1f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c1f3700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f903400ca80 tx=0x7f903400cf40 comp rx=0 tx=0).stop 2023-11-04T01:42:57.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 shutdown_connections 2023-11-04T01:42:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90280664a0 0x7f9028068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f903c15d6c0 0x7f903c1f3700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f903c0d0ad0 0x7f903c0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 --2- 172.21.15.2:0/2066676497 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f903c0b4ec0 0x7f903c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 >> 172.21.15.2:0/2066676497 conn(0x7f903c0cf980 msgr2=0x7f903c0cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 shutdown_connections 2023-11-04T01:42:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.218+0000 7f9042b76640 1 -- 172.21.15.2:0/2066676497 wait complete. 2023-11-04T01:42:57.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:57.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 Processor -- start 2023-11-04T01:42:57.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 -- start start 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773815af70 0x7f77380cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f773806d160 0x7f77380cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f773815dd80 0x7f773815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773806c0c0 con 0x7f773806d160 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773806c3a0 con 0x7f773815dd80 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773ed57640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773806c680 con 0x7f773815af70 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f773806d160 0x7f77380cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f773806d160 0x7f77380cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37802/0 (socket says 172.21.15.2:37802) 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 -- 172.21.15.2:0/1266516310 learned_addr learned my addr 172.21.15.2:0/1266516310 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:57.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773d2f4640 1 --2- 172.21.15.2:0/1266516310 >> v2:172.21.15.90:3300/0 conn(0x7f773815dd80 0x7f773815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f773caf3640 1 --2- 172.21.15.2:0/1266516310 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773815af70 0x7f77380cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 -- 172.21.15.2:0/1266516310 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773815af70 msgr2=0x7f77380cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 --2- 172.21.15.2:0/1266516310 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773815af70 0x7f77380cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 -- 172.21.15.2:0/1266516310 >> v2:172.21.15.90:3300/0 conn(0x7f773815dd80 msgr2=0x7f773815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 --2- 172.21.15.2:0/1266516310 >> v2:172.21.15.90:3300/0 conn(0x7f773815dd80 0x7f773815e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.354+0000 7f7737fff640 1 -- 172.21.15.2:0/1266516310 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773806c960 con 0x7f773806d160 2023-11-04T01:42:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f7737fff640 1 --2- 172.21.15.2:0/1266516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773806d160 0x7f77380cdfe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f773806f780 tx=0x7f772c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e0bfde6129cc0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f77377fe640 1 -- 172.21.15.2:0/1266516310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0ac630 con 0x7f773806d160 2023-11-04T01:42:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f77377fe640 1 -- 172.21.15.2:0/1266516310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772c0ac790 con 0x7f773806d160 2023-11-04T01:42:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f77377fe640 1 -- 172.21.15.2:0/1266516310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772c0acb20 con 0x7f773806d160 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- 172.21.15.2:0/1266516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773806d160 msgr2=0x7f77380cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 --2- 172.21.15.2:0/1266516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773806d160 0x7f77380cdfe0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f773806f780 tx=0x7f772c01c500 comp rx=0 tx=0).stop 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- 172.21.15.2:0/1266516310 shutdown_connections 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 --2- 172.21.15.2:0/1266516310 >> v2:172.21.15.90:3300/0 conn(0x7f773815dd80 0x7f773815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 --2- 172.21.15.2:0/1266516310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773806d160 0x7f77380cdfe0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 --2- 172.21.15.2:0/1266516310 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773815af70 0x7f77380cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- 172.21.15.2:0/1266516310 >> 172.21.15.2:0/1266516310 conn(0x7f77380cb510 msgr2=0x7f77380cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- 172.21.15.2:0/1266516310 shutdown_connections 2023-11-04T01:42:57.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- 172.21.15.2:0/1266516310 wait complete. 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 Processor -- start 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- start start 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773806d160 0x7f77381fa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f773815af70 0x7f7738159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773815dd80 0x7f77380c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7738159ba0 con 0x7f773815dd80 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380c49f0 con 0x7f773815af70 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773ed57640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77381588a0 con 0x7f773806d160 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773815dd80 0x7f77380c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773815dd80 0x7f77380c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37818/0 (socket says 172.21.15.2:37818) 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 -- 172.21.15.2:0/3661004303 learned_addr learned my addr 172.21.15.2:0/3661004303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f7737fff640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f773815af70 0x7f7738159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773caf3640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773806d160 0x7f77381fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 -- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773806d160 msgr2=0x7f77381fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773806d160 0x7f77381fa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 -- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f773815af70 msgr2=0x7f7738159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f773815af70 0x7f7738159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773d2f4640 1 -- 172.21.15.2:0/3661004303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772c0094d0 con 0x7f773815dd80 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f7737fff640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f773815af70 0x7f7738159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.358+0000 7f773caf3640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773806d160 0x7f77381fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f773d2f4640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773815dd80 0x7f77380c4150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f773000d560 tx=0x7f773000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f77357fa640 1 -- 172.21.15.2:0/3661004303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300125f0 con 0x7f773815dd80 2023-11-04T01:42:57.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f77357fa640 1 -- 172.21.15.2:0/3661004303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730012770 con 0x7f773815dd80 2023-11-04T01:42:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7738158b80 con 0x7f773815dd80 2023-11-04T01:42:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f77357fa640 1 -- 172.21.15.2:0/3661004303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730012b20 con 0x7f773815dd80 2023-11-04T01:42:57.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7738159140 con 0x7f773815dd80 2023-11-04T01:42:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7738159330 con 0x7f773815dd80 2023-11-04T01:42:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f77357fa640 1 -- 172.21.15.2:0/3661004303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7730012c80 con 0x7f773815dd80 2023-11-04T01:42:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f77357fa640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77240664a0 0x7f7724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f77357fa640 1 -- 172.21.15.2:0/3661004303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77300842c0 con 0x7f773815dd80 2023-11-04T01:42:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f773caf3640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77240664a0 0x7f7724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.362+0000 7f773caf3640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77240664a0 0x7f7724068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7728003fd0 tx=0x7f7728003a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.366+0000 7f77357fa640 1 -- 172.21.15.2:0/3661004303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77300517d0 con 0x7f773815dd80 2023-11-04T01:42:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.522+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77380744a0 con 0x7f773815dd80 2023-11-04T01:42:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.522+0000 7f77357fa640 1 -- 172.21.15.2:0/3661004303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7730054df0 con 0x7f773815dd80 2023-11-04T01:42:57.526 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:42:57.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77240664a0 msgr2=0x7f7724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77240664a0 0x7f7724068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7728003fd0 tx=0x7f7728003a00 comp rx=0 tx=0).stop 2023-11-04T01:42:57.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773815dd80 msgr2=0x7f77380c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773815dd80 0x7f77380c4150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f773000d560 tx=0x7f773000da20 comp rx=0 tx=0).stop 2023-11-04T01:42:57.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 shutdown_connections 2023-11-04T01:42:57.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77240664a0 0x7f7724068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f773815dd80 0x7f77380c4150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f773815af70 0x7f7738159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 --2- 172.21.15.2:0/3661004303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f773806d160 0x7f77381fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 >> 172.21.15.2:0/3661004303 conn(0x7f77380cb510 msgr2=0x7f77380c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 shutdown_connections 2023-11-04T01:42:57.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.526+0000 7f773ed57640 1 -- 172.21.15.2:0/3661004303 wait complete. 2023-11-04T01:42:57.545 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6be866640 1 Processor -- start 2023-11-04T01:42:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6be866640 1 -- start start 2023-11-04T01:42:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6be866640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6be866640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6b80cdee0 0x7fb6b806e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6be866640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b80ce9b0 con 0x7fb6b815d840 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6be866640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b815e8a0 con 0x7fb6b80cdee0 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6be866640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b806ea40 con 0x7fb6b815aec0 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6bce03640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6b80cdee0 0x7fb6b806e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6bce03640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6b80cdee0 0x7fb6b806e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37832/0 (socket says 172.21.15.2:37832) 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6bce03640 1 -- 172.21.15.2:0/4022016262 learned_addr learned my addr 172.21.15.2:0/4022016262 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6b7fff640 1 --2- 172.21.15.2:0/4022016262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6bce03640 1 -- 172.21.15.2:0/4022016262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 msgr2=0x7fb6b806c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6bce03640 1 --2- 172.21.15.2:0/4022016262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6bce03640 1 -- 172.21.15.2:0/4022016262 >> v1:172.21.15.90:6789/0 conn(0x7fb6b815d840 legacy=0x7fb6b80cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.666+0000 7fb6bce03640 1 -- 172.21.15.2:0/4022016262 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b80d0940 con 0x7fb6b80cdee0 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6bce03640 1 --2- 172.21.15.2:0/4022016262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b806e500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009e50 tx=0x7fb6b001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92147cf135ddd20c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b77fe640 1 -- 172.21.15.2:0/4022016262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00a5730 con 0x7fb6b80cdee0 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b77fe640 1 -- 172.21.15.2:0/4022016262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b00a5890 con 0x7fb6b80cdee0 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b77fe640 1 -- 172.21.15.2:0/4022016262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00a5c20 con 0x7fb6b80cdee0 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- 172.21.15.2:0/4022016262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 msgr2=0x7fb6b806e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 --2- 172.21.15.2:0/4022016262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b806e500 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009e50 tx=0x7fb6b001c980 comp rx=0 tx=0).stop 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- 172.21.15.2:0/4022016262 shutdown_connections 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 --2- 172.21.15.2:0/4022016262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b806e500 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 --2- 172.21.15.2:0/4022016262 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- 172.21.15.2:0/4022016262 >> 172.21.15.2:0/4022016262 conn(0x7fb6b80b28f0 msgr2=0x7fb6b80b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- 172.21.15.2:0/4022016262 shutdown_connections 2023-11-04T01:42:57.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- 172.21.15.2:0/4022016262 wait complete. 2023-11-04T01:42:57.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 Processor -- start 2023-11-04T01:42:57.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- start start 2023-11-04T01:42:57.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b80cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6b815d840 0x7fb6b80b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80b5980 con 0x7fb6b80cdee0 2023-11-04T01:42:57.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80c80c0 con 0x7fb6b815d840 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6be866640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80b5bd0 con 0x7fb6b815aec0 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b80cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b80cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37840/0 (socket says 172.21.15.2:37840) 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 -- 172.21.15.2:0/403927383 learned_addr learned my addr 172.21.15.2:0/403927383 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6affff640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6bce03640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6b815d840 0x7fb6b80b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 -- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 msgr2=0x7fb6b806bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 -- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6b815d840 msgr2=0x7fb6b80b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6b815d840 0x7fb6b80b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 -- 172.21.15.2:0/403927383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b0009b30 con 0x7fb6b80cdee0 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b7fff640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b80cab90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800d800 tx=0x7fb6a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b57fa640 1 -- 172.21.15.2:0/403927383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a800b6c0 con 0x7fb6b80cdee0 2023-11-04T01:42:57.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b57fa640 1 -- 172.21.15.2:0/403927383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a800b820 con 0x7fb6b80cdee0 2023-11-04T01:42:57.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.670+0000 7fb6b57fa640 1 -- 172.21.15.2:0/403927383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a800bb90 con 0x7fb6b80cdee0 2023-11-04T01:42:57.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b80b5eb0 con 0x7fb6b80cdee0 2023-11-04T01:42:57.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b80c8360 con 0x7fb6b80cdee0 2023-11-04T01:42:57.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b80b35c0 con 0x7fb6b80cdee0 2023-11-04T01:42:57.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6b57fa640 1 -- 172.21.15.2:0/403927383 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb6a800bcf0 con 0x7fb6b80cdee0 2023-11-04T01:42:57.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6b57fa640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6980664a0 0x7fb698068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6b57fa640 1 -- 172.21.15.2:0/403927383 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6a80844b0 con 0x7fb6b80cdee0 2023-11-04T01:42:57.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6affff640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6980664a0 0x7fb698068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.674+0000 7fb6affff640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6980664a0 0x7fb698068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6b815e1d0 tx=0x7fb6a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.678+0000 7fb6b57fa640 1 -- 172.21.15.2:0/403927383 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb6a8051890 con 0x7fb6b80cdee0 2023-11-04T01:42:57.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.834+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6b80b6d60 con 0x7fb6b80cdee0 2023-11-04T01:42:57.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6b57fa640 1 -- 172.21.15.2:0/403927383 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7fb6a8011340 con 0x7fb6b80cdee0 2023-11-04T01:42:57.839 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:57.839 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6980664a0 msgr2=0x7fb698068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6980664a0 0x7fb698068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb6b815e1d0 tx=0x7fb6a0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 msgr2=0x7fb6b80cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b80cab90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800d800 tx=0x7fb6a800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 shutdown_connections 2023-11-04T01:42:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6980664a0 0x7fb698068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6b815d840 0x7fb6b80b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb6b815aec0 0x7fb6b806bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 --2- 172.21.15.2:0/403927383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6b80cdee0 0x7fb6b80cab90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 >> 172.21.15.2:0/403927383 conn(0x7fb6b80b28f0 msgr2=0x7fb6b806b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 shutdown_connections 2023-11-04T01:42:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.838+0000 7fb6be866640 1 -- 172.21.15.2:0/403927383 wait complete. 2023-11-04T01:42:57.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:57.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:57.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.970+0000 7fea6882d640 1 Processor -- start 2023-11-04T01:42:57.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6882d640 1 -- start start 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6882d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea6415acb0 0x7fea6415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6882d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fea6415c160 0x7fea640b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6882d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea640cb130 con 0x7fea640b0a50 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6882d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6415bd40 con 0x7fea6415acb0 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6882d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6406fd80 con 0x7fea6415c160 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea6415acb0 0x7fea6415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea6415acb0 0x7fea6415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37842/0 (socket says 172.21.15.2:37842) 2023-11-04T01:42:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 -- 172.21.15.2:0/3423858732 learned_addr learned my addr 172.21.15.2:0/3423858732 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea61d9b640 1 --2- 172.21.15.2:0/3423858732 >> v2:172.21.15.90:3300/0 conn(0x7fea6415c160 0x7fea640b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 -- 172.21.15.2:0/3423858732 >> v2:172.21.15.90:3300/0 conn(0x7fea6415c160 msgr2=0x7fea640b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 --2- 172.21.15.2:0/3423858732 >> v2:172.21.15.90:3300/0 conn(0x7fea6415c160 0x7fea640b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 -- 172.21.15.2:0/3423858732 >> v1:172.21.15.90:6789/0 conn(0x7fea640b0a50 legacy=0x7fea640ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 -- 172.21.15.2:0/3423858732 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6415b680 con 0x7fea6415acb0 2023-11-04T01:42:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea61d9b640 1 --2- 172.21.15.2:0/3423858732 >> v2:172.21.15.90:3300/0 conn(0x7fea6415c160 0x7fea640b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:57.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6259c640 1 --2- 172.21.15.2:0/3423858732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415acb0 0x7fea6415b090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea640ce4b0 tx=0x7fea5401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00a654754d7f0ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.974+0000 7fea6159a640 1 -- 172.21.15.2:0/3423858732 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540a5760 con 0x7fea6415acb0 2023-11-04T01:42:57.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6159a640 1 -- 172.21.15.2:0/3423858732 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea540a58c0 con 0x7fea6415acb0 2023-11-04T01:42:57.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6159a640 1 -- 172.21.15.2:0/3423858732 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea540a5c50 con 0x7fea6415acb0 2023-11-04T01:42:57.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- 172.21.15.2:0/3423858732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415acb0 msgr2=0x7fea6415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 --2- 172.21.15.2:0/3423858732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415acb0 0x7fea6415b090 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea640ce4b0 tx=0x7fea5401c990 comp rx=0 tx=0).stop 2023-11-04T01:42:57.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- 172.21.15.2:0/3423858732 shutdown_connections 2023-11-04T01:42:57.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 --2- 172.21.15.2:0/3423858732 >> v2:172.21.15.90:3300/0 conn(0x7fea6415c160 0x7fea640b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 --2- 172.21.15.2:0/3423858732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415acb0 0x7fea6415b090 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- 172.21.15.2:0/3423858732 >> 172.21.15.2:0/3423858732 conn(0x7fea640cb510 msgr2=0x7fea640cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:57.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- 172.21.15.2:0/3423858732 shutdown_connections 2023-11-04T01:42:57.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- 172.21.15.2:0/3423858732 wait complete. 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 Processor -- start 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- start start 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea640b0a50 0x7fea6415e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea6415acb0 0x7fea640c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415c160 0x7fea64151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea641525a0 con 0x7fea6415c160 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6415e1a0 con 0x7fea6415acb0 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea640c5890 con 0x7fea640b0a50 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415c160 0x7fea64151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415c160 0x7fea64151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37854/0 (socket says 172.21.15.2:37854) 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 -- 172.21.15.2:0/3837735185 learned_addr learned my addr 172.21.15.2:0/3837735185 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6259c640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea640b0a50 0x7fea6415e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea61d9b640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea6415acb0 0x7fea640c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 -- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea640b0a50 msgr2=0x7fea6415e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea640b0a50 0x7fea6415e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 -- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea6415acb0 msgr2=0x7fea640c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea6415acb0 0x7fea640c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 -- 172.21.15.2:0/3837735185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea54009b30 con 0x7fea6415c160 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea62d9d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415c160 0x7fea64151d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b410 tx=0x7fea5c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea52ffd640 1 -- 172.21.15.2:0/3837735185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011830 con 0x7fea6415c160 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea52ffd640 1 -- 172.21.15.2:0/3837735185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c0119d0 con 0x7fea6415c160 2023-11-04T01:42:57.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea52ffd640 1 -- 172.21.15.2:0/3837735185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011d80 con 0x7fea6415c160 2023-11-04T01:42:57.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6415d5d0 con 0x7fea6415c160 2023-11-04T01:42:57.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.978+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6415db50 con 0x7fea6415c160 2023-11-04T01:42:57.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.982+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea640744a0 con 0x7fea6415c160 2023-11-04T01:42:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.982+0000 7fea52ffd640 1 -- 172.21.15.2:0/3837735185 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea5c0193b0 con 0x7fea6415c160 2023-11-04T01:42:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.982+0000 7fea52ffd640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea440664d0 0x7fea44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.982+0000 7fea52ffd640 1 -- 172.21.15.2:0/3837735185 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea5c083b90 con 0x7fea6415c160 2023-11-04T01:42:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.982+0000 7fea6259c640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea440664d0 0x7fea44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:57.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.982+0000 7fea6259c640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea440664d0 0x7fea44068990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fea540ae000 tx=0x7fea540a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:57.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:57.986+0000 7fea52ffd640 1 -- 172.21.15.2:0/3837735185 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea5c051010 con 0x7fea6415c160 2023-11-04T01:42:58.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.134+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea640b3f10 con 0x7fea6415c160 2023-11-04T01:42:58.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea52ffd640 1 -- 172.21.15.2:0/3837735185 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea5c054630 con 0x7fea6415c160 2023-11-04T01:42:58.139 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:58.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea440664d0 msgr2=0x7fea44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea440664d0 0x7fea44068990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fea540ae000 tx=0x7fea540a7070 comp rx=0 tx=0).stop 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415c160 msgr2=0x7fea64151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415c160 0x7fea64151d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b410 tx=0x7fea5c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 shutdown_connections 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea440664d0 0x7fea44068990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea6415c160 0x7fea64151d50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea6415acb0 0x7fea640c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 --2- 172.21.15.2:0/3837735185 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea640b0a50 0x7fea6415e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 >> 172.21.15.2:0/3837735185 conn(0x7fea640cb510 msgr2=0x7fea640ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 shutdown_connections 2023-11-04T01:42:58.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.138+0000 7fea6882d640 1 -- 172.21.15.2:0/3837735185 wait complete. 2023-11-04T01:42:58.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd702a82640 1 Processor -- start 2023-11-04T01:42:58.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd702a82640 1 -- start start 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd702a82640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd6fc15af70 0x7fd6fc0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd702a82640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd6fc15e490 0x7fd6fc0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd702a82640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc15e890 con 0x7fd6fc06d160 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd702a82640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc071200 con 0x7fd6fc15e490 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd702a82640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc06c0c0 con 0x7fd6fc15af70 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70101f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd6fc15e490 0x7fd6fc0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70101f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd6fc15e490 0x7fd6fc0cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37862/0 (socket says 172.21.15.2:37862) 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70101f640 1 -- 172.21.15.2:0/2908210614 learned_addr learned my addr 172.21.15.2:0/2908210614 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70081e640 1 --2- 172.21.15.2:0/2908210614 >> v2:172.21.15.90:3300/0 conn(0x7fd6fc15af70 0x7fd6fc0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70101f640 1 -- 172.21.15.2:0/2908210614 >> v2:172.21.15.90:3300/0 conn(0x7fd6fc15af70 msgr2=0x7fd6fc0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70101f640 1 --2- 172.21.15.2:0/2908210614 >> v2:172.21.15.90:3300/0 conn(0x7fd6fc15af70 0x7fd6fc0cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70101f640 1 -- 172.21.15.2:0/2908210614 >> v1:172.21.15.90:6789/0 conn(0x7fd6fc06d160 legacy=0x7fd6fc15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.274+0000 7fd70101f640 1 -- 172.21.15.2:0/2908210614 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc06c3a0 con 0x7fd6fc15e490 2023-11-04T01:42:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70101f640 1 --2- 172.21.15.2:0/2908210614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc15e490 0x7fd6fc0cdfe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc06b490 tx=0x7fd6f401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f9a650c247efe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd6fb7fe640 1 -- 172.21.15.2:0/2908210614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40a5740 con 0x7fd6fc15e490 2023-11-04T01:42:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd6fb7fe640 1 -- 172.21.15.2:0/2908210614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f40a58a0 con 0x7fd6fc15e490 2023-11-04T01:42:58.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd6fb7fe640 1 -- 172.21.15.2:0/2908210614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40a5c30 con 0x7fd6fc15e490 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- 172.21.15.2:0/2908210614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc15e490 msgr2=0x7fd6fc0cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 --2- 172.21.15.2:0/2908210614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc15e490 0x7fd6fc0cdfe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc06b490 tx=0x7fd6f401c990 comp rx=0 tx=0).stop 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- 172.21.15.2:0/2908210614 shutdown_connections 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 --2- 172.21.15.2:0/2908210614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc15e490 0x7fd6fc0cdfe0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 --2- 172.21.15.2:0/2908210614 >> v2:172.21.15.90:3300/0 conn(0x7fd6fc15af70 0x7fd6fc0cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- 172.21.15.2:0/2908210614 >> 172.21.15.2:0/2908210614 conn(0x7fd6fc0cb510 msgr2=0x7fd6fc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- 172.21.15.2:0/2908210614 shutdown_connections 2023-11-04T01:42:58.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- 172.21.15.2:0/2908210614 wait complete. 2023-11-04T01:42:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 Processor -- start 2023-11-04T01:42:58.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- start start 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc06d160 0x7fd6fc148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6fc15af70 0x7fd6fc15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6fc15e490 0x7fd6fc0c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc15a850 con 0x7fd6fc06d160 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c5520 con 0x7fd6fc15e490 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd702a82640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b1b80 con 0x7fd6fc15af70 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc06d160 0x7fd6fc148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc06d160 0x7fd6fc148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37876/0 (socket says 172.21.15.2:37876) 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 -- 172.21.15.2:0/1055004534 learned_addr learned my addr 172.21.15.2:0/1055004534 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70101f640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6fc15e490 0x7fd6fc0c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd6fbfff640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6fc15af70 0x7fd6fc15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 -- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6fc15af70 msgr2=0x7fd6fc15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6fc15af70 0x7fd6fc15a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 -- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6fc15e490 msgr2=0x7fd6fc0c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6fc15e490 0x7fd6fc0c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 -- 172.21.15.2:0/1055004534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4009b30 con 0x7fd6fc06d160 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd6fbfff640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6fc15af70 0x7fd6fc15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.278+0000 7fd70081e640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc06d160 0x7fd6fc148800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00d800 tx=0x7fd6ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6f97fa640 1 -- 172.21.15.2:0/1055004534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00b6c0 con 0x7fd6fc06d160 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6f97fa640 1 -- 172.21.15.2:0/1055004534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00b820 con 0x7fd6fc06d160 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6f97fa640 1 -- 172.21.15.2:0/1055004534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00bb90 con 0x7fd6fc06d160 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc0b1e60 con 0x7fd6fc06d160 2023-11-04T01:42:58.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc0c4ac0 con 0x7fd6fc06d160 2023-11-04T01:42:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc0c4c80 con 0x7fd6fc06d160 2023-11-04T01:42:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6f97fa640 1 -- 172.21.15.2:0/1055004534 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6ec00bcf0 con 0x7fd6fc06d160 2023-11-04T01:42:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6f97fa640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd6e80664a0 0x7fd6e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6f97fa640 1 -- 172.21.15.2:0/1055004534 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6ec0843a0 con 0x7fd6fc06d160 2023-11-04T01:42:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6fbfff640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd6e80664a0 0x7fd6e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.282+0000 7fd6fbfff640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd6e80664a0 0x7fd6e8068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc156380 tx=0x7fd6f0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.286+0000 7fd6f97fa640 1 -- 172.21.15.2:0/1055004534 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd6ec051820 con 0x7fd6fc06d160 2023-11-04T01:42:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.438+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6fc0744a0 con 0x7fd6fc06d160 2023-11-04T01:42:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd6f97fa640 1 -- 172.21.15.2:0/1055004534 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6ec054e40 con 0x7fd6fc06d160 2023-11-04T01:42:58.443 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd6e80664a0 msgr2=0x7fd6e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd6e80664a0 0x7fd6e8068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc156380 tx=0x7fd6f0009040 comp rx=0 tx=0).stop 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc06d160 msgr2=0x7fd6fc148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc06d160 0x7fd6fc148800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00d800 tx=0x7fd6ec00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 shutdown_connections 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd6e80664a0 0x7fd6e8068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd6fc15e490 0x7fd6fc0c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6fc15af70 0x7fd6fc15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 --2- 172.21.15.2:0/1055004534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6fc06d160 0x7fd6fc148800 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 >> 172.21.15.2:0/1055004534 conn(0x7fd6fc0cb510 msgr2=0x7fd6fc15b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 shutdown_connections 2023-11-04T01:42:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.442+0000 7fd702a82640 1 -- 172.21.15.2:0/1055004534 wait complete. 2023-11-04T01:42:58.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.582+0000 7fc09b82d640 1 Processor -- start 2023-11-04T01:42:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.582+0000 7fc09b82d640 1 -- start start 2023-11-04T01:42:58.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc09b82d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc09415acb0 0x7fc09415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc09b82d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0940b0c20 0x7fc0940ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc09b82d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940cb130 con 0x7fc09415c160 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc09b82d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09415bd40 con 0x7fc0940b0c20 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc09b82d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09406fd80 con 0x7fc09415acb0 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc099dca640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc0940b0c20 0x7fc0940ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc098dc8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc09415c160 0x7fc0940b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41912/0 (socket says 172.21.15.2:41912) 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc098dc8640 1 -- 172.21.15.2:0/1182217945 learned_addr learned my addr 172.21.15.2:0/1182217945 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc0995c9640 1 --2- 172.21.15.2:0/1182217945 >> v2:172.21.15.90:3300/0 conn(0x7fc09415acb0 0x7fc09415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc099dca640 1 -- 172.21.15.2:0/1182217945 >> v2:172.21.15.90:3300/0 conn(0x7fc09415acb0 msgr2=0x7fc09415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc099dca640 1 --2- 172.21.15.2:0/1182217945 >> v2:172.21.15.90:3300/0 conn(0x7fc09415acb0 0x7fc09415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc099dca640 1 -- 172.21.15.2:0/1182217945 >> v1:172.21.15.2:6789/0 conn(0x7fc09415c160 legacy=0x7fc0940b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc099dca640 1 -- 172.21.15.2:0/1182217945 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09415b680 con 0x7fc0940b0c20 2023-11-04T01:42:58.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc08bfff640 1 -- 172.21.15.2:0/1182217945 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679771771 0 0) 0x7fc0940cb130 con 0x7fc09415c160 2023-11-04T01:42:58.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc0995c9640 1 --2- 172.21.15.2:0/1182217945 >> v2:172.21.15.90:3300/0 conn(0x7fc09415acb0 0x7fc09415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc099dca640 1 --2- 172.21.15.2:0/1182217945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0940b0c20 0x7fc0940ca490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009d90 tx=0x7fc08c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbd328fbd942616 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc08bfff640 1 -- 172.21.15.2:0/1182217945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0a59c0 con 0x7fc0940b0c20 2023-11-04T01:42:58.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc08bfff640 1 -- 172.21.15.2:0/1182217945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c0a5b20 con 0x7fc0940b0c20 2023-11-04T01:42:58.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.586+0000 7fc08bfff640 1 -- 172.21.15.2:0/1182217945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0ad440 con 0x7fc0940b0c20 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/1182217945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0940b0c20 msgr2=0x7fc0940ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 --2- 172.21.15.2:0/1182217945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0940b0c20 0x7fc0940ca490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009d90 tx=0x7fc08c01c8e0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/1182217945 shutdown_connections 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 --2- 172.21.15.2:0/1182217945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0940b0c20 0x7fc0940ca490 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 --2- 172.21.15.2:0/1182217945 >> v2:172.21.15.90:3300/0 conn(0x7fc09415acb0 0x7fc09415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/1182217945 >> 172.21.15.2:0/1182217945 conn(0x7fc0940cb510 msgr2=0x7fc0940cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/1182217945 shutdown_connections 2023-11-04T01:42:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/1182217945 wait complete. 2023-11-04T01:42:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 Processor -- start 2023-11-04T01:42:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- start start 2023-11-04T01:42:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0940b0c20 0x7fc0940c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc09415acb0 0x7fc0941510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc09415c160 0x7fc0940aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09406bd80 con 0x7fc09415acb0 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09406b4b0 con 0x7fc0940b0c20 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940ae340 con 0x7fc09415c160 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc09415acb0 0x7fc0941510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc09415acb0 0x7fc0941510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37900/0 (socket says 172.21.15.2:37900) 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 -- 172.21.15.2:0/3656827807 learned_addr learned my addr 172.21.15.2:0/3656827807 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 -- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc09415c160 msgr2=0x7fc0940aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc09415c160 0x7fc0940aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 -- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0940b0c20 msgr2=0x7fc0940c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0940b0c20 0x7fc0940c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 -- 172.21.15.2:0/3656827807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009a70 con 0x7fc09415acb0 2023-11-04T01:42:58.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc098dc8640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc09415acb0 0x7fc0941510b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c480 tx=0x7fc08400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc089ffb640 1 -- 172.21.15.2:0/3656827807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840074e0 con 0x7fc09415acb0 2023-11-04T01:42:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc089ffb640 1 -- 172.21.15.2:0/3656827807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084007660 con 0x7fc09415acb0 2023-11-04T01:42:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc089ffb640 1 -- 172.21.15.2:0/3656827807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084004a30 con 0x7fc09415acb0 2023-11-04T01:42:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0941515f0 con 0x7fc09415acb0 2023-11-04T01:42:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09406b6c0 con 0x7fc09415acb0 2023-11-04T01:42:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.590+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0940744a0 con 0x7fc09415acb0 2023-11-04T01:42:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.594+0000 7fc089ffb640 1 -- 172.21.15.2:0/3656827807 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc084004b90 con 0x7fc09415acb0 2023-11-04T01:42:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.594+0000 7fc089ffb640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc0780664a0 0x7fc078068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.594+0000 7fc089ffb640 1 -- 172.21.15.2:0/3656827807 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc084083070 con 0x7fc09415acb0 2023-11-04T01:42:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.594+0000 7fc0995c9640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc0780664a0 0x7fc078068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.594+0000 7fc0995c9640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc0780664a0 0x7fc078068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc09000a8d0 tx=0x7fc090008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.598+0000 7fc089ffb640 1 -- 172.21.15.2:0/3656827807 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc084053f80 con 0x7fc09415acb0 2023-11-04T01:42:58.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.746+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0940cde30 con 0x7fc09415acb0 2023-11-04T01:42:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.746+0000 7fc089ffb640 1 -- 172.21.15.2:0/3656827807 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0840180a0 con 0x7fc09415acb0 2023-11-04T01:42:58.749 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:42:58.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc0780664a0 msgr2=0x7fc078068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc0780664a0 0x7fc078068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc09000a8d0 tx=0x7fc090008040 comp rx=0 tx=0).stop 2023-11-04T01:42:58.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc09415acb0 msgr2=0x7fc0941510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc09415acb0 0x7fc0941510b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c480 tx=0x7fc08400c940 comp rx=0 tx=0).stop 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 shutdown_connections 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc0780664a0 0x7fc078068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc09415c160 0x7fc0940aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc09415acb0 0x7fc0941510b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 --2- 172.21.15.2:0/3656827807 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0940b0c20 0x7fc0940c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 >> 172.21.15.2:0/3656827807 conn(0x7fc0940cb510 msgr2=0x7fc0940ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 shutdown_connections 2023-11-04T01:42:58.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.750+0000 7fc09b82d640 1 -- 172.21.15.2:0/3656827807 wait complete. 2023-11-04T01:42:58.777 INFO:tasks.cephfs_test_runner:Starting test: test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that attempt to attach pool with snapshots to an fs fails 2023-11-04T01:42:58.777 INFO:tasks.cephfs_test_runner:test_attaching_pools_with_snaps_to_fs_fails (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:42:58.777 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:42:58.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.886+0000 7f256eb91640 1 Processor -- start 2023-11-04T01:42:58.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.886+0000 7f256eb91640 1 -- start start 2023-11-04T01:42:58.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256eb91640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 0x7f2568065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256eb91640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f256815e7f0 0x7f256815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256eb91640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680cc740 con 0x7f256815e170 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256eb91640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2568066510 con 0x7f256815e7f0 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256eb91640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256806b170 con 0x7f256815a080 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f256815e170 0x7f25680b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41920/0 (socket says 172.21.15.2:41920) 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 -- 172.21.15.2:0/992381524 learned_addr learned my addr 172.21.15.2:0/992381524 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816368554 0 0) 0x7f25680cc740 con 0x7f256815e170 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2558003530 con 0x7f256815e170 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256c92d640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 0x7f2568065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f2567fff640 1 --2- 172.21.15.2:0/992381524 >> v2:172.21.15.90:3300/0 conn(0x7f256815e7f0 0x7f256815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133196717 0 0) 0x7f2558003530 con 0x7f256815e170 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 msgr2=0x7f2568065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 0x7f2568065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 >> v2:172.21.15.90:3300/0 conn(0x7f256815e7f0 msgr2=0x7f256815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 --2- 172.21.15.2:0/992381524 >> v2:172.21.15.90:3300/0 conn(0x7f256815e7f0 0x7f256815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256815e590 con 0x7f256815e170 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2560001a00 con 0x7f256815e170 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 >> v1:172.21.15.2:6789/0 conn(0x7f256815e170 legacy=0x7f25680b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 0x7f2558003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2558003fb0 0x7f25580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558004d10 0x7f2558005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568066510 con 0x7f2558004d10 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256806b170 con 0x7f2558003fb0 2023-11-04T01:42:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255800ba90 con 0x7f256815a080 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558004d10 0x7f2558005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256c92d640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 0x7f2558003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f2567fff640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2558003fb0 0x7f25580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 -- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 msgr2=0x7f2558003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f256815a080 0x7f2558003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 -- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2558003fb0 msgr2=0x7f25580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2558003fb0 0x7f25580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 -- 172.21.15.2:0/992381524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558003530 con 0x7f2558004d10 2023-11-04T01:42:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f2567fff640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2558003fb0 0x7f25580047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.890+0000 7f256d12e640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558004d10 0x7f2558005190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f256000a830 tx=0x7f256001f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79f79ca6f6f41b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600ad5f0 con 0x7f2558004d10 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25600a9040 con 0x7f2558004d10 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f25677fe640 1 -- 172.21.15.2:0/992381524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600ada10 con 0x7f2558004d10 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- 172.21.15.2:0/992381524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558004d10 msgr2=0x7f2558005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 --2- 172.21.15.2:0/992381524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2558004d10 0x7f2558005190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f256000a830 tx=0x7f256001f570 comp rx=0 tx=0).stop 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 -- 172.21.15.2:0/992381524 reap_dead start 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- 172.21.15.2:0/992381524 shutdown_connections 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- 172.21.15.2:0/992381524 >> 172.21.15.2:0/992381524 conn(0x7f25680716a0 msgr2=0x7f2568071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- 172.21.15.2:0/992381524 shutdown_connections 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- 172.21.15.2:0/992381524 wait complete. 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 Processor -- start 2023-11-04T01:42:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- start start 2023-11-04T01:42:58.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2568153010 0x7f25681533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25681f2430 0x7f25680cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680cb370 0x7f25680c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680cb7f0 con 0x7f25680cb370 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25681ef350 con 0x7f25681f2430 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680b10b0 con 0x7f2568153010 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680cb370 0x7f25680c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680cb370 0x7f25680c64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37918/0 (socket says 172.21.15.2:37918) 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 -- 172.21.15.2:0/3015907769 learned_addr learned my addr 172.21.15.2:0/3015907769 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256c92d640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2568153010 0x7f25681533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 -- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2568153010 msgr2=0x7f25681533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2568153010 0x7f25681533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 -- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25681f2430 msgr2=0x7f25680cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f2567fff640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25681f2430 0x7f25680cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25681f2430 0x7f25680cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:58.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 -- 172.21.15.2:0/3015907769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25681ee740 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f2567fff640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25681f2430 0x7f25680cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256d12e640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680cb370 0x7f25680c64f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25600b0040 tx=0x7f2558005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f25657fa640 1 -- 172.21.15.2:0/3015907769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600add00 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f25657fa640 1 -- 172.21.15.2:0/3015907769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25600ade60 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25681eea20 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f25657fa640 1 -- 172.21.15.2:0/3015907769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25600072c0 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.894+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25681eefe0 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.898+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25680675f0 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.898+0000 7f25657fa640 1 -- 172.21.15.2:0/3015907769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25600b4040 con 0x7f25680cb370 2023-11-04T01:42:58.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.898+0000 7f25657fa640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f254c0664d0 0x7f254c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:58.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.898+0000 7f25657fa640 1 -- 172.21.15.2:0/3015907769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f256011fca0 con 0x7f25680cb370 2023-11-04T01:42:58.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.898+0000 7f256c92d640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f254c0664d0 0x7f254c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:58.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.898+0000 7f256c92d640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f254c0664d0 0x7f254c068990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f255c00b9b0 tx=0x7f255c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:58.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:58.902+0000 7f25657fa640 1 -- 172.21.15.2:0/3015907769 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25600ed260 con 0x7f25680cb370 2023-11-04T01:42:59.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.058+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25680aeb60 con 0x7f25680cb370 2023-11-04T01:42:59.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.062+0000 7f25657fa640 1 -- 172.21.15.2:0/3015907769 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f2560001fd0 con 0x7f25680cb370 2023-11-04T01:42:59.065 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:42:59.065 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f254c0664d0 msgr2=0x7f254c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f254c0664d0 0x7f254c068990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f255c00b9b0 tx=0x7f255c008040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680cb370 msgr2=0x7f25680c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680cb370 0x7f25680c64f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f25600b0040 tx=0x7f2558005800 comp rx=0 tx=0).stop 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 shutdown_connections 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f254c0664d0 0x7f254c068990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25680cb370 0x7f25680c64f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25681f2430 0x7f25680cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 --2- 172.21.15.2:0/3015907769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2568153010 0x7f25681533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 >> 172.21.15.2:0/3015907769 conn(0x7f25680716a0 msgr2=0x7f25680cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 shutdown_connections 2023-11-04T01:42:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.066+0000 7f256eb91640 1 -- 172.21.15.2:0/3015907769 wait complete. 2023-11-04T01:42:59.083 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:42:59.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:42:59.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f90a0443640 1 Processor -- start 2023-11-04T01:42:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f90a0443640 1 -- start start 2023-11-04T01:42:59.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f90a0443640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f90980b5090 0x7f90980d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f90a0443640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f90a0443640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90980d08e0 con 0x7f909815d6c0 2023-11-04T01:42:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f90a0443640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980d2080 con 0x7f90980b5090 2023-11-04T01:42:59.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f90a0443640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90980d2360 con 0x7f90980d0ad0 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909d9de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f90980b5090 0x7f90980d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909e9e0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909d9de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f90980b5090 0x7f90980d19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:59868/0 (socket says 172.21.15.2:59868) 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909d9de640 1 -- 172.21.15.2:0/3522275658 learned_addr learned my addr 172.21.15.2:0/3522275658 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909e1df640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f909815d6c0 0x7f90980b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:57128/0 (socket says 172.21.15.2:57128) 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909e9e0640 1 -- 172.21.15.2:0/3522275658 >> v2:172.21.15.90:3300/0 conn(0x7f90980b5090 msgr2=0x7f90980d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909e9e0640 1 --2- 172.21.15.2:0/3522275658 >> v2:172.21.15.90:3300/0 conn(0x7f90980b5090 0x7f90980d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909e9e0640 1 -- 172.21.15.2:0/3522275658 >> v1:172.21.15.90:6789/0 conn(0x7f909815d6c0 legacy=0x7f90980b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.202+0000 7f909e9e0640 1 -- 172.21.15.2:0/3522275658 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90980d2640 con 0x7f90980d0ad0 2023-11-04T01:42:59.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f909e9e0640 1 --2- 172.21.15.2:0/3522275658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980b6a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9090009d90 tx=0x7f909001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1577aeb873014281 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f909d1dd640 1 -- 172.21.15.2:0/3522275658 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900af600 con 0x7f90980d0ad0 2023-11-04T01:42:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f909d1dd640 1 -- 172.21.15.2:0/3522275658 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900ab050 con 0x7f90980d0ad0 2023-11-04T01:42:59.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f909d1dd640 1 -- 172.21.15.2:0/3522275658 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900af980 con 0x7f90980d0ad0 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 -- 172.21.15.2:0/3522275658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 msgr2=0x7f90980b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 --2- 172.21.15.2:0/3522275658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980b6a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9090009d90 tx=0x7f909001f130 comp rx=0 tx=0).stop 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 -- 172.21.15.2:0/3522275658 shutdown_connections 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 --2- 172.21.15.2:0/3522275658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980b6a30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 --2- 172.21.15.2:0/3522275658 >> v2:172.21.15.90:3300/0 conn(0x7f90980b5090 0x7f90980d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 -- 172.21.15.2:0/3522275658 >> 172.21.15.2:0/3522275658 conn(0x7f90980cf980 msgr2=0x7f90980cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 -- 172.21.15.2:0/3522275658 shutdown_connections 2023-11-04T01:42:59.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.206+0000 7f90a0443640 1 -- 172.21.15.2:0/3522275658 wait complete. 2023-11-04T01:42:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 Processor -- start 2023-11-04T01:42:59.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 -- start start 2023-11-04T01:42:59.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90980b5090 0x7f909814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909815d6c0 0x7f90980c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098157760 con 0x7f909815d6c0 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909815ee20 con 0x7f90980b5090 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909815daa0 con 0x7f90980d0ad0 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909815d6c0 0x7f90980c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909815d6c0 0x7f90980c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37932/0 (socket says 172.21.15.2:37932) 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 -- 172.21.15.2:0/2338035960 learned_addr learned my addr 172.21.15.2:0/2338035960 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e1df640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90980b5090 0x7f909814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909d9de640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 -- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 msgr2=0x7f90980cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 -- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90980b5090 msgr2=0x7f909814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90980b5090 0x7f909814a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 -- 172.21.15.2:0/2338035960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009a70 con 0x7f909815d6c0 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909d9de640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f909e9e0640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909815d6c0 0x7f90980c8a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f909001cd60 tx=0x7f909001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f908effd640 1 -- 172.21.15.2:0/2338035960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090009450 con 0x7f909815d6c0 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f908effd640 1 -- 172.21.15.2:0/2338035960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900afda0 con 0x7f909815d6c0 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909815dd80 con 0x7f909815d6c0 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f908effd640 1 -- 172.21.15.2:0/2338035960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ba660 con 0x7f909815d6c0 2023-11-04T01:42:59.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909815e340 con 0x7f909815d6c0 2023-11-04T01:42:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90980675f0 con 0x7f909815d6c0 2023-11-04T01:42:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.210+0000 7f908effd640 1 -- 172.21.15.2:0/2338035960 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90900ba7c0 con 0x7f909815d6c0 2023-11-04T01:42:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.214+0000 7f908effd640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f907c066470 0x7f907c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.214+0000 7f908effd640 1 -- 172.21.15.2:0/2338035960 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9090122980 con 0x7f909815d6c0 2023-11-04T01:42:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.214+0000 7f909e1df640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f907c066470 0x7f907c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.214+0000 7f909e1df640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f907c066470 0x7f907c068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9094000f70 tx=0x7f9094007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.214+0000 7f908effd640 1 -- 172.21.15.2:0/2338035960 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90900f0020 con 0x7f909815d6c0 2023-11-04T01:42:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90980b7120 con 0x7f909815d6c0 2023-11-04T01:42:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f908effd640 1 -- 172.21.15.2:0/2338035960 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90900c80a0 con 0x7f909815d6c0 2023-11-04T01:42:59.369 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:42:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f907c066470 msgr2=0x7f907c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f907c066470 0x7f907c068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9094000f70 tx=0x7f9094007e90 comp rx=0 tx=0).stop 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909815d6c0 msgr2=0x7f90980c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909815d6c0 0x7f90980c8a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f909001cd60 tx=0x7f909001bed0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 shutdown_connections 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f907c066470 0x7f907c068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f909815d6c0 0x7f90980c8a30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90980d0ad0 0x7f90980cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 --2- 172.21.15.2:0/2338035960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90980b5090 0x7f909814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 >> 172.21.15.2:0/2338035960 conn(0x7f90980cf980 msgr2=0x7f90980b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 shutdown_connections 2023-11-04T01:42:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.366+0000 7f90a0443640 1 -- 172.21.15.2:0/2338035960 wait complete. 2023-11-04T01:42:59.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:42:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff42a974640 1 Processor -- start 2023-11-04T01:42:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff42a974640 1 -- start start 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff42a974640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff42415d0b0 0x7ff424160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff42a974640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff4240cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff42a974640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4240b5e00 con 0x7ff4240cfd50 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff42a974640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240d1520 con 0x7ff42415d0b0 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff42a974640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240d01e0 con 0x7ff4241610f0 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff423fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff42415d0b0 0x7ff424160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff423fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff42415d0b0 0x7ff424160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37934/0 (socket says 172.21.15.2:37934) 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff423fff640 1 -- 172.21.15.2:0/336998761 learned_addr learned my addr 172.21.15.2:0/336998761 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff4237fe640 1 --2- 172.21.15.2:0/336998761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff4240cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff423fff640 1 -- 172.21.15.2:0/336998761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 msgr2=0x7ff4240cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff423fff640 1 --2- 172.21.15.2:0/336998761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff4240cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff423fff640 1 -- 172.21.15.2:0/336998761 >> v1:172.21.15.90:6789/0 conn(0x7ff4240cfd50 legacy=0x7ff4240b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.494+0000 7ff423fff640 1 -- 172.21.15.2:0/336998761 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42415d490 con 0x7ff42415d0b0 2023-11-04T01:42:59.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff423fff640 1 --2- 172.21.15.2:0/336998761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff424160bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff414009870 tx=0x7ff41401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62419d7ffabb80c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff422ffd640 1 -- 172.21.15.2:0/336998761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4140ac630 con 0x7ff42415d0b0 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff422ffd640 1 -- 172.21.15.2:0/336998761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4140ac790 con 0x7ff42415d0b0 2023-11-04T01:42:59.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff422ffd640 1 -- 172.21.15.2:0/336998761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4140acb20 con 0x7ff42415d0b0 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 -- 172.21.15.2:0/336998761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 msgr2=0x7ff424160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 --2- 172.21.15.2:0/336998761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff424160bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff414009870 tx=0x7ff41401c500 comp rx=0 tx=0).stop 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 -- 172.21.15.2:0/336998761 shutdown_connections 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 --2- 172.21.15.2:0/336998761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff4240cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 --2- 172.21.15.2:0/336998761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff424160bb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 -- 172.21.15.2:0/336998761 >> 172.21.15.2:0/336998761 conn(0x7ff42406a890 msgr2=0x7ff42406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 -- 172.21.15.2:0/336998761 shutdown_connections 2023-11-04T01:42:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 -- 172.21.15.2:0/336998761 wait complete. 2023-11-04T01:42:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.498+0000 7ff42a974640 1 Processor -- start 2023-11-04T01:42:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 -- start start 2023-11-04T01:42:59.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4240cfd50 0x7ff424158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff42415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff42414c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff424157080 con 0x7ff42415d0b0 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42415ab40 con 0x7ff4240cfd50 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42415adc0 con 0x7ff4241610f0 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff42415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff42415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37944/0 (socket says 172.21.15.2:37944) 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 -- 172.21.15.2:0/3878908430 learned_addr learned my addr 172.21.15.2:0/3878908430 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff423fff640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4240cfd50 0x7ff424158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff428f11640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff42414c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 -- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 msgr2=0x7ff42414c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff42414c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 -- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4240cfd50 msgr2=0x7ff424158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4240cfd50 0x7ff424158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 -- 172.21.15.2:0/3878908430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4140094d0 con 0x7ff42415d0b0 2023-11-04T01:42:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff4237fe640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff42415a600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff41800d620 tx=0x7ff41800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff420ff9640 1 -- 172.21.15.2:0/3878908430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800b620 con 0x7ff42415d0b0 2023-11-04T01:42:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff420ff9640 1 -- 172.21.15.2:0/3878908430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800b780 con 0x7ff42415d0b0 2023-11-04T01:42:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42415b0a0 con 0x7ff42415d0b0 2023-11-04T01:42:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff420ff9640 1 -- 172.21.15.2:0/3878908430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800bb10 con 0x7ff42415d0b0 2023-11-04T01:42:59.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42415b660 con 0x7ff42415d0b0 2023-11-04T01:42:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4240744a0 con 0x7ff42415d0b0 2023-11-04T01:42:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff420ff9640 1 -- 172.21.15.2:0/3878908430 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff41800bc70 con 0x7ff42415d0b0 2023-11-04T01:42:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff420ff9640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4100664a0 0x7ff410068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.502+0000 7ff420ff9640 1 -- 172.21.15.2:0/3878908430 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff418084420 con 0x7ff42415d0b0 2023-11-04T01:42:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.506+0000 7ff423fff640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4100664a0 0x7ff410068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.506+0000 7ff423fff640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4100664a0 0x7ff410068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4140ae000 tx=0x7ff414008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.506+0000 7ff420ff9640 1 -- 172.21.15.2:0/3878908430 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff418051800 con 0x7ff42415d0b0 2023-11-04T01:42:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.658+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff42415c8e0 con 0x7ff42415d0b0 2023-11-04T01:42:59.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.658+0000 7ff420ff9640 1 -- 172.21.15.2:0/3878908430 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff418007380 con 0x7ff42415d0b0 2023-11-04T01:42:59.660 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4100664a0 msgr2=0x7ff410068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4100664a0 0x7ff410068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff4140ae000 tx=0x7ff414008040 comp rx=0 tx=0).stop 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 msgr2=0x7ff42415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff42415a600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff41800d620 tx=0x7ff41800dae0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 shutdown_connections 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4100664a0 0x7ff410068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4241610f0 0x7ff42414c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff42415d0b0 0x7ff42415a600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 --2- 172.21.15.2:0/3878908430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff4240cfd50 0x7ff424158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 >> 172.21.15.2:0/3878908430 conn(0x7ff42406a890 msgr2=0x7ff4240b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 shutdown_connections 2023-11-04T01:42:59.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.662+0000 7ff42a974640 1 -- 172.21.15.2:0/3878908430 wait complete. 2023-11-04T01:42:59.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:42:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf77cf5640 1 Processor -- start 2023-11-04T01:42:59.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf77cf5640 1 -- start start 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf77cf5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faf7015acb0 0x7faf7015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf77cf5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf700cb130 con 0x7faf7015c160 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf77cf5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7015b680 con 0x7faf700b0c20 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf77cf5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7015bd40 con 0x7faf7015acb0 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf75290640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faf7015c160 0x7faf700b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41926/0 (socket says 172.21.15.2:41926) 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf75290640 1 -- 172.21.15.2:0/2162645742 learned_addr learned my addr 172.21.15.2:0/2162645742 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf75a91640 1 --2- 172.21.15.2:0/2162645742 >> v2:172.21.15.90:3300/0 conn(0x7faf7015acb0 0x7faf7015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926905056 0 0) 0x7faf700cb130 con 0x7faf7015c160 2023-11-04T01:42:59.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf58003530 con 0x7faf7015c160 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1191923556 0 0) 0x7faf58003530 con 0x7faf7015c160 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 >> v2:172.21.15.90:3300/0 conn(0x7faf7015acb0 msgr2=0x7faf7015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 --2- 172.21.15.2:0/2162645742 >> v2:172.21.15.90:3300/0 conn(0x7faf7015acb0 0x7faf7015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 >> v1:172.21.15.90:6789/0 conn(0x7faf700b0c20 legacy=0x7faf700ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7015b960 con 0x7faf7015c160 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7faf60001a00 con 0x7faf7015c160 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 >> v1:172.21.15.2:6789/0 conn(0x7faf7015c160 legacy=0x7faf700b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf580047d0 0x7faf58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf58005190 0x7faf5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7015bd40 con 0x7faf58003980 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c030 con 0x7faf580047d0 2023-11-04T01:42:59.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5800c1f0 con 0x7faf58005190 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.790+0000 7faf75a91640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf75290640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf580047d0 0x7faf58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf75a91640 1 -- 172.21.15.2:0/2162645742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf58005190 msgr2=0x7faf5800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf75a91640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf58005190 0x7faf5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf75a91640 1 -- 172.21.15.2:0/2162645742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf580047d0 msgr2=0x7faf58004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf75a91640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf580047d0 0x7faf58004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf75a91640 1 -- 172.21.15.2:0/2162645742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58003530 con 0x7faf58003980 2023-11-04T01:42:59.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf76292640 1 -- 172.21.15.2:0/2162645742 reap_dead start 2023-11-04T01:42:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf75a91640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf58003da0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ae0 tx=0x7faf6401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e976f43e5b62572e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640a6420 con 0x7faf58003980 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640a6580 con 0x7faf58003980 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf74a8f640 1 -- 172.21.15.2:0/2162645742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640a6930 con 0x7faf58003980 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf77cf5640 1 -- 172.21.15.2:0/2162645742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 msgr2=0x7faf58003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf58003da0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ae0 tx=0x7faf6401ca70 comp rx=0 tx=0).stop 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf77cf5640 1 -- 172.21.15.2:0/2162645742 shutdown_connections 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2162645742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf58003da0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf77cf5640 1 -- 172.21.15.2:0/2162645742 >> 172.21.15.2:0/2162645742 conn(0x7faf700cb510 msgr2=0x7faf700cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf77cf5640 1 -- 172.21.15.2:0/2162645742 shutdown_connections 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.794+0000 7faf77cf5640 1 -- 172.21.15.2:0/2162645742 wait complete. 2023-11-04T01:42:59.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 Processor -- start 2023-11-04T01:42:59.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 -- start start 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf701487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf70155410 0x7faf70147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf700c83e0 0x7faf700c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700b2e80 con 0x7faf58003980 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf70148460 con 0x7faf700c83e0 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf700b2200 con 0x7faf70155410 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf701487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf701487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37962/0 (socket says 172.21.15.2:37962) 2023-11-04T01:42:59.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 -- 172.21.15.2:0/2981543649 learned_addr learned my addr 172.21.15.2:0/2981543649 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf76292640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf700c83e0 0x7faf700c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 -- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf70155410 msgr2=0x7faf70147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf70155410 0x7faf70147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 -- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf700c83e0 msgr2=0x7faf700c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf700c83e0 0x7faf700c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 -- 172.21.15.2:0/2981543649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700b24e0 con 0x7faf58003980 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf75a91640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf701487f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf6401c8a0 tx=0x7faf64019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf6e7fc640 1 -- 172.21.15.2:0/2981543649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640b9640 con 0x7faf58003980 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf6e7fc640 1 -- 172.21.15.2:0/2981543649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640b97a0 con 0x7faf58003980 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700b27c0 con 0x7faf58003980 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf6e7fc640 1 -- 172.21.15.2:0/2981543649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640b9b30 con 0x7faf58003980 2023-11-04T01:42:59.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf700c8870 con 0x7faf58003980 2023-11-04T01:42:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf700744a0 con 0x7faf58003980 2023-11-04T01:42:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf6e7fc640 1 -- 172.21.15.2:0/2981543649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf640a7400 con 0x7faf58003980 2023-11-04T01:42:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.798+0000 7faf6e7fc640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf5c0664a0 0x7faf5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:42:59.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.802+0000 7faf6e7fc640 1 -- 172.21.15.2:0/2981543649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf6411e830 con 0x7faf58003980 2023-11-04T01:42:59.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.802+0000 7faf75290640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf5c0664a0 0x7faf5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:42:59.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.802+0000 7faf75290640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf5c0664a0 0x7faf5c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf600013e0 tx=0x7faf600020d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:42:59.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.806+0000 7faf6e7fc640 1 -- 172.21.15.2:0/2981543649 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faf640ebd40 con 0x7faf58003980 2023-11-04T01:42:59.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf7015a5e0 con 0x7faf58003980 2023-11-04T01:42:59.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf6e7fc640 1 -- 172.21.15.2:0/2981543649 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf640ef360 con 0x7faf58003980 2023-11-04T01:42:59.955 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:42:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf5c0664a0 msgr2=0x7faf5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf5c0664a0 0x7faf5c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf600013e0 tx=0x7faf600020d0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 msgr2=0x7faf701487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf701487f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf6401c8a0 tx=0x7faf64019810 comp rx=0 tx=0).stop 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 shutdown_connections 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf5c0664a0 0x7faf5c068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf700c83e0 0x7faf700c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf70155410 0x7faf70147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 --2- 172.21.15.2:0/2981543649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf58003980 0x7faf701487f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 >> 172.21.15.2:0/2981543649 conn(0x7faf700cb510 msgr2=0x7faf701561e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 shutdown_connections 2023-11-04T01:42:59.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:42:59.954+0000 7faf77cf5640 1 -- 172.21.15.2:0/2981543649 wait complete. 2023-11-04T01:42:59.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:43:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.086+0000 7f20c267e640 1 Processor -- start 2023-11-04T01:43:00.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.086+0000 7f20c267e640 1 -- start start 2023-11-04T01:43:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20bc15a1f0 0x7f20bc0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0b0d40 0x7f20bc0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc0ccee0 con 0x7f20bc0cdea0 2023-11-04T01:43:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc15a5d0 con 0x7f20bc15a1f0 2023-11-04T01:43:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc0ca900 con 0x7f20bc0b0d40 2023-11-04T01:43:00.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20bc15a1f0 0x7f20bc0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bb7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f20bc0cdea0 0x7f20bc0b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41934/0 (socket says 172.21.15.2:41934) 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bb7fe640 1 -- 172.21.15.2:0/347361236 learned_addr learned my addr 172.21.15.2:0/347361236 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c0c1b640 1 --2- 172.21.15.2:0/347361236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0b0d40 0x7f20bc0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bbfff640 1 -- 172.21.15.2:0/347361236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0b0d40 msgr2=0x7f20bc0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bbfff640 1 --2- 172.21.15.2:0/347361236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0b0d40 0x7f20bc0704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bbfff640 1 -- 172.21.15.2:0/347361236 >> v1:172.21.15.2:6789/0 conn(0x7f20bc0cdea0 legacy=0x7f20bc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20baffd640 1 -- 172.21.15.2:0/347361236 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952324188 0 0) 0x7f20bc0ccee0 con 0x7f20bc0cdea0 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bbfff640 1 -- 172.21.15.2:0/347361236 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc0cabe0 con 0x7f20bc15a1f0 2023-11-04T01:43:00.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c0c1b640 1 --2- 172.21.15.2:0/347361236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0b0d40 0x7f20bc0704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20bbfff640 1 --2- 172.21.15.2:0/347361236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc0cd370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009d90 tx=0x7f20ac01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222bf9d1618ccfc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20baffd640 1 -- 172.21.15.2:0/347361236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0a59e0 con 0x7f20bc15a1f0 2023-11-04T01:43:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20baffd640 1 -- 172.21.15.2:0/347361236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac0a5b40 con 0x7f20bc15a1f0 2023-11-04T01:43:00.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20baffd640 1 -- 172.21.15.2:0/347361236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0ad440 con 0x7f20bc15a1f0 2023-11-04T01:43:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- 172.21.15.2:0/347361236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 msgr2=0x7f20bc0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 --2- 172.21.15.2:0/347361236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc0cd370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009d90 tx=0x7f20ac01c920 comp rx=0 tx=0).stop 2023-11-04T01:43:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- 172.21.15.2:0/347361236 shutdown_connections 2023-11-04T01:43:00.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 --2- 172.21.15.2:0/347361236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0b0d40 0x7f20bc0704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 --2- 172.21.15.2:0/347361236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc0cd370 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- 172.21.15.2:0/347361236 >> 172.21.15.2:0/347361236 conn(0x7f20bc0cebb0 msgr2=0x7f20bc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- 172.21.15.2:0/347361236 shutdown_connections 2023-11-04T01:43:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.090+0000 7f20c267e640 1 -- 172.21.15.2:0/347361236 wait complete. 2023-11-04T01:43:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 Processor -- start 2023-11-04T01:43:00.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 -- start start 2023-11-04T01:43:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20bc0b0d40 0x7f20bc15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0cdea0 0x7f20bc15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc15e3f0 con 0x7f20bc15a1f0 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc1f44b0 con 0x7f20bc0b0d40 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc15e1c0 con 0x7f20bc0cdea0 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37984/0 (socket says 172.21.15.2:37984) 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 -- 172.21.15.2:0/289125028 learned_addr learned my addr 172.21.15.2:0/289125028 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20bbfff640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20bc0b0d40 0x7f20bc15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20bb7fe640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0cdea0 0x7f20bc15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 -- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0cdea0 msgr2=0x7f20bc15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0cdea0 0x7f20bc15dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 -- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20bc0b0d40 msgr2=0x7f20bc15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20bc0b0d40 0x7f20bc15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 -- 172.21.15.2:0/289125028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac009a70 con 0x7f20bc15a1f0 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20bb7fe640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0cdea0 0x7f20bc15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c0c1b640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc154f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f20b400c7f0 tx=0x7f20b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20b8ff9640 1 -- 172.21.15.2:0/289125028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4007820 con 0x7f20bc15a1f0 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20b8ff9640 1 -- 172.21.15.2:0/289125028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b4007980 con 0x7f20bc15a1f0 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc0c7a70 con 0x7f20bc15a1f0 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20b8ff9640 1 -- 172.21.15.2:0/289125028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b4007d70 con 0x7f20bc15a1f0 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc0c8030 con 0x7f20bc15a1f0 2023-11-04T01:43:00.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc1f4620 con 0x7f20bc15a1f0 2023-11-04T01:43:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.094+0000 7f20b8ff9640 1 -- 172.21.15.2:0/289125028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20b40113f0 con 0x7f20bc15a1f0 2023-11-04T01:43:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.098+0000 7f20b8ff9640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20a80664a0 0x7f20a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.098+0000 7f20b8ff9640 1 -- 172.21.15.2:0/289125028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20b4084200 con 0x7f20bc15a1f0 2023-11-04T01:43:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.098+0000 7f20bbfff640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20a80664a0 0x7f20a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:00.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.098+0000 7f20bbfff640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20a80664a0 0x7f20a8068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0af000 tx=0x7f20ac0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:00.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.102+0000 7f20b8ff9640 1 -- 172.21.15.2:0/289125028 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f20bc1f4620 con 0x7f20bc15a1f0 2023-11-04T01:43:00.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.310+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7f20bc1f4620 con 0x7f20bc15a1f0 2023-11-04T01:43:00.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.878+0000 7f20b8ff9640 1 -- 172.21.15.2:0/289125028 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v53) v1 ==== 176+0+0 (secure 0 0 0) 0x7f20bc1f4620 con 0x7f20bc15a1f0 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20a80664a0 msgr2=0x7f20a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20a80664a0 0x7f20a8068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0af000 tx=0x7f20ac0a7070 comp rx=0 tx=0).stop 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 msgr2=0x7f20bc154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc154f00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f20b400c7f0 tx=0x7f20b400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 shutdown_connections 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20a80664a0 0x7f20a8068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20bc15a1f0 0x7f20bc154f00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20bc0cdea0 0x7f20bc15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 --2- 172.21.15.2:0/289125028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20bc0b0d40 0x7f20bc15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:00.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 >> 172.21.15.2:0/289125028 conn(0x7f20bc0cebb0 msgr2=0x7f20bc06ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 shutdown_connections 2023-11-04T01:43:00.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:00.882+0000 7f20c267e640 1 -- 172.21.15.2:0/289125028 wait complete. 2023-11-04T01:43:00.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd9a57a0640 1 Processor -- start 2023-11-04T01:43:01.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd9a57a0640 1 -- start start 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd9a57a0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9a015c160 0x7fd9a015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd9a57a0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a00cb130 con 0x7fd9a015acb0 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd9a57a0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a015b680 con 0x7fd9a00b0c20 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd9a57a0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a015bd40 con 0x7fd9a015c160 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9a015c160 0x7fd9a015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd9a015acb0 0x7fd9a00b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41938/0 (socket says 172.21.15.2:41938) 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9a015c160 0x7fd9a015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37992/0 (socket says 172.21.15.2:37992) 2023-11-04T01:43:01.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99effd640 1 -- 172.21.15.2:0/2771610290 learned_addr learned my addr 172.21.15.2:0/2771610290 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:01.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99f7fe640 1 -- 172.21.15.2:0/2771610290 >> v1:172.21.15.90:6789/0 conn(0x7fd9a00b0c20 legacy=0x7fd9a00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99f7fe640 1 -- 172.21.15.2:0/2771610290 >> v1:172.21.15.2:6789/0 conn(0x7fd9a015acb0 legacy=0x7fd9a00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99f7fe640 1 -- 172.21.15.2:0/2771610290 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a015b960 con 0x7fd9a015c160 2023-11-04T01:43:01.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.030+0000 7fd99dffb640 1 -- 172.21.15.2:0/2771610290 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072467328 0 0) 0x7fd9a00cb130 con 0x7fd9a015acb0 2023-11-04T01:43:01.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd99f7fe640 1 --2- 172.21.15.2:0/2771610290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a015b090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd998009d90 tx=0x7fd99801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3542616660dc30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd99dffb640 1 -- 172.21.15.2:0/2771610290 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980a58e0 con 0x7fd9a015c160 2023-11-04T01:43:01.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd99dffb640 1 -- 172.21.15.2:0/2771610290 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9980a5a40 con 0x7fd9a015c160 2023-11-04T01:43:01.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd99dffb640 1 -- 172.21.15.2:0/2771610290 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980a5dd0 con 0x7fd9a015c160 2023-11-04T01:43:01.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 -- 172.21.15.2:0/2771610290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 msgr2=0x7fd9a015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/2771610290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a015b090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd998009d90 tx=0x7fd99801c910 comp rx=0 tx=0).stop 2023-11-04T01:43:01.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 -- 172.21.15.2:0/2771610290 shutdown_connections 2023-11-04T01:43:01.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/2771610290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a015b090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 -- 172.21.15.2:0/2771610290 >> 172.21.15.2:0/2771610290 conn(0x7fd9a00cb510 msgr2=0x7fd9a00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 -- 172.21.15.2:0/2771610290 shutdown_connections 2023-11-04T01:43:01.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 -- 172.21.15.2:0/2771610290 wait complete. 2023-11-04T01:43:01.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 Processor -- start 2023-11-04T01:43:01.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.034+0000 7fd9a57a0640 1 -- start start 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9a00b0c20 0x7fd9a00aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9a015acb0 0x7fd9a0147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0147f80 con 0x7fd9a015c160 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a006c8a0 con 0x7fd9a00b0c20 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a006b800 con 0x7fd9a015acb0 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a00ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38008/0 (socket says 172.21.15.2:38008) 2023-11-04T01:43:01.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 -- 172.21.15.2:0/1949278452 learned_addr learned my addr 172.21.15.2:0/1949278452 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99effd640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9a00b0c20 0x7fd9a00aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99e7fc640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9a015acb0 0x7fd9a0147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 -- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9a015acb0 msgr2=0x7fd9a0147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9a015acb0 0x7fd9a0147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 -- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9a00b0c20 msgr2=0x7fd9a00aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9a00b0c20 0x7fd9a00aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 -- 172.21.15.2:0/1949278452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009a70 con 0x7fd9a015c160 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99f7fe640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a00ac8c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd99801a540 tx=0x7fd9980196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9877fe640 1 -- 172.21.15.2:0/1949278452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980adb80 con 0x7fd9a015c160 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9877fe640 1 -- 172.21.15.2:0/1949278452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9980adce0 con 0x7fd9a015c160 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9877fe640 1 -- 172.21.15.2:0/1949278452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980b7610 con 0x7fd9a015c160 2023-11-04T01:43:01.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a006bae0 con 0x7fd9a015c160 2023-11-04T01:43:01.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a006c0a0 con 0x7fd9a015c160 2023-11-04T01:43:01.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a00744a0 con 0x7fd9a015c160 2023-11-04T01:43:01.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9877fe640 1 -- 172.21.15.2:0/1949278452 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9980b4050 con 0x7fd9a015c160 2023-11-04T01:43:01.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9877fe640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd98c066470 0x7fd98c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd9877fe640 1 -- 172.21.15.2:0/1949278452 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd99811f2a0 con 0x7fd9a015c160 2023-11-04T01:43:01.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.038+0000 7fd99effd640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd98c066470 0x7fd98c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.042+0000 7fd99effd640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd98c066470 0x7fd98c068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd990007fd0 tx=0x7fd990007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.042+0000 7fd9877fe640 1 -- 172.21.15.2:0/1949278452 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9980ec960 con 0x7fd9a015c160 2023-11-04T01:43:01.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.202+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd9a00cde30 con 0x7fd9a015c160 2023-11-04T01:43:01.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9877fe640 1 -- 172.21.15.2:0/1949278452 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd9980eff80 con 0x7fd9a015c160 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd98c066470 msgr2=0x7fd98c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd98c066470 0x7fd98c068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd990007fd0 tx=0x7fd990007d60 comp rx=0 tx=0).stop 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 msgr2=0x7fd9a00ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a00ac8c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd99801a540 tx=0x7fd9980196b0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 shutdown_connections 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd98c066470 0x7fd98c068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9a015c160 0x7fd9a00ac8c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9a015acb0 0x7fd9a0147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 --2- 172.21.15.2:0/1949278452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9a00b0c20 0x7fd9a00aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 >> 172.21.15.2:0/1949278452 conn(0x7fd9a00cb510 msgr2=0x7fd9a0151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 shutdown_connections 2023-11-04T01:43:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.206+0000 7fd9a57a0640 1 -- 172.21.15.2:0/1949278452 wait complete. 2023-11-04T01:43:01.227 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:43:01.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:01.276 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:01.323 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:43:01.323 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:01.323 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:01.329 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:01.330 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:01.377 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:01.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:43:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.546+0000 7f33e48d4640 1 Processor -- start 2023-11-04T01:43:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33e48d4640 1 -- start start 2023-11-04T01:43:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33e48d4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f33e00715d0 0x7f33e00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33e48d4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e00c2670 con 0x7f33e015afd0 2023-11-04T01:43:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33e48d4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e006bc30 con 0x7f33e00b0b70 2023-11-04T01:43:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33e48d4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e0070140 con 0x7f33e00715d0 2023-11-04T01:43:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33de59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f33e015afd0 0x7f33e006f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41042/0 (socket says 172.21.15.2:41042) 2023-11-04T01:43:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33de59c640 1 -- 172.21.15.2:0/3798579342 learned_addr learned my addr 172.21.15.2:0/3798579342 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/3798579342 >> v2:172.21.15.90:3300/0 conn(0x7f33e00715d0 0x7f33e00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938608451 0 0) 0x7f33e00c2670 con 0x7f33e015afd0 2023-11-04T01:43:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33cc003530 con 0x7f33e015afd0 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2505980596 0 0) 0x7f33cc003530 con 0x7f33e015afd0 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 >> v2:172.21.15.90:3300/0 conn(0x7f33e00715d0 msgr2=0x7f33e00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 --2- 172.21.15.2:0/3798579342 >> v2:172.21.15.90:3300/0 conn(0x7f33e00715d0 0x7f33e00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 >> v1:172.21.15.90:6789/0 conn(0x7f33e00b0b70 legacy=0x7f33e015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e006bf10 con 0x7f33e015afd0 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f33d0001680 con 0x7f33e015afd0 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 >> v1:172.21.15.2:6789/0 conn(0x7f33e015afd0 legacy=0x7f33e006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33cc0039d0 0x7f33cc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33cc005190 0x7f33cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0070140 con 0x7f33cc0047d0 2023-11-04T01:43:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc00c090 con 0x7f33cc005190 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc00c250 con 0x7f33cc0039d0 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33de59c640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33cc0039d0 0x7f33cc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ded9d640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33cc005190 0x7f33cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33d5d9b640 1 -- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33cc0039d0 msgr2=0x7f33cc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33cc0039d0 0x7f33cc003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33d5d9b640 1 -- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33cc005190 msgr2=0x7f33cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33cc005190 0x7f33cc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33d5d9b640 1 -- 172.21.15.2:0/3798579342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc003530 con 0x7f33cc0047d0 2023-11-04T01:43:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.550+0000 7f33ded9d640 1 -- 172.21.15.2:0/3798579342 reap_dead start 2023-11-04T01:43:01.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33cc004c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009ae0 tx=0x7f33c801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa3f33438d89811 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80a5640 con 0x7f33cc0047d0 2023-11-04T01:43:01.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c80a57a0 con 0x7f33cc0047d0 2023-11-04T01:43:01.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33ddd9b640 1 -- 172.21.15.2:0/3798579342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80a5b50 con 0x7f33cc0047d0 2023-11-04T01:43:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- 172.21.15.2:0/3798579342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 msgr2=0x7f33cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33cc004c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009ae0 tx=0x7f33c801ca50 comp rx=0 tx=0).stop 2023-11-04T01:43:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- 172.21.15.2:0/3798579342 shutdown_connections 2023-11-04T01:43:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 --2- 172.21.15.2:0/3798579342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33cc004c50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- 172.21.15.2:0/3798579342 >> 172.21.15.2:0/3798579342 conn(0x7f33e00cebb0 msgr2=0x7f33e00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- 172.21.15.2:0/3798579342 shutdown_connections 2023-11-04T01:43:01.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- 172.21.15.2:0/3798579342 wait complete. 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 Processor -- start 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- start start 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33e01f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33e00c5bf0 0x7f33e00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33e015bae0 0x7f33e015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e015d420 con 0x7f33cc0047d0 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e01505e0 con 0x7f33e00c5bf0 2023-11-04T01:43:01.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33e48d4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00c65b0 con 0x7f33e015bae0 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33de59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33e01f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33de59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33e01f09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43894/0 (socket says 172.21.15.2:43894) 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.554+0000 7f33de59c640 1 -- 172.21.15.2:0/1133964678 learned_addr learned my addr 172.21.15.2:0/1133964678 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33ded9d640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33e015bae0 0x7f33e015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33e00c5bf0 0x7f33e00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33de59c640 1 -- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33e015bae0 msgr2=0x7f33e015bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33de59c640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33e015bae0 0x7f33e015bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33de59c640 1 -- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33e00c5bf0 msgr2=0x7f33e00c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33de59c640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33e00c5bf0 0x7f33e00c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33de59c640 1 -- 172.21.15.2:0/1133964678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e015c7a0 con 0x7f33cc0047d0 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33de59c640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33e01f09f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f33d0001060 tx=0x7f33d000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d77fe640 1 -- 172.21.15.2:0/1133964678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0010ea0 con 0x7f33cc0047d0 2023-11-04T01:43:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d77fe640 1 -- 172.21.15.2:0/1133964678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00143a0 con 0x7f33cc0047d0 2023-11-04T01:43:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e015ca80 con 0x7f33cc0047d0 2023-11-04T01:43:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d77fe640 1 -- 172.21.15.2:0/1133964678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d0014710 con 0x7f33cc0047d0 2023-11-04T01:43:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e015d040 con 0x7f33cc0047d0 2023-11-04T01:43:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00744a0 con 0x7f33cc0047d0 2023-11-04T01:43:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d77fe640 1 -- 172.21.15.2:0/1133964678 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f33d0014870 con 0x7f33cc0047d0 2023-11-04T01:43:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d77fe640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33c00664a0 0x7f33c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d77fe640 1 -- 172.21.15.2:0/1133964678 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33d0086bf0 con 0x7f33cc0047d0 2023-11-04T01:43:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33c00664a0 0x7f33c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.558+0000 7f33d5d9b640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33c00664a0 0x7f33c0068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f33c80af000 tx=0x7f33c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.562+0000 7f33d77fe640 1 -- 172.21.15.2:0/1133964678 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33d0054100 con 0x7f33cc0047d0 2023-11-04T01:43:01.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.718+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33e006cba0 con 0x7f33cc0047d0 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.722+0000 7f33d77fe640 1 -- 172.21.15.2:0/1133964678 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f33d001b090 con 0x7f33cc0047d0 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:01.724 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:01.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.722+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33c00664a0 msgr2=0x7f33c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33c00664a0 0x7f33c0068960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f33c80af000 tx=0x7f33c8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 msgr2=0x7f33e01f09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33e01f09f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f33d0001060 tx=0x7f33d000e4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 shutdown_connections 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33c00664a0 0x7f33c0068960 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33e015bae0 0x7f33e015bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33e00c5bf0 0x7f33e00c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 --2- 172.21.15.2:0/1133964678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33cc0047d0 0x7f33e01f09f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 >> 172.21.15.2:0/1133964678 conn(0x7f33e00cebb0 msgr2=0x7f33e00ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 shutdown_connections 2023-11-04T01:43:01.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.726+0000 7f33e48d4640 1 -- 172.21.15.2:0/1133964678 wait complete. 2023-11-04T01:43:01.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:01.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0abc3e5640 1 Processor -- start 2023-11-04T01:43:01.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0abc3e5640 1 -- start start 2023-11-04T01:43:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0abc3e5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0abc3e5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ab40b0c20 0x7f0ab40ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0abc3e5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab40cb130 con 0x7f0ab415c160 2023-11-04T01:43:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0abc3e5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab415bd40 con 0x7f0ab40b0c20 2023-11-04T01:43:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0abc3e5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab406fd80 con 0x7f0ab415acb0 2023-11-04T01:43:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba982640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ab40b0c20 0x7f0ab40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba982640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ab40b0c20 0x7f0ab40ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43910/0 (socket says 172.21.15.2:43910) 2023-11-04T01:43:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba982640 1 -- 172.21.15.2:0/2814693903 learned_addr learned my addr 172.21.15.2:0/2814693903 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba181640 1 --2- 172.21.15.2:0/2814693903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba982640 1 -- 172.21.15.2:0/2814693903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 msgr2=0x7f0ab415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba982640 1 --2- 172.21.15.2:0/2814693903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba982640 1 -- 172.21.15.2:0/2814693903 >> v1:172.21.15.90:6789/0 conn(0x7f0ab415c160 legacy=0x7f0ab40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.870+0000 7f0aba982640 1 -- 172.21.15.2:0/2814693903 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab415b680 con 0x7f0ab40b0c20 2023-11-04T01:43:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0aba982640 1 --2- 172.21.15.2:0/2814693903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40ca490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009e50 tx=0x7f0aac01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34c6e7950a28eab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0ab917f640 1 -- 172.21.15.2:0/2814693903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0a58d0 con 0x7f0ab40b0c20 2023-11-04T01:43:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0ab917f640 1 -- 172.21.15.2:0/2814693903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac0a5a30 con 0x7f0ab40b0c20 2023-11-04T01:43:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0ab917f640 1 -- 172.21.15.2:0/2814693903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0a5dc0 con 0x7f0ab40b0c20 2023-11-04T01:43:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2814693903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab40b0c20 msgr2=0x7f0ab40ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2814693903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40ca490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009e50 tx=0x7f0aac01c9e0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2814693903 shutdown_connections 2023-11-04T01:43:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2814693903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40ca490 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2814693903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2814693903 >> 172.21.15.2:0/2814693903 conn(0x7f0ab40cb510 msgr2=0x7f0ab40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:01.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2814693903 shutdown_connections 2023-11-04T01:43:01.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2814693903 wait complete. 2023-11-04T01:43:01.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 Processor -- start 2023-11-04T01:43:01.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- start start 2023-11-04T01:43:01.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab40c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab415c160 0x7f0ab40ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40afe50 con 0x7f0ab415c160 2023-11-04T01:43:01.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40b0270 con 0x7f0ab40b0c20 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0abc3e5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40af1d0 con 0x7f0ab415acb0 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0aba982640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab415c160 0x7f0ab40ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0aba982640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab415c160 0x7f0ab40ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43926/0 (socket says 172.21.15.2:43926) 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.874+0000 7f0aba982640 1 -- 172.21.15.2:0/2864313284 learned_addr learned my addr 172.21.15.2:0/2864313284 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0ab9980640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab40c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba181640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba982640 1 -- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 msgr2=0x7f0ab40c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba982640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab40c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba982640 1 -- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ab40b0c20 msgr2=0x7f0ab40b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba982640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba982640 1 -- 172.21.15.2:0/2864313284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac009b30 con 0x7f0ab415c160 2023-11-04T01:43:01.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba181640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba982640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab415c160 0x7f0ab40ae8d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0aac01a610 tx=0x7f0aac019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aaaffd640 1 -- 172.21.15.2:0/2864313284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0b8670 con 0x7f0ab415c160 2023-11-04T01:43:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aaaffd640 1 -- 172.21.15.2:0/2864313284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac0b87f0 con 0x7f0ab415c160 2023-11-04T01:43:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab40af4b0 con 0x7f0ab415c160 2023-11-04T01:43:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aaaffd640 1 -- 172.21.15.2:0/2864313284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0b8ba0 con 0x7f0ab415c160 2023-11-04T01:43:01.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab40afa70 con 0x7f0ab415c160 2023-11-04T01:43:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab40aff90 con 0x7f0ab415c160 2023-11-04T01:43:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aaaffd640 1 -- 172.21.15.2:0/2864313284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0aac0b8d00 con 0x7f0ab415c160 2023-11-04T01:43:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aaaffd640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a980664a0 0x7f0a98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aaaffd640 1 -- 172.21.15.2:0/2864313284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0aac11fcf0 con 0x7f0ab415c160 2023-11-04T01:43:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.878+0000 7f0aba181640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a980664a0 0x7f0a98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:01.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.882+0000 7f0aba181640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a980664a0 0x7f0a98068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009840 tx=0x7f0ab0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:01.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:01.882+0000 7f0aaaffd640 1 -- 172.21.15.2:0/2864313284 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0aac0ed4c0 con 0x7f0ab415c160 2023-11-04T01:43:02.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.042+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ab40aff90 con 0x7f0ab415c160 2023-11-04T01:43:02.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.042+0000 7f0aaaffd640 1 -- 172.21.15.2:0/2864313284 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ab40aff90 con 0x7f0ab415c160 2023-11-04T01:43:02.045 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:02.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a980664a0 msgr2=0x7f0a98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a980664a0 0x7f0a98068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009840 tx=0x7f0ab0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab415c160 msgr2=0x7f0ab40ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab415c160 0x7f0ab40ae8d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0aac01a610 tx=0x7f0aac019780 comp rx=0 tx=0).stop 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 shutdown_connections 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a980664a0 0x7f0a98068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ab415c160 0x7f0ab40ae8d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ab415acb0 0x7f0ab40c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 --2- 172.21.15.2:0/2864313284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ab40b0c20 0x7f0ab40b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 >> 172.21.15.2:0/2864313284 conn(0x7f0ab40cb510 msgr2=0x7f0ab406b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 shutdown_connections 2023-11-04T01:43:02.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.046+0000 7f0abc3e5640 1 -- 172.21.15.2:0/2864313284 wait complete. 2023-11-04T01:43:02.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:02.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2907eb3640 1 Processor -- start 2023-11-04T01:43:02.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2907eb3640 1 -- start start 2023-11-04T01:43:02.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2907eb3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 0x7f29000b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2907eb3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29000cb220 con 0x7f290015b190 2023-11-04T01:43:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2907eb3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290006fcd0 con 0x7f290015adb0 2023-11-04T01:43:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2907eb3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000cac60 con 0x7f29000ca590 2023-11-04T01:43:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f290544e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f290015b190 0x7f290015f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41044/0 (socket says 172.21.15.2:41044) 2023-11-04T01:43:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f290544e640 1 -- 172.21.15.2:0/488780921 learned_addr learned my addr 172.21.15.2:0/488780921 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2906450640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 0x7f29000b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935746253 0 0) 0x7f29000cb220 con 0x7f290015b190 2023-11-04T01:43:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28ec003530 con 0x7f290015b190 2023-11-04T01:43:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140459785 0 0) 0x7f28ec003530 con 0x7f290015b190 2023-11-04T01:43:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 msgr2=0x7f29000b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 0x7f29000b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 >> v1:172.21.15.90:6789/0 conn(0x7f290015adb0 legacy=0x7f29000cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000caf40 con 0x7f290015b190 2023-11-04T01:43:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f28f0001680 con 0x7f290015b190 2023-11-04T01:43:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 >> v1:172.21.15.2:6789/0 conn(0x7f290015b190 legacy=0x7f290015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec0039b0 0x7f28ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 0x7f28ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec004d10 0x7f28ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000cac60 con 0x7f28ec0039b0 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec00ba70 con 0x7f28ec004d10 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec00bc30 con 0x7f29000ca590 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2905c4f640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec0039b0 0x7f28ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2906450640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec004d10 0x7f28ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f290544e640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 0x7f28ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2905c4f640 1 -- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 msgr2=0x7f28ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2905c4f640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29000ca590 0x7f28ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2905c4f640 1 -- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec004d10 msgr2=0x7f28ec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2905c4f640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec004d10 0x7f28ec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2905c4f640 1 -- 172.21.15.2:0/488780921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec003530 con 0x7f28ec0039b0 2023-11-04T01:43:02.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.194+0000 7f2906450640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec004d10 0x7f28ec005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2905c4f640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec0039b0 0x7f28ec003dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f28fc001750 tx=0x7f28fc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815934550992efcb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0052d0 con 0x7f28ec0039b0 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc0a7050 con 0x7f28ec0039b0 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2904c4d640 1 -- 172.21.15.2:0/488780921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc003600 con 0x7f28ec0039b0 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2907eb3640 1 -- 172.21.15.2:0/488780921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec0039b0 msgr2=0x7f28ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2907eb3640 1 --2- 172.21.15.2:0/488780921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28ec0039b0 0x7f28ec003dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f28fc001750 tx=0x7f28fc01c390 comp rx=0 tx=0).stop 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2906450640 1 -- 172.21.15.2:0/488780921 reap_dead start 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2907eb3640 1 -- 172.21.15.2:0/488780921 shutdown_connections 2023-11-04T01:43:02.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2907eb3640 1 -- 172.21.15.2:0/488780921 >> 172.21.15.2:0/488780921 conn(0x7f29000cb510 msgr2=0x7f29000cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2907eb3640 1 -- 172.21.15.2:0/488780921 shutdown_connections 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.198+0000 7f2907eb3640 1 -- 172.21.15.2:0/488780921 wait complete. 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 Processor -- start 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 -- start start 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0039b0 0x7f290014f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2900154480 0x7f29000c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29000c2b00 0x7f29000c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900154060 con 0x7f29000c2b00 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2900153a30 con 0x7f28ec0039b0 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290015e130 con 0x7f2900154480 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29000c2b00 0x7f29000c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29000c2b00 0x7f29000c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43958/0 (socket says 172.21.15.2:43958) 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 -- 172.21.15.2:0/1683153532 learned_addr learned my addr 172.21.15.2:0/1683153532 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f290544e640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2900154480 0x7f29000c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2905c4f640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0039b0 0x7f290014f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 -- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2900154480 msgr2=0x7f29000c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2900154480 0x7f29000c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 -- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0039b0 msgr2=0x7f290014f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0039b0 0x7f290014f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 -- 172.21.15.2:0/1683153532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000c78e0 con 0x7f29000c2b00 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2905c4f640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0039b0 0x7f290014f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2906450640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29000c2b00 0x7f29000c65f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f29000cde10 tx=0x7f28f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f28f67fc640 1 -- 172.21.15.2:0/1683153532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800e030 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f28f67fc640 1 -- 172.21.15.2:0/1683153532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f8011e60 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29000c7bc0 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f28f67fc640 1 -- 172.21.15.2:0/1683153532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f80166b0 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2900154900 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29001541a0 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f28f67fc640 1 -- 172.21.15.2:0/1683153532 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28f8016810 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f28f67fc640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28e40664d0 0x7f28e4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.202+0000 7f28f67fc640 1 -- 172.21.15.2:0/1683153532 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28f800f070 con 0x7f29000c2b00 2023-11-04T01:43:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.206+0000 7f2905c4f640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28e40664d0 0x7f28e4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.206+0000 7f2905c4f640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28e40664d0 0x7f28e4068990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0057b0 tx=0x7f28fc0011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.210+0000 7f28f67fc640 1 -- 172.21.15.2:0/1683153532 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29001541a0 con 0x7f29000c2b00 2023-11-04T01:43:02.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29001541a0 con 0x7f29000c2b00 2023-11-04T01:43:02.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f28f67fc640 1 -- 172.21.15.2:0/1683153532 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28f801a020 con 0x7f29000c2b00 2023-11-04T01:43:02.367 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28e40664d0 msgr2=0x7f28e4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28e40664d0 0x7f28e4068990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0057b0 tx=0x7f28fc0011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29000c2b00 msgr2=0x7f29000c65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29000c2b00 0x7f29000c65f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f29000cde10 tx=0x7f28f8009f90 comp rx=0 tx=0).stop 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 shutdown_connections 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28e40664d0 0x7f28e4068990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29000c2b00 0x7f29000c65f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2900154480 0x7f29000c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 --2- 172.21.15.2:0/1683153532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec0039b0 0x7f290014f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 >> 172.21.15.2:0/1683153532 conn(0x7f29000cb510 msgr2=0x7f2900159b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 shutdown_connections 2023-11-04T01:43:02.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.366+0000 7f2907eb3640 1 -- 172.21.15.2:0/1683153532 wait complete. 2023-11-04T01:43:02.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:02.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 Processor -- start 2023-11-04T01:43:02.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 -- start start 2023-11-04T01:43:02.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c74159f50 0x7f9c740ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c74065dc0 0x7f9c740ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c740caed0 0x7f9c740ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c74066250 con 0x7f9c74065dc0 2023-11-04T01:43:02.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7406b3f0 con 0x7f9c740caed0 2023-11-04T01:43:02.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c7b515640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7406b6d0 con 0x7f9c74159f50 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c74065dc0 0x7f9c740ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9c74065dc0 0x7f9c740ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43960/0 (socket says 172.21.15.2:43960) 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 -- 172.21.15.2:0/3736575409 learned_addr learned my addr 172.21.15.2:0/3736575409 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c792b1640 1 --2- 172.21.15.2:0/3736575409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c74159f50 0x7f9c740ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c79ab2640 1 --2- 172.21.15.2:0/3736575409 >> v2:172.21.15.90:3300/0 conn(0x7f9c740caed0 0x7f9c740ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 -- 172.21.15.2:0/3736575409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c74159f50 msgr2=0x7f9c740ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 --2- 172.21.15.2:0/3736575409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c74159f50 0x7f9c740ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 -- 172.21.15.2:0/3736575409 >> v2:172.21.15.90:3300/0 conn(0x7f9c740caed0 msgr2=0x7f9c740ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 --2- 172.21.15.2:0/3736575409 >> v2:172.21.15.90:3300/0 conn(0x7f9c740caed0 0x7f9c740ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c78ab0640 1 -- 172.21.15.2:0/3736575409 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740cd450 con 0x7f9c74065dc0 2023-11-04T01:43:02.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.510+0000 7f9c792b1640 1 --2- 172.21.15.2:0/3736575409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c74159f50 0x7f9c740ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c78ab0640 1 --2- 172.21.15.2:0/3736575409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c74065dc0 0x7f9c740ca330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c740b1af0 tx=0x7f9c6401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdad55cb27051124 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c6bfff640 1 -- 172.21.15.2:0/3736575409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640ac630 con 0x7f9c74065dc0 2023-11-04T01:43:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c6bfff640 1 -- 172.21.15.2:0/3736575409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c640ac790 con 0x7f9c74065dc0 2023-11-04T01:43:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c6bfff640 1 -- 172.21.15.2:0/3736575409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640acb20 con 0x7f9c74065dc0 2023-11-04T01:43:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- 172.21.15.2:0/3736575409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c74065dc0 msgr2=0x7f9c740ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3736575409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c74065dc0 0x7f9c740ca330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c740b1af0 tx=0x7f9c6401c500 comp rx=0 tx=0).stop 2023-11-04T01:43:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- 172.21.15.2:0/3736575409 shutdown_connections 2023-11-04T01:43:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3736575409 >> v2:172.21.15.90:3300/0 conn(0x7f9c740caed0 0x7f9c740ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3736575409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c74065dc0 0x7f9c740ca330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3736575409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c74159f50 0x7f9c740ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- 172.21.15.2:0/3736575409 >> 172.21.15.2:0/3736575409 conn(0x7f9c740b0e30 msgr2=0x7f9c740b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- 172.21.15.2:0/3736575409 shutdown_connections 2023-11-04T01:43:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- 172.21.15.2:0/3736575409 wait complete. 2023-11-04T01:43:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 Processor -- start 2023-11-04T01:43:02.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- start start 2023-11-04T01:43:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c740caed0 0x7f9c7415d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c74159f50 0x7f9c7414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c740c8790 0x7f9c740c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740c9160 con 0x7f9c740caed0 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7415bb60 con 0x7f9c74159f50 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740c7b90 con 0x7f9c740c8790 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c740caed0 0x7f9c7415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c740caed0 0x7f9c7415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43962/0 (socket says 172.21.15.2:43962) 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 -- 172.21.15.2:0/3819601358 learned_addr learned my addr 172.21.15.2:0/3819601358 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c79ab2640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c740c8790 0x7f9c740c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c78ab0640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c74159f50 0x7f9c7414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 -- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c740c8790 msgr2=0x7f9c740c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c740c8790 0x7f9c740c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 -- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c74159f50 msgr2=0x7f9c7414de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c74159f50 0x7f9c7414de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 -- 172.21.15.2:0/3819601358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c640094d0 con 0x7f9c740caed0 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c79ab2640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c740c8790 0x7f9c740c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c792b1640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c740caed0 0x7f9c7415d490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000d800 tx=0x7f9c7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c69ffb640 1 -- 172.21.15.2:0/3819601358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70009660 con 0x7f9c740caed0 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c69ffb640 1 -- 172.21.15.2:0/3819601358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c700097c0 con 0x7f9c740caed0 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7415bff0 con 0x7f9c740caed0 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.514+0000 7f9c69ffb640 1 -- 172.21.15.2:0/3819601358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70009b70 con 0x7f9c740caed0 2023-11-04T01:43:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.518+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7415b510 con 0x7f9c740caed0 2023-11-04T01:43:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.518+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c74071460 con 0x7f9c740caed0 2023-11-04T01:43:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.518+0000 7f9c69ffb640 1 -- 172.21.15.2:0/3819601358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c70009cd0 con 0x7f9c740caed0 2023-11-04T01:43:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.518+0000 7f9c69ffb640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c580664a0 0x7f9c58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.518+0000 7f9c69ffb640 1 -- 172.21.15.2:0/3819601358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c70084580 con 0x7f9c740caed0 2023-11-04T01:43:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.518+0000 7f9c78ab0640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c580664a0 0x7f9c58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.518+0000 7f9c78ab0640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c580664a0 0x7f9c58068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c640ae000 tx=0x7f9c64008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.522+0000 7f9c69ffb640 1 -- 172.21.15.2:0/3819601358 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9c70051a90 con 0x7f9c740caed0 2023-11-04T01:43:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c740b4e90 con 0x7f9c740caed0 2023-11-04T01:43:02.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c69ffb640 1 -- 172.21.15.2:0/3819601358 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c700550b0 con 0x7f9c740caed0 2023-11-04T01:43:02.684 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c580664a0 msgr2=0x7f9c58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c580664a0 0x7f9c58068960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9c640ae000 tx=0x7f9c64008040 comp rx=0 tx=0).stop 2023-11-04T01:43:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c740caed0 msgr2=0x7f9c7415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c740caed0 0x7f9c7415d490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000d800 tx=0x7f9c7000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 shutdown_connections 2023-11-04T01:43:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9c580664a0 0x7f9c58068960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9c740c8790 0x7f9c740c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c74159f50 0x7f9c7414de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 --2- 172.21.15.2:0/3819601358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c740caed0 0x7f9c7415d490 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 >> 172.21.15.2:0/3819601358 conn(0x7f9c740b0e30 msgr2=0x7f9c74158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 shutdown_connections 2023-11-04T01:43:02.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.682+0000 7f9c7b515640 1 -- 172.21.15.2:0/3819601358 wait complete. 2023-11-04T01:43:02.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f36389640 1 Processor -- start 2023-11-04T01:43:02.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f36389640 1 -- start start 2023-11-04T01:43:02.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f36389640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d2b0 0x7f0f3006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f36389640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f3015d690 0x7f0f300ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f36389640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f300cd160 con 0x7f0f3006f8f0 2023-11-04T01:43:02.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f36389640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f300ad450 con 0x7f0f3015d690 2023-11-04T01:43:02.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f36389640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f300cd400 con 0x7f0f3015d2b0 2023-11-04T01:43:02.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f34926640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0f3006f8f0 0x7f0f300b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41052/0 (socket says 172.21.15.2:41052) 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f34926640 1 -- 172.21.15.2:0/827129019 learned_addr learned my addr 172.21.15.2:0/827129019 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2f7fe640 1 --2- 172.21.15.2:0/827129019 >> v2:172.21.15.2:3300/0 conn(0x7f0f3015d690 0x7f0f300ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2ffff640 1 --2- 172.21.15.2:0/827129019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d2b0 0x7f0f3006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2effd640 1 -- 172.21.15.2:0/827129019 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140419016 0 0) 0x7f0f300cd160 con 0x7f0f3006f8f0 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2effd640 1 -- 172.21.15.2:0/827129019 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f1c003530 con 0x7f0f3006f8f0 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2f7fe640 1 -- 172.21.15.2:0/827129019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d2b0 msgr2=0x7f0f3006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2f7fe640 1 --2- 172.21.15.2:0/827129019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d2b0 0x7f0f3006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2f7fe640 1 -- 172.21.15.2:0/827129019 >> v1:172.21.15.2:6789/0 conn(0x7f0f3006f8f0 legacy=0x7f0f300b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.818+0000 7f0f2f7fe640 1 -- 172.21.15.2:0/827129019 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f300cd6e0 con 0x7f0f3015d690 2023-11-04T01:43:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f2f7fe640 1 --2- 172.21.15.2:0/827129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3015d690 0x7f0f300ccc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0f200097c0 tx=0x7f0f2001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f577dcab4cdf93 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f2effd640 1 -- 172.21.15.2:0/827129019 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f200ac640 con 0x7f0f3015d690 2023-11-04T01:43:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f2effd640 1 -- 172.21.15.2:0/827129019 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f200ac7a0 con 0x7f0f3015d690 2023-11-04T01:43:02.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f2effd640 1 -- 172.21.15.2:0/827129019 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f200acb30 con 0x7f0f3015d690 2023-11-04T01:43:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- 172.21.15.2:0/827129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3015d690 msgr2=0x7f0f300ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 --2- 172.21.15.2:0/827129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3015d690 0x7f0f300ccc20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0f200097c0 tx=0x7f0f2001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- 172.21.15.2:0/827129019 shutdown_connections 2023-11-04T01:43:02.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 --2- 172.21.15.2:0/827129019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3015d690 0x7f0f300ccc20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 --2- 172.21.15.2:0/827129019 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d2b0 0x7f0f3006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- 172.21.15.2:0/827129019 >> 172.21.15.2:0/827129019 conn(0x7f0f300cebb0 msgr2=0x7f0f300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- 172.21.15.2:0/827129019 shutdown_connections 2023-11-04T01:43:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- 172.21.15.2:0/827129019 wait complete. 2023-11-04T01:43:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 Processor -- start 2023-11-04T01:43:02.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- start start 2023-11-04T01:43:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3006f8f0 0x7f0f300c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f3015d2b0 0x7f0f30155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d690 0x7f0f300af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30151090 con 0x7f0f3006f8f0 2023-11-04T01:43:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30156380 con 0x7f0f3015d2b0 2023-11-04T01:43:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f36389640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f30156660 con 0x7f0f3015d690 2023-11-04T01:43:02.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3006f8f0 0x7f0f300c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3006f8f0 0x7f0f300c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43976/0 (socket says 172.21.15.2:43976) 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.822+0000 7f0f2ffff640 1 -- 172.21.15.2:0/2380260688 learned_addr learned my addr 172.21.15.2:0/2380260688 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f34926640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d690 0x7f0f300af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2ffff640 1 -- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d690 msgr2=0x7f0f300af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2ffff640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d690 0x7f0f300af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2ffff640 1 -- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f3015d2b0 msgr2=0x7f0f30155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2ffff640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f3015d2b0 0x7f0f30155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2ffff640 1 -- 172.21.15.2:0/2380260688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f20009420 con 0x7f0f3006f8f0 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f34926640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d690 0x7f0f300af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2ffff640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3006f8f0 0x7f0f300c9510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e870 tx=0x7f0f1800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2cff9640 1 -- 172.21.15.2:0/2380260688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18009510 con 0x7f0f3006f8f0 2023-11-04T01:43:02.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2cff9640 1 -- 172.21.15.2:0/2380260688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1800eec0 con 0x7f0f3006f8f0 2023-11-04T01:43:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f301512e0 con 0x7f0f3006f8f0 2023-11-04T01:43:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2cff9640 1 -- 172.21.15.2:0/2380260688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800cb40 con 0x7f0f3006f8f0 2023-11-04T01:43:02.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f30156090 con 0x7f0f3006f8f0 2023-11-04T01:43:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f30156820 con 0x7f0f3006f8f0 2023-11-04T01:43:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2cff9640 1 -- 172.21.15.2:0/2380260688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f1800cca0 con 0x7f0f3006f8f0 2023-11-04T01:43:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2cff9640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f100664a0 0x7f0f10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2cff9640 1 -- 172.21.15.2:0/2380260688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f18084000 con 0x7f0f3006f8f0 2023-11-04T01:43:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2f7fe640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f100664a0 0x7f0f10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:02.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.826+0000 7f0f2f7fe640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f100664a0 0x7f0f10068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0f200ae000 tx=0x7f0f20004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:02.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.830+0000 7f0f2cff9640 1 -- 172.21.15.2:0/2380260688 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0f18051480 con 0x7f0f3006f8f0 2023-11-04T01:43:02.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.994+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0f300744a0 con 0x7f0f3006f8f0 2023-11-04T01:43:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.994+0000 7f0f2cff9640 1 -- 172.21.15.2:0/2380260688 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0f18054aa0 con 0x7f0f3006f8f0 2023-11-04T01:43:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:03.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f100664a0 msgr2=0x7f0f10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f100664a0 0x7f0f10068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0f200ae000 tx=0x7f0f20004740 comp rx=0 tx=0).stop 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3006f8f0 msgr2=0x7f0f300c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3006f8f0 0x7f0f300c9510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e870 tx=0x7f0f1800ec70 comp rx=0 tx=0).stop 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 shutdown_connections 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f100664a0 0x7f0f10068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f3015d690 0x7f0f300af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f3015d2b0 0x7f0f30155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 --2- 172.21.15.2:0/2380260688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3006f8f0 0x7f0f300c9510 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 >> 172.21.15.2:0/2380260688 conn(0x7f0f300cebb0 msgr2=0x7f0f30153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 shutdown_connections 2023-11-04T01:43:03.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:02.998+0000 7f0f36389640 1 -- 172.21.15.2:0/2380260688 wait complete. 2023-11-04T01:43:03.017 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:03.017 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:03.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:03.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.178+0000 7fb2df81a640 1 Processor -- start 2023-11-04T01:43:03.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.178+0000 7fb2df81a640 1 -- start start 2023-11-04T01:43:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2df81a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2d815afd0 0x7fb2d80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2df81a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80c2670 con 0x7fb2d80b0d40 2023-11-04T01:43:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2df81a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d806bc30 con 0x7fb2d806f8f0 2023-11-04T01:43:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2df81a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d8070140 con 0x7fb2d815afd0 2023-11-04T01:43:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dddb7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb2d80b0d40 0x7fb2d815ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41056/0 (socket says 172.21.15.2:41056) 2023-11-04T01:43:03.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dddb7640 1 -- 172.21.15.2:0/2029315532 learned_addr learned my addr 172.21.15.2:0/2029315532 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dd5b6640 1 --2- 172.21.15.2:0/2029315532 >> v2:172.21.15.90:3300/0 conn(0x7fb2d815afd0 0x7fb2d80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824759465 0 0) 0x7fb2d80c2670 con 0x7fb2d80b0d40 2023-11-04T01:43:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c4003530 con 0x7fb2d80b0d40 2023-11-04T01:43:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640612351 0 0) 0x7fb2c4003530 con 0x7fb2d80b0d40 2023-11-04T01:43:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 >> v2:172.21.15.90:3300/0 conn(0x7fb2d815afd0 msgr2=0x7fb2d80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 --2- 172.21.15.2:0/2029315532 >> v2:172.21.15.90:3300/0 conn(0x7fb2d815afd0 0x7fb2d80715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 >> v1:172.21.15.90:6789/0 conn(0x7fb2d806f8f0 legacy=0x7fb2d80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d806bf10 con 0x7fb2d80b0d40 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fb2d0001a00 con 0x7fb2d80b0d40 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 >> v1:172.21.15.2:6789/0 conn(0x7fb2d80b0d40 legacy=0x7fb2d815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c4003980 0x7fb2c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2c40047d0 0x7fb2c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2c4005190 0x7fb2c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d8070140 con 0x7fb2c40047d0 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c400c030 con 0x7fb2c4003980 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c400c1f0 con 0x7fb2c4005190 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dcdb5640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2c40047d0 0x7fb2c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dd5b6640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c4003980 0x7fb2c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dddb7640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2c4005190 0x7fb2c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dcdb5640 1 -- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2c4005190 msgr2=0x7fb2c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dcdb5640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2c4005190 0x7fb2c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dcdb5640 1 -- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c4003980 msgr2=0x7fb2c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dcdb5640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c4003980 0x7fb2c4003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dcdb5640 1 -- 172.21.15.2:0/2029315532 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4003530 con 0x7fb2c40047d0 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dddb7640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2c4005190 0x7fb2c400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.182+0000 7fb2dddb7640 1 -- 172.21.15.2:0/2029315532 reap_dead start 2023-11-04T01:43:03.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dcdb5640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2c40047d0 0x7fb2c4004c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4001780 tx=0x7fb2d401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd6e0af8b188987 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40052d0 con 0x7fb2c40047d0 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d40a7050 con 0x7fb2c40047d0 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2cffff640 1 -- 172.21.15.2:0/2029315532 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4003600 con 0x7fb2c40047d0 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- 172.21.15.2:0/2029315532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2c40047d0 msgr2=0x7fb2c4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2c40047d0 0x7fb2c4004c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4001780 tx=0x7fb2d401c3e0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- 172.21.15.2:0/2029315532 shutdown_connections 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 --2- 172.21.15.2:0/2029315532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2c40047d0 0x7fb2c4004c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- 172.21.15.2:0/2029315532 >> 172.21.15.2:0/2029315532 conn(0x7fb2d80cebb0 msgr2=0x7fb2d80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- 172.21.15.2:0/2029315532 shutdown_connections 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- 172.21.15.2:0/2029315532 wait complete. 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 Processor -- start 2023-11-04T01:43:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- start start 2023-11-04T01:43:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c40047d0 0x7fb2d80c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2d8154190 0x7fb2d81f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d80c5f00 0x7fb2d80c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c68c0 con 0x7fb2d80c5f00 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80af170 con 0x7fb2c40047d0 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d81f4e50 con 0x7fb2d8154190 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d80c5f00 0x7fb2d80c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d80c5f00 0x7fb2d80c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44006/0 (socket says 172.21.15.2:44006) 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 -- 172.21.15.2:0/1843858087 learned_addr learned my addr 172.21.15.2:0/1843858087 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dd5b6640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c40047d0 0x7fb2d80c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dcdb5640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2d8154190 0x7fb2d81f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 -- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2d8154190 msgr2=0x7fb2d81f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2d8154190 0x7fb2d81f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 -- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c40047d0 msgr2=0x7fb2d80c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c40047d0 0x7fb2d80c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 -- 172.21.15.2:0/1843858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80c8b30 con 0x7fb2d80c5f00 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dd5b6640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c40047d0 0x7fb2d80c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dcdb5640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2d8154190 0x7fb2d81f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2dddb7640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d80c5f00 0x7fb2d80c6380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0004c00 tx=0x7fb2d0010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2cdffb640 1 -- 172.21.15.2:0/1843858087 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0010ee0 con 0x7fb2d80c5f00 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2cdffb640 1 -- 172.21.15.2:0/1843858087 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000ea80 con 0x7fb2d80c5f00 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d8154610 con 0x7fb2d80c5f00 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2cdffb640 1 -- 172.21.15.2:0/1843858087 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000ee30 con 0x7fb2d80c5f00 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.186+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d80c8850 con 0x7fb2d80c5f00 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.190+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d80744a0 con 0x7fb2d80c5f00 2023-11-04T01:43:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.190+0000 7fb2cdffb640 1 -- 172.21.15.2:0/1843858087 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2d001e3b0 con 0x7fb2d80c5f00 2023-11-04T01:43:03.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.190+0000 7fb2cdffb640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2bc0664d0 0x7fb2bc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.190+0000 7fb2cdffb640 1 -- 172.21.15.2:0/1843858087 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2d00867f0 con 0x7fb2d80c5f00 2023-11-04T01:43:03.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.190+0000 7fb2dd5b6640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2bc0664d0 0x7fb2bc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.190+0000 7fb2dd5b6640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2bc0664d0 0x7fb2bc068990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009a80 tx=0x7fb2c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.194+0000 7fb2cdffb640 1 -- 172.21.15.2:0/1843858087 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2d0053d00 con 0x7fb2d80c5f00 2023-11-04T01:43:03.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.350+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2d80af2b0 con 0x7fb2d80c5f00 2023-11-04T01:43:03.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.350+0000 7fb2cdffb640 1 -- 172.21.15.2:0/1843858087 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7fb2d001a070 con 0x7fb2d80c5f00 2023-11-04T01:43:03.355 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:03.355 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2bc0664d0 msgr2=0x7fb2bc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2bc0664d0 0x7fb2bc068990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009a80 tx=0x7fb2c8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d80c5f00 msgr2=0x7fb2d80c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d80c5f00 0x7fb2d80c6380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0004c00 tx=0x7fb2d0010cf0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 shutdown_connections 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2bc0664d0 0x7fb2bc068990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2d80c5f00 0x7fb2d80c6380 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2d8154190 0x7fb2d81f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 --2- 172.21.15.2:0/1843858087 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c40047d0 0x7fb2d80c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 >> 172.21.15.2:0/1843858087 conn(0x7fb2d80cebb0 msgr2=0x7fb2d80c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 shutdown_connections 2023-11-04T01:43:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.354+0000 7fb2df81a640 1 -- 172.21.15.2:0/1843858087 wait complete. 2023-11-04T01:43:03.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:03.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:03.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c844ca640 1 Processor -- start 2023-11-04T01:43:03.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c844ca640 1 -- start start 2023-11-04T01:43:03.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c844ca640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c7c06b580 0x7f5c7c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c844ca640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5c7c06c1c0 0x7f5c7c15d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c844ca640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c160cb0 con 0x7f5c7c0b26c0 2023-11-04T01:43:03.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c844ca640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c160f50 con 0x7f5c7c06b580 2023-11-04T01:43:03.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c844ca640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c161230 con 0x7f5c7c06c1c0 2023-11-04T01:43:03.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c7c06b580 0x7f5c7c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5c7c06b580 0x7f5c7c06bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44010/0 (socket says 172.21.15.2:44010) 2023-11-04T01:43:03.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 -- 172.21.15.2:0/3319521565 learned_addr learned my addr 172.21.15.2:0/3319521565 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:03.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c82a67640 1 --2- 172.21.15.2:0/3319521565 >> v2:172.21.15.90:3300/0 conn(0x7f5c7c06c1c0 0x7f5c7c15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 -- 172.21.15.2:0/3319521565 >> v2:172.21.15.90:3300/0 conn(0x7f5c7c06c1c0 msgr2=0x7f5c7c15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 --2- 172.21.15.2:0/3319521565 >> v2:172.21.15.90:3300/0 conn(0x7f5c7c06c1c0 0x7f5c7c15d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 -- 172.21.15.2:0/3319521565 >> v1:172.21.15.90:6789/0 conn(0x7f5c7c0b26c0 legacy=0x7f5c7c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 -- 172.21.15.2:0/3319521565 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c161510 con 0x7f5c7c06b580 2023-11-04T01:43:03.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c82a67640 1 --2- 172.21.15.2:0/3319521565 >> v2:172.21.15.90:3300/0 conn(0x7f5c7c06c1c0 0x7f5c7c15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81a65640 1 --2- 172.21.15.2:0/3319521565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c06bc80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c09a5f0 tx=0x7f5c6c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c19d5ac37d01c60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.490+0000 7f5c81264640 1 -- 172.21.15.2:0/3319521565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0ab600 con 0x7f5c7c06b580 2023-11-04T01:43:03.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c81264640 1 -- 172.21.15.2:0/3319521565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c0a7050 con 0x7f5c7c06b580 2023-11-04T01:43:03.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c81264640 1 -- 172.21.15.2:0/3319521565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0ab980 con 0x7f5c7c06b580 2023-11-04T01:43:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- 172.21.15.2:0/3319521565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 msgr2=0x7f5c7c06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 --2- 172.21.15.2:0/3319521565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c06bc80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c09a5f0 tx=0x7f5c6c01c4c0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- 172.21.15.2:0/3319521565 shutdown_connections 2023-11-04T01:43:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 --2- 172.21.15.2:0/3319521565 >> v2:172.21.15.90:3300/0 conn(0x7f5c7c06c1c0 0x7f5c7c15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 --2- 172.21.15.2:0/3319521565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c06bc80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- 172.21.15.2:0/3319521565 >> 172.21.15.2:0/3319521565 conn(0x7f5c7c09a030 msgr2=0x7f5c7c0d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- 172.21.15.2:0/3319521565 shutdown_connections 2023-11-04T01:43:03.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- 172.21.15.2:0/3319521565 wait complete. 2023-11-04T01:43:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 Processor -- start 2023-11-04T01:43:03.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- start start 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c7c06c1c0 0x7f5c7c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c7c0b26c0 0x7f5c7c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c154860 con 0x7f5c7c06b580 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c155900 con 0x7f5c7c06c1c0 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c1f6e80 con 0x7f5c7c0b26c0 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c1602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44020/0 (socket says 172.21.15.2:44020) 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 -- 172.21.15.2:0/2981501802 learned_addr learned my addr 172.21.15.2:0/2981501802 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c81a65640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c7c06c1c0 0x7f5c7c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82a67640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c7c0b26c0 0x7f5c7c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 -- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c7c0b26c0 msgr2=0x7f5c7c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c7c0b26c0 0x7f5c7c154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 -- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c7c06c1c0 msgr2=0x7f5c7c153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c7c06c1c0 0x7f5c7c153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 -- 172.21.15.2:0/2981501802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c0094d0 con 0x7f5c7c06b580 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c81a65640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c7c06c1c0 0x7f5c7c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c82266640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c1602d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800ba50 tx=0x7f5c7800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c72ffd640 1 -- 172.21.15.2:0/2981501802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7800cbe0 con 0x7f5c7c06b580 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c72ffd640 1 -- 172.21.15.2:0/2981501802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7800cd80 con 0x7f5c7c06b580 2023-11-04T01:43:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c72ffd640 1 -- 172.21.15.2:0/2981501802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c78014680 con 0x7f5c7c06b580 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c1541a0 con 0x7f5c7c06b580 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.494+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c160810 con 0x7f5c7c06b580 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.498+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c154000 con 0x7f5c7c06b580 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.498+0000 7f5c72ffd640 1 -- 172.21.15.2:0/2981501802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c780147e0 con 0x7f5c7c06b580 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.498+0000 7f5c72ffd640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c600664a0 0x7f5c60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.498+0000 7f5c72ffd640 1 -- 172.21.15.2:0/2981501802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c78083b80 con 0x7f5c7c06b580 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.498+0000 7f5c81a65640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c600664a0 0x7f5c60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.498+0000 7f5c81a65640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c600664a0 0x7f5c60068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0ad000 tx=0x7f5c6c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.502+0000 7f5c72ffd640 1 -- 172.21.15.2:0/2981501802 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c7c154000 con 0x7f5c7c06b580 2023-11-04T01:43:03.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.650+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c7c154000 con 0x7f5c7c06b580 2023-11-04T01:43:03.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.650+0000 7f5c72ffd640 1 -- 172.21.15.2:0/2981501802 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c7c154000 con 0x7f5c7c06b580 2023-11-04T01:43:03.654 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c600664a0 msgr2=0x7f5c60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c600664a0 0x7f5c60068960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0ad000 tx=0x7f5c6c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 msgr2=0x7f5c7c1602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c1602d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800ba50 tx=0x7f5c7800bf10 comp rx=0 tx=0).stop 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 shutdown_connections 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c600664a0 0x7f5c60068960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c7c0b26c0 0x7f5c7c154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c7c06c1c0 0x7f5c7c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 --2- 172.21.15.2:0/2981501802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c7c06b580 0x7f5c7c1602d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 >> 172.21.15.2:0/2981501802 conn(0x7f5c7c09a030 msgr2=0x7f5c7c0aee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 shutdown_connections 2023-11-04T01:43:03.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.654+0000 7f5c844ca640 1 -- 172.21.15.2:0/2981501802 wait complete. 2023-11-04T01:43:03.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:03.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45ce46b640 1 Processor -- start 2023-11-04T01:43:03.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45ce46b640 1 -- start start 2023-11-04T01:43:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45ce46b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 0x7f45c815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45ce46b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c80cb130 con 0x7f45c815acb0 2023-11-04T01:43:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45ce46b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c815b680 con 0x7f45c815c160 2023-11-04T01:43:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45ce46b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c815bd40 con 0x7f45c80b0c20 2023-11-04T01:43:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c7fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f45c815acb0 0x7f45c80b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41064/0 (socket says 172.21.15.2:41064) 2023-11-04T01:43:03.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c7fff640 1 -- 172.21.15.2:0/2726472131 learned_addr learned my addr 172.21.15.2:0/2726472131 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45bffff640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 0x7f45c815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152497286 0 0) 0x7f45c80cb130 con 0x7f45c815acb0 2023-11-04T01:43:03.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4003530 con 0x7f45c815acb0 2023-11-04T01:43:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3073086334 0 0) 0x7f45b4003530 con 0x7f45c815acb0 2023-11-04T01:43:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 msgr2=0x7f45c815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 0x7f45c815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 >> v1:172.21.15.90:6789/0 conn(0x7f45c815c160 legacy=0x7f45c80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c815b960 con 0x7f45c815acb0 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f45b8001680 con 0x7f45c815acb0 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 >> v1:172.21.15.2:6789/0 conn(0x7f45c815acb0 legacy=0x7f45c80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b40039b0 0x7f45b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45b4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 0x7f45b4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c815bd40 con 0x7f45b4004360 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400b990 con 0x7f45b40039b0 2023-11-04T01:43:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400bb50 con 0x7f45c80b0c20 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45bffff640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45b4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45c7fff640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b40039b0 0x7f45b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45cca08640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 0x7f45b4005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45bffff640 1 -- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 msgr2=0x7f45b4005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45bffff640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c80b0c20 0x7f45b4005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45bffff640 1 -- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b40039b0 msgr2=0x7f45b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45bffff640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45b40039b0 0x7f45b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.786+0000 7f45bffff640 1 -- 172.21.15.2:0/2726472131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4003530 con 0x7f45b4004360 2023-11-04T01:43:03.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45bffff640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45b4004830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009ae0 tx=0x7f45b001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a211a279df57b06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00a5640 con 0x7f45b4004360 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b00a57a0 con 0x7f45b4004360 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45c77fe640 1 -- 172.21.15.2:0/2726472131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00a5b50 con 0x7f45b4004360 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- 172.21.15.2:0/2726472131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 msgr2=0x7f45b4004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 --2- 172.21.15.2:0/2726472131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45b4004830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009ae0 tx=0x7f45b001ca50 comp rx=0 tx=0).stop 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45cca08640 1 -- 172.21.15.2:0/2726472131 reap_dead start 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- 172.21.15.2:0/2726472131 shutdown_connections 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- 172.21.15.2:0/2726472131 >> 172.21.15.2:0/2726472131 conn(0x7f45c80cb510 msgr2=0x7f45c80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- 172.21.15.2:0/2726472131 shutdown_connections 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- 172.21.15.2:0/2726472131 wait complete. 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 Processor -- start 2023-11-04T01:43:03.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- start start 2023-11-04T01:43:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45c8155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c8154410 0x7f45c8154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c80c7a40 0x7f45c80c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c81f2ee0 con 0x7f45b4004360 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c81f31c0 con 0x7f45c80c7a40 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45ce46b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c81f34a0 con 0x7f45c8154410 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45c8155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45c7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45c8155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44028/0 (socket says 172.21.15.2:44028) 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.790+0000 7f45c7fff640 1 -- 172.21.15.2:0/1049739829 learned_addr learned my addr 172.21.15.2:0/1049739829 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45cca08640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c80c7a40 0x7f45c80c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45bffff640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c8154410 0x7f45c8154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c7fff640 1 -- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c8154410 msgr2=0x7f45c8154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c7fff640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c8154410 0x7f45c8154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c7fff640 1 -- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c80c7a40 msgr2=0x7f45c80c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c7fff640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c80c7a40 0x7f45c80c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c7fff640 1 -- 172.21.15.2:0/1049739829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c81f3780 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45bffff640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c8154410 0x7f45c8154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c7fff640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45c8155a90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f45b800e850 tx=0x7f45b800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c57fa640 1 -- 172.21.15.2:0/1049739829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800c8d0 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c57fa640 1 -- 172.21.15.2:0/1049739829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b800ca50 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c8154dd0 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c57fa640 1 -- 172.21.15.2:0/1049739829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800ce00 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c80c8430 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c80744a0 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c57fa640 1 -- 172.21.15.2:0/1049739829 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45b801d460 con 0x7f45b4004360 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c57fa640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45a80664d0 0x7f45a8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45c57fa640 1 -- 172.21.15.2:0/1049739829 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45b8083dc0 con 0x7f45b4004360 2023-11-04T01:43:03.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45bffff640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45a80664d0 0x7f45a8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:03.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.794+0000 7f45bffff640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45a80664d0 0x7f45a8068990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009ae0 tx=0x7f45b00046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:03.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.798+0000 7f45c57fa640 1 -- 172.21.15.2:0/1049739829 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f45b80512d0 con 0x7f45b4004360 2023-11-04T01:43:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45c81f3020 con 0x7f45b4004360 2023-11-04T01:43:03.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45c57fa640 1 -- 172.21.15.2:0/1049739829 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45c81f3020 con 0x7f45b4004360 2023-11-04T01:43:03.952 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45a80664d0 msgr2=0x7f45a8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45a80664d0 0x7f45a8068990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009ae0 tx=0x7f45b00046d0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 msgr2=0x7f45c8155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45c8155a90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f45b800e850 tx=0x7f45b800ed10 comp rx=0 tx=0).stop 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 shutdown_connections 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45a80664d0 0x7f45a8068990 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009ae0 tx=0x7f45b00046d0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c80c7a40 0x7f45c80c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45c8154410 0x7f45c8154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 --2- 172.21.15.2:0/1049739829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45b4004360 0x7f45c8155a90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:03.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 >> 172.21.15.2:0/1049739829 conn(0x7f45c80cb510 msgr2=0x7f45c80ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:03.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 shutdown_connections 2023-11-04T01:43:03.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:03.950+0000 7f45ce46b640 1 -- 172.21.15.2:0/1049739829 wait complete. 2023-11-04T01:43:03.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b543b0640 1 Processor -- start 2023-11-04T01:43:04.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b543b0640 1 -- start start 2023-11-04T01:43:04.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b543b0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2b4c0b0c20 0x7f2b4c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b543b0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15c160 0x7f2b4c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b543b0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0cb130 con 0x7f2b4c15acb0 2023-11-04T01:43:04.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b543b0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c15bd40 con 0x7f2b4c0b0c20 2023-11-04T01:43:04.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b543b0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c06fd80 con 0x7f2b4c15c160 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5294d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15c160 0x7f2b4c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5194b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2b4c0b0c20 0x7f2b4c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5194b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2b4c0b0c20 0x7f2b4c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:41708/0 (socket says 172.21.15.2:41708) 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5194b640 1 -- 172.21.15.2:0/721280522 learned_addr learned my addr 172.21.15.2:0/721280522 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5294d640 1 --2- 172.21.15.2:0/721280522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15c160 0x7f2b4c0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:60716/0 (socket says 172.21.15.2:60716) 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5214c640 1 --1- 172.21.15.2:0/721280522 >> v1:172.21.15.90:6789/0 conn(0x7f2b4c15acb0 0x7f2b4c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:59094/0 (socket says 172.21.15.2:59094) 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5294d640 1 -- 172.21.15.2:0/721280522 >> v2:172.21.15.90:3300/0 conn(0x7f2b4c0b0c20 msgr2=0x7f2b4c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5294d640 1 --2- 172.21.15.2:0/721280522 >> v2:172.21.15.90:3300/0 conn(0x7f2b4c0b0c20 0x7f2b4c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5294d640 1 -- 172.21.15.2:0/721280522 >> v1:172.21.15.90:6789/0 conn(0x7f2b4c15acb0 legacy=0x7f2b4c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.094+0000 7f2b5294d640 1 -- 172.21.15.2:0/721280522 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c15b680 con 0x7f2b4c15c160 2023-11-04T01:43:04.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b5294d640 1 --2- 172.21.15.2:0/721280522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15c160 0x7f2b4c0ca490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009d90 tx=0x7f2b4401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b9c875ed4868580 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b5114a640 1 -- 172.21.15.2:0/721280522 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440a5a00 con 0x7f2b4c15c160 2023-11-04T01:43:04.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b5114a640 1 -- 172.21.15.2:0/721280522 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b440a5b60 con 0x7f2b4c15c160 2023-11-04T01:43:04.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b5114a640 1 -- 172.21.15.2:0/721280522 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440ad440 con 0x7f2b4c15c160 2023-11-04T01:43:04.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- 172.21.15.2:0/721280522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15c160 msgr2=0x7f2b4c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 --2- 172.21.15.2:0/721280522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15c160 0x7f2b4c0ca490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009d90 tx=0x7f2b4401c920 comp rx=0 tx=0).stop 2023-11-04T01:43:04.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- 172.21.15.2:0/721280522 shutdown_connections 2023-11-04T01:43:04.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 --2- 172.21.15.2:0/721280522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15c160 0x7f2b4c0ca490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 --2- 172.21.15.2:0/721280522 >> v2:172.21.15.90:3300/0 conn(0x7f2b4c0b0c20 0x7f2b4c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- 172.21.15.2:0/721280522 >> 172.21.15.2:0/721280522 conn(0x7f2b4c0cb510 msgr2=0x7f2b4c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- 172.21.15.2:0/721280522 shutdown_connections 2023-11-04T01:43:04.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- 172.21.15.2:0/721280522 wait complete. 2023-11-04T01:43:04.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 Processor -- start 2023-11-04T01:43:04.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- start start 2023-11-04T01:43:04.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4c0b0c20 0x7f2b4c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15acb0 0x7f2b4c0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b4c15c160 0x7f2b4c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c7230 con 0x7f2b4c15c160 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c6620 con 0x7f2b4c0b0c20 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.098+0000 7f2b543b0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0c6900 con 0x7f2b4c15acb0 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b4c15c160 0x7f2b4c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b4c15c160 0x7f2b4c151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44034/0 (socket says 172.21.15.2:44034) 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 -- 172.21.15.2:0/947708496 learned_addr learned my addr 172.21.15.2:0/947708496 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5214c640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4c0b0c20 0x7f2b4c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5194b640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15acb0 0x7f2b4c0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 -- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15acb0 msgr2=0x7f2b4c0c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15acb0 0x7f2b4c0c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 -- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4c0b0c20 msgr2=0x7f2b4c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4c0b0c20 0x7f2b4c0ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 -- 172.21.15.2:0/947708496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009a70 con 0x7f2b4c15c160 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5294d640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b4c15c160 0x7f2b4c151c70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2b4401afd0 tx=0x7f2b440196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b42ffd640 1 -- 172.21.15.2:0/947708496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440add90 con 0x7f2b4c15c160 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b42ffd640 1 -- 172.21.15.2:0/947708496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44009450 con 0x7f2b4c15c160 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b42ffd640 1 -- 172.21.15.2:0/947708496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440b9670 con 0x7f2b4c15c160 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c0c6be0 con 0x7f2b4c15c160 2023-11-04T01:43:04.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c0af750 con 0x7f2b4c15c160 2023-11-04T01:43:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c0c7090 con 0x7f2b4c15c160 2023-11-04T01:43:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b42ffd640 1 -- 172.21.15.2:0/947708496 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b440b97d0 con 0x7f2b4c15c160 2023-11-04T01:43:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b42ffd640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b300664a0 0x7f2b30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b42ffd640 1 -- 172.21.15.2:0/947708496 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b4411f6b0 con 0x7f2b4c15c160 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.102+0000 7f2b5214c640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b300664a0 0x7f2b30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.106+0000 7f2b5214c640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b300664a0 0x7f2b30068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b48000f70 tx=0x7f2b48007e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.106+0000 7f2b42ffd640 1 -- 172.21.15.2:0/947708496 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b4c0c7090 con 0x7f2b4c15c160 2023-11-04T01:43:04.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.262+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b4c0c7090 con 0x7f2b4c15c160 2023-11-04T01:43:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b42ffd640 1 -- 172.21.15.2:0/947708496 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b4c0c7090 con 0x7f2b4c15c160 2023-11-04T01:43:04.267 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b300664a0 msgr2=0x7f2b30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b300664a0 0x7f2b30068960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b48000f70 tx=0x7f2b48007e50 comp rx=0 tx=0).stop 2023-11-04T01:43:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b4c15c160 msgr2=0x7f2b4c151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b4c15c160 0x7f2b4c151c70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2b4401afd0 tx=0x7f2b440196c0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 shutdown_connections 2023-11-04T01:43:04.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b300664a0 0x7f2b30068960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b4c15c160 0x7f2b4c151c70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b4c15acb0 0x7f2b4c0c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 --2- 172.21.15.2:0/947708496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b4c0b0c20 0x7f2b4c0ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 >> 172.21.15.2:0/947708496 conn(0x7f2b4c0cb510 msgr2=0x7f2b4c0c9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 shutdown_connections 2023-11-04T01:43:04.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.266+0000 7f2b543b0640 1 -- 172.21.15.2:0/947708496 wait complete. 2023-11-04T01:43:04.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:04.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28ffdc640 1 Processor -- start 2023-11-04T01:43:04.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28ffdc640 1 -- start start 2023-11-04T01:43:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28ffdc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2880d0690 0x7fb2880b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28ffdc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2880d0ae0 0x7fb2880b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28ffdc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880b6070 con 0x7fb2880b4990 2023-11-04T01:43:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28ffdc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880b8ed0 con 0x7fb2880d0690 2023-11-04T01:43:04.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28ffdc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880d1ce0 con 0x7fb2880d0ae0 2023-11-04T01:43:04.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28d577640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2880d0690 0x7fb2880b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28dd78640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb2880b4990 0x7fb2880b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41074/0 (socket says 172.21.15.2:41074) 2023-11-04T01:43:04.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28dd78640 1 -- 172.21.15.2:0/2196703184 learned_addr learned my addr 172.21.15.2:0/2196703184 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:04.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28e579640 1 --2- 172.21.15.2:0/2196703184 >> v2:172.21.15.90:3300/0 conn(0x7fb2880d0ae0 0x7fb2880b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28d577640 1 -- 172.21.15.2:0/2196703184 >> v2:172.21.15.90:3300/0 conn(0x7fb2880d0ae0 msgr2=0x7fb2880b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28d577640 1 --2- 172.21.15.2:0/2196703184 >> v2:172.21.15.90:3300/0 conn(0x7fb2880d0ae0 0x7fb2880b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28d577640 1 -- 172.21.15.2:0/2196703184 >> v1:172.21.15.2:6789/0 conn(0x7fb2880b4990 legacy=0x7fb2880b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28d577640 1 -- 172.21.15.2:0/2196703184 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880d1fc0 con 0x7fb2880d0690 2023-11-04T01:43:04.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.414+0000 7fb28cd76640 1 -- 172.21.15.2:0/2196703184 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225649709 0 0) 0x7fb2880b6070 con 0x7fb2880b4990 2023-11-04T01:43:04.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28d577640 1 --2- 172.21.15.2:0/2196703184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880b64e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb288067730 tx=0x7fb27801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235e82db16488be2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28cd76640 1 -- 172.21.15.2:0/2196703184 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780a8950 con 0x7fb2880d0690 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28cd76640 1 -- 172.21.15.2:0/2196703184 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2780a8ab0 con 0x7fb2880d0690 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28cd76640 1 -- 172.21.15.2:0/2196703184 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780a8e40 con 0x7fb2880d0690 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 -- 172.21.15.2:0/2196703184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 msgr2=0x7fb2880b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/2196703184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880b64e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb288067730 tx=0x7fb27801ec50 comp rx=0 tx=0).stop 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 -- 172.21.15.2:0/2196703184 shutdown_connections 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/2196703184 >> v2:172.21.15.90:3300/0 conn(0x7fb2880d0ae0 0x7fb2880b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/2196703184 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880b64e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 -- 172.21.15.2:0/2196703184 >> 172.21.15.2:0/2196703184 conn(0x7fb2880cf990 msgr2=0x7fb2880cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 -- 172.21.15.2:0/2196703184 shutdown_connections 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 -- 172.21.15.2:0/2196703184 wait complete. 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 Processor -- start 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 -- start start 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2880b4990 0x7fb2880cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.418+0000 7fb28ffdc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2880d0ae0 0x7fb28815ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28ffdc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28814ac50 con 0x7fb2880d0690 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28ffdc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880ca950 con 0x7fb2880b4990 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28ffdc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880cac30 con 0x7fb2880d0ae0 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44058/0 (socket says 172.21.15.2:44058) 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 -- 172.21.15.2:0/3820578565 learned_addr learned my addr 172.21.15.2:0/3820578565 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28dd78640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2880b4990 0x7fb2880cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28e579640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2880d0ae0 0x7fb28815ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 -- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2880d0ae0 msgr2=0x7fb28815ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2880d0ae0 0x7fb28815ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 -- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2880b4990 msgr2=0x7fb2880cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2880b4990 0x7fb2880cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 -- 172.21.15.2:0/3820578565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278009420 con 0x7fb2880d0690 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28dd78640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2880b4990 0x7fb2880cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28d577640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880c9fe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2780b3040 tx=0x7fb27801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb27e7fc640 1 -- 172.21.15.2:0/3820578565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780b9630 con 0x7fb2880d0690 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb27e7fc640 1 -- 172.21.15.2:0/3820578565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2780b97b0 con 0x7fb2880d0690 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2880caf10 con 0x7fb2880d0690 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb27e7fc640 1 -- 172.21.15.2:0/3820578565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2780b9b60 con 0x7fb2880d0690 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2880cba00 con 0x7fb2880d0690 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2880744a0 con 0x7fb2880d0690 2023-11-04T01:43:04.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb27e7fc640 1 -- 172.21.15.2:0/3820578565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2780b7040 con 0x7fb2880d0690 2023-11-04T01:43:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb27e7fc640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb26c0664a0 0x7fb26c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb27e7fc640 1 -- 172.21.15.2:0/3820578565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb278121dc0 con 0x7fb2880d0690 2023-11-04T01:43:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28dd78640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb26c0664a0 0x7fb26c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.422+0000 7fb28dd78640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb26c0664a0 0x7fb26c068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb284007fd0 tx=0x7fb284009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.426+0000 7fb27e7fc640 1 -- 172.21.15.2:0/3820578565 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2780ef240 con 0x7fb2880d0690 2023-11-04T01:43:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.594+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb288067ae0 con 0x7fb2880d0690 2023-11-04T01:43:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.594+0000 7fb27e7fc640 1 -- 172.21.15.2:0/3820578565 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb2780b5080 con 0x7fb2880d0690 2023-11-04T01:43:04.597 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb26c0664a0 msgr2=0x7fb26c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb26c0664a0 0x7fb26c068960 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb284007fd0 tx=0x7fb284009040 comp rx=0 tx=0).stop 2023-11-04T01:43:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 msgr2=0x7fb2880c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880c9fe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb2780b3040 tx=0x7fb27801b9f0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 shutdown_connections 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb26c0664a0 0x7fb26c068960 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2880d0ae0 0x7fb28815ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2880d0690 0x7fb2880c9fe0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 --2- 172.21.15.2:0/3820578565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2880b4990 0x7fb2880cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 >> 172.21.15.2:0/3820578565 conn(0x7fb2880cf990 msgr2=0x7fb2880d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 shutdown_connections 2023-11-04T01:43:04.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.598+0000 7fb28ffdc640 1 -- 172.21.15.2:0/3820578565 wait complete. 2023-11-04T01:43:04.614 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:43:04.614 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:04.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:04.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:04.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[44925]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:04.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:04.676 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:04.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:43:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:04.686 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:43:04.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:04.687 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:43:04.747 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:04.747 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:04.753 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:04.754 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:04.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:04.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi090.stderr:2023-11-04T01:43:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:04.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 Processor -- start 2023-11-04T01:43:04.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 -- start start 2023-11-04T01:43:04.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4b800b4990 0x7f4b800b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800d0690 0x7f4b800cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b800d0ae0 0x7f4b800cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b800b6070 con 0x7f4b800d0ae0 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b800b8ed0 con 0x7f4b800b4990 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b87477640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800b52b0 con 0x7f4b800d0690 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b800d0ae0 0x7f4b800cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b800d0ae0 0x7f4b800cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44062/0 (socket says 172.21.15.2:44062) 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 -- 172.21.15.2:0/1887733245 learned_addr learned my addr 172.21.15.2:0/1887733245 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b84a12640 1 --2- 172.21.15.2:0/1887733245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800d0690 0x7f4b800cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85213640 1 --2- 172.21.15.2:0/1887733245 >> v2:172.21.15.90:3300/0 conn(0x7f4b800b4990 0x7f4b800b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 -- 172.21.15.2:0/1887733245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800d0690 msgr2=0x7f4b800cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 --2- 172.21.15.2:0/1887733245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800d0690 0x7f4b800cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 -- 172.21.15.2:0/1887733245 >> v2:172.21.15.90:3300/0 conn(0x7f4b800b4990 msgr2=0x7f4b800b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:04.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 --2- 172.21.15.2:0/1887733245 >> v2:172.21.15.90:3300/0 conn(0x7f4b800b4990 0x7f4b800b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85a14640 1 -- 172.21.15.2:0/1887733245 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800d1ce0 con 0x7f4b800d0ae0 2023-11-04T01:43:04.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.926+0000 7f4b85213640 1 --2- 172.21.15.2:0/1887733245 >> v2:172.21.15.90:3300/0 conn(0x7f4b800b4990 0x7f4b800b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:04.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b85a14640 1 --2- 172.21.15.2:0/1887733245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b800cdcb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4b80160ce0 tx=0x7f4b7801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14425897ceae8db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b77fff640 1 -- 172.21.15.2:0/1887733245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780af400 con 0x7f4b800d0ae0 2023-11-04T01:43:04.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b77fff640 1 -- 172.21.15.2:0/1887733245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780ab050 con 0x7f4b800d0ae0 2023-11-04T01:43:04.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b77fff640 1 -- 172.21.15.2:0/1887733245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780af780 con 0x7f4b800d0ae0 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- 172.21.15.2:0/1887733245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 msgr2=0x7f4b800cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 --2- 172.21.15.2:0/1887733245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b800cdcb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4b80160ce0 tx=0x7f4b7801f1c0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- 172.21.15.2:0/1887733245 shutdown_connections 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 --2- 172.21.15.2:0/1887733245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b800cdcb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 --2- 172.21.15.2:0/1887733245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800d0690 0x7f4b800cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 --2- 172.21.15.2:0/1887733245 >> v2:172.21.15.90:3300/0 conn(0x7f4b800b4990 0x7f4b800b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- 172.21.15.2:0/1887733245 >> 172.21.15.2:0/1887733245 conn(0x7f4b800cf990 msgr2=0x7f4b800cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:04.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- 172.21.15.2:0/1887733245 shutdown_connections 2023-11-04T01:43:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- 172.21.15.2:0/1887733245 wait complete. 2023-11-04T01:43:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 Processor -- start 2023-11-04T01:43:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- start start 2023-11-04T01:43:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800b4990 0x7f4b8015af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b800d0690 0x7f4b801efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b801f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800aacd0 con 0x7f4b800d0ae0 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800aa3c0 con 0x7f4b800d0690 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b87477640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b801f39f0 con 0x7f4b800b4990 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b85a14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b801f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b85a14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b801f0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44070/0 (socket says 172.21.15.2:44070) 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b85213640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800b4990 0x7f4b8015af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.930+0000 7f4b85a14640 1 -- 172.21.15.2:0/3258298221 learned_addr learned my addr 172.21.15.2:0/3258298221 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b84a12640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b800d0690 0x7f4b801efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85a14640 1 -- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800b4990 msgr2=0x7f4b8015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85a14640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800b4990 0x7f4b8015af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85a14640 1 -- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b800d0690 msgr2=0x7f4b801efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85a14640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b800d0690 0x7f4b801efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85a14640 1 -- 172.21.15.2:0/3258298221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78009b30 con 0x7f4b800d0ae0 2023-11-04T01:43:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b84a12640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b800d0690 0x7f4b801efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85a14640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b801f0190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4b780b2040 tx=0x7f4b7801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b75ffb640 1 -- 172.21.15.2:0/3258298221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78009510 con 0x7f4b800d0ae0 2023-11-04T01:43:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b75ffb640 1 -- 172.21.15.2:0/3258298221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780afc00 con 0x7f4b800d0ae0 2023-11-04T01:43:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b800aa610 con 0x7f4b800d0ae0 2023-11-04T01:43:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b75ffb640 1 -- 172.21.15.2:0/3258298221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b8400 con 0x7f4b800d0ae0 2023-11-04T01:43:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b800ab0f0 con 0x7f4b800d0ae0 2023-11-04T01:43:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b800aae10 con 0x7f4b800d0ae0 2023-11-04T01:43:04.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b75ffb640 1 -- 172.21.15.2:0/3258298221 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b780b6040 con 0x7f4b800d0ae0 2023-11-04T01:43:04.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b75ffb640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b640664a0 0x7f4b64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:04.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b75ffb640 1 -- 172.21.15.2:0/3258298221 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b781215c0 con 0x7f4b800d0ae0 2023-11-04T01:43:04.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85213640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b640664a0 0x7f4b64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:04.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.934+0000 7f4b85213640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b640664a0 0x7f4b64068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00aaf0 tx=0x7f4b7c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:04.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:04.938+0000 7f4b75ffb640 1 -- 172.21.15.2:0/3258298221 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4b800aae10 con 0x7f4b800d0ae0 2023-11-04T01:43:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.094+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b800aae10 con 0x7f4b800d0ae0 2023-11-04T01:43:05.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.094+0000 7f4b75ffb640 1 -- 172.21.15.2:0/3258298221 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f4b800aae10 con 0x7f4b800d0ae0 2023-11-04T01:43:05.099 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:05.099 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:42:25.492232+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:05.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b640664a0 msgr2=0x7f4b64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b640664a0 0x7f4b64068960 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00aaf0 tx=0x7f4b7c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 msgr2=0x7f4b801f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b801f0190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4b780b2040 tx=0x7f4b7801bf60 comp rx=0 tx=0).stop 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 shutdown_connections 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b640664a0 0x7f4b64068960 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b800d0ae0 0x7f4b801f0190 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b800d0690 0x7f4b801efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 --2- 172.21.15.2:0/3258298221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b800b4990 0x7f4b8015af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 >> 172.21.15.2:0/3258298221 conn(0x7f4b800cf990 msgr2=0x7f4b800b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 shutdown_connections 2023-11-04T01:43:05.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.098+0000 7f4b87477640 1 -- 172.21.15.2:0/3258298221 wait complete. 2023-11-04T01:43:05.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:05.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:05.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c402f640 1 Processor -- start 2023-11-04T01:43:05.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c402f640 1 -- start start 2023-11-04T01:43:05.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c402f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27bc0c2190 0x7f27bc165c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c402f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27bc06f9c0 0x7f27bc06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c402f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0cc990 con 0x7f27bc0c1db0 2023-11-04T01:43:05.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c402f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc06cc90 con 0x7f27bc06f9c0 2023-11-04T01:43:05.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c402f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc06cf70 con 0x7f27bc0c2190 2023-11-04T01:43:05.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c25cc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27bc06f9c0 0x7f27bc06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c25cc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27bc06f9c0 0x7f27bc06fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44076/0 (socket says 172.21.15.2:44076) 2023-11-04T01:43:05.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c25cc640 1 -- 172.21.15.2:0/4129270942 learned_addr learned my addr 172.21.15.2:0/4129270942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:05.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c15ca640 1 --2- 172.21.15.2:0/4129270942 >> v2:172.21.15.90:3300/0 conn(0x7f27bc0c2190 0x7f27bc165c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c25cc640 1 -- 172.21.15.2:0/4129270942 >> v2:172.21.15.90:3300/0 conn(0x7f27bc0c2190 msgr2=0x7f27bc165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c25cc640 1 --2- 172.21.15.2:0/4129270942 >> v2:172.21.15.90:3300/0 conn(0x7f27bc0c2190 0x7f27bc165c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c25cc640 1 -- 172.21.15.2:0/4129270942 >> v1:172.21.15.90:6789/0 conn(0x7f27bc0c1db0 legacy=0x7f27bc0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c25cc640 1 -- 172.21.15.2:0/4129270942 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc06d250 con 0x7f27bc06f9c0 2023-11-04T01:43:05.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.246+0000 7f27c15ca640 1 --2- 172.21.15.2:0/4129270942 >> v2:172.21.15.90:3300/0 conn(0x7f27bc0c2190 0x7f27bc165c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:05.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c25cc640 1 --2- 172.21.15.2:0/4129270942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc06f9c0 0x7f27bc06fde0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0c2570 tx=0x7f27b401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36471e0815235b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c0dc9640 1 -- 172.21.15.2:0/4129270942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40af400 con 0x7f27bc06f9c0 2023-11-04T01:43:05.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c0dc9640 1 -- 172.21.15.2:0/4129270942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40ab050 con 0x7f27bc06f9c0 2023-11-04T01:43:05.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c0dc9640 1 -- 172.21.15.2:0/4129270942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40af780 con 0x7f27bc06f9c0 2023-11-04T01:43:05.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 -- 172.21.15.2:0/4129270942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc06f9c0 msgr2=0x7f27bc06fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 --2- 172.21.15.2:0/4129270942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc06f9c0 0x7f27bc06fde0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0c2570 tx=0x7f27b401f1c0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 -- 172.21.15.2:0/4129270942 shutdown_connections 2023-11-04T01:43:05.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 --2- 172.21.15.2:0/4129270942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc06f9c0 0x7f27bc06fde0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 --2- 172.21.15.2:0/4129270942 >> v2:172.21.15.90:3300/0 conn(0x7f27bc0c2190 0x7f27bc165c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 -- 172.21.15.2:0/4129270942 >> 172.21.15.2:0/4129270942 conn(0x7f27bc0cb510 msgr2=0x7f27bc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 -- 172.21.15.2:0/4129270942 shutdown_connections 2023-11-04T01:43:05.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.250+0000 7f27c402f640 1 -- 172.21.15.2:0/4129270942 wait complete. 2023-11-04T01:43:05.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 Processor -- start 2023-11-04T01:43:05.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 -- start start 2023-11-04T01:43:05.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27bc06f9c0 0x7f27bc152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc0c1db0 0x7f27bc0c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27bc0c2190 0x7f27bc0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc152740 con 0x7f27bc0c1db0 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0c4e90 con 0x7f27bc0c2190 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0c26a0 con 0x7f27bc06f9c0 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc0c1db0 0x7f27bc0c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc0c1db0 0x7f27bc0c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44088/0 (socket says 172.21.15.2:44088) 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 -- 172.21.15.2:0/3158547317 learned_addr learned my addr 172.21.15.2:0/3158547317 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c25cc640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27bc0c2190 0x7f27bc0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c1dcb640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27bc06f9c0 0x7f27bc152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 -- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27bc06f9c0 msgr2=0x7f27bc152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27bc06f9c0 0x7f27bc152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 -- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27bc0c2190 msgr2=0x7f27bc0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27bc0c2190 0x7f27bc0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 -- 172.21.15.2:0/3158547317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4009b30 con 0x7f27bc0c1db0 2023-11-04T01:43:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c15ca640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc0c1db0 0x7f27bc0c7390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c7f0 tx=0x7f27b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27ae7fc640 1 -- 172.21.15.2:0/3158547317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8007820 con 0x7f27bc0c1db0 2023-11-04T01:43:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27ae7fc640 1 -- 172.21.15.2:0/3158547317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b8007980 con 0x7f27bc0c1db0 2023-11-04T01:43:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc0c2980 con 0x7f27bc0c1db0 2023-11-04T01:43:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27ae7fc640 1 -- 172.21.15.2:0/3158547317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8007d30 con 0x7f27bc0c1db0 2023-11-04T01:43:05.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc0c2f40 con 0x7f27bc0c1db0 2023-11-04T01:43:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc0c3100 con 0x7f27bc0c1db0 2023-11-04T01:43:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27ae7fc640 1 -- 172.21.15.2:0/3158547317 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27b80113f0 con 0x7f27bc0c1db0 2023-11-04T01:43:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.254+0000 7f27ae7fc640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27a00664a0 0x7f27a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.258+0000 7f27ae7fc640 1 -- 172.21.15.2:0/3158547317 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27b8084110 con 0x7f27bc0c1db0 2023-11-04T01:43:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.258+0000 7f27c1dcb640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27a00664a0 0x7f27a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.258+0000 7f27c1dcb640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27a00664a0 0x7f27a0068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27b0001650 tx=0x7f27b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.262+0000 7f27ae7fc640 1 -- 172.21.15.2:0/3158547317 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27b8051620 con 0x7f27bc0c1db0 2023-11-04T01:43:05.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.414+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27bc0744a0 con 0x7f27bc0c1db0 2023-11-04T01:43:05.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.414+0000 7f27ae7fc640 1 -- 172.21.15.2:0/3158547317 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27b805b030 con 0x7f27bc0c1db0 2023-11-04T01:43:05.417 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:05.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27a00664a0 msgr2=0x7f27a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27a00664a0 0x7f27a0068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f27b0001650 tx=0x7f27b0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc0c1db0 msgr2=0x7f27bc0c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc0c1db0 0x7f27bc0c7390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27b800c7f0 tx=0x7f27b800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 shutdown_connections 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27a00664a0 0x7f27a0068960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27bc0c2190 0x7f27bc0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27bc0c1db0 0x7f27bc0c7390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 --2- 172.21.15.2:0/3158547317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27bc06f9c0 0x7f27bc152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 >> 172.21.15.2:0/3158547317 conn(0x7f27bc0cb510 msgr2=0x7f27bc06b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 shutdown_connections 2023-11-04T01:43:05.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.418+0000 7f27c402f640 1 -- 172.21.15.2:0/3158547317 wait complete. 2023-11-04T01:43:05.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:05.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3eeee3640 1 Processor -- start 2023-11-04T01:43:05.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3eeee3640 1 -- start start 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3eeee3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd3e806cc10 0x7fd3e80701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3eeee3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3e815e8f0 0x7fd3e815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3eeee3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e806ae80 con 0x7fd3e80b4770 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3eeee3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e815f260 con 0x7fd3e815e8f0 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3eeee3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e80b4b50 con 0x7fd3e806cc10 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3ed480640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3e815e8f0 0x7fd3e815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3ecc7f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd3e80b4770 0x7fd3e806b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41078/0 (socket says 172.21.15.2:41078) 2023-11-04T01:43:05.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3ecc7f640 1 -- 172.21.15.2:0/1286813998 learned_addr learned my addr 172.21.15.2:0/1286813998 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3e7fff640 1 --2- 172.21.15.2:0/1286813998 >> v2:172.21.15.90:3300/0 conn(0x7fd3e806cc10 0x7fd3e80701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3ed480640 1 -- 172.21.15.2:0/1286813998 >> v2:172.21.15.90:3300/0 conn(0x7fd3e806cc10 msgr2=0x7fd3e80701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3ed480640 1 --2- 172.21.15.2:0/1286813998 >> v2:172.21.15.90:3300/0 conn(0x7fd3e806cc10 0x7fd3e80701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3ed480640 1 -- 172.21.15.2:0/1286813998 >> v1:172.21.15.2:6789/0 conn(0x7fd3e80b4770 legacy=0x7fd3e806b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3ed480640 1 -- 172.21.15.2:0/1286813998 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e806d030 con 0x7fd3e815e8f0 2023-11-04T01:43:05.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.566+0000 7fd3e7fff640 1 --2- 172.21.15.2:0/1286813998 >> v2:172.21.15.90:3300/0 conn(0x7fd3e806cc10 0x7fd3e80701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:05.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ed480640 1 --2- 172.21.15.2:0/1286813998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e815e8f0 0x7fd3e815ed20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd3e806bd00 tx=0x7fd3e001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9438a0695276be94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3e77fe640 1 -- 172.21.15.2:0/1286813998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00a5830 con 0x7fd3e815e8f0 2023-11-04T01:43:05.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3e77fe640 1 -- 172.21.15.2:0/1286813998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e00a5990 con 0x7fd3e815e8f0 2023-11-04T01:43:05.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3e77fe640 1 -- 172.21.15.2:0/1286813998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00a5d20 con 0x7fd3e815e8f0 2023-11-04T01:43:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- 172.21.15.2:0/1286813998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e815e8f0 msgr2=0x7fd3e815ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/1286813998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e815e8f0 0x7fd3e815ed20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd3e806bd00 tx=0x7fd3e001c880 comp rx=0 tx=0).stop 2023-11-04T01:43:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- 172.21.15.2:0/1286813998 shutdown_connections 2023-11-04T01:43:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/1286813998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e815e8f0 0x7fd3e815ed20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/1286813998 >> v2:172.21.15.90:3300/0 conn(0x7fd3e806cc10 0x7fd3e80701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- 172.21.15.2:0/1286813998 >> 172.21.15.2:0/1286813998 conn(0x7fd3e806c0f0 msgr2=0x7fd3e806c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- 172.21.15.2:0/1286813998 shutdown_connections 2023-11-04T01:43:05.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- 172.21.15.2:0/1286813998 wait complete. 2023-11-04T01:43:05.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 Processor -- start 2023-11-04T01:43:05.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- start start 2023-11-04T01:43:05.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e806cc10 0x7fd3e8157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3e80b4770 0x7fd3e80c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3e815e8f0 0x7fd3e80c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8157d60 con 0x7fd3e806cc10 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80b3ec0 con 0x7fd3e80b4770 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3eeee3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e80c8000 con 0x7fd3e815e8f0 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e806cc10 0x7fd3e8157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e806cc10 0x7fd3e8157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44108/0 (socket says 172.21.15.2:44108) 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 -- 172.21.15.2:0/2689101153 learned_addr learned my addr 172.21.15.2:0/2689101153 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 -- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3e815e8f0 msgr2=0x7fd3e80c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3e815e8f0 0x7fd3e80c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 -- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3e80b4770 msgr2=0x7fd3e80c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3e80b4770 0x7fd3e80c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.570+0000 7fd3ecc7f640 1 -- 172.21.15.2:0/2689101153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0009a70 con 0x7fd3e806cc10 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3ecc7f640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e806cc10 0x7fd3e8157820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c400 tx=0x7fd3d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e57fa640 1 -- 172.21.15.2:0/2689101153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8005cf0 con 0x7fd3e806cc10 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e57fa640 1 -- 172.21.15.2:0/2689101153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d8005e50 con 0x7fd3e806cc10 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e80c82e0 con 0x7fd3e806cc10 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e57fa640 1 -- 172.21.15.2:0/2689101153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d80072d0 con 0x7fd3e806cc10 2023-11-04T01:43:05.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e81533b0 con 0x7fd3e806cc10 2023-11-04T01:43:05.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e80675f0 con 0x7fd3e806cc10 2023-11-04T01:43:05.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e57fa640 1 -- 172.21.15.2:0/2689101153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3d8007430 con 0x7fd3e806cc10 2023-11-04T01:43:05.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e57fa640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd3d40664a0 0x7fd3d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e57fa640 1 -- 172.21.15.2:0/2689101153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd3d8083340 con 0x7fd3e806cc10 2023-11-04T01:43:05.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e7fff640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd3d40664a0 0x7fd3d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.574+0000 7fd3e7fff640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd3d40664a0 0x7fd3d4068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80c8890 tx=0x7fd3dc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.578+0000 7fd3e57fa640 1 -- 172.21.15.2:0/2689101153 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3d8050840 con 0x7fd3e806cc10 2023-11-04T01:43:05.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3e80c84d0 con 0x7fd3e806cc10 2023-11-04T01:43:05.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3e57fa640 1 -- 172.21.15.2:0/2689101153 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd3d8053e60 con 0x7fd3e806cc10 2023-11-04T01:43:05.740 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd3d40664a0 msgr2=0x7fd3d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd3d40664a0 0x7fd3d4068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80c8890 tx=0x7fd3dc008040 comp rx=0 tx=0).stop 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e806cc10 msgr2=0x7fd3e8157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e806cc10 0x7fd3e8157820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c400 tx=0x7fd3d800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 shutdown_connections 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd3d40664a0 0x7fd3d4068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3e815e8f0 0x7fd3e80c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3e80b4770 0x7fd3e80c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 --2- 172.21.15.2:0/2689101153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e806cc10 0x7fd3e8157820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 >> 172.21.15.2:0/2689101153 conn(0x7fd3e806c0f0 msgr2=0x7fd3e815dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 shutdown_connections 2023-11-04T01:43:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.738+0000 7fd3eeee3640 1 -- 172.21.15.2:0/2689101153 wait complete. 2023-11-04T01:43:05.759 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:05.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.886+0000 7ff983675640 1 Processor -- start 2023-11-04T01:43:05.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.886+0000 7ff983675640 1 -- start start 2023-11-04T01:43:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff983675640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff97c0b0c20 0x7ff97c06b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff983675640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c06c010 con 0x7ff97c15d290 2023-11-04T01:43:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff983675640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c0ac960 con 0x7ff97c06b840 2023-11-04T01:43:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff983675640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0c90e0 con 0x7ff97c0b0c20 2023-11-04T01:43:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff980c10640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff97c0b0c20 0x7ff97c06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff980c10640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff97c0b0c20 0x7ff97c06b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44112/0 (socket says 172.21.15.2:44112) 2023-11-04T01:43:05.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff980c10640 1 -- 172.21.15.2:0/3953998728 learned_addr learned my addr 172.21.15.2:0/3953998728 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:05.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff981411640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff97c15d290 0x7ff97c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41080/0 (socket says 172.21.15.2:41080) 2023-11-04T01:43:05.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff980c10640 1 -- 172.21.15.2:0/3953998728 >> v1:172.21.15.90:6789/0 conn(0x7ff97c06b840 legacy=0x7ff97c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:05.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff980c10640 1 -- 172.21.15.2:0/3953998728 >> v1:172.21.15.2:6789/0 conn(0x7ff97c15d290 legacy=0x7ff97c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff980c10640 1 -- 172.21.15.2:0/3953998728 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0acc40 con 0x7ff97c0b0c20 2023-11-04T01:43:05.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff980c10640 1 --2- 172.21.15.2:0/3953998728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c0b0c20 0x7ff97c06b300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff970009870 tx=0x7ff97001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7524f55e46400939 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff96ffff640 1 -- 172.21.15.2:0/3953998728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9700aa430 con 0x7ff97c0b0c20 2023-11-04T01:43:05.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff96ffff640 1 -- 172.21.15.2:0/3953998728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9700aa590 con 0x7ff97c0b0c20 2023-11-04T01:43:05.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff96ffff640 1 -- 172.21.15.2:0/3953998728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9700aa920 con 0x7ff97c0b0c20 2023-11-04T01:43:05.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff983675640 1 -- 172.21.15.2:0/3953998728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c0b0c20 msgr2=0x7ff97c06b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.890+0000 7ff983675640 1 --2- 172.21.15.2:0/3953998728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c0b0c20 0x7ff97c06b300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff970009870 tx=0x7ff97001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- 172.21.15.2:0/3953998728 shutdown_connections 2023-11-04T01:43:05.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 --2- 172.21.15.2:0/3953998728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c0b0c20 0x7ff97c06b300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- 172.21.15.2:0/3953998728 >> 172.21.15.2:0/3953998728 conn(0x7ff97c0cb510 msgr2=0x7ff97c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:05.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- 172.21.15.2:0/3953998728 shutdown_connections 2023-11-04T01:43:05.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- 172.21.15.2:0/3953998728 wait complete. 2023-11-04T01:43:05.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 Processor -- start 2023-11-04T01:43:05.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- start start 2023-11-04T01:43:05.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c06b840 0x7ff97c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff97c0b0c20 0x7ff97c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c15d290 0x7ff97c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0cdc60 con 0x7ff97c06b840 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0af8c0 con 0x7ff97c0b0c20 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c151320 con 0x7ff97c15d290 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c06b840 0x7ff97c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c06b840 0x7ff97c0b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44114/0 (socket says 172.21.15.2:44114) 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 -- 172.21.15.2:0/3210727971 learned_addr learned my addr 172.21.15.2:0/3210727971 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff980c10640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff97c0b0c20 0x7ff97c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981c12640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c15d290 0x7ff97c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 -- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c15d290 msgr2=0x7ff97c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c15d290 0x7ff97c0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 -- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff97c0b0c20 msgr2=0x7ff97c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff97c0b0c20 0x7ff97c0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 -- 172.21.15.2:0/3210727971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700094d0 con 0x7ff97c06b840 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff981411640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c06b840 0x7ff97c0b22a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff97800c430 tx=0x7ff97800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff96dffb640 1 -- 172.21.15.2:0/3210727971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9780074e0 con 0x7ff97c06b840 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff96dffb640 1 -- 172.21.15.2:0/3210727971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978007640 con 0x7ff97c06b840 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c0cd400 con 0x7ff97c06b840 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff96dffb640 1 -- 172.21.15.2:0/3210727971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978004a10 con 0x7ff97c06b840 2023-11-04T01:43:05.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.894+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c0cd980 con 0x7ff97c06b840 2023-11-04T01:43:05.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.898+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c0744a0 con 0x7ff97c06b840 2023-11-04T01:43:05.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.898+0000 7ff96dffb640 1 -- 172.21.15.2:0/3210727971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff978004b70 con 0x7ff97c06b840 2023-11-04T01:43:05.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.898+0000 7ff96dffb640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9600664d0 0x7ff960068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:05.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.898+0000 7ff96dffb640 1 -- 172.21.15.2:0/3210727971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff9780837e0 con 0x7ff97c06b840 2023-11-04T01:43:05.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.898+0000 7ff980c10640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9600664d0 0x7ff960068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:05.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.898+0000 7ff980c10640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9600664d0 0x7ff960068990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff9700ae000 tx=0x7ff9700b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:05.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:05.902+0000 7ff96dffb640 1 -- 172.21.15.2:0/3210727971 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff978050c30 con 0x7ff97c06b840 2023-11-04T01:43:06.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.062+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff97c151550 con 0x7ff97c06b840 2023-11-04T01:43:06.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff96dffb640 1 -- 172.21.15.2:0/3210727971 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff978054250 con 0x7ff97c06b840 2023-11-04T01:43:06.067 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9600664d0 msgr2=0x7ff960068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9600664d0 0x7ff960068990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff9700ae000 tx=0x7ff9700b5040 comp rx=0 tx=0).stop 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c06b840 msgr2=0x7ff97c0b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c06b840 0x7ff97c0b22a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff97800c430 tx=0x7ff97800c8f0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 shutdown_connections 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9600664d0 0x7ff960068990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff97c15d290 0x7ff97c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff97c0b0c20 0x7ff97c0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 --2- 172.21.15.2:0/3210727971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff97c06b840 0x7ff97c0b22a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 >> 172.21.15.2:0/3210727971 conn(0x7ff97c0cb510 msgr2=0x7ff97c0cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 shutdown_connections 2023-11-04T01:43:06.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.066+0000 7ff983675640 1 -- 172.21.15.2:0/3210727971 wait complete. 2023-11-04T01:43:06.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:06.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f936d932640 1 Processor -- start 2023-11-04T01:43:06.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f936d932640 1 -- start start 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f936d932640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f936815ccb0 0x7f93680ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f936d932640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f93680cdf00 0x7f93680cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f936d932640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680ccc30 con 0x7f936806ba90 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f936d932640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93680cda70 con 0x7f93680cdf00 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f936d932640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9368070af0 con 0x7f936815ccb0 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f93677fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f936806ba90 0x7f936815d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41096/0 (socket says 172.21.15.2:41096) 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f93677fe640 1 -- 172.21.15.2:0/1870804961 learned_addr learned my addr 172.21.15.2:0/1870804961 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:06.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f93667fc640 1 --2- 172.21.15.2:0/1870804961 >> v2:172.21.15.2:3300/0 conn(0x7f93680cdf00 0x7f93680cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f9366ffd640 1 --2- 172.21.15.2:0/1870804961 >> v2:172.21.15.90:3300/0 conn(0x7f936815ccb0 0x7f93680ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f9365ffb640 1 -- 172.21.15.2:0/1870804961 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271218095 0 0) 0x7f93680ccc30 con 0x7f936806ba90 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f9365ffb640 1 -- 172.21.15.2:0/1870804961 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9350003530 con 0x7f936806ba90 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f93667fc640 1 -- 172.21.15.2:0/1870804961 >> v2:172.21.15.90:3300/0 conn(0x7f936815ccb0 msgr2=0x7f93680ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f93667fc640 1 --2- 172.21.15.2:0/1870804961 >> v2:172.21.15.90:3300/0 conn(0x7f936815ccb0 0x7f93680ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f93667fc640 1 -- 172.21.15.2:0/1870804961 >> v1:172.21.15.2:6789/0 conn(0x7f936806ba90 legacy=0x7f936815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f93667fc640 1 -- 172.21.15.2:0/1870804961 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680cce60 con 0x7f93680cdf00 2023-11-04T01:43:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.206+0000 7f9366ffd640 1 --2- 172.21.15.2:0/1870804961 >> v2:172.21.15.90:3300/0 conn(0x7f936815ccb0 0x7f93680ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:06.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f93667fc640 1 --2- 172.21.15.2:0/1870804961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f93680cc6f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f936806de50 tx=0x7f9358020020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb32c6e918ac4e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f9365ffb640 1 -- 172.21.15.2:0/1870804961 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580a9e30 con 0x7f93680cdf00 2023-11-04T01:43:06.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f9365ffb640 1 -- 172.21.15.2:0/1870804961 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93580b1440 con 0x7f93680cdf00 2023-11-04T01:43:06.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f9365ffb640 1 -- 172.21.15.2:0/1870804961 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580b17d0 con 0x7f93680cdf00 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 -- 172.21.15.2:0/1870804961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 msgr2=0x7f93680cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 --2- 172.21.15.2:0/1870804961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f93680cc6f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f936806de50 tx=0x7f9358020020 comp rx=0 tx=0).stop 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 -- 172.21.15.2:0/1870804961 shutdown_connections 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 --2- 172.21.15.2:0/1870804961 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f93680cc6f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 --2- 172.21.15.2:0/1870804961 >> v2:172.21.15.90:3300/0 conn(0x7f936815ccb0 0x7f93680ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 -- 172.21.15.2:0/1870804961 >> 172.21.15.2:0/1870804961 conn(0x7f93680cebb0 msgr2=0x7f93680cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 -- 172.21.15.2:0/1870804961 shutdown_connections 2023-11-04T01:43:06.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 -- 172.21.15.2:0/1870804961 wait complete. 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 Processor -- start 2023-11-04T01:43:06.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.210+0000 7f936d932640 1 -- start start 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936806ba90 0x7f936814fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f936815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f936815ccb0 0x7f9368154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936813cda0 con 0x7f93680cdf00 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815bdc0 con 0x7f936806ba90 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936813d060 con 0x7f936815ccb0 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f936815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f936815b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44136/0 (socket says 172.21.15.2:44136) 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 -- 172.21.15.2:0/1689725266 learned_addr learned my addr 172.21.15.2:0/1689725266 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f9366ffd640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936806ba90 0x7f936814fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 -- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f936815ccb0 msgr2=0x7f9368154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f936815ccb0 0x7f9368154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 -- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936806ba90 msgr2=0x7f936814fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936806ba90 0x7f936814fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 -- 172.21.15.2:0/1689725266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935800a5c0 con 0x7f93680cdf00 2023-11-04T01:43:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f93667fc640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f936815b880 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f93580b4040 tx=0x7f935801cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f934ffff640 1 -- 172.21.15.2:0/1689725266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580ba840 con 0x7f93680cdf00 2023-11-04T01:43:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f934ffff640 1 -- 172.21.15.2:0/1689725266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93580ba9c0 con 0x7f93680cdf00 2023-11-04T01:43:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936813d340 con 0x7f93680cdf00 2023-11-04T01:43:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f934ffff640 1 -- 172.21.15.2:0/1689725266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580bad70 con 0x7f93680cdf00 2023-11-04T01:43:06.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f936813d900 con 0x7f93680cdf00 2023-11-04T01:43:06.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f934ffff640 1 -- 172.21.15.2:0/1689725266 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f93580b8040 con 0x7f93680cdf00 2023-11-04T01:43:06.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93680744a0 con 0x7f93680cdf00 2023-11-04T01:43:06.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f934ffff640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f93540664a0 0x7f9354068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f934ffff640 1 -- 172.21.15.2:0/1689725266 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f93581221c0 con 0x7f93680cdf00 2023-11-04T01:43:06.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.214+0000 7f9366ffd640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f93540664a0 0x7f9354068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.218+0000 7f9366ffd640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f93540664a0 0x7f9354068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f93680b44a0 tx=0x7f935c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.218+0000 7f934ffff640 1 -- 172.21.15.2:0/1689725266 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93580ef580 con 0x7f93680cdf00 2023-11-04T01:43:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.386+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f93680b4b30 con 0x7f93680cdf00 2023-11-04T01:43:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.386+0000 7f934ffff640 1 -- 172.21.15.2:0/1689725266 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f93580f2ba0 con 0x7f93680cdf00 2023-11-04T01:43:06.389 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f93540664a0 msgr2=0x7f9354068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f93540664a0 0x7f9354068960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f93680b44a0 tx=0x7f935c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 msgr2=0x7f936815b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f936815b880 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f93580b4040 tx=0x7f935801cdc0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 shutdown_connections 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f93540664a0 0x7f9354068960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f936815ccb0 0x7f9368154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93680cdf00 0x7f936815b880 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 --2- 172.21.15.2:0/1689725266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936806ba90 0x7f936814fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 >> 172.21.15.2:0/1689725266 conn(0x7f93680cebb0 msgr2=0x7f936806cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 shutdown_connections 2023-11-04T01:43:06.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.390+0000 7f936d932640 1 -- 172.21.15.2:0/1689725266 wait complete. 2023-11-04T01:43:06.409 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:06.409 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:06.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:06.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f1485bf9640 1 Processor -- start 2023-11-04T01:43:06.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f1485bf9640 1 -- start start 2023-11-04T01:43:06.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f1485bf9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1480159a50 0x7f14800cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f1485bf9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14800ce720 0x7f148006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f1485bf9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1480159e30 con 0x7f14800ce070 2023-11-04T01:43:06.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f1485bf9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800b0db0 con 0x7f14800ce720 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f1485bf9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14800ccfd0 con 0x7f1480159a50 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14800ce720 0x7f148006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14800ce720 0x7f148006ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44150/0 (socket says 172.21.15.2:44150) 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 -- 172.21.15.2:0/4028429198 learned_addr learned my addr 172.21.15.2:0/4028429198 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147f7fe640 1 --2- 172.21.15.2:0/4028429198 >> v2:172.21.15.90:3300/0 conn(0x7f1480159a50 0x7f14800cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 -- 172.21.15.2:0/4028429198 >> v2:172.21.15.90:3300/0 conn(0x7f1480159a50 msgr2=0x7f14800cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 --2- 172.21.15.2:0/4028429198 >> v2:172.21.15.90:3300/0 conn(0x7f1480159a50 0x7f14800cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 -- 172.21.15.2:0/4028429198 >> v1:172.21.15.90:6789/0 conn(0x7f14800ce070 legacy=0x7f14800b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 -- 172.21.15.2:0/4028429198 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800cd2b0 con 0x7f14800ce720 2023-11-04T01:43:06.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.542+0000 7f147effd640 1 --2- 172.21.15.2:0/4028429198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce720 0x7f148006ba90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f14800b1610 tx=0x7f146c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f04210d3428791 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147e7fc640 1 -- 172.21.15.2:0/4028429198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c0a89b0 con 0x7f14800ce720 2023-11-04T01:43:06.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147e7fc640 1 -- 172.21.15.2:0/4028429198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c0a8b10 con 0x7f14800ce720 2023-11-04T01:43:06.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147e7fc640 1 -- 172.21.15.2:0/4028429198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c0a8ea0 con 0x7f14800ce720 2023-11-04T01:43:06.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- 172.21.15.2:0/4028429198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce720 msgr2=0x7f148006ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 --2- 172.21.15.2:0/4028429198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce720 0x7f148006ba90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f14800b1610 tx=0x7f146c01ecb0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- 172.21.15.2:0/4028429198 shutdown_connections 2023-11-04T01:43:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 --2- 172.21.15.2:0/4028429198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce720 0x7f148006ba90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 --2- 172.21.15.2:0/4028429198 >> v2:172.21.15.90:3300/0 conn(0x7f1480159a50 0x7f14800cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- 172.21.15.2:0/4028429198 >> 172.21.15.2:0/4028429198 conn(0x7f14800cebb0 msgr2=0x7f14800cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- 172.21.15.2:0/4028429198 shutdown_connections 2023-11-04T01:43:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- 172.21.15.2:0/4028429198 wait complete. 2023-11-04T01:43:06.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 Processor -- start 2023-11-04T01:43:06.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- start start 2023-11-04T01:43:06.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce070 0x7f1480151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800ce720 0x7f14800c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1480159a50 0x7f148006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c7460 con 0x7f14800ce070 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c7740 con 0x7f14800ce720 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800c7a20 con 0x7f1480159a50 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce070 0x7f1480151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce070 0x7f1480151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44158/0 (socket says 172.21.15.2:44158) 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 -- 172.21.15.2:0/1633353455 learned_addr learned my addr 172.21.15.2:0/1633353455 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147effd640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800ce720 0x7f14800c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147ffff640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1480159a50 0x7f148006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 -- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1480159a50 msgr2=0x7f148006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1480159a50 0x7f148006ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 -- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800ce720 msgr2=0x7f14800c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800ce720 0x7f14800c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 -- 172.21.15.2:0/1633353455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c0094d0 con 0x7f14800ce070 2023-11-04T01:43:06.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f147f7fe640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce070 0x7f1480151060 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f147000d5f0 tx=0x7f147000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1477fff640 1 -- 172.21.15.2:0/1633353455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14700125f0 con 0x7f14800ce070 2023-11-04T01:43:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1477fff640 1 -- 172.21.15.2:0/1633353455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470012750 con 0x7f14800ce070 2023-11-04T01:43:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800c7d00 con 0x7f14800ce070 2023-11-04T01:43:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1477fff640 1 -- 172.21.15.2:0/1633353455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470012ae0 con 0x7f14800ce070 2023-11-04T01:43:06.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.546+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14801515a0 con 0x7f14800ce070 2023-11-04T01:43:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.550+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148006d2e0 con 0x7f14800ce070 2023-11-04T01:43:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.550+0000 7f1477fff640 1 -- 172.21.15.2:0/1633353455 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1470012c40 con 0x7f14800ce070 2023-11-04T01:43:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.550+0000 7f1477fff640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14680664a0 0x7f1468068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.550+0000 7f1477fff640 1 -- 172.21.15.2:0/1633353455 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1470084310 con 0x7f14800ce070 2023-11-04T01:43:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.550+0000 7f147effd640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14680664a0 0x7f1468068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.550+0000 7f147effd640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14680664a0 0x7f1468068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f146c0b2000 tx=0x7f146c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.554+0000 7f1477fff640 1 -- 172.21.15.2:0/1633353455 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1470051800 con 0x7f14800ce070 2023-11-04T01:43:06.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.710+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14800744a0 con 0x7f14800ce070 2023-11-04T01:43:06.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1477fff640 1 -- 172.21.15.2:0/1633353455 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7f1470054e20 con 0x7f14800ce070 2023-11-04T01:43:06.715 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:06.715 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14680664a0 msgr2=0x7f1468068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14680664a0 0x7f1468068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f146c0b2000 tx=0x7f146c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce070 msgr2=0x7f1480151060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce070 0x7f1480151060 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f147000d5f0 tx=0x7f147000dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 shutdown_connections 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14680664a0 0x7f1468068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1480159a50 0x7f148006ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14800ce720 0x7f14800c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 --2- 172.21.15.2:0/1633353455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14800ce070 0x7f1480151060 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 >> 172.21.15.2:0/1633353455 conn(0x7f14800cebb0 msgr2=0x7f14800cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 shutdown_connections 2023-11-04T01:43:06.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.714+0000 7f1485bf9640 1 -- 172.21.15.2:0/1633353455 wait complete. 2023-11-04T01:43:06.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:06.735 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.858+0000 7f6ea185a640 1 Processor -- start 2023-11-04T01:43:06.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.858+0000 7f6ea185a640 1 -- start start 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.858+0000 7f6ea185a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6e9c06cfc0 0x7f6e9c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.858+0000 7f6ea185a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c160c50 con 0x7f6e9c0cd670 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.858+0000 7f6ea185a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c160ef0 con 0x7f6e9c0cda50 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.858+0000 7f6ea185a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c1611d0 con 0x7f6e9c06cfc0 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6e9c0cd670 0x7f6e9c0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41098/0 (socket says 172.21.15.2:41098) 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 -- 172.21.15.2:0/2143629905 learned_addr learned my addr 172.21.15.2:0/2143629905 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9a7fc640 1 --2- 172.21.15.2:0/2143629905 >> v2:172.21.15.90:3300/0 conn(0x7f6e9c06cfc0 0x7f6e9c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640555918 0 0) 0x7f6e9c160c50 con 0x7f6e9c0cd670 2023-11-04T01:43:06.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e84003530 con 0x7f6e9c0cd670 2023-11-04T01:43:06.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811105845 0 0) 0x7f6e84003530 con 0x7f6e9c0cd670 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 >> v2:172.21.15.90:3300/0 conn(0x7f6e9c06cfc0 msgr2=0x7f6e9c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 --2- 172.21.15.2:0/2143629905 >> v2:172.21.15.90:3300/0 conn(0x7f6e9c06cfc0 0x7f6e9c15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 >> v1:172.21.15.90:6789/0 conn(0x7f6e9c0cda50 legacy=0x7f6e9c0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c1614b0 con 0x7f6e9c0cd670 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f6e8c0050a0 con 0x7f6e9c0cd670 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 >> v1:172.21.15.2:6789/0 conn(0x7f6e9c0cd670 legacy=0x7f6e9c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e84003980 0x7f6e84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e840047d0 0x7f6e84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e84005190 0x7f6e8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c1611d0 con 0x7f6e84003980 2023-11-04T01:43:06.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8400c030 con 0x7f6e84005190 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8400c1f0 con 0x7f6e840047d0 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e84003980 0x7f6e84003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9b7fe640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e84005190 0x7f6e8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 -- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e840047d0 msgr2=0x7f6e84004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e840047d0 0x7f6e84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 -- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e84005190 msgr2=0x7f6e8400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e84005190 0x7f6e8400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 -- 172.21.15.2:0/2143629905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84003530 con 0x7f6e84003980 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9b7fe640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e84005190 0x7f6e8400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:06.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9b7fe640 1 -- 172.21.15.2:0/2143629905 reap_dead start 2023-11-04T01:43:06.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e9affd640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e84003980 0x7f6e84003da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c240 tx=0x7f6e8c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec01c55b20846186 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c005ae0 con 0x7f6e84003980 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8c005c40 con 0x7f6e84003980 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.862+0000 7f6e99ffb640 1 -- 172.21.15.2:0/2143629905 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c0a5a20 con 0x7f6e84003980 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- 172.21.15.2:0/2143629905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e84003980 msgr2=0x7f6e84003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e84003980 0x7f6e84003da0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00c240 tx=0x7f6e8c01cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- 172.21.15.2:0/2143629905 shutdown_connections 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 --2- 172.21.15.2:0/2143629905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e84003980 0x7f6e84003da0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- 172.21.15.2:0/2143629905 >> 172.21.15.2:0/2143629905 conn(0x7f6e9c065dc0 msgr2=0x7f6e9c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- 172.21.15.2:0/2143629905 shutdown_connections 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- 172.21.15.2:0/2143629905 wait complete. 2023-11-04T01:43:06.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 Processor -- start 2023-11-04T01:43:06.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- start start 2023-11-04T01:43:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e84003980 0x7f6e9c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e9c0b6000 0x7f6e9c1f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c157b30 0x7f6e9c0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0c8100 con 0x7f6e9c0b6000 2023-11-04T01:43:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0b67a0 con 0x7f6e9c157b30 2023-11-04T01:43:06.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c1f6c80 con 0x7f6e84003980 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e9c0b6000 0x7f6e9c1f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e9c0b6000 0x7f6e9c1f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44184/0 (socket says 172.21.15.2:44184) 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 -- 172.21.15.2:0/3271096112 learned_addr learned my addr 172.21.15.2:0/3271096112 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9affd640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e84003980 0x7f6e9c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9b7fe640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c157b30 0x7f6e9c0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 -- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e84003980 msgr2=0x7f6e9c0adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e84003980 0x7f6e9c0adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 -- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c157b30 msgr2=0x7f6e9c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c157b30 0x7f6e9c0c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 -- 172.21.15.2:0/3271096112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0b64c0 con 0x7f6e9c0b6000 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e9a7fc640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e9c0b6000 0x7f6e9c1f6740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000e7f0 tx=0x7f6e9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e83fff640 1 -- 172.21.15.2:0/3271096112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000c940 con 0x7f6e9c0b6000 2023-11-04T01:43:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e83fff640 1 -- 172.21.15.2:0/3271096112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000caa0 con 0x7f6e9c0b6000 2023-11-04T01:43:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c0b0e20 con 0x7f6e9c0b6000 2023-11-04T01:43:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6e83fff640 1 -- 172.21.15.2:0/3271096112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000ce30 con 0x7f6e9c0b6000 2023-11-04T01:43:06.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.866+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c0b13e0 con 0x7f6e9c0b6000 2023-11-04T01:43:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.870+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9c0675f0 con 0x7f6e9c0b6000 2023-11-04T01:43:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.870+0000 7f6e83fff640 1 -- 172.21.15.2:0/3271096112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6e90013470 con 0x7f6e9c0b6000 2023-11-04T01:43:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.870+0000 7f6e83fff640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6e880664a0 0x7f6e88068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.870+0000 7f6e83fff640 1 -- 172.21.15.2:0/3271096112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6e90083ed0 con 0x7f6e9c0b6000 2023-11-04T01:43:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.870+0000 7f6e9affd640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6e880664a0 0x7f6e88068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:06.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.870+0000 7f6e9affd640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6e880664a0 0x7f6e88068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0ab000 tx=0x7f6e8c0b1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:06.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:06.874+0000 7f6e83fff640 1 -- 172.21.15.2:0/3271096112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6e900513c0 con 0x7f6e9c0b6000 2023-11-04T01:43:07.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.030+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e9c0661a0 con 0x7f6e9c0b6000 2023-11-04T01:43:07.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.030+0000 7f6e83fff640 1 -- 172.21.15.2:0/3271096112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e90017020 con 0x7f6e9c0b6000 2023-11-04T01:43:07.034 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:07.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6e880664a0 msgr2=0x7f6e88068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6e880664a0 0x7f6e88068960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0ab000 tx=0x7f6e8c0b1040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e9c0b6000 msgr2=0x7f6e9c1f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e9c0b6000 0x7f6e9c1f6740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000e7f0 tx=0x7f6e9000ecb0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 shutdown_connections 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6e880664a0 0x7f6e88068960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e9c157b30 0x7f6e9c0c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e9c0b6000 0x7f6e9c1f6740 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 --2- 172.21.15.2:0/3271096112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6e84003980 0x7f6e9c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 >> 172.21.15.2:0/3271096112 conn(0x7f6e9c065dc0 msgr2=0x7f6e9c15c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 shutdown_connections 2023-11-04T01:43:07.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.034+0000 7f6ea185a640 1 -- 172.21.15.2:0/3271096112 wait complete. 2023-11-04T01:43:07.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:07.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82c6195640 1 Processor -- start 2023-11-04T01:43:07.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82c6195640 1 -- start start 2023-11-04T01:43:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82c6195640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82c015d290 0x7f82c00b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82c6195640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c006b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82c6195640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c00b0eb0 con 0x7f82c006b840 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82c6195640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c0161cc0 con 0x7f82c015d290 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82c6195640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00c90e0 con 0x7f82c00b0a50 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82bf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82c015d290 0x7f82c00b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82bf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82c015d290 0x7f82c00b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44200/0 (socket says 172.21.15.2:44200) 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82bf7fe640 1 -- 172.21.15.2:0/2128482388 learned_addr learned my addr 172.21.15.2:0/2128482388 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82beffd640 1 --2- 172.21.15.2:0/2128482388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82bf7fe640 1 -- 172.21.15.2:0/2128482388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 msgr2=0x7f82c006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82bf7fe640 1 --2- 172.21.15.2:0/2128482388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c006b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82bf7fe640 1 -- 172.21.15.2:0/2128482388 >> v1:172.21.15.90:6789/0 conn(0x7f82c006b840 legacy=0x7f82c00cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.170+0000 7f82bf7fe640 1 -- 172.21.15.2:0/2128482388 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c006c010 con 0x7f82c015d290 2023-11-04T01:43:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 --2- 172.21.15.2:0/2128482388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c015d290 0x7f82c00b0510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009870 tx=0x7f82b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e5f0cd56b3251a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82be7fc640 1 -- 172.21.15.2:0/2128482388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40ac410 con 0x7f82c015d290 2023-11-04T01:43:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82be7fc640 1 -- 172.21.15.2:0/2128482388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b40ac570 con 0x7f82c015d290 2023-11-04T01:43:07.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82be7fc640 1 -- 172.21.15.2:0/2128482388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40ac900 con 0x7f82c015d290 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- 172.21.15.2:0/2128482388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c015d290 msgr2=0x7f82c00b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 --2- 172.21.15.2:0/2128482388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c015d290 0x7f82c00b0510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009870 tx=0x7f82b401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- 172.21.15.2:0/2128482388 shutdown_connections 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 --2- 172.21.15.2:0/2128482388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 --2- 172.21.15.2:0/2128482388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c015d290 0x7f82c00b0510 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- 172.21.15.2:0/2128482388 >> 172.21.15.2:0/2128482388 conn(0x7f82c00cb510 msgr2=0x7f82c00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- 172.21.15.2:0/2128482388 shutdown_connections 2023-11-04T01:43:07.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- 172.21.15.2:0/2128482388 wait complete. 2023-11-04T01:43:07.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 Processor -- start 2023-11-04T01:43:07.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- start start 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c006b840 0x7f82c01494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c00b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c015d290 0x7f82c01529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00aeff0 con 0x7f82c006b840 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00afb70 con 0x7f82c015d290 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82c6195640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c00af240 con 0x7f82c00b0a50 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c006b840 0x7f82c01494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c006b840 0x7f82c01494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44216/0 (socket says 172.21.15.2:44216) 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 -- 172.21.15.2:0/605496922 learned_addr learned my addr 172.21.15.2:0/605496922 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bffff640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c015d290 0x7f82c01529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82beffd640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c00b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 -- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 msgr2=0x7f82c00b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c00b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 -- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c015d290 msgr2=0x7f82c01529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c015d290 0x7f82c01529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 -- 172.21.15.2:0/605496922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40094d0 con 0x7f82c006b840 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bffff640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c015d290 0x7f82c01529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.174+0000 7f82bf7fe640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c006b840 0x7f82c01494a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82b401ab80 tx=0x7f82b4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82a7fff640 1 -- 172.21.15.2:0/605496922 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40ac410 con 0x7f82c006b840 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82a7fff640 1 -- 172.21.15.2:0/605496922 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b40b65f0 con 0x7f82c006b840 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c00af520 con 0x7f82c006b840 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82a7fff640 1 -- 172.21.15.2:0/605496922 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40b69a0 con 0x7f82c006b840 2023-11-04T01:43:07.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c0149c00 con 0x7f82c006b840 2023-11-04T01:43:07.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c00744a0 con 0x7f82c006b840 2023-11-04T01:43:07.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82a7fff640 1 -- 172.21.15.2:0/605496922 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82b40b6b00 con 0x7f82c006b840 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82a7fff640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82ac0664a0 0x7f82ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82a7fff640 1 -- 172.21.15.2:0/605496922 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f82b411e750 con 0x7f82c006b840 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82beffd640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82ac0664a0 0x7f82ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.178+0000 7f82beffd640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82ac0664a0 0x7f82ac068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f82c00b4580 tx=0x7f82b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.182+0000 7f82a7fff640 1 -- 172.21.15.2:0/605496922 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82b40ebd60 con 0x7f82c006b840 2023-11-04T01:43:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.330+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82c00ade30 con 0x7f82c006b840 2023-11-04T01:43:07.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.330+0000 7f82a7fff640 1 -- 172.21.15.2:0/605496922 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f82b40b1020 con 0x7f82c006b840 2023-11-04T01:43:07.333 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82ac0664a0 msgr2=0x7f82ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82ac0664a0 0x7f82ac068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f82c00b4580 tx=0x7f82b0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c006b840 msgr2=0x7f82c01494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c006b840 0x7f82c01494a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f82b401ab80 tx=0x7f82b4019270 comp rx=0 tx=0).stop 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 shutdown_connections 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82ac0664a0 0x7f82ac068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82c015d290 0x7f82c01529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82c00b0a50 0x7f82c00b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 --2- 172.21.15.2:0/605496922 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82c006b840 0x7f82c01494a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 >> 172.21.15.2:0/605496922 conn(0x7f82c00cb510 msgr2=0x7f82c00cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 shutdown_connections 2023-11-04T01:43:07.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.334+0000 7f82c6195640 1 -- 172.21.15.2:0/605496922 wait complete. 2023-11-04T01:43:07.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:07.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 Processor -- start 2023-11-04T01:43:07.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 -- start start 2023-11-04T01:43:07.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fda1c1438e0 0x7fda1c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c146510 0x7fda1c06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda1c06a6a0 0x7fda1c070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c06ab30 con 0x7fda1c06a6a0 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c161760 con 0x7fda1c1438e0 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda22c3d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c161a40 con 0x7fda1c146510 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda1c06a6a0 0x7fda1c070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fda1c06a6a0 0x7fda1c070b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44224/0 (socket says 172.21.15.2:44224) 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 -- 172.21.15.2:0/153470666 learned_addr learned my addr 172.21.15.2:0/153470666 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda209d9640 1 --2- 172.21.15.2:0/153470666 >> v2:172.21.15.90:3300/0 conn(0x7fda1c1438e0 0x7fda1c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda13fff640 1 --2- 172.21.15.2:0/153470666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c146510 0x7fda1c06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 -- 172.21.15.2:0/153470666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c146510 msgr2=0x7fda1c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 --2- 172.21.15.2:0/153470666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c146510 0x7fda1c06a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 -- 172.21.15.2:0/153470666 >> v2:172.21.15.90:3300/0 conn(0x7fda1c1438e0 msgr2=0x7fda1c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 --2- 172.21.15.2:0/153470666 >> v2:172.21.15.90:3300/0 conn(0x7fda1c1438e0 0x7fda1c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda211da640 1 -- 172.21.15.2:0/153470666 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0d0790 con 0x7fda1c06a6a0 2023-11-04T01:43:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.474+0000 7fda209d9640 1 --2- 172.21.15.2:0/153470666 >> v2:172.21.15.90:3300/0 conn(0x7fda1c1438e0 0x7fda1c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 --2- 172.21.15.2:0/153470666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c06a6a0 0x7fda1c070b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0701f0 tx=0x7fda1401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b782e129050fda47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda137fe640 1 -- 172.21.15.2:0/153470666 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140a9410 con 0x7fda1c06a6a0 2023-11-04T01:43:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda137fe640 1 -- 172.21.15.2:0/153470666 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda140a9570 con 0x7fda1c06a6a0 2023-11-04T01:43:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda137fe640 1 -- 172.21.15.2:0/153470666 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140a9900 con 0x7fda1c06a6a0 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- 172.21.15.2:0/153470666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c06a6a0 msgr2=0x7fda1c070b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 --2- 172.21.15.2:0/153470666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c06a6a0 0x7fda1c070b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0701f0 tx=0x7fda1401c680 comp rx=0 tx=0).stop 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- 172.21.15.2:0/153470666 shutdown_connections 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 --2- 172.21.15.2:0/153470666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c06a6a0 0x7fda1c070b40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 --2- 172.21.15.2:0/153470666 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c146510 0x7fda1c06a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 --2- 172.21.15.2:0/153470666 >> v2:172.21.15.90:3300/0 conn(0x7fda1c1438e0 0x7fda1c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- 172.21.15.2:0/153470666 >> 172.21.15.2:0/153470666 conn(0x7fda1c0cfc70 msgr2=0x7fda1c0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- 172.21.15.2:0/153470666 shutdown_connections 2023-11-04T01:43:07.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- 172.21.15.2:0/153470666 wait complete. 2023-11-04T01:43:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 Processor -- start 2023-11-04T01:43:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- start start 2023-11-04T01:43:07.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda1c06a6a0 0x7fda1c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c1438e0 0x7fda1c0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c146510 0x7fda1c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0b3ca0 con 0x7fda1c146510 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c15b780 con 0x7fda1c06a6a0 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c15ba60 con 0x7fda1c1438e0 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c146510 0x7fda1c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c146510 0x7fda1c06d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44232/0 (socket says 172.21.15.2:44232) 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 -- 172.21.15.2:0/903990443 learned_addr learned my addr 172.21.15.2:0/903990443 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda209d9640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda1c06a6a0 0x7fda1c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda13fff640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c1438e0 0x7fda1c0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 -- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c1438e0 msgr2=0x7fda1c0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c1438e0 0x7fda1c0b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 -- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda1c06a6a0 msgr2=0x7fda1c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda1c06a6a0 0x7fda1c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 -- 172.21.15.2:0/903990443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda14009b30 con 0x7fda1c146510 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda211da640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c146510 0x7fda1c06d760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fda140ab040 tx=0x7fda14019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda117fa640 1 -- 172.21.15.2:0/903990443 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140a98e0 con 0x7fda1c146510 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda117fa640 1 -- 172.21.15.2:0/903990443 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda140b6070 con 0x7fda1c146510 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c15bd40 con 0x7fda1c146510 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda117fa640 1 -- 172.21.15.2:0/903990443 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140a9c60 con 0x7fda1c146510 2023-11-04T01:43:07.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.478+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c15c300 con 0x7fda1c146510 2023-11-04T01:43:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.482+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c15c4f0 con 0x7fda1c146510 2023-11-04T01:43:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.482+0000 7fda117fa640 1 -- 172.21.15.2:0/903990443 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda140b23f0 con 0x7fda1c146510 2023-11-04T01:43:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.482+0000 7fda117fa640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fda080664a0 0x7fda08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.482+0000 7fda117fa640 1 -- 172.21.15.2:0/903990443 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fda1411e510 con 0x7fda1c146510 2023-11-04T01:43:07.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.482+0000 7fda209d9640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fda080664a0 0x7fda08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.482+0000 7fda209d9640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fda080664a0 0x7fda08068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda1c15b4b0 tx=0x7fda18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.486+0000 7fda117fa640 1 -- 172.21.15.2:0/903990443 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda140eb950 con 0x7fda1c146510 2023-11-04T01:43:07.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.642+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda1c0675f0 con 0x7fda1c146510 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda117fa640 1 -- 172.21.15.2:0/903990443 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda140b80a0 con 0x7fda1c146510 2023-11-04T01:43:07.646 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fda080664a0 msgr2=0x7fda08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fda080664a0 0x7fda08068960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda1c15b4b0 tx=0x7fda18008040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c146510 msgr2=0x7fda1c06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c146510 0x7fda1c06d760 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fda140ab040 tx=0x7fda14019420 comp rx=0 tx=0).stop 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 shutdown_connections 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fda080664a0 0x7fda08068960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda1c146510 0x7fda1c06d760 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fda1c1438e0 0x7fda1c0b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 --2- 172.21.15.2:0/903990443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda1c06a6a0 0x7fda1c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 >> 172.21.15.2:0/903990443 conn(0x7fda1c0cfc70 msgr2=0x7fda1c143dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 shutdown_connections 2023-11-04T01:43:07.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.646+0000 7fda22c3d640 1 -- 172.21.15.2:0/903990443 wait complete. 2023-11-04T01:43:07.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e230d640 1 Processor -- start 2023-11-04T01:43:07.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e230d640 1 -- start start 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e230d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 0x7fc5dc166170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e230d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc06c740 con 0x7fc5dc0c2670 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e230d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5dc15b670 con 0x7fc5dc15b290 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e230d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc06bb30 con 0x7fc5dc0b0d40 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5db7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc5dc0c2670 0x7fc5dc0b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41106/0 (socket says 172.21.15.2:41106) 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5db7fe640 1 -- 172.21.15.2:0/1831871565 learned_addr learned my addr 172.21.15.2:0/1831871565 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339506714 0 0) 0x7fc5dc06c740 con 0x7fc5dc0c2670 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c4003530 con 0x7fc5dc0c2670 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e08aa640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 0x7fc5dc166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645337716 0 0) 0x7fc5c4003530 con 0x7fc5dc0c2670 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 msgr2=0x7fc5dc166170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 0x7fc5dc166170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 >> v1:172.21.15.90:6789/0 conn(0x7fc5dc15b290 legacy=0x7fc5dc06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc06be10 con 0x7fc5dc0c2670 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc5d0001680 con 0x7fc5dc0c2670 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 >> v1:172.21.15.2:6789/0 conn(0x7fc5dc0c2670 legacy=0x7fc5dc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 0x7fc5c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c4004030 0x7fc5c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5c4004d10 0x7fc5c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc06bb30 con 0x7fc5c4004d10 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c400bc70 con 0x7fc5c4004030 2023-11-04T01:43:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c400be30 con 0x7fc5dc0b0d40 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e08aa640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5c4004d10 0x7fc5c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5dbfff640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 0x7fc5c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5db7fe640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c4004030 0x7fc5c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e08aa640 1 -- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 msgr2=0x7fc5c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e08aa640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5dc0b0d40 0x7fc5c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e08aa640 1 -- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c4004030 msgr2=0x7fc5c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e08aa640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5c4004030 0x7fc5c40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.778+0000 7fc5e08aa640 1 -- 172.21.15.2:0/1831871565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4003530 con 0x7fc5c4004d10 2023-11-04T01:43:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e08aa640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5c4004d10 0x7fc5c4005190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4007330 tx=0x7fc5d401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99143b389a297065 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40a5d00 con 0x7fc5c4004d10 2023-11-04T01:43:07.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40a5e60 con 0x7fc5c4004d10 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5daffd640 1 -- 172.21.15.2:0/1831871565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40ad660 con 0x7fc5c4004d10 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- 172.21.15.2:0/1831871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5c4004d10 msgr2=0x7fc5c4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 --2- 172.21.15.2:0/1831871565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5c4004d10 0x7fc5c4005190 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4007330 tx=0x7fc5d401ce00 comp rx=0 tx=0).stop 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e08aa640 1 -- 172.21.15.2:0/1831871565 reap_dead start 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- 172.21.15.2:0/1831871565 shutdown_connections 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- 172.21.15.2:0/1831871565 >> 172.21.15.2:0/1831871565 conn(0x7fc5dc0cebb0 msgr2=0x7fc5dc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- 172.21.15.2:0/1831871565 shutdown_connections 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- 172.21.15.2:0/1831871565 wait complete. 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 Processor -- start 2023-11-04T01:43:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- start start 2023-11-04T01:43:07.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5c4004d10 0x7fc5dc0c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5dc1f1380 0x7fc5dc0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5dc1f1800 0x7fc5dc0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc143a30 con 0x7fc5dc1f1380 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc0c1dc0 con 0x7fc5dc1f1800 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5e230d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc142db0 con 0x7fc5c4004d10 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5dc1f1380 0x7fc5dc0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5db7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5dc1f1380 0x7fc5dc0b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44262/0 (socket says 172.21.15.2:44262) 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.782+0000 7fc5db7fe640 1 -- 172.21.15.2:0/3264638276 learned_addr learned my addr 172.21.15.2:0/3264638276 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5dbfff640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5c4004d10 0x7fc5dc0c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5e08aa640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5dc1f1800 0x7fc5dc0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5db7fe640 1 -- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5c4004d10 msgr2=0x7fc5dc0c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5db7fe640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5c4004d10 0x7fc5dc0c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5db7fe640 1 -- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5dc1f1800 msgr2=0x7fc5dc0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5db7fe640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5dc1f1800 0x7fc5dc0b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5db7fe640 1 -- 172.21.15.2:0/3264638276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc143090 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5db7fe640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5dc1f1380 0x7fc5dc0b3190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0010cc0 tx=0x7fc5d000e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5d8ff9640 1 -- 172.21.15.2:0/3264638276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d00143a0 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5d8ff9640 1 -- 172.21.15.2:0/3264638276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d0014500 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc143370 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5d8ff9640 1 -- 172.21.15.2:0/3264638276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0014870 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc1f0dc0 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc143b70 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5d8ff9640 1 -- 172.21.15.2:0/3264638276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5d00149d0 con 0x7fc5dc1f1380 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5d8ff9640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5c80664d0 0x7fc5c8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:07.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5d8ff9640 1 -- 172.21.15.2:0/3264638276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc5d0086f40 con 0x7fc5dc1f1380 2023-11-04T01:43:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5dbfff640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5c80664d0 0x7fc5c8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:07.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.786+0000 7fc5dbfff640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5c80664d0 0x7fc5c8068990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc157740 tx=0x7fc5cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.790+0000 7fc5d8ff9640 1 -- 172.21.15.2:0/3264638276 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5dc143b70 con 0x7fc5dc1f1380 2023-11-04T01:43:07.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.962+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc5dc143b70 con 0x7fc5dc1f1380 2023-11-04T01:43:07.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.962+0000 7fc5d8ff9640 1 -- 172.21.15.2:0/3264638276 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc5dc143b70 con 0x7fc5dc1f1380 2023-11-04T01:43:07.965 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:07.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5c80664d0 msgr2=0x7fc5c8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5c80664d0 0x7fc5c8068990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc157740 tx=0x7fc5cc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:07.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5dc1f1380 msgr2=0x7fc5dc0b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:07.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5dc1f1380 0x7fc5dc0b3190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0010cc0 tx=0x7fc5d000e4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 shutdown_connections 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5c80664d0 0x7fc5c8068990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5dc1f1800 0x7fc5dc0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5dc1f1380 0x7fc5dc0b3190 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 --2- 172.21.15.2:0/3264638276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5c4004d10 0x7fc5dc0c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 >> 172.21.15.2:0/3264638276 conn(0x7fc5dc0cebb0 msgr2=0x7fc5dc0c4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 shutdown_connections 2023-11-04T01:43:07.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:07.966+0000 7fc5e230d640 1 -- 172.21.15.2:0/3264638276 wait complete. 2023-11-04T01:43:07.983 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2023-11-04T01:43:07.983 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:07.983 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-04T01:43:08.045 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:43:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:08.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi090.stderr:ceph-fuse[43526]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:08.046 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:08.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi090.stderr:2023-11-04T01:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:08.055 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:08.062 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:43:08.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:08.062 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:43:08.121 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:08.121 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:08.127 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:08.127 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:08.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:08.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:2023-11-04T01:43:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1164bd2640 1 Processor -- start 2023-11-04T01:43:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1164bd2640 1 -- start start 2023-11-04T01:43:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1164bd2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11600b0d40 0x7f1160166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1164bd2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11600c2670 con 0x7f11600715d0 2023-11-04T01:43:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1164bd2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f116006bc30 con 0x7f116015afd0 2023-11-04T01:43:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1164bd2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1160070140 con 0x7f11600b0d40 2023-11-04T01:43:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f115ed9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11600b0d40 0x7f1160166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1157fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f11600715d0 0x7f11600b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41108/0 (socket says 172.21.15.2:41108) 2023-11-04T01:43:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f1157fff640 1 -- 172.21.15.2:0/3078083145 learned_addr learned my addr 172.21.15.2:0/3078083145 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f115ed9d640 1 -- 172.21.15.2:0/3078083145 >> v1:172.21.15.90:6789/0 conn(0x7f116015afd0 legacy=0x7f116006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.346+0000 7f115ed9d640 1 -- 172.21.15.2:0/3078083145 >> v1:172.21.15.2:6789/0 conn(0x7f11600715d0 legacy=0x7f11600b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f115ed9d640 1 -- 172.21.15.2:0/3078083145 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116006bf10 con 0x7f11600b0d40 2023-11-04T01:43:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f115dd9b640 1 -- 172.21.15.2:0/3078083145 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693993049 0 0) 0x7f11600c2670 con 0x7f11600715d0 2023-11-04T01:43:08.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f115ed9d640 1 --2- 172.21.15.2:0/3078083145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11600b0d40 0x7f1160166010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1158009d90 tx=0x7f115801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5ef8e658d5a8ac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f115dd9b640 1 -- 172.21.15.2:0/3078083145 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580a57d0 con 0x7f11600b0d40 2023-11-04T01:43:08.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f115dd9b640 1 -- 172.21.15.2:0/3078083145 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580a5930 con 0x7f11600b0d40 2023-11-04T01:43:08.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f115dd9b640 1 -- 172.21.15.2:0/3078083145 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580a5cc0 con 0x7f11600b0d40 2023-11-04T01:43:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f1164bd2640 1 -- 172.21.15.2:0/3078083145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11600b0d40 msgr2=0x7f1160166010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f1164bd2640 1 --2- 172.21.15.2:0/3078083145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11600b0d40 0x7f1160166010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1158009d90 tx=0x7f115801c910 comp rx=0 tx=0).stop 2023-11-04T01:43:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f1164bd2640 1 -- 172.21.15.2:0/3078083145 shutdown_connections 2023-11-04T01:43:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f1164bd2640 1 --2- 172.21.15.2:0/3078083145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11600b0d40 0x7f1160166010 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f1164bd2640 1 -- 172.21.15.2:0/3078083145 >> 172.21.15.2:0/3078083145 conn(0x7f11600cebb0 msgr2=0x7f11600cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f1164bd2640 1 -- 172.21.15.2:0/3078083145 shutdown_connections 2023-11-04T01:43:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.350+0000 7f1164bd2640 1 -- 172.21.15.2:0/3078083145 wait complete. 2023-11-04T01:43:08.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 Processor -- start 2023-11-04T01:43:08.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 -- start start 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11600715d0 0x7f1160151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11600b0d40 0x7f1160155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116015afd0 0x7f11600af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116015fc90 con 0x7f116015afd0 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11601655c0 con 0x7f11600715d0 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11600b1dc0 con 0x7f11600b0d40 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116015afd0 0x7f11600af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116015afd0 0x7f11600af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44288/0 (socket says 172.21.15.2:44288) 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 -- 172.21.15.2:0/630081682 learned_addr learned my addr 172.21.15.2:0/630081682 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115e59c640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11600715d0 0x7f1160151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1157fff640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11600b0d40 0x7f1160155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 -- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11600b0d40 msgr2=0x7f1160155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11600b0d40 0x7f1160155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 -- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11600715d0 msgr2=0x7f1160151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11600715d0 0x7f1160151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 -- 172.21.15.2:0/630081682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158009a70 con 0x7f116015afd0 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1157fff640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11600b0d40 0x7f1160155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f115ed9d640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116015afd0 0x7f11600af530 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f11580b0040 tx=0x7f11580196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1156ffd640 1 -- 172.21.15.2:0/630081682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580ad850 con 0x7f116015afd0 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1156ffd640 1 -- 172.21.15.2:0/630081682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11580ad9b0 con 0x7f116015afd0 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1160164f90 con 0x7f116015afd0 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1156ffd640 1 -- 172.21.15.2:0/630081682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11580add60 con 0x7f116015afd0 2023-11-04T01:43:08.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11600b1ae0 con 0x7f116015afd0 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.354+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11600ce0f0 con 0x7f116015afd0 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.358+0000 7f1156ffd640 1 -- 172.21.15.2:0/630081682 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11580b4050 con 0x7f116015afd0 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.358+0000 7f1156ffd640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11400664a0 0x7f1140068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.358+0000 7f1156ffd640 1 -- 172.21.15.2:0/630081682 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f115811ee50 con 0x7f116015afd0 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.358+0000 7f115e59c640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11400664a0 0x7f1140068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.358+0000 7f115e59c640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11400664a0 0x7f1140068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1160164f20 tx=0x7f1148008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.362+0000 7f1156ffd640 1 -- 172.21.15.2:0/630081682 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11600ce0f0 con 0x7f116015afd0 2023-11-04T01:43:08.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11600ce0f0 con 0x7f116015afd0 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1156ffd640 1 -- 172.21.15.2:0/630081682 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7f11600ce0f0 con 0x7f116015afd0 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:08.516 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11400664a0 msgr2=0x7f1140068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11400664a0 0x7f1140068960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1160164f20 tx=0x7f1148008040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116015afd0 msgr2=0x7f11600af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116015afd0 0x7f11600af530 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f11580b0040 tx=0x7f11580196b0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 shutdown_connections 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11400664a0 0x7f1140068960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f116015afd0 0x7f11600af530 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11600b0d40 0x7f1160155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 --2- 172.21.15.2:0/630081682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11600715d0 0x7f1160151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.514+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 >> 172.21.15.2:0/630081682 conn(0x7f11600cebb0 msgr2=0x7f11600cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.518+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 shutdown_connections 2023-11-04T01:43:08.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.518+0000 7f1164bd2640 1 -- 172.21.15.2:0/630081682 wait complete. 2023-11-04T01:43:08.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:08.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd47400f640 1 Processor -- start 2023-11-04T01:43:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd47400f640 1 -- start start 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd47400f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd46c0b0c20 0x7fd46c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd47400f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c0cb130 con 0x7fd46c15c160 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd47400f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c15b680 con 0x7fd46c15acb0 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd47400f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c15bd40 con 0x7fd46c0b0c20 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd4725ac640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd46c15c160 0x7fd46c0ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41118/0 (socket says 172.21.15.2:41118) 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd4725ac640 1 -- 172.21.15.2:0/3076834042 learned_addr learned my addr 172.21.15.2:0/3076834042 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd4715aa640 1 --2- 172.21.15.2:0/3076834042 >> v2:172.21.15.90:3300/0 conn(0x7fd46c0b0c20 0x7fd46c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302999492 0 0) 0x7fd46c0cb130 con 0x7fd46c15c160 2023-11-04T01:43:08.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd458003530 con 0x7fd46c15c160 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419334067 0 0) 0x7fd458003530 con 0x7fd46c15c160 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 >> v2:172.21.15.90:3300/0 conn(0x7fd46c0b0c20 msgr2=0x7fd46c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 --2- 172.21.15.2:0/3076834042 >> v2:172.21.15.90:3300/0 conn(0x7fd46c0b0c20 0x7fd46c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 >> v1:172.21.15.90:6789/0 conn(0x7fd46c15acb0 legacy=0x7fd46c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c15b960 con 0x7fd46c15c160 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fd464001a00 con 0x7fd46c15c160 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 >> v1:172.21.15.2:6789/0 conn(0x7fd46c15c160 legacy=0x7fd46c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd458003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4580047d0 0x7fd458004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd458005190 0x7fd45800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c15bd40 con 0x7fd458003980 2023-11-04T01:43:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45800c030 con 0x7fd458005190 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45800c1f0 con 0x7fd4580047d0 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd471dab640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd458003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd471dab640 1 -- 172.21.15.2:0/3076834042 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4580047d0 msgr2=0x7fd458004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd471dab640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4580047d0 0x7fd458004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd471dab640 1 -- 172.21.15.2:0/3076834042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd458005190 msgr2=0x7fd45800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd4725ac640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd458005190 0x7fd45800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd471dab640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd458005190 0x7fd45800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd471dab640 1 -- 172.21.15.2:0/3076834042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458003530 con 0x7fd458003980 2023-11-04T01:43:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.646+0000 7fd4725ac640 1 -- 172.21.15.2:0/3076834042 reap_dead start 2023-11-04T01:43:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd458003da0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd45c001780 tx=0x7fd45c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8333b12b622c54 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0a4ea0 con 0x7fd458003980 2023-11-04T01:43:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c0a7050 con 0x7fd458003980 2023-11-04T01:43:08.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd470da9640 1 -- 172.21.15.2:0/3076834042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c003600 con 0x7fd458003980 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- 172.21.15.2:0/3076834042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 msgr2=0x7fd458003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd458003da0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd45c001780 tx=0x7fd45c01c3e0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- 172.21.15.2:0/3076834042 shutdown_connections 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 --2- 172.21.15.2:0/3076834042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd458003da0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- 172.21.15.2:0/3076834042 >> 172.21.15.2:0/3076834042 conn(0x7fd46c0cb510 msgr2=0x7fd46c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- 172.21.15.2:0/3076834042 shutdown_connections 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- 172.21.15.2:0/3076834042 wait complete. 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 Processor -- start 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- start start 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd46c0c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd46c14f020 0x7fd46c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd46c157ec0 0x7fd46c1e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0c7410 con 0x7fd458003980 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c158340 con 0x7fd46c14f020 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd47400f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1f3db0 con 0x7fd46c157ec0 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd46c0c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd46c0c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44314/0 (socket says 172.21.15.2:44314) 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 -- 172.21.15.2:0/2817448219 learned_addr learned my addr 172.21.15.2:0/2817448219 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 -- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd46c157ec0 msgr2=0x7fd46c1e7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd4715aa640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd46c14f020 0x7fd46c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd46c157ec0 0x7fd46c1e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 -- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd46c14f020 msgr2=0x7fd46c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd46c14f020 0x7fd46c157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.650+0000 7fd471dab640 1 -- 172.21.15.2:0/2817448219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c1e86f0 con 0x7fd458003980 2023-11-04T01:43:08.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd471dab640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd46c0c6ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd45c01c210 tx=0x7fd458005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4627fc640 1 -- 172.21.15.2:0/2817448219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c003e40 con 0x7fd458003980 2023-11-04T01:43:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4627fc640 1 -- 172.21.15.2:0/2817448219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c007a40 con 0x7fd458003980 2023-11-04T01:43:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c0c63f0 con 0x7fd458003980 2023-11-04T01:43:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4627fc640 1 -- 172.21.15.2:0/2817448219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c007270 con 0x7fd458003980 2023-11-04T01:43:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c0c69b0 con 0x7fd458003980 2023-11-04T01:43:08.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c0744a0 con 0x7fd458003980 2023-11-04T01:43:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4627fc640 1 -- 172.21.15.2:0/2817448219 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd45c0073d0 con 0x7fd458003980 2023-11-04T01:43:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4627fc640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd4500664a0 0x7fd450068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4627fc640 1 -- 172.21.15.2:0/2817448219 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd45c11e170 con 0x7fd458003980 2023-11-04T01:43:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4715aa640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd4500664a0 0x7fd450068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.654+0000 7fd4715aa640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd4500664a0 0x7fd450068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd46c160580 tx=0x7fd468008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.658+0000 7fd4627fc640 1 -- 172.21.15.2:0/2817448219 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd45c0eb530 con 0x7fd458003980 2023-11-04T01:43:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd46c0cde30 con 0x7fd458003980 2023-11-04T01:43:08.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd4627fc640 1 -- 172.21.15.2:0/2817448219 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd45c0eeb50 con 0x7fd458003980 2023-11-04T01:43:08.816 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd4500664a0 msgr2=0x7fd450068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd4500664a0 0x7fd450068960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd46c160580 tx=0x7fd468008040 comp rx=0 tx=0).stop 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 msgr2=0x7fd46c0c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd46c0c6ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd45c01c210 tx=0x7fd458005800 comp rx=0 tx=0).stop 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 shutdown_connections 2023-11-04T01:43:08.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd4500664a0 0x7fd450068960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd46c157ec0 0x7fd46c1e7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd46c14f020 0x7fd46c157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 --2- 172.21.15.2:0/2817448219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd458003980 0x7fd46c0c6ed0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 >> 172.21.15.2:0/2817448219 conn(0x7fd46c0cb510 msgr2=0x7fd46c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 shutdown_connections 2023-11-04T01:43:08.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.814+0000 7fd47400f640 1 -- 172.21.15.2:0/2817448219 wait complete. 2023-11-04T01:43:08.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa737e6d640 1 Processor -- start 2023-11-04T01:43:08.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa737e6d640 1 -- start start 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa737e6d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa73015acb0 0x7fa73015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa737e6d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa73015c160 0x7fa7300b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa737e6d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7300cb130 con 0x7fa7300b0a50 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa737e6d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73015bd40 con 0x7fa73015c160 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa737e6d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73006fd80 con 0x7fa73015acb0 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa735408640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa73015c160 0x7fa7300b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa73640a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa7300b0a50 0x7fa7300ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41132/0 (socket says 172.21.15.2:41132) 2023-11-04T01:43:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa73640a640 1 -- 172.21.15.2:0/3496155554 learned_addr learned my addr 172.21.15.2:0/3496155554 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa735c09640 1 --2- 172.21.15.2:0/3496155554 >> v2:172.21.15.90:3300/0 conn(0x7fa73015acb0 0x7fa73015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa735408640 1 -- 172.21.15.2:0/3496155554 >> v2:172.21.15.90:3300/0 conn(0x7fa73015acb0 msgr2=0x7fa73015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa735408640 1 --2- 172.21.15.2:0/3496155554 >> v2:172.21.15.90:3300/0 conn(0x7fa73015acb0 0x7fa73015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa735408640 1 -- 172.21.15.2:0/3496155554 >> v1:172.21.15.2:6789/0 conn(0x7fa7300b0a50 legacy=0x7fa7300ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.962+0000 7fa735408640 1 -- 172.21.15.2:0/3496155554 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73015b680 con 0x7fa73015c160 2023-11-04T01:43:08.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 --2- 172.21.15.2:0/3496155554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015c160 0x7fa7300b0510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa73006d550 tx=0x7fa72001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebc50863fa47b8f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa734c07640 1 -- 172.21.15.2:0/3496155554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200ab600 con 0x7fa73015c160 2023-11-04T01:43:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa734c07640 1 -- 172.21.15.2:0/3496155554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7200a7050 con 0x7fa73015c160 2023-11-04T01:43:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa734c07640 1 -- 172.21.15.2:0/3496155554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200ab980 con 0x7fa73015c160 2023-11-04T01:43:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- 172.21.15.2:0/3496155554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015c160 msgr2=0x7fa7300b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 --2- 172.21.15.2:0/3496155554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015c160 0x7fa7300b0510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa73006d550 tx=0x7fa72001c460 comp rx=0 tx=0).stop 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- 172.21.15.2:0/3496155554 shutdown_connections 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 --2- 172.21.15.2:0/3496155554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015c160 0x7fa7300b0510 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 --2- 172.21.15.2:0/3496155554 >> v2:172.21.15.90:3300/0 conn(0x7fa73015acb0 0x7fa73015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- 172.21.15.2:0/3496155554 >> 172.21.15.2:0/3496155554 conn(0x7fa7300cb510 msgr2=0x7fa7300cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- 172.21.15.2:0/3496155554 shutdown_connections 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- 172.21.15.2:0/3496155554 wait complete. 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 Processor -- start 2023-11-04T01:43:08.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- start start 2023-11-04T01:43:08.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7300b0a50 0x7fa73014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015acb0 0x7fa7300c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa73015c160 0x7fa7300c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7300c9060 con 0x7fa73015acb0 2023-11-04T01:43:08.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730159c90 con 0x7fa7300b0a50 2023-11-04T01:43:08.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7300b2200 con 0x7fa73015c160 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015acb0 0x7fa7300c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015acb0 0x7fa7300c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44320/0 (socket says 172.21.15.2:44320) 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 -- 172.21.15.2:0/2311301111 learned_addr learned my addr 172.21.15.2:0/2311301111 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735c09640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7300b0a50 0x7fa73014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 -- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa73015c160 msgr2=0x7fa7300c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa73015c160 0x7fa7300c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 -- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7300b0a50 msgr2=0x7fa73014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7300b0a50 0x7fa73014ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 -- 172.21.15.2:0/2311301111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa720009420 con 0x7fa73015acb0 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa735408640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015acb0 0x7fa7300c5b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa7200ae040 tx=0x7fa720019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa7267fc640 1 -- 172.21.15.2:0/2311301111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200b4820 con 0x7fa73015acb0 2023-11-04T01:43:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa7267fc640 1 -- 172.21.15.2:0/2311301111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7200b4980 con 0x7fa73015acb0 2023-11-04T01:43:08.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7300b24e0 con 0x7fa73015acb0 2023-11-04T01:43:08.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa7267fc640 1 -- 172.21.15.2:0/2311301111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7200b4d30 con 0x7fa73015acb0 2023-11-04T01:43:08.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.966+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa730159840 con 0x7fa73015acb0 2023-11-04T01:43:08.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.970+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa730159a30 con 0x7fa73015acb0 2023-11-04T01:43:08.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.970+0000 7fa7267fc640 1 -- 172.21.15.2:0/2311301111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7200b2040 con 0x7fa73015acb0 2023-11-04T01:43:08.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.970+0000 7fa7267fc640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa7140664a0 0x7fa714068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:08.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.970+0000 7fa7267fc640 1 -- 172.21.15.2:0/2311301111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa72011eba0 con 0x7fa73015acb0 2023-11-04T01:43:08.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.970+0000 7fa735c09640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa7140664a0 0x7fa714068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:08.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.970+0000 7fa735c09640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa7140664a0 0x7fa714068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009790 tx=0x7fa72c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:08.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:08.974+0000 7fa7267fc640 1 -- 172.21.15.2:0/2311301111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa7200ec100 con 0x7fa73015acb0 2023-11-04T01:43:09.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.122+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa7300744a0 con 0x7fa73015acb0 2023-11-04T01:43:09.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa7267fc640 1 -- 172.21.15.2:0/2311301111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa7200b00a0 con 0x7fa73015acb0 2023-11-04T01:43:09.127 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa7140664a0 msgr2=0x7fa714068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa7140664a0 0x7fa714068960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009790 tx=0x7fa72c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:09.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015acb0 msgr2=0x7fa7300c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015acb0 0x7fa7300c5b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa7200ae040 tx=0x7fa720019200 comp rx=0 tx=0).stop 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 shutdown_connections 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa7140664a0 0x7fa714068960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa73015c160 0x7fa7300c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa73015acb0 0x7fa7300c5b60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 --2- 172.21.15.2:0/2311301111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7300b0a50 0x7fa73014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 >> 172.21.15.2:0/2311301111 conn(0x7fa7300cb510 msgr2=0x7fa7300ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 shutdown_connections 2023-11-04T01:43:09.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.126+0000 7fa737e6d640 1 -- 172.21.15.2:0/2311301111 wait complete. 2023-11-04T01:43:09.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:09.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa70567640 1 Processor -- start 2023-11-04T01:43:09.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa70567640 1 -- start start 2023-11-04T01:43:09.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa70567640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 0x7ffa680b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa70567640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa680b0eb0 con 0x7ffa6806ba10 2023-11-04T01:43:09.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa70567640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6806c010 con 0x7ffa680b0a50 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa70567640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680c90e0 con 0x7ffa6815d290 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6eb04640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa6806ba10 0x7ffa68160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41142/0 (socket says 172.21.15.2:41142) 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6eb04640 1 -- 172.21.15.2:0/3973124404 learned_addr learned my addr 172.21.15.2:0/3973124404 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6e303640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 0x7ffa680b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008658622 0 0) 0x7ffa680b0eb0 con 0x7ffa6806ba10 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa54003530 con 0x7ffa6806ba10 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98724228 0 0) 0x7ffa54003530 con 0x7ffa6806ba10 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 msgr2=0x7ffa680b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 0x7ffa680b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 >> v1:172.21.15.90:6789/0 conn(0x7ffa680b0a50 legacy=0x7ffa6806b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680ac960 con 0x7ffa6806ba10 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ffa60001a00 con 0x7ffa6806ba10 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 >> v1:172.21.15.2:6789/0 conn(0x7ffa6806ba10 legacy=0x7ffa68160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540039b0 0x7ffa54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa540047d0 0x7ffa54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 0x7ffa540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680c90e0 con 0x7ffa540047d0 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5400bac0 con 0x7ffa540039b0 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5400bc80 con 0x7ffa6815d290 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6db02640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa540047d0 0x7ffa54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6e303640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540039b0 0x7ffa54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6eb04640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 0x7ffa540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6db02640 1 -- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 msgr2=0x7ffa540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6db02640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815d290 0x7ffa540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6db02640 1 -- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540039b0 msgr2=0x7ffa54003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6db02640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540039b0 0x7ffa54003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6db02640 1 -- 172.21.15.2:0/3973124404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54003530 con 0x7ffa540047d0 2023-11-04T01:43:09.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.258+0000 7ffa6e303640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540039b0 0x7ffa54003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6db02640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa540047d0 0x7ffa54004c50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffa58001780 tx=0x7ffa5801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a8edae34761cd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa580052d0 con 0x7ffa540047d0 2023-11-04T01:43:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa580a7050 con 0x7ffa540047d0 2023-11-04T01:43:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6d301640 1 -- 172.21.15.2:0/3973124404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58003600 con 0x7ffa540047d0 2023-11-04T01:43:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- 172.21.15.2:0/3973124404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa540047d0 msgr2=0x7ffa54004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 --2- 172.21.15.2:0/3973124404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa540047d0 0x7ffa54004c50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffa58001780 tx=0x7ffa5801c400 comp rx=0 tx=0).stop 2023-11-04T01:43:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 -- 172.21.15.2:0/3973124404 reap_dead start 2023-11-04T01:43:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- 172.21.15.2:0/3973124404 shutdown_connections 2023-11-04T01:43:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- 172.21.15.2:0/3973124404 >> 172.21.15.2:0/3973124404 conn(0x7ffa680cb510 msgr2=0x7ffa680cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- 172.21.15.2:0/3973124404 shutdown_connections 2023-11-04T01:43:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- 172.21.15.2:0/3973124404 wait complete. 2023-11-04T01:43:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 Processor -- start 2023-11-04T01:43:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- start start 2023-11-04T01:43:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540047d0 0x7ffa68153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815e790 0x7ffa680c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa680c54c0 0x7ffa680c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa681538c0 con 0x7ffa680c54c0 2023-11-04T01:43:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6815ec50 con 0x7ffa540047d0 2023-11-04T01:43:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa70567640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6815ef30 con 0x7ffa6815e790 2023-11-04T01:43:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa680c54c0 0x7ffa680c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa680c54c0 0x7ffa680c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44336/0 (socket says 172.21.15.2:44336) 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 -- 172.21.15.2:0/1872041877 learned_addr learned my addr 172.21.15.2:0/1872041877 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6e303640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540047d0 0x7ffa68153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6db02640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815e790 0x7ffa680c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 -- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815e790 msgr2=0x7ffa680c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815e790 0x7ffa680c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 -- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540047d0 msgr2=0x7ffa68153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540047d0 0x7ffa68153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6eb04640 1 -- 172.21.15.2:0/1872041877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6815f210 con 0x7ffa680c54c0 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.262+0000 7ffa6e303640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540047d0 0x7ffa68153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa6eb04640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa680c54c0 0x7ffa680c5b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffa680ad9f0 tx=0x7ffa60011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa5effd640 1 -- 172.21.15.2:0/1872041877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000f8a0 con 0x7ffa680c54c0 2023-11-04T01:43:09.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa5effd640 1 -- 172.21.15.2:0/1872041877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6000fa00 con 0x7ffa680c54c0 2023-11-04T01:43:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa5effd640 1 -- 172.21.15.2:0/1872041877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000fdb0 con 0x7ffa680c54c0 2023-11-04T01:43:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6815f4f0 con 0x7ffa680c54c0 2023-11-04T01:43:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa680c60a0 con 0x7ffa680c54c0 2023-11-04T01:43:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa680cab20 con 0x7ffa680c54c0 2023-11-04T01:43:09.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa5effd640 1 -- 172.21.15.2:0/1872041877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa6001f460 con 0x7ffa680c54c0 2023-11-04T01:43:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa5effd640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa4c0664a0 0x7ffa4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa5effd640 1 -- 172.21.15.2:0/1872041877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffa60086db0 con 0x7ffa680c54c0 2023-11-04T01:43:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa6e303640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa4c0664a0 0x7ffa4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.266+0000 7ffa6e303640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa4c0664a0 0x7ffa4c068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400da10 tx=0x7ffa64008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.270+0000 7ffa5effd640 1 -- 172.21.15.2:0/1872041877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa60054280 con 0x7ffa680c54c0 2023-11-04T01:43:09.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa680744a0 con 0x7ffa680c54c0 2023-11-04T01:43:09.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa5effd640 1 -- 172.21.15.2:0/1872041877 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa600578a0 con 0x7ffa680c54c0 2023-11-04T01:43:09.428 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa4c0664a0 msgr2=0x7ffa4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa4c0664a0 0x7ffa4c068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400da10 tx=0x7ffa64008040 comp rx=0 tx=0).stop 2023-11-04T01:43:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa680c54c0 msgr2=0x7ffa680c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa680c54c0 0x7ffa680c5b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffa680ad9f0 tx=0x7ffa60011c20 comp rx=0 tx=0).stop 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 shutdown_connections 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa4c0664a0 0x7ffa4c068960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa680c54c0 0x7ffa680c5b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa6815e790 0x7ffa680c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 --2- 172.21.15.2:0/1872041877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa540047d0 0x7ffa68153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 >> 172.21.15.2:0/1872041877 conn(0x7ffa680cb510 msgr2=0x7ffa6806b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 shutdown_connections 2023-11-04T01:43:09.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.426+0000 7ffa70567640 1 -- 172.21.15.2:0/1872041877 wait complete. 2023-11-04T01:43:09.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae7ef1640 1 Processor -- start 2023-11-04T01:43:09.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae7ef1640 1 -- start start 2023-11-04T01:43:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae7ef1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 0x7f0ae006cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae7ef1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae0144560 con 0x7f0ae006a160 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae7ef1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae015f920 con 0x7f0ae0144180 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae7ef1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae015f170 con 0x7f0ae01447f0 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0ae006a160 0x7f0ae00c5850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41158/0 (socket says 172.21.15.2:41158) 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 -- 172.21.15.2:0/2442449014 learned_addr learned my addr 172.21.15.2:0/2442449014 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae548c640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 0x7f0ae006cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568983193 0 0) 0x7f0ae0144560 con 0x7f0ae006a160 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0acc003530 con 0x7f0ae006a160 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853066728 0 0) 0x7f0acc003530 con 0x7f0ae006a160 2023-11-04T01:43:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 msgr2=0x7f0ae006cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 0x7f0ae006cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 >> v1:172.21.15.90:6789/0 conn(0x7f0ae0144180 legacy=0x7f0ae015ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae015f360 con 0x7f0ae006a160 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f0adc001680 con 0x7f0ae006a160 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 >> v1:172.21.15.2:6789/0 conn(0x7f0ae006a160 legacy=0x7f0ae00c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 0x7f0acc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0acc003f30 0x7f0acc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0acc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc00ba40 con 0x7f0acc004d10 2023-11-04T01:43:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc00bbb0 con 0x7f0acc003f30 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc00bd70 con 0x7f0ae01447f0 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0acc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae548c640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0acc003f30 0x7f0acc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae5c8d640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 0x7f0acc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 -- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 msgr2=0x7f0acc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01447f0 0x7f0acc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 -- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0acc003f30 msgr2=0x7f0acc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0acc003f30 0x7f0acc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.566+0000 7f0ae648e640 1 -- 172.21.15.2:0/2442449014 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc003530 con 0x7f0acc004d10 2023-11-04T01:43:09.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae648e640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0acc005190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00c240 tx=0x7f0adc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbc51b9024407d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0a5b40 con 0x7f0acc004d10 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc0a5cc0 con 0x7f0acc004d10 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae4c8b640 1 -- 172.21.15.2:0/2442449014 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc005b20 con 0x7f0acc004d10 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/2442449014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 msgr2=0x7f0acc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 --2- 172.21.15.2:0/2442449014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0acc005190 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00c240 tx=0x7f0adc01cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae648e640 1 -- 172.21.15.2:0/2442449014 reap_dead start 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/2442449014 shutdown_connections 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/2442449014 >> 172.21.15.2:0/2442449014 conn(0x7f0ae00cfc00 msgr2=0x7f0ae00d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/2442449014 shutdown_connections 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/2442449014 wait complete. 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 Processor -- start 2023-11-04T01:43:09.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.570+0000 7f0ae7ef1640 1 -- start start 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0ae01eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01425e0 0x7f0ae0142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ae0142a60 0x7f0ae01434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00b16b0 con 0x7f0acc004d10 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae0140880 con 0x7f0ae0142a60 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae0140b60 con 0x7f0ae01425e0 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0ae01eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0ae01eff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44358/0 (socket says 172.21.15.2:44358) 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 -- 172.21.15.2:0/4035495369 learned_addr learned my addr 172.21.15.2:0/4035495369 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae548c640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01425e0 0x7f0ae0142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae648e640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ae0142a60 0x7f0ae01434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 -- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01425e0 msgr2=0x7f0ae0142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01425e0 0x7f0ae0142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 -- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ae0142a60 msgr2=0x7f0ae01434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ae0142a60 0x7f0ae01434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 -- 172.21.15.2:0/4035495369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0140e40 con 0x7f0acc004d10 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae5c8d640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0ae01eff30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e8d0 tx=0x7f0ad800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ad67fc640 1 -- 172.21.15.2:0/4035495369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8003b90 con 0x7f0acc004d10 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ad67fc640 1 -- 172.21.15.2:0/4035495369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad8003cf0 con 0x7f0acc004d10 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae0141120 con 0x7f0acc004d10 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ad67fc640 1 -- 172.21.15.2:0/4035495369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8005310 con 0x7f0acc004d10 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae01f0470 con 0x7f0acc004d10 2023-11-04T01:43:09.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae00c6c30 con 0x7f0acc004d10 2023-11-04T01:43:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ad67fc640 1 -- 172.21.15.2:0/4035495369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ad8005470 con 0x7f0acc004d10 2023-11-04T01:43:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ad67fc640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ac40664a0 0x7f0ac4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ad67fc640 1 -- 172.21.15.2:0/4035495369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0ad8083f90 con 0x7f0acc004d10 2023-11-04T01:43:09.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.574+0000 7f0ae548c640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ac40664a0 0x7f0ac4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.578+0000 7f0ae548c640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ac40664a0 0x7f0ac4068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ae015b140 tx=0x7f0ad0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.578+0000 7f0ad67fc640 1 -- 172.21.15.2:0/4035495369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ad80b5090 con 0x7f0acc004d10 2023-11-04T01:43:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.742+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0ae00675f0 con 0x7f0acc004d10 2023-11-04T01:43:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.742+0000 7f0ad67fc640 1 -- 172.21.15.2:0/4035495369 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0ad8051480 con 0x7f0acc004d10 2023-11-04T01:43:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:09.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.742+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ac40664a0 msgr2=0x7f0ac4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.742+0000 7f0ae7ef1640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ac40664a0 0x7f0ac4068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0ae015b140 tx=0x7f0ad0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:09.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.742+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 msgr2=0x7f0ae01eff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.742+0000 7f0ae7ef1640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0ae01eff30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e8d0 tx=0x7f0ad800ed90 comp rx=0 tx=0).stop 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 shutdown_connections 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ac40664a0 0x7f0ac4068960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ae0142a60 0x7f0ae01434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ae01425e0 0x7f0ae0142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 --2- 172.21.15.2:0/4035495369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0acc004d10 0x7f0ae01eff30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 >> 172.21.15.2:0/4035495369 conn(0x7f0ae00cfc00 msgr2=0x7f0ae00b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 shutdown_connections 2023-11-04T01:43:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.746+0000 7f0ae7ef1640 1 -- 172.21.15.2:0/4035495369 wait complete. 2023-11-04T01:43:09.762 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:09.762 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:09.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:09.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfc4dc640 1 Processor -- start 2023-11-04T01:43:09.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfc4dc640 1 -- start start 2023-11-04T01:43:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfc4dc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efbf40b0d40 0x7efbf4166170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfc4dc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf406c740 con 0x7efbf415b290 2023-11-04T01:43:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfc4dc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf415b670 con 0x7efbf40c2670 2023-11-04T01:43:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfc4dc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf406bb30 con 0x7efbf40b0d40 2023-11-04T01:43:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfa278640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efbf415b290 0x7efbf406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41168/0 (socket says 172.21.15.2:41168) 2023-11-04T01:43:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfa278640 1 -- 172.21.15.2:0/2728325039 learned_addr learned my addr 172.21.15.2:0/2728325039 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfaa79640 1 --2- 172.21.15.2:0/2728325039 >> v2:172.21.15.2:3300/0 conn(0x7efbf40b0d40 0x7efbf4166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbf9276640 1 -- 172.21.15.2:0/2728325039 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398744527 0 0) 0x7efbf406c740 con 0x7efbf415b290 2023-11-04T01:43:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbf9276640 1 -- 172.21.15.2:0/2728325039 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe0003530 con 0x7efbf415b290 2023-11-04T01:43:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfaa79640 1 -- 172.21.15.2:0/2728325039 >> v1:172.21.15.90:6789/0 conn(0x7efbf40c2670 legacy=0x7efbf40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfaa79640 1 -- 172.21.15.2:0/2728325039 >> v1:172.21.15.2:6789/0 conn(0x7efbf415b290 legacy=0x7efbf406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.938+0000 7efbfaa79640 1 -- 172.21.15.2:0/2728325039 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf406be10 con 0x7efbf40b0d40 2023-11-04T01:43:09.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 --2- 172.21.15.2:0/2728325039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf40b0d40 0x7efbf4166170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efbec009d90 tx=0x7efbec01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa8ef50e74d667a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbf9276640 1 -- 172.21.15.2:0/2728325039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0a5950 con 0x7efbf40b0d40 2023-11-04T01:43:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbf9276640 1 -- 172.21.15.2:0/2728325039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec0a5ab0 con 0x7efbf40b0d40 2023-11-04T01:43:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbf9276640 1 -- 172.21.15.2:0/2728325039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0a5e40 con 0x7efbf40b0d40 2023-11-04T01:43:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2728325039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf40b0d40 msgr2=0x7efbf4166170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2728325039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf40b0d40 0x7efbf4166170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efbec009d90 tx=0x7efbec01c890 comp rx=0 tx=0).stop 2023-11-04T01:43:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2728325039 shutdown_connections 2023-11-04T01:43:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2728325039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf40b0d40 0x7efbf4166170 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2728325039 >> 172.21.15.2:0/2728325039 conn(0x7efbf40cebb0 msgr2=0x7efbf40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2728325039 shutdown_connections 2023-11-04T01:43:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2728325039 wait complete. 2023-11-04T01:43:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 Processor -- start 2023-11-04T01:43:09.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- start start 2023-11-04T01:43:09.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbf40b0d40 0x7efbf414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbf40c2670 0x7efbf41466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf415b290 0x7efbf414ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf414d9c0 con 0x7efbf415b290 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf414dca0 con 0x7efbf40c2670 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf414df80 con 0x7efbf40b0d40 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf415b290 0x7efbf414ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf415b290 0x7efbf414ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44364/0 (socket says 172.21.15.2:44364) 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 -- 172.21.15.2:0/2269216856 learned_addr learned my addr 172.21.15.2:0/2269216856 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfa278640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbf40b0d40 0x7efbf414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbf9a77640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbf40c2670 0x7efbf41466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 -- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbf40b0d40 msgr2=0x7efbf414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbf40b0d40 0x7efbf414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 -- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbf40c2670 msgr2=0x7efbf41466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbf40c2670 0x7efbf41466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 -- 172.21.15.2:0/2269216856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec009a70 con 0x7efbf415b290 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbf9a77640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbf40c2670 0x7efbf41466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfaa79640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf415b290 0x7efbf414ea60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efbec0b0040 tx=0x7efbec019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbeaffd640 1 -- 172.21.15.2:0/2269216856 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0add90 con 0x7efbf415b290 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbeaffd640 1 -- 172.21.15.2:0/2269216856 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec009450 con 0x7efbf415b290 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf414e260 con 0x7efbf415b290 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbeaffd640 1 -- 172.21.15.2:0/2269216856 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0b9690 con 0x7efbf415b290 2023-11-04T01:43:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.942+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf414d5b0 con 0x7efbf415b290 2023-11-04T01:43:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.946+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf40744a0 con 0x7efbf415b290 2023-11-04T01:43:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.946+0000 7efbeaffd640 1 -- 172.21.15.2:0/2269216856 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efbec0b97f0 con 0x7efbf415b290 2023-11-04T01:43:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.946+0000 7efbeaffd640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efbd80664a0 0x7efbd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.946+0000 7efbeaffd640 1 -- 172.21.15.2:0/2269216856 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7efbec11f700 con 0x7efbf415b290 2023-11-04T01:43:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.946+0000 7efbfa278640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efbd80664a0 0x7efbd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.946+0000 7efbfa278640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efbd80664a0 0x7efbd8068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efbf00011f0 tx=0x7efbf0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:09.950+0000 7efbeaffd640 1 -- 172.21.15.2:0/2269216856 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efbec0ecb70 con 0x7efbf415b290 2023-11-04T01:43:10.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.106+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efbf40c2430 con 0x7efbf415b290 2023-11-04T01:43:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbeaffd640 1 -- 172.21.15.2:0/2269216856 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7efbec0f0190 con 0x7efbf415b290 2023-11-04T01:43:10.111 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:10.112 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efbd80664a0 msgr2=0x7efbd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efbd80664a0 0x7efbd8068960 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efbf00011f0 tx=0x7efbf0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf415b290 msgr2=0x7efbf414ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf415b290 0x7efbf414ea60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efbec0b0040 tx=0x7efbec019630 comp rx=0 tx=0).stop 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 shutdown_connections 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efbd80664a0 0x7efbd8068960 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efbf415b290 0x7efbf414ea60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efbf40c2670 0x7efbf41466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 --2- 172.21.15.2:0/2269216856 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efbf40b0d40 0x7efbf414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 >> 172.21.15.2:0/2269216856 conn(0x7efbf40cebb0 msgr2=0x7efbf406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 shutdown_connections 2023-11-04T01:43:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.110+0000 7efbfc4dc640 1 -- 172.21.15.2:0/2269216856 wait complete. 2023-11-04T01:43:10.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:10.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:10.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd4a629f640 1 Processor -- start 2023-11-04T01:43:10.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd4a629f640 1 -- start start 2023-11-04T01:43:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd4a629f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd4a015acb0 0x7fd4a015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd4a629f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4a015c160 0x7fd4a00b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd4a629f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00cb130 con 0x7fd4a00b0a50 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd4a629f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a015bd40 con 0x7fd4a015c160 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd4a629f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a006fd80 con 0x7fd4a015acb0 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4a015c160 0x7fd4a00b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4a015c160 0x7fd4a00b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44374/0 (socket says 172.21.15.2:44374) 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49f7fe640 1 -- 172.21.15.2:0/1413249252 learned_addr learned my addr 172.21.15.2:0/1413249252 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49ffff640 1 --2- 172.21.15.2:0/1413249252 >> v2:172.21.15.90:3300/0 conn(0x7fd4a015acb0 0x7fd4a015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49f7fe640 1 -- 172.21.15.2:0/1413249252 >> v2:172.21.15.90:3300/0 conn(0x7fd4a015acb0 msgr2=0x7fd4a015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49f7fe640 1 --2- 172.21.15.2:0/1413249252 >> v2:172.21.15.90:3300/0 conn(0x7fd4a015acb0 0x7fd4a015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49f7fe640 1 -- 172.21.15.2:0/1413249252 >> v1:172.21.15.2:6789/0 conn(0x7fd4a00b0a50 legacy=0x7fd4a00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49f7fe640 1 -- 172.21.15.2:0/1413249252 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a015b680 con 0x7fd4a015c160 2023-11-04T01:43:10.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.262+0000 7fd49effd640 1 -- 172.21.15.2:0/1413249252 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927924376 0 0) 0x7fd4a00cb130 con 0x7fd4a00b0a50 2023-11-04T01:43:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd49f7fe640 1 --2- 172.21.15.2:0/1413249252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015c160 0x7fd4a00b0510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006d550 tx=0x7fd49401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f7d4826d629abe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd49effd640 1 -- 172.21.15.2:0/1413249252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940ab610 con 0x7fd4a015c160 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd49effd640 1 -- 172.21.15.2:0/1413249252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940ab770 con 0x7fd4a015c160 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd49effd640 1 -- 172.21.15.2:0/1413249252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940abb00 con 0x7fd4a015c160 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd4a629f640 1 -- 172.21.15.2:0/1413249252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015c160 msgr2=0x7fd4a00b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd4a629f640 1 --2- 172.21.15.2:0/1413249252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015c160 0x7fd4a00b0510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4a006d550 tx=0x7fd49401c500 comp rx=0 tx=0).stop 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd4a629f640 1 -- 172.21.15.2:0/1413249252 shutdown_connections 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd4a629f640 1 --2- 172.21.15.2:0/1413249252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015c160 0x7fd4a00b0510 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd4a629f640 1 --2- 172.21.15.2:0/1413249252 >> v2:172.21.15.90:3300/0 conn(0x7fd4a015acb0 0x7fd4a015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.266+0000 7fd4a629f640 1 -- 172.21.15.2:0/1413249252 >> 172.21.15.2:0/1413249252 conn(0x7fd4a00cb510 msgr2=0x7fd4a00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- 172.21.15.2:0/1413249252 shutdown_connections 2023-11-04T01:43:10.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- 172.21.15.2:0/1413249252 wait complete. 2023-11-04T01:43:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 Processor -- start 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- start start 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4a00b0a50 0x7fd4a00c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015acb0 0x7fd4a01548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4a015c160 0x7fd4a014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c6b30 con 0x7fd4a015acb0 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c5f20 con 0x7fd4a015c160 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c6200 con 0x7fd4a00b0a50 2023-11-04T01:43:10.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015acb0 0x7fd4a01548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015acb0 0x7fd4a01548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44376/0 (socket says 172.21.15.2:44376) 2023-11-04T01:43:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 -- 172.21.15.2:0/2383948339 learned_addr learned my addr 172.21.15.2:0/2383948339 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49ffff640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4a00b0a50 0x7fd4a00c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 -- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4a00b0a50 msgr2=0x7fd4a00c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4a00b0a50 0x7fd4a00c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 -- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4a015c160 msgr2=0x7fd4a014f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4a015c160 0x7fd4a014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 -- 172.21.15.2:0/2383948339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940094d0 con 0x7fd4a015acb0 2023-11-04T01:43:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49f7fe640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015acb0 0x7fd4a01548a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd4940ad040 tx=0x7fd49401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49cff9640 1 -- 172.21.15.2:0/2383948339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494004020 con 0x7fd4a015acb0 2023-11-04T01:43:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49cff9640 1 -- 172.21.15.2:0/2383948339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4940b8070 con 0x7fd4a015acb0 2023-11-04T01:43:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a00c64e0 con 0x7fd4a015acb0 2023-11-04T01:43:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd49cff9640 1 -- 172.21.15.2:0/2383948339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494004380 con 0x7fd4a015acb0 2023-11-04T01:43:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a00c5b60 con 0x7fd4a015acb0 2023-11-04T01:43:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.270+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a00744a0 con 0x7fd4a015acb0 2023-11-04T01:43:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.274+0000 7fd49cff9640 1 -- 172.21.15.2:0/2383948339 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd494003620 con 0x7fd4a015acb0 2023-11-04T01:43:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.274+0000 7fd49cff9640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd48c0664a0 0x7fd48c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.274+0000 7fd49cff9640 1 -- 172.21.15.2:0/2383948339 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd49411e5c0 con 0x7fd4a015acb0 2023-11-04T01:43:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.274+0000 7fd49ffff640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd48c0664a0 0x7fd48c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.274+0000 7fd49ffff640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd48c0664a0 0x7fd48c068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd490009790 tx=0x7fd490008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.278+0000 7fd49cff9640 1 -- 172.21.15.2:0/2383948339 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd4940eb8f0 con 0x7fd4a015acb0 2023-11-04T01:43:10.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.430+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4a00c6c70 con 0x7fd4a015acb0 2023-11-04T01:43:10.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.430+0000 7fd49cff9640 1 -- 172.21.15.2:0/2383948339 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4940ba0a0 con 0x7fd4a015acb0 2023-11-04T01:43:10.434 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd48c0664a0 msgr2=0x7fd48c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd48c0664a0 0x7fd48c068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd490009790 tx=0x7fd490008040 comp rx=0 tx=0).stop 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015acb0 msgr2=0x7fd4a01548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015acb0 0x7fd4a01548a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd4940ad040 tx=0x7fd49401ad40 comp rx=0 tx=0).stop 2023-11-04T01:43:10.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 shutdown_connections 2023-11-04T01:43:10.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd48c0664a0 0x7fd48c068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4a015c160 0x7fd4a014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4a015acb0 0x7fd4a01548a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 --2- 172.21.15.2:0/2383948339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd4a00b0a50 0x7fd4a00c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 >> 172.21.15.2:0/2383948339 conn(0x7fd4a00cb510 msgr2=0x7fd4a00b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 shutdown_connections 2023-11-04T01:43:10.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.434+0000 7fd4a629f640 1 -- 172.21.15.2:0/2383948339 wait complete. 2023-11-04T01:43:10.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:10.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.578+0000 7f7eb5e1d640 1 Processor -- start 2023-11-04T01:43:10.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eb5e1d640 1 -- start start 2023-11-04T01:43:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eb5e1d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7eb015d0b0 0x7f7eb0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eb5e1d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb01610f0 0x7f7eb00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eb5e1d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb00b5e00 con 0x7f7eb00cfd50 2023-11-04T01:43:10.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eb5e1d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb00d1520 con 0x7f7eb015d0b0 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eb5e1d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb00d01e0 con 0x7f7eb01610f0 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7eb00cfd50 0x7f7eb00b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41184/0 (socket says 172.21.15.2:41184) 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaffff640 1 -- 172.21.15.2:0/655758614 learned_addr learned my addr 172.21.15.2:0/655758614 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaf7fe640 1 --2- 172.21.15.2:0/655758614 >> v2:172.21.15.2:3300/0 conn(0x7f7eb015d0b0 0x7f7eb0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaeffd640 1 --2- 172.21.15.2:0/655758614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb01610f0 0x7f7eb00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eae7fc640 1 -- 172.21.15.2:0/655758614 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391574301 0 0) 0x7f7eb00b5e00 con 0x7f7eb00cfd50 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eae7fc640 1 -- 172.21.15.2:0/655758614 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c003530 con 0x7f7eb00cfd50 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaf7fe640 1 -- 172.21.15.2:0/655758614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb01610f0 msgr2=0x7f7eb00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaf7fe640 1 --2- 172.21.15.2:0/655758614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb01610f0 0x7f7eb00cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaf7fe640 1 -- 172.21.15.2:0/655758614 >> v1:172.21.15.2:6789/0 conn(0x7f7eb00cfd50 legacy=0x7f7eb00b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.582+0000 7f7eaf7fe640 1 -- 172.21.15.2:0/655758614 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb015d490 con 0x7f7eb015d0b0 2023-11-04T01:43:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eaf7fe640 1 --2- 172.21.15.2:0/655758614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb015d0b0 0x7f7eb0160bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009d90 tx=0x7f7ea001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1d5498ecc62556 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eae7fc640 1 -- 172.21.15.2:0/655758614 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00a5920 con 0x7f7eb015d0b0 2023-11-04T01:43:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eae7fc640 1 -- 172.21.15.2:0/655758614 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea00a5a80 con 0x7f7eb015d0b0 2023-11-04T01:43:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eae7fc640 1 -- 172.21.15.2:0/655758614 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00a5e10 con 0x7f7eb015d0b0 2023-11-04T01:43:10.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/655758614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb015d0b0 msgr2=0x7f7eb0160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/655758614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb015d0b0 0x7f7eb0160bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009d90 tx=0x7f7ea001c950 comp rx=0 tx=0).stop 2023-11-04T01:43:10.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/655758614 shutdown_connections 2023-11-04T01:43:10.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/655758614 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb01610f0 0x7f7eb00cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/655758614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb015d0b0 0x7f7eb0160bb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/655758614 >> 172.21.15.2:0/655758614 conn(0x7f7eb006a890 msgr2=0x7f7eb006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/655758614 shutdown_connections 2023-11-04T01:43:10.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/655758614 wait complete. 2023-11-04T01:43:10.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 Processor -- start 2023-11-04T01:43:10.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- start start 2023-11-04T01:43:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb00cfd50 0x7f7eb014a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb015d0b0 0x7f7eb00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb01610f0 0x7f7eb015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0158980 con 0x7f7eb00cfd50 2023-11-04T01:43:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0157d70 con 0x7f7eb01610f0 2023-11-04T01:43:10.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eb5e1d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0158050 con 0x7f7eb015d0b0 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eaf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb00cfd50 0x7f7eb014a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eaf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb00cfd50 0x7f7eb014a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44382/0 (socket says 172.21.15.2:44382) 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.586+0000 7f7eaf7fe640 1 -- 172.21.15.2:0/3717877696 learned_addr learned my addr 172.21.15.2:0/3717877696 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaeffd640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb015d0b0 0x7f7eb00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaffff640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb01610f0 0x7f7eb015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaf7fe640 1 -- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb015d0b0 msgr2=0x7f7eb00b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaf7fe640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb015d0b0 0x7f7eb00b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaf7fe640 1 -- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb01610f0 msgr2=0x7f7eb015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaf7fe640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb01610f0 0x7f7eb015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaf7fe640 1 -- 172.21.15.2:0/3717877696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0009a70 con 0x7f7eb00cfd50 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaffff640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb01610f0 0x7f7eb015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaf7fe640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb00cfd50 0x7f7eb014a3a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7ea001b000 tx=0x7f7ea00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7ea7fff640 1 -- 172.21.15.2:0/3717877696 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00aee20 con 0x7f7eb00cfd50 2023-11-04T01:43:10.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7ea7fff640 1 -- 172.21.15.2:0/3717877696 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0009450 con 0x7f7eb00cfd50 2023-11-04T01:43:10.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7ea7fff640 1 -- 172.21.15.2:0/3717877696 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00b7650 con 0x7f7eb00cfd50 2023-11-04T01:43:10.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb0158330 con 0x7f7eb00cfd50 2023-11-04T01:43:10.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb00b4b20 con 0x7f7eb00cfd50 2023-11-04T01:43:10.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb00744a0 con 0x7f7eb00cfd50 2023-11-04T01:43:10.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7ea7fff640 1 -- 172.21.15.2:0/3717877696 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ea00b4050 con 0x7f7eb00cfd50 2023-11-04T01:43:10.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7ea7fff640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e900664a0 0x7f7e90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7ea7fff640 1 -- 172.21.15.2:0/3717877696 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7ea011f000 con 0x7f7eb00cfd50 2023-11-04T01:43:10.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.590+0000 7f7eaeffd640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e900664a0 0x7f7e90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.594+0000 7f7eaeffd640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e900664a0 0x7f7e90068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00b87e0 tx=0x7f7e98008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.594+0000 7f7ea7fff640 1 -- 172.21.15.2:0/3717877696 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ea00ec460 con 0x7f7eb00cfd50 2023-11-04T01:43:10.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.750+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7eb00d0a10 con 0x7f7eb00cfd50 2023-11-04T01:43:10.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.750+0000 7f7ea7fff640 1 -- 172.21.15.2:0/3717877696 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ea00efa80 con 0x7f7eb00cfd50 2023-11-04T01:43:10.753 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:10.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e900664a0 msgr2=0x7f7e90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e900664a0 0x7f7e90068960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00b87e0 tx=0x7f7e98008040 comp rx=0 tx=0).stop 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb00cfd50 msgr2=0x7f7eb014a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb00cfd50 0x7f7eb014a3a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7ea001b000 tx=0x7f7ea00196f0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 shutdown_connections 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e900664a0 0x7f7e90068960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb01610f0 0x7f7eb015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb015d0b0 0x7f7eb00b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 --2- 172.21.15.2:0/3717877696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb00cfd50 0x7f7eb014a3a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 >> 172.21.15.2:0/3717877696 conn(0x7f7eb006a890 msgr2=0x7f7eb00d2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 shutdown_connections 2023-11-04T01:43:10.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.754+0000 7f7eb5e1d640 1 -- 172.21.15.2:0/3717877696 wait complete. 2023-11-04T01:43:10.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:10.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.894+0000 7fdec5bdf640 1 Processor -- start 2023-11-04T01:43:10.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.894+0000 7fdec5bdf640 1 -- start start 2023-11-04T01:43:10.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdec5bdf640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdec006a160 0x7fdec006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdec5bdf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec006e440 con 0x7fdec015a970 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdec5bdf640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00b1a10 con 0x7fdec00b1530 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdec5bdf640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec006ab50 con 0x7fdec006a160 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebf7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdec015a970 0x7fdec0160af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41196/0 (socket says 172.21.15.2:41196) 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebf7fe640 1 -- 172.21.15.2:0/4123299125 learned_addr learned my addr 172.21.15.2:0/4123299125 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 --2- 172.21.15.2:0/4123299125 >> v2:172.21.15.90:3300/0 conn(0x7fdec006a160 0x7fdec006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926264976 0 0) 0x7fdec006e440 con 0x7fdec015a970 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea8003530 con 0x7fdec015a970 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427891014 0 0) 0x7fdea8003530 con 0x7fdec015a970 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 >> v2:172.21.15.90:3300/0 conn(0x7fdec006a160 msgr2=0x7fdec006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 --2- 172.21.15.2:0/4123299125 >> v2:172.21.15.90:3300/0 conn(0x7fdec006a160 0x7fdec006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 >> v1:172.21.15.90:6789/0 conn(0x7fdec00b1530 legacy=0x7fdec006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00b1cf0 con 0x7fdec015a970 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fdeb0001680 con 0x7fdec015a970 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 >> v1:172.21.15.2:6789/0 conn(0x7fdec015a970 legacy=0x7fdec0160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdea8003980 0x7fdea8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdea80047d0 0x7fdea8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdea800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec006ab50 con 0x7fdea8005190 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea800c030 con 0x7fdea80047d0 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea800c1f0 con 0x7fdea8003980 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdea800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebf7fe640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdea8003980 0x7fdea8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebeffd640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdea80047d0 0x7fdea8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 -- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdea8003980 msgr2=0x7fdea8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdea8003980 0x7fdea8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 -- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdea80047d0 msgr2=0x7fdea8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:10.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdea80047d0 0x7fdea8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 -- 172.21.15.2:0/4123299125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8003530 con 0x7fdea8005190 2023-11-04T01:43:10.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebeffd640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdea80047d0 0x7fdea8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.898+0000 7fdebffff640 1 -- 172.21.15.2:0/4123299125 reap_dead start 2023-11-04T01:43:10.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebffff640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdea800b990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009fc0 tx=0x7fdeb801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5334c84e0fc32c7e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb80a5cb0 con 0x7fdea8005190 2023-11-04T01:43:10.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb800f040 con 0x7fdea8005190 2023-11-04T01:43:10.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebe7fc640 1 -- 172.21.15.2:0/4123299125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8003be0 con 0x7fdea8005190 2023-11-04T01:43:10.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- 172.21.15.2:0/4123299125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 msgr2=0x7fdea800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdea800b990 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009fc0 tx=0x7fdeb801cca0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- 172.21.15.2:0/4123299125 shutdown_connections 2023-11-04T01:43:10.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/4123299125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdea800b990 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- 172.21.15.2:0/4123299125 >> 172.21.15.2:0/4123299125 conn(0x7fdec00cfab0 msgr2=0x7fdec00cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:10.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- 172.21.15.2:0/4123299125 shutdown_connections 2023-11-04T01:43:10.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- 172.21.15.2:0/4123299125 wait complete. 2023-11-04T01:43:10.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 Processor -- start 2023-11-04T01:43:10.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- start start 2023-11-04T01:43:10.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdec00c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdec00af9e0 0x7fdec01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdec015b9d0 0x7fdec015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00b11f0 con 0x7fdea8005190 2023-11-04T01:43:10.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00afe60 con 0x7fdec00af9e0 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00b0330 con 0x7fdec015b9d0 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdec00c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdec00c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44396/0 (socket says 172.21.15.2:44396) 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 -- 172.21.15.2:0/3881106413 learned_addr learned my addr 172.21.15.2:0/3881106413 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebeffd640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdec00af9e0 0x7fdec01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebffff640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdec015b9d0 0x7fdec015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 -- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdec015b9d0 msgr2=0x7fdec015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdec015b9d0 0x7fdec015be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 -- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdec00af9e0 msgr2=0x7fdec01556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdec00af9e0 0x7fdec01556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 -- 172.21.15.2:0/3881106413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00b0050 con 0x7fdea8005190 2023-11-04T01:43:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebeffd640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdec00af9e0 0x7fdec01556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdebf7fe640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdec00c4730 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000e7b0 tx=0x7fdeb000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdea7fff640 1 -- 172.21.15.2:0/3881106413 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000c660 con 0x7fdea8005190 2023-11-04T01:43:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdea7fff640 1 -- 172.21.15.2:0/3881106413 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb000c7c0 con 0x7fdea8005190 2023-11-04T01:43:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec015aef0 con 0x7fdea8005190 2023-11-04T01:43:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdea7fff640 1 -- 172.21.15.2:0/3881106413 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000cb70 con 0x7fdea8005190 2023-11-04T01:43:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.902+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec015b4b0 con 0x7fdea8005190 2023-11-04T01:43:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.906+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec015ad50 con 0x7fdea8005190 2023-11-04T01:43:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.906+0000 7fdea7fff640 1 -- 172.21.15.2:0/3881106413 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdeb000ccd0 con 0x7fdea8005190 2023-11-04T01:43:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.906+0000 7fdea7fff640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdeac0664a0 0x7fdeac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.906+0000 7fdea7fff640 1 -- 172.21.15.2:0/3881106413 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdeb0083d50 con 0x7fdea8005190 2023-11-04T01:43:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.906+0000 7fdebeffd640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdeac0664a0 0x7fdeac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.906+0000 7fdebeffd640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdeac0664a0 0x7fdeac068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdec00c4210 tx=0x7fdeb4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:10.910+0000 7fdea7fff640 1 -- 172.21.15.2:0/3881106413 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdec015ad50 con 0x7fdea8005190 2023-11-04T01:43:11.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdec015ad50 con 0x7fdea8005190 2023-11-04T01:43:11.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdea7fff640 1 -- 172.21.15.2:0/3881106413 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdec015ad50 con 0x7fdea8005190 2023-11-04T01:43:11.069 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdeac0664a0 msgr2=0x7fdeac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdeac0664a0 0x7fdeac068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdec00c4210 tx=0x7fdeb4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 msgr2=0x7fdec00c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdec00c4730 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000e7b0 tx=0x7fdeb000ebb0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 shutdown_connections 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdeac0664a0 0x7fdeac068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.066+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdec015b9d0 0x7fdec015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.070+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdec00af9e0 0x7fdec01556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.070+0000 7fdec5bdf640 1 --2- 172.21.15.2:0/3881106413 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdea8005190 0x7fdec00c4730 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.070+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 >> 172.21.15.2:0/3881106413 conn(0x7fdec00cfab0 msgr2=0x7fdec00cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.070+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 shutdown_connections 2023-11-04T01:43:11.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.070+0000 7fdec5bdf640 1 -- 172.21.15.2:0/3881106413 wait complete. 2023-11-04T01:43:11.088 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:11.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4f619c640 1 Processor -- start 2023-11-04T01:43:11.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4f619c640 1 -- start start 2023-11-04T01:43:11.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4f619c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4f00b0890 0x7fc4f00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4f619c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f00ce320 con 0x7fc4f00b0c70 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4f619c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f00ce600 con 0x7fc4f00c9960 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4f619c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f006d2f0 con 0x7fc4f00b0890 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4effff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc4f00b0c70 0x7fc4f00ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41200/0 (socket says 172.21.15.2:41200) 2023-11-04T01:43:11.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4effff640 1 -- 172.21.15.2:0/639534564 learned_addr learned my addr 172.21.15.2:0/639534564 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:11.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/639534564 >> v2:172.21.15.90:3300/0 conn(0x7fc4f00b0890 0x7fc4f00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906678617 0 0) 0x7fc4f00ce320 con 0x7fc4f00b0c70 2023-11-04T01:43:11.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d8003530 con 0x7fc4f00b0c70 2023-11-04T01:43:11.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1779316390 0 0) 0x7fc4d8003530 con 0x7fc4f00b0c70 2023-11-04T01:43:11.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 >> v2:172.21.15.90:3300/0 conn(0x7fc4f00b0890 msgr2=0x7fc4f00cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 --2- 172.21.15.2:0/639534564 >> v2:172.21.15.90:3300/0 conn(0x7fc4f00b0890 0x7fc4f00cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 >> v1:172.21.15.90:6789/0 conn(0x7fc4f00c9960 legacy=0x7fc4f00704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00ce8e0 con 0x7fc4f00b0c70 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc4e0001680 con 0x7fc4f00b0c70 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 >> v1:172.21.15.2:6789/0 conn(0x7fc4f00b0c70 legacy=0x7fc4f00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d80039d0 0x7fc4d8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4d80047d0 0x7fc4d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d8005190 0x7fc4d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f006d2f0 con 0x7fc4d80039d0 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d800c090 con 0x7fc4d8005190 2023-11-04T01:43:11.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d800c250 con 0x7fc4d80047d0 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d80039d0 0x7fc4d8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4effff640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d8005190 0x7fc4d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4eeffd640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4d80047d0 0x7fc4d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ef7fe640 1 -- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4d80047d0 msgr2=0x7fc4d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4d80047d0 0x7fc4d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ef7fe640 1 -- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d8005190 msgr2=0x7fc4d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d8005190 0x7fc4d800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4ef7fe640 1 -- 172.21.15.2:0/639534564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d8003530 con 0x7fc4d80039d0 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4eeffd640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4d80047d0 0x7fc4d8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4effff640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d8005190 0x7fc4d800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.206+0000 7fc4effff640 1 -- 172.21.15.2:0/639534564 reap_dead start 2023-11-04T01:43:11.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d80039d0 0x7fc4d8003df0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8010350 tx=0x7fc4e801ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93de73c193c4cba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80a7e40 con 0x7fc4d80039d0 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e8011040 con 0x7fc4d80039d0 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4ee7fc640 1 -- 172.21.15.2:0/639534564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e800b310 con 0x7fc4d80039d0 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 -- 172.21.15.2:0/639534564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d80039d0 msgr2=0x7fc4d8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d80039d0 0x7fc4d8003df0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8010350 tx=0x7fc4e801ee30 comp rx=0 tx=0).stop 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 -- 172.21.15.2:0/639534564 shutdown_connections 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 --2- 172.21.15.2:0/639534564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4d80039d0 0x7fc4d8003df0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 -- 172.21.15.2:0/639534564 >> 172.21.15.2:0/639534564 conn(0x7fc4f00cebb0 msgr2=0x7fc4f00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 -- 172.21.15.2:0/639534564 shutdown_connections 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 -- 172.21.15.2:0/639534564 wait complete. 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 Processor -- start 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.210+0000 7fc4f619c640 1 -- start start 2023-11-04T01:43:11.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d80039d0 0x7fc4f0156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4f00c5bf0 0x7fc4f00b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4f00c6a90 0x7fc4f01f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00c6600 con 0x7fc4f00c6a90 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00c8dd0 con 0x7fc4d80039d0 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00c60d0 con 0x7fc4f00c5bf0 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4f00c6a90 0x7fc4f01f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4f00c6a90 0x7fc4f01f5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44414/0 (socket says 172.21.15.2:44414) 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 -- 172.21.15.2:0/994737860 learned_addr learned my addr 172.21.15.2:0/994737860 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d80039d0 0x7fc4f0156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4eeffd640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4f00c5bf0 0x7fc4f00b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 -- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4f00c5bf0 msgr2=0x7fc4f00b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4f00c5bf0 0x7fc4f00b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 -- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d80039d0 msgr2=0x7fc4f0156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d80039d0 0x7fc4f0156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 -- 172.21.15.2:0/994737860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00c9020 con 0x7fc4f00c6a90 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4effff640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4f00c6a90 0x7fc4f01f5c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00c9d40 tx=0x7fc4e000d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4d7fff640 1 -- 172.21.15.2:0/994737860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0007440 con 0x7fc4f00c6a90 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4d7fff640 1 -- 172.21.15.2:0/994737860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e00075a0 con 0x7fc4f00c6a90 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f00c9300 con 0x7fc4f00c6a90 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4d7fff640 1 -- 172.21.15.2:0/994737860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0004a30 con 0x7fc4f00c6a90 2023-11-04T01:43:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f01f61b0 con 0x7fc4f00c6a90 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f00c67b0 con 0x7fc4f00c6a90 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4d7fff640 1 -- 172.21.15.2:0/994737860 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4e0004b90 con 0x7fc4f00c6a90 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4d7fff640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4dc0664d0 0x7fc4dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.214+0000 7fc4d7fff640 1 -- 172.21.15.2:0/994737860 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc4e0083a90 con 0x7fc4f00c6a90 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.218+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4dc0664d0 0x7fc4dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.218+0000 7fc4ef7fe640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4dc0664d0 0x7fc4dc068990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80b0000 tx=0x7fc4e8004ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.218+0000 7fc4d7fff640 1 -- 172.21.15.2:0/994737860 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4f00c67b0 con 0x7fc4f00c6a90 2023-11-04T01:43:11.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.386+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4f00c94f0 con 0x7fc4f00c6a90 2023-11-04T01:43:11.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.386+0000 7fc4d7fff640 1 -- 172.21.15.2:0/994737860 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc4e0054980 con 0x7fc4f00c6a90 2023-11-04T01:43:11.390 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4dc0664d0 msgr2=0x7fc4dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4dc0664d0 0x7fc4dc068990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc4e80b0000 tx=0x7fc4e8004ac0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4f00c6a90 msgr2=0x7fc4f01f5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4f00c6a90 0x7fc4f01f5c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00c9d40 tx=0x7fc4e000d960 comp rx=0 tx=0).stop 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 shutdown_connections 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4dc0664d0 0x7fc4dc068990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4f00c6a90 0x7fc4f01f5c70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4f00c5bf0 0x7fc4f00b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 --2- 172.21.15.2:0/994737860 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4d80039d0 0x7fc4f0156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 >> 172.21.15.2:0/994737860 conn(0x7fc4f00cebb0 msgr2=0x7fc4f00c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 shutdown_connections 2023-11-04T01:43:11.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.390+0000 7fc4f619c640 1 -- 172.21.15.2:0/994737860 wait complete. 2023-11-04T01:43:11.409 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:43:11.410 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:11.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-04T01:43:11.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:11.461 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:ceph-fuse[45061]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:11.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:11.469 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:11.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:2023-11-04T01:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:11.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:43:11.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:11.477 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:43:11.523 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:11.523 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:11.529 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:11.530 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:11.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:11.620 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi090.stderr:2023-11-04T01:43:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcb01176640 1 Processor -- start 2023-11-04T01:43:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcb01176640 1 -- start start 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcb01176640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcafc0d0b10 0x7fcafc15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcb01176640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcafc0b49c0 0x7fcafc0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcb01176640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc0b52e0 con 0x7fcafc15d240 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcb01176640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc0d2280 con 0x7fcafc0b49c0 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcb01176640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc0d2560 con 0x7fcafc0d0b10 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafb59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcafc0b49c0 0x7fcafc0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafb59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcafc0b49c0 0x7fcafc0b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42820/0 (socket says 172.21.15.2:42820) 2023-11-04T01:43:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafb59e640 1 -- 172.21.15.2:0/1630046024 learned_addr learned my addr 172.21.15.2:0/1630046024 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafa59c640 1 --2- 172.21.15.2:0/1630046024 >> v2:172.21.15.90:3300/0 conn(0x7fcafc0d0b10 0x7fcafc15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafb59e640 1 -- 172.21.15.2:0/1630046024 >> v2:172.21.15.90:3300/0 conn(0x7fcafc0d0b10 msgr2=0x7fcafc15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafb59e640 1 --2- 172.21.15.2:0/1630046024 >> v2:172.21.15.90:3300/0 conn(0x7fcafc0d0b10 0x7fcafc15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafb59e640 1 -- 172.21.15.2:0/1630046024 >> v1:172.21.15.90:6789/0 conn(0x7fcafc15d240 legacy=0x7fcafc0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafb59e640 1 -- 172.21.15.2:0/1630046024 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc0d2840 con 0x7fcafc0b49c0 2023-11-04T01:43:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.702+0000 7fcafa59c640 1 --2- 172.21.15.2:0/1630046024 >> v2:172.21.15.90:3300/0 conn(0x7fcafc0d0b10 0x7fcafc15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcafb59e640 1 --2- 172.21.15.2:0/1630046024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc0b4da0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcafc067c70 tx=0x7fcaf401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8064989217291f72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcaf9d9b640 1 -- 172.21.15.2:0/1630046024 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40a5880 con 0x7fcafc0b49c0 2023-11-04T01:43:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcaf9d9b640 1 -- 172.21.15.2:0/1630046024 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf40a59e0 con 0x7fcafc0b49c0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcaf9d9b640 1 -- 172.21.15.2:0/1630046024 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40a5d70 con 0x7fcafc0b49c0 2023-11-04T01:43:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 -- 172.21.15.2:0/1630046024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 msgr2=0x7fcafc0b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 --2- 172.21.15.2:0/1630046024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc0b4da0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcafc067c70 tx=0x7fcaf401c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 -- 172.21.15.2:0/1630046024 shutdown_connections 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 --2- 172.21.15.2:0/1630046024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc0b4da0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 --2- 172.21.15.2:0/1630046024 >> v2:172.21.15.90:3300/0 conn(0x7fcafc0d0b10 0x7fcafc15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 -- 172.21.15.2:0/1630046024 >> 172.21.15.2:0/1630046024 conn(0x7fcafc0cf9c0 msgr2=0x7fcafc0cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 -- 172.21.15.2:0/1630046024 shutdown_connections 2023-11-04T01:43:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 -- 172.21.15.2:0/1630046024 wait complete. 2023-11-04T01:43:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 Processor -- start 2023-11-04T01:43:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.706+0000 7fcb01176640 1 -- start start 2023-11-04T01:43:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcafc0d0b10 0x7fcafc0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcafc15d240 0x7fcafc1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc0ca0a0 con 0x7fcafc0b49c0 2023-11-04T01:43:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc154f20 con 0x7fcafc0d0b10 2023-11-04T01:43:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc0cd6a0 con 0x7fcafc15d240 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42832/0 (socket says 172.21.15.2:42832) 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 -- 172.21.15.2:0/1864049341 learned_addr learned my addr 172.21.15.2:0/1864049341 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafa59c640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcafc0d0b10 0x7fcafc0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafb59e640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcafc15d240 0x7fcafc1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 -- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcafc15d240 msgr2=0x7fcafc1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcafc15d240 0x7fcafc1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 -- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcafc0d0b10 msgr2=0x7fcafc0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcafc0d0b10 0x7fcafc0c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 -- 172.21.15.2:0/1864049341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4009b30 con 0x7fcafc0b49c0 2023-11-04T01:43:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafb59e640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcafc15d240 0x7fcafc1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafad9d640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc154330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c370 tx=0x7fcaec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcae37fe640 1 -- 172.21.15.2:0/1864049341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec0052d0 con 0x7fcafc0b49c0 2023-11-04T01:43:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcae37fe640 1 -- 172.21.15.2:0/1864049341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec005430 con 0x7fcafc0b49c0 2023-11-04T01:43:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcae37fe640 1 -- 172.21.15.2:0/1864049341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec007260 con 0x7fcafc0b49c0 2023-11-04T01:43:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc0cd980 con 0x7fcafc0b49c0 2023-11-04T01:43:11.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc0cdf40 con 0x7fcafc0b49c0 2023-11-04T01:43:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcafc0675f0 con 0x7fcafc0b49c0 2023-11-04T01:43:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcae37fe640 1 -- 172.21.15.2:0/1864049341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcaec0073c0 con 0x7fcafc0b49c0 2023-11-04T01:43:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcae37fe640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcae80664d0 0x7fcae8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcae37fe640 1 -- 172.21.15.2:0/1864049341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcaec083210 con 0x7fcafc0b49c0 2023-11-04T01:43:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.710+0000 7fcafa59c640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcae80664d0 0x7fcae8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:11.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.714+0000 7fcafa59c640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcae80664d0 0x7fcae8068990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0c5e50 tx=0x7fcaf0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.714+0000 7fcae37fe640 1 -- 172.21.15.2:0/1864049341 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcaec050670 con 0x7fcafc0b49c0 2023-11-04T01:43:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.874+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcafc15bde0 con 0x7fcafc0b49c0 2023-11-04T01:43:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcae37fe640 1 -- 172.21.15.2:0/1864049341 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7fcaec053c90 con 0x7fcafc0b49c0 2023-11-04T01:43:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:11.880 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcae80664d0 msgr2=0x7fcae8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcae80664d0 0x7fcae8068990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0c5e50 tx=0x7fcaf0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 msgr2=0x7fcafc154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc154330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c370 tx=0x7fcaec00c830 comp rx=0 tx=0).stop 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 shutdown_connections 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcae80664d0 0x7fcae8068990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcafc15d240 0x7fcafc1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcafc0d0b10 0x7fcafc0c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 --2- 172.21.15.2:0/1864049341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcafc0b49c0 0x7fcafc154330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 >> 172.21.15.2:0/1864049341 conn(0x7fcafc0cf9c0 msgr2=0x7fcafc1602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 shutdown_connections 2023-11-04T01:43:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:11.878+0000 7fcb01176640 1 -- 172.21.15.2:0/1864049341 wait complete. 2023-11-04T01:43:11.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:11.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.010+0000 7f4b03c38640 1 Processor -- start 2023-11-04T01:43:12.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.010+0000 7f4b03c38640 1 -- start start 2023-11-04T01:43:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b03c38640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4afc0b0c20 0x7f4afc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b03c38640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4afc15c160 0x7f4afc0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b03c38640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4afc0cb130 con 0x7f4afc15acb0 2023-11-04T01:43:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b03c38640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc15bd40 con 0x7f4afc0b0c20 2023-11-04T01:43:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b03c38640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4afc06fd80 con 0x7f4afc15c160 2023-11-04T01:43:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b019d4640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4afc15acb0 0x7f4afc0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39566/0 (socket says 172.21.15.2:39566) 2023-11-04T01:43:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b019d4640 1 -- 172.21.15.2:0/2732812485 learned_addr learned my addr 172.21.15.2:0/2732812485 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b011d3640 1 --2- 172.21.15.2:0/2732812485 >> v2:172.21.15.2:3300/0 conn(0x7f4afc0b0c20 0x7f4afc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b011d3640 1 -- 172.21.15.2:0/2732812485 >> v2:172.21.15.90:3300/0 conn(0x7f4afc15c160 msgr2=0x7f4afc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b011d3640 1 --2- 172.21.15.2:0/2732812485 >> v2:172.21.15.90:3300/0 conn(0x7f4afc15c160 0x7f4afc0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b011d3640 1 -- 172.21.15.2:0/2732812485 >> v1:172.21.15.2:6789/0 conn(0x7f4afc15acb0 legacy=0x7f4afc0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b011d3640 1 -- 172.21.15.2:0/2732812485 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc15b680 con 0x7f4afc0b0c20 2023-11-04T01:43:12.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b009d2640 1 -- 172.21.15.2:0/2732812485 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425443587 0 0) 0x7f4afc0cb130 con 0x7f4afc15acb0 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b011d3640 1 --2- 172.21.15.2:0/2732812485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc0b0c20 0x7f4afc15b090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b47e0 tx=0x7f4aec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d000f88e1f7be8e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b009d2640 1 -- 172.21.15.2:0/2732812485 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0ab650 con 0x7f4afc0b0c20 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b009d2640 1 -- 172.21.15.2:0/2732812485 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec0ab7b0 con 0x7f4afc0b0c20 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.014+0000 7f4b009d2640 1 -- 172.21.15.2:0/2732812485 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0abb40 con 0x7f4afc0b0c20 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/2732812485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc0b0c20 msgr2=0x7f4afc15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 --2- 172.21.15.2:0/2732812485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc0b0c20 0x7f4afc15b090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0b47e0 tx=0x7f4aec01c430 comp rx=0 tx=0).stop 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/2732812485 shutdown_connections 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 --2- 172.21.15.2:0/2732812485 >> v2:172.21.15.90:3300/0 conn(0x7f4afc15c160 0x7f4afc0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 --2- 172.21.15.2:0/2732812485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc0b0c20 0x7f4afc15b090 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/2732812485 >> 172.21.15.2:0/2732812485 conn(0x7f4afc0cb510 msgr2=0x7f4afc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/2732812485 shutdown_connections 2023-11-04T01:43:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/2732812485 wait complete. 2023-11-04T01:43:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 Processor -- start 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- start start 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4afc0b0c20 0x7f4afc0c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4afc15acb0 0x7f4afc0c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc15c160 0x7f4afc157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0ae410 con 0x7f4afc15c160 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0ae6f0 con 0x7f4afc15acb0 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0ae9d0 con 0x7f4afc0b0c20 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc15c160 0x7f4afc157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc15c160 0x7f4afc157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42850/0 (socket says 172.21.15.2:42850) 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 -- 172.21.15.2:0/4161387700 learned_addr learned my addr 172.21.15.2:0/4161387700 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:12.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 -- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4afc0b0c20 msgr2=0x7f4afc0c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4afc0b0c20 0x7f4afc0c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 -- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4afc15acb0 msgr2=0x7f4afc0c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4afc15acb0 0x7f4afc0c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 -- 172.21.15.2:0/4161387700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec009420 con 0x7f4afc15c160 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b021d5640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc15c160 0x7f4afc157e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4af400b970 tx=0x7f4af400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4af27fc640 1 -- 172.21.15.2:0/4161387700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af400cb40 con 0x7f4afc15c160 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4af27fc640 1 -- 172.21.15.2:0/4161387700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af400ccc0 con 0x7f4afc15c160 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4af27fc640 1 -- 172.21.15.2:0/4161387700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4014680 con 0x7f4afc15c160 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc0aecb0 con 0x7f4afc15c160 2023-11-04T01:43:12.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc0c7290 con 0x7f4afc15c160 2023-11-04T01:43:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.018+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc0aeef0 con 0x7f4afc15c160 2023-11-04T01:43:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.022+0000 7f4af27fc640 1 -- 172.21.15.2:0/4161387700 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4af401d3b0 con 0x7f4afc15c160 2023-11-04T01:43:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.022+0000 7f4af27fc640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ae00664a0 0x7f4ae0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.022+0000 7f4af27fc640 1 -- 172.21.15.2:0/4161387700 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4af4083dc0 con 0x7f4afc15c160 2023-11-04T01:43:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.022+0000 7f4b019d4640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ae00664a0 0x7f4ae0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.022+0000 7f4b019d4640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ae00664a0 0x7f4ae0068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4af80011f0 tx=0x7f4af8007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.026+0000 7f4af27fc640 1 -- 172.21.15.2:0/4161387700 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4afc0aeef0 con 0x7f4afc15c160 2023-11-04T01:43:12.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.174+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4afc0aeef0 con 0x7f4afc15c160 2023-11-04T01:43:12.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.174+0000 7f4af27fc640 1 -- 172.21.15.2:0/4161387700 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4afc0aeef0 con 0x7f4afc15c160 2023-11-04T01:43:12.177 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ae00664a0 msgr2=0x7f4ae0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ae00664a0 0x7f4ae0068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4af80011f0 tx=0x7f4af8007930 comp rx=0 tx=0).stop 2023-11-04T01:43:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc15c160 msgr2=0x7f4afc157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc15c160 0x7f4afc157e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4af400b970 tx=0x7f4af400be30 comp rx=0 tx=0).stop 2023-11-04T01:43:12.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 shutdown_connections 2023-11-04T01:43:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ae00664a0 0x7f4ae0068960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4afc15c160 0x7f4afc157e70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4afc15acb0 0x7f4afc0c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 --2- 172.21.15.2:0/4161387700 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4afc0b0c20 0x7f4afc0c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 >> 172.21.15.2:0/4161387700 conn(0x7f4afc0cb510 msgr2=0x7f4afc15c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 shutdown_connections 2023-11-04T01:43:12.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.178+0000 7f4b03c38640 1 -- 172.21.15.2:0/4161387700 wait complete. 2023-11-04T01:43:12.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44ae489640 1 Processor -- start 2023-11-04T01:43:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44ae489640 1 -- start start 2023-11-04T01:43:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44ae489640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f44a815acb0 0x7f44a815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44ae489640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 0x7f44a80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44ae489640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a80cb130 con 0x7f44a815c160 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44ae489640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a815bd40 con 0x7f44a815acb0 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44ae489640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a806fd80 con 0x7f44a80b0c20 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44a77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f44a815c160 0x7f44a80b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39574/0 (socket says 172.21.15.2:39574) 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.306+0000 7f44a77fe640 1 -- 172.21.15.2:0/2620305915 learned_addr learned my addr 172.21.15.2:0/2620305915 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44aca26640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 0x7f44a80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a7fff640 1 --2- 172.21.15.2:0/2620305915 >> v2:172.21.15.90:3300/0 conn(0x7f44a815acb0 0x7f44a815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232321483 0 0) 0x7f44a80cb130 con 0x7f44a815c160 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4490003530 con 0x7f44a815c160 2023-11-04T01:43:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444908327 0 0) 0x7f4490003530 con 0x7f44a815c160 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 msgr2=0x7f44a80ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 0x7f44a80ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 >> v2:172.21.15.90:3300/0 conn(0x7f44a815acb0 msgr2=0x7f44a815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 --2- 172.21.15.2:0/2620305915 >> v2:172.21.15.90:3300/0 conn(0x7f44a815acb0 0x7f44a815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a815b680 con 0x7f44a815c160 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f449c001680 con 0x7f44a815c160 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 >> v1:172.21.15.2:6789/0 conn(0x7f44a815c160 legacy=0x7f44a80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 0x7f4490003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4490003f50 0x7f44900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490004d10 0x7f4490005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a815bd40 con 0x7f4490003f50 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449000b990 con 0x7f4490004d10 2023-11-04T01:43:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449000bad0 con 0x7f44a80b0c20 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a77fe640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4490003f50 0x7f44900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a7fff640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 0x7f4490003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44aca26640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490004d10 0x7f4490005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a77fe640 1 -- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 msgr2=0x7f4490003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a77fe640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80b0c20 0x7f4490003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a77fe640 1 -- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490004d10 msgr2=0x7f4490005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a77fe640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490004d10 0x7f4490005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a77fe640 1 -- 172.21.15.2:0/2620305915 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490003530 con 0x7f4490003f50 2023-11-04T01:43:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a77fe640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4490003f50 0x7f44900047d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c110 tx=0x7f449c01f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8d0bb717c76b3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0a8ce0 con 0x7f4490003f50 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c0a8e40 con 0x7f4490003f50 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44a6ffd640 1 -- 172.21.15.2:0/2620305915 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c005b20 con 0x7f4490003f50 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44ae489640 1 -- 172.21.15.2:0/2620305915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4490003f50 msgr2=0x7f44900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44ae489640 1 --2- 172.21.15.2:0/2620305915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4490003f50 0x7f44900047d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c110 tx=0x7f449c01f2b0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44aca26640 1 -- 172.21.15.2:0/2620305915 reap_dead start 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44ae489640 1 -- 172.21.15.2:0/2620305915 shutdown_connections 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44ae489640 1 -- 172.21.15.2:0/2620305915 >> 172.21.15.2:0/2620305915 conn(0x7f44a80cb510 msgr2=0x7f44a80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44ae489640 1 -- 172.21.15.2:0/2620305915 shutdown_connections 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.310+0000 7f44ae489640 1 -- 172.21.15.2:0/2620305915 wait complete. 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 Processor -- start 2023-11-04T01:43:12.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 -- start start 2023-11-04T01:43:12.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490003f50 0x7f44a80afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a80b3690 0x7f44a8155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a806b300 0x7f44a806b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80b0a30 con 0x7f44a80b3690 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a81f5db0 con 0x7f4490003f50 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80b0190 con 0x7f44a806b300 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a80b3690 0x7f44a8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a80b3690 0x7f44a8155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42872/0 (socket says 172.21.15.2:42872) 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 -- 172.21.15.2:0/1234055432 learned_addr learned my addr 172.21.15.2:0/1234055432 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44aca26640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a806b300 0x7f44a806b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a7fff640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490003f50 0x7f44a80afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 -- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a806b300 msgr2=0x7f44a806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a806b300 0x7f44a806b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 -- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490003f50 msgr2=0x7f44a80afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490003f50 0x7f44a80afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 -- 172.21.15.2:0/1234055432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80b0470 con 0x7f44a80b3690 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a77fe640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a80b3690 0x7f44a8155210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f449c000c10 tx=0x7f4490005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a4ff9640 1 -- 172.21.15.2:0/1234055432 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c0049f0 con 0x7f44a80b3690 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a4ff9640 1 -- 172.21.15.2:0/1234055432 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c0b6070 con 0x7f44a80b3690 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a80b0750 con 0x7f44a80b3690 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44a4ff9640 1 -- 172.21.15.2:0/1234055432 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449c004db0 con 0x7f44a80b3690 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a8155920 con 0x7f44a80b3690 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.314+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a80744a0 con 0x7f44a80b3690 2023-11-04T01:43:12.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.318+0000 7f44a4ff9640 1 -- 172.21.15.2:0/1234055432 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f449c0b2440 con 0x7f44a80b3690 2023-11-04T01:43:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.318+0000 7f44a4ff9640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44940664d0 0x7f4494068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.318+0000 7f44a4ff9640 1 -- 172.21.15.2:0/1234055432 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f449c0b8070 con 0x7f44a80b3690 2023-11-04T01:43:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.318+0000 7f44a7fff640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44940664d0 0x7f4494068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.318+0000 7f44a7fff640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44940664d0 0x7f4494068990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4498009970 tx=0x7f4498008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.322+0000 7f44a4ff9640 1 -- 172.21.15.2:0/1234055432 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f449c0ee410 con 0x7f44a80b3690 2023-11-04T01:43:12.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44a8155920 con 0x7f44a80b3690 2023-11-04T01:43:12.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44a4ff9640 1 -- 172.21.15.2:0/1234055432 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44a8155920 con 0x7f44a80b3690 2023-11-04T01:43:12.479 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44940664d0 msgr2=0x7f4494068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44940664d0 0x7f4494068990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4498009970 tx=0x7f4498008040 comp rx=0 tx=0).stop 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a80b3690 msgr2=0x7f44a8155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a80b3690 0x7f44a8155210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f449c000c10 tx=0x7f4490005800 comp rx=0 tx=0).stop 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 shutdown_connections 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f44940664d0 0x7f4494068990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a806b300 0x7f44a806b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a80b3690 0x7f44a8155210 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 --2- 172.21.15.2:0/1234055432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4490003f50 0x7f44a80afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 >> 172.21.15.2:0/1234055432 conn(0x7f44a80cb510 msgr2=0x7f44a80cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 shutdown_connections 2023-11-04T01:43:12.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.478+0000 7f44ae489640 1 -- 172.21.15.2:0/1234055432 wait complete. 2023-11-04T01:43:12.498 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 Processor -- start 2023-11-04T01:43:12.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 -- start start 2023-11-04T01:43:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27fc1617c0 0x7f27fc165c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc0cb700 0x7f27fc0ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27fc0ce990 0x7f27fc0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc0cee20 con 0x7f27fc0ce990 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27fc0ca1a0 con 0x7f27fc1617c0 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f2802055640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc06a160 con 0x7f27fc0cb700 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27fc0ce990 0x7f27fc0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27fc0ce990 0x7f27fc0ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42886/0 (socket says 172.21.15.2:42886) 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 -- 172.21.15.2:0/1836251899 learned_addr learned my addr 172.21.15.2:0/1836251899 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27faffd640 1 --2- 172.21.15.2:0/1836251899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc0cb700 0x7f27fc0ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fb7fe640 1 --2- 172.21.15.2:0/1836251899 >> v2:172.21.15.90:3300/0 conn(0x7f27fc1617c0 0x7f27fc165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 -- 172.21.15.2:0/1836251899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc0cb700 msgr2=0x7f27fc0ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 --2- 172.21.15.2:0/1836251899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc0cb700 0x7f27fc0ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 -- 172.21.15.2:0/1836251899 >> v2:172.21.15.90:3300/0 conn(0x7f27fc1617c0 msgr2=0x7f27fc165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 --2- 172.21.15.2:0/1836251899 >> v2:172.21.15.90:3300/0 conn(0x7f27fc1617c0 0x7f27fc165c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 -- 172.21.15.2:0/1836251899 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc161ba0 con 0x7f27fc0ce990 2023-11-04T01:43:12.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fbfff640 1 --2- 172.21.15.2:0/1836251899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0ccf10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f27fc06dd20 tx=0x7f27f401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b09be682d4195a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.618+0000 7f27fa7fc640 1 -- 172.21.15.2:0/1836251899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40ab600 con 0x7f27fc0ce990 2023-11-04T01:43:12.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27fa7fc640 1 -- 172.21.15.2:0/1836251899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f40a7050 con 0x7f27fc0ce990 2023-11-04T01:43:12.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27fa7fc640 1 -- 172.21.15.2:0/1836251899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40ab980 con 0x7f27fc0ce990 2023-11-04T01:43:12.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- 172.21.15.2:0/1836251899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 msgr2=0x7f27fc0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 --2- 172.21.15.2:0/1836251899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0ccf10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f27fc06dd20 tx=0x7f27f401c240 comp rx=0 tx=0).stop 2023-11-04T01:43:12.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- 172.21.15.2:0/1836251899 shutdown_connections 2023-11-04T01:43:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 --2- 172.21.15.2:0/1836251899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0ccf10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 --2- 172.21.15.2:0/1836251899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc0cb700 0x7f27fc0ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 --2- 172.21.15.2:0/1836251899 >> v2:172.21.15.90:3300/0 conn(0x7f27fc1617c0 0x7f27fc165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- 172.21.15.2:0/1836251899 >> 172.21.15.2:0/1836251899 conn(0x7f27fc0b0e30 msgr2=0x7f27fc0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- 172.21.15.2:0/1836251899 shutdown_connections 2023-11-04T01:43:12.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- 172.21.15.2:0/1836251899 wait complete. 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 Processor -- start 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- start start 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc0cb700 0x7f27fc156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc1617c0 0x7f27fc0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc0b2fa0 con 0x7f27fc0ce990 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc156e80 con 0x7f27fc0cb700 2023-11-04T01:43:12.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc1584e0 con 0x7f27fc1617c0 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42898/0 (socket says 172.21.15.2:42898) 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 -- 172.21.15.2:0/947162230 learned_addr learned my addr 172.21.15.2:0/947162230 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 -- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc1617c0 msgr2=0x7f27fc0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc1617c0 0x7f27fc0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 -- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc0cb700 msgr2=0x7f27fc156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc0cb700 0x7f27fc156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 -- 172.21.15.2:0/947162230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f40094d0 con 0x7f27fc0ce990 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27faffd640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0c6830 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d7d0 tx=0x7f27e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27f3fff640 1 -- 172.21.15.2:0/947162230 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40096a0 con 0x7f27fc0ce990 2023-11-04T01:43:12.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27f3fff640 1 -- 172.21.15.2:0/947162230 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4009800 con 0x7f27fc0ce990 2023-11-04T01:43:12.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f27f3fff640 1 -- 172.21.15.2:0/947162230 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4009bb0 con 0x7f27fc0ce990 2023-11-04T01:43:12.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc0b29e0 con 0x7f27fc0ce990 2023-11-04T01:43:12.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.622+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc158170 con 0x7f27fc0ce990 2023-11-04T01:43:12.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.626+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc157fd0 con 0x7f27fc0ce990 2023-11-04T01:43:12.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.626+0000 7f27f3fff640 1 -- 172.21.15.2:0/947162230 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27e4009d10 con 0x7f27fc0ce990 2023-11-04T01:43:12.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.626+0000 7f27f3fff640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27dc0664d0 0x7f27dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.626+0000 7f27f3fff640 1 -- 172.21.15.2:0/947162230 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f27e4084520 con 0x7f27fc0ce990 2023-11-04T01:43:12.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.626+0000 7f27fb7fe640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27dc0664d0 0x7f27dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.626+0000 7f27fb7fe640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27dc0664d0 0x7f27dc068990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0070b0 tx=0x7f27ec007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.630+0000 7f27f3fff640 1 -- 172.21.15.2:0/947162230 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27fc157fd0 con 0x7f27fc0ce990 2023-11-04T01:43:12.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27fc157fd0 con 0x7f27fc0ce990 2023-11-04T01:43:12.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f27f3fff640 1 -- 172.21.15.2:0/947162230 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27fc157fd0 con 0x7f27fc0ce990 2023-11-04T01:43:12.780 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27dc0664d0 msgr2=0x7f27dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27dc0664d0 0x7f27dc068990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0070b0 tx=0x7f27ec007040 comp rx=0 tx=0).stop 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 msgr2=0x7f27fc0c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0c6830 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d7d0 tx=0x7f27e400dc90 comp rx=0 tx=0).stop 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 shutdown_connections 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27dc0664d0 0x7f27dc068990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27fc1617c0 0x7f27fc0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27fc0ce990 0x7f27fc0c6830 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 --2- 172.21.15.2:0/947162230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27fc0cb700 0x7f27fc156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 >> 172.21.15.2:0/947162230 conn(0x7f27fc0b0e30 msgr2=0x7f27fc071d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 shutdown_connections 2023-11-04T01:43:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.778+0000 7f2802055640 1 -- 172.21.15.2:0/947162230 wait complete. 2023-11-04T01:43:12.797 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:12.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.918+0000 7f6c56b81640 1 Processor -- start 2023-11-04T01:43:12.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.918+0000 7f6c56b81640 1 -- start start 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c56b81640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6c500b0630 0x7f6c500b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c56b81640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c5015ed00 0x7f6c5015f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c56b81640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c500b0fd0 con 0x7f6c5015b320 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c56b81640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5006c7b0 con 0x7f6c5015ed00 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c56b81640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5006bb30 con 0x7f6c500b0630 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c5015ed00 0x7f6c5015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c5015ed00 0x7f6c5015f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42900/0 (socket says 172.21.15.2:42900) 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 -- 172.21.15.2:0/893228480 learned_addr learned my addr 172.21.15.2:0/893228480 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c4ffff640 1 --2- 172.21.15.2:0/893228480 >> v2:172.21.15.90:3300/0 conn(0x7f6c500b0630 0x7f6c500b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 -- 172.21.15.2:0/893228480 >> v2:172.21.15.90:3300/0 conn(0x7f6c500b0630 msgr2=0x7f6c500b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 --2- 172.21.15.2:0/893228480 >> v2:172.21.15.90:3300/0 conn(0x7f6c500b0630 0x7f6c500b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 -- 172.21.15.2:0/893228480 >> v1:172.21.15.90:6789/0 conn(0x7f6c5015b320 legacy=0x7f6c5006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:12.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 -- 172.21.15.2:0/893228480 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5006be10 con 0x7f6c5015ed00 2023-11-04T01:43:12.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c4ffff640 1 --2- 172.21.15.2:0/893228480 >> v2:172.21.15.90:3300/0 conn(0x7f6c500b0630 0x7f6c500b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:12.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c5511e640 1 --2- 172.21.15.2:0/893228480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c5015ed00 0x7f6c5015f190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6c500cea40 tx=0x7f6c4801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148fee8498a9168b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c4f7fe640 1 -- 172.21.15.2:0/893228480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480a5790 con 0x7f6c5015ed00 2023-11-04T01:43:12.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c4f7fe640 1 -- 172.21.15.2:0/893228480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c480a58f0 con 0x7f6c5015ed00 2023-11-04T01:43:12.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.922+0000 7f6c4f7fe640 1 -- 172.21.15.2:0/893228480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480a5c80 con 0x7f6c5015ed00 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- 172.21.15.2:0/893228480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c5015ed00 msgr2=0x7f6c5015f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 --2- 172.21.15.2:0/893228480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c5015ed00 0x7f6c5015f190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6c500cea40 tx=0x7f6c4801c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- 172.21.15.2:0/893228480 shutdown_connections 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 --2- 172.21.15.2:0/893228480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c5015ed00 0x7f6c5015f190 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 --2- 172.21.15.2:0/893228480 >> v2:172.21.15.90:3300/0 conn(0x7f6c500b0630 0x7f6c500b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- 172.21.15.2:0/893228480 >> 172.21.15.2:0/893228480 conn(0x7f6c500cebb0 msgr2=0x7f6c500cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- 172.21.15.2:0/893228480 shutdown_connections 2023-11-04T01:43:12.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- 172.21.15.2:0/893228480 wait complete. 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 Processor -- start 2023-11-04T01:43:12.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- start start 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c500b0630 0x7f6c50146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c5015ed00 0x7f6c5015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c500c46a0 0x7f6c50159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500c4b30 con 0x7f6c500c46a0 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500c4e10 con 0x7f6c500b0630 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500c50f0 con 0x7f6c5015ed00 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c500c46a0 0x7f6c50159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c500c46a0 0x7f6c50159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42910/0 (socket says 172.21.15.2:42910) 2023-11-04T01:43:12.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 -- 172.21.15.2:0/1912436969 learned_addr learned my addr 172.21.15.2:0/1912436969 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5491d640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c500b0630 0x7f6c50146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c4ffff640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c5015ed00 0x7f6c5015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 -- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c5015ed00 msgr2=0x7f6c5015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c5015ed00 0x7f6c5015c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 -- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c500b0630 msgr2=0x7f6c50146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c500b0630 0x7f6c50146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 -- 172.21.15.2:0/1912436969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c48009b30 con 0x7f6c500c46a0 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5491d640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c500b0630 0x7f6c50146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c5511e640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c500c46a0 0x7f6c50159970 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6c4801a500 tx=0x7f6c48019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c4d7fa640 1 -- 172.21.15.2:0/1912436969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480b8670 con 0x7f6c500c46a0 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c4d7fa640 1 -- 172.21.15.2:0/1912436969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c480b87d0 con 0x7f6c500c46a0 2023-11-04T01:43:12.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c4d7fa640 1 -- 172.21.15.2:0/1912436969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480b8b80 con 0x7f6c500c46a0 2023-11-04T01:43:12.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5015fc60 con 0x7f6c500c46a0 2023-11-04T01:43:12.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.926+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c50146680 con 0x7f6c500c46a0 2023-11-04T01:43:12.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.930+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c500cc7b0 con 0x7f6c500c46a0 2023-11-04T01:43:12.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.930+0000 7f6c4d7fa640 1 -- 172.21.15.2:0/1912436969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c480b8ce0 con 0x7f6c500c46a0 2023-11-04T01:43:12.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.930+0000 7f6c4d7fa640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c3c0664d0 0x7f6c3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:12.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.930+0000 7f6c4d7fa640 1 -- 172.21.15.2:0/1912436969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6c4811f3f0 con 0x7f6c500c46a0 2023-11-04T01:43:12.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.930+0000 7f6c5491d640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c3c0664d0 0x7f6c3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:12.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.930+0000 7f6c5491d640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c3c0664d0 0x7f6c3c068990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c400016e0 tx=0x7f6c40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:12.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:12.934+0000 7f6c4d7fa640 1 -- 172.21.15.2:0/1912436969 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c480ec8e0 con 0x7f6c500c46a0 2023-11-04T01:43:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.098+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c5006ffd0 con 0x7f6c500c46a0 2023-11-04T01:43:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.098+0000 7f6c4d7fa640 1 -- 172.21.15.2:0/1912436969 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c480eff00 con 0x7f6c500c46a0 2023-11-04T01:43:13.102 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:13.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c3c0664d0 msgr2=0x7f6c3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c3c0664d0 0x7f6c3c068990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c400016e0 tx=0x7f6c40009040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c500c46a0 msgr2=0x7f6c50159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c500c46a0 0x7f6c50159970 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6c4801a500 tx=0x7f6c48019670 comp rx=0 tx=0).stop 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 shutdown_connections 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c3c0664d0 0x7f6c3c068990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c500c46a0 0x7f6c50159970 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c5015ed00 0x7f6c5015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 --2- 172.21.15.2:0/1912436969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c500b0630 0x7f6c50146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 >> 172.21.15.2:0/1912436969 conn(0x7f6c500cebb0 msgr2=0x7f6c500cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 shutdown_connections 2023-11-04T01:43:13.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.102+0000 7f6c56b81640 1 -- 172.21.15.2:0/1912436969 wait complete. 2023-11-04T01:43:13.120 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:13.121 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:13.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:13.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.234+0000 7f34724ca640 1 Processor -- start 2023-11-04T01:43:13.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.234+0000 7f34724ca640 1 -- start start 2023-11-04T01:43:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f346c15afd0 0x7f346c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f346c06f8f0 0x7f346c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c0c2670 con 0x7f346c0b0b70 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c070140 con 0x7f346c15afd0 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346c15fc90 con 0x7f346c06f8f0 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f346c15afd0 0x7f346c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f346c15afd0 0x7f346c0715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42922/0 (socket says 172.21.15.2:42922) 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 -- 172.21.15.2:0/3208114549 learned_addr learned my addr 172.21.15.2:0/3208114549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 -- 172.21.15.2:0/3208114549 >> v2:172.21.15.90:3300/0 conn(0x7f346c06f8f0 msgr2=0x7f346c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346b7fe640 1 --2- 172.21.15.2:0/3208114549 >> v2:172.21.15.90:3300/0 conn(0x7f346c06f8f0 0x7f346c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 --2- 172.21.15.2:0/3208114549 >> v2:172.21.15.90:3300/0 conn(0x7f346c06f8f0 0x7f346c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 -- 172.21.15.2:0/3208114549 >> v1:172.21.15.90:6789/0 conn(0x7f346c0b0b70 legacy=0x7f346c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 -- 172.21.15.2:0/3208114549 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c06bc30 con 0x7f346c15afd0 2023-11-04T01:43:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346bfff640 1 --2- 172.21.15.2:0/3208114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c15afd0 0x7f346c0715d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f346c0ce900 tx=0x7f345c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1684a111e0c31df4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346affd640 1 -- 172.21.15.2:0/3208114549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0ab600 con 0x7f346c15afd0 2023-11-04T01:43:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346affd640 1 -- 172.21.15.2:0/3208114549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c0a7050 con 0x7f346c15afd0 2023-11-04T01:43:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f346affd640 1 -- 172.21.15.2:0/3208114549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0ab980 con 0x7f346c15afd0 2023-11-04T01:43:13.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- 172.21.15.2:0/3208114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c15afd0 msgr2=0x7f346c0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 --2- 172.21.15.2:0/3208114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c15afd0 0x7f346c0715d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f346c0ce900 tx=0x7f345c01c4c0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- 172.21.15.2:0/3208114549 shutdown_connections 2023-11-04T01:43:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 --2- 172.21.15.2:0/3208114549 >> v2:172.21.15.90:3300/0 conn(0x7f346c06f8f0 0x7f346c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 --2- 172.21.15.2:0/3208114549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c15afd0 0x7f346c0715d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- 172.21.15.2:0/3208114549 >> 172.21.15.2:0/3208114549 conn(0x7f346c0cebb0 msgr2=0x7f346c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- 172.21.15.2:0/3208114549 shutdown_connections 2023-11-04T01:43:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.238+0000 7f34724ca640 1 -- 172.21.15.2:0/3208114549 wait complete. 2023-11-04T01:43:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 Processor -- start 2023-11-04T01:43:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 -- start start 2023-11-04T01:43:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f346c06f8f0 0x7f346c153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c0b0b70 0x7f346c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f346c15afd0 0x7f346c155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c153aa0 con 0x7f346c0b0b70 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c15b6d0 con 0x7f346c15afd0 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0c6b80 con 0x7f346c06f8f0 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c0b0b70 0x7f346c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c0b0b70 0x7f346c0c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42934/0 (socket says 172.21.15.2:42934) 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 -- 172.21.15.2:0/1840917917 learned_addr learned my addr 172.21.15.2:0/1840917917 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346bfff640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f346c06f8f0 0x7f346c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f3470a67640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f346c15afd0 0x7f346c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 -- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f346c06f8f0 msgr2=0x7f346c153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f346c06f8f0 0x7f346c153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 -- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f346c15afd0 msgr2=0x7f346c155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f346c15afd0 0x7f346c155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 -- 172.21.15.2:0/1840917917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0094d0 con 0x7f346c0b0b70 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f346b7fe640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c0b0b70 0x7f346c0c8540 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f346000c7f0 tx=0x7f346000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f3468ff9640 1 -- 172.21.15.2:0/1840917917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460007820 con 0x7f346c0b0b70 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f3468ff9640 1 -- 172.21.15.2:0/1840917917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460007980 con 0x7f346c0b0b70 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c0c6e60 con 0x7f346c0b0b70 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f3468ff9640 1 -- 172.21.15.2:0/1840917917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460007d30 con 0x7f346c0b0b70 2023-11-04T01:43:13.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c15bc00 con 0x7f346c0b0b70 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.242+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c0744a0 con 0x7f346c0b0b70 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.246+0000 7f3468ff9640 1 -- 172.21.15.2:0/1840917917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f34600113f0 con 0x7f346c0b0b70 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.246+0000 7f3468ff9640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34580664a0 0x7f3458068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.246+0000 7f3468ff9640 1 -- 172.21.15.2:0/1840917917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f34600840e0 con 0x7f346c0b0b70 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.246+0000 7f346bfff640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34580664a0 0x7f3458068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.246+0000 7f346bfff640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34580664a0 0x7f3458068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f345c0ad000 tx=0x7f345c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.250+0000 7f3468ff9640 1 -- 172.21.15.2:0/1840917917 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34600515d0 con 0x7f346c0b0b70 2023-11-04T01:43:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.402+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f346c06cba0 con 0x7f346c0b0b70 2023-11-04T01:43:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.402+0000 7f3468ff9640 1 -- 172.21.15.2:0/1840917917 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7f3460054bf0 con 0x7f346c0b0b70 2023-11-04T01:43:13.406 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:13.406 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:13.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34580664a0 msgr2=0x7f3458068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34580664a0 0x7f3458068960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f345c0ad000 tx=0x7f345c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c0b0b70 msgr2=0x7f346c0c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c0b0b70 0x7f346c0c8540 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f346000c7f0 tx=0x7f346000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 shutdown_connections 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34580664a0 0x7f3458068960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f346c15afd0 0x7f346c155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f346c0b0b70 0x7f346c0c8540 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 --2- 172.21.15.2:0/1840917917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f346c06f8f0 0x7f346c153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 >> 172.21.15.2:0/1840917917 conn(0x7f346c0cebb0 msgr2=0x7f346c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 shutdown_connections 2023-11-04T01:43:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.406+0000 7f34724ca640 1 -- 172.21.15.2:0/1840917917 wait complete. 2023-11-04T01:43:13.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:13.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:13.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f501d0640 1 Processor -- start 2023-11-04T01:43:13.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f501d0640 1 -- start start 2023-11-04T01:43:13.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f501d0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f501d0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f480b0c20 0x7f4f480caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f501d0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4815f990 con 0x7f4f4815ad90 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f501d0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4815f570 con 0x7f4f480b0c20 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f501d0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480cb2c0 con 0x7f4f4815b170 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4e76d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f480b0c20 0x7f4f480caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4e76d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f480b0c20 0x7f4f480caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42944/0 (socket says 172.21.15.2:42944) 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4e76d640 1 -- 172.21.15.2:0/3323023255 learned_addr learned my addr 172.21.15.2:0/3323023255 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4d76b640 1 --2- 172.21.15.2:0/3323023255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4e76d640 1 -- 172.21.15.2:0/3323023255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 msgr2=0x7f4f480ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4e76d640 1 --2- 172.21.15.2:0/3323023255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4e76d640 1 -- 172.21.15.2:0/3323023255 >> v1:172.21.15.90:6789/0 conn(0x7f4f4815ad90 legacy=0x7f4f480b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.538+0000 7f4f4e76d640 1 -- 172.21.15.2:0/3323023255 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4815ec10 con 0x7f4f480b0c20 2023-11-04T01:43:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4e76d640 1 --2- 172.21.15.2:0/3323023255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f480b0c20 0x7f4f480caad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009e80 tx=0x7f4f4001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dccb0c8dbde571 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4cf6a640 1 -- 172.21.15.2:0/3323023255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400a5820 con 0x7f4f480b0c20 2023-11-04T01:43:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4cf6a640 1 -- 172.21.15.2:0/3323023255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f400a5980 con 0x7f4f480b0c20 2023-11-04T01:43:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4cf6a640 1 -- 172.21.15.2:0/3323023255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400a5d10 con 0x7f4f480b0c20 2023-11-04T01:43:13.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- 172.21.15.2:0/3323023255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f480b0c20 msgr2=0x7f4f480caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 --2- 172.21.15.2:0/3323023255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f480b0c20 0x7f4f480caad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009e80 tx=0x7f4f4001c960 comp rx=0 tx=0).stop 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- 172.21.15.2:0/3323023255 shutdown_connections 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 --2- 172.21.15.2:0/3323023255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f480b0c20 0x7f4f480caad0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 --2- 172.21.15.2:0/3323023255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- 172.21.15.2:0/3323023255 >> 172.21.15.2:0/3323023255 conn(0x7f4f480cb510 msgr2=0x7f4f480cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- 172.21.15.2:0/3323023255 shutdown_connections 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- 172.21.15.2:0/3323023255 wait complete. 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 Processor -- start 2023-11-04T01:43:13.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- start start 2023-11-04T01:43:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f480b0c20 0x7f4f48151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f4815ad90 0x7f4f480cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480c8830 con 0x7f4f4815ad90 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4815c310 con 0x7f4f480b0c20 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480c8170 con 0x7f4f4815b170 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f4815ad90 0x7f4f480cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f4815ad90 0x7f4f480cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42950/0 (socket says 172.21.15.2:42950) 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 -- 172.21.15.2:0/767102354 learned_addr learned my addr 172.21.15.2:0/767102354 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4e76d640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4df6c640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f480b0c20 0x7f4f48151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 -- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 msgr2=0x7f4f480cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 -- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f480b0c20 msgr2=0x7f4f48151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f480b0c20 0x7f4f48151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 -- 172.21.15.2:0/767102354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40009b30 con 0x7f4f4815ad90 2023-11-04T01:43:13.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4df6c640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f480b0c20 0x7f4f48151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f4d76b640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f4815ad90 0x7f4f480cc990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800d5f0 tx=0x7f4f3800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f3e7fc640 1 -- 172.21.15.2:0/767102354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380125f0 con 0x7f4f4815ad90 2023-11-04T01:43:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f3e7fc640 1 -- 172.21.15.2:0/767102354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f38012750 con 0x7f4f4815ad90 2023-11-04T01:43:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f3e7fc640 1 -- 172.21.15.2:0/767102354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38012ae0 con 0x7f4f4815ad90 2023-11-04T01:43:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f480c8450 con 0x7f4f4815ad90 2023-11-04T01:43:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.542+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f48152660 con 0x7f4f4815ad90 2023-11-04T01:43:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.546+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f480744a0 con 0x7f4f4815ad90 2023-11-04T01:43:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.546+0000 7f4f3e7fc640 1 -- 172.21.15.2:0/767102354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f38012c40 con 0x7f4f4815ad90 2023-11-04T01:43:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.546+0000 7f4f3e7fc640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f2c0664a0 0x7f4f2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.546+0000 7f4f3e7fc640 1 -- 172.21.15.2:0/767102354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4f380843b0 con 0x7f4f4815ad90 2023-11-04T01:43:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.546+0000 7f4f4df6c640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f2c0664a0 0x7f4f2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.546+0000 7f4f4df6c640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f2c0664a0 0x7f4f2c068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f481550d0 tx=0x7f4f44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.550+0000 7f4f3e7fc640 1 -- 172.21.15.2:0/767102354 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f38051800 con 0x7f4f4815ad90 2023-11-04T01:43:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f480b4460 con 0x7f4f4815ad90 2023-11-04T01:43:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f3e7fc640 1 -- 172.21.15.2:0/767102354 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f38007380 con 0x7f4f4815ad90 2023-11-04T01:43:13.703 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f2c0664a0 msgr2=0x7f4f2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f2c0664a0 0x7f4f2c068960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f481550d0 tx=0x7f4f44009040 comp rx=0 tx=0).stop 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f4815ad90 msgr2=0x7f4f480cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f4815ad90 0x7f4f480cc990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800d5f0 tx=0x7f4f3800dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 shutdown_connections 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f2c0664a0 0x7f4f2c068960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f4815b170 0x7f4f480cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f4815ad90 0x7f4f480cc990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 --2- 172.21.15.2:0/767102354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f480b0c20 0x7f4f48151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 >> 172.21.15.2:0/767102354 conn(0x7f4f480cb510 msgr2=0x7f4f480ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 shutdown_connections 2023-11-04T01:43:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.702+0000 7f4f501d0640 1 -- 172.21.15.2:0/767102354 wait complete. 2023-11-04T01:43:13.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:13.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.842+0000 7f1fee494640 1 Processor -- start 2023-11-04T01:43:13.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.842+0000 7f1fee494640 1 -- start start 2023-11-04T01:43:13.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1fe815c160 0x7f1fe80b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fe80b0a50 0x7f1fe80ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe815bd40 con 0x7f1fe80b0a50 2023-11-04T01:43:13.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe806fd80 con 0x7f1fe815c160 2023-11-04T01:43:13.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80b0ee0 con 0x7f1fe815acb0 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fe80b0a50 0x7f1fe80ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1fe80b0a50 0x7f1fe80ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42952/0 (socket says 172.21.15.2:42952) 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 -- 172.21.15.2:0/1625317360 learned_addr learned my addr 172.21.15.2:0/1625317360 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fe77fe640 1 --2- 172.21.15.2:0/1625317360 >> v2:172.21.15.90:3300/0 conn(0x7f1fe815c160 0x7f1fe80b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fe7fff640 1 --2- 172.21.15.2:0/1625317360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 -- 172.21.15.2:0/1625317360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 msgr2=0x7f1fe815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 --2- 172.21.15.2:0/1625317360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 -- 172.21.15.2:0/1625317360 >> v2:172.21.15.90:3300/0 conn(0x7f1fe815c160 msgr2=0x7f1fe80b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 --2- 172.21.15.2:0/1625317360 >> v2:172.21.15.90:3300/0 conn(0x7f1fe815c160 0x7f1fe80b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 -- 172.21.15.2:0/1625317360 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80cb130 con 0x7f1fe80b0a50 2023-11-04T01:43:13.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fe77fe640 1 --2- 172.21.15.2:0/1625317360 >> v2:172.21.15.90:3300/0 conn(0x7f1fe815c160 0x7f1fe80b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:13.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1feca31640 1 --2- 172.21.15.2:0/1625317360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe80ca490 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80cc260 tx=0x7f1fe001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f687f082d4a84e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fe6ffd640 1 -- 172.21.15.2:0/1625317360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00a5820 con 0x7f1fe80b0a50 2023-11-04T01:43:13.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fe6ffd640 1 -- 172.21.15.2:0/1625317360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe00a5980 con 0x7f1fe80b0a50 2023-11-04T01:43:13.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fe6ffd640 1 -- 172.21.15.2:0/1625317360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00a5d10 con 0x7f1fe80b0a50 2023-11-04T01:43:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- 172.21.15.2:0/1625317360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 msgr2=0x7f1fe80ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 --2- 172.21.15.2:0/1625317360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe80ca490 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80cc260 tx=0x7f1fe001c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- 172.21.15.2:0/1625317360 shutdown_connections 2023-11-04T01:43:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 --2- 172.21.15.2:0/1625317360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe80ca490 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 --2- 172.21.15.2:0/1625317360 >> v2:172.21.15.90:3300/0 conn(0x7f1fe815c160 0x7f1fe80b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 --2- 172.21.15.2:0/1625317360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- 172.21.15.2:0/1625317360 >> 172.21.15.2:0/1625317360 conn(0x7f1fe80cb510 msgr2=0x7f1fe80cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- 172.21.15.2:0/1625317360 shutdown_connections 2023-11-04T01:43:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.846+0000 7f1fee494640 1 -- 172.21.15.2:0/1625317360 wait complete. 2023-11-04T01:43:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 Processor -- start 2023-11-04T01:43:13.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 -- start start 2023-11-04T01:43:13.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe8148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe815c160 0x7f1fe81f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe81f6d20 con 0x7f1fe80b0a50 2023-11-04T01:43:13.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe81509d0 con 0x7f1fe815c160 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe81f6f50 con 0x7f1fe815acb0 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe8148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe8148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42968/0 (socket says 172.21.15.2:42968) 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 -- 172.21.15.2:0/2588071803 learned_addr learned my addr 172.21.15.2:0/2588071803 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1feca31640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe815c160 0x7f1fe81f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe77fe640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 -- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 msgr2=0x7f1fe814c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe814c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 -- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe815c160 msgr2=0x7f1fe81f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe815c160 0x7f1fe81f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 -- 172.21.15.2:0/2588071803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0009b30 con 0x7f1fe80b0a50 2023-11-04T01:43:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe7fff640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe8148fc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800d800 tx=0x7f1fd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe4ff9640 1 -- 172.21.15.2:0/2588071803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800b6c0 con 0x7f1fe80b0a50 2023-11-04T01:43:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe4ff9640 1 -- 172.21.15.2:0/2588071803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800b820 con 0x7f1fe80b0a50 2023-11-04T01:43:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe81f7230 con 0x7f1fe80b0a50 2023-11-04T01:43:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fe4ff9640 1 -- 172.21.15.2:0/2588071803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800bb90 con 0x7f1fe80b0a50 2023-11-04T01:43:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe8150c20 con 0x7f1fe80b0a50 2023-11-04T01:43:13.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.850+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe8150de0 con 0x7f1fe80b0a50 2023-11-04T01:43:13.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.854+0000 7f1fe4ff9640 1 -- 172.21.15.2:0/2588071803 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1fd800bcf0 con 0x7f1fe80b0a50 2023-11-04T01:43:13.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.854+0000 7f1fe4ff9640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1fc80664d0 0x7f1fc8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:13.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.854+0000 7f1fe4ff9640 1 -- 172.21.15.2:0/2588071803 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1fd80843c0 con 0x7f1fe80b0a50 2023-11-04T01:43:13.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.854+0000 7f1fe77fe640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1fc80664d0 0x7f1fc8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:13.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.854+0000 7f1fe77fe640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1fc80664d0 0x7f1fc8068990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0006fd0 tx=0x7f1fd0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:13.858+0000 7f1fe4ff9640 1 -- 172.21.15.2:0/2588071803 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1fd8051820 con 0x7f1fe80b0a50 2023-11-04T01:43:14.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fe80744a0 con 0x7f1fe80b0a50 2023-11-04T01:43:14.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fe4ff9640 1 -- 172.21.15.2:0/2588071803 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fd8054e40 con 0x7f1fe80b0a50 2023-11-04T01:43:14.020 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:14.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1fc80664d0 msgr2=0x7f1fc8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1fc80664d0 0x7f1fc8068990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0006fd0 tx=0x7f1fd0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 msgr2=0x7f1fe8148fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe8148fc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800d800 tx=0x7f1fd800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 shutdown_connections 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1fc80664d0 0x7f1fc8068990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fe815c160 0x7f1fe81f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1fe815acb0 0x7f1fe814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 --2- 172.21.15.2:0/2588071803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1fe80b0a50 0x7f1fe8148fc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 >> 172.21.15.2:0/2588071803 conn(0x7f1fe80cb510 msgr2=0x7f1fe8155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 shutdown_connections 2023-11-04T01:43:14.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.018+0000 7f1fee494640 1 -- 172.21.15.2:0/2588071803 wait complete. 2023-11-04T01:43:14.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.158+0000 7f578b0c0640 1 Processor -- start 2023-11-04T01:43:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.158+0000 7f578b0c0640 1 -- start start 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578b0c0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f578406c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578b0c0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57840b2730 0x7f57840b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578b0c0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57840ce6d0 con 0x7f57840affa0 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578b0c0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578406f8e0 con 0x7f57840b2730 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578b0c0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57840b30e0 con 0x7f57840ce250 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f5788e5c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f57840affa0 0x7f578406fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39584/0 (socket says 172.21.15.2:39584) 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f5788e5c640 1 -- 172.21.15.2:0/1015505984 learned_addr learned my addr 172.21.15.2:0/1015505984 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578965d640 1 --2- 172.21.15.2:0/1015505984 >> v2:172.21.15.2:3300/0 conn(0x7f57840b2730 0x7f57840b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f5783fff640 1 --2- 172.21.15.2:0/1015505984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f578406c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f57837fe640 1 -- 172.21.15.2:0/1015505984 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312314367 0 0) 0x7f57840ce6d0 con 0x7f57840affa0 2023-11-04T01:43:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f57837fe640 1 -- 172.21.15.2:0/1015505984 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f576c003530 con 0x7f57840affa0 2023-11-04T01:43:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578965d640 1 -- 172.21.15.2:0/1015505984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 msgr2=0x7f578406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578965d640 1 --2- 172.21.15.2:0/1015505984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f578406c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578965d640 1 -- 172.21.15.2:0/1015505984 >> v1:172.21.15.2:6789/0 conn(0x7f57840affa0 legacy=0x7f578406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578965d640 1 -- 172.21.15.2:0/1015505984 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840b0380 con 0x7f57840b2730 2023-11-04T01:43:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f5783fff640 1 --2- 172.21.15.2:0/1015505984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f578406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f578965d640 1 --2- 172.21.15.2:0/1015505984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57840b2ba0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f577c009dc0 tx=0x7f577c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e9addb898751eb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f57837fe640 1 -- 172.21.15.2:0/1015505984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0a5930 con 0x7f57840b2730 2023-11-04T01:43:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f57837fe640 1 -- 172.21.15.2:0/1015505984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0a5a90 con 0x7f57840b2730 2023-11-04T01:43:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.162+0000 7f57837fe640 1 -- 172.21.15.2:0/1015505984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0a5e00 con 0x7f57840b2730 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- 172.21.15.2:0/1015505984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 msgr2=0x7f57840b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 --2- 172.21.15.2:0/1015505984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57840b2ba0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f577c009dc0 tx=0x7f577c01c870 comp rx=0 tx=0).stop 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- 172.21.15.2:0/1015505984 shutdown_connections 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 --2- 172.21.15.2:0/1015505984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57840b2ba0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 --2- 172.21.15.2:0/1015505984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f578406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- 172.21.15.2:0/1015505984 >> 172.21.15.2:0/1015505984 conn(0x7f57840cd730 msgr2=0x7f57840cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- 172.21.15.2:0/1015505984 shutdown_connections 2023-11-04T01:43:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- 172.21.15.2:0/1015505984 wait complete. 2023-11-04T01:43:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 Processor -- start 2023-11-04T01:43:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- start start 2023-11-04T01:43:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840affa0 0x7f57840ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57841595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f5784156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57840ad860 con 0x7f57840b2730 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5784157040 con 0x7f57840affa0 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5784159b30 con 0x7f57840ce250 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57841595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57841595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42974/0 (socket says 172.21.15.2:42974) 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 -- 172.21.15.2:0/2444779748 learned_addr learned my addr 172.21.15.2:0/2444779748 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 -- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 msgr2=0x7f5784156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f5784156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 -- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840affa0 msgr2=0x7f57840ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840affa0 0x7f57840ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 -- 172.21.15.2:0/2444779748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c009a70 con 0x7f57840b2730 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f5783fff640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57841595f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f577800c7f0 tx=0x7f577800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f57817fa640 1 -- 172.21.15.2:0/2444779748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778007820 con 0x7f57840b2730 2023-11-04T01:43:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f57817fa640 1 -- 172.21.15.2:0/2444779748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5778007980 con 0x7f57840b2730 2023-11-04T01:43:14.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57840acfc0 con 0x7f57840b2730 2023-11-04T01:43:14.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f57817fa640 1 -- 172.21.15.2:0/2444779748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778007d30 con 0x7f57840b2730 2023-11-04T01:43:14.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.166+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57840ad580 con 0x7f57840b2730 2023-11-04T01:43:14.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.170+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57840675f0 con 0x7f57840b2730 2023-11-04T01:43:14.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.170+0000 7f57817fa640 1 -- 172.21.15.2:0/2444779748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57780113f0 con 0x7f57840b2730 2023-11-04T01:43:14.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.170+0000 7f57817fa640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57700664a0 0x7f5770068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.170+0000 7f57817fa640 1 -- 172.21.15.2:0/2444779748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f57780842c0 con 0x7f57840b2730 2023-11-04T01:43:14.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.170+0000 7f5788e5c640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57700664a0 0x7f5770068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.170+0000 7f5788e5c640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57700664a0 0x7f5770068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5774007fd0 tx=0x7f5774007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.174+0000 7f57817fa640 1 -- 172.21.15.2:0/2444779748 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5778051600 con 0x7f57840b2730 2023-11-04T01:43:14.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.321+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57840b3360 con 0x7f57840b2730 2023-11-04T01:43:14.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.321+0000 7f57817fa640 1 -- 172.21.15.2:0/2444779748 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5778054c20 con 0x7f57840b2730 2023-11-04T01:43:14.326 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57700664a0 msgr2=0x7f5770068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57700664a0 0x7f5770068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5774007fd0 tx=0x7f5774007900 comp rx=0 tx=0).stop 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 msgr2=0x7f57841595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57841595f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f577800c7f0 tx=0x7f577800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 shutdown_connections 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57700664a0 0x7f5770068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57840ce250 0x7f5784156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57840b2730 0x7f57841595f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 --2- 172.21.15.2:0/2444779748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57840affa0 0x7f57840ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 >> 172.21.15.2:0/2444779748 conn(0x7f57840cd730 msgr2=0x7f57840cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 shutdown_connections 2023-11-04T01:43:14.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.325+0000 7f578b0c0640 1 -- 172.21.15.2:0/2444779748 wait complete. 2023-11-04T01:43:14.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c8b368640 1 Processor -- start 2023-11-04T01:43:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c8b368640 1 -- start start 2023-11-04T01:43:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c8b368640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7c840715d0 0x7f7c840b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c8b368640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840c2670 con 0x7f7c8415afd0 2023-11-04T01:43:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c8b368640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8406bc30 con 0x7f7c840b0b70 2023-11-04T01:43:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c8b368640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c84070140 con 0x7f7c840715d0 2023-11-04T01:43:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c88903640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7c840715d0 0x7f7c840b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c89104640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7c8415afd0 0x7f7c8406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39600/0 (socket says 172.21.15.2:39600) 2023-11-04T01:43:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c89104640 1 -- 172.21.15.2:0/924592011 learned_addr learned my addr 172.21.15.2:0/924592011 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c88903640 1 -- 172.21.15.2:0/924592011 >> v1:172.21.15.90:6789/0 conn(0x7f7c840b0b70 legacy=0x7f7c8415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c88903640 1 -- 172.21.15.2:0/924592011 >> v1:172.21.15.2:6789/0 conn(0x7f7c8415afd0 legacy=0x7f7c8406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.453+0000 7f7c88903640 1 -- 172.21.15.2:0/924592011 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8406bf10 con 0x7f7c840715d0 2023-11-04T01:43:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c88903640 1 --2- 172.21.15.2:0/924592011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c840b0630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c740097c0 tx=0x7f7c7401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f329c9c7ac5935ba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c7bfff640 1 -- 172.21.15.2:0/924592011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740ab600 con 0x7f7c840715d0 2023-11-04T01:43:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c7bfff640 1 -- 172.21.15.2:0/924592011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c740a7050 con 0x7f7c840715d0 2023-11-04T01:43:14.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c7bfff640 1 -- 172.21.15.2:0/924592011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740ab980 con 0x7f7c840715d0 2023-11-04T01:43:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 -- 172.21.15.2:0/924592011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 msgr2=0x7f7c840b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 --2- 172.21.15.2:0/924592011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c840b0630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c740097c0 tx=0x7f7c7401c480 comp rx=0 tx=0).stop 2023-11-04T01:43:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 -- 172.21.15.2:0/924592011 shutdown_connections 2023-11-04T01:43:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 --2- 172.21.15.2:0/924592011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c840b0630 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 -- 172.21.15.2:0/924592011 >> 172.21.15.2:0/924592011 conn(0x7f7c840cebb0 msgr2=0x7f7c840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 -- 172.21.15.2:0/924592011 shutdown_connections 2023-11-04T01:43:14.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 -- 172.21.15.2:0/924592011 wait complete. 2023-11-04T01:43:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 Processor -- start 2023-11-04T01:43:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.457+0000 7f7c8b368640 1 -- start start 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c84152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c840b0b70 0x7f7c8414c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c8415afd0 0x7f7c840c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841531a0 con 0x7f7c840715d0 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8414ca30 con 0x7f7c840b0b70 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84155920 con 0x7f7c8415afd0 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c84152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c84152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42988/0 (socket says 172.21.15.2:42988) 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 -- 172.21.15.2:0/2322227513 learned_addr learned my addr 172.21.15.2:0/2322227513 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c88903640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c840b0b70 0x7f7c8414c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89905640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c8415afd0 0x7f7c840c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 -- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c8415afd0 msgr2=0x7f7c840c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c8415afd0 0x7f7c840c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 -- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c840b0b70 msgr2=0x7f7c8414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c840b0b70 0x7f7c8414c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 -- 172.21.15.2:0/2322227513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74009420 con 0x7f7c840715d0 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c88903640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c840b0b70 0x7f7c8414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c89104640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c84152c60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000c500 tx=0x7f7c8000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c79ffb640 1 -- 172.21.15.2:0/2322227513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80005cf0 con 0x7f7c840715d0 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c79ffb640 1 -- 172.21.15.2:0/2322227513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c80005e50 con 0x7f7c840715d0 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c79ffb640 1 -- 172.21.15.2:0/2322227513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800072f0 con 0x7f7c840715d0 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c84155c00 con 0x7f7c840715d0 2023-11-04T01:43:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8414ccc0 con 0x7f7c840715d0 2023-11-04T01:43:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84155d90 con 0x7f7c840715d0 2023-11-04T01:43:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c79ffb640 1 -- 172.21.15.2:0/2322227513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c80007450 con 0x7f7c840715d0 2023-11-04T01:43:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c79ffb640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7c680664a0 0x7f7c68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c79ffb640 1 -- 172.21.15.2:0/2322227513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7c800833d0 con 0x7f7c840715d0 2023-11-04T01:43:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c88903640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7c680664a0 0x7f7c68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.461+0000 7f7c88903640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7c680664a0 0x7f7c68068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c740ad000 tx=0x7f7c74008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.465+0000 7f7c79ffb640 1 -- 172.21.15.2:0/2322227513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c800508f0 con 0x7f7c840715d0 2023-11-04T01:43:14.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c840744a0 con 0x7f7c840715d0 2023-11-04T01:43:14.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c79ffb640 1 -- 172.21.15.2:0/2322227513 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7c80053f10 con 0x7f7c840715d0 2023-11-04T01:43:14.632 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:14.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7c680664a0 msgr2=0x7f7c68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7c680664a0 0x7f7c68068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c740ad000 tx=0x7f7c74008040 comp rx=0 tx=0).stop 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 msgr2=0x7f7c84152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c84152c60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000c500 tx=0x7f7c8000c9c0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 shutdown_connections 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7c680664a0 0x7f7c68068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7c8415afd0 0x7f7c840c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c840b0b70 0x7f7c8414c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 --2- 172.21.15.2:0/2322227513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7c840715d0 0x7f7c84152c60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 >> 172.21.15.2:0/2322227513 conn(0x7f7c840cebb0 msgr2=0x7f7c840cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 shutdown_connections 2023-11-04T01:43:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.629+0000 7f7c8b368640 1 -- 172.21.15.2:0/2322227513 wait complete. 2023-11-04T01:43:14.650 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi090.front.sepia.ceph.com... 2023-11-04T01:43:14.650 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:14.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-04T01:43:14.704 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:43:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:14.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi090.stderr:ceph-fuse[43636]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:14.705 INFO:teuthology.orchestra.run.smithi090.stderr:2023-11-04T01:43:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:14.713 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:14.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi090.stderr:2023-11-04T01:43:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:14.722 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:43:14.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:14.722 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:43:14.769 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:43:14.769 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44c12ac640 1 Processor -- start 2023-11-04T01:43:14.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44c12ac640 1 -- start start 2023-11-04T01:43:14.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44c12ac640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f44bc0d0690 0x7f44bc0b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44c12ac640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0b6070 con 0x7f44bc0b4990 2023-11-04T01:43:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44c12ac640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0b8ed0 con 0x7f44bc0d0ae0 2023-11-04T01:43:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44c12ac640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0d1ce0 con 0x7f44bc0d0690 2023-11-04T01:43:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44baffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f44bc0b4990 0x7f44bc0b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39606/0 (socket says 172.21.15.2:39606) 2023-11-04T01:43:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44baffd640 1 -- 172.21.15.2:0/2425490242 learned_addr learned my addr 172.21.15.2:0/2425490242 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44ba7fc640 1 --2- 172.21.15.2:0/2425490242 >> v2:172.21.15.90:3300/0 conn(0x7f44bc0d0690 0x7f44bc0b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876188736 0 0) 0x7f44bc0b6070 con 0x7f44bc0b4990 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a8003530 con 0x7f44bc0b4990 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1040339414 0 0) 0x7f44a8003530 con 0x7f44bc0b4990 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 >> v2:172.21.15.90:3300/0 conn(0x7f44bc0d0690 msgr2=0x7f44bc0b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 --2- 172.21.15.2:0/2425490242 >> v2:172.21.15.90:3300/0 conn(0x7f44bc0d0690 0x7f44bc0b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 >> v1:172.21.15.90:6789/0 conn(0x7f44bc0d0ae0 legacy=0x7f44bc0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0d1fc0 con 0x7f44bc0b4990 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f44ac001a00 con 0x7f44bc0b4990 2023-11-04T01:43:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 >> v1:172.21.15.2:6789/0 conn(0x7f44bc0b4990 legacy=0x7f44bc0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80039d0 0x7f44a8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a80047d0 0x7f44a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a8005190 0x7f44a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0d1ce0 con 0x7f44a8005190 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a800c070 con 0x7f44a80047d0 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a800c230 con 0x7f44a80039d0 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44bb7fe640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a8005190 0x7f44a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44baffd640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80039d0 0x7f44a8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44ba7fc640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a80047d0 0x7f44a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44bb7fe640 1 -- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80039d0 msgr2=0x7f44a8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44bb7fe640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a80039d0 0x7f44a8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44bb7fe640 1 -- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a80047d0 msgr2=0x7f44a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:14.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44bb7fe640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44a80047d0 0x7f44a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.893+0000 7f44bb7fe640 1 -- 172.21.15.2:0/2425490242 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a8003530 con 0x7f44a8005190 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44bb7fe640 1 -- 172.21.15.2:0/2425490242 reap_dead start 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44bb7fe640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a8005190 0x7f44a800b990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f44b4001750 tx=0x7f44b401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a233f6e17ad2a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40052d0 con 0x7f44a8005190 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40a7050 con 0x7f44a8005190 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44b9ffb640 1 -- 172.21.15.2:0/2425490242 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4003600 con 0x7f44a8005190 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44c12ac640 1 -- 172.21.15.2:0/2425490242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a8005190 msgr2=0x7f44a800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44c12ac640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a8005190 0x7f44a800b990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f44b4001750 tx=0x7f44b401c3c0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44c12ac640 1 -- 172.21.15.2:0/2425490242 shutdown_connections 2023-11-04T01:43:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44c12ac640 1 --2- 172.21.15.2:0/2425490242 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44a8005190 0x7f44a800b990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44c12ac640 1 -- 172.21.15.2:0/2425490242 >> 172.21.15.2:0/2425490242 conn(0x7f44bc0cf990 msgr2=0x7f44bc0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44c12ac640 1 -- 172.21.15.2:0/2425490242 shutdown_connections 2023-11-04T01:43:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.897+0000 7f44c12ac640 1 -- 172.21.15.2:0/2425490242 wait complete. 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 Processor -- start 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 -- start start 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a8005190 0x7f44bc1574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44bc15f740 0x7f44bc0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44bc0cbd30 0x7f44bc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc160430 con 0x7f44bc0cbd30 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc15dcc0 con 0x7f44bc15f740 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc160150 con 0x7f44a8005190 2023-11-04T01:43:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44bc0cbd30 0x7f44bc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44bc0cbd30 0x7f44bc0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43012/0 (socket says 172.21.15.2:43012) 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 -- 172.21.15.2:0/1117772002 learned_addr learned my addr 172.21.15.2:0/1117772002 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44baffd640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a8005190 0x7f44bc1574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44ba7fc640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44bc15f740 0x7f44bc0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 -- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a8005190 msgr2=0x7f44bc1574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a8005190 0x7f44bc1574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 -- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44bc15f740 msgr2=0x7f44bc0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44bc15f740 0x7f44bc0cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 -- 172.21.15.2:0/1117772002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc15d670 con 0x7f44bc0cbd30 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44baffd640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a8005190 0x7f44bc1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44bb7fe640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44bc0cbd30 0x7f44bc0b3c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f44b401cc60 tx=0x7f44a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44b37fe640 1 -- 172.21.15.2:0/1117772002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40b0070 con 0x7f44bc0cbd30 2023-11-04T01:43:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44b37fe640 1 -- 172.21.15.2:0/1117772002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4004b50 con 0x7f44bc0cbd30 2023-11-04T01:43:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc15d950 con 0x7f44bc0cbd30 2023-11-04T01:43:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44b37fe640 1 -- 172.21.15.2:0/1117772002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4004f00 con 0x7f44bc0cbd30 2023-11-04T01:43:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.901+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc1e7850 con 0x7f44bc0cbd30 2023-11-04T01:43:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.905+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc15d4d0 con 0x7f44bc0cbd30 2023-11-04T01:43:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.905+0000 7f44b37fe640 1 -- 172.21.15.2:0/1117772002 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44b40bc3f0 con 0x7f44bc0cbd30 2023-11-04T01:43:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.905+0000 7f44b37fe640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f449c0664a0 0x7f449c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.905+0000 7f44b37fe640 1 -- 172.21.15.2:0/1117772002 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f44b411cd10 con 0x7f44bc0cbd30 2023-11-04T01:43:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.905+0000 7f44baffd640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f449c0664a0 0x7f449c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.905+0000 7f44baffd640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f449c0664a0 0x7f449c068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44ac002240 tx=0x7f44ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:14.909+0000 7f44b37fe640 1 -- 172.21.15.2:0/1117772002 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f44bc15d4d0 con 0x7f44bc0cbd30 2023-11-04T01:43:15.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.101+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44bc15d4d0 con 0x7f44bc0cbd30 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.101+0000 7f44b37fe640 1 -- 172.21.15.2:0/1117772002 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f44bc15d4d0 con 0x7f44bc0cbd30 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:43:15.105 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f449c0664a0 msgr2=0x7f449c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f449c0664a0 0x7f449c068960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f44ac002240 tx=0x7f44ac009040 comp rx=0 tx=0).stop 2023-11-04T01:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44bc0cbd30 msgr2=0x7f44bc0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44bc0cbd30 0x7f44bc0b3c30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f44b401cc60 tx=0x7f44a8005800 comp rx=0 tx=0).stop 2023-11-04T01:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 shutdown_connections 2023-11-04T01:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f449c0664a0 0x7f449c068960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44bc0cbd30 0x7f44bc0b3c30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44bc15f740 0x7f44bc0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 --2- 172.21.15.2:0/1117772002 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f44a8005190 0x7f44bc1574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 >> 172.21.15.2:0/1117772002 conn(0x7f44bc0cf990 msgr2=0x7f44bc0d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 shutdown_connections 2023-11-04T01:43:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.105+0000 7f44c12ac640 1 -- 172.21.15.2:0/1117772002 wait complete. 2023-11-04T01:43:15.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:15.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.245+0000 7fbac7b9f640 1 Processor -- start 2023-11-04T01:43:15.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.245+0000 7fbac7b9f640 1 -- start start 2023-11-04T01:43:15.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac7b9f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbac0161510 0x7fbac01618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac7b9f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006f8f0 0x7fbac00b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac7b9f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbac006ba90 0x7fbac00c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac7b9f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00cc6f0 con 0x7fbac006ba90 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac7b9f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac006bf90 con 0x7fbac0161510 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac7b9f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac006c270 con 0x7fbac006f8f0 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbac006ba90 0x7fbac00c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbac006ba90 0x7fbac00c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43014/0 (socket says 172.21.15.2:43014) 2023-11-04T01:43:15.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 -- 172.21.15.2:0/3605325155 learned_addr learned my addr 172.21.15.2:0/3605325155 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac593b640 1 --2- 172.21.15.2:0/3605325155 >> v2:172.21.15.90:3300/0 conn(0x7fbac0161510 0x7fbac01618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac513a640 1 --2- 172.21.15.2:0/3605325155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006f8f0 0x7fbac00b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 -- 172.21.15.2:0/3605325155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006f8f0 msgr2=0x7fbac00b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 --2- 172.21.15.2:0/3605325155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006f8f0 0x7fbac00b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 -- 172.21.15.2:0/3605325155 >> v2:172.21.15.90:3300/0 conn(0x7fbac0161510 msgr2=0x7fbac01618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 --2- 172.21.15.2:0/3605325155 >> v2:172.21.15.90:3300/0 conn(0x7fbac0161510 0x7fbac01618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 -- 172.21.15.2:0/3605325155 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac006c550 con 0x7fbac006ba90 2023-11-04T01:43:15.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac613c640 1 --2- 172.21.15.2:0/3605325155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006ba90 0x7fbac00c9170 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009e50 tx=0x7fbab801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39871f1745f8c19a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.249+0000 7fbac4939640 1 -- 172.21.15.2:0/3605325155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab80a5730 con 0x7fbac006ba90 2023-11-04T01:43:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac4939640 1 -- 172.21.15.2:0/3605325155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab80a5890 con 0x7fbac006ba90 2023-11-04T01:43:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac4939640 1 -- 172.21.15.2:0/3605325155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab80a5c20 con 0x7fbac006ba90 2023-11-04T01:43:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- 172.21.15.2:0/3605325155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006ba90 msgr2=0x7fbac00c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/3605325155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006ba90 0x7fbac00c9170 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009e50 tx=0x7fbab801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- 172.21.15.2:0/3605325155 shutdown_connections 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/3605325155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006ba90 0x7fbac00c9170 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/3605325155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006f8f0 0x7fbac00b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/3605325155 >> v2:172.21.15.90:3300/0 conn(0x7fbac0161510 0x7fbac01618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- 172.21.15.2:0/3605325155 >> 172.21.15.2:0/3605325155 conn(0x7fbac00cebb0 msgr2=0x7fbac00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- 172.21.15.2:0/3605325155 shutdown_connections 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- 172.21.15.2:0/3605325155 wait complete. 2023-11-04T01:43:15.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 Processor -- start 2023-11-04T01:43:15.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- start start 2023-11-04T01:43:15.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006ba90 0x7fbac00c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006f8f0 0x7fbac014d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0161510 0x7fbac0154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01636a0 con 0x7fbac006f8f0 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0162de0 con 0x7fbac0161510 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00c6130 con 0x7fbac006ba90 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006f8f0 0x7fbac014d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006f8f0 0x7fbac014d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43016/0 (socket says 172.21.15.2:43016) 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 -- 172.21.15.2:0/2743786170 learned_addr learned my addr 172.21.15.2:0/2743786170 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac613c640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0161510 0x7fbac0154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac593b640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006ba90 0x7fbac00c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 -- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006ba90 msgr2=0x7fbac00c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006ba90 0x7fbac00c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 -- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0161510 msgr2=0x7fbac0154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0161510 0x7fbac0154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 -- 172.21.15.2:0/2743786170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8009b30 con 0x7fbac006f8f0 2023-11-04T01:43:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac613c640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0161510 0x7fbac0154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac513a640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006f8f0 0x7fbac014d140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbab000d830 tx=0x7fbab000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbab67fc640 1 -- 172.21.15.2:0/2743786170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab00096a0 con 0x7fbac006f8f0 2023-11-04T01:43:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbab67fc640 1 -- 172.21.15.2:0/2743786170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab0009800 con 0x7fbac006f8f0 2023-11-04T01:43:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac0163050 con 0x7fbac006f8f0 2023-11-04T01:43:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbab67fc640 1 -- 172.21.15.2:0/2743786170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab0009bb0 con 0x7fbac006f8f0 2023-11-04T01:43:15.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.253+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac014d680 con 0x7fbac006f8f0 2023-11-04T01:43:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.257+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac00744a0 con 0x7fbac006f8f0 2023-11-04T01:43:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.257+0000 7fbab67fc640 1 -- 172.21.15.2:0/2743786170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbab0009d10 con 0x7fbac006f8f0 2023-11-04T01:43:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.257+0000 7fbab67fc640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa40664d0 0x7fbaa4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.257+0000 7fbab67fc640 1 -- 172.21.15.2:0/2743786170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbab0084310 con 0x7fbac006f8f0 2023-11-04T01:43:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.257+0000 7fbac593b640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa40664d0 0x7fbaa4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.257+0000 7fbac593b640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa40664d0 0x7fbaa4068990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbac0159bc0 tx=0x7fbabc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.261+0000 7fbab67fc640 1 -- 172.21.15.2:0/2743786170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbab0051770 con 0x7fbac006f8f0 2023-11-04T01:43:15.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbac00b12d0 con 0x7fbac006f8f0 2023-11-04T01:43:15.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbab67fc640 1 -- 172.21.15.2:0/2743786170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7fbab0054d90 con 0x7fbac006f8f0 2023-11-04T01:43:15.416 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:15.416 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa40664d0 msgr2=0x7fbaa4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa40664d0 0x7fbaa4068990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbac0159bc0 tx=0x7fbabc008040 comp rx=0 tx=0).stop 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006f8f0 msgr2=0x7fbac014d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006f8f0 0x7fbac014d140 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbab000d830 tx=0x7fbab000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 shutdown_connections 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa40664d0 0x7fbaa4068990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0161510 0x7fbac0154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006f8f0 0x7fbac014d140 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 --2- 172.21.15.2:0/2743786170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac006ba90 0x7fbac00c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 >> 172.21.15.2:0/2743786170 conn(0x7fbac00cebb0 msgr2=0x7fbac015eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 shutdown_connections 2023-11-04T01:43:15.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.413+0000 7fbac7b9f640 1 -- 172.21.15.2:0/2743786170 wait complete. 2023-11-04T01:43:15.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:42:22.358447+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:42:23.191616+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:15.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738c6d9640 1 Processor -- start 2023-11-04T01:43:15.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738c6d9640 1 -- start start 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738c6d9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73840b32f0 0x7f73840cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738c6d9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f73840cf4c0 0x7f73840d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738c6d9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73840cd830 con 0x7f738415af50 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738c6d9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840b3780 con 0x7f73840b32f0 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738c6d9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73840cdad0 con 0x7f73840cf4c0 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389c74640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73840b32f0 0x7f73840cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389c74640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73840b32f0 0x7f73840cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43032/0 (socket says 172.21.15.2:43032) 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389c74640 1 -- 172.21.15.2:0/4232547420 learned_addr learned my addr 172.21.15.2:0/4232547420 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738a475640 1 --1- 172.21.15.2:0/4232547420 >> v1:172.21.15.2:6789/0 conn(0x7f738415af50 0x7f73840ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39616/0 (socket says 172.21.15.2:39616) 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f738ac76640 1 --2- 172.21.15.2:0/4232547420 >> v2:172.21.15.90:3300/0 conn(0x7f73840cf4c0 0x7f73840d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389c74640 1 -- 172.21.15.2:0/4232547420 >> v2:172.21.15.90:3300/0 conn(0x7f73840cf4c0 msgr2=0x7f73840d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:15.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389c74640 1 --2- 172.21.15.2:0/4232547420 >> v2:172.21.15.90:3300/0 conn(0x7f73840cf4c0 0x7f73840d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389c74640 1 -- 172.21.15.2:0/4232547420 >> v1:172.21.15.2:6789/0 conn(0x7f738415af50 legacy=0x7f73840ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389c74640 1 -- 172.21.15.2:0/4232547420 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73840cddb0 con 0x7f73840b32f0 2023-11-04T01:43:15.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.553+0000 7f7389473640 1 -- 172.21.15.2:0/4232547420 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108847213 0 0) 0x7f73840cd830 con 0x7f738415af50 2023-11-04T01:43:15.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f7389c74640 1 --2- 172.21.15.2:0/4232547420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73840b32f0 0x7f73840cb330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7384066a00 tx=0x7f737401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207d5f2d8bf27047 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f7389473640 1 -- 172.21.15.2:0/4232547420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73740aa5f0 con 0x7f73840b32f0 2023-11-04T01:43:15.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f7389473640 1 -- 172.21.15.2:0/4232547420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73740aa750 con 0x7f73840b32f0 2023-11-04T01:43:15.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f7389473640 1 -- 172.21.15.2:0/4232547420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73740aaae0 con 0x7f73840b32f0 2023-11-04T01:43:15.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- 172.21.15.2:0/4232547420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73840b32f0 msgr2=0x7f73840cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 --2- 172.21.15.2:0/4232547420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73840b32f0 0x7f73840cb330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7384066a00 tx=0x7f737401c470 comp rx=0 tx=0).stop 2023-11-04T01:43:15.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- 172.21.15.2:0/4232547420 shutdown_connections 2023-11-04T01:43:15.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 --2- 172.21.15.2:0/4232547420 >> v2:172.21.15.90:3300/0 conn(0x7f73840cf4c0 0x7f73840d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 --2- 172.21.15.2:0/4232547420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73840b32f0 0x7f73840cb330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- 172.21.15.2:0/4232547420 >> 172.21.15.2:0/4232547420 conn(0x7f7384065dc0 msgr2=0x7f73840661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- 172.21.15.2:0/4232547420 shutdown_connections 2023-11-04T01:43:15.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- 172.21.15.2:0/4232547420 wait complete. 2023-11-04T01:43:15.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 Processor -- start 2023-11-04T01:43:15.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- start start 2023-11-04T01:43:15.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73840cf4c0 0x7f7384154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f738415af50 0x7f7384159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738415d1e0 0x7f738415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738415dd40 con 0x7f738415d1e0 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7384155100 con 0x7f73840cf4c0 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738415d780 con 0x7f738415af50 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738415d1e0 0x7f738415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738415d1e0 0x7f738415e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43038/0 (socket says 172.21.15.2:43038) 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 -- 172.21.15.2:0/3566491004 learned_addr learned my addr 172.21.15.2:0/3566491004 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738a475640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73840cf4c0 0x7f7384154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f7389c74640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f738415af50 0x7f7384159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 -- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f738415af50 msgr2=0x7f7384159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f738415af50 0x7f7384159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 -- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73840cf4c0 msgr2=0x7f7384154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73840cf4c0 0x7f7384154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 -- 172.21.15.2:0/3566491004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73740094d0 con 0x7f738415d1e0 2023-11-04T01:43:15.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738a475640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73840cf4c0 0x7f7384154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:15.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738ac76640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738415d1e0 0x7f738415e940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f737c00cd70 tx=0x7f737c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f737affd640 1 -- 172.21.15.2:0/3566491004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c003ba0 con 0x7f738415d1e0 2023-11-04T01:43:15.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f737affd640 1 -- 172.21.15.2:0/3566491004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c003d00 con 0x7f738415d1e0 2023-11-04T01:43:15.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f737affd640 1 -- 172.21.15.2:0/3566491004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c004240 con 0x7f738415d1e0 2023-11-04T01:43:15.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.557+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738415da60 con 0x7f738415d1e0 2023-11-04T01:43:15.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.561+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7384154770 con 0x7f738415d1e0 2023-11-04T01:43:15.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.561+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7384154b80 con 0x7f738415d1e0 2023-11-04T01:43:15.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.561+0000 7f737affd640 1 -- 172.21.15.2:0/3566491004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f737c0043a0 con 0x7f738415d1e0 2023-11-04T01:43:15.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.561+0000 7f737affd640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73680664d0 0x7f7368068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.561+0000 7f737affd640 1 -- 172.21.15.2:0/3566491004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f737c012070 con 0x7f738415d1e0 2023-11-04T01:43:15.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.561+0000 7f738a475640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73680664d0 0x7f7368068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.561+0000 7f738a475640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73680664d0 0x7f7368068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7380007fd0 tx=0x7f7380009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.565+0000 7f737affd640 1 -- 172.21.15.2:0/3566491004 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7384154b80 con 0x7f738415d1e0 2023-11-04T01:43:15.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7384155240 con 0x7f738415d1e0 2023-11-04T01:43:15.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f737affd640 1 -- 172.21.15.2:0/3566491004 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7384155240 con 0x7f738415d1e0 2023-11-04T01:43:15.724 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73680664d0 msgr2=0x7f7368068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73680664d0 0x7f7368068990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7380007fd0 tx=0x7f7380009040 comp rx=0 tx=0).stop 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738415d1e0 msgr2=0x7f738415e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738415d1e0 0x7f738415e940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f737c00cd70 tx=0x7f737c00a660 comp rx=0 tx=0).stop 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 shutdown_connections 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f73680664d0 0x7f7368068990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f738415d1e0 0x7f738415e940 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f738415af50 0x7f7384159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 --2- 172.21.15.2:0/3566491004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73840cf4c0 0x7f7384154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 >> 172.21.15.2:0/3566491004 conn(0x7f7384065dc0 msgr2=0x7f73840661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 shutdown_connections 2023-11-04T01:43:15.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.721+0000 7f738c6d9640 1 -- 172.21.15.2:0/3566491004 wait complete. 2023-11-04T01:43:15.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 Processor -- start 2023-11-04T01:43:15.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 -- start start 2023-11-04T01:43:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24c40cd670 0x7f24c40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f24c406cfc0 0x7f24c415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c415d600 con 0x7f24c40cd670 2023-11-04T01:43:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c4160c50 con 0x7f24c406cfc0 2023-11-04T01:43:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cc752640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40cedf0 con 0x7f24c40cda50 2023-11-04T01:43:15.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24c40cd670 0x7f24c40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24c40cd670 0x7f24c40ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43044/0 (socket says 172.21.15.2:43044) 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 -- 172.21.15.2:0/3000236966 learned_addr learned my addr 172.21.15.2:0/3000236966 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24c9ced640 1 --2- 172.21.15.2:0/3000236966 >> v2:172.21.15.90:3300/0 conn(0x7f24c406cfc0 0x7f24c415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24cacef640 1 --2- 172.21.15.2:0/3000236966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 -- 172.21.15.2:0/3000236966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 msgr2=0x7f24c415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 --2- 172.21.15.2:0/3000236966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c415d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 -- 172.21.15.2:0/3000236966 >> v2:172.21.15.90:3300/0 conn(0x7f24c406cfc0 msgr2=0x7f24c415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 --2- 172.21.15.2:0/3000236966 >> v2:172.21.15.90:3300/0 conn(0x7f24c406cfc0 0x7f24c415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24ca4ee640 1 -- 172.21.15.2:0/3000236966 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4160ef0 con 0x7f24c40cd670 2023-11-04T01:43:15.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.857+0000 7f24c9ced640 1 --2- 172.21.15.2:0/3000236966 >> v2:172.21.15.90:3300/0 conn(0x7f24c406cfc0 0x7f24c415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:15.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24ca4ee640 1 --2- 172.21.15.2:0/3000236966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ce8b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f24c406f190 tx=0x7f24c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e7fd7c79c70304 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24c94ec640 1 -- 172.21.15.2:0/3000236966 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00aa5f0 con 0x7f24c40cd670 2023-11-04T01:43:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24c94ec640 1 -- 172.21.15.2:0/3000236966 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c00aa750 con 0x7f24c40cd670 2023-11-04T01:43:15.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24c94ec640 1 -- 172.21.15.2:0/3000236966 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00aaae0 con 0x7f24c40cd670 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- 172.21.15.2:0/3000236966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 msgr2=0x7f24c40ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 --2- 172.21.15.2:0/3000236966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ce8b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f24c406f190 tx=0x7f24c001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- 172.21.15.2:0/3000236966 shutdown_connections 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 --2- 172.21.15.2:0/3000236966 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 --2- 172.21.15.2:0/3000236966 >> v2:172.21.15.90:3300/0 conn(0x7f24c406cfc0 0x7f24c415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 --2- 172.21.15.2:0/3000236966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ce8b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- 172.21.15.2:0/3000236966 >> 172.21.15.2:0/3000236966 conn(0x7f24c4065dc0 msgr2=0x7f24c40661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- 172.21.15.2:0/3000236966 shutdown_connections 2023-11-04T01:43:15.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- 172.21.15.2:0/3000236966 wait complete. 2023-11-04T01:43:15.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 Processor -- start 2023-11-04T01:43:15.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- start start 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24c406cfc0 0x7f24c4151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c40af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40ac960 con 0x7f24c40cd670 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40acc00 con 0x7f24c406cfc0 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.861+0000 7f24cc752640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40acee0 con 0x7f24c40cda50 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ad9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43050/0 (socket says 172.21.15.2:43050) 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 -- 172.21.15.2:0/571646823 learned_addr learned my addr 172.21.15.2:0/571646823 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24cacef640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c40af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24ca4ee640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24c406cfc0 0x7f24c4151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 -- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 msgr2=0x7f24c40af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c40af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 -- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24c406cfc0 msgr2=0x7f24c4151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24c406cfc0 0x7f24c4151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 -- 172.21.15.2:0/571646823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0009480 con 0x7f24c40cd670 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24c9ced640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ad9c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c7f0 tx=0x7f24b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24baffd640 1 -- 172.21.15.2:0/571646823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b400cea0 con 0x7f24c40cd670 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24baffd640 1 -- 172.21.15.2:0/571646823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b4007a30 con 0x7f24c40cd670 2023-11-04T01:43:15.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c40ad1c0 con 0x7f24c40cd670 2023-11-04T01:43:15.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24baffd640 1 -- 172.21.15.2:0/571646823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4007de0 con 0x7f24c40cd670 2023-11-04T01:43:15.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c41525d0 con 0x7f24c40cd670 2023-11-04T01:43:15.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c40675f0 con 0x7f24c40cd670 2023-11-04T01:43:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24baffd640 1 -- 172.21.15.2:0/571646823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f24b40113f0 con 0x7f24c40cd670 2023-11-04T01:43:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24baffd640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24a80664d0 0x7f24a8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24baffd640 1 -- 172.21.15.2:0/571646823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f24b4083fe0 con 0x7f24c40cd670 2023-11-04T01:43:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24ca4ee640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24a80664d0 0x7f24a8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:15.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.865+0000 7f24ca4ee640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24a80664d0 0x7f24a8068990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ae000 tx=0x7f24c00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:15.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:15.869+0000 7f24baffd640 1 -- 172.21.15.2:0/571646823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24b40513e0 con 0x7f24c40cd670 2023-11-04T01:43:16.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.017+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24c4066480 con 0x7f24c40cd670 2023-11-04T01:43:16.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.017+0000 7f24baffd640 1 -- 172.21.15.2:0/571646823 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f24b4054a00 con 0x7f24c40cd670 2023-11-04T01:43:16.022 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24a80664d0 msgr2=0x7f24a8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24a80664d0 0x7f24a8068990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ae000 tx=0x7f24c00a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 msgr2=0x7f24c40ad9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ad9c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c7f0 tx=0x7f24b400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 shutdown_connections 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24a80664d0 0x7f24a8068990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24c40cda50 0x7f24c40af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24c40cd670 0x7f24c40ad9c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 --2- 172.21.15.2:0/571646823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24c406cfc0 0x7f24c4151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 >> 172.21.15.2:0/571646823 conn(0x7f24c4065dc0 msgr2=0x7f24c406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 shutdown_connections 2023-11-04T01:43:16.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.021+0000 7f24cc752640 1 -- 172.21.15.2:0/571646823 wait complete. 2023-11-04T01:43:16.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:16.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719c744640 1 Processor -- start 2023-11-04T01:43:16.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719c744640 1 -- start start 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719c744640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7194144940 0x7f719406a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719c744640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f71940cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719c744640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719415b5a0 con 0x7f719406f2d0 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719c744640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719415b880 con 0x7f7194144940 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719c744640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719415bb60 con 0x7f71940d07e0 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719a4e0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7194144940 0x7f719406a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f7199cdf640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f719406f2d0 0x7f719415ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39630/0 (socket says 172.21.15.2:39630) 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f7199cdf640 1 -- 172.21.15.2:0/2454429740 learned_addr learned my addr 172.21.15.2:0/2454429740 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:16.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719ace1640 1 --2- 172.21.15.2:0/2454429740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f71940cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f71994de640 1 -- 172.21.15.2:0/2454429740 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158787767 0 0) 0x7f719415b5a0 con 0x7f719406f2d0 2023-11-04T01:43:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f71994de640 1 -- 172.21.15.2:0/2454429740 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7180003530 con 0x7f719406f2d0 2023-11-04T01:43:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719a4e0640 1 -- 172.21.15.2:0/2454429740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 msgr2=0x7f71940cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719a4e0640 1 --2- 172.21.15.2:0/2454429740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f71940cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719a4e0640 1 -- 172.21.15.2:0/2454429740 >> v1:172.21.15.2:6789/0 conn(0x7f719406f2d0 legacy=0x7f719415ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.153+0000 7f719a4e0640 1 -- 172.21.15.2:0/2454429740 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719415be40 con 0x7f7194144940 2023-11-04T01:43:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719a4e0640 1 --2- 172.21.15.2:0/2454429740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f719406a160 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f71900097c0 tx=0x7f719001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2170d9d66a49df5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f71994de640 1 -- 172.21.15.2:0/2454429740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900ad640 con 0x7f7194144940 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f71994de640 1 -- 172.21.15.2:0/2454429740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71900ad7a0 con 0x7f7194144940 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f71994de640 1 -- 172.21.15.2:0/2454429740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71900adb10 con 0x7f7194144940 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- 172.21.15.2:0/2454429740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 msgr2=0x7f719406a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 --2- 172.21.15.2:0/2454429740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f719406a160 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f71900097c0 tx=0x7f719001c480 comp rx=0 tx=0).stop 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- 172.21.15.2:0/2454429740 shutdown_connections 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 --2- 172.21.15.2:0/2454429740 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f71940cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 --2- 172.21.15.2:0/2454429740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f719406a160 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- 172.21.15.2:0/2454429740 >> 172.21.15.2:0/2454429740 conn(0x7f71940cfcc0 msgr2=0x7f71940d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- 172.21.15.2:0/2454429740 shutdown_connections 2023-11-04T01:43:16.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- 172.21.15.2:0/2454429740 wait complete. 2023-11-04T01:43:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 Processor -- start 2023-11-04T01:43:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- start start 2023-11-04T01:43:16.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f719406f2d0 0x7f719406d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f719413dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f71940b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719406cc50 con 0x7f7194144940 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719415e080 con 0x7f719406f2d0 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719406cea0 con 0x7f71940d07e0 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f71940b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f71940b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43064/0 (socket says 172.21.15.2:43064) 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 -- 172.21.15.2:0/304146309 learned_addr learned my addr 172.21.15.2:0/304146309 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f7199cdf640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f719413dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719a4e0640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f719406f2d0 0x7f719406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 -- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 msgr2=0x7f719413dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f719413dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 -- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f719406f2d0 msgr2=0x7f719406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f719406f2d0 0x7f719406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 -- 172.21.15.2:0/304146309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190009420 con 0x7f7194144940 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719a4e0640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f719406f2d0 0x7f719406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719ace1640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f71940b0450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f718c007e40 tx=0x7f718c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f718affd640 1 -- 172.21.15.2:0/304146309 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c014620 con 0x7f7194144940 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f718affd640 1 -- 172.21.15.2:0/304146309 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c00ee90 con 0x7f7194144940 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f718affd640 1 -- 172.21.15.2:0/304146309 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0149e0 con 0x7f7194144940 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719406d180 con 0x7f7194144940 2023-11-04T01:43:16.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.157+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719406dec0 con 0x7f7194144940 2023-11-04T01:43:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.161+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71940675f0 con 0x7f7194144940 2023-11-04T01:43:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.161+0000 7f718affd640 1 -- 172.21.15.2:0/304146309 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f718c014b40 con 0x7f7194144940 2023-11-04T01:43:16.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.161+0000 7f718affd640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71780664a0 0x7f7178068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.161+0000 7f718affd640 1 -- 172.21.15.2:0/304146309 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f718c0847d0 con 0x7f7194144940 2023-11-04T01:43:16.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.161+0000 7f719a4e0640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71780664a0 0x7f7178068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.161+0000 7f719a4e0640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71780664a0 0x7f7178068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f71900af000 tx=0x7f71900a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.165+0000 7f718affd640 1 -- 172.21.15.2:0/304146309 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f718c051c20 con 0x7f7194144940 2023-11-04T01:43:16.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.313+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f719406d630 con 0x7f7194144940 2023-11-04T01:43:16.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.313+0000 7f718affd640 1 -- 172.21.15.2:0/304146309 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f718c055240 con 0x7f7194144940 2023-11-04T01:43:16.317 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71780664a0 msgr2=0x7f7178068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71780664a0 0x7f7178068960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f71900af000 tx=0x7f71900a7070 comp rx=0 tx=0).stop 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 msgr2=0x7f71940b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f71940b0450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f718c007e40 tx=0x7f718c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 shutdown_connections 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71780664a0 0x7f7178068960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7194144940 0x7f71940b0450 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f71940d07e0 0x7f719413dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 --2- 172.21.15.2:0/304146309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f719406f2d0 0x7f719406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 >> 172.21.15.2:0/304146309 conn(0x7f71940cfcc0 msgr2=0x7f71940b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 shutdown_connections 2023-11-04T01:43:16.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.317+0000 7f719c744640 1 -- 172.21.15.2:0/304146309 wait complete. 2023-11-04T01:43:16.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:16.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f3566316640 1 Processor -- start 2023-11-04T01:43:16.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f3566316640 1 -- start start 2023-11-04T01:43:16.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f3566316640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f356006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f3566316640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f356006f8f0 0x7f35600b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f3566316640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600cd400 con 0x7f356015d2b0 2023-11-04T01:43:16.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f3566316640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600ad450 con 0x7f356006f8f0 2023-11-04T01:43:16.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f3566316640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600cd6e0 con 0x7f356015d690 2023-11-04T01:43:16.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f35648b3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f356006f8f0 0x7f35600b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f355ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f356015d2b0 0x7f35600ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39638/0 (socket says 172.21.15.2:39638) 2023-11-04T01:43:16.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f355ffff640 1 -- 172.21.15.2:0/1830394870 learned_addr learned my addr 172.21.15.2:0/1830394870 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:16.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f355f7fe640 1 --2- 172.21.15.2:0/1830394870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f356006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f35648b3640 1 -- 172.21.15.2:0/1830394870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 msgr2=0x7f356006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f35648b3640 1 --2- 172.21.15.2:0/1830394870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f356006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f35648b3640 1 -- 172.21.15.2:0/1830394870 >> v1:172.21.15.2:6789/0 conn(0x7f356015d2b0 legacy=0x7f35600ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f35648b3640 1 -- 172.21.15.2:0/1830394870 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600ad070 con 0x7f356006f8f0 2023-11-04T01:43:16.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f355effd640 1 -- 172.21.15.2:0/1830394870 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597992131 0 0) 0x7f35600cd400 con 0x7f356015d2b0 2023-11-04T01:43:16.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f35648b3640 1 --2- 172.21.15.2:0/1830394870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600b0630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f35580097c0 tx=0x7f355801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976726f50cc308aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f355effd640 1 -- 172.21.15.2:0/1830394870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580ab600 con 0x7f356006f8f0 2023-11-04T01:43:16.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f355effd640 1 -- 172.21.15.2:0/1830394870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35580a7050 con 0x7f356006f8f0 2023-11-04T01:43:16.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.449+0000 7f355effd640 1 -- 172.21.15.2:0/1830394870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35580ab980 con 0x7f356006f8f0 2023-11-04T01:43:16.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- 172.21.15.2:0/1830394870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 msgr2=0x7f35600b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 --2- 172.21.15.2:0/1830394870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600b0630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f35580097c0 tx=0x7f355801c3f0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- 172.21.15.2:0/1830394870 shutdown_connections 2023-11-04T01:43:16.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 --2- 172.21.15.2:0/1830394870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600b0630 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 --2- 172.21.15.2:0/1830394870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f356006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- 172.21.15.2:0/1830394870 >> 172.21.15.2:0/1830394870 conn(0x7f35600cebb0 msgr2=0x7f35600cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- 172.21.15.2:0/1830394870 shutdown_connections 2023-11-04T01:43:16.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- 172.21.15.2:0/1830394870 wait complete. 2023-11-04T01:43:16.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 Processor -- start 2023-11-04T01:43:16.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- start start 2023-11-04T01:43:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f356015d2b0 0x7f356014ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f35600c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560153a80 con 0x7f356006f8f0 2023-11-04T01:43:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600cada0 con 0x7f356015d2b0 2023-11-04T01:43:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600cb080 con 0x7f356015d690 2023-11-04T01:43:16.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43086/0 (socket says 172.21.15.2:43086) 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 -- 172.21.15.2:0/432178301 learned_addr learned my addr 172.21.15.2:0/432178301 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f35648b3640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f35600c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355f7fe640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f356015d2b0 0x7f356014ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 -- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 msgr2=0x7f35600c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f35600c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 -- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f356015d2b0 msgr2=0x7f356014ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f356015d2b0 0x7f356014ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 -- 172.21.15.2:0/432178301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558009420 con 0x7f356006f8f0 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f35648b3640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f35600c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355f7fe640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f356015d2b0 0x7f356014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:16.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355ffff640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600c9310 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f355000c480 tx=0x7f355000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355cff9640 1 -- 172.21.15.2:0/432178301 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500074e0 con 0x7f356006f8f0 2023-11-04T01:43:16.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355cff9640 1 -- 172.21.15.2:0/432178301 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550007660 con 0x7f356006f8f0 2023-11-04T01:43:16.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f355cff9640 1 -- 172.21.15.2:0/432178301 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550004a30 con 0x7f356006f8f0 2023-11-04T01:43:16.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35600cb360 con 0x7f356006f8f0 2023-11-04T01:43:16.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.453+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3560153790 con 0x7f356006f8f0 2023-11-04T01:43:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.457+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35600cac00 con 0x7f356006f8f0 2023-11-04T01:43:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.457+0000 7f355cff9640 1 -- 172.21.15.2:0/432178301 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3550004b90 con 0x7f356006f8f0 2023-11-04T01:43:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.457+0000 7f355cff9640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f354c0664a0 0x7f354c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.457+0000 7f355cff9640 1 -- 172.21.15.2:0/432178301 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3550083090 con 0x7f356006f8f0 2023-11-04T01:43:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.457+0000 7f355f7fe640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f354c0664a0 0x7f354c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.457+0000 7f355f7fe640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f354c0664a0 0x7f354c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35600aff90 tx=0x7f355400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.461+0000 7f355cff9640 1 -- 172.21.15.2:0/432178301 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f35600cac00 con 0x7f356006f8f0 2023-11-04T01:43:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.649+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35600cac00 con 0x7f356006f8f0 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.649+0000 7f355cff9640 1 -- 172.21.15.2:0/432178301 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f35600cac00 con 0x7f356006f8f0 2023-11-04T01:43:16.653 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:16.654 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:43:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f354c0664a0 msgr2=0x7f354c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f354c0664a0 0x7f354c068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f35600aff90 tx=0x7f355400b040 comp rx=0 tx=0).stop 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 msgr2=0x7f35600c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600c9310 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f355000c480 tx=0x7f355000c940 comp rx=0 tx=0).stop 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 shutdown_connections 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f354c0664a0 0x7f354c068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015d690 0x7f35600c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f356015d2b0 0x7f356014ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 --2- 172.21.15.2:0/432178301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356006f8f0 0x7f35600c9310 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 >> 172.21.15.2:0/432178301 conn(0x7f35600cebb0 msgr2=0x7f356015bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 shutdown_connections 2023-11-04T01:43:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.653+0000 7f3566316640 1 -- 172.21.15.2:0/432178301 wait complete. 2023-11-04T01:43:16.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.785+0000 7fad9d29a640 1 Processor -- start 2023-11-04T01:43:16.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad9d29a640 1 -- start start 2023-11-04T01:43:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad9d29a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 0x7fad980cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad9d29a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980ccee0 con 0x7fad980cdea0 2023-11-04T01:43:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad9d29a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9815a5d0 con 0x7fad980b0d40 2023-11-04T01:43:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad9d29a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980ca900 con 0x7fad9815a1f0 2023-11-04T01:43:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fad980cdea0 0x7fad980b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39640/0 (socket says 172.21.15.2:39640) 2023-11-04T01:43:16.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 -- 172.21.15.2:0/4180550482 learned_addr learned my addr 172.21.15.2:0/4180550482 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad96ffd640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 0x7fad980cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288971112 0 0) 0x7fad980ccee0 con 0x7fad980cdea0 2023-11-04T01:43:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad84003530 con 0x7fad980cdea0 2023-11-04T01:43:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1673626718 0 0) 0x7fad84003530 con 0x7fad980cdea0 2023-11-04T01:43:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 msgr2=0x7fad980cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 0x7fad980cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 >> v1:172.21.15.90:6789/0 conn(0x7fad980b0d40 legacy=0x7fad980704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980cabe0 con 0x7fad980cdea0 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fad88001680 con 0x7fad980cdea0 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 >> v1:172.21.15.2:6789/0 conn(0x7fad980cdea0 legacy=0x7fad980b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 0x7fad840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad84004d10 0x7fad84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980ca900 con 0x7fad84003f30 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8400ba70 con 0x7fad84004d10 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8400bc30 con 0x7fad9815a1f0 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad977fe640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad84004d10 0x7fad84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad96ffd640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 0x7fad840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 -- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 msgr2=0x7fad840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad9815a1f0 0x7fad840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 -- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad84004d10 msgr2=0x7fad84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad84004d10 0x7fad84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.789+0000 7fad967fc640 1 -- 172.21.15.2:0/4180550482 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84003530 con 0x7fad84003f30 2023-11-04T01:43:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad967fc640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad840047d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c240 tx=0x7fad8801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196f8e5970174e1d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88005ae0 con 0x7fad84003f30 2023-11-04T01:43:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880ab070 con 0x7fad84003f30 2023-11-04T01:43:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad95ffb640 1 -- 172.21.15.2:0/4180550482 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88007070 con 0x7fad84003f30 2023-11-04T01:43:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- 172.21.15.2:0/4180550482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 msgr2=0x7fad840047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 --2- 172.21.15.2:0/4180550482 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad840047d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c240 tx=0x7fad8801f3b0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad977fe640 1 -- 172.21.15.2:0/4180550482 reap_dead start 2023-11-04T01:43:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- 172.21.15.2:0/4180550482 shutdown_connections 2023-11-04T01:43:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- 172.21.15.2:0/4180550482 >> 172.21.15.2:0/4180550482 conn(0x7fad980cebb0 msgr2=0x7fad980cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- 172.21.15.2:0/4180550482 shutdown_connections 2023-11-04T01:43:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- 172.21.15.2:0/4180550482 wait complete. 2023-11-04T01:43:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 Processor -- start 2023-11-04T01:43:16.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- start start 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad98157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad981efaa0 0x7fad98159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad981595b0 0x7fad981ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad98159a30 con 0x7fad84003f30 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980c73f0 con 0x7fad981efaa0 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad9d29a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad98157670 con 0x7fad981595b0 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad98157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad98157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43100/0 (socket says 172.21.15.2:43100) 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad96ffd640 1 -- 172.21.15.2:0/1224348342 learned_addr learned my addr 172.21.15.2:0/1224348342 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad967fc640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad981efaa0 0x7fad98159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.793+0000 7fad977fe640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad981595b0 0x7fad981ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad96ffd640 1 -- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad981595b0 msgr2=0x7fad981ee9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad96ffd640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad981595b0 0x7fad981ee9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad96ffd640 1 -- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad981efaa0 msgr2=0x7fad98159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad96ffd640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad981efaa0 0x7fad98159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad96ffd640 1 -- 172.21.15.2:0/1224348342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad981ef730 con 0x7fad84003f30 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad977fe640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad981595b0 0x7fad981ee9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad96ffd640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad98157130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad80011610 tx=0x7fad80011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad8f7fe640 1 -- 172.21.15.2:0/1224348342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8000f8f0 con 0x7fad84003f30 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad8f7fe640 1 -- 172.21.15.2:0/1224348342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8000fa50 con 0x7fad84003f30 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad8f7fe640 1 -- 172.21.15.2:0/1224348342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8000fdc0 con 0x7fad84003f30 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad980c7640 con 0x7fad84003f30 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980c7c00 con 0x7fad84003f30 2023-11-04T01:43:16.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad980ce330 con 0x7fad84003f30 2023-11-04T01:43:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad8f7fe640 1 -- 172.21.15.2:0/1224348342 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad80015460 con 0x7fad84003f30 2023-11-04T01:43:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad8f7fe640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad780664d0 0x7fad78068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad8f7fe640 1 -- 172.21.15.2:0/1224348342 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fad800842d0 con 0x7fad84003f30 2023-11-04T01:43:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad967fc640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad780664d0 0x7fad78068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:16.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.797+0000 7fad967fc640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad780664d0 0x7fad78068990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad880af000 tx=0x7fad880aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:16.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.801+0000 7fad8f7fe640 1 -- 172.21.15.2:0/1224348342 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad80051730 con 0x7fad84003f30 2023-11-04T01:43:16.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.953+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad980744a0 con 0x7fad84003f30 2023-11-04T01:43:16.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad8f7fe640 1 -- 172.21.15.2:0/1224348342 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7fad80054d50 con 0x7fad84003f30 2023-11-04T01:43:16.960 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:16.960 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad780664d0 msgr2=0x7fad78068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad780664d0 0x7fad78068990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad880af000 tx=0x7fad880aa000 comp rx=0 tx=0).stop 2023-11-04T01:43:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 msgr2=0x7fad98157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad98157130 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fad80011610 tx=0x7fad80011ad0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 shutdown_connections 2023-11-04T01:43:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad780664d0 0x7fad78068990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad981595b0 0x7fad981ee9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad981efaa0 0x7fad98159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 --2- 172.21.15.2:0/1224348342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad84003f30 0x7fad98157130 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 >> 172.21.15.2:0/1224348342 conn(0x7fad980cebb0 msgr2=0x7fad9815c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 shutdown_connections 2023-11-04T01:43:16.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:16.957+0000 7fad9d29a640 1 -- 172.21.15.2:0/1224348342 wait complete. 2023-11-04T01:43:16.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:43:16.978 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.093+0000 7f534877c640 1 Processor -- start 2023-11-04T01:43:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.093+0000 7f534877c640 1 -- start start 2023-11-04T01:43:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f534877c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f534015afd0 0x7f53400715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f534877c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400c2670 con 0x7f534006f8f0 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f534877c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534006bc30 con 0x7f53400b0d40 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f534877c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5340070140 con 0x7f534015afd0 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5346518640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f534015afd0 0x7f53400715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5345d17640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f534006f8f0 0x7f53400b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39654/0 (socket says 172.21.15.2:39654) 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5345d17640 1 -- 172.21.15.2:0/1112528870 learned_addr learned my addr 172.21.15.2:0/1112528870 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5346518640 1 -- 172.21.15.2:0/1112528870 >> v1:172.21.15.90:6789/0 conn(0x7f53400b0d40 legacy=0x7f534015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5346518640 1 -- 172.21.15.2:0/1112528870 >> v1:172.21.15.2:6789/0 conn(0x7f534006f8f0 legacy=0x7f53400b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5346518640 1 -- 172.21.15.2:0/1112528870 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534006bf10 con 0x7f534015afd0 2023-11-04T01:43:17.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5345516640 1 -- 172.21.15.2:0/1112528870 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409749237 0 0) 0x7f53400c2670 con 0x7f534006f8f0 2023-11-04T01:43:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5346518640 1 --2- 172.21.15.2:0/1112528870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400715d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f533c009d90 tx=0x7f533c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dadddd82cc9612f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5345516640 1 -- 172.21.15.2:0/1112528870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0a58c0 con 0x7f534015afd0 2023-11-04T01:43:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5345516640 1 -- 172.21.15.2:0/1112528870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c0a5a20 con 0x7f534015afd0 2023-11-04T01:43:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.097+0000 7f5345516640 1 -- 172.21.15.2:0/1112528870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c0a5db0 con 0x7f534015afd0 2023-11-04T01:43:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- 172.21.15.2:0/1112528870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 msgr2=0x7f53400715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 --2- 172.21.15.2:0/1112528870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400715d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f533c009d90 tx=0x7f533c01c910 comp rx=0 tx=0).stop 2023-11-04T01:43:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- 172.21.15.2:0/1112528870 shutdown_connections 2023-11-04T01:43:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 --2- 172.21.15.2:0/1112528870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400715d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- 172.21.15.2:0/1112528870 >> 172.21.15.2:0/1112528870 conn(0x7f53400cebb0 msgr2=0x7f53400cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- 172.21.15.2:0/1112528870 shutdown_connections 2023-11-04T01:43:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- 172.21.15.2:0/1112528870 wait complete. 2023-11-04T01:43:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 Processor -- start 2023-11-04T01:43:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- start start 2023-11-04T01:43:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f534006f8f0 0x7f5340152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53400b0d40 0x7f53400c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400b2130 con 0x7f534015afd0 2023-11-04T01:43:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400b1b00 con 0x7f534006f8f0 2023-11-04T01:43:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5340152960 con 0x7f53400b0d40 2023-11-04T01:43:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43110/0 (socket says 172.21.15.2:43110) 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 -- 172.21.15.2:0/3723724421 learned_addr learned my addr 172.21.15.2:0/3723724421 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346518640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f534006f8f0 0x7f5340152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5345d17640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53400b0d40 0x7f53400c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 -- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53400b0d40 msgr2=0x7f53400c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53400b0d40 0x7f53400c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 -- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f534006f8f0 msgr2=0x7f5340152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f534006f8f0 0x7f5340152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 -- 172.21.15.2:0/3723724421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009a70 con 0x7f534015afd0 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346518640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f534006f8f0 0x7f5340152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5346d19640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400c7ea0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f533800c390 tx=0x7f533800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5336ffd640 1 -- 172.21.15.2:0/3723724421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53380069e0 con 0x7f534015afd0 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5336ffd640 1 -- 172.21.15.2:0/3723724421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338006b40 con 0x7f534015afd0 2023-11-04T01:43:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53400c83e0 con 0x7f534015afd0 2023-11-04T01:43:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f5336ffd640 1 -- 172.21.15.2:0/3723724421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338007030 con 0x7f534015afd0 2023-11-04T01:43:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.101+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53400c8970 con 0x7f534015afd0 2023-11-04T01:43:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.105+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534006fd20 con 0x7f534015afd0 2023-11-04T01:43:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.105+0000 7f5336ffd640 1 -- 172.21.15.2:0/3723724421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5338007190 con 0x7f534015afd0 2023-11-04T01:43:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.105+0000 7f5336ffd640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f53240664a0 0x7f5324068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.105+0000 7f5336ffd640 1 -- 172.21.15.2:0/3723724421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f53380833f0 con 0x7f534015afd0 2023-11-04T01:43:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.105+0000 7f5346518640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f53240664a0 0x7f5324068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.105+0000 7f5346518640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f53240664a0 0x7f5324068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f533c0af000 tx=0x7f533c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.109+0000 7f5336ffd640 1 -- 172.21.15.2:0/3723724421 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f534006fd20 con 0x7f534015afd0 2023-11-04T01:43:17.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.289+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53400b2270 con 0x7f534015afd0 2023-11-04T01:43:17.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f5336ffd640 1 -- 172.21.15.2:0/3723724421 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f53400b2270 con 0x7f534015afd0 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:43:17.295 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f53240664a0 msgr2=0x7f5324068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f53240664a0 0x7f5324068960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f533c0af000 tx=0x7f533c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 msgr2=0x7f53400c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400c7ea0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f533800c390 tx=0x7f533800c850 comp rx=0 tx=0).stop 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 shutdown_connections 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f53240664a0 0x7f5324068960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f534015afd0 0x7f53400c7ea0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53400b0d40 0x7f53400c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 --2- 172.21.15.2:0/3723724421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f534006f8f0 0x7f5340152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 >> 172.21.15.2:0/3723724421 conn(0x7f53400cebb0 msgr2=0x7f53400cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 shutdown_connections 2023-11-04T01:43:17.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.293+0000 7f534877c640 1 -- 172.21.15.2:0/3723724421 wait complete. 2023-11-04T01:43:17.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:17.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed30bd640 1 Processor -- start 2023-11-04T01:43:17.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed30bd640 1 -- start start 2023-11-04T01:43:17.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed30bd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efecc0b4990 0x7efecc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed30bd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efecc0d0690 0x7efecc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed30bd640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc0b6070 con 0x7efecc0d0ae0 2023-11-04T01:43:17.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed30bd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0b8ed0 con 0x7efecc0d0690 2023-11-04T01:43:17.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed30bd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0b52b0 con 0x7efecc0b4990 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efecbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efecc0d0690 0x7efecc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed165a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efecc0d0ae0 0x7efecc0cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39666/0 (socket says 172.21.15.2:39666) 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed165a640 1 -- 172.21.15.2:0/2127718834 learned_addr learned my addr 172.21.15.2:0/2127718834 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed0e59640 1 --2- 172.21.15.2:0/2127718834 >> v2:172.21.15.90:3300/0 conn(0x7efecc0b4990 0x7efecc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efecb7fe640 1 -- 172.21.15.2:0/2127718834 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114675148 0 0) 0x7efecc0b6070 con 0x7efecc0d0ae0 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efecb7fe640 1 -- 172.21.15.2:0/2127718834 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb4003530 con 0x7efecc0d0ae0 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efecbfff640 1 -- 172.21.15.2:0/2127718834 >> v2:172.21.15.90:3300/0 conn(0x7efecc0b4990 msgr2=0x7efecc0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efecbfff640 1 --2- 172.21.15.2:0/2127718834 >> v2:172.21.15.90:3300/0 conn(0x7efecc0b4990 0x7efecc0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efecbfff640 1 -- 172.21.15.2:0/2127718834 >> v1:172.21.15.2:6789/0 conn(0x7efecc0d0ae0 legacy=0x7efecc0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efecbfff640 1 -- 172.21.15.2:0/2127718834 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0d1ce0 con 0x7efecc0d0690 2023-11-04T01:43:17.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.421+0000 7efed0e59640 1 --2- 172.21.15.2:0/2127718834 >> v2:172.21.15.90:3300/0 conn(0x7efecc0b4990 0x7efecc0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:17.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efecbfff640 1 --2- 172.21.15.2:0/2127718834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0d0690 0x7efecc0cd770 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efecc160ce0 tx=0x7efec001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f43b4a96f06c048 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efecb7fe640 1 -- 172.21.15.2:0/2127718834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec00b0440 con 0x7efecc0d0690 2023-11-04T01:43:17.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efecb7fe640 1 -- 172.21.15.2:0/2127718834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec00b05a0 con 0x7efecc0d0690 2023-11-04T01:43:17.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efecb7fe640 1 -- 172.21.15.2:0/2127718834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec00b0930 con 0x7efecc0d0690 2023-11-04T01:43:17.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 -- 172.21.15.2:0/2127718834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0d0690 msgr2=0x7efecc0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 --2- 172.21.15.2:0/2127718834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0d0690 0x7efecc0cd770 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efecc160ce0 tx=0x7efec001f0f0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 -- 172.21.15.2:0/2127718834 shutdown_connections 2023-11-04T01:43:17.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 --2- 172.21.15.2:0/2127718834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0d0690 0x7efecc0cd770 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 --2- 172.21.15.2:0/2127718834 >> v2:172.21.15.90:3300/0 conn(0x7efecc0b4990 0x7efecc0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 -- 172.21.15.2:0/2127718834 >> 172.21.15.2:0/2127718834 conn(0x7efecc0cf990 msgr2=0x7efecc0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 -- 172.21.15.2:0/2127718834 shutdown_connections 2023-11-04T01:43:17.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 -- 172.21.15.2:0/2127718834 wait complete. 2023-11-04T01:43:17.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 Processor -- start 2023-11-04T01:43:17.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.425+0000 7efed30bd640 1 -- start start 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0b4990 0x7efecc0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efecc0d0690 0x7efecc0cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efecc0d0ae0 0x7efecc1e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0ccff0 con 0x7efecc0b4990 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0cba10 con 0x7efecc0d0690 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0cbcf0 con 0x7efecc0d0ae0 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0b4990 0x7efecc0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0b4990 0x7efecc0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43122/0 (socket says 172.21.15.2:43122) 2023-11-04T01:43:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 -- 172.21.15.2:0/1227025969 learned_addr learned my addr 172.21.15.2:0/1227025969 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 -- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efecc0d0ae0 msgr2=0x7efecc1e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efecc0d0ae0 0x7efecc1e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 -- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efecc0d0690 msgr2=0x7efecc0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efecc0d0690 0x7efecc0cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 -- 172.21.15.2:0/1227025969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0009a70 con 0x7efecc0b4990 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed0e59640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0b4990 0x7efecc0ccab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efec400d800 tx=0x7efec400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efec97fa640 1 -- 172.21.15.2:0/1227025969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec40096c0 con 0x7efecc0b4990 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efec97fa640 1 -- 172.21.15.2:0/1227025969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec4009820 con 0x7efecc0b4990 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc0cbfd0 con 0x7efecc0b4990 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efec97fa640 1 -- 172.21.15.2:0/1227025969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4009bd0 con 0x7efecc0b4990 2023-11-04T01:43:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc0cc590 con 0x7efecc0b4990 2023-11-04T01:43:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc0744a0 con 0x7efecc0b4990 2023-11-04T01:43:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efec97fa640 1 -- 172.21.15.2:0/1227025969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efec4009d30 con 0x7efecc0b4990 2023-11-04T01:43:17.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efec97fa640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efeb80664a0 0x7efeb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efec97fa640 1 -- 172.21.15.2:0/1227025969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7efec40845a0 con 0x7efecc0b4990 2023-11-04T01:43:17.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.429+0000 7efecbfff640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efeb80664a0 0x7efeb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.433+0000 7efecbfff640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efeb80664a0 0x7efeb8068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efec00b2000 tx=0x7efec0004ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.433+0000 7efec97fa640 1 -- 172.21.15.2:0/1227025969 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efec4051a00 con 0x7efecc0b4990 2023-11-04T01:43:17.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.621+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efecc0c9870 con 0x7efecc0b4990 2023-11-04T01:43:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.621+0000 7efec97fa640 1 -- 172.21.15.2:0/1227025969 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4901 (secure 0 0 0) 0x7efec4055020 con 0x7efecc0b4990 2023-11-04T01:43:17.625 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:17.625 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3891381918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3891381918},{"type":"v1","addr":"172.21.15.2:6833","nonce":3891381918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3471716153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3471716153},{"type":"v1","addr":"172.21.15.2:6835","nonce":3471716153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2764079412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2764079412},{"type":"v1","addr":"172.21.15.90:6835","nonce":2764079412}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:42:24.210312+0000","modified":"2023-11-04T01:42:26.230136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1515609154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1515609154},{"type":"v1","addr":"172.21.15.90:6837","nonce":1515609154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-04T01:43:17.625 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 6 2023-11-04T01:43:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efeb80664a0 msgr2=0x7efeb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efeb80664a0 0x7efeb8068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efec00b2000 tx=0x7efec0004ac0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0b4990 msgr2=0x7efecc0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0b4990 0x7efecc0ccab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efec400d800 tx=0x7efec400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 shutdown_connections 2023-11-04T01:43:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efeb80664a0 0x7efeb8068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efecc0d0ae0 0x7efecc1e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efecc0d0690 0x7efecc0cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 --2- 172.21.15.2:0/1227025969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efecc0b4990 0x7efecc0ccab0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 >> 172.21.15.2:0/1227025969 conn(0x7efecc0cf990 msgr2=0x7efecc0b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 shutdown_connections 2023-11-04T01:43:17.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.625+0000 7efed30bd640 1 -- 172.21.15.2:0/1227025969 wait complete. 2023-11-04T01:43:17.643 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:17.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.761+0000 7f11795ae640 1 Processor -- start 2023-11-04T01:43:17.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.761+0000 7f11795ae640 1 -- start start 2023-11-04T01:43:17.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11795ae640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 0x7f1174166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11795ae640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740c2670 con 0x7f117415afd0 2023-11-04T01:43:17.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11795ae640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117406bc30 con 0x7f11740715d0 2023-11-04T01:43:17.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11795ae640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1174070140 con 0x7f11740b0d40 2023-11-04T01:43:17.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1172ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f117415afd0 0x7f117406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39668/0 (socket says 172.21.15.2:39668) 2023-11-04T01:43:17.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1172ffd640 1 -- 172.21.15.2:0/2435431038 learned_addr learned my addr 172.21.15.2:0/2435431038 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:17.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225970980 0 0) 0x7f11740c2670 con 0x7f117415afd0 2023-11-04T01:43:17.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11737fe640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 0x7f1174166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f115c003530 con 0x7f117415afd0 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 538543587 0 0) 0x7f115c003530 con 0x7f117415afd0 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 msgr2=0x7f1174166010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 0x7f1174166010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 >> v1:172.21.15.90:6789/0 conn(0x7f11740715d0 legacy=0x7f11740b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117406bf10 con 0x7f117415afd0 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f1164001680 con 0x7f117415afd0 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 >> v1:172.21.15.2:6789/0 conn(0x7f117415afd0 legacy=0x7f117406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 0x7f115c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f115c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f115c004d10 0x7f115c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174070140 con 0x7f115c003f30 2023-11-04T01:43:17.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c00ba70 con 0x7f115c004d10 2023-11-04T01:43:17.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c00bc30 con 0x7f11740b0d40 2023-11-04T01:43:17.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11727fc640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f115c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f1172ffd640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 0x7f115c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11737fe640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f115c004d10 0x7f115c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11727fc640 1 -- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 msgr2=0x7f115c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11727fc640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740b0d40 0x7f115c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11727fc640 1 -- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f115c004d10 msgr2=0x7f115c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:17.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11727fc640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f115c004d10 0x7f115c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11727fc640 1 -- 172.21.15.2:0/2435431038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c003530 con 0x7f115c003f30 2023-11-04T01:43:17.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11737fe640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f115c004d10 0x7f115c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:17.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.765+0000 7f11727fc640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f115c0047d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1168001780 tx=0x7f116801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7e71f98ee2b1e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680052d0 con 0x7f115c003f30 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11680a7050 con 0x7f115c003f30 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1171ffb640 1 -- 172.21.15.2:0/2435431038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168003600 con 0x7f115c003f30 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- 172.21.15.2:0/2435431038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 msgr2=0x7f115c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 --2- 172.21.15.2:0/2435431038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f115c0047d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1168001780 tx=0x7f116801c400 comp rx=0 tx=0).stop 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11737fe640 1 -- 172.21.15.2:0/2435431038 reap_dead start 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- 172.21.15.2:0/2435431038 shutdown_connections 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- 172.21.15.2:0/2435431038 >> 172.21.15.2:0/2435431038 conn(0x7f11740cebb0 msgr2=0x7f11740cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- 172.21.15.2:0/2435431038 shutdown_connections 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- 172.21.15.2:0/2435431038 wait complete. 2023-11-04T01:43:17.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 Processor -- start 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- start start 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f11740ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117414f1d0 0x7f11740b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740ad160 0x7f11740afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117415fc90 con 0x7f115c003f30 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740ae3d0 con 0x7f117414f1d0 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740b3cc0 con 0x7f11740ad160 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f11740ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f11740ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43144/0 (socket says 172.21.15.2:43144) 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 -- 172.21.15.2:0/1279301084 learned_addr learned my addr 172.21.15.2:0/1279301084 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11727fc640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117414f1d0 0x7f11740b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11737fe640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740ad160 0x7f11740afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 -- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740ad160 msgr2=0x7f11740afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740ad160 0x7f11740afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 -- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117414f1d0 msgr2=0x7f11740b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117414f1d0 0x7f11740b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 -- 172.21.15.2:0/1279301084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740b3f80 con 0x7f115c003f30 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f1172ffd640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f11740ade90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f11640118c0 tx=0x7f1164011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f115b7fe640 1 -- 172.21.15.2:0/1279301084 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116400fb60 con 0x7f115c003f30 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f115b7fe640 1 -- 172.21.15.2:0/1279301084 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400fce0 con 0x7f115c003f30 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11740b4260 con 0x7f115c003f30 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f115b7fe640 1 -- 172.21.15.2:0/1279301084 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164015650 con 0x7f115c003f30 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.769+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11740ac960 con 0x7f115c003f30 2023-11-04T01:43:17.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.773+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11740744a0 con 0x7f115c003f30 2023-11-04T01:43:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.773+0000 7f115b7fe640 1 -- 172.21.15.2:0/1279301084 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11640157b0 con 0x7f115c003f30 2023-11-04T01:43:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.773+0000 7f115b7fe640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11600664d0 0x7f1160068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.773+0000 7f115b7fe640 1 -- 172.21.15.2:0/1279301084 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1164087190 con 0x7f115c003f30 2023-11-04T01:43:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.773+0000 7f11727fc640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11600664d0 0x7f1160068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.773+0000 7f11727fc640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11600664d0 0x7f1160068990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1168001750 tx=0x7f11680011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:17.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.777+0000 7f115b7fe640 1 -- 172.21.15.2:0/1279301084 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1164054550 con 0x7f115c003f30 2023-11-04T01:43:17.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.933+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f117406cba0 con 0x7f115c003f30 2023-11-04T01:43:17.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.937+0000 7f115b7fe640 1 -- 172.21.15.2:0/1279301084 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16450 (secure 0 0 0) 0x7f1164057b70 con 0x7f115c003f30 2023-11-04T01:43:17.940 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:17.940 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":23,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:06.514937+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:42:22.358447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-04T01:42:23.191616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.937+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11600664d0 msgr2=0x7f1160068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.937+0000 7f11795ae640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11600664d0 0x7f1160068990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1168001750 tx=0x7f11680011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.937+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 msgr2=0x7f11740ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.937+0000 7f11795ae640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f11740ade90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f11640118c0 tx=0x7f1164011d80 comp rx=0 tx=0).stop 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.937+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 shutdown_connections 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.941+0000 7f11795ae640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11600664d0 0x7f1160068990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.941+0000 7f11795ae640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11740ad160 0x7f11740afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.941+0000 7f11795ae640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f117414f1d0 0x7f11740b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.941+0000 7f11795ae640 1 --2- 172.21.15.2:0/1279301084 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f115c003f30 0x7f11740ade90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:17.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.941+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 >> 172.21.15.2:0/1279301084 conn(0x7f11740cebb0 msgr2=0x7f11740ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:17.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.941+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 shutdown_connections 2023-11-04T01:43:17.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:17.941+0000 7f11795ae640 1 -- 172.21.15.2:0/1279301084 wait complete. 2023-11-04T01:43:17.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:43:18.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd750a0640 1 Processor -- start 2023-11-04T01:43:18.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd750a0640 1 -- start start 2023-11-04T01:43:18.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd750a0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd700cd6a0 0x7efd700cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd750a0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd700ce320 con 0x7efd700b0890 2023-11-04T01:43:18.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd750a0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd700ce600 con 0x7efd700c9960 2023-11-04T01:43:18.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd750a0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7006d2f0 con 0x7efd700cd6a0 2023-11-04T01:43:18.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6ed9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efd700b0890 0x7efd700704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39670/0 (socket says 172.21.15.2:39670) 2023-11-04T01:43:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6ed9d640 1 -- 172.21.15.2:0/4098325747 learned_addr learned my addr 172.21.15.2:0/4098325747 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6f59e640 1 --2- 172.21.15.2:0/4098325747 >> v2:172.21.15.2:3300/0 conn(0x7efd700cd6a0 0x7efd700cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6dd9b640 1 -- 172.21.15.2:0/4098325747 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088228644 0 0) 0x7efd700ce320 con 0x7efd700b0890 2023-11-04T01:43:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6dd9b640 1 -- 172.21.15.2:0/4098325747 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd58005740 con 0x7efd700b0890 2023-11-04T01:43:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6f59e640 1 -- 172.21.15.2:0/4098325747 >> v1:172.21.15.90:6789/0 conn(0x7efd700c9960 legacy=0x7efd700ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6f59e640 1 -- 172.21.15.2:0/4098325747 >> v1:172.21.15.2:6789/0 conn(0x7efd700b0890 legacy=0x7efd700704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.081+0000 7efd6f59e640 1 -- 172.21.15.2:0/4098325747 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd700ce8e0 con 0x7efd700cd6a0 2023-11-04T01:43:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd6f59e640 1 --2- 172.21.15.2:0/4098325747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700cd6a0 0x7efd700cdbd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd68009d90 tx=0x7efd6801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907794bff3b19f3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd6dd9b640 1 -- 172.21.15.2:0/4098325747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680a5870 con 0x7efd700cd6a0 2023-11-04T01:43:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd6dd9b640 1 -- 172.21.15.2:0/4098325747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680a59d0 con 0x7efd700cd6a0 2023-11-04T01:43:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd6dd9b640 1 -- 172.21.15.2:0/4098325747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680a5d60 con 0x7efd700cd6a0 2023-11-04T01:43:18.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- 172.21.15.2:0/4098325747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700cd6a0 msgr2=0x7efd700cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 --2- 172.21.15.2:0/4098325747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700cd6a0 0x7efd700cdbd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd68009d90 tx=0x7efd6801c8c0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- 172.21.15.2:0/4098325747 shutdown_connections 2023-11-04T01:43:18.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 --2- 172.21.15.2:0/4098325747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700cd6a0 0x7efd700cdbd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- 172.21.15.2:0/4098325747 >> 172.21.15.2:0/4098325747 conn(0x7efd700cebb0 msgr2=0x7efd700cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- 172.21.15.2:0/4098325747 shutdown_connections 2023-11-04T01:43:18.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- 172.21.15.2:0/4098325747 wait complete. 2023-11-04T01:43:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 Processor -- start 2023-11-04T01:43:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- start start 2023-11-04T01:43:18.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd700b0890 0x7efd700c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700c9960 0x7efd700c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd700cd6a0 0x7efd700c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c49b0 con 0x7efd700c9960 2023-11-04T01:43:18.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c4f30 con 0x7efd700cd6a0 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.085+0000 7efd750a0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c4c50 con 0x7efd700b0890 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700c9960 0x7efd700c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700c9960 0x7efd700c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43166/0 (socket says 172.21.15.2:43166) 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 -- 172.21.15.2:0/2971935170 learned_addr learned my addr 172.21.15.2:0/2971935170 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6f59e640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd700cd6a0 0x7efd700c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6ed9d640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd700b0890 0x7efd700c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 -- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd700b0890 msgr2=0x7efd700c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd700b0890 0x7efd700c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 -- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd700cd6a0 msgr2=0x7efd700c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd700cd6a0 0x7efd700c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 -- 172.21.15.2:0/2971935170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009a70 con 0x7efd700c9960 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6f59e640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd700cd6a0 0x7efd700c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6e59c640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700c9960 0x7efd700c3f30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c500 tx=0x7efd6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd577fe640 1 -- 172.21.15.2:0/2971935170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64005220 con 0x7efd700c9960 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd577fe640 1 -- 172.21.15.2:0/2971935170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64005380 con 0x7efd700c9960 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700c5c90 con 0x7efd700c9960 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd577fe640 1 -- 172.21.15.2:0/2971935170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64007270 con 0x7efd700c9960 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd700c6250 con 0x7efd700c9960 2023-11-04T01:43:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd700744a0 con 0x7efd700c9960 2023-11-04T01:43:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd577fe640 1 -- 172.21.15.2:0/2971935170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd640073d0 con 0x7efd700c9960 2023-11-04T01:43:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd577fe640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd5c0664d0 0x7efd5c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd577fe640 1 -- 172.21.15.2:0/2971935170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7efd64083730 con 0x7efd700c9960 2023-11-04T01:43:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.089+0000 7efd6ed9d640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd5c0664d0 0x7efd5c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.093+0000 7efd6ed9d640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd5c0664d0 0x7efd5c068990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd600011f0 tx=0x7efd60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.093+0000 7efd577fe640 1 -- 172.21.15.2:0/2971935170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd64050ba0 con 0x7efd700c9960 2023-11-04T01:43:18.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.277+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efd700b4b30 con 0x7efd700c9960 2023-11-04T01:43:18.280 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-04T01:43:18.277+0000 7f4b9aa78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:43:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd577fe640 1 -- 172.21.15.2:0/2971935170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7efd640541c0 con 0x7efd700c9960 2023-11-04T01:43:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:43:18.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd5c0664d0 msgr2=0x7efd5c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd5c0664d0 0x7efd5c068990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd600011f0 tx=0x7efd60009040 comp rx=0 tx=0).stop 2023-11-04T01:43:18.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700c9960 msgr2=0x7efd700c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700c9960 0x7efd700c3f30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c500 tx=0x7efd6400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 shutdown_connections 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd5c0664d0 0x7efd5c068990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd700cd6a0 0x7efd700c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.281+0000 7efd750a0640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd700c9960 0x7efd700c3f30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.285+0000 7efd750a0640 1 --2- 172.21.15.2:0/2971935170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd700b0890 0x7efd700c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.285+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 >> 172.21.15.2:0/2971935170 conn(0x7efd700cebb0 msgr2=0x7efd70070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.285+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 shutdown_connections 2023-11-04T01:43:18.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.285+0000 7efd750a0640 1 -- 172.21.15.2:0/2971935170 wait complete. 2023-11-04T01:43:18.296 INFO:tasks.ceph.mds.b.smithi090.stderr: -3320> 2023-11-04T01:42:28.897+0000 7f9b54b78640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:18.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:43:18.358 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:43:18.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.421+0000 7f7ec040f640 1 Processor -- start 2023-11-04T01:43:18.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.421+0000 7f7ec040f640 1 -- start start 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ec040f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb80cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ec040f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7eb80d1940 0x7f7eb80d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ec040f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb80b5e00 con 0x7f7eb815d0b0 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ec040f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb80d1520 con 0x7f7eb80d1940 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ec040f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb80d0190 con 0x7f7eb80cf810 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebe9ac640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7eb80d1940 0x7f7eb80d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebe9ac640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7eb80d1940 0x7f7eb80d1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43174/0 (socket says 172.21.15.2:43174) 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebe9ac640 1 -- 172.21.15.2:0/2112579124 learned_addr learned my addr 172.21.15.2:0/2112579124 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebd9aa640 1 --2- 172.21.15.2:0/2112579124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb80cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebe9ac640 1 -- 172.21.15.2:0/2112579124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 msgr2=0x7f7eb80cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebe9ac640 1 --2- 172.21.15.2:0/2112579124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb80cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebe9ac640 1 -- 172.21.15.2:0/2112579124 >> v1:172.21.15.90:6789/0 conn(0x7f7eb815d0b0 legacy=0x7f7eb8160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.425+0000 7f7ebe9ac640 1 -- 172.21.15.2:0/2112579124 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb815d490 con 0x7f7eb80d1940 2023-11-04T01:43:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebe9ac640 1 --2- 172.21.15.2:0/2112579124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80d1dd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009e50 tx=0x7f7eb001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326b5f0b04acd132 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd1a9640 1 -- 172.21.15.2:0/2112579124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00a5850 con 0x7f7eb80d1940 2023-11-04T01:43:18.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd1a9640 1 -- 172.21.15.2:0/2112579124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb00a59b0 con 0x7f7eb80d1940 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd1a9640 1 -- 172.21.15.2:0/2112579124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00a5d40 con 0x7f7eb80d1940 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- 172.21.15.2:0/2112579124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 msgr2=0x7f7eb80d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2112579124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80d1dd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0009e50 tx=0x7f7eb001c9d0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- 172.21.15.2:0/2112579124 shutdown_connections 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2112579124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80d1dd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2112579124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb80cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- 172.21.15.2:0/2112579124 >> 172.21.15.2:0/2112579124 conn(0x7f7eb806a890 msgr2=0x7f7eb806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- 172.21.15.2:0/2112579124 shutdown_connections 2023-11-04T01:43:18.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- 172.21.15.2:0/2112579124 wait complete. 2023-11-04T01:43:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 Processor -- start 2023-11-04T01:43:18.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- start start 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb815d0b0 0x7f7eb80c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8154ea0 con 0x7f7eb80d1940 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8154290 con 0x7f7eb815d0b0 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ec040f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb8154570 con 0x7f7eb80cf810 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43188/0 (socket says 172.21.15.2:43188) 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 -- 172.21.15.2:0/2383274714 learned_addr learned my addr 172.21.15.2:0/2383274714 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebe1ab640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebe9ac640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb815d0b0 0x7f7eb80c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 -- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 msgr2=0x7f7eb815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 -- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb815d0b0 msgr2=0x7f7eb80c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb815d0b0 0x7f7eb80c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 -- 172.21.15.2:0/2383274714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0009b30 con 0x7f7eb80d1940 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebe9ac640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb815d0b0 0x7f7eb80c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7ebd9aa640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80b7b30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800d5f0 tx=0x7f7ea800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.429+0000 7f7eaeffd640 1 -- 172.21.15.2:0/2383274714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80125f0 con 0x7f7eb80d1940 2023-11-04T01:43:18.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7eaeffd640 1 -- 172.21.15.2:0/2383274714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8012750 con 0x7f7eb80d1940 2023-11-04T01:43:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7eaeffd640 1 -- 172.21.15.2:0/2383274714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8012ae0 con 0x7f7eb80d1940 2023-11-04T01:43:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb8154850 con 0x7f7eb80d1940 2023-11-04T01:43:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb815c170 con 0x7f7eb80d1940 2023-11-04T01:43:18.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb80744a0 con 0x7f7eb80d1940 2023-11-04T01:43:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7eaeffd640 1 -- 172.21.15.2:0/2383274714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ea8012c40 con 0x7f7eb80d1940 2023-11-04T01:43:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7eaeffd640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e9c0664a0 0x7f7e9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7eaeffd640 1 -- 172.21.15.2:0/2383274714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f7ea8084410 con 0x7f7eb80d1940 2023-11-04T01:43:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7ebe1ab640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e9c0664a0 0x7f7e9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:18.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.433+0000 7f7ebe1ab640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e9c0664a0 0x7f7e9c068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4004e30 tx=0x7f7eb4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:18.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.437+0000 7f7eaeffd640 1 -- 172.21.15.2:0/2383274714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ea80517a0 con 0x7f7eb80d1940 2023-11-04T01:43:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:18.629+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7eb80d0a10 con 0x7f7eb80d1940 2023-11-04T01:43:19.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.281+0000 7f7eaeffd640 1 -- 172.21.15.2:0/2383274714 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7ea8007380 con 0x7f7eb80d1940 2023-11-04T01:43:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e9c0664a0 msgr2=0x7f7e9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e9c0664a0 0x7f7e9c068960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4004e30 tx=0x7f7eb4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 msgr2=0x7f7eb80b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80b7b30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800d5f0 tx=0x7f7ea800dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 shutdown_connections 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e9c0664a0 0x7f7e9c068960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb815d0b0 0x7f7eb80c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7eb80d1940 0x7f7eb80b7b30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 --2- 172.21.15.2:0/2383274714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7eb80cf810 0x7f7eb815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 >> 172.21.15.2:0/2383274714 conn(0x7f7eb806a890 msgr2=0x7f7eb80cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 shutdown_connections 2023-11-04T01:43:19.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.285+0000 7f7ec040f640 1 -- 172.21.15.2:0/2383274714 wait complete. 2023-11-04T01:43:19.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:43:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.441+0000 7f84e806c640 1 Processor -- start 2023-11-04T01:43:19.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.441+0000 7f84e806c640 1 -- start start 2023-11-04T01:43:19.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e806c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84e00cae40 0x7f84e00cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e806c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84e00cb300 0x7f84e015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e806c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e00b2e20 con 0x7f84e015b2c0 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e806c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e00ce0a0 con 0x7f84e00cae40 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e806c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e00cd190 con 0x7f84e00cb300 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e5e08640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f84e015b2c0 0x7f84e00cd450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39686/0 (socket says 172.21.15.2:39686) 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e5e08640 1 -- 172.21.15.2:0/635969746 learned_addr learned my addr 172.21.15.2:0/635969746 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e5607640 1 --2- 172.21.15.2:0/635969746 >> v2:172.21.15.2:3300/0 conn(0x7f84e00cae40 0x7f84e00cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e6609640 1 --2- 172.21.15.2:0/635969746 >> v2:172.21.15.90:3300/0 conn(0x7f84e00cb300 0x7f84e015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e4e06640 1 -- 172.21.15.2:0/635969746 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276621745 0 0) 0x7f84e00b2e20 con 0x7f84e015b2c0 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e4e06640 1 -- 172.21.15.2:0/635969746 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84cc003530 con 0x7f84e015b2c0 2023-11-04T01:43:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e5607640 1 -- 172.21.15.2:0/635969746 >> v2:172.21.15.90:3300/0 conn(0x7f84e00cb300 msgr2=0x7f84e015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e5607640 1 --2- 172.21.15.2:0/635969746 >> v2:172.21.15.90:3300/0 conn(0x7f84e00cb300 0x7f84e015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e5607640 1 -- 172.21.15.2:0/635969746 >> v1:172.21.15.2:6789/0 conn(0x7f84e015b2c0 legacy=0x7f84e00cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.445+0000 7f84e5607640 1 -- 172.21.15.2:0/635969746 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e00b27d0 con 0x7f84e00cae40 2023-11-04T01:43:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 --2- 172.21.15.2:0/635969746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cae40 0x7f84e00cdb60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f84e00c7d00 tx=0x7f84d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf27dd7de81aea6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e4e06640 1 -- 172.21.15.2:0/635969746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00ab600 con 0x7f84e00cae40 2023-11-04T01:43:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e4e06640 1 -- 172.21.15.2:0/635969746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d00a7050 con 0x7f84e00cae40 2023-11-04T01:43:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e4e06640 1 -- 172.21.15.2:0/635969746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00ab960 con 0x7f84e00cae40 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- 172.21.15.2:0/635969746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cae40 msgr2=0x7f84e00cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 --2- 172.21.15.2:0/635969746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cae40 0x7f84e00cdb60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f84e00c7d00 tx=0x7f84d001c430 comp rx=0 tx=0).stop 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- 172.21.15.2:0/635969746 shutdown_connections 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 --2- 172.21.15.2:0/635969746 >> v2:172.21.15.90:3300/0 conn(0x7f84e00cb300 0x7f84e015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 --2- 172.21.15.2:0/635969746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cae40 0x7f84e00cdb60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- 172.21.15.2:0/635969746 >> 172.21.15.2:0/635969746 conn(0x7f84e006dcf0 msgr2=0x7f84e006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- 172.21.15.2:0/635969746 shutdown_connections 2023-11-04T01:43:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- 172.21.15.2:0/635969746 wait complete. 2023-11-04T01:43:19.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 Processor -- start 2023-11-04T01:43:19.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- start start 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e00cae40 0x7f84e01481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cb300 0x7f84e00c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e015b2c0 0x7f84e014ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00c7d80 con 0x7f84e00cb300 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e01486e0 con 0x7f84e015b2c0 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e806c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00c6fe0 con 0x7f84e00cae40 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cb300 0x7f84e00c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cb300 0x7f84e00c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43192/0 (socket says 172.21.15.2:43192) 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 -- 172.21.15.2:0/165395159 learned_addr learned my addr 172.21.15.2:0/165395159 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:19.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e6609640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e015b2c0 0x7f84e014ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5e08640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e00cae40 0x7f84e01481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 -- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e00cae40 msgr2=0x7f84e01481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e00cae40 0x7f84e01481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 -- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e015b2c0 msgr2=0x7f84e014ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e015b2c0 0x7f84e014ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e5607640 1 -- 172.21.15.2:0/165395159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d0009420 con 0x7f84e00cb300 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.449+0000 7f84e6609640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e015b2c0 0x7f84e014ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84e5607640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cb300 0x7f84e00c6720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f84d0000c10 tx=0x7f84d00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84d67fc640 1 -- 172.21.15.2:0/165395159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00b4400 con 0x7f84e00cb300 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84d67fc640 1 -- 172.21.15.2:0/165395159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d00b4580 con 0x7f84e00cb300 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e00c72c0 con 0x7f84e00cb300 2023-11-04T01:43:19.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84d67fc640 1 -- 172.21.15.2:0/165395159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00b4930 con 0x7f84e00cb300 2023-11-04T01:43:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e00c82b0 con 0x7f84e00cb300 2023-11-04T01:43:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e00675f0 con 0x7f84e00cb300 2023-11-04T01:43:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84d67fc640 1 -- 172.21.15.2:0/165395159 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84d00b2040 con 0x7f84e00cb300 2023-11-04T01:43:19.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84d67fc640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84c40664a0 0x7f84c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84d67fc640 1 -- 172.21.15.2:0/165395159 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f84d011dd90 con 0x7f84e00cb300 2023-11-04T01:43:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84e5e08640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84c40664a0 0x7f84c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:19.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.453+0000 7f84e5e08640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84c40664a0 0x7f84c4068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005890 tx=0x7f84dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:19.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.457+0000 7f84d67fc640 1 -- 172.21.15.2:0/165395159 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84d00eb1b0 con 0x7f84e00cb300 2023-11-04T01:43:19.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:19.613+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84e00cfca0 con 0x7f84e00cb300 2023-11-04T01:43:20.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.509+0000 7f84d67fc640 1 -- 172.21.15.2:0/165395159 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f84d00ee7d0 con 0x7f84e00cb300 2023-11-04T01:43:20.512 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:43:20.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.513+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84c40664a0 msgr2=0x7f84c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.513+0000 7f84e806c640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84c40664a0 0x7f84c4068960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005890 tx=0x7f84dc009040 comp rx=0 tx=0).stop 2023-11-04T01:43:20.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.513+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cb300 msgr2=0x7f84e00c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.513+0000 7f84e806c640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cb300 0x7f84e00c6720 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f84d0000c10 tx=0x7f84d00191d0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.517+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 shutdown_connections 2023-11-04T01:43:20.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.517+0000 7f84e806c640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84c40664a0 0x7f84c4068960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.517+0000 7f84e806c640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e015b2c0 0x7f84e014ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.517+0000 7f84e806c640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e00cb300 0x7f84e00c6720 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.517+0000 7f84e806c640 1 --2- 172.21.15.2:0/165395159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e00cae40 0x7f84e01481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.517+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 >> 172.21.15.2:0/165395159 conn(0x7f84e006dcf0 msgr2=0x7f84e00b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.525+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 shutdown_connections 2023-11-04T01:43:20.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.525+0000 7f84e806c640 1 -- 172.21.15.2:0/165395159 wait complete. 2023-11-04T01:43:20.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:43:20.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.689+0000 7f59f7dce640 1 Processor -- start 2023-11-04T01:43:20.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.689+0000 7f59f7dce640 1 -- start start 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f7dce640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59f015b2c0 0x7f59f00cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f7dce640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f00cae40 0x7f59f00cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f7dce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f59f00cb300 0x7f59f015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f7dce640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00b2e20 con 0x7f59f015b2c0 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f7dce640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00cd190 con 0x7f59f00cb300 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f7dce640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00b27d0 con 0x7f59f00cae40 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59f015b2c0 0x7f59f00cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f59f015b2c0 0x7f59f00cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43202/0 (socket says 172.21.15.2:43202) 2023-11-04T01:43:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 -- 172.21.15.2:0/1985510504 learned_addr learned my addr 172.21.15.2:0/1985510504 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f636b640 1 --2- 172.21.15.2:0/1985510504 >> v2:172.21.15.90:3300/0 conn(0x7f59f00cb300 0x7f59f015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5369640 1 --2- 172.21.15.2:0/1985510504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f00cae40 0x7f59f00cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 -- 172.21.15.2:0/1985510504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f00cae40 msgr2=0x7f59f00cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 --2- 172.21.15.2:0/1985510504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f00cae40 0x7f59f00cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 -- 172.21.15.2:0/1985510504 >> v2:172.21.15.90:3300/0 conn(0x7f59f00cb300 msgr2=0x7f59f015ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 --2- 172.21.15.2:0/1985510504 >> v2:172.21.15.90:3300/0 conn(0x7f59f00cb300 0x7f59f015ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 -- 172.21.15.2:0/1985510504 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00b2ab0 con 0x7f59f015b2c0 2023-11-04T01:43:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5369640 1 --2- 172.21.15.2:0/1985510504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f00cae40 0x7f59f00cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f5b6a640 1 --2- 172.21.15.2:0/1985510504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f015b2c0 0x7f59f00cd450 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f59f015fda0 tx=0x7f59ec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9accfc53246214f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f4b68640 1 -- 172.21.15.2:0/1985510504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f00ccf90 con 0x7f59f015b2c0 2023-11-04T01:43:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f4b68640 1 -- 172.21.15.2:0/1985510504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec0ac630 con 0x7f59f015b2c0 2023-11-04T01:43:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.693+0000 7f59f4b68640 1 -- 172.21.15.2:0/1985510504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec0ac9c0 con 0x7f59f015b2c0 2023-11-04T01:43:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- 172.21.15.2:0/1985510504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f015b2c0 msgr2=0x7f59f00cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1985510504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f015b2c0 0x7f59f00cd450 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f59f015fda0 tx=0x7f59ec01c500 comp rx=0 tx=0).stop 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- 172.21.15.2:0/1985510504 shutdown_connections 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1985510504 >> v2:172.21.15.90:3300/0 conn(0x7f59f00cb300 0x7f59f015ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1985510504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f00cae40 0x7f59f00cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1985510504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f015b2c0 0x7f59f00cd450 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- 172.21.15.2:0/1985510504 >> 172.21.15.2:0/1985510504 conn(0x7f59f006dcf0 msgr2=0x7f59f006e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- 172.21.15.2:0/1985510504 shutdown_connections 2023-11-04T01:43:20.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- 172.21.15.2:0/1985510504 wait complete. 2023-11-04T01:43:20.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 Processor -- start 2023-11-04T01:43:20.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- start start 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59f00cae40 0x7f59f0147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f00cb300 0x7f59f015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f015b2c0 0x7f59f0151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0147770 con 0x7f59f00cb300 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f015a560 con 0x7f59f00cae40 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f7dce640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00c5890 con 0x7f59f015b2c0 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f5369640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f00cb300 0x7f59f015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f5369640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f00cb300 0x7f59f015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43214/0 (socket says 172.21.15.2:43214) 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f5369640 1 -- 172.21.15.2:0/1637376783 learned_addr learned my addr 172.21.15.2:0/1637376783 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f636b640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f015b2c0 0x7f59f0151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.697+0000 7f59f5b6a640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59f00cae40 0x7f59f0147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f5369640 1 -- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f015b2c0 msgr2=0x7f59f0151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f5369640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f015b2c0 0x7f59f0151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f5369640 1 -- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59f00cae40 msgr2=0x7f59f0147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f5369640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59f00cae40 0x7f59f0147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f5369640 1 -- 172.21.15.2:0/1637376783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0094d0 con 0x7f59f00cb300 2023-11-04T01:43:20.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f5369640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f00cb300 0x7f59f015a020 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59e000c7c0 tx=0x7f59e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59e67fc640 1 -- 172.21.15.2:0/1637376783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0007a30 con 0x7f59f00cb300 2023-11-04T01:43:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59e67fc640 1 -- 172.21.15.2:0/1637376783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0007b90 con 0x7f59f00cb300 2023-11-04T01:43:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f00c5b70 con 0x7f59f00cb300 2023-11-04T01:43:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59e67fc640 1 -- 172.21.15.2:0/1637376783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000ce70 con 0x7f59f00cb300 2023-11-04T01:43:20.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f00c6130 con 0x7f59f00cb300 2023-11-04T01:43:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f00675f0 con 0x7f59f00cb300 2023-11-04T01:43:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59e67fc640 1 -- 172.21.15.2:0/1637376783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f59e00113f0 con 0x7f59f00cb300 2023-11-04T01:43:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59e67fc640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59d40664a0 0x7f59d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59e67fc640 1 -- 172.21.15.2:0/1637376783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f59e0083e50 con 0x7f59f00cb300 2023-11-04T01:43:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.701+0000 7f59f5b6a640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59d40664a0 0x7f59d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:20.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.705+0000 7f59f5b6a640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59d40664a0 0x7f59d4068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0ae000 tx=0x7f59ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.705+0000 7f59e67fc640 1 -- 172.21.15.2:0/1637376783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59e0051400 con 0x7f59f00cb300 2023-11-04T01:43:20.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:20.873+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f59f00ce1f0 con 0x7f59f00cb300 2023-11-04T01:43:21.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.521+0000 7f59e67fc640 1 -- 172.21.15.2:0/1637376783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f59e0054a20 con 0x7f59f00cb300 2023-11-04T01:43:21.524 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-04T01:43:21.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59d40664a0 msgr2=0x7f59d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59d40664a0 0x7f59d4068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0ae000 tx=0x7f59ec008040 comp rx=0 tx=0).stop 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f00cb300 msgr2=0x7f59f015a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f00cb300 0x7f59f015a020 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59e000c7c0 tx=0x7f59e000cc80 comp rx=0 tx=0).stop 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 shutdown_connections 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59d40664a0 0x7f59d4068960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f59f015b2c0 0x7f59f0151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59f00cb300 0x7f59f015a020 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 --2- 172.21.15.2:0/1637376783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59f00cae40 0x7f59f0147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 >> 172.21.15.2:0/1637376783 conn(0x7f59f006dcf0 msgr2=0x7f59f00b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 shutdown_connections 2023-11-04T01:43:21.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.525+0000 7f59f7dce640 1 -- 172.21.15.2:0/1637376783 wait complete. 2023-11-04T01:43:21.559 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:43:21.559 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:43:21.559 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:43:21.559 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:21.560 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:43:21.560 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:43:21.560 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:43:21.560 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:21.560 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:43:21.560 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:43:21.560 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:43:21.560 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:21.561 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:43:21.561 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:43:21.561 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:43:21.561 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:21.578 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:43:21.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:43:21.579 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:43:21.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:43:21.583 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:43:21.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:43:21.589 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:43:21.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:43:21.624 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:43:21.625 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:21.626 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:43:21.626 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:21.632 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:43:21.632 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:21.632 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:43:21.633 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:21.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:43:21.683 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:43:21.684 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:43:21.697 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:43:21.697 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:43:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2eaae640 1 Processor -- start 2023-11-04T01:43:21.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2eaae640 1 -- start start 2023-11-04T01:43:21.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2eaae640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d280b4990 0x7f6d280b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2eaae640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d280b74f0 0x7f6d280cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2eaae640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d280b6070 con 0x7f6d280d0690 2023-11-04T01:43:21.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2eaae640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280b8ed0 con 0x7f6d280b4990 2023-11-04T01:43:21.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2eaae640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280b52b0 con 0x7f6d280b74f0 2023-11-04T01:43:21.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2c84a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d280b4990 0x7f6d280b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2c84a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6d280b4990 0x7f6d280b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50154/0 (socket says 172.21.15.2:50154) 2023-11-04T01:43:21.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2c84a640 1 -- 172.21.15.2:0/1644297969 learned_addr learned my addr 172.21.15.2:0/1644297969 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:21.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2d04b640 1 --2- 172.21.15.2:0/1644297969 >> v2:172.21.15.90:3300/0 conn(0x7f6d280b74f0 0x7f6d280cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2c84a640 1 -- 172.21.15.2:0/1644297969 >> v2:172.21.15.90:3300/0 conn(0x7f6d280b74f0 msgr2=0x7f6d280cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:21.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2c84a640 1 --2- 172.21.15.2:0/1644297969 >> v2:172.21.15.90:3300/0 conn(0x7f6d280b74f0 0x7f6d280cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2c84a640 1 -- 172.21.15.2:0/1644297969 >> v1:172.21.15.90:6789/0 conn(0x7f6d280d0690 legacy=0x7f6d280cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.745+0000 7f6d2c84a640 1 -- 172.21.15.2:0/1644297969 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280d1ce0 con 0x7f6d280b4990 2023-11-04T01:43:21.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2c84a640 1 --2- 172.21.15.2:0/1644297969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280b4990 0x7f6d280b4d70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6d2808c3b0 tx=0x7f6d1c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63707eaf4f5d2f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d277fe640 1 -- 172.21.15.2:0/1644297969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0a89f0 con 0x7f6d280b4990 2023-11-04T01:43:21.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d277fe640 1 -- 172.21.15.2:0/1644297969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0a8b50 con 0x7f6d280b4990 2023-11-04T01:43:21.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d277fe640 1 -- 172.21.15.2:0/1644297969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0b0440 con 0x7f6d280b4990 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- 172.21.15.2:0/1644297969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280b4990 msgr2=0x7f6d280b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/1644297969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280b4990 0x7f6d280b4d70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6d2808c3b0 tx=0x7f6d1c01ecf0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- 172.21.15.2:0/1644297969 shutdown_connections 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/1644297969 >> v2:172.21.15.90:3300/0 conn(0x7f6d280b74f0 0x7f6d280cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/1644297969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280b4990 0x7f6d280b4d70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- 172.21.15.2:0/1644297969 >> 172.21.15.2:0/1644297969 conn(0x7f6d280cf990 msgr2=0x7f6d280cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- 172.21.15.2:0/1644297969 shutdown_connections 2023-11-04T01:43:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- 172.21.15.2:0/1644297969 wait complete. 2023-11-04T01:43:21.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 Processor -- start 2023-11-04T01:43:21.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- start start 2023-11-04T01:43:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d280b4990 0x7f6d2815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d280b74f0 0x7f6d2815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280d0690 0x7f6d2815a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28160380 con 0x7f6d280d0690 2023-11-04T01:43:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d281e57d0 con 0x7f6d280b4990 2023-11-04T01:43:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2eaae640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d281e5a90 con 0x7f6d280b74f0 2023-11-04T01:43:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2d04b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280d0690 0x7f6d2815a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2d04b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280d0690 0x7f6d2815a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50160/0 (socket says 172.21.15.2:50160) 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.749+0000 7f6d2d04b640 1 -- 172.21.15.2:0/251796388 learned_addr learned my addr 172.21.15.2:0/251796388 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2c84a640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d280b4990 0x7f6d2815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d27fff640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d280b74f0 0x7f6d2815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2d04b640 1 -- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d280b74f0 msgr2=0x7f6d2815fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2d04b640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d280b74f0 0x7f6d2815fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2d04b640 1 -- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d280b4990 msgr2=0x7f6d2815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2d04b640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d280b4990 0x7f6d2815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2d04b640 1 -- 172.21.15.2:0/251796388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c0094d0 con 0x7f6d280d0690 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d27fff640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d280b74f0 0x7f6d2815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2d04b640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280d0690 0x7f6d2815a680 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009fd0 tx=0x7f6d2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d257fa640 1 -- 172.21.15.2:0/251796388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20014420 con 0x7f6d280d0690 2023-11-04T01:43:21.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d257fa640 1 -- 172.21.15.2:0/251796388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20014580 con 0x7f6d280d0690 2023-11-04T01:43:21.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d257fa640 1 -- 172.21.15.2:0/251796388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20014930 con 0x7f6d280d0690 2023-11-04T01:43:21.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d281e5d70 con 0x7f6d280d0690 2023-11-04T01:43:21.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d281e6330 con 0x7f6d280d0690 2023-11-04T01:43:21.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d280744a0 con 0x7f6d280d0690 2023-11-04T01:43:21.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d257fa640 1 -- 172.21.15.2:0/251796388 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d20014a90 con 0x7f6d280d0690 2023-11-04T01:43:21.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d257fa640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d140664d0 0x7f6d14068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:21.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d257fa640 1 -- 172.21.15.2:0/251796388 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d20084560 con 0x7f6d280d0690 2023-11-04T01:43:21.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2c84a640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d140664d0 0x7f6d14068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:21.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.753+0000 7f6d2c84a640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d140664d0 0x7f6d14068990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0b2000 tx=0x7f6d1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:21.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.757+0000 7f6d257fa640 1 -- 172.21.15.2:0/251796388 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6d20051c40 con 0x7f6d280d0690 2023-11-04T01:43:21.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:21.925+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6d2815c9b0 con 0x7f6d280d0690 2023-11-04T01:43:22.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.541+0000 7f6d257fa640 1 -- 172.21.15.2:0/251796388 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6d20055260 con 0x7f6d280d0690 2023-11-04T01:43:22.547 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-04T01:43:22.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d140664d0 msgr2=0x7f6d14068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d140664d0 0x7f6d14068990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0b2000 tx=0x7f6d1c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280d0690 msgr2=0x7f6d2815a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280d0690 0x7f6d2815a680 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009fd0 tx=0x7f6d2000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 shutdown_connections 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d140664d0 0x7f6d14068990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d280d0690 0x7f6d2815a680 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d280b74f0 0x7f6d2815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 --2- 172.21.15.2:0/251796388 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d280b4990 0x7f6d2815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 >> 172.21.15.2:0/251796388 conn(0x7f6d280cf990 msgr2=0x7f6d280d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 shutdown_connections 2023-11-04T01:43:22.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.545+0000 7f6d2eaae640 1 -- 172.21.15.2:0/251796388 wait complete. 2023-11-04T01:43:22.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:43:22.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.693+0000 7f9fc0e2f640 1 Processor -- start 2023-11-04T01:43:22.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.693+0000 7f9fc0e2f640 1 -- start start 2023-11-04T01:43:22.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fc0e2f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9fbc0b0890 0x7f9fbc0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fc0e2f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9fbc0c9960 0x7f9fbc0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fc0e2f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0ce320 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fc0e2f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc06d2f0 con 0x7f9fbc0b0890 2023-11-04T01:43:22.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fc0e2f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc0ce110 con 0x7f9fbc0c9960 2023-11-04T01:43:22.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9fbc0b0890 0x7f9fbc0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9fbc0b0890 0x7f9fbc0cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50170/0 (socket says 172.21.15.2:50170) 2023-11-04T01:43:22.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 -- 172.21.15.2:0/24481244 learned_addr learned my addr 172.21.15.2:0/24481244 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:22.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 -- 172.21.15.2:0/24481244 >> v2:172.21.15.90:3300/0 conn(0x7f9fbc0c9960 msgr2=0x7f9fbc0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fb9d9b640 1 --2- 172.21.15.2:0/24481244 >> v2:172.21.15.90:3300/0 conn(0x7f9fbc0c9960 0x7f9fbc0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 --2- 172.21.15.2:0/24481244 >> v2:172.21.15.90:3300/0 conn(0x7f9fbc0c9960 0x7f9fbc0704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 -- 172.21.15.2:0/24481244 >> v1:172.21.15.90:6789/0 conn(0x7f9fbc0b0c70 legacy=0x7f9fbc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:22.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 -- 172.21.15.2:0/24481244 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0ce600 con 0x7f9fbc0b0890 2023-11-04T01:43:22.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fba59c640 1 --2- 172.21.15.2:0/24481244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0890 0x7f9fbc0cdbd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc070050 tx=0x7f9fac01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b03924a82e6c32c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fb959a640 1 -- 172.21.15.2:0/24481244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00b2d0 con 0x7f9fbc0b0890 2023-11-04T01:43:22.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.697+0000 7f9fb959a640 1 -- 172.21.15.2:0/24481244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac00b430 con 0x7f9fbc0b0890 2023-11-04T01:43:22.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb959a640 1 -- 172.21.15.2:0/24481244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0a7c50 con 0x7f9fbc0b0890 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/24481244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0890 msgr2=0x7f9fbc0cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/24481244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0890 0x7f9fbc0cdbd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc070050 tx=0x7f9fac01eb60 comp rx=0 tx=0).stop 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/24481244 shutdown_connections 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/24481244 >> v2:172.21.15.90:3300/0 conn(0x7f9fbc0c9960 0x7f9fbc0704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/24481244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0890 0x7f9fbc0cdbd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/24481244 >> 172.21.15.2:0/24481244 conn(0x7f9fbc0cebb0 msgr2=0x7f9fbc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/24481244 shutdown_connections 2023-11-04T01:43:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/24481244 wait complete. 2023-11-04T01:43:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 Processor -- start 2023-11-04T01:43:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- start start 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fbc0b0890 0x7f9fbc1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0c70 0x7f9fbc1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fbc0c9960 0x7f9fbc1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0c30c0 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0c2540 con 0x7f9fbc0c9960 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fc0e2f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0c2820 con 0x7f9fbc0b0890 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0c70 0x7f9fbc1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0c70 0x7f9fbc1550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50172/0 (socket says 172.21.15.2:50172) 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 -- 172.21.15.2:0/939494116 learned_addr learned my addr 172.21.15.2:0/939494116 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fbad9d640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fbc0c9960 0x7f9fbc1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fba59c640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fbc0b0890 0x7f9fbc1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 -- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fbc0b0890 msgr2=0x7f9fbc1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fbc0b0890 0x7f9fbc1509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 -- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fbc0c9960 msgr2=0x7f9fbc1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fbc0c9960 0x7f9fbc1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fb9d9b640 1 -- 172.21.15.2:0/939494116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac00bd40 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.701+0000 7f9fba59c640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fbc0b0890 0x7f9fbc1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9fb9d9b640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0c70 0x7f9fbc1550b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000c7f0 tx=0x7f9fb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9faaffd640 1 -- 172.21.15.2:0/939494116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0007820 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9faaffd640 1 -- 172.21.15.2:0/939494116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb0007980 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc0c2b00 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9faaffd640 1 -- 172.21.15.2:0/939494116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0007d30 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc150ef0 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc0744a0 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9faaffd640 1 -- 172.21.15.2:0/939494116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9fb00113f0 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9faaffd640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f9c0664d0 0x7f9f9c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:22.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9faaffd640 1 -- 172.21.15.2:0/939494116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9fb0083cb0 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9fba59c640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f9c0664d0 0x7f9f9c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.705+0000 7f9fba59c640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f9c0664d0 0x7f9f9c068990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0b0000 tx=0x7f9fac0a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.709+0000 7f9faaffd640 1 -- 172.21.15.2:0/939494116 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9fb0051510 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.921+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9fbc0b4b30 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.921+0000 7f9faaffd640 1 -- 172.21.15.2:0/939494116 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f9fb0054b30 con 0x7f9fbc0b0c70 2023-11-04T01:43:22.926 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlnFZCMBAAsgGcwY3jbh9F9NEVwbamwg==", 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDZRuAxAA6zx8mu5wQEvvcICXPTXZZQ==", 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-04T01:43:22.928 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlFSvMOBAA0k4I7A+4TRIrxBOwUdIZLw==", 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl/PDbCxAA+6y8He/9gQZa1vvdJH+iCg==", 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.929 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBIoUVlnpFvJBAAAyqa0u7D+cz+Gy4XpppWYQ==", 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.930 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBLoUVlObtjKhAAbf3wgZ9mpp8+pI1IGyIwdg==", 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.931 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBOoUVlOF4QMxAANdCz1HMyMGzyFpUv9xawYA==", 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBRoUVlMnFiOxAA2d7ZoQEhtXkAMhu0yPh4iw==", 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.932 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBYoUVlfe9FCBAA3oVMNubThpWJoxlqFzaAfg==", 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.933 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBboUVlTfGNEBAA2FNXiCKGJ2s4XeH+paqrNw==", 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBeoUVluX7oGBAAh+/toMBPGjq99EonfWEPtQ==", 2023-11-04T01:43:22.934 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBhoUVlGhEAIhAAO8mqoIPekhVmAxnR1VKXeQ==", 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ==", 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-04T01:43:22.936 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDtmNGRAAFXXp/X0fnL9uuEIfj1Eadw==", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlPzfyFhAAbCRYmyHHFu2GDtyZOL2ISw==", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:43:22.937 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl1jK2HhAAH1E38zcrKticBLLRR/8IuA==", 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlCj8pFxAApTKY8a6VcYBWkCLKrKHorQ==", 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2023-11-04T01:43:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBnoUVletZHMBAAyXY+/uOu4cwfXHXS6H1jKw==", 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBnoUVlSvNHMBAAympe8JAg6Q2gu7aLkp3OAg==", 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.940 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBnoUVlIApIMBAAEKU0bdI114fZOicoEb7NGA==", 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBnoUVloiBIMBAAJQ4CkA1MoroICS9kCz9ZZA==", 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.941 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBnoUVlkzhIMBAAA3gz8yYj88uhQC1wUM9kxg==", 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBnoUVlVVBIMBAAlLMagP/nQX4ZfOzKommX8g==", 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-04T01:43:22.942 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlcZ/jKhAAWDrmzYgapIV+SBRNrXWAjg==", 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-04T01:43:22.943 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlhYtpKBAAn1snUSz1+SKC8frnVuvFdA==", 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-04T01:43:22.944 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f9c0664d0 msgr2=0x7f9f9c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f9c0664d0 0x7f9f9c068990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0b0000 tx=0x7f9fac0a9070 comp rx=0 tx=0).stop 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0c70 msgr2=0x7f9fbc1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0c70 0x7f9fbc1550b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000c7f0 tx=0x7f9fb000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 shutdown_connections 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f9c0664d0 0x7f9f9c068990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fbc0c9960 0x7f9fbc1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fbc0b0c70 0x7f9fbc1550b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 --2- 172.21.15.2:0/939494116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fbc0b0890 0x7f9fbc1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 >> 172.21.15.2:0/939494116 conn(0x7f9fbc0cebb0 msgr2=0x7f9fbc070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 shutdown_connections 2023-11-04T01:43:22.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:22.925+0000 7f9fc0e2f640 1 -- 172.21.15.2:0/939494116 wait complete. 2023-11-04T01:43:22.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-04T01:43:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e970f640 1 Processor -- start 2023-11-04T01:43:23.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e970f640 1 -- start start 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e970f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 0x7f63e40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e970f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e40b6070 con 0x7f63e40b74f0 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e970f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e40b8ed0 con 0x7f63e40d0690 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e970f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40ce590 con 0x7f63e40b4990 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f63e40b74f0 0x7f63e40cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58886/0 (socket says 172.21.15.2:58886) 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e37fe640 1 -- 172.21.15.2:0/1554934102 learned_addr learned my addr 172.21.15.2:0/1554934102 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 0x7f63e40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622426978 0 0) 0x7f63e40b6070 con 0x7f63e40b74f0 2023-11-04T01:43:23.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63cc003530 con 0x7f63e40b74f0 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1253331248 0 0) 0x7f63cc003530 con 0x7f63e40b74f0 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 msgr2=0x7f63e40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 0x7f63e40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 >> v1:172.21.15.90:6789/0 conn(0x7f63e40d0690 legacy=0x7f63e40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40b52b0 con 0x7f63e40b74f0 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f63dc001a00 con 0x7f63e40b74f0 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 >> v1:172.21.15.2:6789/0 conn(0x7f63e40b74f0 legacy=0x7f63e40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc004360 0x7f63cc004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 0x7f63cc005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40ce590 con 0x7f63cc0039b0 2023-11-04T01:43:23.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc00b990 con 0x7f63cc004360 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc00bb50 con 0x7f63e40b4990 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.061+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e27fc640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc004360 0x7f63cc004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e37fe640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 0x7f63cc005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e2ffd640 1 -- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 msgr2=0x7f63cc005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 0x7f63cc005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e2ffd640 1 -- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc004360 msgr2=0x7f63cc004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63cc004360 0x7f63cc004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e2ffd640 1 -- 172.21.15.2:0/1554934102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc003530 con 0x7f63cc0039b0 2023-11-04T01:43:23.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e37fe640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e40b4990 0x7f63cc005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:23.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63cc003d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009ae0 tx=0x7f63d801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1263634cac8b2e20 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80a5640 con 0x7f63cc0039b0 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d80a57a0 con 0x7f63cc0039b0 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e1ffb640 1 -- 172.21.15.2:0/1554934102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80a5b50 con 0x7f63cc0039b0 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e970f640 1 -- 172.21.15.2:0/1554934102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 msgr2=0x7f63cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e970f640 1 --2- 172.21.15.2:0/1554934102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63cc003d90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009ae0 tx=0x7f63d801ca50 comp rx=0 tx=0).stop 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e37fe640 1 -- 172.21.15.2:0/1554934102 reap_dead start 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e970f640 1 -- 172.21.15.2:0/1554934102 shutdown_connections 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e970f640 1 -- 172.21.15.2:0/1554934102 >> 172.21.15.2:0/1554934102 conn(0x7f63e40cf990 msgr2=0x7f63e40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e970f640 1 -- 172.21.15.2:0/1554934102 shutdown_connections 2023-11-04T01:43:23.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.065+0000 7f63e970f640 1 -- 172.21.15.2:0/1554934102 wait complete. 2023-11-04T01:43:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 Processor -- start 2023-11-04T01:43:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 -- start start 2023-11-04T01:43:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63e415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63e4156240 0x7f63e41566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e4142130 0x7f63e41425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e40b3140 con 0x7f63cc0039b0 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e4156c00 con 0x7f63e4156240 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e415fff0 con 0x7f63e4142130 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63e415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63e415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50186/0 (socket says 172.21.15.2:50186) 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 -- 172.21.15.2:0/1336903102 learned_addr learned my addr 172.21.15.2:0/1336903102 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e27fc640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63e4156240 0x7f63e41566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e37fe640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e4142130 0x7f63e41425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 -- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e4142130 msgr2=0x7f63e41425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e4142130 0x7f63e41425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 -- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63e4156240 msgr2=0x7f63e41566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63e4156240 0x7f63e41566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 -- 172.21.15.2:0/1336903102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e415ea10 con 0x7f63cc0039b0 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e37fe640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e4142130 0x7f63e41425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e2ffd640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63e415fab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63d801c880 tx=0x7f63cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63cb7fe640 1 -- 172.21.15.2:0/1336903102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80a5640 con 0x7f63cc0039b0 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63cb7fe640 1 -- 172.21.15.2:0/1336903102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8004230 con 0x7f63cc0039b0 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e415ecf0 con 0x7f63cc0039b0 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63cb7fe640 1 -- 172.21.15.2:0/1336903102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8003620 con 0x7f63cc0039b0 2023-11-04T01:43:23.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e415f2b0 con 0x7f63cc0039b0 2023-11-04T01:43:23.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e40744a0 con 0x7f63cc0039b0 2023-11-04T01:43:23.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.069+0000 7f63cb7fe640 1 -- 172.21.15.2:0/1336903102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f63d80b4040 con 0x7f63cc0039b0 2023-11-04T01:43:23.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.073+0000 7f63cb7fe640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f63d00664d0 0x7f63d0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.073+0000 7f63cb7fe640 1 -- 172.21.15.2:0/1336903102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63d811e350 con 0x7f63cc0039b0 2023-11-04T01:43:23.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.073+0000 7f63e27fc640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f63d00664d0 0x7f63d0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.073+0000 7f63e27fc640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f63d00664d0 0x7f63d0068990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63e4144740 tx=0x7f63d400aa70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.077+0000 7f63cb7fe640 1 -- 172.21.15.2:0/1336903102 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63d80ebbd0 con 0x7f63cc0039b0 2023-11-04T01:43:23.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.289+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f63e40b85d0 con 0x7f63cc0039b0 2023-11-04T01:43:23.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63cb7fe640 1 -- 172.21.15.2:0/1336903102 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7f63d80ef1f0 con 0x7f63cc0039b0 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f63d00664d0 msgr2=0x7f63d0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f63d00664d0 0x7f63d0068990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f63e4144740 tx=0x7f63d400aa70 comp rx=0 tx=0).stop 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 msgr2=0x7f63e415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63e415fab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63d801c880 tx=0x7f63cc005800 comp rx=0 tx=0).stop 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 shutdown_connections 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f63d00664d0 0x7f63d0068990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f63e4142130 0x7f63e41425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f63e4156240 0x7f63e41566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 --2- 172.21.15.2:0/1336903102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f63cc0039b0 0x7f63e415fab0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 >> 172.21.15.2:0/1336903102 conn(0x7f63e40cf990 msgr2=0x7f63e40d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 shutdown_connections 2023-11-04T01:43:23.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.293+0000 7f63e970f640 1 -- 172.21.15.2:0/1336903102 wait complete. 2023-11-04T01:43:23.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-04T01:43:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.421+0000 7f64af720640 1 Processor -- start 2023-11-04T01:43:23.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.421+0000 7f64af720640 1 -- start start 2023-11-04T01:43:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.421+0000 7f64af720640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f64a815a080 0x7f64a8065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.421+0000 7f64af720640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64a815e7f0 0x7f64a815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.421+0000 7f64af720640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a815e5c0 con 0x7f64a815e170 2023-11-04T01:43:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.421+0000 7f64af720640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a8066510 con 0x7f64a815e7f0 2023-11-04T01:43:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.421+0000 7f64af720640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a806b170 con 0x7f64a815a080 2023-11-04T01:43:23.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64a815e7f0 0x7f64a815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64a815e7f0 0x7f64a815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50206/0 (socket says 172.21.15.2:50206) 2023-11-04T01:43:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 -- 172.21.15.2:0/681673297 learned_addr learned my addr 172.21.15.2:0/681673297 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64ad4bc640 1 --2- 172.21.15.2:0/681673297 >> v2:172.21.15.90:3300/0 conn(0x7f64a815a080 0x7f64a8065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 -- 172.21.15.2:0/681673297 >> v2:172.21.15.90:3300/0 conn(0x7f64a815a080 msgr2=0x7f64a8065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 --2- 172.21.15.2:0/681673297 >> v2:172.21.15.90:3300/0 conn(0x7f64a815a080 0x7f64a8065fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 -- 172.21.15.2:0/681673297 >> v1:172.21.15.90:6789/0 conn(0x7f64a815e170 legacy=0x7f64a80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 -- 172.21.15.2:0/681673297 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80cc740 con 0x7f64a815e7f0 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64accbb640 1 --2- 172.21.15.2:0/681673297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815dc30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f64a80b1f50 tx=0x7f649801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69d0399023d0d52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f649ffff640 1 -- 172.21.15.2:0/681673297 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64980a89b0 con 0x7f64a815e7f0 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f649ffff640 1 -- 172.21.15.2:0/681673297 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64980a8b10 con 0x7f64a815e7f0 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f649ffff640 1 -- 172.21.15.2:0/681673297 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64980a8ea0 con 0x7f64a815e7f0 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 -- 172.21.15.2:0/681673297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 msgr2=0x7f64a815dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 --2- 172.21.15.2:0/681673297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815dc30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f64a80b1f50 tx=0x7f649801ecb0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 -- 172.21.15.2:0/681673297 shutdown_connections 2023-11-04T01:43:23.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 --2- 172.21.15.2:0/681673297 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815dc30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 --2- 172.21.15.2:0/681673297 >> v2:172.21.15.90:3300/0 conn(0x7f64a815a080 0x7f64a8065fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 -- 172.21.15.2:0/681673297 >> 172.21.15.2:0/681673297 conn(0x7f64a80716a0 msgr2=0x7f64a8071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 -- 172.21.15.2:0/681673297 shutdown_connections 2023-11-04T01:43:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.425+0000 7f64af720640 1 -- 172.21.15.2:0/681673297 wait complete. 2023-11-04T01:43:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 Processor -- start 2023-11-04T01:43:23.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 -- start start 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a815a080 0x7f64a80b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a815e170 0x7f64a80ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a81541d0 con 0x7f64a815e7f0 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a80ad320 con 0x7f64a815e170 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a80ad7b0 con 0x7f64a815a080 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50208/0 (socket says 172.21.15.2:50208) 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 -- 172.21.15.2:0/1359273550 learned_addr learned my addr 172.21.15.2:0/1359273550 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64accbb640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a815e170 0x7f64a80ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64ad4bc640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a815a080 0x7f64a80b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 -- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a815a080 msgr2=0x7f64a80b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a815a080 0x7f64a80b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 -- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a815e170 msgr2=0x7f64a80ac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a815e170 0x7f64a80ac010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 -- 172.21.15.2:0/1359273550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980094d0 con 0x7f64a815e7f0 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64adcbd640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815a670 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c3f0 tx=0x7f64a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f649dffb640 1 -- 172.21.15.2:0/1359273550 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0011790 con 0x7f64a815e7f0 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f649dffb640 1 -- 172.21.15.2:0/1359273550 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a00118f0 con 0x7f64a815e7f0 2023-11-04T01:43:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f649dffb640 1 -- 172.21.15.2:0/1359273550 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0011ca0 con 0x7f64a815e7f0 2023-11-04T01:43:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a80ac710 con 0x7f64a815e7f0 2023-11-04T01:43:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a80accd0 con 0x7f64a815e7f0 2023-11-04T01:43:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a80ad4b0 con 0x7f64a815e7f0 2023-11-04T01:43:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f649dffb640 1 -- 172.21.15.2:0/1359273550 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64a001c460 con 0x7f64a815e7f0 2023-11-04T01:43:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.429+0000 7f649dffb640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f648c0664a0 0x7f648c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.433+0000 7f649dffb640 1 -- 172.21.15.2:0/1359273550 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64a0083a00 con 0x7f64a815e7f0 2023-11-04T01:43:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.433+0000 7f64ad4bc640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f648c0664a0 0x7f648c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.433+0000 7f64ad4bc640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f648c0664a0 0x7f648c068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f64a815d5b0 tx=0x7f64a400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.437+0000 7f649dffb640 1 -- 172.21.15.2:0/1359273550 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64a00511d0 con 0x7f64a815e7f0 2023-11-04T01:43:23.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.653+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f64a80675f0 con 0x7f64a815e7f0 2023-11-04T01:43:23.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.657+0000 7f649dffb640 1 -- 172.21.15.2:0/1359273550 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f64a0003810 con 0x7f64a815e7f0 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f648c0664a0 msgr2=0x7f648c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f648c0664a0 0x7f648c068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f64a815d5b0 tx=0x7f64a400b040 comp rx=0 tx=0).stop 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 msgr2=0x7f64a815a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815a670 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f64a000c3f0 tx=0x7f64a000c8b0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 shutdown_connections 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f648c0664a0 0x7f648c068960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64a815e7f0 0x7f64a815a670 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a815e170 0x7f64a80ac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 --2- 172.21.15.2:0/1359273550 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f64a815a080 0x7f64a80b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 >> 172.21.15.2:0/1359273550 conn(0x7f64a80716a0 msgr2=0x7f64a806b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 shutdown_connections 2023-11-04T01:43:23.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.661+0000 7f64af720640 1 -- 172.21.15.2:0/1359273550 wait complete. 2023-11-04T01:43:23.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-04T01:43:23.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29c974640 1 Processor -- start 2023-11-04T01:43:23.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29c974640 1 -- start start 2023-11-04T01:43:23.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29c974640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd29815afd0 0x7fd2980715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29c974640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980c2670 con 0x7fd29806f8f0 2023-11-04T01:43:23.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29c974640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29806bc30 con 0x7fd2980b0d40 2023-11-04T01:43:23.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29c974640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd298070140 con 0x7fd29815afd0 2023-11-04T01:43:23.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd29815afd0 0x7fd2980715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd295d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd29806f8f0 0x7fd2980b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58890/0 (socket says 172.21.15.2:58890) 2023-11-04T01:43:23.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd295d9b640 1 -- 172.21.15.2:0/190805779 learned_addr learned my addr 172.21.15.2:0/190805779 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:23.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29659c640 1 -- 172.21.15.2:0/190805779 >> v1:172.21.15.90:6789/0 conn(0x7fd2980b0d40 legacy=0x7fd29815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:23.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29659c640 1 -- 172.21.15.2:0/190805779 >> v1:172.21.15.2:6789/0 conn(0x7fd29806f8f0 legacy=0x7fd2980b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29659c640 1 -- 172.21.15.2:0/190805779 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29806bf10 con 0x7fd29815afd0 2023-11-04T01:43:23.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.801+0000 7fd29559a640 1 -- 172.21.15.2:0/190805779 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578328611 0 0) 0x7fd2980c2670 con 0x7fd29806f8f0 2023-11-04T01:43:23.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 --2- 172.21.15.2:0/190805779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29815afd0 0x7fd2980715d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd2880097c0 tx=0x7fd28801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c343de9a2ca6b4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29559a640 1 -- 172.21.15.2:0/190805779 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880ab600 con 0x7fd29815afd0 2023-11-04T01:43:23.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29559a640 1 -- 172.21.15.2:0/190805779 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2880a7050 con 0x7fd29815afd0 2023-11-04T01:43:23.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29559a640 1 -- 172.21.15.2:0/190805779 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880ab980 con 0x7fd29815afd0 2023-11-04T01:43:23.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- 172.21.15.2:0/190805779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29815afd0 msgr2=0x7fd2980715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 --2- 172.21.15.2:0/190805779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29815afd0 0x7fd2980715d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd2880097c0 tx=0x7fd28801c440 comp rx=0 tx=0).stop 2023-11-04T01:43:23.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- 172.21.15.2:0/190805779 shutdown_connections 2023-11-04T01:43:23.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 --2- 172.21.15.2:0/190805779 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29815afd0 0x7fd2980715d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- 172.21.15.2:0/190805779 >> 172.21.15.2:0/190805779 conn(0x7fd2980cebb0 msgr2=0x7fd2980cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- 172.21.15.2:0/190805779 shutdown_connections 2023-11-04T01:43:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- 172.21.15.2:0/190805779 wait complete. 2023-11-04T01:43:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 Processor -- start 2023-11-04T01:43:23.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- start start 2023-11-04T01:43:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29806f8f0 0x7fd298152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2980b0d40 0x7fd2980c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29815afd0 0x7fd2980c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980b2130 con 0x7fd29806f8f0 2023-11-04T01:43:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980b1b00 con 0x7fd2980b0d40 2023-11-04T01:43:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29c974640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd298152960 con 0x7fd29815afd0 2023-11-04T01:43:23.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29806f8f0 0x7fd298152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29806f8f0 0x7fd298152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50224/0 (socket says 172.21.15.2:50224) 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 -- 172.21.15.2:0/3306039902 learned_addr learned my addr 172.21.15.2:0/3306039902 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd295d9b640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2980b0d40 0x7fd2980c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 -- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29815afd0 msgr2=0x7fd2980c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd296d9d640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29815afd0 0x7fd2980c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29815afd0 0x7fd2980c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 -- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2980b0d40 msgr2=0x7fd2980c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2980b0d40 0x7fd2980c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.805+0000 7fd29659c640 1 -- 172.21.15.2:0/3306039902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009420 con 0x7fd29806f8f0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd29659c640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29806f8f0 0x7fd298152420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd2880ae040 tx=0x7fd28801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd286ffd640 1 -- 172.21.15.2:0/3306039902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880b7650 con 0x7fd29806f8f0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd286ffd640 1 -- 172.21.15.2:0/3306039902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2880abe90 con 0x7fd29806f8f0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd286ffd640 1 -- 172.21.15.2:0/3306039902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2880b7a10 con 0x7fd29806f8f0 2023-11-04T01:43:23.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2980c83e0 con 0x7fd29806f8f0 2023-11-04T01:43:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2980c8970 con 0x7fd29806f8f0 2023-11-04T01:43:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29806fd20 con 0x7fd29806f8f0 2023-11-04T01:43:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd286ffd640 1 -- 172.21.15.2:0/3306039902 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2880b7b70 con 0x7fd29806f8f0 2023-11-04T01:43:23.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd286ffd640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2780664a0 0x7fd278068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd286ffd640 1 -- 172.21.15.2:0/3306039902 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd28811e4d0 con 0x7fd29806f8f0 2023-11-04T01:43:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd295d9b640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2780664a0 0x7fd278068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:23.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.809+0000 7fd295d9b640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2780664a0 0x7fd278068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd29815dea0 tx=0x7fd28c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:23.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:23.813+0000 7fd286ffd640 1 -- 172.21.15.2:0/3306039902 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd29806fd20 con 0x7fd29806f8f0 2023-11-04T01:43:24.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.017+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd29806fd00 con 0x7fd29806f8f0 2023-11-04T01:43:24.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd286ffd640 1 -- 172.21.15.2:0/3306039902 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd2880bb0a0 con 0x7fd29806f8f0 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2780664a0 msgr2=0x7fd278068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2780664a0 0x7fd278068960 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd29815dea0 tx=0x7fd28c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29806f8f0 msgr2=0x7fd298152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29806f8f0 0x7fd298152420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd2880ae040 tx=0x7fd28801ac80 comp rx=0 tx=0).stop 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 shutdown_connections 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2780664a0 0x7fd278068960 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29815afd0 0x7fd2980c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd2980b0d40 0x7fd2980c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 --2- 172.21.15.2:0/3306039902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29806f8f0 0x7fd298152420 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 >> 172.21.15.2:0/3306039902 conn(0x7fd2980cebb0 msgr2=0x7fd2980cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 shutdown_connections 2023-11-04T01:43:24.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.021+0000 7fd29c974640 1 -- 172.21.15.2:0/3306039902 wait complete. 2023-11-04T01:43:24.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-04T01:43:24.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92b4c9e640 1 Processor -- start 2023-11-04T01:43:24.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92b4c9e640 1 -- start start 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92b4c9e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92b4c9e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f92b00b1d40 0x7f92b00ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92b4c9e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00cdc80 con 0x7f92b015cd60 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92b4c9e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b0071e40 con 0x7f92b00b1d40 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92b4c9e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00ca700 con 0x7f92b00b1960 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92add9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f92b00b1d40 0x7f92b00ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92add9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f92b00b1d40 0x7f92b00ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50232/0 (socket says 172.21.15.2:50232) 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92add9b640 1 -- 172.21.15.2:0/3371410607 learned_addr learned my addr 172.21.15.2:0/3371410607 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:24.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92ae59c640 1 --2- 172.21.15.2:0/3371410607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92add9b640 1 -- 172.21.15.2:0/3371410607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 msgr2=0x7f92b00cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92add9b640 1 --2- 172.21.15.2:0/3371410607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92ad59a640 1 -- 172.21.15.2:0/3371410607 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268906897 0 0) 0x7f92b00cdc80 con 0x7f92b015cd60 2023-11-04T01:43:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92add9b640 1 -- 172.21.15.2:0/3371410607 >> v1:172.21.15.2:6789/0 conn(0x7f92b015cd60 legacy=0x7f92b015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.149+0000 7f92add9b640 1 -- 172.21.15.2:0/3371410607 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00cf5a0 con 0x7f92b00b1d40 2023-11-04T01:43:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92add9b640 1 --2- 172.21.15.2:0/3371410607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b00b1d40 0x7f92b00ca1c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009e50 tx=0x7f92a001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c6e4031e2c19dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92ad59a640 1 -- 172.21.15.2:0/3371410607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a58a0 con 0x7f92b00b1d40 2023-11-04T01:43:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92ad59a640 1 -- 172.21.15.2:0/3371410607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a00a5a00 con 0x7f92b00b1d40 2023-11-04T01:43:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92ad59a640 1 -- 172.21.15.2:0/3371410607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a5d90 con 0x7f92b00b1d40 2023-11-04T01:43:24.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3371410607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b00b1d40 msgr2=0x7f92b00ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3371410607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b00b1d40 0x7f92b00ca1c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009e50 tx=0x7f92a001c9e0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3371410607 shutdown_connections 2023-11-04T01:43:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3371410607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b00b1d40 0x7f92b00ca1c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3371410607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3371410607 >> 172.21.15.2:0/3371410607 conn(0x7f92b006e760 msgr2=0x7f92b006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3371410607 shutdown_connections 2023-11-04T01:43:24.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3371410607 wait complete. 2023-11-04T01:43:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 Processor -- start 2023-11-04T01:43:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.153+0000 7f92b4c9e640 1 -- start start 2023-11-04T01:43:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92b00b1d40 0x7f92b01601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b015cd60 0x7f92b015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0160b40 con 0x7f92b015cd60 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00c7a20 con 0x7f92b00b1d40 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00c87e0 con 0x7f92b00b1960 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b015cd60 0x7f92b015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b015cd60 0x7f92b015b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50248/0 (socket says 172.21.15.2:50248) 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 -- 172.21.15.2:0/3478725329 learned_addr learned my addr 172.21.15.2:0/3478725329 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92add9b640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92b00b1d40 0x7f92b01601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92ae59c640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 -- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 msgr2=0x7f92b00c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 -- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92b00b1d40 msgr2=0x7f92b01601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92b00b1d40 0x7f92b01601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 -- 172.21.15.2:0/3478725329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0009b30 con 0x7f92b015cd60 2023-11-04T01:43:24.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92add9b640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92b00b1d40 0x7f92b01601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92ae59c640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92aed9d640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b015cd60 0x7f92b015b440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c410 tx=0x7f92a800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92a6ffd640 1 -- 172.21.15.2:0/3478725329 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80052d0 con 0x7f92b015cd60 2023-11-04T01:43:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92a6ffd640 1 -- 172.21.15.2:0/3478725329 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8005450 con 0x7f92b015cd60 2023-11-04T01:43:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0160730 con 0x7f92b015cd60 2023-11-04T01:43:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92a6ffd640 1 -- 172.21.15.2:0/3478725329 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8003860 con 0x7f92b015cd60 2023-11-04T01:43:24.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b00c8220 con 0x7f92b015cd60 2023-11-04T01:43:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b0156660 con 0x7f92b015cd60 2023-11-04T01:43:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92a6ffd640 1 -- 172.21.15.2:0/3478725329 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92a80039c0 con 0x7f92b015cd60 2023-11-04T01:43:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92a6ffd640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92900664a0 0x7f9290068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92a6ffd640 1 -- 172.21.15.2:0/3478725329 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f92a8083050 con 0x7f92b015cd60 2023-11-04T01:43:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92ae59c640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92900664a0 0x7f9290068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.157+0000 7f92ae59c640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92900664a0 0x7f9290068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9298009840 tx=0x7f9298008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.161+0000 7f92a6ffd640 1 -- 172.21.15.2:0/3478725329 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92b0156660 con 0x7f92b015cd60 2023-11-04T01:43:24.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.369+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f92b0156660 con 0x7f92b015cd60 2023-11-04T01:43:24.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.373+0000 7f92a6ffd640 1 -- 172.21.15.2:0/3478725329 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f92b0156660 con 0x7f92b015cd60 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92900664a0 msgr2=0x7f9290068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92900664a0 0x7f9290068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9298009840 tx=0x7f9298008040 comp rx=0 tx=0).stop 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b015cd60 msgr2=0x7f92b015b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b015cd60 0x7f92b015b440 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f92a800c410 tx=0x7f92a800c8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 shutdown_connections 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92900664a0 0x7f9290068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f92b015cd60 0x7f92b015b440 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f92b00b1d40 0x7f92b01601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 --2- 172.21.15.2:0/3478725329 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92b00b1960 0x7f92b00c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 >> 172.21.15.2:0/3478725329 conn(0x7f92b006e760 msgr2=0x7f92b00ae8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 shutdown_connections 2023-11-04T01:43:24.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.377+0000 7f92b4c9e640 1 -- 172.21.15.2:0/3478725329 wait complete. 2023-11-04T01:43:24.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-04T01:43:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89bd1a640 1 Processor -- start 2023-11-04T01:43:24.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89bd1a640 1 -- start start 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89bd1a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa8940d0690 0x7fa8940b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89bd1a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940b6070 con 0x7fa8940d0ae0 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89bd1a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8940b8ed0 con 0x7fa8940b4990 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89bd1a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8940d1ce0 con 0x7fa8940d0690 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89a2b7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa8940d0ae0 0x7fa8940b6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58912/0 (socket says 172.21.15.2:58912) 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa89a2b7640 1 -- 172.21.15.2:0/2786021159 learned_addr learned my addr 172.21.15.2:0/2786021159 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa8992b5640 1 --2- 172.21.15.2:0/2786021159 >> v2:172.21.15.90:3300/0 conn(0x7fa8940d0690 0x7fa8940b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896757189 0 0) 0x7fa8940b6070 con 0x7fa8940d0ae0 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.513+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa880003530 con 0x7fa8940d0ae0 2023-11-04T01:43:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516684943 0 0) 0x7fa880003530 con 0x7fa8940d0ae0 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 >> v2:172.21.15.90:3300/0 conn(0x7fa8940d0690 msgr2=0x7fa8940b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 --2- 172.21.15.2:0/2786021159 >> v2:172.21.15.90:3300/0 conn(0x7fa8940d0690 0x7fa8940b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 >> v1:172.21.15.90:6789/0 conn(0x7fa8940b4990 legacy=0x7fa8940b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8940d1fc0 con 0x7fa8940d0ae0 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa88c001a00 con 0x7fa8940d0ae0 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 >> v1:172.21.15.2:6789/0 conn(0x7fa8940d0ae0 legacy=0x7fa8940b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa880003980 0x7fa880003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8800047d0 0x7fa880004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa880005190 0x7fa88000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940d1ce0 con 0x7fa880003980 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88000c040 con 0x7fa8800047d0 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88000c200 con 0x7fa880005190 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa899ab6640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa880003980 0x7fa880003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa8992b5640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8800047d0 0x7fa880004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa89a2b7640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa880005190 0x7fa88000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa899ab6640 1 -- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa880005190 msgr2=0x7fa88000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa899ab6640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa880005190 0x7fa88000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa899ab6640 1 -- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8800047d0 msgr2=0x7fa880004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa899ab6640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8800047d0 0x7fa880004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa899ab6640 1 -- 172.21.15.2:0/2786021159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa880003530 con 0x7fa880003980 2023-11-04T01:43:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa89a2b7640 1 -- 172.21.15.2:0/2786021159 reap_dead start 2023-11-04T01:43:24.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa899ab6640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa880003980 0x7fa880003da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa890001780 tx=0x7fa89001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba18c84279ddd94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900052d0 con 0x7fa880003980 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8900a7050 con 0x7fa880003980 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.517+0000 7fa898ab4640 1 -- 172.21.15.2:0/2786021159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890003600 con 0x7fa880003980 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- 172.21.15.2:0/2786021159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa880003980 msgr2=0x7fa880003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa880003980 0x7fa880003da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa890001780 tx=0x7fa89001c3e0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- 172.21.15.2:0/2786021159 shutdown_connections 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/2786021159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa880003980 0x7fa880003da0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- 172.21.15.2:0/2786021159 >> 172.21.15.2:0/2786021159 conn(0x7fa8940cf990 msgr2=0x7fa8940cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- 172.21.15.2:0/2786021159 shutdown_connections 2023-11-04T01:43:24.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- 172.21.15.2:0/2786021159 wait complete. 2023-11-04T01:43:24.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 Processor -- start 2023-11-04T01:43:24.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- start start 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa880003980 0x7fa8940ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8940caf30 0x7fa8940cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8940cc320 0x7fa89415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940cc7a0 con 0x7fa8940caf30 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415d570 con 0x7fa880003980 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89415d810 con 0x7fa8940cc320 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8940caf30 0x7fa8940cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8940caf30 0x7fa8940cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50258/0 (socket says 172.21.15.2:50258) 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 -- 172.21.15.2:0/560002094 learned_addr learned my addr 172.21.15.2:0/560002094 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa899ab6640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa880003980 0x7fa8940ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89a2b7640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8940cc320 0x7fa89415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 -- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8940cc320 msgr2=0x7fa89415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8940cc320 0x7fa89415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 -- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa880003980 msgr2=0x7fa8940ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa880003980 0x7fa8940ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 -- 172.21.15.2:0/560002094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89415daf0 con 0x7fa8940caf30 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa8992b5640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8940caf30 0x7fa8940cbde0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa884011600 tx=0x7fa884011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa88a7fc640 1 -- 172.21.15.2:0/560002094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884004220 con 0x7fa8940caf30 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa88a7fc640 1 -- 172.21.15.2:0/560002094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa884004380 con 0x7fa8940caf30 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89415ddd0 con 0x7fa8940caf30 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa88a7fc640 1 -- 172.21.15.2:0/560002094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400f960 con 0x7fa8940caf30 2023-11-04T01:43:24.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.521+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa894160300 con 0x7fa8940caf30 2023-11-04T01:43:24.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.525+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8940744a0 con 0x7fa8940caf30 2023-11-04T01:43:24.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.525+0000 7fa88a7fc640 1 -- 172.21.15.2:0/560002094 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa88400fac0 con 0x7fa8940caf30 2023-11-04T01:43:24.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.525+0000 7fa88a7fc640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.525+0000 7fa88a7fc640 1 -- 172.21.15.2:0/560002094 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa884083ce0 con 0x7fa8940caf30 2023-11-04T01:43:24.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.525+0000 7fa899ab6640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.525+0000 7fa899ab6640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa890001750 tx=0x7fa8900011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.529+0000 7fa88a7fc640 1 -- 172.21.15.2:0/560002094 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa884051410 con 0x7fa8940caf30 2023-11-04T01:43:24.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:24.650 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:24.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.733+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa8940cd320 con 0x7fa8940caf30 2023-11-04T01:43:24.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa88a7fc640 1 -- 172.21.15.2:0/560002094 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa884054a30 con 0x7fa8940caf30 2023-11-04T01:43:24.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 msgr2=0x7fa878068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa890001750 tx=0x7fa8900011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8940caf30 msgr2=0x7fa8940cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8940caf30 0x7fa8940cbde0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa884011600 tx=0x7fa884011ac0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 shutdown_connections 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8780664d0 0x7fa878068990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8940cc320 0x7fa89415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8940caf30 0x7fa8940cbde0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 --2- 172.21.15.2:0/560002094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa880003980 0x7fa8940ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 >> 172.21.15.2:0/560002094 conn(0x7fa8940cf990 msgr2=0x7fa8940b7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 shutdown_connections 2023-11-04T01:43:24.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.737+0000 7fa89bd1a640 1 -- 172.21.15.2:0/560002094 wait complete. 2023-11-04T01:43:24.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-04T01:43:24.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96d486c640 1 Processor -- start 2023-11-04T01:43:24.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96d486c640 1 -- start start 2023-11-04T01:43:24.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96d486c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96d00ce720 0x7f96d006ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96d486c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d0159e30 con 0x7f96d00ce070 2023-11-04T01:43:24.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96d486c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00ccfd0 con 0x7f96d0159a50 2023-11-04T01:43:24.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96d486c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d00cd2b0 con 0x7f96d00ce720 2023-11-04T01:43:24.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96cdd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96d00ce720 0x7f96d006ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96cdd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96d00ce720 0x7f96d006ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50260/0 (socket says 172.21.15.2:50260) 2023-11-04T01:43:24.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96cdd9b640 1 -- 172.21.15.2:0/1639614010 learned_addr learned my addr 172.21.15.2:0/1639614010 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:24.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96cdd9b640 1 -- 172.21.15.2:0/1639614010 >> v1:172.21.15.90:6789/0 conn(0x7f96d0159a50 legacy=0x7f96d00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96cdd9b640 1 -- 172.21.15.2:0/1639614010 >> v1:172.21.15.2:6789/0 conn(0x7f96d00ce070 legacy=0x7f96d006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.877+0000 7f96cdd9b640 1 -- 172.21.15.2:0/1639614010 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00cd590 con 0x7f96d00ce720 2023-11-04T01:43:24.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96cdd9b640 1 --2- 172.21.15.2:0/1639614010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00ce720 0x7f96d006ba90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009e50 tx=0x7f96c401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d942fe2017b998 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96cd59a640 1 -- 172.21.15.2:0/1639614010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40a5790 con 0x7f96d00ce720 2023-11-04T01:43:24.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96cd59a640 1 -- 172.21.15.2:0/1639614010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40a58f0 con 0x7f96d00ce720 2023-11-04T01:43:24.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96cd59a640 1 -- 172.21.15.2:0/1639614010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40a5c80 con 0x7f96d00ce720 2023-11-04T01:43:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96d486c640 1 -- 172.21.15.2:0/1639614010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00ce720 msgr2=0x7f96d006ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96d486c640 1 --2- 172.21.15.2:0/1639614010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00ce720 0x7f96d006ba90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009e50 tx=0x7f96c401c930 comp rx=0 tx=0).stop 2023-11-04T01:43:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96d486c640 1 -- 172.21.15.2:0/1639614010 shutdown_connections 2023-11-04T01:43:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96d486c640 1 --2- 172.21.15.2:0/1639614010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00ce720 0x7f96d006ba90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96d486c640 1 -- 172.21.15.2:0/1639614010 >> 172.21.15.2:0/1639614010 conn(0x7f96d00cebb0 msgr2=0x7f96d00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96d486c640 1 -- 172.21.15.2:0/1639614010 shutdown_connections 2023-11-04T01:43:24.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.881+0000 7f96d486c640 1 -- 172.21.15.2:0/1639614010 wait complete. 2023-11-04T01:43:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 Processor -- start 2023-11-04T01:43:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 -- start start 2023-11-04T01:43:24.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96d00ce070 0x7f96d00c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96d00ce720 0x7f96d0151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d0159a50 0x7f96d0151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0152f50 con 0x7f96d0159a50 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0151ad0 con 0x7f96d00ce070 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0152340 con 0x7f96d00ce720 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d0159a50 0x7f96d0151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d0159a50 0x7f96d0151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50266/0 (socket says 172.21.15.2:50266) 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 -- 172.21.15.2:0/1649070953 learned_addr learned my addr 172.21.15.2:0/1649070953 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ce59c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96d00ce070 0x7f96d00c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96cdd9b640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96d00ce720 0x7f96d0151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 -- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96d00ce720 msgr2=0x7f96d0151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96d00ce720 0x7f96d0151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 -- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96d00ce070 msgr2=0x7f96d00c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96d00ce070 0x7f96d00c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 -- 172.21.15.2:0/1649070953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009b30 con 0x7f96d0159a50 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ce59c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96d00ce070 0x7f96d00c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96ced9d640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d0159a50 0x7f96d0151590 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f96c800fa40 tx=0x7f96c800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96beffd640 1 -- 172.21.15.2:0/1649070953 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8008480 con 0x7f96d0159a50 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96beffd640 1 -- 172.21.15.2:0/1649070953 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c800d7c0 con 0x7f96d0159a50 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d0152620 con 0x7f96d0159a50 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d0152be0 con 0x7f96d0159a50 2023-11-04T01:43:24.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96beffd640 1 -- 172.21.15.2:0/1649070953 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800dbb0 con 0x7f96d0159a50 2023-11-04T01:43:24.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d00744a0 con 0x7f96d0159a50 2023-11-04T01:43:24.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96beffd640 1 -- 172.21.15.2:0/1649070953 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f96c800dd10 con 0x7f96d0159a50 2023-11-04T01:43:24.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96beffd640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f96b00664a0 0x7f96b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:24.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.885+0000 7f96beffd640 1 -- 172.21.15.2:0/1649070953 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96c8086470 con 0x7f96d0159a50 2023-11-04T01:43:24.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.889+0000 7f96ce59c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f96b00664a0 0x7f96b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:24.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.889+0000 7f96ce59c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f96b00664a0 0x7f96b0068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f96c0000f70 tx=0x7f96c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:24.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:24.893+0000 7f96beffd640 1 -- 172.21.15.2:0/1649070953 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96c8053cd0 con 0x7f96d0159a50 2023-11-04T01:43:25.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.105+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f96d0159e30 con 0x7f96d0159a50 2023-11-04T01:43:25.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.109+0000 7f96beffd640 1 -- 172.21.15.2:0/1649070953 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f96d0159e30 con 0x7f96d0159a50 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f96b00664a0 msgr2=0x7f96b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f96b00664a0 0x7f96b0068960 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f96c0000f70 tx=0x7f96c0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d0159a50 msgr2=0x7f96d0151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d0159a50 0x7f96d0151590 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f96c800fa40 tx=0x7f96c800ff00 comp rx=0 tx=0).stop 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 shutdown_connections 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f96b00664a0 0x7f96b0068960 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d0159a50 0x7f96d0151590 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f96d00ce720 0x7f96d0151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 --2- 172.21.15.2:0/1649070953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96d00ce070 0x7f96d00c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 >> 172.21.15.2:0/1649070953 conn(0x7f96d00cebb0 msgr2=0x7f96d0158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 shutdown_connections 2023-11-04T01:43:25.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.113+0000 7f96d486c640 1 -- 172.21.15.2:0/1649070953 wait complete. 2023-11-04T01:43:25.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:25.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.249+0000 7feeb2cb7640 1 Processor -- start 2023-11-04T01:43:25.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.249+0000 7feeb2cb7640 1 -- start start 2023-11-04T01:43:25.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeb2cb7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feeac0d0b10 0x7feeac15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeb2cb7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feeac0b49c0 0x7feeac0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeb2cb7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0b52e0 con 0x7feeac15d240 2023-11-04T01:43:25.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeb2cb7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0d2280 con 0x7feeac0d0b10 2023-11-04T01:43:25.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeb2cb7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac0d2560 con 0x7feeac0b49c0 2023-11-04T01:43:25.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feeac0d0b10 0x7feeac15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feeac0d0b10 0x7feeac15d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50270/0 (socket says 172.21.15.2:50270) 2023-11-04T01:43:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 -- 172.21.15.2:0/1221319420 learned_addr learned my addr 172.21.15.2:0/1221319420 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeb1254640 1 --2- 172.21.15.2:0/1221319420 >> v2:172.21.15.90:3300/0 conn(0x7feeac0b49c0 0x7feeac0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 -- 172.21.15.2:0/1221319420 >> v2:172.21.15.90:3300/0 conn(0x7feeac0b49c0 msgr2=0x7feeac0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 --2- 172.21.15.2:0/1221319420 >> v2:172.21.15.90:3300/0 conn(0x7feeac0b49c0 0x7feeac0b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 -- 172.21.15.2:0/1221319420 >> v1:172.21.15.90:6789/0 conn(0x7feeac15d240 legacy=0x7feeac0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 -- 172.21.15.2:0/1221319420 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0d2840 con 0x7feeac0d0b10 2023-11-04T01:43:25.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeabfff640 1 --2- 172.21.15.2:0/1221319420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0d0b10 0x7feeac15d620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feeac0b5720 tx=0x7feea001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858637e74769b247 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeab7fe640 1 -- 172.21.15.2:0/1221319420 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00aa610 con 0x7feeac0d0b10 2023-11-04T01:43:25.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeab7fe640 1 -- 172.21.15.2:0/1221319420 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00a6040 con 0x7feeac0d0b10 2023-11-04T01:43:25.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.253+0000 7feeab7fe640 1 -- 172.21.15.2:0/1221319420 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00aa990 con 0x7feeac0d0b10 2023-11-04T01:43:25.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- 172.21.15.2:0/1221319420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0d0b10 msgr2=0x7feeac15d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/1221319420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0d0b10 0x7feeac15d620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feeac0b5720 tx=0x7feea001c490 comp rx=0 tx=0).stop 2023-11-04T01:43:25.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- 172.21.15.2:0/1221319420 shutdown_connections 2023-11-04T01:43:25.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/1221319420 >> v2:172.21.15.90:3300/0 conn(0x7feeac0b49c0 0x7feeac0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/1221319420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0d0b10 0x7feeac15d620 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- 172.21.15.2:0/1221319420 >> 172.21.15.2:0/1221319420 conn(0x7feeac0cf9c0 msgr2=0x7feeac0cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- 172.21.15.2:0/1221319420 shutdown_connections 2023-11-04T01:43:25.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- 172.21.15.2:0/1221319420 wait complete. 2023-11-04T01:43:25.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 Processor -- start 2023-11-04T01:43:25.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- start start 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0b49c0 0x7feeac14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feeac0d0b10 0x7feeac151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeac15d240 0x7feeac15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1515f0 con 0x7feeac0b49c0 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1509e0 con 0x7feeac15d240 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac150cc0 con 0x7feeac0d0b10 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0b49c0 0x7feeac14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0b49c0 0x7feeac14ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50272/0 (socket says 172.21.15.2:50272) 2023-11-04T01:43:25.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 -- 172.21.15.2:0/699431862 learned_addr learned my addr 172.21.15.2:0/699431862 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb1254640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeac15d240 0x7feeac15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 -- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feeac0d0b10 msgr2=0x7feeac151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feeac0d0b10 0x7feeac151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 -- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeac15d240 msgr2=0x7feeac15ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeac15d240 0x7feeac15ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 -- 172.21.15.2:0/699431862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00094d0 con 0x7feeac0b49c0 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb0a53640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0b49c0 0x7feeac14ed90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00b410 tx=0x7fee9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feea97fa640 1 -- 172.21.15.2:0/699431862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c004020 con 0x7feeac0b49c0 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feea97fa640 1 -- 172.21.15.2:0/699431862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c004180 con 0x7feeac0b49c0 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac150fa0 con 0x7feeac0b49c0 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feea97fa640 1 -- 172.21.15.2:0/699431862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011630 con 0x7feeac0b49c0 2023-11-04T01:43:25.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.257+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac14f5c0 con 0x7feeac0b49c0 2023-11-04T01:43:25.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.261+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac0675f0 con 0x7feeac0b49c0 2023-11-04T01:43:25.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.261+0000 7feea97fa640 1 -- 172.21.15.2:0/699431862 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fee9c011790 con 0x7feeac0b49c0 2023-11-04T01:43:25.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.261+0000 7feea97fa640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee980664a0 0x7fee98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.261+0000 7feea97fa640 1 -- 172.21.15.2:0/699431862 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee9c0838b0 con 0x7feeac0b49c0 2023-11-04T01:43:25.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.261+0000 7feeabfff640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee980664a0 0x7fee98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.261+0000 7feeabfff640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee980664a0 0x7fee98068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feea00ae000 tx=0x7feea0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.265+0000 7feea97fa640 1 -- 172.21.15.2:0/699431862 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee9c051110 con 0x7feeac0b49c0 2023-11-04T01:43:25.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.417+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeac1578a0 con 0x7feeac0b49c0 2023-11-04T01:43:25.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.417+0000 7feea97fa640 1 -- 172.21.15.2:0/699431862 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12749 (secure 0 0 0) 0x7fee9c054730 con 0x7feeac0b49c0 2023-11-04T01:43:25.423 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:25.423 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":30,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:22.559076+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee980664a0 msgr2=0x7fee98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee980664a0 0x7fee98068960 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feea00ae000 tx=0x7feea0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0b49c0 msgr2=0x7feeac14ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0b49c0 0x7feeac14ed90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00b410 tx=0x7fee9c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 shutdown_connections 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fee980664a0 0x7fee98068960 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feeac15d240 0x7feeac15ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feeac0d0b10 0x7feeac151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 --2- 172.21.15.2:0/699431862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feeac0b49c0 0x7feeac14ed90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 >> 172.21.15.2:0/699431862 conn(0x7feeac0cf9c0 msgr2=0x7feeac0c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 shutdown_connections 2023-11-04T01:43:25.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.421+0000 7feeb2cb7640 1 -- 172.21.15.2:0/699431862 wait complete. 2023-11-04T01:43:25.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:25.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3362d49640 1 Processor -- start 2023-11-04T01:43:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3362d49640 1 -- start start 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3362d49640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f335c065dc0 0x7f335c06b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3362d49640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 0x7f335c160d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3362d49640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c06b7c0 con 0x7f335c160790 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3362d49640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c066270 con 0x7f335c065dc0 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3362d49640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c160b70 con 0x7f335c0ceb70 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3360ae5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f335c160790 0x7f335c06ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58918/0 (socket says 172.21.15.2:58918) 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3360ae5640 1 -- 172.21.15.2:0/3457254678 learned_addr learned my addr 172.21.15.2:0/3457254678 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335bfff640 1 --2- 172.21.15.2:0/3457254678 >> v2:172.21.15.90:3300/0 conn(0x7f335c065dc0 0x7f335c06b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f33612e6640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 0x7f335c160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147984455 0 0) 0x7f334c001120 con 0x7f335c160790 2023-11-04T01:43:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3344003530 con 0x7f335c160790 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825308389 0 0) 0x7f3344003530 con 0x7f335c160790 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 msgr2=0x7f335c160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 0x7f335c160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 >> v2:172.21.15.90:3300/0 conn(0x7f335c065dc0 msgr2=0x7f335c06b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 --2- 172.21.15.2:0/3457254678 >> v2:172.21.15.90:3300/0 conn(0x7f335c065dc0 0x7f335c06b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0ca010 con 0x7f335c160790 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f334c001810 con 0x7f335c160790 2023-11-04T01:43:25.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 >> v1:172.21.15.2:6789/0 conn(0x7f335c160790 legacy=0x7f335c06ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 0x7f33440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344003f30 0x7f33440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3344004d10 0x7f3344005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c160b70 con 0x7f3344004d10 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334400b990 con 0x7f3344003f30 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334400bad0 con 0x7f335c0ceb70 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f33612e6640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3344004d10 0x7f3344005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f3360ae5640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 0x7f33440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f33612e6640 1 -- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 msgr2=0x7f33440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f33612e6640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c0ceb70 0x7f33440039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f33612e6640 1 -- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344003f30 msgr2=0x7f33440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f33612e6640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3344003f30 0x7f33440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.553+0000 7f33612e6640 1 -- 172.21.15.2:0/3457254678 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3344003530 con 0x7f3344004d10 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f33612e6640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3344004d10 0x7f3344005190 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3354009fc0 tx=0x7f335401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1128cf13d7c36b09 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33540a5c70 con 0x7f3344004d10 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400f040 con 0x7f3344004d10 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f335b7fe640 1 -- 172.21.15.2:0/3457254678 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33540ad440 con 0x7f3344004d10 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 -- 172.21.15.2:0/3457254678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3344004d10 msgr2=0x7f3344005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 --2- 172.21.15.2:0/3457254678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3344004d10 0x7f3344005190 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3354009fc0 tx=0x7f335401cc60 comp rx=0 tx=0).stop 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f33612e6640 1 -- 172.21.15.2:0/3457254678 reap_dead start 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 -- 172.21.15.2:0/3457254678 shutdown_connections 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 -- 172.21.15.2:0/3457254678 >> 172.21.15.2:0/3457254678 conn(0x7f335c0b0e30 msgr2=0x7f335c0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 -- 172.21.15.2:0/3457254678 shutdown_connections 2023-11-04T01:43:25.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 -- 172.21.15.2:0/3457254678 wait complete. 2023-11-04T01:43:25.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 Processor -- start 2023-11-04T01:43:25.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.557+0000 7f3362d49640 1 -- start start 2023-11-04T01:43:25.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c151140 0x7f335c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c0c6410 0x7f335c1f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f335c1f6720 0x7f335c1f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0c69b0 con 0x7f335c0c6410 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0c88d0 con 0x7f335c1f6720 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c1f3ae0 con 0x7f335c151140 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c0c6410 0x7f335c1f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c0c6410 0x7f335c1f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50298/0 (socket says 172.21.15.2:50298) 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 -- 172.21.15.2:0/1317824580 learned_addr learned my addr 172.21.15.2:0/1317824580 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33612e6640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f335c1f6720 0x7f335c1f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3360ae5640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c151140 0x7f335c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 -- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c151140 msgr2=0x7f335c0b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c151140 0x7f335c0b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 -- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f335c1f6720 msgr2=0x7f335c1f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f335c1f6720 0x7f335c1f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 -- 172.21.15.2:0/1317824580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0c8b20 con 0x7f335c0c6410 2023-11-04T01:43:25.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33612e6640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f335c1f6720 0x7f335c1f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f335bfff640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c0c6410 0x7f335c1f61e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3350009fd0 tx=0x7f335000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33597fa640 1 -- 172.21.15.2:0/1317824580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335000eea0 con 0x7f335c0c6410 2023-11-04T01:43:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33597fa640 1 -- 172.21.15.2:0/1317824580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335000c940 con 0x7f335c0c6410 2023-11-04T01:43:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c0c8e00 con 0x7f335c0c6410 2023-11-04T01:43:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33597fa640 1 -- 172.21.15.2:0/1317824580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335000ccf0 con 0x7f335c0c6410 2023-11-04T01:43:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c151520 con 0x7f335c0c6410 2023-11-04T01:43:25.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c0675f0 con 0x7f335c0c6410 2023-11-04T01:43:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33597fa640 1 -- 172.21.15.2:0/1317824580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3350013470 con 0x7f335c0c6410 2023-11-04T01:43:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33597fa640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33480664a0 0x7f3348068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f33597fa640 1 -- 172.21.15.2:0/1317824580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3350083bf0 con 0x7f335c0c6410 2023-11-04T01:43:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3360ae5640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33480664a0 0x7f3348068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.561+0000 7f3360ae5640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33480664a0 0x7f3348068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f334c000f70 tx=0x7f334c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.565+0000 7f33597fa640 1 -- 172.21.15.2:0/1317824580 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f33500513c0 con 0x7f335c0c6410 2023-11-04T01:43:25.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f335c0b52c0 con 0x7f335c0c6410 2023-11-04T01:43:25.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f33597fa640 1 -- 172.21.15.2:0/1317824580 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33500549e0 con 0x7f335c0c6410 2023-11-04T01:43:25.724 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:25.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33480664a0 msgr2=0x7f3348068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33480664a0 0x7f3348068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f334c000f70 tx=0x7f334c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:25.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c0c6410 msgr2=0x7f335c1f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c0c6410 0x7f335c1f61e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3350009fd0 tx=0x7f335000ec50 comp rx=0 tx=0).stop 2023-11-04T01:43:25.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 shutdown_connections 2023-11-04T01:43:25.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33480664a0 0x7f3348068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f335c1f6720 0x7f335c1f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f335c0c6410 0x7f335c1f61e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 --2- 172.21.15.2:0/1317824580 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f335c151140 0x7f335c0b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 >> 172.21.15.2:0/1317824580 conn(0x7f335c0b0e30 msgr2=0x7f335c0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 shutdown_connections 2023-11-04T01:43:25.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.721+0000 7f3362d49640 1 -- 172.21.15.2:0/1317824580 wait complete. 2023-11-04T01:43:25.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:43:25.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.865+0000 7f81a4782640 1 Processor -- start 2023-11-04T01:43:25.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.865+0000 7f81a4782640 1 -- start start 2023-11-04T01:43:25.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a4782640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f819c15afd0 0x7f819c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a4782640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c06f8f0 0x7f819c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a4782640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0c2670 con 0x7f819c0b0b70 2023-11-04T01:43:25.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a4782640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c070140 con 0x7f819c15afd0 2023-11-04T01:43:25.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a4782640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c15fc90 con 0x7f819c06f8f0 2023-11-04T01:43:25.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f819c15afd0 0x7f819c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f819c15afd0 0x7f819c0715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50308/0 (socket says 172.21.15.2:50308) 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 -- 172.21.15.2:0/2358714746 learned_addr learned my addr 172.21.15.2:0/2358714746 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a1d1d640 1 --2- 172.21.15.2:0/2358714746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c06f8f0 0x7f819c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 -- 172.21.15.2:0/2358714746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c06f8f0 msgr2=0x7f819c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 --2- 172.21.15.2:0/2358714746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c06f8f0 0x7f819c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 -- 172.21.15.2:0/2358714746 >> v1:172.21.15.2:6789/0 conn(0x7f819c0b0b70 legacy=0x7f819c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 -- 172.21.15.2:0/2358714746 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c06bc30 con 0x7f819c15afd0 2023-11-04T01:43:25.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a151c640 1 -- 172.21.15.2:0/2358714746 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598260987 0 0) 0x7f819c0c2670 con 0x7f819c0b0b70 2023-11-04T01:43:25.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a251e640 1 --2- 172.21.15.2:0/2358714746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c15afd0 0x7f819c0715d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8194009e50 tx=0x7f819401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1f1e79f797eed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a151c640 1 -- 172.21.15.2:0/2358714746 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940a55f0 con 0x7f819c15afd0 2023-11-04T01:43:25.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a151c640 1 -- 172.21.15.2:0/2358714746 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81940a5750 con 0x7f819c15afd0 2023-11-04T01:43:25.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.869+0000 7f81a151c640 1 -- 172.21.15.2:0/2358714746 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940a5ae0 con 0x7f819c15afd0 2023-11-04T01:43:25.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- 172.21.15.2:0/2358714746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c15afd0 msgr2=0x7f819c0715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 --2- 172.21.15.2:0/2358714746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c15afd0 0x7f819c0715d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8194009e50 tx=0x7f819401ca10 comp rx=0 tx=0).stop 2023-11-04T01:43:25.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- 172.21.15.2:0/2358714746 shutdown_connections 2023-11-04T01:43:25.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 --2- 172.21.15.2:0/2358714746 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c06f8f0 0x7f819c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 --2- 172.21.15.2:0/2358714746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c15afd0 0x7f819c0715d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- 172.21.15.2:0/2358714746 >> 172.21.15.2:0/2358714746 conn(0x7f819c0cebb0 msgr2=0x7f819c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:25.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- 172.21.15.2:0/2358714746 shutdown_connections 2023-11-04T01:43:25.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- 172.21.15.2:0/2358714746 wait complete. 2023-11-04T01:43:25.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 Processor -- start 2023-11-04T01:43:25.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- start start 2023-11-04T01:43:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c06f8f0 0x7f819c1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c0b0b70 0x7f819c165520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f819c15afd0 0x7f819c0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c165d00 con 0x7f819c06f8f0 2023-11-04T01:43:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c15df40 con 0x7f819c15afd0 2023-11-04T01:43:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c15d300 con 0x7f819c0b0b70 2023-11-04T01:43:25.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c06f8f0 0x7f819c1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c06f8f0 0x7f819c1455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50310/0 (socket says 172.21.15.2:50310) 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 -- 172.21.15.2:0/1593634843 learned_addr learned my addr 172.21.15.2:0/1593634843 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a1d1d640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c0b0b70 0x7f819c165520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a2d1f640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f819c15afd0 0x7f819c0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 -- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c0b0b70 msgr2=0x7f819c165520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c0b0b70 0x7f819c165520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 -- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f819c15afd0 msgr2=0x7f819c0c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f819c15afd0 0x7f819c0c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 -- 172.21.15.2:0/1593634843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8194009b30 con 0x7f819c06f8f0 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a2d1f640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f819c15afd0 0x7f819c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a251e640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c06f8f0 0x7f819c1455f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f819401a640 tx=0x7f81940197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f8192ffd640 1 -- 172.21.15.2:0/1593634843 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940b8670 con 0x7f819c06f8f0 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f8192ffd640 1 -- 172.21.15.2:0/1593634843 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81940b87d0 con 0x7f819c06f8f0 2023-11-04T01:43:25.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c165a60 con 0x7f819c06f8f0 2023-11-04T01:43:25.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f8192ffd640 1 -- 172.21.15.2:0/1593634843 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81940b8b80 con 0x7f819c06f8f0 2023-11-04T01:43:25.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.873+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c15d880 con 0x7f819c06f8f0 2023-11-04T01:43:25.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.877+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c15e080 con 0x7f819c06f8f0 2023-11-04T01:43:25.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.877+0000 7f8192ffd640 1 -- 172.21.15.2:0/1593634843 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81940b8ce0 con 0x7f819c06f8f0 2023-11-04T01:43:25.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.877+0000 7f8192ffd640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81800664a0 0x7f8180068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.877+0000 7f8192ffd640 1 -- 172.21.15.2:0/1593634843 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f819411f0a0 con 0x7f819c06f8f0 2023-11-04T01:43:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.877+0000 7f81a1d1d640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81800664a0 0x7f8180068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:25.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.877+0000 7f81a1d1d640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81800664a0 0x7f8180068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f819c1428a0 tx=0x7f818c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:25.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:25.881+0000 7f8192ffd640 1 -- 172.21.15.2:0/1593634843 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f819c15e080 con 0x7f819c06f8f0 2023-11-04T01:43:26.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.037+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f819c15e080 con 0x7f819c06f8f0 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.037+0000 7f8192ffd640 1 -- 172.21.15.2:0/1593634843 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f819c15e080 con 0x7f819c06f8f0 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:26.043 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-04T01:43:26.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81800664a0 msgr2=0x7f8180068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81800664a0 0x7f8180068960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f819c1428a0 tx=0x7f818c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:26.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c06f8f0 msgr2=0x7f819c1455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c06f8f0 0x7f819c1455f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f819401a640 tx=0x7f81940197b0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 shutdown_connections 2023-11-04T01:43:26.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81800664a0 0x7f8180068960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f819c15afd0 0x7f819c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f819c0b0b70 0x7f819c165520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 --2- 172.21.15.2:0/1593634843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f819c06f8f0 0x7f819c1455f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 >> 172.21.15.2:0/1593634843 conn(0x7f819c0cebb0 msgr2=0x7f819c0cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 shutdown_connections 2023-11-04T01:43:26.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.041+0000 7f81a4782640 1 -- 172.21.15.2:0/1593634843 wait complete. 2023-11-04T01:43:26.062 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:43:26.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:43:26.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f130b655640 1 Processor -- start 2023-11-04T01:43:26.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f130b655640 1 -- start start 2023-11-04T01:43:26.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f130b655640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f13040ca440 0x7f130415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f130b655640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130406b320 0x7f130406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f130b655640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13040cb220 con 0x7f130415ae60 2023-11-04T01:43:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f130b655640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130415ea00 con 0x7f13040ca440 2023-11-04T01:43:26.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f130b655640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130415b240 con 0x7f130406b320 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1309bf2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130406b320 0x7f130406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1309bf2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130406b320 0x7f130406b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:52020/0 (socket says 172.21.15.2:52020) 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1308bf0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f13040ca440 0x7f130415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1309bf2640 1 -- 172.21.15.2:0/463974484 learned_addr learned my addr 172.21.15.2:0/463974484 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1309bf2640 1 -- 172.21.15.2:0/463974484 >> v2:172.21.15.90:3300/0 conn(0x7f13040ca440 msgr2=0x7f130415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1309bf2640 1 --2- 172.21.15.2:0/463974484 >> v2:172.21.15.90:3300/0 conn(0x7f13040ca440 0x7f130415f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1309bf2640 1 -- 172.21.15.2:0/463974484 >> v1:172.21.15.90:6789/0 conn(0x7f130415ae60 legacy=0x7f13040cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.181+0000 7f1309bf2640 1 -- 172.21.15.2:0/463974484 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130406cda0 con 0x7f130406b320 2023-11-04T01:43:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f1309bf2640 1 --2- 172.21.15.2:0/463974484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130406b320 0x7f130406b7b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009e50 tx=0x7f12fc01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef71694f3fafa594 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f12fbfff640 1 -- 172.21.15.2:0/463974484 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0a58a0 con 0x7f130406b320 2023-11-04T01:43:26.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f12fbfff640 1 -- 172.21.15.2:0/463974484 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc0a5a00 con 0x7f130406b320 2023-11-04T01:43:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f12fbfff640 1 -- 172.21.15.2:0/463974484 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0a5d90 con 0x7f130406b320 2023-11-04T01:43:26.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 -- 172.21.15.2:0/463974484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130406b320 msgr2=0x7f130406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 --2- 172.21.15.2:0/463974484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130406b320 0x7f130406b7b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009e50 tx=0x7f12fc01c9e0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 -- 172.21.15.2:0/463974484 shutdown_connections 2023-11-04T01:43:26.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 --2- 172.21.15.2:0/463974484 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130406b320 0x7f130406b7b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 --2- 172.21.15.2:0/463974484 >> v2:172.21.15.90:3300/0 conn(0x7f13040ca440 0x7f130415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 -- 172.21.15.2:0/463974484 >> 172.21.15.2:0/463974484 conn(0x7f13040b0630 msgr2=0x7f13040b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 -- 172.21.15.2:0/463974484 shutdown_connections 2023-11-04T01:43:26.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 -- 172.21.15.2:0/463974484 wait complete. 2023-11-04T01:43:26.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 Processor -- start 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.185+0000 7f130b655640 1 -- start start 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f130406b320 0x7f13040c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13040ca440 0x7f13040ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130415ae60 0x7f130414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040c36b0 con 0x7f130406b320 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040c2b30 con 0x7f13040ca440 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040c2e10 con 0x7f130415ae60 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f130406b320 0x7f13040c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f130406b320 0x7f13040c2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50322/0 (socket says 172.21.15.2:50322) 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 -- 172.21.15.2:0/4213113060 learned_addr learned my addr 172.21.15.2:0/4213113060 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:26.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f1309bf2640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130415ae60 0x7f130414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f1308bf0640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13040ca440 0x7f13040ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 -- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130415ae60 msgr2=0x7f130414eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130415ae60 0x7f130414eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 -- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13040ca440 msgr2=0x7f13040ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13040ca440 0x7f13040ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 -- 172.21.15.2:0/4213113060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009b30 con 0x7f130406b320 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f13093f1640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f130406b320 0x7f13040c2550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1300007fd0 tx=0x7f130000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f12f9ffb640 1 -- 172.21.15.2:0/4213113060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000052d0 con 0x7f130406b320 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f12f9ffb640 1 -- 172.21.15.2:0/4213113060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1300005430 con 0x7f130406b320 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13040c30f0 con 0x7f130406b320 2023-11-04T01:43:26.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f12f9ffb640 1 -- 172.21.15.2:0/4213113060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300003840 con 0x7f130406b320 2023-11-04T01:43:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13040cd530 con 0x7f130406b320 2023-11-04T01:43:26.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13040744a0 con 0x7f130406b320 2023-11-04T01:43:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f12f9ffb640 1 -- 172.21.15.2:0/4213113060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13000039a0 con 0x7f130406b320 2023-11-04T01:43:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f12f9ffb640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12e80664d0 0x7f12e8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f12f9ffb640 1 -- 172.21.15.2:0/4213113060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1300082e60 con 0x7f130406b320 2023-11-04T01:43:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.189+0000 7f1308bf0640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12e80664d0 0x7f12e8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.193+0000 7f1308bf0640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12e80664d0 0x7f12e8068990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f13040c3880 tx=0x7f12f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.193+0000 7f12f9ffb640 1 -- 172.21.15.2:0/4213113060 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13000506e0 con 0x7f130406b320 2023-11-04T01:43:26.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.357+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f13040cb220 con 0x7f130406b320 2023-11-04T01:43:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.741+0000 7f12f9ffb640 1 -- 172.21.15.2:0/4213113060 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13040cb220 con 0x7f130406b320 2023-11-04T01:43:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12e80664d0 msgr2=0x7f12e8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12e80664d0 0x7f12e8068990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f13040c3880 tx=0x7f12f4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f130406b320 msgr2=0x7f13040c2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f130406b320 0x7f13040c2550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1300007fd0 tx=0x7f130000c890 comp rx=0 tx=0).stop 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 shutdown_connections 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12e80664d0 0x7f12e8068990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f130415ae60 0x7f130414eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13040ca440 0x7f13040ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 --2- 172.21.15.2:0/4213113060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f130406b320 0x7f13040c2550 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 >> 172.21.15.2:0/4213113060 conn(0x7f13040b0630 msgr2=0x7f13040b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 shutdown_connections 2023-11-04T01:43:26.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.745+0000 7f130b655640 1 -- 172.21.15.2:0/4213113060 wait complete. 2023-11-04T01:43:26.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:43:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95ab970640 1 Processor -- start 2023-11-04T01:43:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95ab970640 1 -- start start 2023-11-04T01:43:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95ab970640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f95a415afd0 0x7f95a40b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95ab970640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95a4071500 0x7f95a4071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95ab970640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a415b3b0 con 0x7f95a40b2ba0 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95ab970640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a406e510 con 0x7f95a4071500 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95ab970640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a406e7f0 con 0x7f95a415afd0 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a8f0b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95a4071500 0x7f95a4071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a8f0b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f95a4071500 0x7f95a4071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50334/0 (socket says 172.21.15.2:50334) 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a8f0b640 1 -- 172.21.15.2:0/4264081549 learned_addr learned my addr 172.21.15.2:0/4264081549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a970c640 1 --2- 172.21.15.2:0/4264081549 >> v2:172.21.15.90:3300/0 conn(0x7f95a415afd0 0x7f95a40b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a8f0b640 1 -- 172.21.15.2:0/4264081549 >> v2:172.21.15.90:3300/0 conn(0x7f95a415afd0 msgr2=0x7f95a40b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a8f0b640 1 --2- 172.21.15.2:0/4264081549 >> v2:172.21.15.90:3300/0 conn(0x7f95a415afd0 0x7f95a40b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a8f0b640 1 -- 172.21.15.2:0/4264081549 >> v1:172.21.15.90:6789/0 conn(0x7f95a40b2ba0 legacy=0x7f95a406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.909+0000 7f95a8f0b640 1 -- 172.21.15.2:0/4264081549 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a406ead0 con 0x7f95a4071500 2023-11-04T01:43:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95a8f0b640 1 --2- 172.21.15.2:0/4264081549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a4071500 0x7f95a4071980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9594009870 tx=0x7f959401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e6135c866aa7cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f959bfff640 1 -- 172.21.15.2:0/4264081549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940aa5f0 con 0x7f95a4071500 2023-11-04T01:43:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f959bfff640 1 -- 172.21.15.2:0/4264081549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95940aa750 con 0x7f95a4071500 2023-11-04T01:43:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f959bfff640 1 -- 172.21.15.2:0/4264081549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940aaae0 con 0x7f95a4071500 2023-11-04T01:43:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 -- 172.21.15.2:0/4264081549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a4071500 msgr2=0x7f95a4071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 --2- 172.21.15.2:0/4264081549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a4071500 0x7f95a4071980 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9594009870 tx=0x7f959401c490 comp rx=0 tx=0).stop 2023-11-04T01:43:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 -- 172.21.15.2:0/4264081549 shutdown_connections 2023-11-04T01:43:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 --2- 172.21.15.2:0/4264081549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a4071500 0x7f95a4071980 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 --2- 172.21.15.2:0/4264081549 >> v2:172.21.15.90:3300/0 conn(0x7f95a415afd0 0x7f95a40b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 -- 172.21.15.2:0/4264081549 >> 172.21.15.2:0/4264081549 conn(0x7f95a40cfd50 msgr2=0x7f95a40d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 -- 172.21.15.2:0/4264081549 shutdown_connections 2023-11-04T01:43:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 -- 172.21.15.2:0/4264081549 wait complete. 2023-11-04T01:43:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 Processor -- start 2023-11-04T01:43:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.913+0000 7f95ab970640 1 -- start start 2023-11-04T01:43:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95a4071500 0x7f95a414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a40b2ba0 0x7f95a40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95a415afd0 0x7f95a40c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40c36b0 con 0x7f95a40b2ba0 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40c3900 con 0x7f95a4071500 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a40c3be0 con 0x7f95a415afd0 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a40b2ba0 0x7f95a40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a40b2ba0 0x7f95a40c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50346/0 (socket says 172.21.15.2:50346) 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 -- 172.21.15.2:0/1450883064 learned_addr learned my addr 172.21.15.2:0/1450883064 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a970c640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95a4071500 0x7f95a414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a9f0d640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95a415afd0 0x7f95a40c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 -- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95a415afd0 msgr2=0x7f95a40c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95a415afd0 0x7f95a40c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 -- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95a4071500 msgr2=0x7f95a414d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95a4071500 0x7f95a414d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 -- 172.21.15.2:0/1450883064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940094d0 con 0x7f95a40b2ba0 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a970c640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95a4071500 0x7f95a414d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a9f0d640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95a415afd0 0x7f95a40c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a8f0b640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a40b2ba0 0x7f95a40c49a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f959401a0c0 tx=0x7f959401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f9599ffb640 1 -- 172.21.15.2:0/1450883064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940aa5f0 con 0x7f95a40b2ba0 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f9599ffb640 1 -- 172.21.15.2:0/1450883064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95940b3800 con 0x7f95a40b2ba0 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a40c3ec0 con 0x7f95a40b2ba0 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f9599ffb640 1 -- 172.21.15.2:0/1450883064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940b3bb0 con 0x7f95a40b2ba0 2023-11-04T01:43:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a40c4480 con 0x7f95a40b2ba0 2023-11-04T01:43:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a40675f0 con 0x7f95a40b2ba0 2023-11-04T01:43:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f9599ffb640 1 -- 172.21.15.2:0/1450883064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95940b3d10 con 0x7f95a40b2ba0 2023-11-04T01:43:26.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f9599ffb640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f95880664a0 0x7f9588068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f9599ffb640 1 -- 172.21.15.2:0/1450883064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f95940a7070 con 0x7f95a40b2ba0 2023-11-04T01:43:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.917+0000 7f95a970c640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f95880664a0 0x7f9588068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:26.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.921+0000 7f95a970c640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f95880664a0 0x7f9588068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f959c009f50 tx=0x7f959c00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:26.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:26.921+0000 7f9599ffb640 1 -- 172.21.15.2:0/1450883064 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f95940ebc60 con 0x7f95a40b2ba0 2023-11-04T01:43:27.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.085+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f95a40b48d0 con 0x7f95a40b2ba0 2023-11-04T01:43:27.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.757+0000 7f9599ffb640 1 -- 172.21.15.2:0/1450883064 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f95940ef280 con 0x7f95a40b2ba0 2023-11-04T01:43:27.761 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f95880664a0 msgr2=0x7f9588068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f95880664a0 0x7f9588068960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f959c009f50 tx=0x7f959c00b040 comp rx=0 tx=0).stop 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a40b2ba0 msgr2=0x7f95a40c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a40b2ba0 0x7f95a40c49a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f959401a0c0 tx=0x7f959401acd0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 shutdown_connections 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f95880664a0 0x7f9588068960 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f95a415afd0 0x7f95a40c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95a40b2ba0 0x7f95a40c49a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 --2- 172.21.15.2:0/1450883064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95a4071500 0x7f95a414d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 >> 172.21.15.2:0/1450883064 conn(0x7f95a40cfd50 msgr2=0x7f95a4156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 shutdown_connections 2023-11-04T01:43:27.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.761+0000 7f95ab970640 1 -- 172.21.15.2:0/1450883064 wait complete. 2023-11-04T01:43:27.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:43:27.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7ee6c640 1 Processor -- start 2023-11-04T01:43:27.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7ee6c640 1 -- start start 2023-11-04T01:43:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7ee6c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efc7815af70 0x7efc780cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7ee6c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7815e490 0x7efc780cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7ee6c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7806c0c0 con 0x7efc7806d160 2023-11-04T01:43:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7ee6c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7815e8e0 con 0x7efc7815af70 2023-11-04T01:43:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7ee6c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc78071200 con 0x7efc7815e490 2023-11-04T01:43:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7cc08640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efc7815af70 0x7efc780cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7d409640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7815e490 0x7efc780cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc77fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7efc7806d160 0x7efc7815dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:46576/0 (socket says 172.21.15.2:46576) 2023-11-04T01:43:27.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7cc08640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efc7815af70 0x7efc780cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38932/0 (socket says 172.21.15.2:38932) 2023-11-04T01:43:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc77fff640 1 -- 172.21.15.2:0/1626360341 learned_addr learned my addr 172.21.15.2:0/1626360341 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7d409640 1 -- 172.21.15.2:0/1626360341 >> v2:172.21.15.90:3300/0 conn(0x7efc7815af70 msgr2=0x7efc780cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7d409640 1 --2- 172.21.15.2:0/1626360341 >> v2:172.21.15.90:3300/0 conn(0x7efc7815af70 0x7efc780cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7d409640 1 -- 172.21.15.2:0/1626360341 >> v1:172.21.15.90:6789/0 conn(0x7efc7806d160 legacy=0x7efc7815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7d409640 1 -- 172.21.15.2:0/1626360341 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7806c3a0 con 0x7efc7815e490 2023-11-04T01:43:27.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.913+0000 7efc7cc08640 1 --2- 172.21.15.2:0/1626360341 >> v2:172.21.15.90:3300/0 conn(0x7efc7815af70 0x7efc780cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7d409640 1 --2- 172.21.15.2:0/1626360341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7815e490 0x7efc780cdfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc700097c0 tx=0x7efc7001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7e3cfc43b2e661e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc777fe640 1 -- 172.21.15.2:0/1626360341 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700ab600 con 0x7efc7815e490 2023-11-04T01:43:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc777fe640 1 -- 172.21.15.2:0/1626360341 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc700a7050 con 0x7efc7815e490 2023-11-04T01:43:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc777fe640 1 -- 172.21.15.2:0/1626360341 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700ab980 con 0x7efc7815e490 2023-11-04T01:43:27.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1626360341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7815e490 msgr2=0x7efc780cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1626360341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7815e490 0x7efc780cdfe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efc700097c0 tx=0x7efc7001c480 comp rx=0 tx=0).stop 2023-11-04T01:43:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1626360341 shutdown_connections 2023-11-04T01:43:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1626360341 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7815e490 0x7efc780cdfe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1626360341 >> v2:172.21.15.90:3300/0 conn(0x7efc7815af70 0x7efc780cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1626360341 >> 172.21.15.2:0/1626360341 conn(0x7efc780cb510 msgr2=0x7efc780cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1626360341 shutdown_connections 2023-11-04T01:43:27.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1626360341 wait complete. 2023-11-04T01:43:27.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.917+0000 7efc7ee6c640 1 Processor -- start 2023-11-04T01:43:27.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 -- start start 2023-11-04T01:43:27.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7806d160 0x7efc78153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc7815af70 0x7efc7815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc7815e490 0x7efc780c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc781528b0 con 0x7efc7815af70 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc78152b90 con 0x7efc7815e490 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc78152e70 con 0x7efc7806d160 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc7815af70 0x7efc7815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc7815af70 0x7efc7815bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50358/0 (socket says 172.21.15.2:50358) 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 -- 172.21.15.2:0/1382249160 learned_addr learned my addr 172.21.15.2:0/1382249160 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7cc08640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7806d160 0x7efc78153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7d409640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc7815e490 0x7efc780c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 -- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7806d160 msgr2=0x7efc78153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7806d160 0x7efc78153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 -- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc7815e490 msgr2=0x7efc780c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc7815e490 0x7efc780c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 -- 172.21.15.2:0/1382249160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc60009420 con 0x7efc7815af70 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc77fff640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc7815af70 0x7efc7815bea0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc68002240 tx=0x7efc6800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc757fa640 1 -- 172.21.15.2:0/1382249160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800ad40 con 0x7efc7815af70 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc757fa640 1 -- 172.21.15.2:0/1382249160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc68012400 con 0x7efc7815af70 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc757fa640 1 -- 172.21.15.2:0/1382249160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800aea0 con 0x7efc7815af70 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc70009420 con 0x7efc7815af70 2023-11-04T01:43:27.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc78153430 con 0x7efc7815af70 2023-11-04T01:43:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc780744a0 con 0x7efc7815af70 2023-11-04T01:43:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc757fa640 1 -- 172.21.15.2:0/1382249160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc68007070 con 0x7efc7815af70 2023-11-04T01:43:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc757fa640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc580664a0 0x7efc58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:27.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc757fa640 1 -- 172.21.15.2:0/1382249160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7efc68083e30 con 0x7efc7815af70 2023-11-04T01:43:27.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.921+0000 7efc7cc08640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc580664a0 0x7efc58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:27.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.925+0000 7efc7cc08640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc580664a0 0x7efc58068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc60009c80 tx=0x7efc60008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:27.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:27.929+0000 7efc757fa640 1 -- 172.21.15.2:0/1382249160 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc68051310 con 0x7efc7815af70 2023-11-04T01:43:28.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.113+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efc7806b950 con 0x7efc7815af70 2023-11-04T01:43:28.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.793+0000 7efc757fa640 1 -- 172.21.15.2:0/1382249160 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7efc680170c0 con 0x7efc7815af70 2023-11-04T01:43:28.802 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 4 and data pool 5 2023-11-04T01:43:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc580664a0 msgr2=0x7efc58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc580664a0 0x7efc58068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc60009c80 tx=0x7efc60008040 comp rx=0 tx=0).stop 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc7815af70 msgr2=0x7efc7815bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc7815af70 0x7efc7815bea0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc68002240 tx=0x7efc6800a430 comp rx=0 tx=0).stop 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 shutdown_connections 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efc580664a0 0x7efc58068960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc7815e490 0x7efc780c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc7815af70 0x7efc7815bea0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 --2- 172.21.15.2:0/1382249160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efc7806d160 0x7efc78153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.813+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 >> 172.21.15.2:0/1382249160 conn(0x7efc780cb510 msgr2=0x7efc780cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:28.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.817+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 shutdown_connections 2023-11-04T01:43:28.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.817+0000 7efc7ee6c640 1 -- 172.21.15.2:0/1382249160 wait complete. 2023-11-04T01:43:28.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79a3c2640 1 Processor -- start 2023-11-04T01:43:28.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79a3c2640 1 -- start start 2023-11-04T01:43:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79a3c2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940b4990 0x7fe7940b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79a3c2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe7940d0690 0x7fe7940cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79a3c2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940b6070 con 0x7fe7940d0ae0 2023-11-04T01:43:28.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79a3c2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940b8ed0 con 0x7fe7940d0690 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79a3c2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940b52b0 con 0x7fe7940b4990 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe7937fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe7940d0690 0x7fe7940cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79895f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe7940d0ae0 0x7fe7940cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58942/0 (socket says 172.21.15.2:58942) 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe79895f640 1 -- 172.21.15.2:0/3600666056 learned_addr learned my addr 172.21.15.2:0/3600666056 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe793fff640 1 --2- 172.21.15.2:0/3600666056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940b4990 0x7fe7940b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe7937fe640 1 -- 172.21.15.2:0/3600666056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940b4990 msgr2=0x7fe7940b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe7937fe640 1 --2- 172.21.15.2:0/3600666056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940b4990 0x7fe7940b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe7937fe640 1 -- 172.21.15.2:0/3600666056 >> v1:172.21.15.2:6789/0 conn(0x7fe7940d0ae0 legacy=0x7fe7940cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe7937fe640 1 -- 172.21.15.2:0/3600666056 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940d1ce0 con 0x7fe7940d0690 2023-11-04T01:43:28.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe792ffd640 1 -- 172.21.15.2:0/3600666056 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324885932 0 0) 0x7fe7940b6070 con 0x7fe7940d0ae0 2023-11-04T01:43:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.961+0000 7fe7937fe640 1 --2- 172.21.15.2:0/3600666056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940d0690 0x7fe7940cd770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe7880097c0 tx=0x7fe78801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9ffd3504d2a584 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe792ffd640 1 -- 172.21.15.2:0/3600666056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880a8970 con 0x7fe7940d0690 2023-11-04T01:43:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe792ffd640 1 -- 172.21.15.2:0/3600666056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7880a8ad0 con 0x7fe7940d0690 2023-11-04T01:43:28.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe792ffd640 1 -- 172.21.15.2:0/3600666056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880a8e60 con 0x7fe7940d0690 2023-11-04T01:43:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- 172.21.15.2:0/3600666056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940d0690 msgr2=0x7fe7940cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/3600666056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940d0690 0x7fe7940cd770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe7880097c0 tx=0x7fe78801ec70 comp rx=0 tx=0).stop 2023-11-04T01:43:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- 172.21.15.2:0/3600666056 shutdown_connections 2023-11-04T01:43:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/3600666056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940d0690 0x7fe7940cd770 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/3600666056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940b4990 0x7fe7940b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- 172.21.15.2:0/3600666056 >> 172.21.15.2:0/3600666056 conn(0x7fe7940cf990 msgr2=0x7fe7940cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:28.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- 172.21.15.2:0/3600666056 shutdown_connections 2023-11-04T01:43:28.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- 172.21.15.2:0/3600666056 wait complete. 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 Processor -- start 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- start start 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940b4990 0x7fe7941e6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940d0690 0x7fe794158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7940d0ae0 0x7fe7940cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7941e6970 con 0x7fe7940b4990 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940c9fe0 con 0x7fe7940d0ae0 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940ca2a0 con 0x7fe7940d0690 2023-11-04T01:43:28.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940b4990 0x7fe7941e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940b4990 0x7fe7941e6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50380/0 (socket says 172.21.15.2:50380) 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 -- 172.21.15.2:0/2348882371 learned_addr learned my addr 172.21.15.2:0/2348882371 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe7937fe640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940d0690 0x7fe794158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79895f640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7940d0ae0 0x7fe7940cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 -- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940d0690 msgr2=0x7fe794158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940d0690 0x7fe794158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 -- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7940d0ae0 msgr2=0x7fe7940cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7940d0ae0 0x7fe7940cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 -- 172.21.15.2:0/2348882371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe788009420 con 0x7fe7940b4990 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe7937fe640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940d0690 0x7fe794158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe793fff640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940b4990 0x7fe7941e6430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe78400d5f0 tx=0x7fe78400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe790ff9640 1 -- 172.21.15.2:0/2348882371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7840125f0 con 0x7fe7940b4990 2023-11-04T01:43:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe790ff9640 1 -- 172.21.15.2:0/2348882371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe784012750 con 0x7fe7940b4990 2023-11-04T01:43:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe790ff9640 1 -- 172.21.15.2:0/2348882371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784012ae0 con 0x7fe7940b4990 2023-11-04T01:43:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7940ca580 con 0x7fe7940b4990 2023-11-04T01:43:28.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.965+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7940cab40 con 0x7fe7940b4990 2023-11-04T01:43:28.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.969+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7940744a0 con 0x7fe7940b4990 2023-11-04T01:43:28.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.969+0000 7fe790ff9640 1 -- 172.21.15.2:0/2348882371 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe784012c40 con 0x7fe7940b4990 2023-11-04T01:43:28.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.969+0000 7fe790ff9640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7800664a0 0x7fe780068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:28.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.969+0000 7fe790ff9640 1 -- 172.21.15.2:0/2348882371 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7840842f0 con 0x7fe7940b4990 2023-11-04T01:43:28.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.969+0000 7fe7937fe640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7800664a0 0x7fe780068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:28.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.969+0000 7fe7937fe640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7800664a0 0x7fe780068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7880b2000 tx=0x7fe7880aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:28.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:28.973+0000 7fe790ff9640 1 -- 172.21.15.2:0/2348882371 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe784051800 con 0x7fe7940b4990 2023-11-04T01:43:29.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.125+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7940cd320 con 0x7fe7940b4990 2023-11-04T01:43:29.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.125+0000 7fe790ff9640 1 -- 172.21.15.2:0/2348882371 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16414 (secure 0 0 0) 0x7fe784054e20 con 0x7fe7940b4990 2023-11-04T01:43:29.130 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:29.130 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:28.119718+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:26.399544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:27.128100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7800664a0 msgr2=0x7fe780068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7800664a0 0x7fe780068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe7880b2000 tx=0x7fe7880aa070 comp rx=0 tx=0).stop 2023-11-04T01:43:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940b4990 msgr2=0x7fe7941e6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940b4990 0x7fe7941e6430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe78400d5f0 tx=0x7fe78400dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 shutdown_connections 2023-11-04T01:43:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7800664a0 0x7fe780068960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7940d0ae0 0x7fe7940cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7940d0690 0x7fe794158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 --2- 172.21.15.2:0/2348882371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7940b4990 0x7fe7941e6430 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 >> 172.21.15.2:0/2348882371 conn(0x7fe7940cf990 msgr2=0x7fe7940b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 shutdown_connections 2023-11-04T01:43:29.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.129+0000 7fe79a3c2640 1 -- 172.21.15.2:0/2348882371 wait complete. 2023-11-04T01:43:29.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3f52fe640 1 Processor -- start 2023-11-04T01:43:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3f52fe640 1 -- start start 2023-11-04T01:43:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3f52fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 0x7fa3f00cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3f52fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00cdc80 con 0x7fa3f00b1960 2023-11-04T01:43:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3f52fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00cf5a0 con 0x7fa3f015cd60 2023-11-04T01:43:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3f52fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0071e40 con 0x7fa3f00b1d40 2023-11-04T01:43:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3eeffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa3f00b1960 0x7fa3f00ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58958/0 (socket says 172.21.15.2:58958) 2023-11-04T01:43:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3eeffd640 1 -- 172.21.15.2:0/506030498 learned_addr learned my addr 172.21.15.2:0/506030498 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3e7fff640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 0x7fa3f00cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566268555 0 0) 0x7fa3f00cdc80 con 0x7fa3f00b1960 2023-11-04T01:43:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3dc003530 con 0x7fa3f00b1960 2023-11-04T01:43:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1188844165 0 0) 0x7fa3dc003530 con 0x7fa3f00b1960 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 msgr2=0x7fa3f00cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 0x7fa3f00cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 >> v1:172.21.15.90:6789/0 conn(0x7fa3f015cd60 legacy=0x7fa3f015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00cf880 con 0x7fa3f00b1960 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa3e00016a0 con 0x7fa3f00b1960 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 >> v1:172.21.15.2:6789/0 conn(0x7fa3f00b1960 legacy=0x7fa3f00ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3dc0039b0 0x7fa3dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 0x7fa3dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3dc004d10 0x7fa3dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0071e40 con 0x7fa3dc004d10 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc00ba40 con 0x7fa3dc0039b0 2023-11-04T01:43:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc00bc00 con 0x7fa3f00b1d40 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ef7fe640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3dc004d10 0x7fa3dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3e7fff640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 0x7fa3dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3eeffd640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3dc0039b0 0x7fa3dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 msgr2=0x7fa3dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ef7fe640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3f00b1d40 0x7fa3dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3dc0039b0 msgr2=0x7fa3dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ef7fe640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3dc0039b0 0x7fa3dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.253+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/506030498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc003530 con 0x7fa3dc004d10 2023-11-04T01:43:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3ef7fe640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3dc004d10 0x7fa3dc005190 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8001e40 tx=0x7fa3e801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d01033b071c1af server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8003b80 con 0x7fa3dc004d10 2023-11-04T01:43:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e8003ce0 con 0x7fa3dc004d10 2023-11-04T01:43:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3ee7fc640 1 -- 172.21.15.2:0/506030498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80052c0 con 0x7fa3dc004d10 2023-11-04T01:43:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 -- 172.21.15.2:0/506030498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3dc004d10 msgr2=0x7fa3dc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 --2- 172.21.15.2:0/506030498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3dc004d10 0x7fa3dc005190 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8001e40 tx=0x7fa3e801c740 comp rx=0 tx=0).stop 2023-11-04T01:43:29.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/506030498 reap_dead start 2023-11-04T01:43:29.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 -- 172.21.15.2:0/506030498 shutdown_connections 2023-11-04T01:43:29.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 -- 172.21.15.2:0/506030498 >> 172.21.15.2:0/506030498 conn(0x7fa3f006e760 msgr2=0x7fa3f006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 -- 172.21.15.2:0/506030498 shutdown_connections 2023-11-04T01:43:29.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 -- 172.21.15.2:0/506030498 wait complete. 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 Processor -- start 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.257+0000 7fa3f52fe640 1 -- start start 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3dc004d10 0x7fa3f014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad960 0x7fa3f00adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f015f6c0 0x7fa3f015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0159c90 con 0x7fa3f015f6c0 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0160080 con 0x7fa3f00ad960 2023-11-04T01:43:29.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0159010 con 0x7fa3dc004d10 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f015f6c0 0x7fa3f015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f015f6c0 0x7fa3f015fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50390/0 (socket says 172.21.15.2:50390) 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/2084331465 learned_addr learned my addr 172.21.15.2:0/2084331465 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3e7fff640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad960 0x7fa3f00adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3eeffd640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3dc004d10 0x7fa3f014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3dc004d10 msgr2=0x7fa3f014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3dc004d10 0x7fa3f014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad960 msgr2=0x7fa3f00adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad960 0x7fa3f00adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 -- 172.21.15.2:0/2084331465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f01592f0 con 0x7fa3f015f6c0 2023-11-04T01:43:29.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3ef7fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f015f6c0 0x7fa3f015fb40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3e801c570 tx=0x7fa3dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3e77fe640 1 -- 172.21.15.2:0/2084331465 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80b8070 con 0x7fa3f015f6c0 2023-11-04T01:43:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3e77fe640 1 -- 172.21.15.2:0/2084331465 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e8003e50 con 0x7fa3f015f6c0 2023-11-04T01:43:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f01595d0 con 0x7fa3f015f6c0 2023-11-04T01:43:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3e77fe640 1 -- 172.21.15.2:0/2084331465 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8005030 con 0x7fa3f015f6c0 2023-11-04T01:43:29.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f0158ca0 con 0x7fa3f015f6c0 2023-11-04T01:43:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00675f0 con 0x7fa3f015f6c0 2023-11-04T01:43:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3e77fe640 1 -- 172.21.15.2:0/2084331465 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3e8005190 con 0x7fa3f015f6c0 2023-11-04T01:43:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3e77fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3d00664a0 0x7fa3d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3e77fe640 1 -- 172.21.15.2:0/2084331465 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3e811d190 con 0x7fa3f015f6c0 2023-11-04T01:43:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3eeffd640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3d00664a0 0x7fa3d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.261+0000 7fa3eeffd640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3d00664a0 0x7fa3d0068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00cde10 tx=0x7fa3e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.265+0000 7fa3e77fe640 1 -- 172.21.15.2:0/2084331465 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3e80ea6a0 con 0x7fa3f015f6c0 2023-11-04T01:43:29.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.421+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3f00c9c70 con 0x7fa3f015f6c0 2023-11-04T01:43:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.421+0000 7fa3e77fe640 1 -- 172.21.15.2:0/2084331465 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16414 (secure 0 0 0) 0x7fa3e80edcc0 con 0x7fa3f015f6c0 2023-11-04T01:43:29.427 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:29.427 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:28.119718+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:26.399544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:27.128100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3d00664a0 msgr2=0x7fa3d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3d00664a0 0x7fa3d0068960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00cde10 tx=0x7fa3e0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f015f6c0 msgr2=0x7fa3f015fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f015f6c0 0x7fa3f015fb40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa3e801c570 tx=0x7fa3dc005800 comp rx=0 tx=0).stop 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 shutdown_connections 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3d00664a0 0x7fa3d0068960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3f015f6c0 0x7fa3f015fb40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3f00ad960 0x7fa3f00adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 --2- 172.21.15.2:0/2084331465 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa3dc004d10 0x7fa3f014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 >> 172.21.15.2:0/2084331465 conn(0x7fa3f006e760 msgr2=0x7fa3f006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 shutdown_connections 2023-11-04T01:43:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.425+0000 7fa3f52fe640 1 -- 172.21.15.2:0/2084331465 wait complete. 2023-11-04T01:43:29.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:43:29.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad5685a640 1 Processor -- start 2023-11-04T01:43:29.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad5685a640 1 -- start start 2023-11-04T01:43:29.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad5685a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad50144840 0x7fad5015f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad5685a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fad50070b40 0x7fad500b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad5685a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5006cc10 con 0x7fad500b54d0 2023-11-04T01:43:29.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad5685a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad500b5960 con 0x7fad50144840 2023-11-04T01:43:29.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad5685a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad50071d10 con 0x7fad50070b40 2023-11-04T01:43:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad4ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fad50144840 0x7fad5015f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad54df7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fad500b54d0 0x7fad5006a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58972/0 (socket says 172.21.15.2:58972) 2023-11-04T01:43:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad54df7640 1 -- 172.21.15.2:0/2310273530 learned_addr learned my addr 172.21.15.2:0/2310273530 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad4f7fe640 1 --2- 172.21.15.2:0/2310273530 >> v2:172.21.15.90:3300/0 conn(0x7fad50070b40 0x7fad500b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad4ffff640 1 -- 172.21.15.2:0/2310273530 >> v2:172.21.15.90:3300/0 conn(0x7fad50070b40 msgr2=0x7fad500b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:29.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad4ffff640 1 --2- 172.21.15.2:0/2310273530 >> v2:172.21.15.90:3300/0 conn(0x7fad50070b40 0x7fad500b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad4ffff640 1 -- 172.21.15.2:0/2310273530 >> v1:172.21.15.2:6789/0 conn(0x7fad500b54d0 legacy=0x7fad5006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.569+0000 7fad4ffff640 1 -- 172.21.15.2:0/2310273530 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5015fb20 con 0x7fad50144840 2023-11-04T01:43:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 --2- 172.21.15.2:0/2310273530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50144840 0x7fad5015f5e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fad5006b1a0 tx=0x7fad4001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edec24719cec637e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4effd640 1 -- 172.21.15.2:0/2310273530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400ab600 con 0x7fad50144840 2023-11-04T01:43:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4effd640 1 -- 172.21.15.2:0/2310273530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad400a7050 con 0x7fad50144840 2023-11-04T01:43:29.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4effd640 1 -- 172.21.15.2:0/2310273530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400ab980 con 0x7fad50144840 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- 172.21.15.2:0/2310273530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50144840 msgr2=0x7fad5015f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 --2- 172.21.15.2:0/2310273530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50144840 0x7fad5015f5e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fad5006b1a0 tx=0x7fad4001c3a0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- 172.21.15.2:0/2310273530 shutdown_connections 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 --2- 172.21.15.2:0/2310273530 >> v2:172.21.15.90:3300/0 conn(0x7fad50070b40 0x7fad500b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 --2- 172.21.15.2:0/2310273530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50144840 0x7fad5015f5e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- 172.21.15.2:0/2310273530 >> 172.21.15.2:0/2310273530 conn(0x7fad500cfc70 msgr2=0x7fad500d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- 172.21.15.2:0/2310273530 shutdown_connections 2023-11-04T01:43:29.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- 172.21.15.2:0/2310273530 wait complete. 2023-11-04T01:43:29.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 Processor -- start 2023-11-04T01:43:29.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- start start 2023-11-04T01:43:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50070b40 0x7fad50139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad500b54d0 0x7fad5015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad50144840 0x7fad50155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500b4910 con 0x7fad50070b40 2023-11-04T01:43:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500b3d00 con 0x7fad50144840 2023-11-04T01:43:29.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500b3fe0 con 0x7fad500b54d0 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50070b40 0x7fad50139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50070b40 0x7fad50139480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50414/0 (socket says 172.21.15.2:50414) 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 -- 172.21.15.2:0/989291676 learned_addr learned my addr 172.21.15.2:0/989291676 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad54df7640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad50144840 0x7fad50155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4f7fe640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad500b54d0 0x7fad5015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 -- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad500b54d0 msgr2=0x7fad5015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad500b54d0 0x7fad5015d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 -- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad50144840 msgr2=0x7fad50155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad50144840 0x7fad50155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 -- 172.21.15.2:0/989291676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40009420 con 0x7fad50070b40 2023-11-04T01:43:29.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad54df7640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad50144840 0x7fad50155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:29.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4ffff640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50070b40 0x7fad50139480 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fad400ae040 tx=0x7fad4001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4cff9640 1 -- 172.21.15.2:0/989291676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400b7450 con 0x7fad50070b40 2023-11-04T01:43:29.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4cff9640 1 -- 172.21.15.2:0/989291676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad400b75d0 con 0x7fad50070b40 2023-11-04T01:43:29.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500b42c0 con 0x7fad50070b40 2023-11-04T01:43:29.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad4cff9640 1 -- 172.21.15.2:0/989291676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400b7980 con 0x7fad50070b40 2023-11-04T01:43:29.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.573+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad501399c0 con 0x7fad50070b40 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.577+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad500675f0 con 0x7fad50070b40 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.577+0000 7fad4cff9640 1 -- 172.21.15.2:0/989291676 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad400b7ae0 con 0x7fad50070b40 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.577+0000 7fad4cff9640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad3c0664a0 0x7fad3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.577+0000 7fad4cff9640 1 -- 172.21.15.2:0/989291676 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad4011e520 con 0x7fad50070b40 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.577+0000 7fad4f7fe640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad3c0664a0 0x7fad3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:29.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.577+0000 7fad4f7fe640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad3c0664a0 0x7fad3c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fad501540d0 tx=0x7fad44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:29.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.581+0000 7fad4cff9640 1 -- 172.21.15.2:0/989291676 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad400ebb50 con 0x7fad50070b40 2023-11-04T01:43:29.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:29.769+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fad500cf9e0 con 0x7fad50070b40 2023-11-04T01:43:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.777+0000 7fad4cff9640 1 -- 172.21.15.2:0/989291676 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fad400ef170 con 0x7fad50070b40 2023-11-04T01:43:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad3c0664a0 msgr2=0x7fad3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad3c0664a0 0x7fad3c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fad501540d0 tx=0x7fad44008040 comp rx=0 tx=0).stop 2023-11-04T01:43:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50070b40 msgr2=0x7fad50139480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50070b40 0x7fad50139480 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fad400ae040 tx=0x7fad4001abe0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 shutdown_connections 2023-11-04T01:43:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad3c0664a0 0x7fad3c068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad50144840 0x7fad50155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fad500b54d0 0x7fad5015d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 --2- 172.21.15.2:0/989291676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fad50070b40 0x7fad50139480 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 >> 172.21.15.2:0/989291676 conn(0x7fad500cfc70 msgr2=0x7fad5015aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 shutdown_connections 2023-11-04T01:43:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.781+0000 7fad5685a640 1 -- 172.21.15.2:0/989291676 wait complete. 2023-11-04T01:43:30.808 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:43:30.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:43:30.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe8a5413640 1 Processor -- start 2023-11-04T01:43:30.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe8a5413640 1 -- start start 2023-11-04T01:43:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe8a5413640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe8a00b0c20 0x7fe8a015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe8a5413640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8a015c160 0x7fe8a00ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe8a5413640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a00cb130 con 0x7fe8a015acb0 2023-11-04T01:43:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe8a5413640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a015bd40 con 0x7fe8a015c160 2023-11-04T01:43:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe8a5413640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a006fd80 con 0x7fe8a00b0c20 2023-11-04T01:43:30.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8a015c160 0x7fe8a00ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8a015c160 0x7fe8a00ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50422/0 (socket says 172.21.15.2:50422) 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89f7fe640 1 -- 172.21.15.2:0/1221556177 learned_addr learned my addr 172.21.15.2:0/1221556177 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe8a015acb0 0x7fe8a00b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58974/0 (socket says 172.21.15.2:58974) 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89e7fc640 1 --2- 172.21.15.2:0/1221556177 >> v2:172.21.15.90:3300/0 conn(0x7fe8a00b0c20 0x7fe8a015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89f7fe640 1 -- 172.21.15.2:0/1221556177 >> v2:172.21.15.90:3300/0 conn(0x7fe8a00b0c20 msgr2=0x7fe8a015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89f7fe640 1 --2- 172.21.15.2:0/1221556177 >> v2:172.21.15.90:3300/0 conn(0x7fe8a00b0c20 0x7fe8a015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89f7fe640 1 -- 172.21.15.2:0/1221556177 >> v1:172.21.15.2:6789/0 conn(0x7fe8a015acb0 legacy=0x7fe8a00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.937+0000 7fe89f7fe640 1 -- 172.21.15.2:0/1221556177 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a015b680 con 0x7fe8a015c160 2023-11-04T01:43:30.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89f7fe640 1 --2- 172.21.15.2:0/1221556177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015c160 0x7fe8a00ca490 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00ce4b0 tx=0x7fe89801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7286c7c1932f8027 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89dffb640 1 -- 172.21.15.2:0/1221556177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8980a5880 con 0x7fe8a015c160 2023-11-04T01:43:30.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89dffb640 1 -- 172.21.15.2:0/1221556177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8980a59e0 con 0x7fe8a015c160 2023-11-04T01:43:30.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89dffb640 1 -- 172.21.15.2:0/1221556177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8980a5d70 con 0x7fe8a015c160 2023-11-04T01:43:30.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- 172.21.15.2:0/1221556177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015c160 msgr2=0x7fe8a00ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1221556177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015c160 0x7fe8a00ca490 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00ce4b0 tx=0x7fe89801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- 172.21.15.2:0/1221556177 shutdown_connections 2023-11-04T01:43:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1221556177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015c160 0x7fe8a00ca490 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1221556177 >> v2:172.21.15.90:3300/0 conn(0x7fe8a00b0c20 0x7fe8a015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- 172.21.15.2:0/1221556177 >> 172.21.15.2:0/1221556177 conn(0x7fe8a00cb510 msgr2=0x7fe8a00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- 172.21.15.2:0/1221556177 shutdown_connections 2023-11-04T01:43:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- 172.21.15.2:0/1221556177 wait complete. 2023-11-04T01:43:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 Processor -- start 2023-11-04T01:43:30.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- start start 2023-11-04T01:43:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8a00b0c20 0x7fe8a00af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015acb0 0x7fe8a0151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a015c160 0x7fe8a01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a006c660 con 0x7fe8a015acb0 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00acd90 con 0x7fe8a015c160 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe8a5413640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00acfe0 con 0x7fe8a00b0c20 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015acb0 0x7fe8a0151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015acb0 0x7fe8a0151140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50438/0 (socket says 172.21.15.2:50438) 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 -- 172.21.15.2:0/1982967998 learned_addr learned my addr 172.21.15.2:0/1982967998 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89f7fe640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a015c160 0x7fe8a01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89effd640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8a00b0c20 0x7fe8a00af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 -- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8a00b0c20 msgr2=0x7fe8a00af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8a00b0c20 0x7fe8a00af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 -- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a015c160 msgr2=0x7fe8a01562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a015c160 0x7fe8a01562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89e7fc640 1 -- 172.21.15.2:0/1982967998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009b30 con 0x7fe8a015acb0 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.941+0000 7fe89effd640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8a00b0c20 0x7fe8a00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe89e7fc640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015acb0 0x7fe8a0151140 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe89400d800 tx=0x7fe89400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8877fe640 1 -- 172.21.15.2:0/1982967998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400b6c0 con 0x7fe8a015acb0 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8877fe640 1 -- 172.21.15.2:0/1982967998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400b820 con 0x7fe8a015acb0 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a00ad2c0 con 0x7fe8a015acb0 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8877fe640 1 -- 172.21.15.2:0/1982967998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400bb90 con 0x7fe8a015acb0 2023-11-04T01:43:30.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a00af130 con 0x7fe8a015acb0 2023-11-04T01:43:30.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a00744a0 con 0x7fe8a015acb0 2023-11-04T01:43:30.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8877fe640 1 -- 172.21.15.2:0/1982967998 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe89400bcf0 con 0x7fe8a015acb0 2023-11-04T01:43:30.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8877fe640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe88c0664a0 0x7fe88c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:30.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe8877fe640 1 -- 172.21.15.2:0/1982967998 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8940843b0 con 0x7fe8a015acb0 2023-11-04T01:43:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe89effd640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe88c0664a0 0x7fe88c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:30.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.945+0000 7fe89effd640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe88c0664a0 0x7fe88c068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe890000f70 tx=0x7fe890009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:30.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:30.949+0000 7fe8877fe640 1 -- 172.21.15.2:0/1982967998 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe894051820 con 0x7fe8a015acb0 2023-11-04T01:43:31.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.141+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe8a00cde30 con 0x7fe8a015acb0 2023-11-04T01:43:31.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.785+0000 7fe8877fe640 1 -- 172.21.15.2:0/1982967998 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe894054e40 con 0x7fe8a015acb0 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe88c0664a0 msgr2=0x7fe88c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe88c0664a0 0x7fe88c068960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe890000f70 tx=0x7fe890009040 comp rx=0 tx=0).stop 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015acb0 msgr2=0x7fe8a0151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015acb0 0x7fe8a0151140 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe89400d800 tx=0x7fe89400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 shutdown_connections 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe88c0664a0 0x7fe88c068960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8a015c160 0x7fe8a01562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8a015acb0 0x7fe8a0151140 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 --2- 172.21.15.2:0/1982967998 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8a00b0c20 0x7fe8a00af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 >> 172.21.15.2:0/1982967998 conn(0x7fe8a00cb510 msgr2=0x7fe8a00c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 shutdown_connections 2023-11-04T01:43:31.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.789+0000 7fe8a5413640 1 -- 172.21.15.2:0/1982967998 wait complete. 2023-11-04T01:43:31.815 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:43:31.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:31.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f77613e7640 1 Processor -- start 2023-11-04T01:43:31.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f77613e7640 1 -- start start 2023-11-04T01:43:31.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f77613e7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f775c0715d0 0x7f775c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f77613e7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c0b0b70 0x7f775c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f77613e7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0c2670 con 0x7f775c15afd0 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f77613e7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775c070140 con 0x7f775c0715d0 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f77613e7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c071a60 con 0x7f775c0b0b70 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f775c0715d0 0x7f775c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f775c0715d0 0x7f775c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45804/0 (socket says 172.21.15.2:45804) 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 -- 172.21.15.2:0/1968610357 learned_addr learned my addr 172.21.15.2:0/1968610357 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 -- 172.21.15.2:0/1968610357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c0b0b70 msgr2=0x7f775c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 --2- 172.21.15.2:0/1968610357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c0b0b70 0x7f775c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 -- 172.21.15.2:0/1968610357 >> v1:172.21.15.90:6789/0 conn(0x7f775c15afd0 legacy=0x7f775c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:31.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 -- 172.21.15.2:0/1968610357 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c06bc30 con 0x7f775c0715d0 2023-11-04T01:43:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.937+0000 7f775a7fc640 1 --2- 172.21.15.2:0/1968610357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c0b0630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f774c009e50 tx=0x7f774c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1182c852fc50b49b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f7759ffb640 1 -- 172.21.15.2:0/1968610357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c0a5650 con 0x7f775c0715d0 2023-11-04T01:43:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f7759ffb640 1 -- 172.21.15.2:0/1968610357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c0a57b0 con 0x7f775c0715d0 2023-11-04T01:43:31.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f7759ffb640 1 -- 172.21.15.2:0/1968610357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c0a5b40 con 0x7f775c0715d0 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- 172.21.15.2:0/1968610357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 msgr2=0x7f775c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 --2- 172.21.15.2:0/1968610357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c0b0630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f774c009e50 tx=0x7f774c01c9d0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- 172.21.15.2:0/1968610357 shutdown_connections 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 --2- 172.21.15.2:0/1968610357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c0b0b70 0x7f775c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 --2- 172.21.15.2:0/1968610357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c0b0630 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- 172.21.15.2:0/1968610357 >> 172.21.15.2:0/1968610357 conn(0x7f775c0cebb0 msgr2=0x7f775c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- 172.21.15.2:0/1968610357 shutdown_connections 2023-11-04T01:43:31.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- 172.21.15.2:0/1968610357 wait complete. 2023-11-04T01:43:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 Processor -- start 2023-11-04T01:43:31.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- start start 2023-11-04T01:43:31.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f775c0b0b70 0x7f775c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c15afd0 0x7f775c150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c14e020 con 0x7f775c0715d0 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c14e2a0 con 0x7f775c0b0b70 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f77613e7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c14e580 con 0x7f775c15afd0 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f775affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f775affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c14d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45814/0 (socket says 172.21.15.2:45814) 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.941+0000 7f775affd640 1 -- 172.21.15.2:0/1119721952 learned_addr learned my addr 172.21.15.2:0/1119721952 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775a7fc640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f775c0b0b70 0x7f775c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775b7fe640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c15afd0 0x7f775c150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775affd640 1 -- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c15afd0 msgr2=0x7f775c150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775affd640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c15afd0 0x7f775c150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775affd640 1 -- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f775c0b0b70 msgr2=0x7f775c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775affd640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f775c0b0b70 0x7f775c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775affd640 1 -- 172.21.15.2:0/1119721952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c009b30 con 0x7f775c0715d0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775a7fc640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f775c0b0b70 0x7f775c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775affd640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c14d570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f774400c450 tx=0x7f774400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77537fe640 1 -- 172.21.15.2:0/1119721952 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744012830 con 0x7f775c0715d0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77537fe640 1 -- 172.21.15.2:0/1119721952 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440129b0 con 0x7f775c0715d0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77537fe640 1 -- 172.21.15.2:0/1119721952 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744012d60 con 0x7f775c0715d0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c14e860 con 0x7f775c0715d0 2023-11-04T01:43:31.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c14f020 con 0x7f775c0715d0 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c158da0 con 0x7f775c0715d0 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77537fe640 1 -- 172.21.15.2:0/1119721952 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f774401c460 con 0x7f775c0715d0 2023-11-04T01:43:31.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77537fe640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f773c0664a0 0x7f773c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f77537fe640 1 -- 172.21.15.2:0/1119721952 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7744083ce0 con 0x7f775c0715d0 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.945+0000 7f775a7fc640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f773c0664a0 0x7f773c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:31.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.949+0000 7f775a7fc640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f773c0664a0 0x7f773c068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f774c0ae000 tx=0x7f774c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:31.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:31.949+0000 7f77537fe640 1 -- 172.21.15.2:0/1119721952 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77440511f0 con 0x7f775c0715d0 2023-11-04T01:43:32.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.141+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f775c0744a0 con 0x7f775c0715d0 2023-11-04T01:43:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.141+0000 7f77537fe640 1 -- 172.21.15.2:0/1119721952 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4897 (secure 0 0 0) 0x7f7744054810 con 0x7f775c0715d0 2023-11-04T01:43:32.147 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:32.147 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/926400153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":926400153},{"type":"v1","addr":"172.21.15.90:6837","nonce":926400153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/1780832630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1780832630},{"type":"v1","addr":"172.21.15.90:6836","nonce":1780832630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/763530639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":763530639},{"type":"v1","addr":"172.21.15.2:6834","nonce":763530639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:28.120677+0000","modified":"2023-11-04T01:43:31.147336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/610836033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":610836033},{"type":"v1","addr":"172.21.15.2:6835","nonce":610836033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:43:32.147 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 14 2023-11-04T01:43:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f773c0664a0 msgr2=0x7f773c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f773c0664a0 0x7f773c068960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f774c0ae000 tx=0x7f774c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:43:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 msgr2=0x7f775c14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c14d570 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f774400c450 tx=0x7f774400c910 comp rx=0 tx=0).stop 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 shutdown_connections 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f773c0664a0 0x7f773c068960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f775c15afd0 0x7f775c150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f775c0b0b70 0x7f775c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 --2- 172.21.15.2:0/1119721952 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f775c0715d0 0x7f775c14d570 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 >> 172.21.15.2:0/1119721952 conn(0x7f775c0cebb0 msgr2=0x7f775c0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 shutdown_connections 2023-11-04T01:43:32.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.145+0000 7f77613e7640 1 -- 172.21.15.2:0/1119721952 wait complete. 2023-11-04T01:43:32.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:32.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f139dd640 1 Processor -- start 2023-11-04T01:43:32.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f139dd640 1 -- start start 2023-11-04T01:43:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f139dd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 0x7f9f0c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f139dd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9f0c0b0b70 0x7f9f0c15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f139dd640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c06c740 con 0x7f9f0c15b290 2023-11-04T01:43:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f139dd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b1000 con 0x7f9f0c0b0b70 2023-11-04T01:43:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f139dd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c15b670 con 0x7f9f0c0c2670 2023-11-04T01:43:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11779640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9f0c15b290 0x7f9f0c06f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52578/0 (socket says 172.21.15.2:52578) 2023-11-04T01:43:32.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11779640 1 -- 172.21.15.2:0/304508833 learned_addr learned my addr 172.21.15.2:0/304508833 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f10f78640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 0x7f9f0c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11f7a640 1 --2- 172.21.15.2:0/304508833 >> v2:172.21.15.90:3300/0 conn(0x7f9f0c0b0b70 0x7f9f0c15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319335807 0 0) 0x7f9f0c06c740 con 0x7f9f0c15b290 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef8003530 con 0x7f9f0c15b290 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2932513022 0 0) 0x7f9ef8003530 con 0x7f9f0c15b290 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 msgr2=0x7f9f0c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 0x7f9f0c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 >> v2:172.21.15.90:3300/0 conn(0x7f9f0c0b0b70 msgr2=0x7f9f0c15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 --2- 172.21.15.2:0/304508833 >> v2:172.21.15.90:3300/0 conn(0x7f9f0c0b0b70 0x7f9f0c15eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c06bb30 con 0x7f9f0c15b290 2023-11-04T01:43:32.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f9f08001680 con 0x7f9f0c15b290 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 >> v1:172.21.15.2:6789/0 conn(0x7f9f0c15b290 legacy=0x7f9f0c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 0x7f9ef8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef8003f00 0x7f9ef80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9ef8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b1000 con 0x7f9ef8004d10 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c15b670 con 0x7f9ef8003f00 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef800b9e0 con 0x7f9f0c0c2670 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11f7a640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9ef8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11779640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 0x7f9ef8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f10f78640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef8003f00 0x7f9ef80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11f7a640 1 -- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 msgr2=0x7f9ef8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11f7a640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c0c2670 0x7f9ef8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11f7a640 1 -- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef8003f00 msgr2=0x7f9ef80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11f7a640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef8003f00 0x7f9ef80047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.289+0000 7f9f11f7a640 1 -- 172.21.15.2:0/304508833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8003530 con 0x7f9ef8004d10 2023-11-04T01:43:32.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f11f7a640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9ef8005190 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400e170 tx=0x7f9f0401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d838c96b93d76 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040a5c90 con 0x7f9ef8004d10 2023-11-04T01:43:32.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0400f040 con 0x7f9ef8004d10 2023-11-04T01:43:32.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f03fff640 1 -- 172.21.15.2:0/304508833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040ad440 con 0x7f9ef8004d10 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- 172.21.15.2:0/304508833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 msgr2=0x7f9ef8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 --2- 172.21.15.2:0/304508833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9ef8005190 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400e170 tx=0x7f9f0401cc80 comp rx=0 tx=0).stop 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f11f7a640 1 -- 172.21.15.2:0/304508833 reap_dead start 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- 172.21.15.2:0/304508833 shutdown_connections 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- 172.21.15.2:0/304508833 >> 172.21.15.2:0/304508833 conn(0x7f9f0c0cebb0 msgr2=0x7f9f0c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- 172.21.15.2:0/304508833 shutdown_connections 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- 172.21.15.2:0/304508833 wait complete. 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 Processor -- start 2023-11-04T01:43:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- start start 2023-11-04T01:43:32.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9f0c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c156f60 0x7f9f0c152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c0b3e80 0x7f9f0c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b4850 con 0x7f9ef8004d10 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c153c70 con 0x7f9f0c0b3e80 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.293+0000 7f9f139dd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c156540 con 0x7f9f0c156f60 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9f0c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9f0c156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45840/0 (socket says 172.21.15.2:45840) 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 -- 172.21.15.2:0/1715924281 learned_addr learned my addr 172.21.15.2:0/1715924281 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f10f78640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c156f60 0x7f9f0c152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11f7a640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c0b3e80 0x7f9f0c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 -- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c156f60 msgr2=0x7f9f0c152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c156f60 0x7f9f0c152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 -- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c0b3e80 msgr2=0x7f9f0c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c0b3e80 0x7f9f0c0b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 -- 172.21.15.2:0/1715924281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c153060 con 0x7f9ef8004d10 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11f7a640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c0b3e80 0x7f9f0c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f11779640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9f0c156000 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9f08012510 tx=0x7f9f080129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f01ffb640 1 -- 172.21.15.2:0/1715924281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08014810 con 0x7f9ef8004d10 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f01ffb640 1 -- 172.21.15.2:0/1715924281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08014970 con 0x7f9ef8004d10 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c153340 con 0x7f9ef8004d10 2023-11-04T01:43:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f01ffb640 1 -- 172.21.15.2:0/1715924281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f08014d20 con 0x7f9ef8004d10 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c153900 con 0x7f9ef8004d10 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c0744a0 con 0x7f9ef8004d10 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f01ffb640 1 -- 172.21.15.2:0/1715924281 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f080153e0 con 0x7f9ef8004d10 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f01ffb640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9ef00664a0 0x7f9ef0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f01ffb640 1 -- 172.21.15.2:0/1715924281 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f08086cc0 con 0x7f9ef8004d10 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f10f78640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9ef00664a0 0x7f9ef0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.297+0000 7f9f10f78640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9ef00664a0 0x7f9ef0068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0c2a90 tx=0x7f9efc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.301+0000 7f9f01ffb640 1 -- 172.21.15.2:0/1715924281 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f0808d080 con 0x7f9ef8004d10 2023-11-04T01:43:32.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.457+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f0c0c2430 con 0x7f9ef8004d10 2023-11-04T01:43:32.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.457+0000 7f9f01ffb640 1 -- 172.21.15.2:0/1715924281 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16401 (secure 0 0 0) 0x7f9f0801c090 con 0x7f9ef8004d10 2023-11-04T01:43:32.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:32.463 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:29.789436+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:26.399544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:27.128100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9ef00664a0 msgr2=0x7f9ef0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9ef00664a0 0x7f9ef0068960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c0c2a90 tx=0x7f9efc008040 comp rx=0 tx=0).stop 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 msgr2=0x7f9f0c156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9f0c156000 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9f08012510 tx=0x7f9f080129d0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 shutdown_connections 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9ef00664a0 0x7f9ef0068960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f0c0b3e80 0x7f9f0c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f0c156f60 0x7f9f0c152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 --2- 172.21.15.2:0/1715924281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ef8004d10 0x7f9f0c156000 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 >> 172.21.15.2:0/1715924281 conn(0x7f9f0c0cebb0 msgr2=0x7f9f0c15e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 shutdown_connections 2023-11-04T01:43:32.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.461+0000 7f9f139dd640 1 -- 172.21.15.2:0/1715924281 wait complete. 2023-11-04T01:43:32.481 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:43:32.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:32.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.601+0000 7f3938288640 1 Processor -- start 2023-11-04T01:43:32.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.601+0000 7f3938288640 1 -- start start 2023-11-04T01:43:32.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3938288640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300ccac0 0x7f39300d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3938288640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f39300cdd20 0x7f39301617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3938288640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393006ccf0 con 0x7f39300ccea0 2023-11-04T01:43:32.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3938288640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3930161d30 con 0x7f39300cdd20 2023-11-04T01:43:32.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3938288640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393006d220 con 0x7f39300ccac0 2023-11-04T01:43:32.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936825640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f39300cdd20 0x7f39301617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300ccac0 0x7f39300d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300ccac0 0x7f39300d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:38924/0 (socket says 172.21.15.2:38924) 2023-11-04T01:43:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 -- 172.21.15.2:0/830712899 learned_addr learned my addr 172.21.15.2:0/830712899 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 -- 172.21.15.2:0/830712899 >> v2:172.21.15.90:3300/0 conn(0x7f39300cdd20 msgr2=0x7f39301617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 --2- 172.21.15.2:0/830712899 >> v2:172.21.15.90:3300/0 conn(0x7f39300cdd20 0x7f39301617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 -- 172.21.15.2:0/830712899 >> v1:172.21.15.90:6789/0 conn(0x7f39300ccea0 legacy=0x7f39300cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 -- 172.21.15.2:0/830712899 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393006c630 con 0x7f39300ccac0 2023-11-04T01:43:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3936024640 1 --2- 172.21.15.2:0/830712899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300ccac0 0x7f39300d06a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f392c009870 tx=0x7f392c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc96ec825eb611c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3935022640 1 -- 172.21.15.2:0/830712899 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0aa670 con 0x7f39300ccac0 2023-11-04T01:43:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.605+0000 7f3935022640 1 -- 172.21.15.2:0/830712899 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0aa7d0 con 0x7f39300ccac0 2023-11-04T01:43:32.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3935022640 1 -- 172.21.15.2:0/830712899 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0aab60 con 0x7f39300ccac0 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- 172.21.15.2:0/830712899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300ccac0 msgr2=0x7f39300d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 --2- 172.21.15.2:0/830712899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300ccac0 0x7f39300d06a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f392c009870 tx=0x7f392c01c510 comp rx=0 tx=0).stop 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- 172.21.15.2:0/830712899 shutdown_connections 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 --2- 172.21.15.2:0/830712899 >> v2:172.21.15.90:3300/0 conn(0x7f39300cdd20 0x7f39301617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 --2- 172.21.15.2:0/830712899 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300ccac0 0x7f39300d06a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- 172.21.15.2:0/830712899 >> 172.21.15.2:0/830712899 conn(0x7f3930065dc0 msgr2=0x7f39300661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- 172.21.15.2:0/830712899 shutdown_connections 2023-11-04T01:43:32.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- 172.21.15.2:0/830712899 wait complete. 2023-11-04T01:43:32.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 Processor -- start 2023-11-04T01:43:32.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- start start 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39300ccac0 0x7f393015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39300ccea0 0x7f3930159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300cdd20 0x7f39300b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393015f2d0 con 0x7f39300ccac0 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393015dcf0 con 0x7f39300ccea0 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393015dfd0 con 0x7f39300cdd20 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39300ccac0 0x7f393015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39300ccac0 0x7f393015ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45856/0 (socket says 172.21.15.2:45856) 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 -- 172.21.15.2:0/406420848 learned_addr learned my addr 172.21.15.2:0/406420848 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936825640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300cdd20 0x7f39300b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3935823640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39300ccea0 0x7f3930159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 -- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300cdd20 msgr2=0x7f39300b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300cdd20 0x7f39300b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 -- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39300ccea0 msgr2=0x7f3930159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39300ccea0 0x7f3930159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 -- 172.21.15.2:0/406420848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0094d0 con 0x7f39300ccac0 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3935823640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39300ccea0 0x7f3930159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3936024640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39300ccac0 0x7f393015ed90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f392c0ac040 tx=0x7f392c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3922ffd640 1 -- 172.21.15.2:0/406420848 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0b3800 con 0x7f39300ccac0 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3922ffd640 1 -- 172.21.15.2:0/406420848 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0b3960 con 0x7f39300ccac0 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393015e2b0 con 0x7f39300ccac0 2023-11-04T01:43:32.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3922ffd640 1 -- 172.21.15.2:0/406420848 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0b3d10 con 0x7f39300ccac0 2023-11-04T01:43:32.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.609+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393015e870 con 0x7f39300ccac0 2023-11-04T01:43:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.613+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393015ea60 con 0x7f39300ccac0 2023-11-04T01:43:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.613+0000 7f3922ffd640 1 -- 172.21.15.2:0/406420848 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f392c0b2380 con 0x7f39300ccac0 2023-11-04T01:43:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.613+0000 7f3922ffd640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664a0 0x7f3914068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.613+0000 7f3922ffd640 1 -- 172.21.15.2:0/406420848 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f392c11e750 con 0x7f39300ccac0 2023-11-04T01:43:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.613+0000 7f3935823640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664a0 0x7f3914068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.613+0000 7f3935823640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664a0 0x7f3914068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39300cf240 tx=0x7f3924009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.617+0000 7f3922ffd640 1 -- 172.21.15.2:0/406420848 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f392c0ebc90 con 0x7f39300ccac0 2023-11-04T01:43:32.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.769+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39300ced70 con 0x7f39140664a0 2023-11-04T01:43:32.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.793+0000 7f3922ffd640 1 -- 172.21.15.2:0/406420848 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272902 (secure 0 0 0) 0x7f3924001cc0 con 0x7f39140664a0 2023-11-04T01:43:32.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:32.801 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:43:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664a0 msgr2=0x7f3914068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664a0 0x7f3914068960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f39300cf240 tx=0x7f3924009040 comp rx=0 tx=0).stop 2023-11-04T01:43:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39300ccac0 msgr2=0x7f393015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39300ccac0 0x7f393015ed90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f392c0ac040 tx=0x7f392c01ad50 comp rx=0 tx=0).stop 2023-11-04T01:43:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 shutdown_connections 2023-11-04T01:43:32.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664a0 0x7f3914068960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39300cdd20 0x7f39300b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39300ccea0 0x7f3930159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 --2- 172.21.15.2:0/406420848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39300ccac0 0x7f393015ed90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 >> 172.21.15.2:0/406420848 conn(0x7f3930065dc0 msgr2=0x7f39300b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 shutdown_connections 2023-11-04T01:43:32.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.797+0000 7f3938288640 1 -- 172.21.15.2:0/406420848 wait complete. 2023-11-04T01:43:32.819 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-11-04T01:43:30.783461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":6,"acting":6,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236592,"kb_used_data":3720,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738128,"statfs":{"total":773094113280,"available":772851843072,"internally_reserved":0,"allocated":3809280,"data_stored":2165344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.037319"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-04T01:43:26.750438+0000","last_change":"2023-11-04T01:43:26.750438+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.750438+0000","last_undegraded":"2023-11-04T01:43:26.750438+0000","last_fullsized":"2023-11-04T01:43:26.750438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2023-11-04T01:43:26.753777+0000","last_change":"2023-11-04T01:43:26.753777+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.753777+0000","last_undegraded":"2023-11-04T01:43:26.753777+0000","last_fullsized":"2023-11-04T01:43:26.753777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:27.745779+0000","last_change":"2023-11-04T01:43:27.745779+0000","last_active":"2023-11-04T01:43:27.745779+0000","last_peered":"2023-11-04T01:43:27.745779+0000","last_clean":"2023-11-04T01:43:27.745779+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:27.745779+0000","last_undegraded":"2023-11-04T01:43:27.745779+0000","last_fullsized":"2023-11-04T01:43:27.745779+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:26.741087+0000","last_change":"2023-11-04T01:43:26.741087+0000","last_active":"2023-11-04T01:43:26.741087+0000","last_peered":"2023-11-04T01:43:26.741087+0000","last_clean":"2023-11-04T01:43:26.741087+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:26.741087+0000","last_undegraded":"2023-11-04T01:43:26.741087+0000","last_fullsized":"2023-11-04T01:43:26.741087+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-04T01:43:22.566454+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:43:22.566454+0000","last_peered":"2023-11-04T01:43:22.566454+0000","last_clean":"2023-11-04T01:43:22.566454+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:43:22.566454+0000","last_undegraded":"2023-11-04T01:43:22.566454+0000","last_fullsized":"2023-11-04T01:43:22.566454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":713444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.45700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.56399999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.65300000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.67100000000000004},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.502},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.63900000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":327680,"data_stored":123076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.92400000000000004}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":1.129}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":1.097}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.2609999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.222},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.075}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.345},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.3069999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.385},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.179}]}]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.89500000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.0149999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.1150000000000002,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":0.98599999999999999},{"interface":"front","average":{"1min":2.786,"5min":2.786,"15min":2.786},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":40.195,"5min":40.195,"15min":40.195},"last":1.046}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.097},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.0740000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":123076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.282},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.093}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.127}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.878}]},{"osd":3,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.3100000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.97399999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.1759999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2390000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":713444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.1160000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.2969999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.194}]},{"osd":3,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.248}]},{"osd":4,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.343},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.367},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.399}]},{"osd":7,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.429}]}]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":123076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":1.145},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.107}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.88200000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.83799999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.998},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.0660000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.25},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.3160000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.349}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":123076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.91700000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.0089999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.1719999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.96099999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.127},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.3480000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.081},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2569999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.3180000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31508,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":327680,"data_stored":123076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.71899999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.49099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.137}]},{"osd":5,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.097}]},{"osd":7,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.016},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.0509999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:32.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:43:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa697a04640 1 Processor -- start 2023-11-04T01:43:32.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa697a04640 1 -- start start 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa697a04640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa69015afd0 0x7fa6900715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa697a04640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6900c2670 con 0x7fa69006f8f0 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa697a04640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69006bc30 con 0x7fa6900b0d40 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa697a04640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa690070140 con 0x7fa69015afd0 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa69006f8f0 0x7fa6900b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52580/0 (socket says 172.21.15.2:52580) 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 -- 172.21.15.2:0/1438327664 learned_addr learned my addr 172.21.15.2:0/1438327664 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa6957a0640 1 --2- 172.21.15.2:0/1438327664 >> v2:172.21.15.90:3300/0 conn(0x7fa69015afd0 0x7fa6900715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947186317 0 0) 0x7fa6900c2670 con 0x7fa69006f8f0 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa678003530 con 0x7fa69006f8f0 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2847512981 0 0) 0x7fa678003530 con 0x7fa69006f8f0 2023-11-04T01:43:32.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 >> v2:172.21.15.90:3300/0 conn(0x7fa69015afd0 msgr2=0x7fa6900715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 --2- 172.21.15.2:0/1438327664 >> v2:172.21.15.90:3300/0 conn(0x7fa69015afd0 0x7fa6900715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 >> v1:172.21.15.90:6789/0 conn(0x7fa6900b0d40 legacy=0x7fa69015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69006bf10 con 0x7fa69006f8f0 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa684001a00 con 0x7fa69006f8f0 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 >> v1:172.21.15.2:6789/0 conn(0x7fa69006f8f0 legacy=0x7fa6900b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6780039d0 0x7fa678003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6780047d0 0x7fa678004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa678005190 0x7fa67800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa690070140 con 0x7fa6780047d0 2023-11-04T01:43:32.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67800c090 con 0x7fa678005190 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67800c250 con 0x7fa6780039d0 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6780047d0 0x7fa678004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa6957a0640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6780039d0 0x7fa678003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa695fa1640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa678005190 0x7fa67800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 -- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6780039d0 msgr2=0x7fa678003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6780039d0 0x7fa678003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 -- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa678005190 msgr2=0x7fa67800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa678005190 0x7fa67800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa694f9f640 1 -- 172.21.15.2:0/1438327664 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678003530 con 0x7fa6780047d0 2023-11-04T01:43:32.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa695fa1640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa678005190 0x7fa67800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:32.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.985+0000 7fa695fa1640 1 -- 172.21.15.2:0/1438327664 reap_dead start 2023-11-04T01:43:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa694f9f640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6780047d0 0x7fa678004c50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa68400a810 tx=0x7fa68401fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1bc956d6137f8d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6840aa620 con 0x7fa6780047d0 2023-11-04T01:43:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6840aa780 con 0x7fa6780047d0 2023-11-04T01:43:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa68ffff640 1 -- 172.21.15.2:0/1438327664 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6840aab70 con 0x7fa6780047d0 2023-11-04T01:43:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa697a04640 1 -- 172.21.15.2:0/1438327664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6780047d0 msgr2=0x7fa678004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa697a04640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6780047d0 0x7fa678004c50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa68400a810 tx=0x7fa68401fa80 comp rx=0 tx=0).stop 2023-11-04T01:43:32.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa697a04640 1 -- 172.21.15.2:0/1438327664 shutdown_connections 2023-11-04T01:43:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa697a04640 1 --2- 172.21.15.2:0/1438327664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6780047d0 0x7fa678004c50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa697a04640 1 -- 172.21.15.2:0/1438327664 >> 172.21.15.2:0/1438327664 conn(0x7fa6900cebb0 msgr2=0x7fa6900cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa697a04640 1 -- 172.21.15.2:0/1438327664 shutdown_connections 2023-11-04T01:43:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.989+0000 7fa697a04640 1 -- 172.21.15.2:0/1438327664 wait complete. 2023-11-04T01:43:32.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 Processor -- start 2023-11-04T01:43:32.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 -- start start 2023-11-04T01:43:32.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6780047d0 0x7fa6900b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa690159500 0x7fa6901f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6900c8830 0x7fa6901f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69015c400 con 0x7fa690159500 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900b3ed0 con 0x7fa6780047d0 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900b41b0 con 0x7fa6900c8830 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa690159500 0x7fa6901f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa690159500 0x7fa6901f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45880/0 (socket says 172.21.15.2:45880) 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 -- 172.21.15.2:0/3580050563 learned_addr learned my addr 172.21.15.2:0/3580050563 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa6957a0640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6780047d0 0x7fa6900b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:32.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa695fa1640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6900c8830 0x7fa6901f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 -- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6900c8830 msgr2=0x7fa6901f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6900c8830 0x7fa6901f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 -- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6780047d0 msgr2=0x7fa6900b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6780047d0 0x7fa6900b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 -- 172.21.15.2:0/3580050563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6900b4490 con 0x7fa690159500 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa694f9f640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa690159500 0x7fa6901f3fd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa68401fac0 tx=0x7fa68401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa68dffb640 1 -- 172.21.15.2:0/3580050563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6840aa620 con 0x7fa690159500 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa68dffb640 1 -- 172.21.15.2:0/3580050563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684001800 con 0x7fa690159500 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa68dffb640 1 -- 172.21.15.2:0/3580050563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6840bc630 con 0x7fa690159500 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6900b4770 con 0x7fa690159500 2023-11-04T01:43:33.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.993+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6900b3c50 con 0x7fa690159500 2023-11-04T01:43:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.997+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6900744a0 con 0x7fa690159500 2023-11-04T01:43:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.997+0000 7fa68dffb640 1 -- 172.21.15.2:0/3580050563 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa6840ab400 con 0x7fa690159500 2023-11-04T01:43:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.997+0000 7fa68dffb640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa67c0664a0 0x7fa67c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.997+0000 7fa68dffb640 1 -- 172.21.15.2:0/3580050563 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa684121a20 con 0x7fa690159500 2023-11-04T01:43:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.997+0000 7fa6957a0640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa67c0664a0 0x7fa67c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:32.997+0000 7fa6957a0640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa67c0664a0 0x7fa67c068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa690159d00 tx=0x7fa688008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.001+0000 7fa68dffb640 1 -- 172.21.15.2:0/3580050563 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa6840eef30 con 0x7fa690159500 2023-11-04T01:43:33.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.149+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6900c4ab0 con 0x7fa67c0664a0 2023-11-04T01:43:33.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.173+0000 7fa68dffb640 1 -- 172.21.15.2:0/3580050563 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287276 (secure 0 0 0) 0x7fa6900c4ab0 con 0x7fa67c0664a0 2023-11-04T01:43:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:33.182 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa67c0664a0 msgr2=0x7fa67c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa67c0664a0 0x7fa67c068960 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa690159d00 tx=0x7fa688008040 comp rx=0 tx=0).stop 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa690159500 msgr2=0x7fa6901f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa690159500 0x7fa6901f3fd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa68401fac0 tx=0x7fa68401c820 comp rx=0 tx=0).stop 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 shutdown_connections 2023-11-04T01:43:33.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa67c0664a0 0x7fa67c068960 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa6900c8830 0x7fa6901f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa690159500 0x7fa6901f3fd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 --2- 172.21.15.2:0/3580050563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6780047d0 0x7fa6900b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 >> 172.21.15.2:0/3580050563 conn(0x7fa6900cebb0 msgr2=0x7fa6900c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 shutdown_connections 2023-11-04T01:43:33.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.177+0000 7fa697a04640 1 -- 172.21.15.2:0/3580050563 wait complete. 2023-11-04T01:43:33.197 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-11-04T01:43:32.794457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236976,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737744,"statfs":{"total":773094113280,"available":772851449856,"internally_reserved":0,"allocated":4243456,"data_stored":2358900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.013908"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807487+0000","last_change":"2023-11-04T01:43:28.814308+0000","last_active":"2023-11-04T01:43:29.807487+0000","last_peered":"2023-11-04T01:43:29.807487+0000","last_clean":"2023-11-04T01:43:29.807487+0000","last_became_active":"2023-11-04T01:43:28.806961+0000","last_became_peered":"2023-11-04T01:43:28.806961+0000","last_unstale":"2023-11-04T01:43:29.807487+0000","last_undegraded":"2023-11-04T01:43:29.807487+0000","last_fullsized":"2023-11-04T01:43:29.807487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:25.081907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061288+0000","last_change":"2023-11-04T01:43:28.809876+0000","last_active":"2023-11-04T01:43:30.061288+0000","last_peered":"2023-11-04T01:43:30.061288+0000","last_clean":"2023-11-04T01:43:30.061288+0000","last_became_active":"2023-11-04T01:43:28.809193+0000","last_became_peered":"2023-11-04T01:43:28.809193+0000","last_unstale":"2023-11-04T01:43:30.061288+0000","last_undegraded":"2023-11-04T01:43:30.061288+0000","last_fullsized":"2023-11-04T01:43:30.061288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:56:55.069262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060631+0000","last_change":"2023-11-04T01:43:28.815258+0000","last_active":"2023-11-04T01:43:30.060631+0000","last_peered":"2023-11-04T01:43:30.060631+0000","last_clean":"2023-11-04T01:43:30.060631+0000","last_became_active":"2023-11-04T01:43:28.814972+0000","last_became_peered":"2023-11-04T01:43:28.814972+0000","last_unstale":"2023-11-04T01:43:30.060631+0000","last_undegraded":"2023-11-04T01:43:30.060631+0000","last_fullsized":"2023-11-04T01:43:30.060631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:52.594769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812962+0000","last_change":"2023-11-04T01:43:28.811924+0000","last_active":"2023-11-04T01:43:29.812962+0000","last_peered":"2023-11-04T01:43:29.812962+0000","last_clean":"2023-11-04T01:43:29.812962+0000","last_became_active":"2023-11-04T01:43:28.810401+0000","last_became_peered":"2023-11-04T01:43:28.810401+0000","last_unstale":"2023-11-04T01:43:29.812962+0000","last_undegraded":"2023-11-04T01:43:29.812962+0000","last_fullsized":"2023-11-04T01:43:29.812962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:02:57.318259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062050+0000","last_change":"2023-11-04T01:43:28.832647+0000","last_active":"2023-11-04T01:43:30.062050+0000","last_peered":"2023-11-04T01:43:30.062050+0000","last_clean":"2023-11-04T01:43:30.062050+0000","last_became_active":"2023-11-04T01:43:28.832081+0000","last_became_peered":"2023-11-04T01:43:28.832081+0000","last_unstale":"2023-11-04T01:43:30.062050+0000","last_undegraded":"2023-11-04T01:43:30.062050+0000","last_fullsized":"2023-11-04T01:43:30.062050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:32.863673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061899+0000","last_change":"2023-11-04T01:43:28.822285+0000","last_active":"2023-11-04T01:43:30.061899+0000","last_peered":"2023-11-04T01:43:30.061899+0000","last_clean":"2023-11-04T01:43:30.061899+0000","last_became_active":"2023-11-04T01:43:28.821639+0000","last_became_peered":"2023-11-04T01:43:28.821639+0000","last_unstale":"2023-11-04T01:43:30.061899+0000","last_undegraded":"2023-11-04T01:43:30.061899+0000","last_fullsized":"2023-11-04T01:43:30.061899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:55:23.163940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.806824+0000","last_change":"2023-11-04T01:43:28.808785+0000","last_active":"2023-11-04T01:43:29.806824+0000","last_peered":"2023-11-04T01:43:29.806824+0000","last_clean":"2023-11-04T01:43:29.806824+0000","last_became_active":"2023-11-04T01:43:28.807986+0000","last_became_peered":"2023-11-04T01:43:28.807986+0000","last_unstale":"2023-11-04T01:43:29.806824+0000","last_undegraded":"2023-11-04T01:43:29.806824+0000","last_fullsized":"2023-11-04T01:43:29.806824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:00.617371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807098+0000","last_change":"2023-11-04T01:43:28.832962+0000","last_active":"2023-11-04T01:43:29.807098+0000","last_peered":"2023-11-04T01:43:29.807098+0000","last_clean":"2023-11-04T01:43:29.807098+0000","last_became_active":"2023-11-04T01:43:28.832632+0000","last_became_peered":"2023-11-04T01:43:28.832632+0000","last_unstale":"2023-11-04T01:43:29.807098+0000","last_undegraded":"2023-11-04T01:43:29.807098+0000","last_fullsized":"2023-11-04T01:43:29.807098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:34:44.098565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060567+0000","last_change":"2023-11-04T01:43:28.826768+0000","last_active":"2023-11-04T01:43:30.060567+0000","last_peered":"2023-11-04T01:43:30.060567+0000","last_clean":"2023-11-04T01:43:30.060567+0000","last_became_active":"2023-11-04T01:43:28.826487+0000","last_became_peered":"2023-11-04T01:43:28.826487+0000","last_unstale":"2023-11-04T01:43:30.060567+0000","last_undegraded":"2023-11-04T01:43:30.060567+0000","last_fullsized":"2023-11-04T01:43:30.060567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:35.211157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813647+0000","last_change":"2023-11-04T01:43:28.800043+0000","last_active":"2023-11-04T01:43:29.813647+0000","last_peered":"2023-11-04T01:43:29.813647+0000","last_clean":"2023-11-04T01:43:29.813647+0000","last_became_active":"2023-11-04T01:43:28.799217+0000","last_became_peered":"2023-11-04T01:43:28.799217+0000","last_unstale":"2023-11-04T01:43:29.813647+0000","last_undegraded":"2023-11-04T01:43:29.813647+0000","last_fullsized":"2023-11-04T01:43:29.813647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:05.066586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041981+0000","last_change":"2023-11-04T01:43:28.826814+0000","last_active":"2023-11-04T01:43:30.041981+0000","last_peered":"2023-11-04T01:43:30.041981+0000","last_clean":"2023-11-04T01:43:30.041981+0000","last_became_active":"2023-11-04T01:43:28.826455+0000","last_became_peered":"2023-11-04T01:43:28.826455+0000","last_unstale":"2023-11-04T01:43:30.041981+0000","last_undegraded":"2023-11-04T01:43:30.041981+0000","last_fullsized":"2023-11-04T01:43:30.041981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:35.756089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060927+0000","last_change":"2023-11-04T01:43:28.837281+0000","last_active":"2023-11-04T01:43:30.060927+0000","last_peered":"2023-11-04T01:43:30.060927+0000","last_clean":"2023-11-04T01:43:30.060927+0000","last_became_active":"2023-11-04T01:43:28.836894+0000","last_became_peered":"2023-11-04T01:43:28.836894+0000","last_unstale":"2023-11-04T01:43:30.060927+0000","last_undegraded":"2023-11-04T01:43:30.060927+0000","last_fullsized":"2023-11-04T01:43:30.060927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:28.443933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.063164+0000","last_change":"2023-11-04T01:43:28.830788+0000","last_active":"2023-11-04T01:43:30.063164+0000","last_peered":"2023-11-04T01:43:30.063164+0000","last_clean":"2023-11-04T01:43:30.063164+0000","last_became_active":"2023-11-04T01:43:28.830246+0000","last_became_peered":"2023-11-04T01:43:28.830246+0000","last_unstale":"2023-11-04T01:43:30.063164+0000","last_undegraded":"2023-11-04T01:43:30.063164+0000","last_fullsized":"2023-11-04T01:43:30.063164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:04.860708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812467+0000","last_change":"2023-11-04T01:43:28.802479+0000","last_active":"2023-11-04T01:43:29.812467+0000","last_peered":"2023-11-04T01:43:29.812467+0000","last_clean":"2023-11-04T01:43:29.812467+0000","last_became_active":"2023-11-04T01:43:28.801664+0000","last_became_peered":"2023-11-04T01:43:28.801664+0000","last_unstale":"2023-11-04T01:43:29.812467+0000","last_undegraded":"2023-11-04T01:43:29.812467+0000","last_fullsized":"2023-11-04T01:43:29.812467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:33:41.611668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.809604+0000","last_change":"2023-11-04T01:43:28.799646+0000","last_active":"2023-11-04T01:43:29.809604+0000","last_peered":"2023-11-04T01:43:29.809604+0000","last_clean":"2023-11-04T01:43:29.809604+0000","last_became_active":"2023-11-04T01:43:28.799347+0000","last_became_peered":"2023-11-04T01:43:28.799347+0000","last_unstale":"2023-11-04T01:43:29.809604+0000","last_undegraded":"2023-11-04T01:43:29.809604+0000","last_fullsized":"2023-11-04T01:43:29.809604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:25.081907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.809265+0000","last_change":"2023-11-04T01:43:28.804854+0000","last_active":"2023-11-04T01:43:29.809265+0000","last_peered":"2023-11-04T01:43:29.809265+0000","last_clean":"2023-11-04T01:43:29.809265+0000","last_became_active":"2023-11-04T01:43:28.804543+0000","last_became_peered":"2023-11-04T01:43:28.804543+0000","last_unstale":"2023-11-04T01:43:29.809265+0000","last_undegraded":"2023-11-04T01:43:29.809265+0000","last_fullsized":"2023-11-04T01:43:29.809265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.157079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041767+0000","last_change":"2023-11-04T01:43:28.816631+0000","last_active":"2023-11-04T01:43:30.041767+0000","last_peered":"2023-11-04T01:43:30.041767+0000","last_clean":"2023-11-04T01:43:30.041767+0000","last_became_active":"2023-11-04T01:43:28.816202+0000","last_became_peered":"2023-11-04T01:43:28.816202+0000","last_unstale":"2023-11-04T01:43:30.041767+0000","last_undegraded":"2023-11-04T01:43:30.041767+0000","last_fullsized":"2023-11-04T01:43:30.041767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:16:47.662445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061754+0000","last_change":"2023-11-04T01:43:28.832964+0000","last_active":"2023-11-04T01:43:30.061754+0000","last_peered":"2023-11-04T01:43:30.061754+0000","last_clean":"2023-11-04T01:43:30.061754+0000","last_became_active":"2023-11-04T01:43:28.832397+0000","last_became_peered":"2023-11-04T01:43:28.832397+0000","last_unstale":"2023-11-04T01:43:30.061754+0000","last_undegraded":"2023-11-04T01:43:30.061754+0000","last_fullsized":"2023-11-04T01:43:30.061754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:36.497493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062353+0000","last_change":"2023-11-04T01:43:28.825932+0000","last_active":"2023-11-04T01:43:30.062353+0000","last_peered":"2023-11-04T01:43:30.062353+0000","last_clean":"2023-11-04T01:43:30.062353+0000","last_became_active":"2023-11-04T01:43:28.822622+0000","last_became_peered":"2023-11-04T01:43:28.822622+0000","last_unstale":"2023-11-04T01:43:30.062353+0000","last_undegraded":"2023-11-04T01:43:30.062353+0000","last_fullsized":"2023-11-04T01:43:30.062353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:21:00.770200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.063856+0000","last_change":"2023-11-04T01:43:28.824332+0000","last_active":"2023-11-04T01:43:30.063856+0000","last_peered":"2023-11-04T01:43:30.063856+0000","last_clean":"2023-11-04T01:43:30.063856+0000","last_became_active":"2023-11-04T01:43:28.821996+0000","last_became_peered":"2023-11-04T01:43:28.821996+0000","last_unstale":"2023-11-04T01:43:30.063856+0000","last_undegraded":"2023-11-04T01:43:30.063856+0000","last_fullsized":"2023-11-04T01:43:30.063856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:09.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.809610+0000","last_change":"2023-11-04T01:43:28.816246+0000","last_active":"2023-11-04T01:43:29.809610+0000","last_peered":"2023-11-04T01:43:29.809610+0000","last_clean":"2023-11-04T01:43:29.809610+0000","last_became_active":"2023-11-04T01:43:28.815628+0000","last_became_peered":"2023-11-04T01:43:28.815628+0000","last_unstale":"2023-11-04T01:43:29.809610+0000","last_undegraded":"2023-11-04T01:43:29.809610+0000","last_fullsized":"2023-11-04T01:43:29.809610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:49.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807386+0000","last_change":"2023-11-04T01:43:28.806346+0000","last_active":"2023-11-04T01:43:29.807386+0000","last_peered":"2023-11-04T01:43:29.807386+0000","last_clean":"2023-11-04T01:43:29.807386+0000","last_became_active":"2023-11-04T01:43:28.805543+0000","last_became_peered":"2023-11-04T01:43:28.805543+0000","last_unstale":"2023-11-04T01:43:29.807386+0000","last_undegraded":"2023-11-04T01:43:29.807386+0000","last_fullsized":"2023-11-04T01:43:29.807386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:54.866145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061970+0000","last_change":"2023-11-04T01:43:28.808841+0000","last_active":"2023-11-04T01:43:30.061970+0000","last_peered":"2023-11-04T01:43:30.061970+0000","last_clean":"2023-11-04T01:43:30.061970+0000","last_became_active":"2023-11-04T01:43:28.808093+0000","last_became_peered":"2023-11-04T01:43:28.808093+0000","last_unstale":"2023-11-04T01:43:30.061970+0000","last_undegraded":"2023-11-04T01:43:30.061970+0000","last_fullsized":"2023-11-04T01:43:30.061970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:37.430251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807097+0000","last_change":"2023-11-04T01:43:28.816116+0000","last_active":"2023-11-04T01:43:29.807097+0000","last_peered":"2023-11-04T01:43:29.807097+0000","last_clean":"2023-11-04T01:43:29.807097+0000","last_became_active":"2023-11-04T01:43:28.815737+0000","last_became_peered":"2023-11-04T01:43:28.815737+0000","last_unstale":"2023-11-04T01:43:29.807097+0000","last_undegraded":"2023-11-04T01:43:29.807097+0000","last_fullsized":"2023-11-04T01:43:29.807097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:13:38.606860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813764+0000","last_change":"2023-11-04T01:43:28.801110+0000","last_active":"2023-11-04T01:43:29.813764+0000","last_peered":"2023-11-04T01:43:29.813764+0000","last_clean":"2023-11-04T01:43:29.813764+0000","last_became_active":"2023-11-04T01:43:28.800313+0000","last_became_peered":"2023-11-04T01:43:28.800313+0000","last_unstale":"2023-11-04T01:43:29.813764+0000","last_undegraded":"2023-11-04T01:43:29.813764+0000","last_fullsized":"2023-11-04T01:43:29.813764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:07:39.106671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813710+0000","last_change":"2023-11-04T01:43:28.804629+0000","last_active":"2023-11-04T01:43:29.813710+0000","last_peered":"2023-11-04T01:43:29.813710+0000","last_clean":"2023-11-04T01:43:29.813710+0000","last_became_active":"2023-11-04T01:43:28.803856+0000","last_became_peered":"2023-11-04T01:43:28.803856+0000","last_unstale":"2023-11-04T01:43:29.813710+0000","last_undegraded":"2023-11-04T01:43:29.813710+0000","last_fullsized":"2023-11-04T01:43:29.813710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:33.516232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060868+0000","last_change":"2023-11-04T01:43:28.804202+0000","last_active":"2023-11-04T01:43:30.060868+0000","last_peered":"2023-11-04T01:43:30.060868+0000","last_clean":"2023-11-04T01:43:30.060868+0000","last_became_active":"2023-11-04T01:43:28.803490+0000","last_became_peered":"2023-11-04T01:43:28.803490+0000","last_unstale":"2023-11-04T01:43:30.060868+0000","last_undegraded":"2023-11-04T01:43:30.060868+0000","last_fullsized":"2023-11-04T01:43:30.060868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:37.100948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.808888+0000","last_change":"2023-11-04T01:43:28.837544+0000","last_active":"2023-11-04T01:43:29.808888+0000","last_peered":"2023-11-04T01:43:29.808888+0000","last_clean":"2023-11-04T01:43:29.808888+0000","last_became_active":"2023-11-04T01:43:28.837220+0000","last_became_peered":"2023-11-04T01:43:28.837220+0000","last_unstale":"2023-11-04T01:43:29.808888+0000","last_undegraded":"2023-11-04T01:43:29.808888+0000","last_fullsized":"2023-11-04T01:43:29.808888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:37.100948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.809724+0000","last_change":"2023-11-04T01:43:28.805043+0000","last_active":"2023-11-04T01:43:29.809724+0000","last_peered":"2023-11-04T01:43:29.809724+0000","last_clean":"2023-11-04T01:43:29.809724+0000","last_became_active":"2023-11-04T01:43:28.804834+0000","last_became_peered":"2023-11-04T01:43:28.804834+0000","last_unstale":"2023-11-04T01:43:29.809724+0000","last_undegraded":"2023-11-04T01:43:29.809724+0000","last_fullsized":"2023-11-04T01:43:29.809724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:56:55.069262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.809621+0000","last_change":"2023-11-04T01:43:28.796814+0000","last_active":"2023-11-04T01:43:29.809621+0000","last_peered":"2023-11-04T01:43:29.809621+0000","last_clean":"2023-11-04T01:43:29.809621+0000","last_became_active":"2023-11-04T01:43:28.795498+0000","last_became_peered":"2023-11-04T01:43:28.795498+0000","last_unstale":"2023-11-04T01:43:29.809621+0000","last_undegraded":"2023-11-04T01:43:29.809621+0000","last_fullsized":"2023-11-04T01:43:29.809621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:37.100948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.806895+0000","last_change":"2023-11-04T01:43:28.807459+0000","last_active":"2023-11-04T01:43:29.806895+0000","last_peered":"2023-11-04T01:43:29.806895+0000","last_clean":"2023-11-04T01:43:29.806895+0000","last_became_active":"2023-11-04T01:43:28.806725+0000","last_became_peered":"2023-11-04T01:43:28.806725+0000","last_unstale":"2023-11-04T01:43:29.806895+0000","last_undegraded":"2023-11-04T01:43:29.806895+0000","last_fullsized":"2023-11-04T01:43:29.806895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:53:09.610012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041164+0000","last_change":"2023-11-04T01:43:28.816868+0000","last_active":"2023-11-04T01:43:30.041164+0000","last_peered":"2023-11-04T01:43:30.041164+0000","last_clean":"2023-11-04T01:43:30.041164+0000","last_became_active":"2023-11-04T01:43:28.816220+0000","last_became_peered":"2023-11-04T01:43:28.816220+0000","last_unstale":"2023-11-04T01:43:30.041164+0000","last_undegraded":"2023-11-04T01:43:30.041164+0000","last_fullsized":"2023-11-04T01:43:30.041164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:50.314450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.063694+0000","last_change":"2023-11-04T01:43:28.812290+0000","last_active":"2023-11-04T01:43:30.063694+0000","last_peered":"2023-11-04T01:43:30.063694+0000","last_clean":"2023-11-04T01:43:30.063694+0000","last_became_active":"2023-11-04T01:43:28.811577+0000","last_became_peered":"2023-11-04T01:43:28.811577+0000","last_unstale":"2023-11-04T01:43:30.063694+0000","last_undegraded":"2023-11-04T01:43:30.063694+0000","last_fullsized":"2023-11-04T01:43:30.063694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:15:00.617371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041980+0000","last_change":"2023-11-04T01:43:27.789378+0000","last_active":"2023-11-04T01:43:30.041980+0000","last_peered":"2023-11-04T01:43:30.041980+0000","last_clean":"2023-11-04T01:43:30.041980+0000","last_became_active":"2023-11-04T01:43:27.789019+0000","last_became_peered":"2023-11-04T01:43:27.789019+0000","last_unstale":"2023-11-04T01:43:30.041980+0000","last_undegraded":"2023-11-04T01:43:30.041980+0000","last_fullsized":"2023-11-04T01:43:30.041980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:15.736728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807413+0000","last_change":"2023-11-04T01:43:28.815105+0000","last_active":"2023-11-04T01:43:29.807413+0000","last_peered":"2023-11-04T01:43:29.807413+0000","last_clean":"2023-11-04T01:43:29.807413+0000","last_became_active":"2023-11-04T01:43:28.814662+0000","last_became_peered":"2023-11-04T01:43:28.814662+0000","last_unstale":"2023-11-04T01:43:29.807413+0000","last_undegraded":"2023-11-04T01:43:29.807413+0000","last_fullsized":"2023-11-04T01:43:29.807413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:19.337381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813838+0000","last_change":"2023-11-04T01:43:27.786404+0000","last_active":"2023-11-04T01:43:29.813838+0000","last_peered":"2023-11-04T01:43:29.813838+0000","last_clean":"2023-11-04T01:43:29.813838+0000","last_became_active":"2023-11-04T01:43:27.785834+0000","last_became_peered":"2023-11-04T01:43:27.785834+0000","last_unstale":"2023-11-04T01:43:29.813838+0000","last_undegraded":"2023-11-04T01:43:29.813838+0000","last_fullsized":"2023-11-04T01:43:29.813838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:35.656828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.808897+0000","last_change":"2023-11-04T01:43:28.815585+0000","last_active":"2023-11-04T01:43:29.808897+0000","last_peered":"2023-11-04T01:43:29.808897+0000","last_clean":"2023-11-04T01:43:29.808897+0000","last_became_active":"2023-11-04T01:43:28.815053+0000","last_became_peered":"2023-11-04T01:43:28.815053+0000","last_unstale":"2023-11-04T01:43:29.808897+0000","last_undegraded":"2023-11-04T01:43:29.808897+0000","last_fullsized":"2023-11-04T01:43:29.808897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:49.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062519+0000","last_change":"2023-11-04T01:43:27.807939+0000","last_active":"2023-11-04T01:43:30.062519+0000","last_peered":"2023-11-04T01:43:30.062519+0000","last_clean":"2023-11-04T01:43:30.062519+0000","last_became_active":"2023-11-04T01:43:27.807391+0000","last_became_peered":"2023-11-04T01:43:27.807391+0000","last_unstale":"2023-11-04T01:43:30.062519+0000","last_undegraded":"2023-11-04T01:43:30.062519+0000","last_fullsized":"2023-11-04T01:43:30.062519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:27:55.252085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813340+0000","last_change":"2023-11-04T01:43:28.820421+0000","last_active":"2023-11-04T01:43:29.813340+0000","last_peered":"2023-11-04T01:43:29.813340+0000","last_clean":"2023-11-04T01:43:29.813340+0000","last_became_active":"2023-11-04T01:43:28.819813+0000","last_became_peered":"2023-11-04T01:43:28.819813+0000","last_unstale":"2023-11-04T01:43:29.813340+0000","last_undegraded":"2023-11-04T01:43:29.813340+0000","last_fullsized":"2023-11-04T01:43:29.813340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:37:55.165237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813371+0000","last_change":"2023-11-04T01:43:27.803615+0000","last_active":"2023-11-04T01:43:29.813371+0000","last_peered":"2023-11-04T01:43:29.813371+0000","last_clean":"2023-11-04T01:43:29.813371+0000","last_became_active":"2023-11-04T01:43:27.802845+0000","last_became_peered":"2023-11-04T01:43:27.802845+0000","last_unstale":"2023-11-04T01:43:29.813371+0000","last_undegraded":"2023-11-04T01:43:29.813371+0000","last_fullsized":"2023-11-04T01:43:29.813371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:16:07.900017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060518+0000","last_change":"2023-11-04T01:43:28.804852+0000","last_active":"2023-11-04T01:43:30.060518+0000","last_peered":"2023-11-04T01:43:30.060518+0000","last_clean":"2023-11-04T01:43:30.060518+0000","last_became_active":"2023-11-04T01:43:28.804503+0000","last_became_peered":"2023-11-04T01:43:28.804503+0000","last_unstale":"2023-11-04T01:43:30.060518+0000","last_undegraded":"2023-11-04T01:43:30.060518+0000","last_fullsized":"2023-11-04T01:43:30.060518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:29:57.961560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.808138+0000","last_change":"2023-11-04T01:43:27.791428+0000","last_active":"2023-11-04T01:43:29.808138+0000","last_peered":"2023-11-04T01:43:29.808138+0000","last_clean":"2023-11-04T01:43:29.808138+0000","last_became_active":"2023-11-04T01:43:27.791033+0000","last_became_peered":"2023-11-04T01:43:27.791033+0000","last_unstale":"2023-11-04T01:43:29.808138+0000","last_undegraded":"2023-11-04T01:43:29.808138+0000","last_fullsized":"2023-11-04T01:43:29.808138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:03.925052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807905+0000","last_change":"2023-11-04T01:43:28.807585+0000","last_active":"2023-11-04T01:43:29.807905+0000","last_peered":"2023-11-04T01:43:29.807905+0000","last_clean":"2023-11-04T01:43:29.807905+0000","last_became_active":"2023-11-04T01:43:28.807371+0000","last_became_peered":"2023-11-04T01:43:28.807371+0000","last_unstale":"2023-11-04T01:43:29.807905+0000","last_undegraded":"2023-11-04T01:43:29.807905+0000","last_fullsized":"2023-11-04T01:43:29.807905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:26.802759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807299+0000","last_change":"2023-11-04T01:43:27.804062+0000","last_active":"2023-11-04T01:43:29.807299+0000","last_peered":"2023-11-04T01:43:29.807299+0000","last_clean":"2023-11-04T01:43:29.807299+0000","last_became_active":"2023-11-04T01:43:27.803694+0000","last_became_peered":"2023-11-04T01:43:27.803694+0000","last_unstale":"2023-11-04T01:43:29.807299+0000","last_undegraded":"2023-11-04T01:43:29.807299+0000","last_fullsized":"2023-11-04T01:43:29.807299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:36.425559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060622+0000","last_change":"2023-11-04T01:43:28.810385+0000","last_active":"2023-11-04T01:43:30.060622+0000","last_peered":"2023-11-04T01:43:30.060622+0000","last_clean":"2023-11-04T01:43:30.060622+0000","last_became_active":"2023-11-04T01:43:28.810123+0000","last_became_peered":"2023-11-04T01:43:28.810123+0000","last_unstale":"2023-11-04T01:43:30.060622+0000","last_undegraded":"2023-11-04T01:43:30.060622+0000","last_fullsized":"2023-11-04T01:43:30.060622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:51:55.689648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061369+0000","last_change":"2023-11-04T01:43:27.803573+0000","last_active":"2023-11-04T01:43:30.061369+0000","last_peered":"2023-11-04T01:43:30.061369+0000","last_clean":"2023-11-04T01:43:30.061369+0000","last_became_active":"2023-11-04T01:43:27.802956+0000","last_became_peered":"2023-11-04T01:43:27.802956+0000","last_unstale":"2023-11-04T01:43:30.061369+0000","last_undegraded":"2023-11-04T01:43:30.061369+0000","last_fullsized":"2023-11-04T01:43:30.061369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:04.347224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812033+0000","last_change":"2023-11-04T01:43:28.805687+0000","last_active":"2023-11-04T01:43:29.812033+0000","last_peered":"2023-11-04T01:43:29.812033+0000","last_clean":"2023-11-04T01:43:29.812033+0000","last_became_active":"2023-11-04T01:43:28.804844+0000","last_became_peered":"2023-11-04T01:43:28.804844+0000","last_unstale":"2023-11-04T01:43:29.812033+0000","last_undegraded":"2023-11-04T01:43:29.812033+0000","last_fullsized":"2023-11-04T01:43:29.812033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:45:49.578668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807291+0000","last_change":"2023-11-04T01:43:27.791309+0000","last_active":"2023-11-04T01:43:29.807291+0000","last_peered":"2023-11-04T01:43:29.807291+0000","last_clean":"2023-11-04T01:43:29.807291+0000","last_became_active":"2023-11-04T01:43:27.790965+0000","last_became_peered":"2023-11-04T01:43:27.790965+0000","last_unstale":"2023-11-04T01:43:29.807291+0000","last_undegraded":"2023-11-04T01:43:29.807291+0000","last_fullsized":"2023-11-04T01:43:29.807291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:23.621166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.042126+0000","last_change":"2023-11-04T01:43:28.832705+0000","last_active":"2023-11-04T01:43:30.042126+0000","last_peered":"2023-11-04T01:43:30.042126+0000","last_clean":"2023-11-04T01:43:30.042126+0000","last_became_active":"2023-11-04T01:43:28.832277+0000","last_became_peered":"2023-11-04T01:43:28.832277+0000","last_unstale":"2023-11-04T01:43:30.042126+0000","last_undegraded":"2023-11-04T01:43:30.042126+0000","last_fullsized":"2023-11-04T01:43:30.042126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:26:29.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061491+0000","last_change":"2023-11-04T01:43:27.779265+0000","last_active":"2023-11-04T01:43:30.061491+0000","last_peered":"2023-11-04T01:43:30.061491+0000","last_clean":"2023-11-04T01:43:30.061491+0000","last_became_active":"2023-11-04T01:43:27.778428+0000","last_became_peered":"2023-11-04T01:43:27.778428+0000","last_unstale":"2023-11-04T01:43:30.061491+0000","last_undegraded":"2023-11-04T01:43:30.061491+0000","last_fullsized":"2023-11-04T01:43:30.061491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:08.152387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813939+0000","last_change":"2023-11-04T01:43:28.799906+0000","last_active":"2023-11-04T01:43:29.813939+0000","last_peered":"2023-11-04T01:43:29.813939+0000","last_clean":"2023-11-04T01:43:29.813939+0000","last_became_active":"2023-11-04T01:43:28.799082+0000","last_became_peered":"2023-11-04T01:43:28.799082+0000","last_unstale":"2023-11-04T01:43:29.813939+0000","last_undegraded":"2023-11-04T01:43:29.813939+0000","last_fullsized":"2023-11-04T01:43:29.813939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:09:42.435668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061162+0000","last_change":"2023-11-04T01:43:27.799585+0000","last_active":"2023-11-04T01:43:30.061162+0000","last_peered":"2023-11-04T01:43:30.061162+0000","last_clean":"2023-11-04T01:43:30.061162+0000","last_became_active":"2023-11-04T01:43:27.799051+0000","last_became_peered":"2023-11-04T01:43:27.799051+0000","last_unstale":"2023-11-04T01:43:30.061162+0000","last_undegraded":"2023-11-04T01:43:30.061162+0000","last_fullsized":"2023-11-04T01:43:30.061162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:53.861453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.813154+0000","last_change":"2023-11-04T01:43:28.812354+0000","last_active":"2023-11-04T01:43:29.813154+0000","last_peered":"2023-11-04T01:43:29.813154+0000","last_clean":"2023-11-04T01:43:29.813154+0000","last_became_active":"2023-11-04T01:43:28.811312+0000","last_became_peered":"2023-11-04T01:43:28.811312+0000","last_unstale":"2023-11-04T01:43:29.813154+0000","last_undegraded":"2023-11-04T01:43:29.813154+0000","last_fullsized":"2023-11-04T01:43:29.813154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:29.988407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041577+0000","last_change":"2023-11-04T01:43:27.786592+0000","last_active":"2023-11-04T01:43:30.041577+0000","last_peered":"2023-11-04T01:43:30.041577+0000","last_clean":"2023-11-04T01:43:30.041577+0000","last_became_active":"2023-11-04T01:43:27.786227+0000","last_became_peered":"2023-11-04T01:43:27.786227+0000","last_unstale":"2023-11-04T01:43:30.041577+0000","last_undegraded":"2023-11-04T01:43:30.041577+0000","last_fullsized":"2023-11-04T01:43:30.041577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:38.552762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041567+0000","last_change":"2023-11-04T01:43:28.826170+0000","last_active":"2023-11-04T01:43:30.041567+0000","last_peered":"2023-11-04T01:43:30.041567+0000","last_clean":"2023-11-04T01:43:30.041567+0000","last_became_active":"2023-11-04T01:43:28.825840+0000","last_became_peered":"2023-11-04T01:43:28.825840+0000","last_unstale":"2023-11-04T01:43:30.041567+0000","last_undegraded":"2023-11-04T01:43:30.041567+0000","last_fullsized":"2023-11-04T01:43:30.041567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:37:02.884497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.063386+0000","last_change":"2023-11-04T01:43:27.800898+0000","last_active":"2023-11-04T01:43:30.063386+0000","last_peered":"2023-11-04T01:43:30.063386+0000","last_clean":"2023-11-04T01:43:30.063386+0000","last_became_active":"2023-11-04T01:43:27.800169+0000","last_became_peered":"2023-11-04T01:43:27.800169+0000","last_unstale":"2023-11-04T01:43:30.063386+0000","last_undegraded":"2023-11-04T01:43:30.063386+0000","last_fullsized":"2023-11-04T01:43:30.063386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:03.925052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062226+0000","last_change":"2023-11-04T01:43:28.810450+0000","last_active":"2023-11-04T01:43:30.062226+0000","last_peered":"2023-11-04T01:43:30.062226+0000","last_clean":"2023-11-04T01:43:30.062226+0000","last_became_active":"2023-11-04T01:43:28.809245+0000","last_became_peered":"2023-11-04T01:43:28.809245+0000","last_unstale":"2023-11-04T01:43:30.062226+0000","last_undegraded":"2023-11-04T01:43:30.062226+0000","last_fullsized":"2023-11-04T01:43:30.062226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:40.315826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.808410+0000","last_change":"2023-11-04T01:43:27.793566+0000","last_active":"2023-11-04T01:43:29.808410+0000","last_peered":"2023-11-04T01:43:29.808410+0000","last_clean":"2023-11-04T01:43:29.808410+0000","last_became_active":"2023-11-04T01:43:27.793150+0000","last_became_peered":"2023-11-04T01:43:27.793150+0000","last_unstale":"2023-11-04T01:43:29.808410+0000","last_undegraded":"2023-11-04T01:43:29.808410+0000","last_fullsized":"2023-11-04T01:43:29.808410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:10.331981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812528+0000","last_change":"2023-11-04T01:43:28.831274+0000","last_active":"2023-11-04T01:43:29.812528+0000","last_peered":"2023-11-04T01:43:29.812528+0000","last_clean":"2023-11-04T01:43:29.812528+0000","last_became_active":"2023-11-04T01:43:28.830707+0000","last_became_peered":"2023-11-04T01:43:28.830707+0000","last_unstale":"2023-11-04T01:43:29.812528+0000","last_undegraded":"2023-11-04T01:43:29.812528+0000","last_fullsized":"2023-11-04T01:43:29.812528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:52.382269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812380+0000","last_change":"2023-11-04T01:43:27.786700+0000","last_active":"2023-11-04T01:43:29.812380+0000","last_peered":"2023-11-04T01:43:29.812380+0000","last_clean":"2023-11-04T01:43:29.812380+0000","last_became_active":"2023-11-04T01:43:27.786029+0000","last_became_peered":"2023-11-04T01:43:27.786029+0000","last_unstale":"2023-11-04T01:43:29.812380+0000","last_undegraded":"2023-11-04T01:43:29.812380+0000","last_fullsized":"2023-11-04T01:43:29.812380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:46:24.426760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807472+0000","last_change":"2023-11-04T01:43:28.815411+0000","last_active":"2023-11-04T01:43:29.807472+0000","last_peered":"2023-11-04T01:43:29.807472+0000","last_clean":"2023-11-04T01:43:29.807472+0000","last_became_active":"2023-11-04T01:43:28.804604+0000","last_became_peered":"2023-11-04T01:43:28.804604+0000","last_unstale":"2023-11-04T01:43:29.807472+0000","last_undegraded":"2023-11-04T01:43:29.807472+0000","last_fullsized":"2023-11-04T01:43:29.807472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:18:09.157079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.811893+0000","last_change":"2023-11-04T01:43:27.786305+0000","last_active":"2023-11-04T01:43:29.811893+0000","last_peered":"2023-11-04T01:43:29.811893+0000","last_clean":"2023-11-04T01:43:29.811893+0000","last_became_active":"2023-11-04T01:43:27.785160+0000","last_became_peered":"2023-11-04T01:43:27.785160+0000","last_unstale":"2023-11-04T01:43:29.811893+0000","last_undegraded":"2023-11-04T01:43:29.811893+0000","last_fullsized":"2023-11-04T01:43:29.811893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:21.301600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041298+0000","last_change":"2023-11-04T01:43:28.810152+0000","last_active":"2023-11-04T01:43:30.041298+0000","last_peered":"2023-11-04T01:43:30.041298+0000","last_clean":"2023-11-04T01:43:30.041298+0000","last_became_active":"2023-11-04T01:43:28.809813+0000","last_became_peered":"2023-11-04T01:43:28.809813+0000","last_unstale":"2023-11-04T01:43:30.041298+0000","last_undegraded":"2023-11-04T01:43:30.041298+0000","last_fullsized":"2023-11-04T01:43:30.041298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:00.332315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061062+0000","last_change":"2023-11-04T01:43:27.797258+0000","last_active":"2023-11-04T01:43:30.061062+0000","last_peered":"2023-11-04T01:43:30.061062+0000","last_clean":"2023-11-04T01:43:30.061062+0000","last_became_active":"2023-11-04T01:43:27.796519+0000","last_became_peered":"2023-11-04T01:43:27.796519+0000","last_unstale":"2023-11-04T01:43:30.061062+0000","last_undegraded":"2023-11-04T01:43:30.061062+0000","last_fullsized":"2023-11-04T01:43:30.061062+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:12:42.447678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.042150+0000","last_change":"2023-11-04T01:43:28.826373+0000","last_active":"2023-11-04T01:43:30.042150+0000","last_peered":"2023-11-04T01:43:30.042150+0000","last_clean":"2023-11-04T01:43:30.042150+0000","last_became_active":"2023-11-04T01:43:28.826014+0000","last_became_peered":"2023-11-04T01:43:28.826014+0000","last_unstale":"2023-11-04T01:43:30.042150+0000","last_undegraded":"2023-11-04T01:43:30.042150+0000","last_fullsized":"2023-11-04T01:43:30.042150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:49.885552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062847+0000","last_change":"2023-11-04T01:43:27.804228+0000","last_active":"2023-11-04T01:43:30.062847+0000","last_peered":"2023-11-04T01:43:30.062847+0000","last_clean":"2023-11-04T01:43:30.062847+0000","last_became_active":"2023-11-04T01:43:27.803605+0000","last_became_peered":"2023-11-04T01:43:27.803605+0000","last_unstale":"2023-11-04T01:43:30.062847+0000","last_undegraded":"2023-11-04T01:43:30.062847+0000","last_fullsized":"2023-11-04T01:43:30.062847+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:04:42.850788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060841+0000","last_change":"2023-11-04T01:43:28.811358+0000","last_active":"2023-11-04T01:43:30.060841+0000","last_peered":"2023-11-04T01:43:30.060841+0000","last_clean":"2023-11-04T01:43:30.060841+0000","last_became_active":"2023-11-04T01:43:28.810998+0000","last_became_peered":"2023-11-04T01:43:28.810998+0000","last_unstale":"2023-11-04T01:43:30.060841+0000","last_undegraded":"2023-11-04T01:43:30.060841+0000","last_fullsized":"2023-11-04T01:43:30.060841+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:26:23.508524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807129+0000","last_change":"2023-11-04T01:43:27.793378+0000","last_active":"2023-11-04T01:43:29.807129+0000","last_peered":"2023-11-04T01:43:29.807129+0000","last_clean":"2023-11-04T01:43:29.807129+0000","last_became_active":"2023-11-04T01:43:27.792746+0000","last_became_peered":"2023-11-04T01:43:27.792746+0000","last_unstale":"2023-11-04T01:43:29.807129+0000","last_undegraded":"2023-11-04T01:43:29.807129+0000","last_fullsized":"2023-11-04T01:43:29.807129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:36:13.434248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060683+0000","last_change":"2023-11-04T01:43:28.797399+0000","last_active":"2023-11-04T01:43:30.060683+0000","last_peered":"2023-11-04T01:43:30.060683+0000","last_clean":"2023-11-04T01:43:30.060683+0000","last_became_active":"2023-11-04T01:43:28.796619+0000","last_became_peered":"2023-11-04T01:43:28.796619+0000","last_unstale":"2023-11-04T01:43:30.060683+0000","last_undegraded":"2023-11-04T01:43:30.060683+0000","last_fullsized":"2023-11-04T01:43:30.060683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:26.802759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041770+0000","last_change":"2023-11-04T01:43:27.784819+0000","last_active":"2023-11-04T01:43:30.041770+0000","last_peered":"2023-11-04T01:43:30.041770+0000","last_clean":"2023-11-04T01:43:30.041770+0000","last_became_active":"2023-11-04T01:43:27.784420+0000","last_became_peered":"2023-11-04T01:43:27.784420+0000","last_unstale":"2023-11-04T01:43:30.041770+0000","last_undegraded":"2023-11-04T01:43:30.041770+0000","last_fullsized":"2023-11-04T01:43:30.041770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:54.340337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062357+0000","last_change":"2023-11-04T01:43:28.823291+0000","last_active":"2023-11-04T01:43:30.062357+0000","last_peered":"2023-11-04T01:43:30.062357+0000","last_clean":"2023-11-04T01:43:30.062357+0000","last_became_active":"2023-11-04T01:43:28.821278+0000","last_became_peered":"2023-11-04T01:43:28.821278+0000","last_unstale":"2023-11-04T01:43:30.062357+0000","last_undegraded":"2023-11-04T01:43:30.062357+0000","last_fullsized":"2023-11-04T01:43:30.062357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:41.719799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:43:28.772547+0000","last_change":"2023-11-04T01:43:27.791509+0000","last_active":"2023-11-04T01:43:28.772547+0000","last_peered":"2023-11-04T01:43:28.772547+0000","last_clean":"2023-11-04T01:43:28.772547+0000","last_became_active":"2023-11-04T01:43:27.791093+0000","last_became_peered":"2023-11-04T01:43:27.791093+0000","last_unstale":"2023-11-04T01:43:28.772547+0000","last_undegraded":"2023-11-04T01:43:28.772547+0000","last_fullsized":"2023-11-04T01:43:28.772547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:27:53.861453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062324+0000","last_change":"2023-11-04T01:43:28.809968+0000","last_active":"2023-11-04T01:43:30.062324+0000","last_peered":"2023-11-04T01:43:30.062324+0000","last_clean":"2023-11-04T01:43:30.062324+0000","last_became_active":"2023-11-04T01:43:28.808495+0000","last_became_peered":"2023-11-04T01:43:28.808495+0000","last_unstale":"2023-11-04T01:43:30.062324+0000","last_undegraded":"2023-11-04T01:43:30.062324+0000","last_fullsized":"2023-11-04T01:43:30.062324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061255+0000","last_change":"2023-11-04T01:43:27.792098+0000","last_active":"2023-11-04T01:43:30.061255+0000","last_peered":"2023-11-04T01:43:30.061255+0000","last_clean":"2023-11-04T01:43:30.061255+0000","last_became_active":"2023-11-04T01:43:27.790791+0000","last_became_peered":"2023-11-04T01:43:27.790791+0000","last_unstale":"2023-11-04T01:43:30.061255+0000","last_undegraded":"2023-11-04T01:43:30.061255+0000","last_fullsized":"2023-11-04T01:43:30.061255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:14:59.612678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061030+0000","last_change":"2023-11-04T01:43:28.792667+0000","last_active":"2023-11-04T01:43:30.061030+0000","last_peered":"2023-11-04T01:43:30.061030+0000","last_clean":"2023-11-04T01:43:30.061030+0000","last_became_active":"2023-11-04T01:43:28.791867+0000","last_became_peered":"2023-11-04T01:43:28.791867+0000","last_unstale":"2023-11-04T01:43:30.061030+0000","last_undegraded":"2023-11-04T01:43:30.061030+0000","last_fullsized":"2023-11-04T01:43:30.061030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:49.930877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807531+0000","last_change":"2023-11-04T01:43:27.793083+0000","last_active":"2023-11-04T01:43:29.807531+0000","last_peered":"2023-11-04T01:43:29.807531+0000","last_clean":"2023-11-04T01:43:29.807531+0000","last_became_active":"2023-11-04T01:43:27.792751+0000","last_became_peered":"2023-11-04T01:43:27.792751+0000","last_unstale":"2023-11-04T01:43:29.807531+0000","last_undegraded":"2023-11-04T01:43:29.807531+0000","last_fullsized":"2023-11-04T01:43:29.807531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:17:39.311133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060829+0000","last_change":"2023-11-04T01:43:28.831113+0000","last_active":"2023-11-04T01:43:30.060829+0000","last_peered":"2023-11-04T01:43:30.060829+0000","last_clean":"2023-11-04T01:43:30.060829+0000","last_became_active":"2023-11-04T01:43:28.830680+0000","last_became_peered":"2023-11-04T01:43:28.830680+0000","last_unstale":"2023-11-04T01:43:30.060829+0000","last_undegraded":"2023-11-04T01:43:30.060829+0000","last_fullsized":"2023-11-04T01:43:30.060829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:11.336674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:43:28.791472+0000","last_change":"2023-11-04T01:43:27.792075+0000","last_active":"2023-11-04T01:43:28.791472+0000","last_peered":"2023-11-04T01:43:28.791472+0000","last_clean":"2023-11-04T01:43:28.791472+0000","last_became_active":"2023-11-04T01:43:27.791714+0000","last_became_peered":"2023-11-04T01:43:27.791714+0000","last_unstale":"2023-11-04T01:43:28.791472+0000","last_undegraded":"2023-11-04T01:43:28.791472+0000","last_fullsized":"2023-11-04T01:43:28.791472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:26:51.799601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.060794+0000","last_change":"2023-11-04T01:43:28.811425+0000","last_active":"2023-11-04T01:43:30.060794+0000","last_peered":"2023-11-04T01:43:30.060794+0000","last_clean":"2023-11-04T01:43:30.060794+0000","last_became_active":"2023-11-04T01:43:28.810691+0000","last_became_peered":"2023-11-04T01:43:28.810691+0000","last_unstale":"2023-11-04T01:43:30.060794+0000","last_undegraded":"2023-11-04T01:43:30.060794+0000","last_fullsized":"2023-11-04T01:43:30.060794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:12:56.012302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041193+0000","last_change":"2023-11-04T01:43:27.785292+0000","last_active":"2023-11-04T01:43:30.041193+0000","last_peered":"2023-11-04T01:43:30.041193+0000","last_clean":"2023-11-04T01:43:30.041193+0000","last_became_active":"2023-11-04T01:43:27.784947+0000","last_became_peered":"2023-11-04T01:43:27.784947+0000","last_unstale":"2023-11-04T01:43:30.041193+0000","last_undegraded":"2023-11-04T01:43:30.041193+0000","last_fullsized":"2023-11-04T01:43:30.041193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:14.952722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062093+0000","last_change":"2023-11-04T01:43:28.820548+0000","last_active":"2023-11-04T01:43:30.062093+0000","last_peered":"2023-11-04T01:43:30.062093+0000","last_clean":"2023-11-04T01:43:30.062093+0000","last_became_active":"2023-11-04T01:43:28.819912+0000","last_became_peered":"2023-11-04T01:43:28.819912+0000","last_unstale":"2023-11-04T01:43:30.062093+0000","last_undegraded":"2023-11-04T01:43:30.062093+0000","last_fullsized":"2023-11-04T01:43:30.062093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:22.306293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.063167+0000","last_change":"2023-11-04T01:43:27.799530+0000","last_active":"2023-11-04T01:43:30.063167+0000","last_peered":"2023-11-04T01:43:30.063167+0000","last_clean":"2023-11-04T01:43:30.063167+0000","last_became_active":"2023-11-04T01:43:27.798769+0000","last_became_peered":"2023-11-04T01:43:27.798769+0000","last_unstale":"2023-11-04T01:43:30.063167+0000","last_undegraded":"2023-11-04T01:43:30.063167+0000","last_fullsized":"2023-11-04T01:43:30.063167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:24.974551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041840+0000","last_change":"2023-11-04T01:43:28.802588+0000","last_active":"2023-11-04T01:43:30.041840+0000","last_peered":"2023-11-04T01:43:30.041840+0000","last_clean":"2023-11-04T01:43:30.041840+0000","last_became_active":"2023-11-04T01:43:28.802197+0000","last_became_peered":"2023-11-04T01:43:28.802197+0000","last_unstale":"2023-11-04T01:43:30.041840+0000","last_undegraded":"2023-11-04T01:43:30.041840+0000","last_fullsized":"2023-11-04T01:43:30.041840+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:22:39.024470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.061369+0000","last_change":"2023-11-04T01:43:27.796458+0000","last_active":"2023-11-04T01:43:30.061369+0000","last_peered":"2023-11-04T01:43:30.061369+0000","last_clean":"2023-11-04T01:43:30.061369+0000","last_became_active":"2023-11-04T01:43:27.795917+0000","last_became_peered":"2023-11-04T01:43:27.795917+0000","last_unstale":"2023-11-04T01:43:30.061369+0000","last_undegraded":"2023-11-04T01:43:30.061369+0000","last_fullsized":"2023-11-04T01:43:30.061369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:18.332688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062600+0000","last_change":"2023-11-04T01:43:28.823743+0000","last_active":"2023-11-04T01:43:30.062600+0000","last_peered":"2023-11-04T01:43:30.062600+0000","last_clean":"2023-11-04T01:43:30.062600+0000","last_became_active":"2023-11-04T01:43:28.821975+0000","last_became_peered":"2023-11-04T01:43:28.821975+0000","last_unstale":"2023-11-04T01:43:30.062600+0000","last_undegraded":"2023-11-04T01:43:30.062600+0000","last_fullsized":"2023-11-04T01:43:30.062600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:07.570382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.063592+0000","last_change":"2023-11-04T01:43:27.800129+0000","last_active":"2023-11-04T01:43:30.063592+0000","last_peered":"2023-11-04T01:43:30.063592+0000","last_clean":"2023-11-04T01:43:30.063592+0000","last_became_active":"2023-11-04T01:43:27.799499+0000","last_became_peered":"2023-11-04T01:43:27.799499+0000","last_unstale":"2023-11-04T01:43:30.063592+0000","last_undegraded":"2023-11-04T01:43:30.063592+0000","last_fullsized":"2023-11-04T01:43:30.063592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:23.621166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.809595+0000","last_change":"2023-11-04T01:43:28.796229+0000","last_active":"2023-11-04T01:43:29.809595+0000","last_peered":"2023-11-04T01:43:29.809595+0000","last_clean":"2023-11-04T01:43:29.809595+0000","last_became_active":"2023-11-04T01:43:28.794460+0000","last_became_peered":"2023-11-04T01:43:28.794460+0000","last_unstale":"2023-11-04T01:43:29.809595+0000","last_undegraded":"2023-11-04T01:43:29.809595+0000","last_fullsized":"2023-11-04T01:43:29.809595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:26.802759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.063415+0000","last_change":"2023-11-04T01:43:27.802585+0000","last_active":"2023-11-04T01:43:30.063415+0000","last_peered":"2023-11-04T01:43:30.063415+0000","last_clean":"2023-11-04T01:43:30.063415+0000","last_became_active":"2023-11-04T01:43:27.801911+0000","last_became_peered":"2023-11-04T01:43:27.801911+0000","last_unstale":"2023-11-04T01:43:30.063415+0000","last_undegraded":"2023-11-04T01:43:30.063415+0000","last_fullsized":"2023-11-04T01:43:30.063415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:46.264946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812772+0000","last_change":"2023-11-04T01:43:28.820620+0000","last_active":"2023-11-04T01:43:29.812772+0000","last_peered":"2023-11-04T01:43:29.812772+0000","last_clean":"2023-11-04T01:43:29.812772+0000","last_became_active":"2023-11-04T01:43:28.819917+0000","last_became_peered":"2023-11-04T01:43:28.819917+0000","last_unstale":"2023-11-04T01:43:29.812772+0000","last_undegraded":"2023-11-04T01:43:29.812772+0000","last_fullsized":"2023-11-04T01:43:29.812772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:09:18.937450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.062434+0000","last_change":"2023-11-04T01:43:27.799075+0000","last_active":"2023-11-04T01:43:30.062434+0000","last_peered":"2023-11-04T01:43:30.062434+0000","last_clean":"2023-11-04T01:43:30.062434+0000","last_became_active":"2023-11-04T01:43:27.798425+0000","last_became_peered":"2023-11-04T01:43:27.798425+0000","last_unstale":"2023-11-04T01:43:30.062434+0000","last_undegraded":"2023-11-04T01:43:30.062434+0000","last_fullsized":"2023-11-04T01:43:30.062434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:41:17.288669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812077+0000","last_change":"2023-11-04T01:43:28.799752+0000","last_active":"2023-11-04T01:43:29.812077+0000","last_peered":"2023-11-04T01:43:29.812077+0000","last_clean":"2023-11-04T01:43:29.812077+0000","last_became_active":"2023-11-04T01:43:28.798987+0000","last_became_peered":"2023-11-04T01:43:28.798987+0000","last_unstale":"2023-11-04T01:43:29.812077+0000","last_undegraded":"2023-11-04T01:43:29.812077+0000","last_fullsized":"2023-11-04T01:43:29.812077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:13:20.369663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.807027+0000","last_change":"2023-11-04T01:43:27.793153+0000","last_active":"2023-11-04T01:43:29.807027+0000","last_peered":"2023-11-04T01:43:29.807027+0000","last_clean":"2023-11-04T01:43:29.807027+0000","last_became_active":"2023-11-04T01:43:27.792746+0000","last_became_peered":"2023-11-04T01:43:27.792746+0000","last_unstale":"2023-11-04T01:43:29.807027+0000","last_undegraded":"2023-11-04T01:43:29.807027+0000","last_fullsized":"2023-11-04T01:43:29.807027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:46.264946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041341+0000","last_change":"2023-11-04T01:43:28.799628+0000","last_active":"2023-11-04T01:43:30.041341+0000","last_peered":"2023-11-04T01:43:30.041341+0000","last_clean":"2023-11-04T01:43:30.041341+0000","last_became_active":"2023-11-04T01:43:28.799213+0000","last_became_peered":"2023-11-04T01:43:28.799213+0000","last_unstale":"2023-11-04T01:43:30.041341+0000","last_undegraded":"2023-11-04T01:43:30.041341+0000","last_fullsized":"2023-11-04T01:43:30.041341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:01.909561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.812067+0000","last_change":"2023-11-04T01:43:27.777437+0000","last_active":"2023-11-04T01:43:29.812067+0000","last_peered":"2023-11-04T01:43:29.812067+0000","last_clean":"2023-11-04T01:43:29.812067+0000","last_became_active":"2023-11-04T01:43:27.776758+0000","last_became_peered":"2023-11-04T01:43:27.776758+0000","last_unstale":"2023-11-04T01:43:29.812067+0000","last_undegraded":"2023-11-04T01:43:29.812067+0000","last_fullsized":"2023-11-04T01:43:29.812067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:40.715107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:29.809868+0000","last_change":"2023-11-04T01:43:28.803307+0000","last_active":"2023-11-04T01:43:29.809868+0000","last_peered":"2023-11-04T01:43:29.809868+0000","last_clean":"2023-11-04T01:43:29.809868+0000","last_became_active":"2023-11-04T01:43:28.799756+0000","last_became_peered":"2023-11-04T01:43:28.799756+0000","last_unstale":"2023-11-04T01:43:29.809868+0000","last_undegraded":"2023-11-04T01:43:29.809868+0000","last_fullsized":"2023-11-04T01:43:29.809868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:27.745779+0000","last_clean_scrub_stamp":"2023-11-04T01:43:27.745779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:32.863673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-04T01:43:30.041894+0000","last_change":"2023-11-04T01:43:27.785354+0000","last_active":"2023-11-04T01:43:30.041894+0000","last_peered":"2023-11-04T01:43:30.041894+0000","last_clean":"2023-11-04T01:43:30.041894+0000","last_became_active":"2023-11-04T01:43:27.783399+0000","last_became_peered":"2023-11-04T01:43:27.783399+0000","last_unstale":"2023-11-04T01:43:30.041894+0000","last_undegraded":"2023-11-04T01:43:30.041894+0000","last_fullsized":"2023-11-04T01:43:30.041894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:26.741087+0000","last_clean_scrub_stamp":"2023-11-04T01:43:26.741087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:10:02.616576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-04T01:43:28.777475+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:43:28.777475+0000","last_peered":"2023-11-04T01:43:28.777475+0000","last_clean":"2023-11-04T01:43:28.777475+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:43:28.777475+0000","last_undegraded":"2023-11-04T01:43:28.777475+0000","last_fullsized":"2023-11-04T01:43:28.777475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":738681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.495},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.69999999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.74399999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.145}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.89100000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0549999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.2},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.2490000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":148333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.0700000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1990000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":1.411}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":1.133},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.369}]}]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":148265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.96599999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.57399999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.92500000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.052},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.079}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.1150000000000002,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.016},{"interface":"front","average":{"1min":2.786,"5min":2.786,"15min":2.786},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":40.195,"5min":40.195,"15min":40.195},"last":1.1020000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.88500000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":143555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.79800000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.57199999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.88800000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.048},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.95399999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.141}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.0980000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.83999999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":739193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65200000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.93600000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.004}]},{"osd":6,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.075},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.046}]},{"osd":7,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.109},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.139}]}]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.995},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.96199999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.034},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.0629999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.71599999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":0.88600000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.92000000000000004}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.103}]}]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":142719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":1.103}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.64600000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.86699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.2430000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0249999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.129},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.2210000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":148277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.73699999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.099}]},{"osd":6,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0369999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:43:33.202 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:43:33.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:43:33.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.365+0000 7efd13746640 1 Processor -- start 2023-11-04T01:43:33.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.365+0000 7efd13746640 1 -- start start 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.365+0000 7efd13746640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c15a750 0x7efd0c0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.365+0000 7efd13746640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd0c0c96b0 0x7efd0c0ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.365+0000 7efd13746640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c159da0 con 0x7efd0c0cd020 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.365+0000 7efd13746640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c06cc90 con 0x7efd0c0c96b0 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.365+0000 7efd13746640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0cd650 con 0x7efd0c15a750 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd11ce3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd0c0c96b0 0x7efd0c0ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd11ce3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efd0c0c96b0 0x7efd0c0ad500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45892/0 (socket says 172.21.15.2:45892) 2023-11-04T01:43:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd11ce3640 1 -- 172.21.15.2:0/1697544177 learned_addr learned my addr 172.21.15.2:0/1697544177 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd114e2640 1 --2- 172.21.15.2:0/1697544177 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c15a750 0x7efd0c0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd11ce3640 1 -- 172.21.15.2:0/1697544177 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c15a750 msgr2=0x7efd0c0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd11ce3640 1 --2- 172.21.15.2:0/1697544177 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c15a750 0x7efd0c0ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd11ce3640 1 -- 172.21.15.2:0/1697544177 >> v1:172.21.15.2:6789/0 conn(0x7efd0c0cd020 legacy=0x7efd0c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd11ce3640 1 -- 172.21.15.2:0/1697544177 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0cd930 con 0x7efd0c0c96b0 2023-11-04T01:43:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.369+0000 7efd03fff640 1 -- 172.21.15.2:0/1697544177 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300977719 0 0) 0x7efd0c159da0 con 0x7efd0c0cd020 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd11ce3640 1 --2- 172.21.15.2:0/1697544177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0c96b0 0x7efd0c0ad500 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efd04009e50 tx=0x7efd0401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79810aca280c6a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd03fff640 1 -- 172.21.15.2:0/1697544177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd040a5730 con 0x7efd0c0c96b0 2023-11-04T01:43:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd03fff640 1 -- 172.21.15.2:0/1697544177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd040a5890 con 0x7efd0c0c96b0 2023-11-04T01:43:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd03fff640 1 -- 172.21.15.2:0/1697544177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd040a5c20 con 0x7efd0c0c96b0 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- 172.21.15.2:0/1697544177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0c96b0 msgr2=0x7efd0c0ad500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 --2- 172.21.15.2:0/1697544177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0c96b0 0x7efd0c0ad500 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efd04009e50 tx=0x7efd0401c980 comp rx=0 tx=0).stop 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- 172.21.15.2:0/1697544177 shutdown_connections 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 --2- 172.21.15.2:0/1697544177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0c96b0 0x7efd0c0ad500 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 --2- 172.21.15.2:0/1697544177 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c15a750 0x7efd0c0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- 172.21.15.2:0/1697544177 >> 172.21.15.2:0/1697544177 conn(0x7efd0c0ce9e0 msgr2=0x7efd0c0cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- 172.21.15.2:0/1697544177 shutdown_connections 2023-11-04T01:43:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- 172.21.15.2:0/1697544177 wait complete. 2023-11-04T01:43:33.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 Processor -- start 2023-11-04T01:43:33.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- start start 2023-11-04T01:43:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c0c96b0 0x7efd0c15b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0cd020 0x7efd0c14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd0c15a750 0x7efd0c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c15dfb0 con 0x7efd0c0cd020 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0b30c0 con 0x7efd0c15a750 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd13746640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c15b600 con 0x7efd0c0c96b0 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd10ce1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0cd020 0x7efd0c14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd10ce1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0cd020 0x7efd0c14fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45894/0 (socket says 172.21.15.2:45894) 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd10ce1640 1 -- 172.21.15.2:0/625297575 learned_addr learned my addr 172.21.15.2:0/625297575 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd11ce3640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd0c15a750 0x7efd0c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.373+0000 7efd114e2640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c0c96b0 0x7efd0c15b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd10ce1640 1 -- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c0c96b0 msgr2=0x7efd0c15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd10ce1640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c0c96b0 0x7efd0c15b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd10ce1640 1 -- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd0c15a750 msgr2=0x7efd0c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd10ce1640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd0c15a750 0x7efd0c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd10ce1640 1 -- 172.21.15.2:0/625297575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd04009b30 con 0x7efd0c0cd020 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd10ce1640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0cd020 0x7efd0c14fe80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c550 tx=0x7efcfc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd01ffb640 1 -- 172.21.15.2:0/625297575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0052d0 con 0x7efd0c0cd020 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd01ffb640 1 -- 172.21.15.2:0/625297575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc005430 con 0x7efd0c0cd020 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0b2d90 con 0x7efd0c0cd020 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd01ffb640 1 -- 172.21.15.2:0/625297575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc012870 con 0x7efd0c0cd020 2023-11-04T01:43:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c15dcd0 con 0x7efd0c0cd020 2023-11-04T01:43:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c0744a0 con 0x7efd0c0cd020 2023-11-04T01:43:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd01ffb640 1 -- 172.21.15.2:0/625297575 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efcfc0129d0 con 0x7efd0c0cd020 2023-11-04T01:43:33.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd01ffb640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efcf00664a0 0x7efcf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd01ffb640 1 -- 172.21.15.2:0/625297575 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcfc0839f0 con 0x7efd0c0cd020 2023-11-04T01:43:33.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd114e2640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efcf00664a0 0x7efcf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.377+0000 7efd114e2640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efcf00664a0 0x7efcf0068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd0800b930 tx=0x7efd08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.381+0000 7efd01ffb640 1 -- 172.21.15.2:0/625297575 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efcfc050e80 con 0x7efd0c0cd020 2023-11-04T01:43:33.558 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:43:33.553+0000 7f405099b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:33.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.593+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efd0c0ce750 con 0x7efd0c0cd020 2023-11-04T01:43:33.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.597+0000 7efd01ffb640 1 -- 172.21.15.2:0/625297575 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7efcfc0544a0 con 0x7efd0c0cd020 2023-11-04T01:43:33.601 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-04T01:43:33.601 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ== 2023-11-04T01:43:33.601 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-04T01:43:33.601 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-04T01:43:33.601 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:43:33.602 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-04T01:43:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efcf00664a0 msgr2=0x7efcf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efcf00664a0 0x7efcf0068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efd0800b930 tx=0x7efd08008040 comp rx=0 tx=0).stop 2023-11-04T01:43:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0cd020 msgr2=0x7efd0c14fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0cd020 0x7efd0c14fe80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c550 tx=0x7efcfc00ca10 comp rx=0 tx=0).stop 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 shutdown_connections 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efcf00664a0 0x7efcf0068960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd0c15a750 0x7efd0c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd0c0cd020 0x7efd0c14fe80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 --2- 172.21.15.2:0/625297575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd0c0c96b0 0x7efd0c15b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 >> 172.21.15.2:0/625297575 conn(0x7efd0c0ce9e0 msgr2=0x7efd0c164630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 shutdown_connections 2023-11-04T01:43:33.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.601+0000 7efd13746640 1 -- 172.21.15.2:0/625297575 wait complete. 2023-11-04T01:43:33.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780edf6640 1 Processor -- start 2023-11-04T01:43:33.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780edf6640 1 -- start start 2023-11-04T01:43:33.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780edf6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 0x7f78080b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780edf6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78080b0b70 0x7f780815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780edf6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080c2670 con 0x7f780815afd0 2023-11-04T01:43:33.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780edf6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7808070140 con 0x7f78080b0b70 2023-11-04T01:43:33.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780edf6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b1000 con 0x7f78080715d0 2023-11-04T01:43:33.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f780815afd0 0x7f780806f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52608/0 (socket says 172.21.15.2:52608) 2023-11-04T01:43:33.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 -- 172.21.15.2:0/1184631889 learned_addr learned my addr 172.21.15.2:0/1184631889 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310965947 0 0) 0x7f78080c2670 con 0x7f780815afd0 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f7807fff640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 0x7f78080b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780d393640 1 --2- 172.21.15.2:0/1184631889 >> v2:172.21.15.90:3300/0 conn(0x7f78080b0b70 0x7f780815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8003530 con 0x7f780815afd0 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 97720329 0 0) 0x7f77f8003530 con 0x7f780815afd0 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 msgr2=0x7f78080b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 0x7f78080b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 >> v2:172.21.15.90:3300/0 conn(0x7f78080b0b70 msgr2=0x7f780815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 --2- 172.21.15.2:0/1184631889 >> v2:172.21.15.90:3300/0 conn(0x7f78080b0b70 0x7f780815ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780806bc30 con 0x7f780815afd0 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f77fc001680 con 0x7f780815afd0 2023-11-04T01:43:33.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 >> v1:172.21.15.2:6789/0 conn(0x7f780815afd0 legacy=0x7f780806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f8003980 0x7f77f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 0x7f77f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808070140 con 0x7f77f8003980 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b1000 con 0x7f77f80047d0 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f800b990 con 0x7f78080715d0 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f8003980 0x7f77f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f7807fff640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780d393640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 0x7f77f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 -- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 msgr2=0x7f77f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78080715d0 0x7f77f8005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 -- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f80047d0 msgr2=0x7f77f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f780cb92640 1 -- 172.21.15.2:0/1184631889 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8003530 con 0x7f77f8003980 2023-11-04T01:43:33.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.729+0000 7f7807fff640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f80047d0 0x7f77f8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:33.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780cb92640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f8003980 0x7f77f8003da0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c210 tx=0x7f77fc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871096138799b239 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0058e0 con 0x7f77f8003980 2023-11-04T01:43:33.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc005a60 con 0x7f77f8003980 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f78077fe640 1 -- 172.21.15.2:0/1184631889 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc005e10 con 0x7f77f8003980 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- 172.21.15.2:0/1184631889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f8003980 msgr2=0x7f77f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 --2- 172.21.15.2:0/1184631889 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f77f8003980 0x7f77f8003da0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c210 tx=0x7f77fc01cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780d393640 1 -- 172.21.15.2:0/1184631889 reap_dead start 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- 172.21.15.2:0/1184631889 shutdown_connections 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- 172.21.15.2:0/1184631889 >> 172.21.15.2:0/1184631889 conn(0x7f78080cebb0 msgr2=0x7f78080cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- 172.21.15.2:0/1184631889 shutdown_connections 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- 172.21.15.2:0/1184631889 wait complete. 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 Processor -- start 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- start start 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78081f7280 0x7f7808160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780814de10 0x7f78080c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78081f7660 0x7f78080c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78080b2310 con 0x7f780814de10 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780814dba0 con 0x7f78081f7660 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780edf6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78080c5bf0 con 0x7f78081f7280 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780814de10 0x7f78080c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780814de10 0x7f78080c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45914/0 (socket says 172.21.15.2:45914) 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 -- 172.21.15.2:0/1940337101 learned_addr learned my addr 172.21.15.2:0/1940337101 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 -- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78081f7280 msgr2=0x7f7808160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780d393640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78081f7660 0x7f78080c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f780cb92640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78081f7280 0x7f7808160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78081f7280 0x7f7808160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 -- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78081f7660 msgr2=0x7f78080c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78081f7660 0x7f78080c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.733+0000 7f7807fff640 1 -- 172.21.15.2:0/1940337101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080b17d0 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f7807fff640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780814de10 0x7f78080c4a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f77f4010890 tx=0x7f77f4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f78057fa640 1 -- 172.21.15.2:0/1940337101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4004220 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f78057fa640 1 -- 172.21.15.2:0/1940337101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4004380 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78080b1a70 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f78057fa640 1 -- 172.21.15.2:0/1940337101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400eb80 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78080b2030 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78080744a0 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f78057fa640 1 -- 172.21.15.2:0/1940337101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77f400ece0 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f78057fa640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77ec0664d0 0x7f77ec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f78057fa640 1 -- 172.21.15.2:0/1940337101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77f4084130 con 0x7f780814de10 2023-11-04T01:43:33.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f780cb92640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77ec0664d0 0x7f77ec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.737+0000 7f780cb92640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77ec0664d0 0x7f77ec068990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0aa000 tx=0x7f77fc000ff0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:33.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.741+0000 7f78057fa640 1 -- 172.21.15.2:0/1940337101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77f4051520 con 0x7f780814de10 2023-11-04T01:43:33.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.929+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f780806cba0 con 0x7f780814de10 2023-11-04T01:43:33.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.929+0000 7f78057fa640 1 -- 172.21.15.2:0/1940337101 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4897 (secure 0 0 0) 0x7f77f40044f0 con 0x7f780814de10 2023-11-04T01:43:33.933 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:33.933 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/926400153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":926400153},{"type":"v1","addr":"172.21.15.90:6837","nonce":926400153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/1780832630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1780832630},{"type":"v1","addr":"172.21.15.90:6836","nonce":1780832630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/763530639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":763530639},{"type":"v1","addr":"172.21.15.2:6834","nonce":763530639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:28.120677+0000","modified":"2023-11-04T01:43:31.147336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/610836033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":610836033},{"type":"v1","addr":"172.21.15.2:6835","nonce":610836033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:43:33.934 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 14 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77ec0664d0 msgr2=0x7f77ec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77ec0664d0 0x7f77ec068990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0aa000 tx=0x7f77fc000ff0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780814de10 msgr2=0x7f78080c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780814de10 0x7f78080c4a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f77f4010890 tx=0x7f77f4010d50 comp rx=0 tx=0).stop 2023-11-04T01:43:33.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 shutdown_connections 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f77ec0664d0 0x7f77ec068990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78081f7660 0x7f78080c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780814de10 0x7f78080c4a40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 --2- 172.21.15.2:0/1940337101 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f78081f7280 0x7f7808160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 >> 172.21.15.2:0/1940337101 conn(0x7f78080cebb0 msgr2=0x7f78080caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 shutdown_connections 2023-11-04T01:43:33.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:33.933+0000 7f780edf6640 1 -- 172.21.15.2:0/1940337101 wait complete. 2023-11-04T01:43:34.355 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:43:28.120677+0000', 'modified': '2023-11-04T01:43:31.147336+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5313}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5313': {'gid': 5313, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6835/610836033', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6833', 'nonce': 610836033}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 610836033}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:43:34.355 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:43:34.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:43:34.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0f6f9640 1 Processor -- start 2023-11-04T01:43:34.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0f6f9640 1 -- start start 2023-11-04T01:43:34.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0f6f9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 0x7fdd080d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0f6f9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd080d02f0 con 0x7fdd080cfe40 2023-11-04T01:43:34.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0f6f9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0815f980 con 0x7fdd080b27d0 2023-11-04T01:43:34.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0f6f9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0815f4f0 con 0x7fdd0815b150 2023-11-04T01:43:34.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0dc96640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdd080cfe40 0x7fdd0806f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52618/0 (socket says 172.21.15.2:52618) 2023-11-04T01:43:34.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4215946839 learned_addr learned my addr 172.21.15.2:0/4215946839 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:34.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 0x7fdd080d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107667367 0 0) 0x7fdd000014a0 con 0x7fdd080cfe40 2023-11-04T01:43:34.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf4003530 con 0x7fdd080cfe40 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2331879476 0 0) 0x7fdcf4003530 con 0x7fdd080cfe40 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 msgr2=0x7fdd080d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 0x7fdd080d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 >> v1:172.21.15.90:6789/0 conn(0x7fdd080b27d0 legacy=0x7fdd080b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080d0af0 con 0x7fdd080cfe40 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fdd00001b90 con 0x7fdd080cfe40 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 >> v1:172.21.15.2:6789/0 conn(0x7fdd080cfe40 legacy=0x7fdd0806f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf40039b0 0x7fdcf4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 0x7fdcf40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcf4004d10 0x7fdcf4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0815f4f0 con 0x7fdcf4004d10 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf400ba40 con 0x7fdcf40039b0 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf400bc00 con 0x7fdd0815b150 2023-11-04T01:43:34.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcf4004d10 0x7fdcf4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf40039b0 0x7fdcf4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.485+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 0x7fdcf40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 msgr2=0x7fdcf40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd0815b150 0x7fdcf40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf40039b0 msgr2=0x7fdcf4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf40039b0 0x7fdcf4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4215946839 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4003530 con 0x7fdcf4004d10 2023-11-04T01:43:34.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf40039b0 0x7fdcf4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcf4004d10 0x7fdcf4005190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000a840 tx=0x7fdd0001d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d1fe1081ba05c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000ad630 con 0x7fdcf4004d10 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000a8070 con 0x7fdcf4004d10 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdcfffff640 1 -- 172.21.15.2:0/4215946839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000ad9f0 con 0x7fdcf4004d10 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4215946839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcf4004d10 msgr2=0x7fdcf4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0f6f9640 1 --2- 172.21.15.2:0/4215946839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdcf4004d10 0x7fdcf4005190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000a840 tx=0x7fdd0001d320 comp rx=0 tx=0).stop 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4215946839 reap_dead start 2023-11-04T01:43:34.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4215946839 shutdown_connections 2023-11-04T01:43:34.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4215946839 >> 172.21.15.2:0/4215946839 conn(0x7fdd080cd7d0 msgr2=0x7fdd080cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4215946839 shutdown_connections 2023-11-04T01:43:34.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.489+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4215946839 wait complete. 2023-11-04T01:43:34.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 Processor -- start 2023-11-04T01:43:34.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 -- start start 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf4004d10 0x7fdd08153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd081591d0 0x7fdd0815d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080c9f60 0x7fdd080ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080ca920 con 0x7fdd080c9f60 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08157710 con 0x7fdcf4004d10 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08153b40 con 0x7fdd081591d0 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080c9f60 0x7fdd080ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080c9f60 0x7fdd080ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45924/0 (socket says 172.21.15.2:45924) 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4222643414 learned_addr learned my addr 172.21.15.2:0/4222643414 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:34.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf4004d10 0x7fdd08153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd081591d0 0x7fdd0815d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd081591d0 msgr2=0x7fdd0815d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd081591d0 0x7fdd0815d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf4004d10 msgr2=0x7fdd08153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf4004d10 0x7fdd08153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 -- 172.21.15.2:0/4222643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0815ddc0 con 0x7fdd080c9f60 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd081591d0 0x7fdd0815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080c9f60 0x7fdd080ca3e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd0001d150 tx=0x7fdcf4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdcfdffb640 1 -- 172.21.15.2:0/4222643414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000011d0 con 0x7fdd080c9f60 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdcfdffb640 1 -- 172.21.15.2:0/4222643414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00001950 con 0x7fdd080c9f60 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdcfdffb640 1 -- 172.21.15.2:0/4222643414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00004b70 con 0x7fdd080c9f60 2023-11-04T01:43:34.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0815e0a0 con 0x7fdd080c9f60 2023-11-04T01:43:34.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd081573a0 con 0x7fdd080c9f60 2023-11-04T01:43:34.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.493+0000 7fdcfdffb640 1 -- 172.21.15.2:0/4222643414 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd000aa030 con 0x7fdd080c9f60 2023-11-04T01:43:34.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdcfdffb640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcec0664a0 0x7fdcec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdcfdffb640 1 -- 172.21.15.2:0/4222643414 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd0011dc00 con 0x7fdd080c9f60 2023-11-04T01:43:34.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcec0664a0 0x7fdcec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 Processor -- start 2023-11-04T01:43:34.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- start start 2023-11-04T01:43:34.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcec0664a0 0x7fdcec068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001210 tx=0x7fdd04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854e6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e68c0 0x561f85499600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f85499f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f85364460 con 0x561f85499b40 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f852f5690 con 0x561f854e68c0 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f852f2bc0 con 0x561f854e5fa0 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f85499f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f85499f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45938/0 (socket says 172.21.15.2:45938) 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 -- 172.21.15.2:0/635639187 learned_addr learned my addr 172.21.15.2:0/635639187 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e68c0 0x561f85499600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0d495640 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 -- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 msgr2=0x561f854e6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854e6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 -- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e68c0 msgr2=0x561f85499600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e68c0 0x561f85499600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 -- 172.21.15.2:0/635639187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f84fe6890 con 0x561f85499b40 2023-11-04T01:43:34.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0d495640 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f85499f20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd000f6b10 tx=0x7fdd000eec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6758a5c3bc74a743 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdceaffd640 1 -- 172.21.15.2:0/635639187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000f7040 con 0x561f85499b40 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdceaffd640 1 -- 172.21.15.2:0/635639187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000ecea0 con 0x561f85499b40 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdceaffd640 1 -- 172.21.15.2:0/635639187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000eb470 con 0x561f85499b40 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- 172.21.15.2:0/635639187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 msgr2=0x561f85499f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f85499f20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdd000f6b10 tx=0x7fdd000eec60 comp rx=0 tx=0).stop 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- 172.21.15.2:0/635639187 shutdown_connections 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f85499f20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e68c0 0x561f85499600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 --2- 172.21.15.2:0/635639187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- 172.21.15.2:0/635639187 >> 172.21.15.2:0/635639187 conn(0x561f854c6d40 msgr2=0x561f854c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- 172.21.15.2:0/635639187 shutdown_connections 2023-11-04T01:43:34.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.497+0000 7fdd12826000 1 -- 172.21.15.2:0/635639187 wait complete. 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- start start 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 Processor -- start 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f8549f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 0x561f8549f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e68c0 0x561f8549fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f852ee4b0 con 0x561f85499b40 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f852a6aa0 con 0x561f854e5fa0 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f852ac940 con 0x561f854e68c0 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 10 client.0 _ll_register_callbacks cb 0x561f85487460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:34.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f8549f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f8549f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45950/0 (socket says 172.21.15.2:45950) 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 -- 172.21.15.2:0/4064061442 learned_addr learned my addr 172.21.15.2:0/4064061442 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0dc96640 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e68c0 0x561f8549fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 0x561f8549f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 -- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e68c0 msgr2=0x561f8549fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e68c0 0x561f8549fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 -- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 msgr2=0x561f8549f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 0x561f8549f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 -- 172.21.15.2:0/4064061442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd081573a0 con 0x561f85499b40 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0d495640 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f8549f080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd04012010 tx=0x7fdd040011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df707db3a6dae7b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 1 -- 172.21.15.2:0/4064061442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04014720 con 0x561f85499b40 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 1 -- 172.21.15.2:0/4064061442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd0401a040 con 0x561f85499b40 2023-11-04T01:43:34.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f852abe10 con 0x561f85499b40 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 1 -- 172.21.15.2:0/4064061442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd04014880 con 0x561f85499b40 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 10 client.5484 fetch_fsmap learned FSMap version 14 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x561f852af1a0 con 0x561f85499b40 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 1 -- 172.21.15.2:0/4064061442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f852abe10 con 0x561f85499b40 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 1 -- 172.21.15.2:0/4064061442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdd040149e0 con 0x561f85499b40 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 10 client.5484 fetch_fsmap finished waiting for FSMap version 14 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 10 client.5484 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 20 client.5484 populate_metadata read hostname 'smithi002' 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854f5240 0x561f854f7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 4 client.5484 mds_command: new command op to 5313 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 --> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f852ece00 con 0x561f854f5240 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854f5240 0x561f854f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854f5240 0x561f854f7630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f424c9bf6978a7 server_cookie=d5bce77df313d027 in_seq=0 out_seq=0 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 10 client.5484 ms_handle_connect on v2:172.21.15.2:6833/610836033 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 1 -- 172.21.15.2:0/4064061442 <== mds.0 v2:172.21.15.2:6833/610836033 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561f852ece00 con 0x561f854f5240 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 10 client.5484 handle_command_reply: tid=0 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 client.5484 shutdown 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 msgr2=0x561f8549f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f8549f080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdd04012010 tx=0x7fdd040011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 shutdown_connections 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854f5240 0x561f854f7630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e68c0 0x561f8549fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 0x561f8549f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 --2- 172.21.15.2:0/4064061442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f8549f080 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdce3fff640 0 client.5484 ms_handle_reset on v2:172.21.15.2:6833/610836033 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 >> 172.21.15.2:0/4064061442 conn(0x561f854c6d40 msgr2=0x561f854c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 shutdown_connections 2023-11-04T01:43:34.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.501+0000 7fdd12826000 1 -- 172.21.15.2:0/4064061442 wait complete. 2023-11-04T01:43:34.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.505+0000 7fdd12826000 20 client.5484 trim_cache size 0 max 16384 2023-11-04T01:43:34.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.517+0000 7fdd12826000 1 Processor -- start 2023-11-04T01:43:34.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.517+0000 7fdd12826000 1 -- start start 2023-11-04T01:43:34.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854c6d40 0x561f854a1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f854a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854f7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f854996f0 con 0x561f85499b40 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f84fa7940 con 0x561f854c6d40 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f852ed340 con 0x561f854e5fa0 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f854a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f854a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45958/0 (socket says 172.21.15.2:45958) 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/2605190131 learned_addr learned my addr 172.21.15.2:0/2605190131 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0d495640 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854c6d40 0x561f854a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/2605190131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 msgr2=0x561f854f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/2605190131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854c6d40 msgr2=0x561f854a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854c6d40 0x561f854a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/2605190131 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f852954a0 con 0x561f85499b40 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f854a1dc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x561f852ed100 tx=0x7fdcf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2068896b5c8a1e78 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdceb7fe640 1 -- 172.21.15.2:0/2605190131 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf801c040 con 0x561f85499b40 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdceb7fe640 1 -- 172.21.15.2:0/2605190131 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8018ca0 con 0x561f85499b40 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdceb7fe640 1 -- 172.21.15.2:0/2605190131 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf801f550 con 0x561f85499b40 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- 172.21.15.2:0/2605190131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 msgr2=0x561f854a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f854a1dc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x561f852ed100 tx=0x7fdcf8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- 172.21.15.2:0/2605190131 shutdown_connections 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f854e5fa0 0x561f854f7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f85499b40 0x561f854a1dc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- 172.21.15.2:0/2605190131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854c6d40 0x561f854a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- 172.21.15.2:0/2605190131 >> 172.21.15.2:0/2605190131 conn(0x561f85498f20 msgr2=0x561f854e4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- 172.21.15.2:0/2605190131 shutdown_connections 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- 172.21.15.2:0/2605190131 wait complete. 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- start start 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 Processor -- start 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f85499b40 0x561f85543bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f854c6d40 0x561f85544100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 0x561f85544640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f8532e830 con 0x561f854c6d40 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f852ebcc0 con 0x561f854e5fa0 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f852f1010 con 0x561f85499b40 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd12826000 10 client.0 _ll_register_callbacks cb 0x7fdd0000a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f854c6d40 0x561f85544100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f854c6d40 0x561f85544100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45966/0 (socket says 172.21.15.2:45966) 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/52266673 learned_addr learned my addr 172.21.15.2:0/52266673 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/52266673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f85499b40 msgr2=0x561f85543bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f85499b40 0x561f85543bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/52266673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 msgr2=0x561f85544640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 0x561f85544640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 -- 172.21.15.2:0/52266673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf8009900 con 0x561f854c6d40 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdd0cc94640 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f854c6d40 0x561f85544100 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x561f8528c350 tx=0x7fdd04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60295f077797b7e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.521+0000 7fdce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 1 -- 172.21.15.2:0/52266673 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf801f740 con 0x561f854c6d40 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 1 -- 172.21.15.2:0/52266673 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcf802c070 con 0x561f854c6d40 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f852b8d10 con 0x561f854c6d40 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 1 -- 172.21.15.2:0/52266673 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf801f8a0 con 0x561f854c6d40 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 10 client.5490 fetch_fsmap learned FSMap version 14 2023-11-04T01:43:34.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x561f84fe6cc0 con 0x561f854c6d40 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 1 -- 172.21.15.2:0/52266673 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561f852b8d10 con 0x561f854c6d40 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 1 -- 172.21.15.2:0/52266673 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 14) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdcf801f050 con 0x561f854c6d40 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 10 client.5490 fetch_fsmap finished waiting for FSMap version 14 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 10 client.5490 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 20 client.5490 populate_metadata read hostname 'smithi002' 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854e68c0 0x561f85544b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 4 client.5490 mds_command: new command op to 5313 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 --> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561f852e7490 con 0x561f854e68c0 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0d495640 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854e68c0 0x561f85544b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 10 client.5490 ms_handle_connect on v2:172.21.15.2:6833/610836033 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0d495640 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854e68c0 0x561f85544b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e6dca5b9a72ca0 server_cookie=58d1a45ef3b7822a in_seq=0 out_seq=0 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 1 -- 172.21.15.2:0/52266673 <== mds.0 v2:172.21.15.2:6833/610836033 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561f852e7490 con 0x561f854e68c0 2023-11-04T01:43:34.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 10 client.5490 handle_command_reply: tid=0 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 client.5490 shutdown 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f854c6d40 msgr2=0x561f85544100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f854c6d40 0x561f85544100 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x561f8528c350 tx=0x7fdd04014000 comp rx=0 tx=0).stop 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 shutdown_connections 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561f854e5fa0 0x561f85544640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561f854c6d40 0x561f85544100 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.2:6833/610836033,v1:172.21.15.2:6835/610836033] conn(0x561f854e68c0 0x561f85544b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 --2- 172.21.15.2:0/52266673 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561f85499b40 0x561f85543bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdce3fff640 0 client.5490 ms_handle_reset on v2:172.21.15.2:6833/610836033 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 >> 172.21.15.2:0/52266673 conn(0x561f85498f20 msgr2=0x561f854a1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 shutdown_connections 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 1 -- 172.21.15.2:0/52266673 wait complete. 2023-11-04T01:43:34.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd12826000 20 client.5490 trim_cache size 0 max 16384 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5313, 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 5.7307094709999999, 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 14, 2023-11-04T01:43:34.592 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 34, 2023-11-04T01:43:34.593 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 34, 2023-11-04T01:43:34.593 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 12.828991566999999 2023-11-04T01:43:34.593 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcec0664a0 msgr2=0x7fdcec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcec0664a0 0x7fdcec068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001210 tx=0x7fdd04009040 comp rx=0 tx=0).stop 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080c9f60 msgr2=0x7fdd080ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080c9f60 0x7fdd080ca3e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fdd0001d150 tx=0x7fdcf4005800 comp rx=0 tx=0).stop 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 shutdown_connections 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcec0664a0 0x7fdcec068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd080c9f60 0x7fdd080ca3e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd081591d0 0x7fdd0815d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 --2- 172.21.15.2:0/4222643414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdcf4004d10 0x7fdd08153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 >> 172.21.15.2:0/4222643414 conn(0x7fdd080cd7d0 msgr2=0x7fdd08166400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 shutdown_connections 2023-11-04T01:43:34.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.525+0000 7fdd0f6f9640 1 -- 172.21.15.2:0/4222643414 wait complete. 2023-11-04T01:43:34.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:43:34.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a2d7f8640 1 Processor -- start 2023-11-04T01:43:34.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a2d7f8640 1 -- start start 2023-11-04T01:43:34.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a2d7f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 0x7f7a280704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a2d7f8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a280ccee0 con 0x7f7a280cdea0 2023-11-04T01:43:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a2d7f8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2815a5d0 con 0x7f7a2815a1f0 2023-11-04T01:43:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a2d7f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280ca900 con 0x7f7a280b0d40 2023-11-04T01:43:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a267fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7a280cdea0 0x7f7a280b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52624/0 (socket says 172.21.15.2:52624) 2023-11-04T01:43:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a267fc640 1 -- 172.21.15.2:0/1820729352 learned_addr learned my addr 172.21.15.2:0/1820729352 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:34.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a277fe640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 0x7f7a280704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808992283 0 0) 0x7f7a280ccee0 con 0x7f7a280cdea0 2023-11-04T01:43:34.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a10003530 con 0x7f7a280cdea0 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851762617 0 0) 0x7f7a10003530 con 0x7f7a280cdea0 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 msgr2=0x7f7a280704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 0x7f7a280704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 >> v1:172.21.15.90:6789/0 conn(0x7f7a2815a1f0 legacy=0x7f7a280cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280cabe0 con 0x7f7a280cdea0 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f7a1c001680 con 0x7f7a280cdea0 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 >> v1:172.21.15.2:6789/0 conn(0x7f7a280cdea0 legacy=0x7f7a280b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a100039b0 0x7f7a10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a100047d0 0x7f7a10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 0x7f7a10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280ca900 con 0x7f7a100039b0 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1000bac0 con 0x7f7a100047d0 2023-11-04T01:43:34.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1000bc80 con 0x7f7a280b0d40 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a100039b0 0x7f7a10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a267fc640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a100047d0 0x7f7a10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a277fe640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 0x7f7a10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a26ffd640 1 -- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 msgr2=0x7f7a10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280b0d40 0x7f7a10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a26ffd640 1 -- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a100047d0 msgr2=0x7f7a10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a100047d0 0x7f7a10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.709+0000 7f7a26ffd640 1 -- 172.21.15.2:0/1820729352 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10003530 con 0x7f7a100039b0 2023-11-04T01:43:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a100039b0 0x7f7a10003dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001780 tx=0x7f7a1801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff26d74aa1799c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a180a4ea0 con 0x7f7a100039b0 2023-11-04T01:43:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a180a7050 con 0x7f7a100039b0 2023-11-04T01:43:34.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a25ffb640 1 -- 172.21.15.2:0/1820729352 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18003600 con 0x7f7a100039b0 2023-11-04T01:43:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/1820729352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a100039b0 msgr2=0x7f7a10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a2d7f8640 1 --2- 172.21.15.2:0/1820729352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a100039b0 0x7f7a10003dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001780 tx=0x7f7a1801c400 comp rx=0 tx=0).stop 2023-11-04T01:43:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a277fe640 1 -- 172.21.15.2:0/1820729352 reap_dead start 2023-11-04T01:43:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/1820729352 shutdown_connections 2023-11-04T01:43:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/1820729352 >> 172.21.15.2:0/1820729352 conn(0x7f7a280cebb0 msgr2=0x7f7a280cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/1820729352 shutdown_connections 2023-11-04T01:43:34.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.713+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/1820729352 wait complete. 2023-11-04T01:43:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 Processor -- start 2023-11-04T01:43:34.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 -- start start 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a281545e0 0x7f7a280a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a281549c0 0x7f7a280aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280ac500 0x7f7a280ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280aced0 con 0x7f7a281549c0 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280a8f60 con 0x7f7a281545e0 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280a9f40 con 0x7f7a280ac500 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a281549c0 0x7f7a280aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a281549c0 0x7f7a280aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45978/0 (socket says 172.21.15.2:45978) 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 -- 172.21.15.2:0/2296603957 learned_addr learned my addr 172.21.15.2:0/2296603957 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a277fe640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280ac500 0x7f7a280ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a281545e0 0x7f7a280a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 -- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280ac500 msgr2=0x7f7a280ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280ac500 0x7f7a280ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 -- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a281545e0 msgr2=0x7f7a280a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a281545e0 0x7f7a280a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 -- 172.21.15.2:0/2296603957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280ab620 con 0x7f7a281549c0 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a277fe640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280ac500 0x7f7a280ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a281545e0 0x7f7a280a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a267fc640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a281549c0 0x7f7a280aec40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00e700 tx=0x7f7a1c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a0f7fe640 1 -- 172.21.15.2:0/2296603957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00c6c0 con 0x7f7a281549c0 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a0f7fe640 1 -- 172.21.15.2:0/2296603957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00c820 con 0x7f7a281549c0 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a280a9200 con 0x7f7a281549c0 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a0f7fe640 1 -- 172.21.15.2:0/2296603957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c00cbb0 con 0x7f7a281549c0 2023-11-04T01:43:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a280ab900 con 0x7f7a281549c0 2023-11-04T01:43:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a280744a0 con 0x7f7a281549c0 2023-11-04T01:43:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a0f7fe640 1 -- 172.21.15.2:0/2296603957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a1c00cd10 con 0x7f7a281549c0 2023-11-04T01:43:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a0f7fe640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a140664a0 0x7f7a14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.717+0000 7f7a0f7fe640 1 -- 172.21.15.2:0/2296603957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a1c083da0 con 0x7f7a281549c0 2023-11-04T01:43:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.721+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a140664a0 0x7f7a14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:34.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.721+0000 7f7a26ffd640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a140664a0 0x7f7a14068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001750 tx=0x7f7a180011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:34.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.725+0000 7f7a0f7fe640 1 -- 172.21.15.2:0/2296603957 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a1c051220 con 0x7f7a281549c0 2023-11-04T01:43:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.909+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7a280a96b0 con 0x7f7a281549c0 2023-11-04T01:43:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.909+0000 7f7a0f7fe640 1 -- 172.21.15.2:0/2296603957 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7a1c054840 con 0x7f7a281549c0 2023-11-04T01:43:34.915 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a140664a0 msgr2=0x7f7a14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a140664a0 0x7f7a14068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7a18001750 tx=0x7f7a180011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a281549c0 msgr2=0x7f7a280aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a281549c0 0x7f7a280aec40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00e700 tx=0x7f7a1c00ebc0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 shutdown_connections 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a140664a0 0x7f7a14068960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a280ac500 0x7f7a280ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a281549c0 0x7f7a280aec40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 --2- 172.21.15.2:0/2296603957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a281545e0 0x7f7a280a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 >> 172.21.15.2:0/2296603957 conn(0x7f7a280cebb0 msgr2=0x7f7a280c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 shutdown_connections 2023-11-04T01:43:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:34.913+0000 7f7a2d7f8640 1 -- 172.21.15.2:0/2296603957 wait complete. 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:43:34.932 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:34.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:34.932 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:43:34.938 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:43:34.938 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:43:34.938 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:43:34.939 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42130sec preferred_lft 42130sec 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:43:34.940 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:43:34.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:34.942 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:43:34.994 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:43:34.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:34.996 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:43:35.045 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:43:35.045 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:43:35.046 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:43:35.046 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:43:35.046 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:43:35.046 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:43:35.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:35.046 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:43:35.046 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:43:35.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:43:35.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:43:35.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:43:35.046 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:43:35.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:35.123 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:43:35.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:43:35.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:43:35.172 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:35.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:35.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:43:35.227 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:43:35.227 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:35.227 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:35.276 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:43:35.276 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:43:35.276 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:35.324 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:35.372 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:43:35.373 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:43:35.374 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:43:35.375 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:35.376 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:35.376 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:35.376 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:35.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:35.377 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:43:35.428 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:43:35.428 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:43:35.473 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:43:35.480 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:43:35.481 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:35.482 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:35.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:35.483 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:43:35.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:43:35.553+0000 7fe94a546580 -1 init, newargv = 0x564be38289a0 newargc=15 2023-11-04T01:43:35.559 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[47987]: starting ceph client 2023-11-04T01:43:35.566 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[47987]: starting fuse 2023-11-04T01:43:36.628 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:43:36.636 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:43:36.636 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:43:36.636 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:43:36.636 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:43:36.636 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:43:36.636 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:43:36.637 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:43:36.638 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:36.639 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:43:36.639 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:36.639 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:43:36.639 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:36.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:36.640 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:43:36.688 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:43:36.688 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:43:36.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:43:36.688 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:43:36.689 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:43:36.690 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:43:36.820 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.47987.asok 2023-11-04T01:43:36.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:36.832 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47987.asok 2023-11-04T01:43:36.833 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:36.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.47987.asok status 2023-11-04T01:43:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "47987", 2023-11-04T01:43:37.037 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5505, 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 5505 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:43:37.038 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3064643769 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3064643769 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.5505 192.168.0.1:0/3064643769", 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/3064643769", 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 14, 2023-11-04T01:43:37.039 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 34, 2023-11-04T01:43:37.040 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:43:37.040 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:43:37.040 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:43:37.040 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:43:37.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:37.058 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:37.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:43:37.058 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:37.105 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:43:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:37.112 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:37.112 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:37.113 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:37.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:37.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:37.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create snap-test-pool 2023-11-04T01:43:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 Processor -- start 2023-11-04T01:43:37.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 -- start start 2023-11-04T01:43:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815acb0 0x7f255815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f255815c160 0x7f25580b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25580b0a50 0x7f25580ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255815bd40 con 0x7f255815c160 2023-11-04T01:43:37.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255806fd80 con 0x7f25580b0a50 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255ff36640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580b0ee0 con 0x7f255815acb0 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255d4d1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f255815c160 0x7f25580b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255d4d1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f255815c160 0x7f25580b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45984/0 (socket says 172.21.15.2:45984) 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.297+0000 7f255d4d1640 1 -- 172.21.15.2:0/2310181926 learned_addr learned my addr 172.21.15.2:0/2310181926 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255e4d3640 1 --2- 172.21.15.2:0/2310181926 >> v2:172.21.15.90:3300/0 conn(0x7f25580b0a50 0x7f25580ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255dcd2640 1 --2- 172.21.15.2:0/2310181926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815acb0 0x7f255815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255d4d1640 1 -- 172.21.15.2:0/2310181926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815acb0 msgr2=0x7f255815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255d4d1640 1 --2- 172.21.15.2:0/2310181926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815acb0 0x7f255815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255d4d1640 1 -- 172.21.15.2:0/2310181926 >> v2:172.21.15.90:3300/0 conn(0x7f25580b0a50 msgr2=0x7f25580ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255d4d1640 1 --2- 172.21.15.2:0/2310181926 >> v2:172.21.15.90:3300/0 conn(0x7f25580b0a50 0x7f25580ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255d4d1640 1 -- 172.21.15.2:0/2310181926 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580cb130 con 0x7f255815c160 2023-11-04T01:43:37.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255dcd2640 1 --2- 172.21.15.2:0/2310181926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815acb0 0x7f255815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:37.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255d4d1640 1 --2- 172.21.15.2:0/2310181926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815c160 0x7f25580b0510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f255806d5c0 tx=0x7f255401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6db168257dcc69 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ccd0640 1 -- 172.21.15.2:0/2310181926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540aa5f0 con 0x7f255815c160 2023-11-04T01:43:37.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ccd0640 1 -- 172.21.15.2:0/2310181926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25540aa750 con 0x7f255815c160 2023-11-04T01:43:37.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ccd0640 1 -- 172.21.15.2:0/2310181926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540aaae0 con 0x7f255815c160 2023-11-04T01:43:37.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 -- 172.21.15.2:0/2310181926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815c160 msgr2=0x7f25580b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 --2- 172.21.15.2:0/2310181926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815c160 0x7f25580b0510 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f255806d5c0 tx=0x7f255401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 -- 172.21.15.2:0/2310181926 shutdown_connections 2023-11-04T01:43:37.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 --2- 172.21.15.2:0/2310181926 >> v2:172.21.15.90:3300/0 conn(0x7f25580b0a50 0x7f25580ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 --2- 172.21.15.2:0/2310181926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815c160 0x7f25580b0510 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 --2- 172.21.15.2:0/2310181926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815acb0 0x7f255815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 -- 172.21.15.2:0/2310181926 >> 172.21.15.2:0/2310181926 conn(0x7f25580cb510 msgr2=0x7f25580cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 -- 172.21.15.2:0/2310181926 shutdown_connections 2023-11-04T01:43:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.301+0000 7f255ff36640 1 -- 172.21.15.2:0/2310181926 wait complete. 2023-11-04T01:43:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 Processor -- start 2023-11-04T01:43:37.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 -- start start 2023-11-04T01:43:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25580b0a50 0x7f2558152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815acb0 0x7f25580c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815c160 0x7f25580c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255814e2e0 con 0x7f255815acb0 2023-11-04T01:43:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c6a20 con 0x7f25580b0a50 2023-11-04T01:43:37.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c6740 con 0x7f255815c160 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815acb0 0x7f25580c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815acb0 0x7f25580c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45990/0 (socket says 172.21.15.2:45990) 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 -- 172.21.15.2:0/553098257 learned_addr learned my addr 172.21.15.2:0/553098257 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255dcd2640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25580b0a50 0x7f2558152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 -- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815c160 msgr2=0x7f25580c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255e4d3640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815c160 0x7f25580c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815c160 0x7f25580c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 -- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25580b0a50 msgr2=0x7f2558152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25580b0a50 0x7f2558152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 -- 172.21.15.2:0/553098257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540094d0 con 0x7f255815acb0 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255dcd2640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25580b0a50 0x7f2558152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:37.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255d4d1640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815acb0 0x7f25580c5b60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f25540ac040 tx=0x7f255401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f254a7fc640 1 -- 172.21.15.2:0/553098257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540b3800 con 0x7f255815acb0 2023-11-04T01:43:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f254a7fc640 1 -- 172.21.15.2:0/553098257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25540b3980 con 0x7f255815acb0 2023-11-04T01:43:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2558139ae0 con 0x7f255815acb0 2023-11-04T01:43:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255813a0a0 con 0x7f255815acb0 2023-11-04T01:43:37.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f254a7fc640 1 -- 172.21.15.2:0/553098257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540b3d30 con 0x7f255815acb0 2023-11-04T01:43:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2540005260 con 0x7f255815acb0 2023-11-04T01:43:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.305+0000 7f254a7fc640 1 -- 172.21.15.2:0/553098257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25540bd3f0 con 0x7f255815acb0 2023-11-04T01:43:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.309+0000 7f254a7fc640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f253c0664a0 0x7f253c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.309+0000 7f254a7fc640 1 -- 172.21.15.2:0/553098257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25540a7070 con 0x7f255815acb0 2023-11-04T01:43:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.309+0000 7f255dcd2640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f253c0664a0 0x7f253c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.309+0000 7f255dcd2640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f253c0664a0 0x7f253c068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f254c006fd0 tx=0x7f254c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.313+0000 7f254a7fc640 1 -- 172.21.15.2:0/553098257 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25540ebe20 con 0x7f255815acb0 2023-11-04T01:43:37.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.473+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "snap-test-pool"} v 0) v1 -- 0x7f25400057e0 con 0x7f255815acb0 2023-11-04T01:43:37.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.817+0000 7f254a7fc640 1 -- 172.21.15.2:0/553098257 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "snap-test-pool"}]=0 pool 'snap-test-pool' created v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7f25540ef440 con 0x7f255815acb0 2023-11-04T01:43:37.821 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'snap-test-pool' created 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f253c0664a0 msgr2=0x7f253c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f253c0664a0 0x7f253c068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f254c006fd0 tx=0x7f254c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815acb0 msgr2=0x7f25580c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815acb0 0x7f25580c5b60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f25540ac040 tx=0x7f255401ad10 comp rx=0 tx=0).stop 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 shutdown_connections 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f253c0664a0 0x7f253c068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f255815c160 0x7f25580c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f255815acb0 0x7f25580c5b60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 --2- 172.21.15.2:0/553098257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25580b0a50 0x7f2558152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 >> 172.21.15.2:0/553098257 conn(0x7f25580cb510 msgr2=0x7f255815d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 shutdown_connections 2023-11-04T01:43:37.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.821+0000 7f255ff36640 1 -- 172.21.15.2:0/553098257 wait complete. 2023-11-04T01:43:37.851 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool mksnap snap3 2023-11-04T01:43:37.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 Processor -- start 2023-11-04T01:43:37.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 -- start start 2023-11-04T01:43:37.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd493060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd4955b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd320fc0 con 0x55cddd478150 2023-11-04T01:43:37.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd320cc0 con 0x55cddd3ec8f0 2023-11-04T01:43:37.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876f31c080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cddd2f72c0 con 0x55cddd478530 2023-11-04T01:43:37.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876c63a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd4955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876c63a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd4955b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46016/0 (socket says 172.21.15.2:46016) 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876c63a640 1 -- 172.21.15.2:0/3026036133 learned_addr learned my addr 172.21.15.2:0/3026036133 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876ce3b640 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd493060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.877+0000 7f876d63c640 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 -- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 msgr2=0x55cddd48d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 -- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 msgr2=0x55cddd493060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd493060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 -- 172.21.15.2:0/3026036133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754005df0 con 0x55cddd478150 2023-11-04T01:43:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876ce3b640 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd493060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd4955b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8754019ac0 tx=0x7f8754003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b738796edc8caa4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876b638640 1 -- 172.21.15.2:0/3026036133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540b5740 con 0x55cddd478150 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876b638640 1 -- 172.21.15.2:0/3026036133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87540b58a0 con 0x55cddd478150 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876b638640 1 -- 172.21.15.2:0/3026036133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540b5c50 con 0x55cddd478150 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- 172.21.15.2:0/3026036133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 msgr2=0x55cddd4955b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd4955b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8754019ac0 tx=0x7f8754003030 comp rx=0 tx=0).stop 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- 172.21.15.2:0/3026036133 shutdown_connections 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd4955b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 --2- 172.21.15.2:0/3026036133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd493060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- 172.21.15.2:0/3026036133 >> 172.21.15.2:0/3026036133 conn(0x55cddd3e89e0 msgr2=0x55cddd3eb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:37.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- 172.21.15.2:0/3026036133 shutdown_connections 2023-11-04T01:43:37.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- 172.21.15.2:0/3026036133 wait complete. 2023-11-04T01:43:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 Processor -- start 2023-11-04T01:43:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- start start 2023-11-04T01:43:37.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd474e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd48b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd48f310 con 0x55cddd478150 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd526820 con 0x55cddd3ec8f0 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cddd48f540 con 0x55cddd478530 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd48b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876ce3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd474e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876ce3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd474e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:45882/0 (socket says 172.21.15.2:45882) 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876ce3b640 1 -- 172.21.15.2:0/4038055515 learned_addr learned my addr 172.21.15.2:0/4038055515 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd48b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46028/0 (socket says 172.21.15.2:46028) 2023-11-04T01:43:37.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876d63c640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 -- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 msgr2=0x55cddd48bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 -- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 msgr2=0x55cddd474e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd474e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 -- 172.21.15.2:0/4038055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cddd302240 con 0x55cddd478150 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876d63c640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876c63a640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd48b770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f87540b7000 tx=0x7f87540181b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540c7640 con 0x55cddd478150 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87540c77a0 con 0x55cddd478150 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cddd329410 con 0x55cddd478150 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540c7b50 con 0x55cddd478150 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.881+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cddd30f420 con 0x55cddd478150 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.885+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87540b1040 con 0x55cddd478150 2023-11-04T01:43:37.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.885+0000 7f876a636640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f874c064e50 0x7f874c067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.885+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f875411f2b0 con 0x55cddd478150 2023-11-04T01:43:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.885+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(create snap pool 6 tid 1 name snap3 v0) v4 -- 0x55cddd373110 con 0x55cddd478150 2023-11-04T01:43:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.885+0000 7f876ce3b640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f874c064e50 0x7f874c067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:37.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:37.885+0000 7f876ce3b640 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f874c064e50 0x7f874c067310 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8764005fd0 tx=0x7f8764005b30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:38.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.833+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 <== mon.0 v2:172.21.15.2:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v36) v1 ==== 43+0+0 (secure 0 0 0) 0x7f87540ec6b0 con 0x55cddd478150 2023-11-04T01:43:38.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.833+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=36}) v3 -- 0x7f874c06d690 con 0x55cddd478150 2023-11-04T01:43:38.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.853+0000 7f876a636640 1 -- 172.21.15.2:0/4038055515 <== mon.0 v2:172.21.15.2:3300/0 7 ==== osd_map(36..36 src has 1..36) v4 ==== 718+0+0 (secure 0 0 0) 0x7f87540f0330 con 0x55cddd478150 2023-11-04T01:43:38.861 INFO:teuthology.orchestra.run.smithi002.stdout:created pool snap-test-pool snap snap3 2023-11-04T01:43:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f874c064e50 msgr2=0x7f874c067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f874c064e50 0x7f874c067310 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8764005fd0 tx=0x7f8764005b30 comp rx=0 tx=0).stop 2023-11-04T01:43:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 msgr2=0x55cddd48b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd48b770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f87540b7000 tx=0x7f87540181b0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 shutdown_connections 2023-11-04T01:43:38.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f874c064e50 0x7f874c067310 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cddd478530 0x55cddd48bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cddd478150 0x55cddd48b770 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.857+0000 7f876f31c080 1 --2- 172.21.15.2:0/4038055515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cddd3ec8f0 0x55cddd474e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:38.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.861+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 >> 172.21.15.2:0/4038055515 conn(0x55cddd3e89e0 msgr2=0x55cddd495280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:38.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.861+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 shutdown_connections 2023-11-04T01:43:38.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:38.861+0000 7f876f31c080 1 -- 172.21.15.2:0/4038055515 wait complete. 2023-11-04T01:43:38.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs snap-test-pool 2023-11-04T01:43:39.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.041+0000 7ff66117d640 1 Processor -- start 2023-11-04T01:43:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.041+0000 7ff66117d640 1 -- start start 2023-11-04T01:43:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff66117d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff65c15acb0 0x7ff65c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff66117d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 0x7ff65c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff66117d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c0cb130 con 0x7ff65c0b0a50 2023-11-04T01:43:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff66117d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c15bd40 con 0x7ff65c15acb0 2023-11-04T01:43:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff66117d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c06fd80 con 0x7ff65c15c160 2023-11-04T01:43:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff65c0b0a50 0x7ff65c0ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52640/0 (socket says 172.21.15.2:52640) 2023-11-04T01:43:39.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 -- 172.21.15.2:0/743119624 learned_addr learned my addr 172.21.15.2:0/743119624 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65ad9d640 1 --2- 172.21.15.2:0/743119624 >> v2:172.21.15.90:3300/0 conn(0x7ff65c15acb0 0x7ff65c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65a59c640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 0x7ff65c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600960553 0 0) 0x7ff65c0cb130 con 0x7ff65c0b0a50 2023-11-04T01:43:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff63c003530 con 0x7ff65c0b0a50 2023-11-04T01:43:39.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2186941033 0 0) 0x7ff63c003530 con 0x7ff65c0b0a50 2023-11-04T01:43:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 msgr2=0x7ff65c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 0x7ff65c0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 >> v2:172.21.15.90:3300/0 conn(0x7ff65c15acb0 msgr2=0x7ff65c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 --2- 172.21.15.2:0/743119624 >> v2:172.21.15.90:3300/0 conn(0x7ff65c15acb0 0x7ff65c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c15b680 con 0x7ff65c0b0a50 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff654001680 con 0x7ff65c0b0a50 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 >> v1:172.21.15.2:6789/0 conn(0x7ff65c0b0a50 legacy=0x7ff65c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff63c003980 0x7ff63c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 0x7ff63c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff63c004d10 0x7ff63c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c15bd40 con 0x7ff63c004d10 2023-11-04T01:43:39.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c00b990 con 0x7ff63c003980 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c00bad0 con 0x7ff65c15c160 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff63c004d10 0x7ff63c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65a59c640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 0x7ff63c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65ad9d640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff63c003980 0x7ff63c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 -- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 msgr2=0x7ff63c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c15c160 0x7ff63c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 -- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff63c003980 msgr2=0x7ff63c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff63c003980 0x7ff63c003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.044+0000 7ff65b59e640 1 -- 172.21.15.2:0/743119624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c003530 con 0x7ff63c004d10 2023-11-04T01:43:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65b59e640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff63c004d10 0x7ff63c005190 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c210 tx=0x7ff65401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53238da3b9c33949 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540a5940 con 0x7ff63c004d10 2023-11-04T01:43:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540a5aa0 con 0x7ff63c004d10 2023-11-04T01:43:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff659d9b640 1 -- 172.21.15.2:0/743119624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540a5e50 con 0x7ff63c004d10 2023-11-04T01:43:39.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- 172.21.15.2:0/743119624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff63c004d10 msgr2=0x7ff63c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 --2- 172.21.15.2:0/743119624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff63c004d10 0x7ff63c005190 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c210 tx=0x7ff65401cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65b59e640 1 -- 172.21.15.2:0/743119624 reap_dead start 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- 172.21.15.2:0/743119624 shutdown_connections 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- 172.21.15.2:0/743119624 >> 172.21.15.2:0/743119624 conn(0x7ff65c0cb510 msgr2=0x7ff65c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- 172.21.15.2:0/743119624 shutdown_connections 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- 172.21.15.2:0/743119624 wait complete. 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 Processor -- start 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- start start 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff65c0aebd0 0x7ff65c1f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c0aefb0 0x7ff65c156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff65c156960 0x7ff65c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c153c50 con 0x7ff65c0aebd0 2023-11-04T01:43:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c153f30 con 0x7ff65c156960 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff66117d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c1f3c40 con 0x7ff65c0aefb0 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff65c0aebd0 0x7ff65c1f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff65c0aebd0 0x7ff65c1f4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46040/0 (socket says 172.21.15.2:46040) 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 -- 172.21.15.2:0/882103193 learned_addr learned my addr 172.21.15.2:0/882103193 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65a59c640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c0aefb0 0x7ff65c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65b59e640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff65c156960 0x7ff65c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 -- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c0aefb0 msgr2=0x7ff65c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff65c0aefb0 0x7ff65c156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 -- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff65c156960 msgr2=0x7ff65c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff65c156960 0x7ff65c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65ad9d640 1 -- 172.21.15.2:0/882103193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c1f3f20 con 0x7ff65c0aebd0 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.048+0000 7ff65b59e640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff65c156960 0x7ff65c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff65ad9d640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff65c0aebd0 0x7ff65c1f4720 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00f3d0 tx=0x7ff64c00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff6537fe640 1 -- 172.21.15.2:0/882103193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c016620 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff6537fe640 1 -- 172.21.15.2:0/882103193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c0167a0 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff66117d640 1 -- 172.21.15.2:0/882103193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c1f4200 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff6537fe640 1 -- 172.21.15.2:0/882103193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c016b50 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff66117d640 1 -- 172.21.15.2:0/882103193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c15ece0 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff66117d640 1 -- 172.21.15.2:0/882103193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0744a0 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff6537fe640 1 -- 172.21.15.2:0/882103193 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff64c016cb0 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff6537fe640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff6400664d0 0x7ff640068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff6537fe640 1 -- 172.21.15.2:0/882103193 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff64c084ed0 con 0x7ff65c0aebd0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff65a59c640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff6400664d0 0x7ff640068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.052+0000 7ff65a59c640 1 --2- 172.21.15.2:0/882103193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff6400664d0 0x7ff640068990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff65c1f3ba0 tx=0x7ff644008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.056+0000 7ff6537fe640 1 -- 172.21.15.2:0/882103193 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff64c0521c0 con 0x7ff65c0aebd0 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.248+0000 7ff66117d640 1 -- 172.21.15.2:0/882103193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"} v 0) v1 -- 0x7ff65c153d90 con 0x7ff65c0aebd0 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.248+0000 7ff6537fe640 1 -- 172.21.15.2:0/882103193 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "snap-test-pool"}]=-95 pool(6) already has mon-managed snaps; can't attach pool to fs v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff65c153d90 con 0x7ff65c0aebd0 2023-11-04T01:43:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:Error ENOTSUP: pool(6) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:43:39.262 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:43:39.263 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool snap-test-pool rmsnap snap3 2023-11-04T01:43:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 Processor -- start 2023-11-04T01:43:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 -- start start 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4520003600 0x55e82c2b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb420 0x55e82c3ddc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e82c2bb800 0x55e82c3de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82c2298a0 con 0x7f4520003600 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82c225190 con 0x55e82c2bb420 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f4536dbe080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e82c1dcfc0 con 0x55e82c2bb800 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4520003600 0x55e82c2b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4520003600 0x55e82c2b7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46056/0 (socket says 172.21.15.2:46056) 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 -- 172.21.15.2:0/896970414 learned_addr learned my addr 172.21.15.2:0/896970414 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45340dc640 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb420 0x55e82c3ddc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45350de640 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e82c2bb800 0x55e82c3de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 -- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e82c2bb800 msgr2=0x55e82c3de1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e82c2bb800 0x55e82c3de1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 -- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb420 msgr2=0x55e82c3ddc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb420 0x55e82c3ddc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 -- 172.21.15.2:0/896970414 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e82c1be5d0 con 0x7f4520003600 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45348dd640 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4520003600 0x55e82c2b7c50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f452c00d2a0 tx=0x7f452c00d760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8673e2802a9297e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45330da640 1 -- 172.21.15.2:0/896970414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c015030 con 0x7f4520003600 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45330da640 1 -- 172.21.15.2:0/896970414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00ded0 con 0x7f4520003600 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.296+0000 7f45330da640 1 -- 172.21.15.2:0/896970414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c001610 con 0x7f4520003600 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- 172.21.15.2:0/896970414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4520003600 msgr2=0x55e82c2b7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4520003600 0x55e82c2b7c50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f452c00d2a0 tx=0x7f452c00d760 comp rx=0 tx=0).stop 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- 172.21.15.2:0/896970414 shutdown_connections 2023-11-04T01:43:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e82c2bb800 0x55e82c3de1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb420 0x55e82c3ddc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 --2- 172.21.15.2:0/896970414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4520003600 0x55e82c2b7c50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- 172.21.15.2:0/896970414 >> 172.21.15.2:0/896970414 conn(0x55e82c2a49e0 msgr2=0x55e82c34b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- 172.21.15.2:0/896970414 shutdown_connections 2023-11-04T01:43:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- 172.21.15.2:0/896970414 wait complete. 2023-11-04T01:43:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 Processor -- start 2023-11-04T01:43:39.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- start start 2023-11-04T01:43:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82c2bb420 0x55e82c2be200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb800 0x55e82c34a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4520003600 0x55e82c345b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82c1dccc0 con 0x55e82c2bb420 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e82c1b32c0 con 0x55e82c2bb800 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e82c3deb40 con 0x7f4520003600 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82c2bb420 0x55e82c2be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82c2bb420 0x55e82c2be200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46064/0 (socket says 172.21.15.2:46064) 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 -- 172.21.15.2:0/2391929833 learned_addr learned my addr 172.21.15.2:0/2391929833 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45340dc640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb800 0x55e82c34a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45350de640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4520003600 0x55e82c345b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 -- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4520003600 msgr2=0x55e82c345b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4520003600 0x55e82c345b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 -- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb800 msgr2=0x55e82c34a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb800 0x55e82c34a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 -- 172.21.15.2:0/2391929833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e82c1e5410 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45340dc640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb800 0x55e82c34a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45348dd640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82c2bb420 0x55e82c2be200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f452c001b70 tx=0x7f452c0011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c026670 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c0267f0 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e82c1be030 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c026ba0 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.300+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e82c34b070 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.304+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f452c023070 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.304+0000 7f45320d8640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4514064e80 0x7f4514067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.304+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f452c016070 con 0x55e82c2bb420 2023-11-04T01:43:39.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.304+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(delete snap pool 6 tid 1 name snap3 v0) v4 -- 0x55e82c22f110 con 0x55e82c2bb420 2023-11-04T01:43:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.304+0000 7f45340dc640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4514064e80 0x7f4514067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:39.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.304+0000 7f45340dc640 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4514064e80 0x7f4514067340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f451c001c00 tx=0x7f451c000ee0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:39.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 <== mon.0 v2:172.21.15.2:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v37) v1 ==== 43+0+0 (secure 0 0 0) 0x7f452c02b020 con 0x55e82c2bb420 2023-11-04T01:43:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=37}) v3 -- 0x7f451406d6c0 con 0x55e82c2bb420 2023-11-04T01:43:39.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f45320d8640 1 -- 172.21.15.2:0/2391929833 <== mon.0 v2:172.21.15.2:3300/0 7 ==== osd_map(37..37 src has 1..37) v4 ==== 643+0+0 (secure 0 0 0) 0x7f452c0565a0 con 0x55e82c2bb420 2023-11-04T01:43:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:removed pool snap-test-pool snap snap3 2023-11-04T01:43:39.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4514064e80 msgr2=0x7f4514067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4514064e80 0x7f4514067340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f451c001c00 tx=0x7f451c000ee0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82c2bb420 msgr2=0x55e82c2be200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82c2bb420 0x55e82c2be200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f452c001b70 tx=0x7f452c0011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 shutdown_connections 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4514064e80 0x7f4514067340 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4520003600 0x55e82c345b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e82c2bb800 0x55e82c34a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 --2- 172.21.15.2:0/2391929833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82c2bb420 0x55e82c2be200 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 >> 172.21.15.2:0/2391929833 conn(0x55e82c2a49e0 msgr2=0x55e82c2c0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 shutdown_connections 2023-11-04T01:43:39.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:39.856+0000 7f4536dbe080 1 -- 172.21.15.2:0/2391929833 wait complete. 2023-11-04T01:43:39.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete snap-test-pool 2023-11-04T01:43:40.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9e5c86640 1 Processor -- start 2023-11-04T01:43:40.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9e5c86640 1 -- start start 2023-11-04T01:43:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9e5c86640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9e5c86640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9e00cff20 0x7fa9e00d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9e5c86640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e00b5e00 con 0x7fa9e01610f0 2023-11-04T01:43:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9e5c86640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e00d1520 con 0x7fa9e00cff20 2023-11-04T01:43:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9e5c86640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e015d490 con 0x7fa9e015d0b0 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9dffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9e00cff20 0x7fa9e00d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9d7fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa9e01610f0 0x7fa9e00cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52654/0 (socket says 172.21.15.2:52654) 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.040+0000 7fa9d7fff640 1 -- 172.21.15.2:0/2562817544 learned_addr learned my addr 172.21.15.2:0/2562817544 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9df7fe640 1 --2- 172.21.15.2:0/2562817544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9dffff640 1 -- 172.21.15.2:0/2562817544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 msgr2=0x7fa9e0160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9dffff640 1 --2- 172.21.15.2:0/2562817544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e0160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9dffff640 1 -- 172.21.15.2:0/2562817544 >> v1:172.21.15.2:6789/0 conn(0x7fa9e01610f0 legacy=0x7fa9e00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9dffff640 1 -- 172.21.15.2:0/2562817544 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00b8930 con 0x7fa9e00cff20 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9deffd640 1 -- 172.21.15.2:0/2562817544 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084684788 0 0) 0x7fa9e00b5e00 con 0x7fa9e01610f0 2023-11-04T01:43:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9df7fe640 1 --2- 172.21.15.2:0/2562817544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e0160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9dffff640 1 --2- 172.21.15.2:0/2562817544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 0x7fa9e00d1940 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c120f97bb356383 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9deffd640 1 -- 172.21.15.2:0/2562817544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80a5920 con 0x7fa9e00cff20 2023-11-04T01:43:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9deffd640 1 -- 172.21.15.2:0/2562817544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80a5a80 con 0x7fa9e00cff20 2023-11-04T01:43:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9deffd640 1 -- 172.21.15.2:0/2562817544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80a5e10 con 0x7fa9e00cff20 2023-11-04T01:43:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 -- 172.21.15.2:0/2562817544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 msgr2=0x7fa9e00d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 --2- 172.21.15.2:0/2562817544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 0x7fa9e00d1940 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009d90 tx=0x7fa9d801c950 comp rx=0 tx=0).stop 2023-11-04T01:43:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 -- 172.21.15.2:0/2562817544 shutdown_connections 2023-11-04T01:43:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 --2- 172.21.15.2:0/2562817544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 0x7fa9e00d1940 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 --2- 172.21.15.2:0/2562817544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e0160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 -- 172.21.15.2:0/2562817544 >> 172.21.15.2:0/2562817544 conn(0x7fa9e006a890 msgr2=0x7fa9e006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 -- 172.21.15.2:0/2562817544 shutdown_connections 2023-11-04T01:43:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.044+0000 7fa9e5c86640 1 -- 172.21.15.2:0/2562817544 wait complete. 2023-11-04T01:43:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 Processor -- start 2023-11-04T01:43:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 -- start start 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 0x7fa9e0159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e01610f0 0x7fa9e014d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e015d880 con 0x7fa9e00cff20 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e015bdb0 con 0x7fa9e01610f0 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e015c090 con 0x7fa9e015d0b0 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 0x7fa9e0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 0x7fa9e0159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46082/0 (socket says 172.21.15.2:46082) 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 -- 172.21.15.2:0/1084802492 learned_addr learned my addr 172.21.15.2:0/1084802492 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9dffff640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e01610f0 0x7fa9e014d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9d7fff640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 -- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 msgr2=0x7fa9e015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e015abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 -- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e01610f0 msgr2=0x7fa9e014d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e01610f0 0x7fa9e014d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 -- 172.21.15.2:0/1084802492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d8009a70 con 0x7fa9e00cff20 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9d7fff640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa9e015d0b0 0x7fa9e015abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9dffff640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9e01610f0 0x7fa9e014d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9df7fe640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e00cff20 0x7fa9e0159730 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000c7c0 tx=0x7fa9d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9dcff9640 1 -- 172.21.15.2:0/1084802492 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0007a30 con 0x7fa9e00cff20 2023-11-04T01:43:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9dcff9640 1 -- 172.21.15.2:0/1084802492 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d0007b90 con 0x7fa9e00cff20 2023-11-04T01:43:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 -- 172.21.15.2:0/1084802492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e015c390 con 0x7fa9e00cff20 2023-11-04T01:43:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9dcff9640 1 -- 172.21.15.2:0/1084802492 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000ce70 con 0x7fa9e00cff20 2023-11-04T01:43:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 -- 172.21.15.2:0/1084802492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e015b130 con 0x7fa9e00cff20 2023-11-04T01:43:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.048+0000 7fa9e5c86640 1 -- 172.21.15.2:0/1084802492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e00b1c90 con 0x7fa9e00cff20 2023-11-04T01:43:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.052+0000 7fa9dcff9640 1 -- 172.21.15.2:0/1084802492 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9d00113f0 con 0x7fa9e00cff20 2023-11-04T01:43:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.052+0000 7fa9dcff9640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9c00664d0 0x7fa9c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.052+0000 7fa9dcff9640 1 -- 172.21.15.2:0/1084802492 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fa9d0084560 con 0x7fa9e00cff20 2023-11-04T01:43:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.052+0000 7fa9d7fff640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9c00664d0 0x7fa9c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.052+0000 7fa9d7fff640 1 --2- 172.21.15.2:0/1084802492 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9c00664d0 0x7fa9c0068990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8007fd0 tx=0x7fa9c8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.056+0000 7fa9dcff9640 1 -- 172.21.15.2:0/1084802492 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa9d00519b0 con 0x7fa9e00cff20 2023-11-04T01:43:40.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.216+0000 7fa9e5c86640 1 -- 172.21.15.2:0/1084802492 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "snap-test-pool"} v 0) v1 -- 0x7fa9e00d0e30 con 0x7fa9e00cff20 2023-11-04T01:43:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.216+0000 7fa9dcff9640 1 -- 172.21.15.2:0/1084802492 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "snap-test-pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v37) v1 ==== 296+0+0 (secure 0 0 0) 0x7fa9d0054fd0 con 0x7fa9e00cff20 2023-11-04T01:43:40.220 INFO:teuthology.orchestra.run.smithi002.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool snap-test-pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:43:40.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:40.227 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:43:40.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:40.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:40.334 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:43:40.334 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:40.334 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:40.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:40.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cce40d640 1 Processor -- start 2023-11-04T01:43:40.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cce40d640 1 -- start start 2023-11-04T01:43:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cce40d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9cc80b1960 0x7f9cc80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cce40d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 0x7f9cc815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cce40d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc80cdc80 con 0x7f9cc80b1d40 2023-11-04T01:43:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cce40d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc8071e40 con 0x7f9cc80b1960 2023-11-04T01:43:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cce40d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc815d730 con 0x7f9cc815cd60 2023-11-04T01:43:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9cc80b1d40 0x7f9cc80ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52666/0 (socket says 172.21.15.2:52666) 2023-11-04T01:43:40.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 -- 172.21.15.2:0/3222304578 learned_addr learned my addr 172.21.15.2:0/3222304578 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc7fff640 1 --2- 172.21.15.2:0/3222304578 >> v2:172.21.15.90:3300/0 conn(0x7f9cc80b1960 0x7f9cc80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9ccc9aa640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 0x7f9cc815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218861331 0 0) 0x7f9cc80cdc80 con 0x7f9cc80b1d40 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb0003530 con 0x7f9cc80b1d40 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3315072819 0 0) 0x7f9cb0003530 con 0x7f9cc80b1d40 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 msgr2=0x7f9cc815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 0x7f9cc815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 >> v2:172.21.15.90:3300/0 conn(0x7f9cc80b1960 msgr2=0x7f9cc80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 --2- 172.21.15.2:0/3222304578 >> v2:172.21.15.90:3300/0 conn(0x7f9cc80b1960 0x7f9cc80cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80cf5a0 con 0x7f9cc80b1d40 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f9cbc0016a0 con 0x7f9cc80b1d40 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 >> v1:172.21.15.2:6789/0 conn(0x7f9cc80b1d40 legacy=0x7f9cc80ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cb0003980 0x7f9cb0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00047d0 0x7f9cb0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 0x7f9cb0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8071e40 con 0x7f9cb00047d0 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc815d730 con 0x7f9cb0003980 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb000b990 con 0x7f9cc815cd60 2023-11-04T01:43:40.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00047d0 0x7f9cb0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9ccc9aa640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 0x7f9cb0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc7fff640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cb0003980 0x7f9cb0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 -- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 msgr2=0x7f9cb0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 0x7f9cb0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 -- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cb0003980 msgr2=0x7f9cb0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cb0003980 0x7f9cb0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc77fe640 1 -- 172.21.15.2:0/3222304578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb0003530 con 0x7f9cb00047d0 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9ccc9aa640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cc815cd60 0x7f9cb0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:40.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.508+0000 7f9cc7fff640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cb0003980 0x7f9cb0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:40.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cc77fe640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00047d0 0x7f9cb0004c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80cde10 tx=0x7f9cbc01f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd2cef52ad83421 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0a8c90 con 0x7f9cb00047d0 2023-11-04T01:43:40.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc0a8df0 con 0x7f9cb00047d0 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cc6ffd640 1 -- 172.21.15.2:0/3222304578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc005b20 con 0x7f9cb00047d0 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 -- 172.21.15.2:0/3222304578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00047d0 msgr2=0x7f9cb0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 --2- 172.21.15.2:0/3222304578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cb00047d0 0x7f9cb0004c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80cde10 tx=0x7f9cbc01f370 comp rx=0 tx=0).stop 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9ccc9aa640 1 -- 172.21.15.2:0/3222304578 reap_dead start 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 -- 172.21.15.2:0/3222304578 shutdown_connections 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 -- 172.21.15.2:0/3222304578 >> 172.21.15.2:0/3222304578 conn(0x7f9cc806e760 msgr2=0x7f9cc806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 -- 172.21.15.2:0/3222304578 shutdown_connections 2023-11-04T01:43:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 -- 172.21.15.2:0/3222304578 wait complete. 2023-11-04T01:43:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 Processor -- start 2023-11-04T01:43:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.512+0000 7f9cce40d640 1 -- start start 2023-11-04T01:43:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cb00047d0 0x7f9cc8157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc8156410 0x7f9cc81600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc8159360 0x7f9cc81597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8159d20 con 0x7f9cc8156410 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8156870 con 0x7f9cc8159360 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8158180 con 0x7f9cb00047d0 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc8156410 0x7f9cc81600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc8156410 0x7f9cc81600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46100/0 (socket says 172.21.15.2:46100) 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 -- 172.21.15.2:0/1247652183 learned_addr learned my addr 172.21.15.2:0/1247652183 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc7fff640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cb00047d0 0x7f9cc8157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9ccc9aa640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc8159360 0x7f9cc81597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 -- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cb00047d0 msgr2=0x7f9cc8157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cb00047d0 0x7f9cc8157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 -- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc8159360 msgr2=0x7f9cc81597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc8159360 0x7f9cc81597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 -- 172.21.15.2:0/1247652183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8158460 con 0x7f9cc8156410 2023-11-04T01:43:40.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc77fe640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc8156410 0x7f9cc81600d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc007040 tx=0x7f9cb0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc4ff9640 1 -- 172.21.15.2:0/1247652183 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0049f0 con 0x7f9cc8156410 2023-11-04T01:43:40.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc4ff9640 1 -- 172.21.15.2:0/1247652183 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc0b6070 con 0x7f9cc8156410 2023-11-04T01:43:40.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc4ff9640 1 -- 172.21.15.2:0/1247652183 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc004d90 con 0x7f9cc8156410 2023-11-04T01:43:40.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc8158740 con 0x7f9cc8156410 2023-11-04T01:43:40.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc8158d00 con 0x7f9cc8156410 2023-11-04T01:43:40.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc80675f0 con 0x7f9cc8156410 2023-11-04T01:43:40.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc4ff9640 1 -- 172.21.15.2:0/1247652183 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9cbc0070d0 con 0x7f9cc8156410 2023-11-04T01:43:40.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc4ff9640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9cb40664d0 0x7f9cb4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.516+0000 7f9cc4ff9640 1 -- 172.21.15.2:0/1247652183 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f9cbc0b8070 con 0x7f9cc8156410 2023-11-04T01:43:40.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.520+0000 7f9cc7fff640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9cb40664d0 0x7f9cb4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.520+0000 7f9cc7fff640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9cb40664d0 0x7f9cb4068990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009ac0 tx=0x7f9cb8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.524+0000 7f9cc4ff9640 1 -- 172.21.15.2:0/1247652183 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9cbc0ee1d0 con 0x7f9cc8156410 2023-11-04T01:43:40.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.680+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cc8071170 con 0x7f9cc8156410 2023-11-04T01:43:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.680+0000 7f9cc4ff9640 1 -- 172.21.15.2:0/1247652183 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18236 (secure 0 0 0) 0x7f9cbc0f17f0 con 0x7f9cc8156410 2023-11-04T01:43:40.687 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:40.687 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:39.845366+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:26.399544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:27.128100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9cb40664d0 msgr2=0x7f9cb4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9cb40664d0 0x7f9cb4068990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009ac0 tx=0x7f9cb8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc8156410 msgr2=0x7f9cc81600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc8156410 0x7f9cc81600d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc007040 tx=0x7f9cb0005800 comp rx=0 tx=0).stop 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 shutdown_connections 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9cb40664d0 0x7f9cb4068990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc8159360 0x7f9cc81597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9cc8156410 0x7f9cc81600d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 --2- 172.21.15.2:0/1247652183 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9cb00047d0 0x7f9cc8157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 >> 172.21.15.2:0/1247652183 conn(0x7f9cc806e760 msgr2=0x7f9cc80b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 shutdown_connections 2023-11-04T01:43:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.684+0000 7f9cce40d640 1 -- 172.21.15.2:0/1247652183 wait complete. 2023-11-04T01:43:40.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:26.399544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:27.128100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:40.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:40.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe437b5e640 1 Processor -- start 2023-11-04T01:43:40.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe437b5e640 1 -- start start 2023-11-04T01:43:40.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe437b5e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe43015acb0 0x7fe43015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe437b5e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe43015c160 0x7fe4300b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe437b5e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4300cb130 con 0x7fe4300b0a50 2023-11-04T01:43:40.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe437b5e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43015bd40 con 0x7fe43015c160 2023-11-04T01:43:40.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe437b5e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43006fd80 con 0x7fe43015acb0 2023-11-04T01:43:40.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4350f9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe43015c160 0x7fe4300b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4350f9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe43015c160 0x7fe4300b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46108/0 (socket says 172.21.15.2:46108) 2023-11-04T01:43:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4350f9640 1 -- 172.21.15.2:0/2059710356 learned_addr learned my addr 172.21.15.2:0/2059710356 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4358fa640 1 --2- 172.21.15.2:0/2059710356 >> v2:172.21.15.90:3300/0 conn(0x7fe43015acb0 0x7fe43015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4350f9640 1 -- 172.21.15.2:0/2059710356 >> v2:172.21.15.90:3300/0 conn(0x7fe43015acb0 msgr2=0x7fe43015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4350f9640 1 --2- 172.21.15.2:0/2059710356 >> v2:172.21.15.90:3300/0 conn(0x7fe43015acb0 0x7fe43015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4350f9640 1 -- 172.21.15.2:0/2059710356 >> v1:172.21.15.90:6789/0 conn(0x7fe4300b0a50 legacy=0x7fe4300ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.832+0000 7fe4350f9640 1 -- 172.21.15.2:0/2059710356 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43015b680 con 0x7fe43015c160 2023-11-04T01:43:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe4350f9640 1 --2- 172.21.15.2:0/2059710356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015c160 0x7fe4300b0510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe43006d550 tx=0x7fe42001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ce1735fb74a1b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe4348f8640 1 -- 172.21.15.2:0/2059710356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200ac630 con 0x7fe43015c160 2023-11-04T01:43:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe4348f8640 1 -- 172.21.15.2:0/2059710356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4200ac790 con 0x7fe43015c160 2023-11-04T01:43:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe4348f8640 1 -- 172.21.15.2:0/2059710356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200acb20 con 0x7fe43015c160 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- 172.21.15.2:0/2059710356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015c160 msgr2=0x7fe4300b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 --2- 172.21.15.2:0/2059710356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015c160 0x7fe4300b0510 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe43006d550 tx=0x7fe42001c4c0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- 172.21.15.2:0/2059710356 shutdown_connections 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 --2- 172.21.15.2:0/2059710356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015c160 0x7fe4300b0510 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 --2- 172.21.15.2:0/2059710356 >> v2:172.21.15.90:3300/0 conn(0x7fe43015acb0 0x7fe43015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- 172.21.15.2:0/2059710356 >> 172.21.15.2:0/2059710356 conn(0x7fe4300cb510 msgr2=0x7fe4300cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- 172.21.15.2:0/2059710356 shutdown_connections 2023-11-04T01:43:40.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- 172.21.15.2:0/2059710356 wait complete. 2023-11-04T01:43:40.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 Processor -- start 2023-11-04T01:43:40.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- start start 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4300b0a50 0x7fe43014f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015acb0 0x7fe4300c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe43015c160 0x7fe4300c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430155080 con 0x7fe43015acb0 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430156e40 con 0x7fe4300b0a50 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.836+0000 7fe437b5e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe430157120 con 0x7fe43015c160 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015acb0 0x7fe4300c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015acb0 0x7fe4300c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46124/0 (socket says 172.21.15.2:46124) 2023-11-04T01:43:40.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 -- 172.21.15.2:0/1851491781 learned_addr learned my addr 172.21.15.2:0/1851491781 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4358fa640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4300b0a50 0x7fe43014f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4360fb640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe43015c160 0x7fe4300c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 -- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe43015c160 msgr2=0x7fe4300c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe43015c160 0x7fe4300c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 -- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4300b0a50 msgr2=0x7fe43014f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4300b0a50 0x7fe43014f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 -- 172.21.15.2:0/1851491781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4200094d0 con 0x7fe43015acb0 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4350f9640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015acb0 0x7fe4300c8f30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe4200af040 tx=0x7fe420019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4267fc640 1 -- 172.21.15.2:0/1851491781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200b58f0 con 0x7fe43015acb0 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4267fc640 1 -- 172.21.15.2:0/1851491781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4200b5a70 con 0x7fe43015acb0 2023-11-04T01:43:40.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe430157400 con 0x7fe43015acb0 2023-11-04T01:43:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4267fc640 1 -- 172.21.15.2:0/1851491781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200b5e20 con 0x7fe43015acb0 2023-11-04T01:43:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43014fb40 con 0x7fe43015acb0 2023-11-04T01:43:40.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4300744a0 con 0x7fe43015acb0 2023-11-04T01:43:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4267fc640 1 -- 172.21.15.2:0/1851491781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe4200b3070 con 0x7fe43015acb0 2023-11-04T01:43:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4267fc640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4140664a0 0x7fe414068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4267fc640 1 -- 172.21.15.2:0/1851491781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fe42011ea60 con 0x7fe43015acb0 2023-11-04T01:43:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.840+0000 7fe4358fa640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4140664a0 0x7fe414068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:40.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.844+0000 7fe4358fa640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4140664a0 0x7fe414068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00b800 tx=0x7fe42c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:40.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:40.844+0000 7fe4267fc640 1 -- 172.21.15.2:0/1851491781 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe4200ebdd0 con 0x7fe43015acb0 2023-11-04T01:43:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.000+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4301578b0 con 0x7fe43015acb0 2023-11-04T01:43:41.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.000+0000 7fe4267fc640 1 -- 172.21.15.2:0/1851491781 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4200a80a0 con 0x7fe43015acb0 2023-11-04T01:43:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4140664a0 msgr2=0x7fe414068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4140664a0 0x7fe414068960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe42c00b800 tx=0x7fe42c008040 comp rx=0 tx=0).stop 2023-11-04T01:43:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015acb0 msgr2=0x7fe4300c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015acb0 0x7fe4300c8f30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe4200af040 tx=0x7fe420019260 comp rx=0 tx=0).stop 2023-11-04T01:43:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 shutdown_connections 2023-11-04T01:43:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4140664a0 0x7fe414068960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe43015c160 0x7fe4300c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe43015acb0 0x7fe4300c8f30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 --2- 172.21.15.2:0/1851491781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4300b0a50 0x7fe43014f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 >> 172.21.15.2:0/1851491781 conn(0x7fe4300cb510 msgr2=0x7fe4300af320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 shutdown_connections 2023-11-04T01:43:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.004+0000 7fe437b5e640 1 -- 172.21.15.2:0/1851491781 wait complete. 2023-11-04T01:43:41.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:41.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.148+0000 7f3f21a4f640 1 Processor -- start 2023-11-04T01:43:41.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.148+0000 7f3f21a4f640 1 -- start start 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f21a4f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 0x7f3f1c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f21a4f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3f1c15c160 0x7f3f1c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f21a4f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c0cb130 con 0x7f3f1c0b0a50 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f21a4f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c15bd40 con 0x7f3f1c15c160 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f21a4f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c06fd80 con 0x7f3f1c15acb0 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3f1c0b0a50 0x7f3f1c0ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52672/0 (socket says 172.21.15.2:52672) 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1b7fe640 1 -- 172.21.15.2:0/3720838217 learned_addr learned my addr 172.21.15.2:0/3720838217 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/3720838217 >> v2:172.21.15.90:3300/0 conn(0x7f3f1c15c160 0x7f3f1c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1affd640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 0x7f3f1c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514639824 0 0) 0x7f3f1c0cb130 con 0x7f3f1c0b0a50 2023-11-04T01:43:41.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f08003530 con 0x7f3f1c0b0a50 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1065894843 0 0) 0x7f3f08003530 con 0x7f3f1c0b0a50 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 msgr2=0x7f3f1c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 0x7f3f1c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 >> v2:172.21.15.90:3300/0 conn(0x7f3f1c15c160 msgr2=0x7f3f1c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 --2- 172.21.15.2:0/3720838217 >> v2:172.21.15.90:3300/0 conn(0x7f3f1c15c160 0x7f3f1c0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c15b680 con 0x7f3f1c0b0a50 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3f14001a00 con 0x7f3f1c0b0a50 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 >> v1:172.21.15.2:6789/0 conn(0x7f3f1c0b0a50 legacy=0x7f3f1c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f08003980 0x7f3f08003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f080047d0 0x7f3f08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 0x7f3f08005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c15bd40 con 0x7f3f080047d0 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0800b990 con 0x7f3f08003980 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0800bad0 con 0x7f3f1c15acb0 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f080047d0 0x7f3f08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1affd640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f08003980 0x7f3f08003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1b7fe640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 0x7f3f08005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1a7fc640 1 -- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 msgr2=0x7f3f08005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f1c15acb0 0x7f3f08005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1a7fc640 1 -- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f08003980 msgr2=0x7f3f08003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f08003980 0x7f3f08003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.152+0000 7f3f1a7fc640 1 -- 172.21.15.2:0/3720838217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f08003530 con 0x7f3f080047d0 2023-11-04T01:43:41.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f080047d0 0x7f3f08004c50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ae0 tx=0x7f3f0c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4df74a2a17ba6b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0a64a0 con 0x7f3f080047d0 2023-11-04T01:43:41.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c0a6600 con 0x7f3f080047d0 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f19ffb640 1 -- 172.21.15.2:0/3720838217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0a69b0 con 0x7f3f080047d0 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- 172.21.15.2:0/3720838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f080047d0 msgr2=0x7f3f08004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 --2- 172.21.15.2:0/3720838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f080047d0 0x7f3f08004c50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ae0 tx=0x7f3f0c01ca90 comp rx=0 tx=0).stop 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1b7fe640 1 -- 172.21.15.2:0/3720838217 reap_dead start 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- 172.21.15.2:0/3720838217 shutdown_connections 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- 172.21.15.2:0/3720838217 >> 172.21.15.2:0/3720838217 conn(0x7f3f1c0cb510 msgr2=0x7f3f1c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- 172.21.15.2:0/3720838217 shutdown_connections 2023-11-04T01:43:41.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- 172.21.15.2:0/3720838217 wait complete. 2023-11-04T01:43:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 Processor -- start 2023-11-04T01:43:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- start start 2023-11-04T01:43:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f080047d0 0x7f3f1c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f1c0b3be0 0x7f3f1c1f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f1c0c6920 0x7f3f1c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1f4d50 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1f4790 con 0x7f3f1c0c6920 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f21a4f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1f4a70 con 0x7f3f080047d0 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f1c0b3be0 0x7f3f1c1f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f1c0b3be0 0x7f3f1c1f3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46144/0 (socket says 172.21.15.2:46144) 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 -- 172.21.15.2:0/2750212118 learned_addr learned my addr 172.21.15.2:0/2750212118 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1affd640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f080047d0 0x7f3f1c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1b7fe640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f1c0c6920 0x7f3f1c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 -- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f080047d0 msgr2=0x7f3f1c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f080047d0 0x7f3f1c155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 -- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f1c0c6920 msgr2=0x7f3f1c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f1c0c6920 0x7f3f1c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.156+0000 7f3f1a7fc640 1 -- 172.21.15.2:0/2750212118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0c6120 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f1a7fc640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f1c0b3be0 0x7f3f1c1f3e90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ae0 tx=0x7f3f08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f13fff640 1 -- 172.21.15.2:0/2750212118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0a7680 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f13fff640 1 -- 172.21.15.2:0/2750212118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c0a77e0 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f13fff640 1 -- 172.21.15.2:0/2750212118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0a7b70 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c0c6400 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c1f43d0 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c0744a0 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f13fff640 1 -- 172.21.15.2:0/2750212118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f0c0a7cd0 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f13fff640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3efc0664d0 0x7f3efc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f13fff640 1 -- 172.21.15.2:0/2750212118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f3f0c11e950 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f1affd640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3efc0664d0 0x7f3efc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.160+0000 7f3f1affd640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3efc0664d0 0x7f3efc068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009a40 tx=0x7f3f04008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.164+0000 7f3f13fff640 1 -- 172.21.15.2:0/2750212118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f0c0ebcc0 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.320+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f1c0cde30 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.320+0000 7f3f13fff640 1 -- 172.21.15.2:0/2750212118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f0c0c1020 con 0x7f3f1c0b3be0 2023-11-04T01:43:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3efc0664d0 msgr2=0x7f3efc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3efc0664d0 0x7f3efc068990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009a40 tx=0x7f3f04008040 comp rx=0 tx=0).stop 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f1c0b3be0 msgr2=0x7f3f1c1f3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f1c0b3be0 0x7f3f1c1f3e90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009ae0 tx=0x7f3f08005800 comp rx=0 tx=0).stop 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 shutdown_connections 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3efc0664d0 0x7f3efc068990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f1c0c6920 0x7f3f1c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f1c0b3be0 0x7f3f1c1f3e90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 --2- 172.21.15.2:0/2750212118 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f080047d0 0x7f3f1c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 >> 172.21.15.2:0/2750212118 conn(0x7f3f1c0cb510 msgr2=0x7f3f1c15c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 shutdown_connections 2023-11-04T01:43:41.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.324+0000 7f3f21a4f640 1 -- 172.21.15.2:0/2750212118 wait complete. 2023-11-04T01:43:41.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:41.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd1df02640 1 Processor -- start 2023-11-04T01:43:41.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd1df02640 1 -- start start 2023-11-04T01:43:41.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd1df02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbd18159c10 0x7fbd180b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd1df02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd180ce1b0 0x7fbd18159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd1df02640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1815abd0 con 0x7fbd1815e0c0 2023-11-04T01:43:41.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd1df02640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1815aeb0 con 0x7fbd18159c10 2023-11-04T01:43:41.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd1df02640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1815b190 con 0x7fbd180ce1b0 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd17fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd180ce1b0 0x7fbd18159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd17fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd180ce1b0 0x7fbd18159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:36500/0 (socket says 172.21.15.2:36500) 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd17fff640 1 -- 172.21.15.2:0/4069951324 learned_addr learned my addr 172.21.15.2:0/4069951324 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd177fe640 1 --2- 172.21.15.2:0/4069951324 >> v2:172.21.15.90:3300/0 conn(0x7fbd18159c10 0x7fbd180b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd17fff640 1 -- 172.21.15.2:0/4069951324 >> v2:172.21.15.90:3300/0 conn(0x7fbd18159c10 msgr2=0x7fbd180b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd17fff640 1 --2- 172.21.15.2:0/4069951324 >> v2:172.21.15.90:3300/0 conn(0x7fbd18159c10 0x7fbd180b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd17fff640 1 -- 172.21.15.2:0/4069951324 >> v1:172.21.15.90:6789/0 conn(0x7fbd1815e0c0 legacy=0x7fbd180cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.472+0000 7fbd17fff640 1 -- 172.21.15.2:0/4069951324 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1815d8c0 con 0x7fbd180ce1b0 2023-11-04T01:43:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd17fff640 1 --2- 172.21.15.2:0/4069951324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd180ce1b0 0x7fbd18159ff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009e50 tx=0x7fbd1001ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f313bd8c5db77b96 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd16ffd640 1 -- 172.21.15.2:0/4069951324 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100a79d0 con 0x7fbd180ce1b0 2023-11-04T01:43:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd16ffd640 1 -- 172.21.15.2:0/4069951324 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd100a7b30 con 0x7fbd180ce1b0 2023-11-04T01:43:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd16ffd640 1 -- 172.21.15.2:0/4069951324 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100af3f0 con 0x7fbd180ce1b0 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- 172.21.15.2:0/4069951324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd180ce1b0 msgr2=0x7fbd18159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 --2- 172.21.15.2:0/4069951324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd180ce1b0 0x7fbd18159ff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009e50 tx=0x7fbd1001ebf0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- 172.21.15.2:0/4069951324 shutdown_connections 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 --2- 172.21.15.2:0/4069951324 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd180ce1b0 0x7fbd18159ff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 --2- 172.21.15.2:0/4069951324 >> v2:172.21.15.90:3300/0 conn(0x7fbd18159c10 0x7fbd180b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- 172.21.15.2:0/4069951324 >> 172.21.15.2:0/4069951324 conn(0x7fbd180cb510 msgr2=0x7fbd180cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- 172.21.15.2:0/4069951324 shutdown_connections 2023-11-04T01:43:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- 172.21.15.2:0/4069951324 wait complete. 2023-11-04T01:43:41.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 Processor -- start 2023-11-04T01:43:41.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- start start 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd180ce1b0 0x7fbd180b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd18159c10 0x7fbd1814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1815e0c0 0x7fbd180c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c5510 con 0x7fbd1815e0c0 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180c2ae0 con 0x7fbd180ce1b0 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd1df02640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd180b25c0 con 0x7fbd18159c10 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1815e0c0 0x7fbd180c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd17fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1815e0c0 0x7fbd180c25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53814/0 (socket says 172.21.15.2:53814) 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.476+0000 7fbd17fff640 1 -- 172.21.15.2:0/857784252 learned_addr learned my addr 172.21.15.2:0/857784252 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd177fe640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd180ce1b0 0x7fbd180b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd0effd640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd18159c10 0x7fbd1814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd17fff640 1 -- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd18159c10 msgr2=0x7fbd1814ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd17fff640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd18159c10 0x7fbd1814ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd17fff640 1 -- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd180ce1b0 msgr2=0x7fbd180b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd17fff640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd180ce1b0 0x7fbd180b42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd17fff640 1 -- 172.21.15.2:0/857784252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10009b30 con 0x7fbd1815e0c0 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd17fff640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1815e0c0 0x7fbd180c25a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbd1001c820 tx=0x7fbd1001b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd14ff9640 1 -- 172.21.15.2:0/857784252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100bf070 con 0x7fbd1815e0c0 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd14ff9640 1 -- 172.21.15.2:0/857784252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd10007e80 con 0x7fbd1815e0c0 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd180c2d10 con 0x7fbd1815e0c0 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd14ff9640 1 -- 172.21.15.2:0/857784252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100a79d0 con 0x7fbd1815e0c0 2023-11-04T01:43:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd180b2250 con 0x7fbd1815e0c0 2023-11-04T01:43:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd180b2750 con 0x7fbd1815e0c0 2023-11-04T01:43:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd14ff9640 1 -- 172.21.15.2:0/857784252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd100ba690 con 0x7fbd1815e0c0 2023-11-04T01:43:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd14ff9640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbcf80664a0 0x7fbcf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd14ff9640 1 -- 172.21.15.2:0/857784252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fbd10121770 con 0x7fbd1815e0c0 2023-11-04T01:43:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd177fe640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbcf80664a0 0x7fbcf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.480+0000 7fbd177fe640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbcf80664a0 0x7fbcf8068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd180b20d0 tx=0x7fbd08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.484+0000 7fbd14ff9640 1 -- 172.21.15.2:0/857784252 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd100eea50 con 0x7fbd1815e0c0 2023-11-04T01:43:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd180744a0 con 0x7fbd1815e0c0 2023-11-04T01:43:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd14ff9640 1 -- 172.21.15.2:0/857784252 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd10009510 con 0x7fbd1815e0c0 2023-11-04T01:43:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbcf80664a0 msgr2=0x7fbcf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbcf80664a0 0x7fbcf8068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbd180b20d0 tx=0x7fbd08008040 comp rx=0 tx=0).stop 2023-11-04T01:43:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1815e0c0 msgr2=0x7fbd180c25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1815e0c0 0x7fbd180c25a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbd1001c820 tx=0x7fbd1001b990 comp rx=0 tx=0).stop 2023-11-04T01:43:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 shutdown_connections 2023-11-04T01:43:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbcf80664a0 0x7fbcf8068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd1815e0c0 0x7fbd180c25a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd18159c10 0x7fbd1814ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 --2- 172.21.15.2:0/857784252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd180ce1b0 0x7fbd180b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 >> 172.21.15.2:0/857784252 conn(0x7fbd180cb510 msgr2=0x7fbd180b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 shutdown_connections 2023-11-04T01:43:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.640+0000 7fbd1df02640 1 -- 172.21.15.2:0/857784252 wait complete. 2023-11-04T01:43:41.664 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.784+0000 7f72e9a64640 1 Processor -- start 2023-11-04T01:43:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.784+0000 7f72e9a64640 1 -- start start 2023-11-04T01:43:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.784+0000 7f72e9a64640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72e40b0c20 0x7f72e415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.784+0000 7f72e9a64640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e40cb130 con 0x7f72e415acb0 2023-11-04T01:43:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.784+0000 7f72e9a64640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e415b680 con 0x7f72e415c160 2023-11-04T01:43:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.784+0000 7f72e9a64640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e415bd40 con 0x7f72e40b0c20 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f72e415acb0 0x7f72e40b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57930/0 (socket says 172.21.15.2:57930) 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e37fe640 1 -- 172.21.15.2:0/1764123601 learned_addr learned my addr 172.21.15.2:0/1764123601 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72dbfff640 1 --2- 172.21.15.2:0/1764123601 >> v2:172.21.15.2:3300/0 conn(0x7f72e40b0c20 0x7f72e415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e2ffd640 1 -- 172.21.15.2:0/1764123601 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857229522 0 0) 0x7f72e40cb130 con 0x7f72e415acb0 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e2ffd640 1 -- 172.21.15.2:0/1764123601 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d0003530 con 0x7f72e415acb0 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72dbfff640 1 -- 172.21.15.2:0/1764123601 >> v1:172.21.15.90:6789/0 conn(0x7f72e415c160 legacy=0x7f72e40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72dbfff640 1 -- 172.21.15.2:0/1764123601 >> v1:172.21.15.2:6789/0 conn(0x7f72e415acb0 legacy=0x7f72e40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72dbfff640 1 -- 172.21.15.2:0/1764123601 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e415b960 con 0x7f72e40b0c20 2023-11-04T01:43:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72dbfff640 1 --2- 172.21.15.2:0/1764123601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e40b0c20 0x7f72e415b090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0097c0 tx=0x7f72cc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6adf42bd24408e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e2ffd640 1 -- 172.21.15.2:0/1764123601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0a8050 con 0x7f72e40b0c20 2023-11-04T01:43:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e2ffd640 1 -- 172.21.15.2:0/1764123601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc0ac5f0 con 0x7f72e40b0c20 2023-11-04T01:43:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e2ffd640 1 -- 172.21.15.2:0/1764123601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0ac980 con 0x7f72e40b0c20 2023-11-04T01:43:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e9a64640 1 -- 172.21.15.2:0/1764123601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e40b0c20 msgr2=0x7f72e415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e9a64640 1 --2- 172.21.15.2:0/1764123601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e40b0c20 0x7f72e415b090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0097c0 tx=0x7f72cc01c480 comp rx=0 tx=0).stop 2023-11-04T01:43:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e9a64640 1 -- 172.21.15.2:0/1764123601 shutdown_connections 2023-11-04T01:43:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e9a64640 1 --2- 172.21.15.2:0/1764123601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e40b0c20 0x7f72e415b090 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.788+0000 7f72e9a64640 1 -- 172.21.15.2:0/1764123601 >> 172.21.15.2:0/1764123601 conn(0x7f72e40cb510 msgr2=0x7f72e40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- 172.21.15.2:0/1764123601 shutdown_connections 2023-11-04T01:43:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- 172.21.15.2:0/1764123601 wait complete. 2023-11-04T01:43:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 Processor -- start 2023-11-04T01:43:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- start start 2023-11-04T01:43:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72e40b0c20 0x7f72e40c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72e415acb0 0x7f72e40c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e415c160 0x7f72e40c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c4150 con 0x7f72e415c160 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c8b40 con 0x7f72e415acb0 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40c3c00 con 0x7f72e40b0c20 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e415c160 0x7f72e40c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e415c160 0x7f72e40c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53842/0 (socket says 172.21.15.2:53842) 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 -- 172.21.15.2:0/2988943570 learned_addr learned my addr 172.21.15.2:0/2988943570 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72dbfff640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72e415acb0 0x7f72e40c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e37fe640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72e40b0c20 0x7f72e40c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 -- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72e40b0c20 msgr2=0x7f72e40c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72e40b0c20 0x7f72e40c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 -- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72e415acb0 msgr2=0x7f72e40c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72e415acb0 0x7f72e40c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 -- 172.21.15.2:0/2988943570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc009420 con 0x7f72e415c160 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e3fff640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e415c160 0x7f72e40c7860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00c730 tx=0x7f72dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e0ff9640 1 -- 172.21.15.2:0/2988943570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc003b80 con 0x7f72e415c160 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e0ff9640 1 -- 172.21.15.2:0/2988943570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc003ce0 con 0x7f72e415c160 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e40c5c00 con 0x7f72e415c160 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e0ff9640 1 -- 172.21.15.2:0/2988943570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc00aa30 con 0x7f72e415c160 2023-11-04T01:43:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.792+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e40c61c0 con 0x7f72e415c160 2023-11-04T01:43:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.796+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e40c42c0 con 0x7f72e415c160 2023-11-04T01:43:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.796+0000 7f72e0ff9640 1 -- 172.21.15.2:0/2988943570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72dc00ab90 con 0x7f72e415c160 2023-11-04T01:43:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.796+0000 7f72e0ff9640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72c40664a0 0x7f72c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.796+0000 7f72e0ff9640 1 -- 172.21.15.2:0/2988943570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f72dc083dd0 con 0x7f72e415c160 2023-11-04T01:43:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.796+0000 7f72e37fe640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72c40664a0 0x7f72c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.796+0000 7f72e37fe640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72c40664a0 0x7f72c4068960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f72d40011f0 tx=0x7f72d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.800+0000 7f72e0ff9640 1 -- 172.21.15.2:0/2988943570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f72dc0510a0 con 0x7f72e415c160 2023-11-04T01:43:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.952+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f72e40744a0 con 0x7f72e415c160 2023-11-04T01:43:41.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.952+0000 7f72e0ff9640 1 -- 172.21.15.2:0/2988943570 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v37) v1 ==== 103+0+11 (secure 0 0 0) 0x7f72dc0546c0 con 0x7f72e415c160 2023-11-04T01:43:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72c40664a0 msgr2=0x7f72c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72c40664a0 0x7f72c4068960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f72d40011f0 tx=0x7f72d4009040 comp rx=0 tx=0).stop 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e415c160 msgr2=0x7f72e40c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e415c160 0x7f72e40c7860 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00c730 tx=0x7f72dc00cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 shutdown_connections 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72c40664a0 0x7f72c4068960 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72e415c160 0x7f72e40c7860 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f72e415acb0 0x7f72e40c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 --2- 172.21.15.2:0/2988943570 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f72e40b0c20 0x7f72e40c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:41.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 >> 172.21.15.2:0/2988943570 conn(0x7f72e40cb510 msgr2=0x7f72e415c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 shutdown_connections 2023-11-04T01:43:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:41.956+0000 7f72e9a64640 1 -- 172.21.15.2:0/2988943570 wait complete. 2023-11-04T01:43:41.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:43:42.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb53509f640 1 Processor -- start 2023-11-04T01:43:42.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb53509f640 1 -- start start 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb53509f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb5300d0b10 0x7fb53015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb53509f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300b49c0 0x7fb5300b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb53509f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5300b5330 con 0x7fb53015d240 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb53509f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5300d2280 con 0x7fb5300d0b10 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb53509f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300d2560 con 0x7fb5300b49c0 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb527fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb5300d0b10 0x7fb53015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb527fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb5300d0b10 0x7fb53015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53854/0 (socket says 172.21.15.2:53854) 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb527fff640 1 -- 172.21.15.2:0/506388665 learned_addr learned my addr 172.21.15.2:0/506388665 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.084+0000 7fb52ed9d640 1 --1- 172.21.15.2:0/506388665 >> v1:172.21.15.2:6789/0 conn(0x7fb53015d240 0x7fb5300d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57934/0 (socket says 172.21.15.2:57934) 2023-11-04T01:43:42.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb527fff640 1 -- 172.21.15.2:0/506388665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300b49c0 msgr2=0x7fb5300b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb527fff640 1 --2- 172.21.15.2:0/506388665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300b49c0 0x7fb5300b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb527fff640 1 -- 172.21.15.2:0/506388665 >> v1:172.21.15.2:6789/0 conn(0x7fb53015d240 legacy=0x7fb5300d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb527fff640 1 -- 172.21.15.2:0/506388665 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300d2840 con 0x7fb5300d0b10 2023-11-04T01:43:42.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb527fff640 1 --2- 172.21.15.2:0/506388665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5300d0b10 0x7fb53015d620 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb518009870 tx=0x7fb51801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d33ebbda2a5d589 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb52e59c640 1 -- 172.21.15.2:0/506388665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5180a95f0 con 0x7fb5300d0b10 2023-11-04T01:43:42.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb52e59c640 1 -- 172.21.15.2:0/506388665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5180a9750 con 0x7fb5300d0b10 2023-11-04T01:43:42.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb52e59c640 1 -- 172.21.15.2:0/506388665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5180a9ae0 con 0x7fb5300d0b10 2023-11-04T01:43:42.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 -- 172.21.15.2:0/506388665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5300d0b10 msgr2=0x7fb53015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 --2- 172.21.15.2:0/506388665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5300d0b10 0x7fb53015d620 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb518009870 tx=0x7fb51801c510 comp rx=0 tx=0).stop 2023-11-04T01:43:42.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 -- 172.21.15.2:0/506388665 shutdown_connections 2023-11-04T01:43:42.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 --2- 172.21.15.2:0/506388665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5300d0b10 0x7fb53015d620 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 --2- 172.21.15.2:0/506388665 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300b49c0 0x7fb5300b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 -- 172.21.15.2:0/506388665 >> 172.21.15.2:0/506388665 conn(0x7fb5300cf9c0 msgr2=0x7fb5300cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 -- 172.21.15.2:0/506388665 shutdown_connections 2023-11-04T01:43:42.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.088+0000 7fb53509f640 1 -- 172.21.15.2:0/506388665 wait complete. 2023-11-04T01:43:42.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 Processor -- start 2023-11-04T01:43:42.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 -- start start 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5300b49c0 0x7fb53015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300d0b10 0x7fb53015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53015d240 0x7fb5301504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53015ca80 con 0x7fb53015d240 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300c6fe0 con 0x7fb5300b49c0 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300c72c0 con 0x7fb5300d0b10 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53015d240 0x7fb5301504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53015d240 0x7fb5301504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53862/0 (socket says 172.21.15.2:53862) 2023-11-04T01:43:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 -- 172.21.15.2:0/1181907483 learned_addr learned my addr 172.21.15.2:0/1181907483 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52ed9d640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5300b49c0 0x7fb53015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb527fff640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300d0b10 0x7fb53015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 -- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300d0b10 msgr2=0x7fb53015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300d0b10 0x7fb53015f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 -- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5300b49c0 msgr2=0x7fb53015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5300b49c0 0x7fb53015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 -- 172.21.15.2:0/1181907483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180094d0 con 0x7fb53015d240 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52f59e640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53015d240 0x7fb5301504f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb52800b970 tx=0x7fb52800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb5277fe640 1 -- 172.21.15.2:0/1181907483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800cb40 con 0x7fb53015d240 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb5277fe640 1 -- 172.21.15.2:0/1181907483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52800ccc0 con 0x7fb53015d240 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5300c75a0 con 0x7fb53015d240 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb5277fe640 1 -- 172.21.15.2:0/1181907483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb528014680 con 0x7fb53015d240 2023-11-04T01:43:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5300c7b60 con 0x7fb53015d240 2023-11-04T01:43:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5300675f0 con 0x7fb53015d240 2023-11-04T01:43:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb5277fe640 1 -- 172.21.15.2:0/1181907483 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb52801d3b0 con 0x7fb53015d240 2023-11-04T01:43:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb5277fe640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5100664a0 0x7fb510068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb5277fe640 1 -- 172.21.15.2:0/1181907483 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb528083f10 con 0x7fb53015d240 2023-11-04T01:43:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.092+0000 7fb52ed9d640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5100664a0 0x7fb510068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.096+0000 7fb52ed9d640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5100664a0 0x7fb510068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb520000f70 tx=0x7fb520007c30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.096+0000 7fb5277fe640 1 -- 172.21.15.2:0/1181907483 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb528051280 con 0x7fb53015d240 2023-11-04T01:43:42.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.264+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb5300ceb20 con 0x7fb53015d240 2023-11-04T01:43:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.264+0000 7fb5277fe640 1 -- 172.21.15.2:0/1181907483 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb528019080 con 0x7fb53015d240 2023-11-04T01:43:42.269 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:43:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5100664a0 msgr2=0x7fb510068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5100664a0 0x7fb510068960 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb520000f70 tx=0x7fb520007c30 comp rx=0 tx=0).stop 2023-11-04T01:43:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53015d240 msgr2=0x7fb5301504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53015d240 0x7fb5301504f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb52800b970 tx=0x7fb52800be30 comp rx=0 tx=0).stop 2023-11-04T01:43:42.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 shutdown_connections 2023-11-04T01:43:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5100664a0 0x7fb510068960 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb53015d240 0x7fb5301504f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5300d0b10 0x7fb53015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 --2- 172.21.15.2:0/1181907483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5300b49c0 0x7fb53015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 >> 172.21.15.2:0/1181907483 conn(0x7fb5300cf9c0 msgr2=0x7fb53015d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 shutdown_connections 2023-11-04T01:43:42.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.268+0000 7fb53509f640 1 -- 172.21.15.2:0/1181907483 wait complete. 2023-11-04T01:43:42.289 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:43:42.289 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:43:42.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:43:42.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:43:42.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[47987]: fuse finished with error 0 and tester_r 0 2023-11-04T01:43:42.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:42.348 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:43:42.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:42.348 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:43:42.348 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:43:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:43:42.357 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:42.357 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:42.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:42.363 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:43:42.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:42.363 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:43:42.412 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:43:42.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:42.413 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:42.413 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:42.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:42.418 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:43:42.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:42.418 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:43:42.463 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:43:42.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:42.464 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:42.464 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:42.470 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:42.470 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:43:42.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:43:42.471 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:43:42.516 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:43:42.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:43:42.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.640+0000 7f0b48f90640 1 Processor -- start 2023-11-04T01:43:42.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.640+0000 7f0b48f90640 1 -- start start 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b48f90640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b440b0890 0x7f0b440cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b48f90640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440b0c70 0x7f0b440ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b48f90640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b440ce320 con 0x7f0b440c9960 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b48f90640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4406d2f0 con 0x7f0b440b0890 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b48f90640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440ce110 con 0x7f0b440b0c70 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440b0c70 0x7f0b440ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b4259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b440b0890 0x7f0b440cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440b0c70 0x7f0b440ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:36538/0 (socket says 172.21.15.2:36538) 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b41d9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0b440c9960 0x7f0b440704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:60460/0 (socket says 172.21.15.2:60460) 2023-11-04T01:43:42.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 -- 172.21.15.2:0/446475628 learned_addr learned my addr 172.21.15.2:0/446475628 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 -- 172.21.15.2:0/446475628 >> v2:172.21.15.90:3300/0 conn(0x7f0b440b0890 msgr2=0x7f0b440cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 --2- 172.21.15.2:0/446475628 >> v2:172.21.15.90:3300/0 conn(0x7f0b440b0890 0x7f0b440cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 -- 172.21.15.2:0/446475628 >> v1:172.21.15.90:6789/0 conn(0x7f0b440c9960 legacy=0x7f0b440704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 -- 172.21.15.2:0/446475628 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b440ce600 con 0x7f0b440b0c70 2023-11-04T01:43:42.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b4259c640 1 --2- 172.21.15.2:0/446475628 >> v2:172.21.15.90:3300/0 conn(0x7f0b440b0890 0x7f0b440cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:43:42.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.644+0000 7f0b42d9d640 1 --2- 172.21.15.2:0/446475628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440b0c70 0x7f0b440ccf90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009e50 tx=0x7f0b3c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533bd5f7adce318 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4159a640 1 -- 172.21.15.2:0/446475628 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0a58a0 con 0x7f0b440b0c70 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4159a640 1 -- 172.21.15.2:0/446475628 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c0a5a00 con 0x7f0b440b0c70 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4159a640 1 -- 172.21.15.2:0/446475628 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0a5d90 con 0x7f0b440b0c70 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- 172.21.15.2:0/446475628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440b0c70 msgr2=0x7f0b440ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 --2- 172.21.15.2:0/446475628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440b0c70 0x7f0b440ccf90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009e50 tx=0x7f0b3c01c9e0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- 172.21.15.2:0/446475628 shutdown_connections 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 --2- 172.21.15.2:0/446475628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440b0c70 0x7f0b440ccf90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 --2- 172.21.15.2:0/446475628 >> v2:172.21.15.90:3300/0 conn(0x7f0b440b0890 0x7f0b440cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- 172.21.15.2:0/446475628 >> 172.21.15.2:0/446475628 conn(0x7f0b440cebb0 msgr2=0x7f0b440cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- 172.21.15.2:0/446475628 shutdown_connections 2023-11-04T01:43:42.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- 172.21.15.2:0/446475628 wait complete. 2023-11-04T01:43:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 Processor -- start 2023-11-04T01:43:42.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- start start 2023-11-04T01:43:42.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b440b0890 0x7f0b440a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b440b0c70 0x7f0b440c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440c9960 0x7f0b440c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440c2a30 con 0x7f0b440b0890 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440c51e0 con 0x7f0b440b0c70 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b440c54c0 con 0x7f0b440c9960 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b440b0890 0x7f0b440a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b440b0890 0x7f0b440a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53868/0 (socket says 172.21.15.2:53868) 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 -- 172.21.15.2:0/2129368501 learned_addr learned my addr 172.21.15.2:0/2129368501 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b42d9d640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440c9960 0x7f0b440c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b41d9b640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b440b0c70 0x7f0b440c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 -- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440c9960 msgr2=0x7f0b440c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440c9960 0x7f0b440c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 -- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b440b0c70 msgr2=0x7f0b440c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b440b0c70 0x7f0b440c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 -- 172.21.15.2:0/2129368501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009420 con 0x7f0b440b0890 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b41d9b640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b440b0c70 0x7f0b440c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b4259c640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b440b0890 0x7f0b440a84b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ebe0 tx=0x7f0b3800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b32ffd640 1 -- 172.21.15.2:0/2129368501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800eee0 con 0x7f0b440b0890 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b32ffd640 1 -- 172.21.15.2:0/2129368501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3800cc30 con 0x7f0b440b0890 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b32ffd640 1 -- 172.21.15.2:0/2129368501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38013470 con 0x7f0b440b0890 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c009b30 con 0x7f0b440b0890 2023-11-04T01:43:42.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.648+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b440c7870 con 0x7f0b440b0890 2023-11-04T01:43:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.652+0000 7f0b32ffd640 1 -- 172.21.15.2:0/2129368501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b380135d0 con 0x7f0b440b0890 2023-11-04T01:43:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.652+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b440744a0 con 0x7f0b440b0890 2023-11-04T01:43:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.652+0000 7f0b32ffd640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b240664a0 0x7f0b24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.652+0000 7f0b32ffd640 1 -- 172.21.15.2:0/2129368501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f0b38084330 con 0x7f0b440b0890 2023-11-04T01:43:42.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.652+0000 7f0b41d9b640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b240664a0 0x7f0b24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.652+0000 7f0b41d9b640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b240664a0 0x7f0b24068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0b34007fd0 tx=0x7f0b34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.656+0000 7f0b32ffd640 1 -- 172.21.15.2:0/2129368501 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b38051600 con 0x7f0b440b0890 2023-11-04T01:43:42.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.840+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b440b4b30 con 0x7f0b440b0890 2023-11-04T01:43:42.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.840+0000 7f0b32ffd640 1 -- 172.21.15.2:0/2129368501 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4897 (secure 0 0 0) 0x7f0b38054c20 con 0x7f0b440b0890 2023-11-04T01:43:42.846 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/926400153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":926400153},{"type":"v1","addr":"172.21.15.90:6837","nonce":926400153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/1780832630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1780832630},{"type":"v1","addr":"172.21.15.90:6836","nonce":1780832630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/763530639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":763530639},{"type":"v1","addr":"172.21.15.2:6834","nonce":763530639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:28.120677+0000","modified":"2023-11-04T01:43:31.147336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/610836033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":610836033},{"type":"v1","addr":"172.21.15.2:6835","nonce":610836033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:43:42.846 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 14 2023-11-04T01:43:42.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b240664a0 msgr2=0x7f0b24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b240664a0 0x7f0b24068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0b34007fd0 tx=0x7f0b34009040 comp rx=0 tx=0).stop 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b440b0890 msgr2=0x7f0b440a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b440b0890 0x7f0b440a84b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800ebe0 tx=0x7f0b3800c520 comp rx=0 tx=0).stop 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 shutdown_connections 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b240664a0 0x7f0b24068960 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b440c9960 0x7f0b440c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b440b0c70 0x7f0b440c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 --2- 172.21.15.2:0/2129368501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b440b0890 0x7f0b440a84b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 >> 172.21.15.2:0/2129368501 conn(0x7f0b440cebb0 msgr2=0x7f0b440b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 shutdown_connections 2023-11-04T01:43:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.844+0000 7f0b48f90640 1 -- 172.21.15.2:0/2129368501 wait complete. 2023-11-04T01:43:42.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a69a5640 1 Processor -- start 2023-11-04T01:43:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a69a5640 1 -- start start 2023-11-04T01:43:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a69a5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3a00cead0 0x7fd3a00c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a69a5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd3a0070bf0 0x7fd3a0071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a69a5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00cb9a0 con 0x7fd3a01435e0 2023-11-04T01:43:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a69a5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00cc540 con 0x7fd3a00cead0 2023-11-04T01:43:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a69a5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00c59a0 con 0x7fd3a0070bf0 2023-11-04T01:43:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd39f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3a00cead0 0x7fd3a00c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd39f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd3a00cead0 0x7fd3a00c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53880/0 (socket says 172.21.15.2:53880) 2023-11-04T01:43:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd39f7fe640 1 -- 172.21.15.2:0/1328505051 learned_addr learned my addr 172.21.15.2:0/1328505051 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a4f42640 1 --2- 172.21.15.2:0/1328505051 >> v2:172.21.15.90:3300/0 conn(0x7fd3a0070bf0 0x7fd3a0071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd39f7fe640 1 -- 172.21.15.2:0/1328505051 >> v2:172.21.15.90:3300/0 conn(0x7fd3a0070bf0 msgr2=0x7fd3a0071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd39f7fe640 1 --2- 172.21.15.2:0/1328505051 >> v2:172.21.15.90:3300/0 conn(0x7fd3a0070bf0 0x7fd3a0071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd39f7fe640 1 -- 172.21.15.2:0/1328505051 >> v1:172.21.15.90:6789/0 conn(0x7fd3a01435e0 legacy=0x7fd3a00cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd39f7fe640 1 -- 172.21.15.2:0/1328505051 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00cb390 con 0x7fd3a00cead0 2023-11-04T01:43:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.984+0000 7fd3a4f42640 1 --2- 172.21.15.2:0/1328505051 >> v2:172.21.15.90:3300/0 conn(0x7fd3a0070bf0 0x7fd3a0071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd39f7fe640 1 --2- 172.21.15.2:0/1328505051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a00cead0 0x7fd3a00c4ae0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00cb910 tx=0x7fd39401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab51a3e84ca4ddc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd39effd640 1 -- 172.21.15.2:0/1328505051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940ac410 con 0x7fd3a00cead0 2023-11-04T01:43:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd39effd640 1 -- 172.21.15.2:0/1328505051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3940ac570 con 0x7fd3a00cead0 2023-11-04T01:43:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd39effd640 1 -- 172.21.15.2:0/1328505051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940ac900 con 0x7fd3a00cead0 2023-11-04T01:43:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1328505051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a00cead0 msgr2=0x7fd3a00c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1328505051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a00cead0 0x7fd3a00c4ae0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd3a00cb910 tx=0x7fd39401c4c0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1328505051 shutdown_connections 2023-11-04T01:43:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1328505051 >> v2:172.21.15.90:3300/0 conn(0x7fd3a0070bf0 0x7fd3a0071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1328505051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a00cead0 0x7fd3a00c4ae0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1328505051 >> 172.21.15.2:0/1328505051 conn(0x7fd3a00cfc00 msgr2=0x7fd3a00d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1328505051 shutdown_connections 2023-11-04T01:43:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1328505051 wait complete. 2023-11-04T01:43:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 Processor -- start 2023-11-04T01:43:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- start start 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a0070bf0 0x7fd3a006a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3a00cead0 0x7fd3a006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3a01435e0 0x7fd3a0158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00c9a30 con 0x7fd3a0070bf0 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01f5680 con 0x7fd3a01435e0 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd3a69a5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00b3170 con 0x7fd3a00cead0 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a0070bf0 0x7fd3a006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a0070bf0 0x7fd3a006a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53896/0 (socket says 172.21.15.2:53896) 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.988+0000 7fd39ffff640 1 -- 172.21.15.2:0/1738059012 learned_addr learned my addr 172.21.15.2:0/1738059012 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:42.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd3a4f42640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3a01435e0 0x7fd3a0158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39ffff640 1 -- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3a00cead0 msgr2=0x7fd3a006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39ffff640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3a00cead0 0x7fd3a006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39ffff640 1 -- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3a01435e0 msgr2=0x7fd3a0158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39ffff640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3a01435e0 0x7fd3a0158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39ffff640 1 -- 172.21.15.2:0/1738059012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940094d0 con 0x7fd3a0070bf0 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd3a4f42640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3a01435e0 0x7fd3a0158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39ffff640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a0070bf0 0x7fd3a006a160 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b410 tx=0x7fd39000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39cff9640 1 -- 172.21.15.2:0/1738059012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390004020 con 0x7fd3a0070bf0 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39cff9640 1 -- 172.21.15.2:0/1738059012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390004180 con 0x7fd3a0070bf0 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a01f58b0 con 0x7fd3a0070bf0 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39cff9640 1 -- 172.21.15.2:0/1738059012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390011630 con 0x7fd3a0070bf0 2023-11-04T01:43:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a01f5e70 con 0x7fd3a0070bf0 2023-11-04T01:43:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a00675f0 con 0x7fd3a0070bf0 2023-11-04T01:43:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39cff9640 1 -- 172.21.15.2:0/1738059012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd390011790 con 0x7fd3a0070bf0 2023-11-04T01:43:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39cff9640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd38c0664a0 0x7fd38c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39cff9640 1 -- 172.21.15.2:0/1738059012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd390083d50 con 0x7fd3a0070bf0 2023-11-04T01:43:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39f7fe640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd38c0664a0 0x7fd38c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:42.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.992+0000 7fd39f7fe640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd38c0664a0 0x7fd38c068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd3940ae000 tx=0x7fd394004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:42.996+0000 7fd39cff9640 1 -- 172.21.15.2:0/1738059012 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd390051020 con 0x7fd3a0070bf0 2023-11-04T01:43:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.156+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3a00b2e90 con 0x7fd3a0070bf0 2023-11-04T01:43:43.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd39cff9640 1 -- 172.21.15.2:0/1738059012 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18236 (secure 0 0 0) 0x7fd3a00b2e90 con 0x7fd3a0070bf0 2023-11-04T01:43:43.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:39.845366+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:26.399544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:27.128100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd38c0664a0 msgr2=0x7fd38c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd38c0664a0 0x7fd38c068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd3940ae000 tx=0x7fd394004740 comp rx=0 tx=0).stop 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a0070bf0 msgr2=0x7fd3a006a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a0070bf0 0x7fd3a006a160 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b410 tx=0x7fd39000b8d0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 shutdown_connections 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd38c0664a0 0x7fd38c068960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3a01435e0 0x7fd3a0158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd3a00cead0 0x7fd3a006a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 --2- 172.21.15.2:0/1738059012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3a0070bf0 0x7fd3a006a160 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 >> 172.21.15.2:0/1738059012 conn(0x7fd3a00cfc00 msgr2=0x7fd3a01424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:43.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 shutdown_connections 2023-11-04T01:43:43.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.160+0000 7fd3a69a5640 1 -- 172.21.15.2:0/1738059012 wait complete. 2023-11-04T01:43:43.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:26.399544+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:27.128100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:43.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a284d640 1 Processor -- start 2023-11-04T01:43:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a284d640 1 -- start start 2023-11-04T01:43:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a284d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 0x7fd29c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a284d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c15f990 con 0x7fd29c15ad90 2023-11-04T01:43:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a284d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c15ec10 con 0x7fd29c15b170 2023-11-04T01:43:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a284d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c15f570 con 0x7fd29c0b0c20 2023-11-04T01:43:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd29c15ad90 0x7fd29c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57948/0 (socket says 172.21.15.2:57948) 2023-11-04T01:43:43.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29bfff640 1 -- 172.21.15.2:0/2605940971 learned_addr learned my addr 172.21.15.2:0/2605940971 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 0x7fd29c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490751245 0 0) 0x7fd28c001120 con 0x7fd29c15ad90 2023-11-04T01:43:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd284003530 con 0x7fd29c15ad90 2023-11-04T01:43:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1551339066 0 0) 0x7fd284003530 con 0x7fd29c15ad90 2023-11-04T01:43:43.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 msgr2=0x7fd29c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 0x7fd29c0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 >> v1:172.21.15.90:6789/0 conn(0x7fd29c15b170 legacy=0x7fd29c0ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0cd9a0 con 0x7fd29c15ad90 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fd28c001810 con 0x7fd29c15ad90 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 >> v1:172.21.15.2:6789/0 conn(0x7fd29c15ad90 legacy=0x7fd29c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 0x7fd2840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd284003f30 0x7fd2840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd284004d10 0x7fd284005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c15f570 con 0x7fd284004d10 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28400bb20 con 0x7fd284003f30 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28400bce0 con 0x7fd29c0b0c20 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd284004d10 0x7fd284005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29bfff640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 0x7fd2840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd29b7fe640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd284003f30 0x7fd2840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a0dea640 1 -- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 msgr2=0x7fd2840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:43.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd29c0b0c20 0x7fd2840039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a0dea640 1 -- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd284003f30 msgr2=0x7fd2840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:43.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd284003f30 0x7fd2840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.308+0000 7fd2a0dea640 1 -- 172.21.15.2:0/2605940971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284003530 con 0x7fd284004d10 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd284004d10 0x7fd284005190 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd294009fc0 tx=0x7fd29401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7becf46e93953c73 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2940a5b60 con 0x7fd284004d10 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29400f040 con 0x7fd284004d10 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd29affd640 1 -- 172.21.15.2:0/2605940971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2940ad440 con 0x7fd284004d10 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 -- 172.21.15.2:0/2605940971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd284004d10 msgr2=0x7fd284005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 --2- 172.21.15.2:0/2605940971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd284004d10 0x7fd284005190 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd294009fc0 tx=0x7fd29401cc60 comp rx=0 tx=0).stop 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a0dea640 1 -- 172.21.15.2:0/2605940971 reap_dead start 2023-11-04T01:43:43.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 -- 172.21.15.2:0/2605940971 shutdown_connections 2023-11-04T01:43:43.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 -- 172.21.15.2:0/2605940971 >> 172.21.15.2:0/2605940971 conn(0x7fd29c0cb510 msgr2=0x7fd29c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:43.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 -- 172.21.15.2:0/2605940971 shutdown_connections 2023-11-04T01:43:43.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 -- 172.21.15.2:0/2605940971 wait complete. 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 Processor -- start 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.312+0000 7fd2a284d640 1 -- start start 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd284004d10 0x7fd29c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd29c15c6d0 0x7fd29c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29c159050 0x7fd29c1f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c158680 con 0x7fd29c159050 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c1594d0 con 0x7fd29c15c6d0 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0c5970 con 0x7fd284004d10 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29c159050 0x7fd29c1f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29c159050 0x7fd29c1f0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53920/0 (socket says 172.21.15.2:53920) 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 -- 172.21.15.2:0/982773381 learned_addr learned my addr 172.21.15.2:0/982773381 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:43.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd29bfff640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd284004d10 0x7fd29c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd29b7fe640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd29c15c6d0 0x7fd29c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 -- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd284004d10 msgr2=0x7fd29c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd284004d10 0x7fd29c158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 -- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd29c15c6d0 msgr2=0x7fd29c158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd29c15c6d0 0x7fd29c158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 -- 172.21.15.2:0/982773381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c1f13c0 con 0x7fd29c159050 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd29bfff640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd284004d10 0x7fd29c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a0dea640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29c159050 0x7fd29c1f0770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd294002240 tx=0x7fd284005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd298ff9640 1 -- 172.21.15.2:0/982773381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2940039a0 con 0x7fd29c159050 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd298ff9640 1 -- 172.21.15.2:0/982773381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd294003b00 con 0x7fd29c159050 2023-11-04T01:43:43.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd298ff9640 1 -- 172.21.15.2:0/982773381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2940b7710 con 0x7fd29c159050 2023-11-04T01:43:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c0a8550 con 0x7fd29c159050 2023-11-04T01:43:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c0a8b10 con 0x7fd29c159050 2023-11-04T01:43:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c0a8d00 con 0x7fd29c159050 2023-11-04T01:43:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd298ff9640 1 -- 172.21.15.2:0/982773381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd2940b7870 con 0x7fd29c159050 2023-11-04T01:43:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd298ff9640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2880664d0 0x7fd288068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd298ff9640 1 -- 172.21.15.2:0/982773381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd29411e340 con 0x7fd29c159050 2023-11-04T01:43:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.316+0000 7fd29bfff640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2880664d0 0x7fd288068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.320+0000 7fd29bfff640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2880664d0 0x7fd288068990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd28c001280 tx=0x7fd28c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.320+0000 7fd298ff9640 1 -- 172.21.15.2:0/982773381 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd2940eb6d0 con 0x7fd29c159050 2023-11-04T01:43:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.476+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd29c0744a0 con 0x7fd29c159050 2023-11-04T01:43:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.476+0000 7fd298ff9640 1 -- 172.21.15.2:0/982773381 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2940f5030 con 0x7fd29c159050 2023-11-04T01:43:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2880664d0 msgr2=0x7fd288068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2880664d0 0x7fd288068990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd28c001280 tx=0x7fd28c009040 comp rx=0 tx=0).stop 2023-11-04T01:43:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29c159050 msgr2=0x7fd29c1f0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29c159050 0x7fd29c1f0770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd294002240 tx=0x7fd284005800 comp rx=0 tx=0).stop 2023-11-04T01:43:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 shutdown_connections 2023-11-04T01:43:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd2880664d0 0x7fd288068990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd29c159050 0x7fd29c1f0770 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd29c15c6d0 0x7fd29c158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 --2- 172.21.15.2:0/982773381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd284004d10 0x7fd29c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 >> 172.21.15.2:0/982773381 conn(0x7fd29c0cb510 msgr2=0x7fd29c0ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 shutdown_connections 2023-11-04T01:43:43.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.480+0000 7fd2a284d640 1 -- 172.21.15.2:0/982773381 wait complete. 2023-11-04T01:43:43.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:43:43.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab4e65b640 1 Processor -- start 2023-11-04T01:43:43.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab4e65b640 1 -- start start 2023-11-04T01:43:43.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab4e65b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fab4815acb0 0x7fab4815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab4e65b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab4815c160 0x7fab480b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab4e65b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab480cb130 con 0x7fab480b0a50 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab4e65b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4815bd40 con 0x7fab4815c160 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab4e65b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4806fd80 con 0x7fab4815acb0 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab477fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab4815c160 0x7fab480b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab477fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab4815c160 0x7fab480b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53924/0 (socket says 172.21.15.2:53924) 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab477fe640 1 -- 172.21.15.2:0/2933427366 learned_addr learned my addr 172.21.15.2:0/2933427366 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab47fff640 1 --2- 172.21.15.2:0/2933427366 >> v2:172.21.15.90:3300/0 conn(0x7fab4815acb0 0x7fab4815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab477fe640 1 -- 172.21.15.2:0/2933427366 >> v2:172.21.15.90:3300/0 conn(0x7fab4815acb0 msgr2=0x7fab4815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab477fe640 1 --2- 172.21.15.2:0/2933427366 >> v2:172.21.15.90:3300/0 conn(0x7fab4815acb0 0x7fab4815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab477fe640 1 -- 172.21.15.2:0/2933427366 >> v1:172.21.15.90:6789/0 conn(0x7fab480b0a50 legacy=0x7fab480ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.624+0000 7fab477fe640 1 -- 172.21.15.2:0/2933427366 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4815b680 con 0x7fab4815c160 2023-11-04T01:43:43.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab477fe640 1 --2- 172.21.15.2:0/2933427366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480b0510 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fab4806d550 tx=0x7fab3801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dea36609f87cbca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab46ffd640 1 -- 172.21.15.2:0/2933427366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380ab610 con 0x7fab4815c160 2023-11-04T01:43:43.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab46ffd640 1 -- 172.21.15.2:0/2933427366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380ab770 con 0x7fab4815c160 2023-11-04T01:43:43.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab46ffd640 1 -- 172.21.15.2:0/2933427366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380abb00 con 0x7fab4815c160 2023-11-04T01:43:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 -- 172.21.15.2:0/2933427366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 msgr2=0x7fab480b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2933427366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480b0510 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fab4806d550 tx=0x7fab3801c500 comp rx=0 tx=0).stop 2023-11-04T01:43:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 -- 172.21.15.2:0/2933427366 shutdown_connections 2023-11-04T01:43:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2933427366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480b0510 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2933427366 >> v2:172.21.15.90:3300/0 conn(0x7fab4815acb0 0x7fab4815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 -- 172.21.15.2:0/2933427366 >> 172.21.15.2:0/2933427366 conn(0x7fab480cb510 msgr2=0x7fab480cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:43.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 -- 172.21.15.2:0/2933427366 shutdown_connections 2023-11-04T01:43:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.628+0000 7fab4e65b640 1 -- 172.21.15.2:0/2933427366 wait complete. 2023-11-04T01:43:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 Processor -- start 2023-11-04T01:43:43.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 -- start start 2023-11-04T01:43:43.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab480b0a50 0x7fab480ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab4815acb0 0x7fab480c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c59e0 con 0x7fab4815c160 2023-11-04T01:43:43.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48151990 con 0x7fab4815acb0 2023-11-04T01:43:43.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c60d0 con 0x7fab480b0a50 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53932/0 (socket says 172.21.15.2:53932) 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 -- 172.21.15.2:0/2584937994 learned_addr learned my addr 172.21.15.2:0/2584937994 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab477fe640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab4815acb0 0x7fab480c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab47fff640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab480b0a50 0x7fab480ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 -- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab480b0a50 msgr2=0x7fab480ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab480b0a50 0x7fab480ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 -- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab4815acb0 msgr2=0x7fab480c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab4815acb0 0x7fab480c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 -- 172.21.15.2:0/2584937994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380094d0 con 0x7fab4815c160 2023-11-04T01:43:43.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab47fff640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab480b0a50 0x7fab480ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:43.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4cbf8640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480c54a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c730 tx=0x7fab4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab44ff9640 1 -- 172.21.15.2:0/2584937994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40003b80 con 0x7fab4815c160 2023-11-04T01:43:43.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab44ff9640 1 -- 172.21.15.2:0/2584937994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40003ce0 con 0x7fab4815c160 2023-11-04T01:43:43.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab48151be0 con 0x7fab4815c160 2023-11-04T01:43:43.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab44ff9640 1 -- 172.21.15.2:0/2584937994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000aa30 con 0x7fab4815c160 2023-11-04T01:43:43.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab480ca780 con 0x7fab4815c160 2023-11-04T01:43:43.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab480744a0 con 0x7fab4815c160 2023-11-04T01:43:43.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab44ff9640 1 -- 172.21.15.2:0/2584937994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab4000ab90 con 0x7fab4815c160 2023-11-04T01:43:43.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab44ff9640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab280664a0 0x7fab28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab44ff9640 1 -- 172.21.15.2:0/2584937994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fab40083dd0 con 0x7fab4815c160 2023-11-04T01:43:43.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.632+0000 7fab47fff640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab280664a0 0x7fab28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.636+0000 7fab47fff640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab280664a0 0x7fab28068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab30009840 tx=0x7fab30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.640+0000 7fab44ff9640 1 -- 172.21.15.2:0/2584937994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab40051140 con 0x7fab4815c160 2023-11-04T01:43:43.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.788+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab480cde30 con 0x7fab4815c160 2023-11-04T01:43:43.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.788+0000 7fab44ff9640 1 -- 172.21.15.2:0/2584937994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab40054760 con 0x7fab4815c160 2023-11-04T01:43:43.794 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:43.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab280664a0 msgr2=0x7fab28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab280664a0 0x7fab28068960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fab30009840 tx=0x7fab30008040 comp rx=0 tx=0).stop 2023-11-04T01:43:43.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 msgr2=0x7fab480c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480c54a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c730 tx=0x7fab4000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 shutdown_connections 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab280664a0 0x7fab28068960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab4815c160 0x7fab480c54a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab4815acb0 0x7fab480c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 --2- 172.21.15.2:0/2584937994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab480b0a50 0x7fab480ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 >> 172.21.15.2:0/2584937994 conn(0x7fab480cb510 msgr2=0x7fab48155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 shutdown_connections 2023-11-04T01:43:43.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.792+0000 7fab4e65b640 1 -- 172.21.15.2:0/2584937994 wait complete. 2023-11-04T01:43:43.812 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:43:43.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b80933640 1 Processor -- start 2023-11-04T01:43:43.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b80933640 1 -- start start 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b80933640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b7c0caa40 0x7f7b7c071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b80933640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c066250 con 0x7f7b7c159f50 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b80933640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c06b3f0 con 0x7f7b7c065dc0 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b80933640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c06b6d0 con 0x7f7b7c0caa40 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b7ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b7c0caa40 0x7f7b7c071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b7a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7b7c159f50 0x7f7b7c0ccf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57956/0 (socket says 172.21.15.2:57956) 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b7a59c640 1 -- 172.21.15.2:0/844445577 learned_addr learned my addr 172.21.15.2:0/844445577 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:43.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b7ad9d640 1 -- 172.21.15.2:0/844445577 >> v1:172.21.15.90:6789/0 conn(0x7f7b7c065dc0 legacy=0x7f7b7c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b7ad9d640 1 -- 172.21.15.2:0/844445577 >> v1:172.21.15.2:6789/0 conn(0x7f7b7c159f50 legacy=0x7f7b7c0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b7ad9d640 1 -- 172.21.15.2:0/844445577 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c15a330 con 0x7f7b7c0caa40 2023-11-04T01:43:43.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b79d9b640 1 -- 172.21.15.2:0/844445577 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027075470 0 0) 0x7f7b7c066250 con 0x7f7b7c159f50 2023-11-04T01:43:43.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.928+0000 7f7b7ad9d640 1 --2- 172.21.15.2:0/844445577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c071a00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009d90 tx=0x7f7b7401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0af9bcf6fb4c7f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b79d9b640 1 -- 172.21.15.2:0/844445577 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740a5860 con 0x7f7b7c0caa40 2023-11-04T01:43:43.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b79d9b640 1 -- 172.21.15.2:0/844445577 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b740a59c0 con 0x7f7b7c0caa40 2023-11-04T01:43:43.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b79d9b640 1 -- 172.21.15.2:0/844445577 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740a5d50 con 0x7f7b7c0caa40 2023-11-04T01:43:43.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- 172.21.15.2:0/844445577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 msgr2=0x7f7b7c071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 --2- 172.21.15.2:0/844445577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c071a00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009d90 tx=0x7f7b7401c890 comp rx=0 tx=0).stop 2023-11-04T01:43:43.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- 172.21.15.2:0/844445577 shutdown_connections 2023-11-04T01:43:43.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 --2- 172.21.15.2:0/844445577 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c071a00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- 172.21.15.2:0/844445577 >> 172.21.15.2:0/844445577 conn(0x7f7b7c0b0e30 msgr2=0x7f7b7c0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:43.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- 172.21.15.2:0/844445577 shutdown_connections 2023-11-04T01:43:43.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- 172.21.15.2:0/844445577 wait complete. 2023-11-04T01:43:43.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 Processor -- start 2023-11-04T01:43:43.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- start start 2023-11-04T01:43:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c15a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c159f50 0x7f7b7c14dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0c5500 0x7f7b7c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15ce00 con 0x7f7b7c0caa40 2023-11-04T01:43:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15aac0 con 0x7f7b7c0c5500 2023-11-04T01:43:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b80933640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c3ae0 con 0x7f7b7c159f50 2023-11-04T01:43:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c15a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53938/0 (socket says 172.21.15.2:53938) 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 -- 172.21.15.2:0/295667167 learned_addr learned my addr 172.21.15.2:0/295667167 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7ad9d640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0c5500 0x7f7b7c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 -- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c159f50 msgr2=0x7f7b7c14dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b73fff640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c159f50 0x7f7b7c14dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c159f50 0x7f7b7c14dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 -- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0c5500 msgr2=0x7f7b7c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0c5500 0x7f7b7c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7a59c640 1 -- 172.21.15.2:0/295667167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74009a70 con 0x7f7b7c0caa40 2023-11-04T01:43:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b7ad9d640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0c5500 0x7f7b7c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.932+0000 7f7b73fff640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c159f50 0x7f7b7c14dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b7a59c640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c15a580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00c440 tx=0x7f7b6c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b72ffd640 1 -- 172.21.15.2:0/295667167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0074e0 con 0x7f7b7c0caa40 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b72ffd640 1 -- 172.21.15.2:0/295667167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c007640 con 0x7f7b7c0caa40 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c14e190 con 0x7f7b7c0caa40 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b72ffd640 1 -- 172.21.15.2:0/295667167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c004a10 con 0x7f7b7c0caa40 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c15c840 con 0x7f7b7c0caa40 2023-11-04T01:43:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c0675f0 con 0x7f7b7c0caa40 2023-11-04T01:43:43.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b72ffd640 1 -- 172.21.15.2:0/295667167 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b6c004b70 con 0x7f7b7c0caa40 2023-11-04T01:43:43.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b72ffd640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b5c0664a0 0x7f7b5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:43.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b72ffd640 1 -- 172.21.15.2:0/295667167 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f7b6c0834b0 con 0x7f7b7c0caa40 2023-11-04T01:43:43.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b73fff640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b5c0664a0 0x7f7b5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:43.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.936+0000 7f7b73fff640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b5c0664a0 0x7f7b5c068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0c7920 tx=0x7f7b64009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:43.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:43.940+0000 7f7b72ffd640 1 -- 172.21.15.2:0/295667167 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b6c050790 con 0x7f7b7c0caa40 2023-11-04T01:43:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.092+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b7c0b52c0 con 0x7f7b7c0caa40 2023-11-04T01:43:44.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b72ffd640 1 -- 172.21.15.2:0/295667167 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b6c053db0 con 0x7f7b7c0caa40 2023-11-04T01:43:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b5c0664a0 msgr2=0x7f7b5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b5c0664a0 0x7f7b5c068960 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0c7920 tx=0x7f7b64009040 comp rx=0 tx=0).stop 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 msgr2=0x7f7b7c15a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c15a580 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00c440 tx=0x7f7b6c00c900 comp rx=0 tx=0).stop 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 shutdown_connections 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b5c0664a0 0x7f7b5c068960 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0c5500 0x7f7b7c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c159f50 0x7f7b7c14dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 --2- 172.21.15.2:0/295667167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0caa40 0x7f7b7c15a580 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 >> 172.21.15.2:0/295667167 conn(0x7f7b7c0b0e30 msgr2=0x7f7b7c0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 shutdown_connections 2023-11-04T01:43:44.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.096+0000 7f7b80933640 1 -- 172.21.15.2:0/295667167 wait complete. 2023-11-04T01:43:44.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:44.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3ef4de4640 1 Processor -- start 2023-11-04T01:43:44.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3ef4de4640 1 -- start start 2023-11-04T01:43:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3ef4de4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3ef00b0c20 0x7f3ef015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3ef4de4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef00cb130 con 0x7f3ef015c160 2023-11-04T01:43:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3ef4de4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef015b680 con 0x7f3ef015acb0 2023-11-04T01:43:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3ef4de4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef015bd40 con 0x7f3ef00b0c20 2023-11-04T01:43:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eeed9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3ef015c160 0x7f3ef00ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57962/0 (socket says 172.21.15.2:57962) 2023-11-04T01:43:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eeed9d640 1 -- 172.21.15.2:0/1821280841 learned_addr learned my addr 172.21.15.2:0/1821280841 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:44.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eedd9b640 1 --2- 172.21.15.2:0/1821280841 >> v2:172.21.15.90:3300/0 conn(0x7f3ef00b0c20 0x7f3ef015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270290515 0 0) 0x7f3ef00cb130 con 0x7f3ef015c160 2023-11-04T01:43:44.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003530 con 0x7f3ef015c160 2023-11-04T01:43:44.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3468911317 0 0) 0x7f3ed8003530 con 0x7f3ef015c160 2023-11-04T01:43:44.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 >> v2:172.21.15.90:3300/0 conn(0x7f3ef00b0c20 msgr2=0x7f3ef015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 --2- 172.21.15.2:0/1821280841 >> v2:172.21.15.90:3300/0 conn(0x7f3ef00b0c20 0x7f3ef015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 >> v1:172.21.15.90:6789/0 conn(0x7f3ef015acb0 legacy=0x7f3ef00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef015b960 con 0x7f3ef015c160 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3ee8001a00 con 0x7f3ef015c160 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 >> v1:172.21.15.2:6789/0 conn(0x7f3ef015c160 legacy=0x7f3ef00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ed8003980 0x7f3ed8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed80047d0 0x7f3ed8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ed8005190 0x7f3ed800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef015bd40 con 0x7f3ed8003980 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800c030 con 0x7f3ed80047d0 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800c1f0 con 0x7f3ed8005190 2023-11-04T01:43:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.236+0000 7f3eee59c640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ed8003980 0x7f3ed8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eedd9b640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed80047d0 0x7f3ed8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eeed9d640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ed8005190 0x7f3ed800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eee59c640 1 -- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ed8005190 msgr2=0x7f3ed800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eee59c640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ed8005190 0x7f3ed800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eee59c640 1 -- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed80047d0 msgr2=0x7f3ed8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eee59c640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed80047d0 0x7f3ed8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eee59c640 1 -- 172.21.15.2:0/1821280841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8003530 con 0x7f3ed8003980 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eeed9d640 1 -- 172.21.15.2:0/1821280841 reap_dead start 2023-11-04T01:43:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eedd9b640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed80047d0 0x7f3ed8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eee59c640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ed8003980 0x7f3ed8003da0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0001780 tx=0x7f3ee001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacc3d48a26930f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee00052d0 con 0x7f3ed8003980 2023-11-04T01:43:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee00a7050 con 0x7f3ed8003980 2023-11-04T01:43:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3eed59a640 1 -- 172.21.15.2:0/1821280841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0003600 con 0x7f3ed8003980 2023-11-04T01:43:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3ef4de4640 1 -- 172.21.15.2:0/1821280841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ed8003980 msgr2=0x7f3ed8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ed8003980 0x7f3ed8003da0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0001780 tx=0x7f3ee001c3e0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3ef4de4640 1 -- 172.21.15.2:0/1821280841 shutdown_connections 2023-11-04T01:43:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/1821280841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ed8003980 0x7f3ed8003da0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.240+0000 7f3ef4de4640 1 -- 172.21.15.2:0/1821280841 >> 172.21.15.2:0/1821280841 conn(0x7f3ef00cb510 msgr2=0x7f3ef00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- 172.21.15.2:0/1821280841 shutdown_connections 2023-11-04T01:43:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- 172.21.15.2:0/1821280841 wait complete. 2023-11-04T01:43:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 Processor -- start 2023-11-04T01:43:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- start start 2023-11-04T01:43:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed8003980 0x7f3ef014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef00acb20 0x7f3ef006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ef006cfb0 0x7f3ef014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef014d930 con 0x7f3ef00acb20 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef014db80 con 0x7f3ed8003980 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef014de60 con 0x7f3ef006cfb0 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef00acb20 0x7f3ef006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef00acb20 0x7f3ef006ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53958/0 (socket says 172.21.15.2:53958) 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 -- 172.21.15.2:0/2443437284 learned_addr learned my addr 172.21.15.2:0/2443437284 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eee59c640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed8003980 0x7f3ef014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eeed9d640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ef006cfb0 0x7f3ef014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 -- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ef006cfb0 msgr2=0x7f3ef014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ef006cfb0 0x7f3ef014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 -- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed8003980 msgr2=0x7f3ef014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed8003980 0x7f3ef014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 -- 172.21.15.2:0/2443437284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef014e140 con 0x7f3ef00acb20 2023-11-04T01:43:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eee59c640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed8003980 0x7f3ef014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eeed9d640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ef006cfb0 0x7f3ef014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3eedd9b640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef00acb20 0x7f3ef006ca70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4011510 tx=0x7f3ee40119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3edeffd640 1 -- 172.21.15.2:0/2443437284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4004220 con 0x7f3ef00acb20 2023-11-04T01:43:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3edeffd640 1 -- 172.21.15.2:0/2443437284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee4004380 con 0x7f3ef00acb20 2023-11-04T01:43:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef014e420 con 0x7f3ef00acb20 2023-11-04T01:43:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3edeffd640 1 -- 172.21.15.2:0/2443437284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4015890 con 0x7f3ef00acb20 2023-11-04T01:43:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.244+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef014fbe0 con 0x7f3ef00acb20 2023-11-04T01:43:44.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.248+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef00744a0 con 0x7f3ef00acb20 2023-11-04T01:43:44.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.248+0000 7f3edeffd640 1 -- 172.21.15.2:0/2443437284 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ee40159f0 con 0x7f3ef00acb20 2023-11-04T01:43:44.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.248+0000 7f3edeffd640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ed00664a0 0x7f3ed0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.248+0000 7f3edeffd640 1 -- 172.21.15.2:0/2443437284 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f3ee40841c0 con 0x7f3ef00acb20 2023-11-04T01:43:44.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.248+0000 7f3eee59c640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ed00664a0 0x7f3ed0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.248+0000 7f3eee59c640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ed00664a0 0x7f3ed0068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0001750 tx=0x7f3ee00011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.252+0000 7f3edeffd640 1 -- 172.21.15.2:0/2443437284 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ee4051530 con 0x7f3ef00acb20 2023-11-04T01:43:44.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.404+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3ef014fbe0 con 0x7f3ef00acb20 2023-11-04T01:43:44.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.404+0000 7f3edeffd640 1 -- 172.21.15.2:0/2443437284 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v37) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3ef014fbe0 con 0x7f3ef00acb20 2023-11-04T01:43:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ed00664a0 msgr2=0x7f3ed0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ed00664a0 0x7f3ed0068960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0001750 tx=0x7f3ee00011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef00acb20 msgr2=0x7f3ef006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef00acb20 0x7f3ef006ca70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4011510 tx=0x7f3ee40119d0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 shutdown_connections 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ed00664a0 0x7f3ed0068960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ef006cfb0 0x7f3ef014cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ef00acb20 0x7f3ef006ca70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 --2- 172.21.15.2:0/2443437284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ed8003980 0x7f3ef014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 >> 172.21.15.2:0/2443437284 conn(0x7f3ef00cb510 msgr2=0x7f3ef00cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 shutdown_connections 2023-11-04T01:43:44.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.408+0000 7f3ef4de4640 1 -- 172.21.15.2:0/2443437284 wait complete. 2023-11-04T01:43:44.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.540+0000 7f8551820640 1 Processor -- start 2023-11-04T01:43:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.540+0000 7f8551820640 1 -- start start 2023-11-04T01:43:44.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f8551820640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c159a50 0x7f854c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f8551820640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f854c0ce720 0x7f854c06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f8551820640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c159e30 con 0x7f854c0ce070 2023-11-04T01:43:44.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f8551820640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c070b80 con 0x7f854c0ce720 2023-11-04T01:43:44.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f8551820640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0ccfd0 con 0x7f854c159a50 2023-11-04T01:43:44.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f85427fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f854c0ce720 0x7f854c06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f85427fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f854c0ce720 0x7f854c06ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53974/0 (socket says 172.21.15.2:53974) 2023-11-04T01:43:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f85427fc640 1 -- 172.21.15.2:0/1349552623 learned_addr learned my addr 172.21.15.2:0/1349552623 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f854affd640 1 --2- 172.21.15.2:0/1349552623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c159a50 0x7f854c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f85427fc640 1 -- 172.21.15.2:0/1349552623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c159a50 msgr2=0x7f854c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f85427fc640 1 --2- 172.21.15.2:0/1349552623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c159a50 0x7f854c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f85427fc640 1 -- 172.21.15.2:0/1349552623 >> v1:172.21.15.90:6789/0 conn(0x7f854c0ce070 legacy=0x7f854c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.544+0000 7f85427fc640 1 -- 172.21.15.2:0/1349552623 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0cd2b0 con 0x7f854c0ce720 2023-11-04T01:43:44.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f85427fc640 1 --2- 172.21.15.2:0/1349552623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce720 0x7f854c06ba90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f853400aa40 tx=0x7f85340200e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de69027786a19351 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854a7fc640 1 -- 172.21.15.2:0/1349552623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85340b1440 con 0x7f854c0ce720 2023-11-04T01:43:44.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854a7fc640 1 -- 172.21.15.2:0/1349552623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85340b15a0 con 0x7f854c0ce720 2023-11-04T01:43:44.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854a7fc640 1 -- 172.21.15.2:0/1349552623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85340b1930 con 0x7f854c0ce720 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- 172.21.15.2:0/1349552623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce720 msgr2=0x7f854c06ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 --2- 172.21.15.2:0/1349552623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce720 0x7f854c06ba90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f853400aa40 tx=0x7f85340200e0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- 172.21.15.2:0/1349552623 shutdown_connections 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 --2- 172.21.15.2:0/1349552623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce720 0x7f854c06ba90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 --2- 172.21.15.2:0/1349552623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c159a50 0x7f854c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- 172.21.15.2:0/1349552623 >> 172.21.15.2:0/1349552623 conn(0x7f854c0cebb0 msgr2=0x7f854c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- 172.21.15.2:0/1349552623 shutdown_connections 2023-11-04T01:43:44.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- 172.21.15.2:0/1349552623 wait complete. 2023-11-04T01:43:44.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 Processor -- start 2023-11-04T01:43:44.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- start start 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce070 0x7f854c0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0ce720 0x7f854c1f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c159a50 0x7f854c145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c149e40 con 0x7f854c0ce070 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0b4450 con 0x7f854c159a50 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0b3840 con 0x7f854c0ce720 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce070 0x7f854c0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce070 0x7f854c0b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53982/0 (socket says 172.21.15.2:53982) 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 -- 172.21.15.2:0/2942877940 learned_addr learned my addr 172.21.15.2:0/2942877940 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:44.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854b7fe640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c159a50 0x7f854c145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 -- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0ce720 msgr2=0x7f854c1f0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0ce720 0x7f854c1f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 -- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c159a50 msgr2=0x7f854c145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c159a50 0x7f854c145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 -- 172.21.15.2:0/2942877940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853400a670 con 0x7f854c0ce070 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854b7fe640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c159a50 0x7f854c145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f854affd640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce070 0x7f854c0b31a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f853c00d5f0 tx=0x7f853c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8548ff9640 1 -- 172.21.15.2:0/2942877940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0125f0 con 0x7f854c0ce070 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8548ff9640 1 -- 172.21.15.2:0/2942877940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c012750 con 0x7f854c0ce070 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8548ff9640 1 -- 172.21.15.2:0/2942877940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c012ae0 con 0x7f854c0ce070 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c0b3b20 con 0x7f854c0ce070 2023-11-04T01:43:44.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.548+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c0b40e0 con 0x7f854c0ce070 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.552+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c0744a0 con 0x7f854c0ce070 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.552+0000 7f8548ff9640 1 -- 172.21.15.2:0/2942877940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f853c012c40 con 0x7f854c0ce070 2023-11-04T01:43:44.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.552+0000 7f8548ff9640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f852c0664d0 0x7f852c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.552+0000 7f8548ff9640 1 -- 172.21.15.2:0/2942877940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f853c084e90 con 0x7f854c0ce070 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.552+0000 7f85427fc640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f852c0664d0 0x7f852c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.552+0000 7f85427fc640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f852c0664d0 0x7f852c068990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85340b3000 tx=0x7f8534004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.556+0000 7f8548ff9640 1 -- 172.21.15.2:0/2942877940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f853c052270 con 0x7f854c0ce070 2023-11-04T01:43:44.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.740+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f854c0b0d10 con 0x7f854c0ce070 2023-11-04T01:43:44.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8548ff9640 1 -- 172.21.15.2:0/2942877940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4897 (secure 0 0 0) 0x7f853c055890 con 0x7f854c0ce070 2023-11-04T01:43:44.748 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/926400153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":926400153},{"type":"v1","addr":"172.21.15.90:6837","nonce":926400153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/1780832630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1780832630},{"type":"v1","addr":"172.21.15.90:6836","nonce":1780832630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/763530639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":763530639},{"type":"v1","addr":"172.21.15.2:6834","nonce":763530639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:28.120677+0000","modified":"2023-11-04T01:43:31.147336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/610836033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":610836033},{"type":"v1","addr":"172.21.15.2:6835","nonce":610836033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:43:44.748 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 14 2023-11-04T01:43:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f852c0664d0 msgr2=0x7f852c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f852c0664d0 0x7f852c068990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85340b3000 tx=0x7f8534004740 comp rx=0 tx=0).stop 2023-11-04T01:43:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce070 msgr2=0x7f854c0b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce070 0x7f854c0b31a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f853c00d5f0 tx=0x7f853c00dab0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 shutdown_connections 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f852c0664d0 0x7f852c068990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854c159a50 0x7f854c145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f854c0ce720 0x7f854c1f0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 --2- 172.21.15.2:0/2942877940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c0ce070 0x7f854c0b31a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 >> 172.21.15.2:0/2942877940 conn(0x7f854c0cebb0 msgr2=0x7f854c153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 shutdown_connections 2023-11-04T01:43:44.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.744+0000 7f8551820640 1 -- 172.21.15.2:0/2942877940 wait complete. 2023-11-04T01:43:44.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd771e640 1 Processor -- start 2023-11-04T01:43:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd771e640 1 -- start start 2023-11-04T01:43:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd771e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd00715d0 0x7f8cd00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd771e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd00c2670 con 0x7f8cd00b0b70 2023-11-04T01:43:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd771e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd006bc30 con 0x7f8cd015afd0 2023-11-04T01:43:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd771e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0070140 con 0x7f8cd00715d0 2023-11-04T01:43:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd5cbb640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8cd00b0b70 0x7f8cd015ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57972/0 (socket says 172.21.15.2:57972) 2023-11-04T01:43:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.880+0000 7f8cd5cbb640 1 -- 172.21.15.2:0/3287090134 learned_addr learned my addr 172.21.15.2:0/3287090134 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cd4cb9640 1 --2- 172.21.15.2:0/3287090134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd00715d0 0x7f8cd00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cc7fff640 1 -- 172.21.15.2:0/3287090134 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495961054 0 0) 0x7f8cd00c2670 con 0x7f8cd00b0b70 2023-11-04T01:43:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cc7fff640 1 -- 172.21.15.2:0/3287090134 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cbc003530 con 0x7f8cd00b0b70 2023-11-04T01:43:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cd4cb9640 1 -- 172.21.15.2:0/3287090134 >> v1:172.21.15.90:6789/0 conn(0x7f8cd015afd0 legacy=0x7f8cd006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cd4cb9640 1 -- 172.21.15.2:0/3287090134 >> v1:172.21.15.2:6789/0 conn(0x7f8cd00b0b70 legacy=0x7f8cd015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cc7fff640 1 -- 172.21.15.2:0/3287090134 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614962667 0 0) 0x7f8cd006bc30 con 0x7f8cd015afd0 2023-11-04T01:43:44.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cd4cb9640 1 -- 172.21.15.2:0/3287090134 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd006bf10 con 0x7f8cd00715d0 2023-11-04T01:43:44.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.884+0000 7f8cd4cb9640 1 --2- 172.21.15.2:0/3287090134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd00715d0 0x7f8cd00b0630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0097f0 tx=0x7f8ccc01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31a81cc5617ef85 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cc7fff640 1 -- 172.21.15.2:0/3287090134 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0ab600 con 0x7f8cd00715d0 2023-11-04T01:43:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cc7fff640 1 -- 172.21.15.2:0/3287090134 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0a7050 con 0x7f8cd00715d0 2023-11-04T01:43:44.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cc7fff640 1 -- 172.21.15.2:0/3287090134 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0ab980 con 0x7f8cd00715d0 2023-11-04T01:43:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- 172.21.15.2:0/3287090134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd00715d0 msgr2=0x7f8cd00b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3287090134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd00715d0 0x7f8cd00b0630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0097f0 tx=0x7f8ccc01c4c0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- 172.21.15.2:0/3287090134 shutdown_connections 2023-11-04T01:43:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3287090134 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd00715d0 0x7f8cd00b0630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- 172.21.15.2:0/3287090134 >> 172.21.15.2:0/3287090134 conn(0x7f8cd00cebb0 msgr2=0x7f8cd00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- 172.21.15.2:0/3287090134 shutdown_connections 2023-11-04T01:43:44.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- 172.21.15.2:0/3287090134 wait complete. 2023-11-04T01:43:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 Processor -- start 2023-11-04T01:43:44.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- start start 2023-11-04T01:43:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd00715d0 0x7f8cd00c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd00b0b70 0x7f8cd014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd015afd0 0x7f8cd00b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b2020 con 0x7f8cd00b0b70 2023-11-04T01:43:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b2300 con 0x7f8cd00715d0 2023-11-04T01:43:44.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b25e0 con 0x7f8cd015afd0 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd00b0b70 0x7f8cd014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd00b0b70 0x7f8cd014f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53988/0 (socket says 172.21.15.2:53988) 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 -- 172.21.15.2:0/3116224509 learned_addr learned my addr 172.21.15.2:0/3116224509 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd5cbb640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd015afd0 0x7f8cd00b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd54ba640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd00715d0 0x7f8cd00c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 -- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd015afd0 msgr2=0x7f8cd00b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd015afd0 0x7f8cd00b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 -- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd00715d0 msgr2=0x7f8cd00c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd00715d0 0x7f8cd00c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 -- 172.21.15.2:0/3116224509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc009420 con 0x7f8cd00b0b70 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd5cbb640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd015afd0 0x7f8cd00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:44.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd4cb9640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd00b0b70 0x7f8cd014f260 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0097f0 tx=0x7f8ccc019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cc5ffb640 1 -- 172.21.15.2:0/3116224509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc004020 con 0x7f8cd00b0b70 2023-11-04T01:43:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cc5ffb640 1 -- 172.21.15.2:0/3116224509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc004180 con 0x7f8cd00b0b70 2023-11-04T01:43:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.892+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd00b28c0 con 0x7f8cd00b0b70 2023-11-04T01:43:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cc5ffb640 1 -- 172.21.15.2:0/3116224509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0044f0 con 0x7f8cd00b0b70 2023-11-04T01:43:44.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd014f7a0 con 0x7f8cd00b0b70 2023-11-04T01:43:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd0068310 con 0x7f8cd00b0b70 2023-11-04T01:43:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cc5ffb640 1 -- 172.21.15.2:0/3116224509 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ccc0b2040 con 0x7f8cd00b0b70 2023-11-04T01:43:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cc5ffb640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8cb40664a0 0x7f8cb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cc5ffb640 1 -- 172.21.15.2:0/3116224509 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8ccc11d030 con 0x7f8cd00b0b70 2023-11-04T01:43:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cd54ba640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8cb40664a0 0x7f8cb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:44.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.896+0000 7f8cd54ba640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8cb40664a0 0x7f8cb4068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0000f70 tx=0x7f8cc0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:44.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:44.900+0000 7f8cc5ffb640 1 -- 172.21.15.2:0/3116224509 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8ccc0ea330 con 0x7f8cd00b0b70 2023-11-04T01:43:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.056+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cd00744a0 con 0x7f8cd00b0b70 2023-11-04T01:43:45.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.060+0000 7f8cc5ffb640 1 -- 172.21.15.2:0/3116224509 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18193 (secure 0 0 0) 0x7f8ccc0ed950 con 0x7f8cd00b0b70 2023-11-04T01:43:45.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:44.513894+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:26.399544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:27.128100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8cb40664a0 msgr2=0x7f8cb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8cb40664a0 0x7f8cb4068960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0000f70 tx=0x7f8cc0009040 comp rx=0 tx=0).stop 2023-11-04T01:43:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd00b0b70 msgr2=0x7f8cd014f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd00b0b70 0x7f8cd014f260 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0097f0 tx=0x7f8ccc019260 comp rx=0 tx=0).stop 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 shutdown_connections 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8cb40664a0 0x7f8cb4068960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8cd015afd0 0x7f8cd00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8cd00b0b70 0x7f8cd014f260 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 --2- 172.21.15.2:0/3116224509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8cd00715d0 0x7f8cd00c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 >> 172.21.15.2:0/3116224509 conn(0x7f8cd00cebb0 msgr2=0x7f8cd00cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 shutdown_connections 2023-11-04T01:43:45.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.064+0000 7f8cd771e640 1 -- 172.21.15.2:0/3116224509 wait complete. 2023-11-04T01:43:45.086 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:43:45.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:45.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.204+0000 7ff08db9e640 1 Processor -- start 2023-11-04T01:43:45.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.204+0000 7ff08db9e640 1 -- start start 2023-11-04T01:43:45.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff08db9e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff0880b0890 0x7ff0880cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff08db9e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0c70 0x7ff0880ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff08db9e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880ce320 con 0x7ff0880c9960 2023-11-04T01:43:45.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff08db9e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08806d2f0 con 0x7ff0880b0890 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff08db9e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880ce110 con 0x7ff0880b0c70 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff0880b0890 0x7ff0880cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff0880b0890 0x7ff0880cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53990/0 (socket says 172.21.15.2:53990) 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 -- 172.21.15.2:0/1730436659 learned_addr learned my addr 172.21.15.2:0/1730436659 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 -- 172.21.15.2:0/1730436659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0c70 msgr2=0x7ff0880ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff087fff640 1 --2- 172.21.15.2:0/1730436659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0c70 0x7ff0880ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 --2- 172.21.15.2:0/1730436659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0c70 0x7ff0880ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 -- 172.21.15.2:0/1730436659 >> v1:172.21.15.90:6789/0 conn(0x7ff0880c9960 legacy=0x7ff0880704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 -- 172.21.15.2:0/1730436659 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0880ce600 con 0x7ff0880b0890 2023-11-04T01:43:45.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff087fff640 1 --2- 172.21.15.2:0/1730436659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0c70 0x7ff0880ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:45.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0877fe640 1 --2- 172.21.15.2:0/1730436659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0890 0x7ff0880cdbd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff080009870 tx=0x7ff08001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e995df1f371692 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0867fc640 1 -- 172.21.15.2:0/1730436659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800aa5f0 con 0x7ff0880b0890 2023-11-04T01:43:45.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0867fc640 1 -- 172.21.15.2:0/1730436659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0800aa750 con 0x7ff0880b0890 2023-11-04T01:43:45.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.208+0000 7ff0867fc640 1 -- 172.21.15.2:0/1730436659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0800aaae0 con 0x7ff0880b0890 2023-11-04T01:43:45.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- 172.21.15.2:0/1730436659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0890 msgr2=0x7ff0880cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 --2- 172.21.15.2:0/1730436659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0890 0x7ff0880cdbd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff080009870 tx=0x7ff08001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- 172.21.15.2:0/1730436659 shutdown_connections 2023-11-04T01:43:45.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 --2- 172.21.15.2:0/1730436659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0c70 0x7ff0880ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 --2- 172.21.15.2:0/1730436659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0890 0x7ff0880cdbd0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- 172.21.15.2:0/1730436659 >> 172.21.15.2:0/1730436659 conn(0x7ff0880cebb0 msgr2=0x7ff0880cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:45.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- 172.21.15.2:0/1730436659 shutdown_connections 2023-11-04T01:43:45.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- 172.21.15.2:0/1730436659 wait complete. 2023-11-04T01:43:45.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 Processor -- start 2023-11-04T01:43:45.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- start start 2023-11-04T01:43:45.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0890 0x7ff0880c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0c70 0x7ff0881515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0880c9960 0x7ff0880b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088151af0 con 0x7ff0880b0c70 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880c6c90 con 0x7ff0880c9960 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0880c5bf0 con 0x7ff0880b0890 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0c70 0x7ff0881515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0c70 0x7ff0881515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53994/0 (socket says 172.21.15.2:53994) 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 -- 172.21.15.2:0/2040395738 learned_addr learned my addr 172.21.15.2:0/2040395738 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 -- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0890 msgr2=0x7ff0880c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff0877fe640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0890 0x7ff0880c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0890 0x7ff0880c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 -- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0880c9960 msgr2=0x7ff0880b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff087fff640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0880c9960 0x7ff0880b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0880c9960 0x7ff0880b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 -- 172.21.15.2:0/2040395738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0800094d0 con 0x7ff0880b0c70 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff087fff640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0880c9960 0x7ff0880b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff086ffd640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0c70 0x7ff0881515b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff07000ba80 tx=0x7ff07000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff07ffff640 1 -- 172.21.15.2:0/2040395738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000cc00 con 0x7ff0880b0c70 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff07ffff640 1 -- 172.21.15.2:0/2040395738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07000cd60 con 0x7ff0880b0c70 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0880c5ed0 con 0x7ff0880b0c70 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff07ffff640 1 -- 172.21.15.2:0/2040395738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070003bc0 con 0x7ff0880b0c70 2023-11-04T01:43:45.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.212+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0880c6490 con 0x7ff0880b0c70 2023-11-04T01:43:45.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.216+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0880744a0 con 0x7ff0880b0c70 2023-11-04T01:43:45.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.216+0000 7ff07ffff640 1 -- 172.21.15.2:0/2040395738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff070014440 con 0x7ff0880b0c70 2023-11-04T01:43:45.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.216+0000 7ff07ffff640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0680664a0 0x7ff068068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.216+0000 7ff07ffff640 1 -- 172.21.15.2:0/2040395738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff070084550 con 0x7ff0880b0c70 2023-11-04T01:43:45.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.216+0000 7ff0877fe640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0680664a0 0x7ff068068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.216+0000 7ff0877fe640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0680664a0 0x7ff068068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0800ae000 tx=0x7ff080008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.220+0000 7ff07ffff640 1 -- 172.21.15.2:0/2040395738 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0700519c0 con 0x7ff0880b0c70 2023-11-04T01:43:45.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.408+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff088164dd0 con 0x7ff0880b0c70 2023-11-04T01:43:45.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff07ffff640 1 -- 172.21.15.2:0/2040395738 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4897 (secure 0 0 0) 0x7ff070022020 con 0x7ff0880b0c70 2023-11-04T01:43:45.415 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:45.416 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/926400153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":926400153},{"type":"v1","addr":"172.21.15.90:6837","nonce":926400153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/1780832630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1780832630},{"type":"v1","addr":"172.21.15.90:6836","nonce":1780832630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/763530639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":763530639},{"type":"v1","addr":"172.21.15.2:6834","nonce":763530639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:28.120677+0000","modified":"2023-11-04T01:43:31.147336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/610836033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":610836033},{"type":"v1","addr":"172.21.15.2:6835","nonce":610836033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:43:45.416 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 14 2023-11-04T01:43:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0680664a0 msgr2=0x7ff068068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0680664a0 0x7ff068068960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0800ae000 tx=0x7ff080008040 comp rx=0 tx=0).stop 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0c70 msgr2=0x7ff0881515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0c70 0x7ff0881515b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff07000ba80 tx=0x7ff07000bf40 comp rx=0 tx=0).stop 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 shutdown_connections 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0680664a0 0x7ff068068960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0880c9960 0x7ff0880b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0880b0c70 0x7ff0881515b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 --2- 172.21.15.2:0/2040395738 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0880b0890 0x7ff0880c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 >> 172.21.15.2:0/2040395738 conn(0x7ff0880cebb0 msgr2=0x7ff08815ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 shutdown_connections 2023-11-04T01:43:45.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.412+0000 7ff08db9e640 1 -- 172.21.15.2:0/2040395738 wait complete. 2023-11-04T01:43:45.434 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f17710be640 1 Processor -- start 2023-11-04T01:43:45.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f17710be640 1 -- start start 2023-11-04T01:43:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f17710be640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f176c15b090 0x7f176c15f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f17710be640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c15b470 0x7f176c06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f17710be640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0cbe40 con 0x7f176c065fd0 2023-11-04T01:43:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f17710be640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c15fca0 con 0x7f176c15b090 2023-11-04T01:43:45.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f17710be640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0cc120 con 0x7f176c15b470 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f176c15b090 0x7f176c15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f176c15b090 0x7f176c15f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54000/0 (socket says 172.21.15.2:54000) 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176ad9d640 1 -- 172.21.15.2:0/3742385386 learned_addr learned my addr 172.21.15.2:0/3742385386 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176a59c640 1 --2- 172.21.15.2:0/3742385386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c15b470 0x7f176c06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176ad9d640 1 -- 172.21.15.2:0/3742385386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c15b470 msgr2=0x7f176c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176ad9d640 1 --2- 172.21.15.2:0/3742385386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c15b470 0x7f176c06a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176ad9d640 1 -- 172.21.15.2:0/3742385386 >> v1:172.21.15.90:6789/0 conn(0x7f176c065fd0 legacy=0x7f176c0cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:45.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.548+0000 7f176ad9d640 1 -- 172.21.15.2:0/3742385386 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0cc400 con 0x7f176c15b090 2023-11-04T01:43:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f176ad9d640 1 --2- 172.21.15.2:0/3742385386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c15f760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f176401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01215f5667a5f62 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f1769d9b640 1 -- 172.21.15.2:0/3742385386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640a5730 con 0x7f176c15b090 2023-11-04T01:43:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f1769d9b640 1 -- 172.21.15.2:0/3742385386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640a5890 con 0x7f176c15b090 2023-11-04T01:43:45.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f1769d9b640 1 -- 172.21.15.2:0/3742385386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640a5c20 con 0x7f176c15b090 2023-11-04T01:43:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 -- 172.21.15.2:0/3742385386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 msgr2=0x7f176c15f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 --2- 172.21.15.2:0/3742385386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c15f760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f176401c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 -- 172.21.15.2:0/3742385386 shutdown_connections 2023-11-04T01:43:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 --2- 172.21.15.2:0/3742385386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c15b470 0x7f176c06a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 --2- 172.21.15.2:0/3742385386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c15f760 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 -- 172.21.15.2:0/3742385386 >> 172.21.15.2:0/3742385386 conn(0x7f176c0716a0 msgr2=0x7f176c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:45.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 -- 172.21.15.2:0/3742385386 shutdown_connections 2023-11-04T01:43:45.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 -- 172.21.15.2:0/3742385386 wait complete. 2023-11-04T01:43:45.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 Processor -- start 2023-11-04T01:43:45.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.552+0000 7f17710be640 1 -- start start 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c065fd0 0x7f176c142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f176c15b470 0x7f176c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0cd990 con 0x7f176c15b090 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c153ca0 con 0x7f176c15b470 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c155a30 con 0x7f176c065fd0 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54016/0 (socket says 172.21.15.2:54016) 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 -- 172.21.15.2:0/1836749523 learned_addr learned my addr 172.21.15.2:0/1836749523 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:45.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176ad9d640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c065fd0 0x7f176c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176b59e640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f176c15b470 0x7f176c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 -- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c065fd0 msgr2=0x7f176c142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c065fd0 0x7f176c142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 -- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f176c15b470 msgr2=0x7f176c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f176c15b470 0x7f176c1554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 -- 172.21.15.2:0/1836749523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764009b30 con 0x7f176c15b090 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176a59c640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c153760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f175400d860 tx=0x7f175400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17637fe640 1 -- 172.21.15.2:0/1836749523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400de50 con 0x7f176c15b090 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17637fe640 1 -- 172.21.15.2:0/1836749523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400b8d0 con 0x7f176c15b090 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17637fe640 1 -- 172.21.15.2:0/1836749523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400bc40 con 0x7f176c15b090 2023-11-04T01:43:45.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c153e90 con 0x7f176c15b090 2023-11-04T01:43:45.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0cd2d0 con 0x7f176c15b090 2023-11-04T01:43:45.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c0cdad0 con 0x7f176c15b090 2023-11-04T01:43:45.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17637fe640 1 -- 172.21.15.2:0/1836749523 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f175401e460 con 0x7f176c15b090 2023-11-04T01:43:45.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17637fe640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f174c0664a0 0x7f174c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f17637fe640 1 -- 172.21.15.2:0/1836749523 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f1754084540 con 0x7f176c15b090 2023-11-04T01:43:45.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.556+0000 7f176ad9d640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f174c0664a0 0x7f174c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.560+0000 7f176ad9d640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f174c0664a0 0x7f174c068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f17640ae000 tx=0x7f17640a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.560+0000 7f17637fe640 1 -- 172.21.15.2:0/1836749523 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f176c0cdad0 con 0x7f176c15b090 2023-11-04T01:43:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.752+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f176c0cdad0 con 0x7f176c15b090 2023-11-04T01:43:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.752+0000 7f17637fe640 1 -- 172.21.15.2:0/1836749523 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4897 (secure 0 0 0) 0x7f176c0cdad0 con 0x7f176c15b090 2023-11-04T01:43:45.758 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:45.758 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/926400153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":926400153},{"type":"v1","addr":"172.21.15.90:6837","nonce":926400153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/1780832630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1780832630},{"type":"v1","addr":"172.21.15.90:6836","nonce":1780832630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/763530639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":763530639},{"type":"v1","addr":"172.21.15.2:6834","nonce":763530639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:28.120677+0000","modified":"2023-11-04T01:43:31.147336+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/610836033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":610836033},{"type":"v1","addr":"172.21.15.2:6835","nonce":610836033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-04T01:43:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 14 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f174c0664a0 msgr2=0x7f174c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f174c0664a0 0x7f174c068960 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f17640ae000 tx=0x7f17640a7070 comp rx=0 tx=0).stop 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 msgr2=0x7f176c153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c153760 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f175400d860 tx=0x7f175400dd20 comp rx=0 tx=0).stop 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 shutdown_connections 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f174c0664a0 0x7f174c068960 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f176c15b470 0x7f176c1554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c15b090 0x7f176c153760 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 --2- 172.21.15.2:0/1836749523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f176c065fd0 0x7f176c142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 >> 172.21.15.2:0/1836749523 conn(0x7f176c0716a0 msgr2=0x7f176c0ac0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 shutdown_connections 2023-11-04T01:43:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.756+0000 7f17710be640 1 -- 172.21.15.2:0/1836749523 wait complete. 2023-11-04T01:43:45.777 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f8991640 1 Processor -- start 2023-11-04T01:43:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f8991640 1 -- start start 2023-11-04T01:43:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f8991640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2f415a080 0x7ff2f4065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f8991640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2f415e7f0 0x7ff2f415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f8991640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f415e5c0 con 0x7ff2f415e170 2023-11-04T01:43:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f8991640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f4066510 con 0x7ff2f415e7f0 2023-11-04T01:43:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f8991640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f406b170 con 0x7ff2f415a080 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2ebfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2f415e7f0 0x7ff2f415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2ebfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2f415e7f0 0x7ff2f415dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54018/0 (socket says 172.21.15.2:54018) 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2ebfff640 1 -- 172.21.15.2:0/1979554830 learned_addr learned my addr 172.21.15.2:0/1979554830 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2f259c640 1 --2- 172.21.15.2:0/1979554830 >> v2:172.21.15.90:3300/0 conn(0x7ff2f415a080 0x7ff2f4065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2ebfff640 1 -- 172.21.15.2:0/1979554830 >> v2:172.21.15.90:3300/0 conn(0x7ff2f415a080 msgr2=0x7ff2f4065fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2ebfff640 1 --2- 172.21.15.2:0/1979554830 >> v2:172.21.15.90:3300/0 conn(0x7ff2f415a080 0x7ff2f4065fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2ebfff640 1 -- 172.21.15.2:0/1979554830 >> v1:172.21.15.90:6789/0 conn(0x7ff2f415e170 legacy=0x7ff2f40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.892+0000 7ff2ebfff640 1 -- 172.21.15.2:0/1979554830 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f40cc740 con 0x7ff2f415e7f0 2023-11-04T01:43:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2ebfff640 1 --2- 172.21.15.2:0/1979554830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f415dc30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b1f50 tx=0x7ff2dc01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d2c0290f414576 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f1d9b640 1 -- 172.21.15.2:0/1979554830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0a89b0 con 0x7ff2f415e7f0 2023-11-04T01:43:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f1d9b640 1 -- 172.21.15.2:0/1979554830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc0a8b10 con 0x7ff2f415e7f0 2023-11-04T01:43:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f1d9b640 1 -- 172.21.15.2:0/1979554830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0a8ea0 con 0x7ff2f415e7f0 2023-11-04T01:43:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- 172.21.15.2:0/1979554830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 msgr2=0x7ff2f415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1979554830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f415dc30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b1f50 tx=0x7ff2dc01ecb0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- 172.21.15.2:0/1979554830 shutdown_connections 2023-11-04T01:43:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1979554830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f415dc30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1979554830 >> v2:172.21.15.90:3300/0 conn(0x7ff2f415a080 0x7ff2f4065fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- 172.21.15.2:0/1979554830 >> 172.21.15.2:0/1979554830 conn(0x7ff2f40716a0 msgr2=0x7ff2f4071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- 172.21.15.2:0/1979554830 shutdown_connections 2023-11-04T01:43:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- 172.21.15.2:0/1979554830 wait complete. 2023-11-04T01:43:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 Processor -- start 2023-11-04T01:43:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- start start 2023-11-04T01:43:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f415a080 0x7ff2f414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f415e170 0x7ff2f40c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f4158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f41f70a0 con 0x7ff2f415e7f0 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40c5730 con 0x7ff2f415a080 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f8991640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f41f7530 con 0x7ff2f415e170 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f4158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54030/0 (socket says 172.21.15.2:54030) 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 -- 172.21.15.2:0/1842687559 learned_addr learned my addr 172.21.15.2:0/1842687559 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2ebfff640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f415e170 0x7ff2f40c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f259c640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f415a080 0x7ff2f414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 -- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f415e170 msgr2=0x7ff2f40c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f415e170 0x7ff2f40c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 -- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f415a080 msgr2=0x7ff2f414e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f415a080 0x7ff2f414e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.896+0000 7ff2f2d9d640 1 -- 172.21.15.2:0/1842687559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0094d0 con 0x7ff2f415e7f0 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2f2d9d640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f4158240 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00c780 tx=0x7ff2ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2eaffd640 1 -- 172.21.15.2:0/1842687559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec004b70 con 0x7ff2f415e7f0 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2eaffd640 1 -- 172.21.15.2:0/1842687559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00ce90 con 0x7ff2f415e7f0 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2eaffd640 1 -- 172.21.15.2:0/1842687559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00a850 con 0x7ff2f415e7f0 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f41f6770 con 0x7ff2f415e7f0 2023-11-04T01:43:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f41f6d30 con 0x7ff2f415e7f0 2023-11-04T01:43:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f41f7210 con 0x7ff2f415e7f0 2023-11-04T01:43:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2eaffd640 1 -- 172.21.15.2:0/1842687559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2ec00a9b0 con 0x7ff2f415e7f0 2023-11-04T01:43:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2eaffd640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d40664d0 0x7ff2d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2eaffd640 1 -- 172.21.15.2:0/1842687559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff2ec0841c0 con 0x7ff2f415e7f0 2023-11-04T01:43:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2f259c640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d40664d0 0x7ff2d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.900+0000 7ff2f259c640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d40664d0 0x7ff2d4068990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400a8d0 tx=0x7ff2e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:45.904+0000 7ff2eaffd640 1 -- 172.21.15.2:0/1842687559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2ec0514b0 con 0x7ff2f415e7f0 2023-11-04T01:43:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.052+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2f40675f0 con 0x7ff2f415e7f0 2023-11-04T01:43:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2eaffd640 1 -- 172.21.15.2:0/1842687559 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18193 (secure 0 0 0) 0x7ff2ec054ad0 con 0x7ff2f415e7f0 2023-11-04T01:43:46.061 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:46.061 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:44.513894+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:26.399544+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:27.128100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d40664d0 msgr2=0x7ff2d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d40664d0 0x7ff2d4068990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400a8d0 tx=0x7ff2e4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 msgr2=0x7ff2f4158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f4158240 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00c780 tx=0x7ff2ec00cc40 comp rx=0 tx=0).stop 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 shutdown_connections 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d40664d0 0x7ff2d4068990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f415e7f0 0x7ff2f4158240 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f415e170 0x7ff2f40c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 --2- 172.21.15.2:0/1842687559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f415a080 0x7ff2f414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 >> 172.21.15.2:0/1842687559 conn(0x7ff2f40716a0 msgr2=0x7ff2f40c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 shutdown_connections 2023-11-04T01:43:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.056+0000 7ff2f8991640 1 -- 172.21.15.2:0/1842687559 wait complete. 2023-11-04T01:43:46.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:43:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddfb937640 1 Processor -- start 2023-11-04T01:43:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddfb937640 1 -- start start 2023-11-04T01:43:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddfb937640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fddf415afd0 0x7fddf40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddfb937640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf40b0d40 0x7fddf415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddfb937640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf40c2670 con 0x7fddf406f8f0 2023-11-04T01:43:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddfb937640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf4070140 con 0x7fddf415afd0 2023-11-04T01:43:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddfb937640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf406c9f0 con 0x7fddf40b0d40 2023-11-04T01:43:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf9ed4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf40b0d40 0x7fddf415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf9ed4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf40b0d40 0x7fddf415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:36678/0 (socket says 172.21.15.2:36678) 2023-11-04T01:43:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf9ed4640 1 -- 172.21.15.2:0/4161614429 learned_addr learned my addr 172.21.15.2:0/4161614429 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf96d3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fddf415afd0 0x7fddf40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf9ed4640 1 -- 172.21.15.2:0/4161614429 >> v2:172.21.15.90:3300/0 conn(0x7fddf415afd0 msgr2=0x7fddf40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf9ed4640 1 --2- 172.21.15.2:0/4161614429 >> v2:172.21.15.90:3300/0 conn(0x7fddf415afd0 0x7fddf40715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf9ed4640 1 -- 172.21.15.2:0/4161614429 >> v1:172.21.15.90:6789/0 conn(0x7fddf406f8f0 legacy=0x7fddf40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.200+0000 7fddf9ed4640 1 -- 172.21.15.2:0/4161614429 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf406bc30 con 0x7fddf40b0d40 2023-11-04T01:43:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddf9ed4640 1 --2- 172.21.15.2:0/4161614429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf40b0d40 0x7fddf415ec80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1172baef40d2eb48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fdde7fff640 1 -- 172.21.15.2:0/4161614429 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0a58a0 con 0x7fddf40b0d40 2023-11-04T01:43:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fdde7fff640 1 -- 172.21.15.2:0/4161614429 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0a5a00 con 0x7fddf40b0d40 2023-11-04T01:43:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fdde7fff640 1 -- 172.21.15.2:0/4161614429 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0a5d90 con 0x7fddf40b0d40 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 -- 172.21.15.2:0/4161614429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf40b0d40 msgr2=0x7fddf415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 --2- 172.21.15.2:0/4161614429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf40b0d40 0x7fddf415ec80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec01c9e0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 -- 172.21.15.2:0/4161614429 shutdown_connections 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 --2- 172.21.15.2:0/4161614429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf40b0d40 0x7fddf415ec80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 --2- 172.21.15.2:0/4161614429 >> v2:172.21.15.90:3300/0 conn(0x7fddf415afd0 0x7fddf40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 -- 172.21.15.2:0/4161614429 >> 172.21.15.2:0/4161614429 conn(0x7fddf40cebb0 msgr2=0x7fddf40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 -- 172.21.15.2:0/4161614429 shutdown_connections 2023-11-04T01:43:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.204+0000 7fddfb937640 1 -- 172.21.15.2:0/4161614429 wait complete. 2023-11-04T01:43:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 Processor -- start 2023-11-04T01:43:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 -- start start 2023-11-04T01:43:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf406f8f0 0x7fddf4152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddf40b0d40 0x7fddf40c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddf415afd0 0x7fddf40ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c2c40 con 0x7fddf415afd0 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c2f20 con 0x7fddf40b0d40 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c3200 con 0x7fddf406f8f0 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddf415afd0 0x7fddf40ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf8ed2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddf40b0d40 0x7fddf40c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddf415afd0 0x7fddf40ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54034/0 (socket says 172.21.15.2:54034) 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 -- 172.21.15.2:0/877849162 learned_addr learned my addr 172.21.15.2:0/877849162 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf96d3640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf406f8f0 0x7fddf4152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 -- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf406f8f0 msgr2=0x7fddf4152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf406f8f0 0x7fddf4152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 -- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddf40b0d40 msgr2=0x7fddf40c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddf40b0d40 0x7fddf40c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 -- 172.21.15.2:0/877849162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec009b30 con 0x7fddf415afd0 2023-11-04T01:43:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddf9ed4640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddf415afd0 0x7fddf40ccfc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fddec01a610 tx=0x7fddec019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fdde5ffb640 1 -- 172.21.15.2:0/877849162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0b8670 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fdde5ffb640 1 -- 172.21.15.2:0/877849162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0b87d0 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fdde5ffb640 1 -- 172.21.15.2:0/877849162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec0b8b60 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf40c34e0 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf40c4220 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf40744a0 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fdde5ffb640 1 -- 172.21.15.2:0/877849162 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fddec0b8cc0 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.208+0000 7fdde5ffb640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fddd80664d0 0x7fddd8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.212+0000 7fdde5ffb640 1 -- 172.21.15.2:0/877849162 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fddec11f440 con 0x7fddf415afd0 2023-11-04T01:43:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.212+0000 7fddf96d3640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fddd80664d0 0x7fddd8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.212+0000 7fddf96d3640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fddd80664d0 0x7fddd8068990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009b60 tx=0x7fddf0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.216+0000 7fdde5ffb640 1 -- 172.21.15.2:0/877849162 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fddec0ec940 con 0x7fddf415afd0 2023-11-04T01:43:46.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.404+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fddf406cba0 con 0x7fddf415afd0 2023-11-04T01:43:46.410 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-04T01:43:46.404+0000 7f4b9aa78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:43:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.408+0000 7fdde5ffb640 1 -- 172.21.15.2:0/877849162 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7fddec0eff60 con 0x7fddf415afd0 2023-11-04T01:43:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:43:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.412+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fddd80664d0 msgr2=0x7fddd8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.412+0000 7fddfb937640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fddd80664d0 0x7fddd8068990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009b60 tx=0x7fddf0009190 comp rx=0 tx=0).stop 2023-11-04T01:43:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.412+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddf415afd0 msgr2=0x7fddf40ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.412+0000 7fddfb937640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddf415afd0 0x7fddf40ccfc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fddec01a610 tx=0x7fddec019780 comp rx=0 tx=0).stop 2023-11-04T01:43:46.418 INFO:tasks.ceph.mds.c.smithi002.stderr: -677> 2023-11-04T01:43:33.553+0000 7f405099b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:43:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 shutdown_connections 2023-11-04T01:43:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fddd80664d0 0x7fddd8068990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fddf415afd0 0x7fddf40ccfc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddf40b0d40 0x7fddf40c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 --2- 172.21.15.2:0/877849162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fddf406f8f0 0x7fddf4152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 >> 172.21.15.2:0/877849162 conn(0x7fddf40cebb0 msgr2=0x7fddf4156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 shutdown_connections 2023-11-04T01:43:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.416+0000 7fddfb937640 1 -- 172.21.15.2:0/877849162 wait complete. 2023-11-04T01:43:46.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:43:46.446 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:43:46.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 Processor -- start 2023-11-04T01:43:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 -- start start 2023-11-04T01:43:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f506c15af50 0x7f506c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0b32f0 0x7f506c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f506c0cf4c0 0x7f506c0cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0b3780 con 0x7f506c0cf4c0 2023-11-04T01:43:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0cd830 con 0x7f506c15af50 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f5072190640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0cdad0 con 0x7f506c0b32f0 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f506c0cf4c0 0x7f506c0cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f506c0cf4c0 0x7f506c0cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54052/0 (socket says 172.21.15.2:54052) 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 -- 172.21.15.2:0/2734665542 learned_addr learned my addr 172.21.15.2:0/2734665542 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506b7fe640 1 --2- 172.21.15.2:0/2734665542 >> v2:172.21.15.90:3300/0 conn(0x7f506c15af50 0x7f506c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506affd640 1 --2- 172.21.15.2:0/2734665542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0b32f0 0x7f506c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 -- 172.21.15.2:0/2734665542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0b32f0 msgr2=0x7f506c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 --2- 172.21.15.2:0/2734665542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0b32f0 0x7f506c0ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 -- 172.21.15.2:0/2734665542 >> v2:172.21.15.90:3300/0 conn(0x7f506c15af50 msgr2=0x7f506c0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 --2- 172.21.15.2:0/2734665542 >> v2:172.21.15.90:3300/0 conn(0x7f506c15af50 0x7f506c0cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506bfff640 1 -- 172.21.15.2:0/2734665542 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c0cddb0 con 0x7f506c0cf4c0 2023-11-04T01:43:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.548+0000 7f506affd640 1 --2- 172.21.15.2:0/2734665542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0b32f0 0x7f506c0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:46.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506bfff640 1 --2- 172.21.15.2:0/2734665542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0cedf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f506c0681a0 tx=0x7f506401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd230a941aa3662 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:46.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506a7fc640 1 -- 172.21.15.2:0/2734665542 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640a57e0 con 0x7f506c0cf4c0 2023-11-04T01:43:46.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506a7fc640 1 -- 172.21.15.2:0/2734665542 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640a5940 con 0x7f506c0cf4c0 2023-11-04T01:43:46.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506a7fc640 1 -- 172.21.15.2:0/2734665542 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640a5cd0 con 0x7f506c0cf4c0 2023-11-04T01:43:46.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- 172.21.15.2:0/2734665542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 msgr2=0x7f506c0cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 --2- 172.21.15.2:0/2734665542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0cedf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f506c0681a0 tx=0x7f506401c940 comp rx=0 tx=0).stop 2023-11-04T01:43:46.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- 172.21.15.2:0/2734665542 shutdown_connections 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 --2- 172.21.15.2:0/2734665542 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0cedf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 --2- 172.21.15.2:0/2734665542 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0b32f0 0x7f506c0ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 --2- 172.21.15.2:0/2734665542 >> v2:172.21.15.90:3300/0 conn(0x7f506c15af50 0x7f506c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- 172.21.15.2:0/2734665542 >> 172.21.15.2:0/2734665542 conn(0x7f506c065dc0 msgr2=0x7f506c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- 172.21.15.2:0/2734665542 shutdown_connections 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- 172.21.15.2:0/2734665542 wait complete. 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 Processor -- start 2023-11-04T01:43:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- start start 2023-11-04T01:43:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f506c15af50 0x7f506c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0ca870 0x7f506c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c146d70 con 0x7f506c0cf4c0 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c146160 con 0x7f506c15af50 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c146440 con 0x7f506c0ca870 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54068/0 (socket says 172.21.15.2:54068) 2023-11-04T01:43:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 -- 172.21.15.2:0/1865905634 learned_addr learned my addr 172.21.15.2:0/1865905634 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506affd640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f506c15af50 0x7f506c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506bfff640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0ca870 0x7f506c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 -- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0ca870 msgr2=0x7f506c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0ca870 0x7f506c0d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 -- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f506c15af50 msgr2=0x7f506c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f506c15af50 0x7f506c0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 -- 172.21.15.2:0/1865905634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009b30 con 0x7f506c0cf4c0 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506bfff640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0ca870 0x7f506c0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f506b7fe640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0c71c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f505c00d7d0 tx=0x7f505c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5053fff640 1 -- 172.21.15.2:0/1865905634 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c00b6c0 con 0x7f506c0cf4c0 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5053fff640 1 -- 172.21.15.2:0/1865905634 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c00b820 con 0x7f506c0cf4c0 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c146720 con 0x7f506c0cf4c0 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5053fff640 1 -- 172.21.15.2:0/1865905634 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c00bbd0 con 0x7f506c0cf4c0 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.552+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0c7700 con 0x7f506c0cf4c0 2023-11-04T01:43:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.556+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c0675f0 con 0x7f506c0cf4c0 2023-11-04T01:43:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.556+0000 7f5053fff640 1 -- 172.21.15.2:0/1865905634 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f505c00bd30 con 0x7f506c0cf4c0 2023-11-04T01:43:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.556+0000 7f5053fff640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50580664a0 0x7f5058068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.556+0000 7f5053fff640 1 -- 172.21.15.2:0/1865905634 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f505c084470 con 0x7f506c0cf4c0 2023-11-04T01:43:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.556+0000 7f506affd640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50580664a0 0x7f5058068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.556+0000 7f506affd640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50580664a0 0x7f5058068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f506c164c90 tx=0x7f5060008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.560+0000 7f5053fff640 1 -- 172.21.15.2:0/1865905634 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f505c0517c0 con 0x7f506c0cf4c0 2023-11-04T01:43:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:46.748+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f506c0ccf90 con 0x7f506c0cf4c0 2023-11-04T01:43:47.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.412+0000 7f5053fff640 1 -- 172.21.15.2:0/1865905634 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f505c054de0 con 0x7f506c0cf4c0 2023-11-04T01:43:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50580664a0 msgr2=0x7f5058068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50580664a0 0x7f5058068960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f506c164c90 tx=0x7f5060008040 comp rx=0 tx=0).stop 2023-11-04T01:43:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 msgr2=0x7f506c0c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0c71c0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f505c00d7d0 tx=0x7f505c00dc90 comp rx=0 tx=0).stop 2023-11-04T01:43:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 shutdown_connections 2023-11-04T01:43:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50580664a0 0x7f5058068960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f506c0ca870 0x7f506c0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f506c15af50 0x7f506c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 --2- 172.21.15.2:0/1865905634 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f506c0cf4c0 0x7f506c0c71c0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 >> 172.21.15.2:0/1865905634 conn(0x7f506c065dc0 msgr2=0x7f506c165290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 shutdown_connections 2023-11-04T01:43:47.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.416+0000 7f5072190640 1 -- 172.21.15.2:0/1865905634 wait complete. 2023-11-04T01:43:47.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:43:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f943da5a640 1 Processor -- start 2023-11-04T01:43:47.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f943da5a640 1 -- start start 2023-11-04T01:43:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f943da5a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f943815cec0 0x7f94380ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f943da5a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 0x7f943806a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f943da5a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94380cd590 con 0x7f94380ceb20 2023-11-04T01:43:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f943da5a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380662d0 con 0x7f943815cec0 2023-11-04T01:43:47.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f943da5a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94380aea30 con 0x7f94380acfd0 2023-11-04T01:43:47.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f94367fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f94380ceb20 0x7f94380ac8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57996/0 (socket says 172.21.15.2:57996) 2023-11-04T01:43:47.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f94367fc640 1 -- 172.21.15.2:0/4086481818 learned_addr learned my addr 172.21.15.2:0/4086481818 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:47.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9436ffd640 1 --2- 172.21.15.2:0/4086481818 >> v2:172.21.15.90:3300/0 conn(0x7f943815cec0 0x7f94380ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f94377fe640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 0x7f943806a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210889952 0 0) 0x7f942c001120 con 0x7f94380ceb20 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9420003530 con 0x7f94380ceb20 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2613509284 0 0) 0x7f9420003530 con 0x7f94380ceb20 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 msgr2=0x7f943806a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 0x7f943806a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 >> v2:172.21.15.90:3300/0 conn(0x7f943815cec0 msgr2=0x7f94380ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 --2- 172.21.15.2:0/4086481818 >> v2:172.21.15.90:3300/0 conn(0x7f943815cec0 0x7f94380ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380ccfd0 con 0x7f94380ceb20 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f942c001810 con 0x7f94380ceb20 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 >> v1:172.21.15.2:6789/0 conn(0x7f94380ceb20 legacy=0x7f94380ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f9420003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200047d0 0x7f9420004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 0x7f9420005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380662d0 con 0x7f9420003980 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380aea30 con 0x7f94200047d0 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942000b990 con 0x7f94380acfd0 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9436ffd640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f9420003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f94367fc640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200047d0 0x7f9420004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f94377fe640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 0x7f9420005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9436ffd640 1 -- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 msgr2=0x7f9420005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9436ffd640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380acfd0 0x7f9420005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9436ffd640 1 -- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200047d0 msgr2=0x7f9420004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:47.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9436ffd640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94200047d0 0x7f9420004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.620+0000 7f9436ffd640 1 -- 172.21.15.2:0/4086481818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9420003530 con 0x7f9420003980 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f9436ffd640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f9420003da0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9430009fc0 tx=0x7f943001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274a29844eaf37c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300a5b80 con 0x7f9420003980 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943000f040 con 0x7f9420003980 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f9435ffb640 1 -- 172.21.15.2:0/4086481818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300ad440 con 0x7f9420003980 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 -- 172.21.15.2:0/4086481818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 msgr2=0x7f9420003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 --2- 172.21.15.2:0/4086481818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f9420003da0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9430009fc0 tx=0x7f943001cc70 comp rx=0 tx=0).stop 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f94377fe640 1 -- 172.21.15.2:0/4086481818 reap_dead start 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 -- 172.21.15.2:0/4086481818 shutdown_connections 2023-11-04T01:43:47.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 -- 172.21.15.2:0/4086481818 >> 172.21.15.2:0/4086481818 conn(0x7f943806c1d0 msgr2=0x7f943806c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:47.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 -- 172.21.15.2:0/4086481818 shutdown_connections 2023-11-04T01:43:47.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 -- 172.21.15.2:0/4086481818 wait complete. 2023-11-04T01:43:47.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 Processor -- start 2023-11-04T01:43:47.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.624+0000 7f943da5a640 1 -- start start 2023-11-04T01:43:47.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f943814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94380b2c60 0x7f94380b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380c2db0 0x7f94380c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380b46f0 con 0x7f9420003980 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380b05d0 con 0x7f94380b2c60 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94380b3930 con 0x7f94380c2db0 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f943814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f943814a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54090/0 (socket says 172.21.15.2:54090) 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 -- 172.21.15.2:0/3054530467 learned_addr learned my addr 172.21.15.2:0/3054530467 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f94377fe640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380c2db0 0x7f94380c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f94367fc640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94380b2c60 0x7f94380b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 -- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380c2db0 msgr2=0x7f94380c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380c2db0 0x7f94380c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 -- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94380b2c60 msgr2=0x7f94380b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94380b2c60 0x7f94380b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:47.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 -- 172.21.15.2:0/3054530467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380b3c10 con 0x7f9420003980 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f94377fe640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380c2db0 0x7f94380c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f9436ffd640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f943814a9e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f943001c6e0 tx=0x7f9430009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f941ffff640 1 -- 172.21.15.2:0/3054530467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300bd070 con 0x7f9420003980 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f941ffff640 1 -- 172.21.15.2:0/3054530467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94300039a0 con 0x7f9420003980 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94380b3ef0 con 0x7f9420003980 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f941ffff640 1 -- 172.21.15.2:0/3054530467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430003d10 con 0x7f9420003980 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943814af20 con 0x7f9420003980 2023-11-04T01:43:47.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94380744a0 con 0x7f9420003980 2023-11-04T01:43:47.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f941ffff640 1 -- 172.21.15.2:0/3054530467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f94300b4040 con 0x7f9420003980 2023-11-04T01:43:47.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f941ffff640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f94240664a0 0x7f9424068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:47.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f941ffff640 1 -- 172.21.15.2:0/3054530467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f943011dc30 con 0x7f9420003980 2023-11-04T01:43:47.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.628+0000 7f94367fc640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f94240664a0 0x7f9424068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:47.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.632+0000 7f94367fc640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f94240664a0 0x7f9424068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f942c0012c0 tx=0x7f942c001d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:47.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.632+0000 7f941ffff640 1 -- 172.21.15.2:0/3054530467 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f94300eaf70 con 0x7f9420003980 2023-11-04T01:43:47.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:47.788+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9438154af0 con 0x7f9420003980 2023-11-04T01:43:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.424+0000 7f941ffff640 1 -- 172.21.15.2:0/3054530467 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f94300b2070 con 0x7f9420003980 2023-11-04T01:43:48.430 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:43:48.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f94240664a0 msgr2=0x7f9424068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f94240664a0 0x7f9424068960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f942c0012c0 tx=0x7f942c001d50 comp rx=0 tx=0).stop 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 msgr2=0x7f943814a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f943814a9e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f943001c6e0 tx=0x7f9430009750 comp rx=0 tx=0).stop 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 shutdown_connections 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f94240664a0 0x7f9424068960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f94380c2db0 0x7f94380c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94380b2c60 0x7f94380b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 --2- 172.21.15.2:0/3054530467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9420003980 0x7f943814a9e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 >> 172.21.15.2:0/3054530467 conn(0x7f943806c1d0 msgr2=0x7f94380cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 shutdown_connections 2023-11-04T01:43:48.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.428+0000 7f943da5a640 1 -- 172.21.15.2:0/3054530467 wait complete. 2023-11-04T01:43:48.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:43:48.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 Processor -- start 2023-11-04T01:43:48.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 -- start start 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe8bc0ccdf0 0x7fe8bc0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8bc0d0540 0x7fe8bc0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc15c110 con 0x7fe8bc0d0540 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0b65e0 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8c11f0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15b7e0 con 0x7fe8bc0cd1d0 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8bc0d0540 0x7fe8bc0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8bc0d0540 0x7fe8bc0b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54094/0 (socket says 172.21.15.2:54094) 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 -- 172.21.15.2:0/2020928057 learned_addr learned my addr 172.21.15.2:0/2020928057 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8bad9d640 1 --2- 172.21.15.2:0/2020928057 >> v2:172.21.15.90:3300/0 conn(0x7fe8bc0ccdf0 0x7fe8bc0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8bb59e640 1 --2- 172.21.15.2:0/2020928057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 -- 172.21.15.2:0/2020928057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 msgr2=0x7fe8bc0b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 --2- 172.21.15.2:0/2020928057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc0b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 -- 172.21.15.2:0/2020928057 >> v2:172.21.15.90:3300/0 conn(0x7fe8bc0ccdf0 msgr2=0x7fe8bc0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 --2- 172.21.15.2:0/2020928057 >> v2:172.21.15.90:3300/0 conn(0x7fe8bc0ccdf0 0x7fe8bc0cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8ba59c640 1 -- 172.21.15.2:0/2020928057 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc15bac0 con 0x7fe8bc0d0540 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8bad9d640 1 --2- 172.21.15.2:0/2020928057 >> v2:172.21.15.90:3300/0 conn(0x7fe8bc0ccdf0 0x7fe8bc0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:48.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.584+0000 7fe8bb59e640 1 --2- 172.21.15.2:0/2020928057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc0b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:48.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8ba59c640 1 --2- 172.21.15.2:0/2020928057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0d0540 0x7fe8bc0b5b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0740f0 tx=0x7fe8a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43ba84ee0627e06 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8b9d9b640 1 -- 172.21.15.2:0/2020928057 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40ab650 con 0x7fe8bc0d0540 2023-11-04T01:43:48.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8b9d9b640 1 -- 172.21.15.2:0/2020928057 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a40ab7b0 con 0x7fe8bc0d0540 2023-11-04T01:43:48.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8b9d9b640 1 -- 172.21.15.2:0/2020928057 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40abb40 con 0x7fe8bc0d0540 2023-11-04T01:43:48.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 -- 172.21.15.2:0/2020928057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0d0540 msgr2=0x7fe8bc0b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/2020928057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0d0540 0x7fe8bc0b5b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0740f0 tx=0x7fe8a401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 -- 172.21.15.2:0/2020928057 shutdown_connections 2023-11-04T01:43:48.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/2020928057 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc0b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/2020928057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0d0540 0x7fe8bc0b5b60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/2020928057 >> v2:172.21.15.90:3300/0 conn(0x7fe8bc0ccdf0 0x7fe8bc0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 -- 172.21.15.2:0/2020928057 >> 172.21.15.2:0/2020928057 conn(0x7fe8bc0cd770 msgr2=0x7fe8bc0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:48.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 -- 172.21.15.2:0/2020928057 shutdown_connections 2023-11-04T01:43:48.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 -- 172.21.15.2:0/2020928057 wait complete. 2023-11-04T01:43:48.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 Processor -- start 2023-11-04T01:43:48.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.588+0000 7fe8c11f0640 1 -- start start 2023-11-04T01:43:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0ccdf0 0x7fe8bc15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8bc0d0540 0x7fe8bc149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc06b9c0 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc06bca0 con 0x7fe8bc0d0540 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc06bf80 con 0x7fe8bc0cd1d0 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0ccdf0 0x7fe8bc15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0ccdf0 0x7fe8bc15d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54102/0 (socket says 172.21.15.2:54102) 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 -- 172.21.15.2:0/137423857 learned_addr learned my addr 172.21.15.2:0/137423857 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bb59e640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8bc0d0540 0x7fe8bc149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8ba59c640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 -- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 msgr2=0x7fe8bc06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc06ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 -- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8bc0d0540 msgr2=0x7fe8bc149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8bc0d0540 0x7fe8bc149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 -- 172.21.15.2:0/137423857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a40094d0 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8bad9d640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0ccdf0 0x7fe8bc15d130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400ce30 tx=0x7fe8b400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8b37fe640 1 -- 172.21.15.2:0/137423857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400f680 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8b37fe640 1 -- 172.21.15.2:0/137423857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b400f7e0 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc06c260 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8b37fe640 1 -- 172.21.15.2:0/137423857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400fb90 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc15d670 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc0744a0 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8b37fe640 1 -- 172.21.15.2:0/137423857 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe8b400b040 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8b37fe640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe89c0664a0 0x7fe89c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8b37fe640 1 -- 172.21.15.2:0/137423857 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5710+0+0 (secure 0 0 0) 0x7fe8b4084880 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.592+0000 7fe8ba59c640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe89c0664a0 0x7fe89c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:48.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.596+0000 7fe8ba59c640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe89c0664a0 0x7fe89c068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40af000 tx=0x7fe8a40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:48.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.600+0000 7fe8b37fe640 1 -- 172.21.15.2:0/137423857 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8b4051d00 con 0x7fe8bc0ccdf0 2023-11-04T01:43:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:48.756+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8bc0b33e0 con 0x7fe8bc0ccdf0 2023-11-04T01:43:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.436+0000 7fe8b37fe640 1 -- 172.21.15.2:0/137423857 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe8b4055320 con 0x7fe8bc0ccdf0 2023-11-04T01:43:49.441 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-04T01:43:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe89c0664a0 msgr2=0x7fe89c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe89c0664a0 0x7fe89c068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40af000 tx=0x7fe8a40a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0ccdf0 msgr2=0x7fe8bc15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0ccdf0 0x7fe8bc15d130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400ce30 tx=0x7fe8b400a650 comp rx=0 tx=0).stop 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 shutdown_connections 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe89c0664a0 0x7fe89c068960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8bc0d0540 0x7fe8bc149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe8bc0cd1d0 0x7fe8bc06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 --2- 172.21.15.2:0/137423857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8bc0ccdf0 0x7fe8bc15d130 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 >> 172.21.15.2:0/137423857 conn(0x7fe8bc0cd770 msgr2=0x7fe8bc15dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 shutdown_connections 2023-11-04T01:43:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.440+0000 7fe8c11f0640 1 -- 172.21.15.2:0/137423857 wait complete. 2023-11-04T01:43:49.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:43:49.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.592+0000 7f22c5802640 1 Processor -- start 2023-11-04T01:43:49.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.592+0000 7f22c5802640 1 -- start start 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22c5802640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22c00cf810 0x7f22c00cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22c5802640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c00d1940 0x7f22c00d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22c5802640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c00b5e00 con 0x7f22c015d0b0 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22c5802640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c00d1520 con 0x7f22c00cf810 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22c5802640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00d01c0 con 0x7f22c00d1940 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22be7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22c00cf810 0x7f22c00cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22beffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f22c015d0b0 0x7f22c0160bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58010/0 (socket says 172.21.15.2:58010) 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22beffd640 1 -- 172.21.15.2:0/2467536905 learned_addr learned my addr 172.21.15.2:0/2467536905 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22bf7fe640 1 --2- 172.21.15.2:0/2467536905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c00d1940 0x7f22c00d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22bdffb640 1 -- 172.21.15.2:0/2467536905 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571972578 0 0) 0x7f22c00b5e00 con 0x7f22c015d0b0 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22bdffb640 1 -- 172.21.15.2:0/2467536905 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22ac003530 con 0x7f22c015d0b0 2023-11-04T01:43:49.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22be7fc640 1 -- 172.21.15.2:0/2467536905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c00d1940 msgr2=0x7f22c00d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22be7fc640 1 --2- 172.21.15.2:0/2467536905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c00d1940 0x7f22c00d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22be7fc640 1 -- 172.21.15.2:0/2467536905 >> v1:172.21.15.2:6789/0 conn(0x7f22c015d0b0 legacy=0x7f22c0160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22be7fc640 1 -- 172.21.15.2:0/2467536905 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c015d490 con 0x7f22c00cf810 2023-11-04T01:43:49.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.596+0000 7f22bf7fe640 1 --2- 172.21.15.2:0/2467536905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c00d1940 0x7f22c00d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:49.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22be7fc640 1 --2- 172.21.15.2:0/2467536905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00cfc80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097f0 tx=0x7f22a801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a264646650d8c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22bdffb640 1 -- 172.21.15.2:0/2467536905 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80ab680 con 0x7f22c00cf810 2023-11-04T01:43:49.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22bdffb640 1 -- 172.21.15.2:0/2467536905 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80ab7e0 con 0x7f22c00cf810 2023-11-04T01:43:49.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22bdffb640 1 -- 172.21.15.2:0/2467536905 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80abb50 con 0x7f22c00cf810 2023-11-04T01:43:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- 172.21.15.2:0/2467536905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 msgr2=0x7f22c00cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 --2- 172.21.15.2:0/2467536905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00cfc80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f22a80097f0 tx=0x7f22a801c480 comp rx=0 tx=0).stop 2023-11-04T01:43:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- 172.21.15.2:0/2467536905 shutdown_connections 2023-11-04T01:43:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 --2- 172.21.15.2:0/2467536905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00cfc80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 --2- 172.21.15.2:0/2467536905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c00d1940 0x7f22c00d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- 172.21.15.2:0/2467536905 >> 172.21.15.2:0/2467536905 conn(0x7f22c006a890 msgr2=0x7f22c006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- 172.21.15.2:0/2467536905 shutdown_connections 2023-11-04T01:43:49.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- 172.21.15.2:0/2467536905 wait complete. 2023-11-04T01:43:49.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 Processor -- start 2023-11-04T01:43:49.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- start start 2023-11-04T01:43:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c00d1940 0x7f22c00b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c015d0b0 0x7f22c014b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c014b400 con 0x7f22c00cf810 2023-11-04T01:43:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c014aad0 con 0x7f22c00d1940 2023-11-04T01:43:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22c5802640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c014adb0 con 0x7f22c015d0b0 2023-11-04T01:43:49.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54124/0 (socket says 172.21.15.2:54124) 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 -- 172.21.15.2:0/3924067555 learned_addr learned my addr 172.21.15.2:0/3924067555 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22bf7fe640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c015d0b0 0x7f22c014b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22be7fc640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c00d1940 0x7f22c00b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 -- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c015d0b0 msgr2=0x7f22c014b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c015d0b0 0x7f22c014b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 -- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c00d1940 msgr2=0x7f22c00b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c00d1940 0x7f22c00b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 -- 172.21.15.2:0/3924067555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009420 con 0x7f22c00cf810 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.600+0000 7f22beffd640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00c89a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c3c0 tx=0x7f22b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22b7fff640 1 -- 172.21.15.2:0/3924067555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0005cf0 con 0x7f22c00cf810 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22b7fff640 1 -- 172.21.15.2:0/3924067555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b0005e50 con 0x7f22c00cf810 2023-11-04T01:43:49.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c014b090 con 0x7f22c00cf810 2023-11-04T01:43:49.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22b7fff640 1 -- 172.21.15.2:0/3924067555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b00072f0 con 0x7f22c00cf810 2023-11-04T01:43:49.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c015b6f0 con 0x7f22c00cf810 2023-11-04T01:43:49.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c00744a0 con 0x7f22c00cf810 2023-11-04T01:43:49.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22b7fff640 1 -- 172.21.15.2:0/3924067555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22b0007450 con 0x7f22c00cf810 2023-11-04T01:43:49.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22b7fff640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22a00664d0 0x7f22a0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22b7fff640 1 -- 172.21.15.2:0/3924067555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f22b00832c0 con 0x7f22c00cf810 2023-11-04T01:43:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22be7fc640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22a00664d0 0x7f22a0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.604+0000 7f22be7fc640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22a00664d0 0x7f22a0068990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22a80af000 tx=0x7f22a80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.608+0000 7f22b7fff640 1 -- 172.21.15.2:0/3924067555 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22b00508e0 con 0x7f22c00cf810 2023-11-04T01:43:49.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.764+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f22c00d0a10 con 0x7f22c00cf810 2023-11-04T01:43:49.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.768+0000 7f22b7fff640 1 -- 172.21.15.2:0/3924067555 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f22b0053f00 con 0x7f22c00cf810 2023-11-04T01:43:49.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22a00664d0 msgr2=0x7f22a0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22a00664d0 0x7f22a0068990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f22a80af000 tx=0x7f22a80a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:49.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 msgr2=0x7f22c00c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00c89a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c3c0 tx=0x7f22b000c880 comp rx=0 tx=0).stop 2023-11-04T01:43:49.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 shutdown_connections 2023-11-04T01:43:49.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22a00664d0 0x7f22a0068990 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22c015d0b0 0x7f22c014b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22c00d1940 0x7f22c00b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 --2- 172.21.15.2:0/3924067555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22c00cf810 0x7f22c00c89a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 >> 172.21.15.2:0/3924067555 conn(0x7f22c006a890 msgr2=0x7f22c015fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 shutdown_connections 2023-11-04T01:43:49.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.772+0000 7f22c5802640 1 -- 172.21.15.2:0/3924067555 wait complete. 2023-11-04T01:43:49.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails' 2023-11-04T01:43:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6aba0640 1 Processor -- start 2023-11-04T01:43:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6aba0640 1 -- start start 2023-11-04T01:43:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6aba0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb640b4990 0x7fcb640b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6aba0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb640b74f0 0x7fcb640cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6aba0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb640b6070 con 0x7fcb640d0690 2023-11-04T01:43:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6aba0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb640b8ed0 con 0x7fcb640b4990 2023-11-04T01:43:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6aba0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb640b52b0 con 0x7fcb640b74f0 2023-11-04T01:43:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb63fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcb640d0690 0x7fcb640cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58022/0 (socket says 172.21.15.2:58022) 2023-11-04T01:43:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb63fff640 1 -- 172.21.15.2:0/1084439331 learned_addr learned my addr 172.21.15.2:0/1084439331 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6893c640 1 --2- 172.21.15.2:0/1084439331 >> v2:172.21.15.2:3300/0 conn(0x7fcb640b4990 0x7fcb640b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6913d640 1 --2- 172.21.15.2:0/1084439331 >> v2:172.21.15.90:3300/0 conn(0x7fcb640b74f0 0x7fcb640cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb637fe640 1 -- 172.21.15.2:0/1084439331 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104115657 0 0) 0x7fcb640b6070 con 0x7fcb640d0690 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb637fe640 1 -- 172.21.15.2:0/1084439331 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb4c003530 con 0x7fcb640d0690 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6893c640 1 -- 172.21.15.2:0/1084439331 >> v2:172.21.15.90:3300/0 conn(0x7fcb640b74f0 msgr2=0x7fcb640cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6893c640 1 --2- 172.21.15.2:0/1084439331 >> v2:172.21.15.90:3300/0 conn(0x7fcb640b74f0 0x7fcb640cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6893c640 1 -- 172.21.15.2:0/1084439331 >> v1:172.21.15.2:6789/0 conn(0x7fcb640d0690 legacy=0x7fcb640cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.908+0000 7fcb6893c640 1 -- 172.21.15.2:0/1084439331 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640d1ce0 con 0x7fcb640b4990 2023-11-04T01:43:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6893c640 1 --2- 172.21.15.2:0/1084439331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b4990 0x7fcb640b4d70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcb6408c3b0 tx=0x7fcb5401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb301dac5b4fcd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb637fe640 1 -- 172.21.15.2:0/1084439331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540a8950 con 0x7fcb640b4990 2023-11-04T01:43:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb637fe640 1 -- 172.21.15.2:0/1084439331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb540a8ab0 con 0x7fcb640b4990 2023-11-04T01:43:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb637fe640 1 -- 172.21.15.2:0/1084439331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540a8e40 con 0x7fcb640b4990 2023-11-04T01:43:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1084439331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b4990 msgr2=0x7fcb640b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1084439331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b4990 0x7fcb640b4d70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcb6408c3b0 tx=0x7fcb5401ec50 comp rx=0 tx=0).stop 2023-11-04T01:43:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1084439331 shutdown_connections 2023-11-04T01:43:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1084439331 >> v2:172.21.15.90:3300/0 conn(0x7fcb640b74f0 0x7fcb640cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1084439331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b4990 0x7fcb640b4d70 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1084439331 >> 172.21.15.2:0/1084439331 conn(0x7fcb640cf990 msgr2=0x7fcb640cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1084439331 shutdown_connections 2023-11-04T01:43:49.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1084439331 wait complete. 2023-11-04T01:43:49.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 Processor -- start 2023-11-04T01:43:49.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.912+0000 7fcb6aba0640 1 -- start start 2023-11-04T01:43:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb640b4990 0x7fcb6415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b74f0 0x7fcb641536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb640d0690 0x7fcb64155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64153be0 con 0x7fcb640b74f0 2023-11-04T01:43:49.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6415fa50 con 0x7fcb640b4990 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6415fd30 con 0x7fcb640d0690 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b74f0 0x7fcb641536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b74f0 0x7fcb641536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54154/0 (socket says 172.21.15.2:54154) 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 -- 172.21.15.2:0/1974974679 learned_addr learned my addr 172.21.15.2:0/1974974679 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6893c640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb640b4990 0x7fcb6415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6913d640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb640d0690 0x7fcb64155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 -- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb640d0690 msgr2=0x7fcb64155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb640d0690 0x7fcb64155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 -- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb640b4990 msgr2=0x7fcb6415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb640b4990 0x7fcb6415dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 -- 172.21.15.2:0/1974974679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54009420 con 0x7fcb640b74f0 2023-11-04T01:43:49.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6893c640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb640b4990 0x7fcb6415dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb63fff640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b74f0 0x7fcb641536a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800c400 tx=0x7fcb5800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb617fa640 1 -- 172.21.15.2:0/1974974679 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58005cf0 con 0x7fcb640b74f0 2023-11-04T01:43:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb617fa640 1 -- 172.21.15.2:0/1974974679 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58005e50 con 0x7fcb640b74f0 2023-11-04T01:43:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb64160010 con 0x7fcb640b74f0 2023-11-04T01:43:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb617fa640 1 -- 172.21.15.2:0/1974974679 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580072d0 con 0x7fcb640b74f0 2023-11-04T01:43:49.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb640cb650 con 0x7fcb640b74f0 2023-11-04T01:43:49.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb640744a0 con 0x7fcb640b74f0 2023-11-04T01:43:49.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb617fa640 1 -- 172.21.15.2:0/1974974679 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb58007430 con 0x7fcb640b74f0 2023-11-04T01:43:49.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb617fa640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb500664a0 0x7fcb50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:49.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb617fa640 1 -- 172.21.15.2:0/1974974679 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcb58083340 con 0x7fcb640b74f0 2023-11-04T01:43:49.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.916+0000 7fcb6893c640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb500664a0 0x7fcb50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:49.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.920+0000 7fcb6893c640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb500664a0 0x7fcb50068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcb540b2000 tx=0x7fcb54008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:49.920+0000 7fcb617fa640 1 -- 172.21.15.2:0/1974974679 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb58050a20 con 0x7fcb640b74f0 2023-11-04T01:43:50.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.136+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]} v 0) v1 -- 0x7fcb64160690 con 0x7fcb640b74f0 2023-11-04T01:43:50.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb617fa640 1 -- 172.21.15.2:0/1974974679 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_attaching_pools_with_snaps_to_fs_fails"]}]=0 v100) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcb58054040 con 0x7fcb640b74f0 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb500664a0 msgr2=0x7fcb50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb500664a0 0x7fcb50068960 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcb540b2000 tx=0x7fcb54008040 comp rx=0 tx=0).stop 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b74f0 msgr2=0x7fcb641536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b74f0 0x7fcb641536a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcb5800c400 tx=0x7fcb5800c8c0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 shutdown_connections 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb500664a0 0x7fcb50068960 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb640d0690 0x7fcb64155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb640b74f0 0x7fcb641536a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 --2- 172.21.15.2:0/1974974679 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb640b4990 0x7fcb6415dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 >> 172.21.15.2:0/1974974679 conn(0x7fcb640cf990 msgr2=0x7fcb640d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 shutdown_connections 2023-11-04T01:43:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.440+0000 7fcb6aba0640 1 -- 172.21.15.2:0/1974974679 wait complete. 2023-11-04T01:43:50.463 INFO:tasks.cephfs_test_runner:Test that attempt to attach pool with snapshots to an fs fails ... ok 2023-11-04T01:43:50.463 INFO:tasks.cephfs_test_runner:Starting test: test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that creation of monitor managed snaps fails for pools attached 2023-11-04T01:43:50.464 INFO:tasks.cephfs_test_runner:test_disallow_monitor_managed_snaps_for_fs_pools (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:43:50.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:50.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f35806640 1 Processor -- start 2023-11-04T01:43:50.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f35806640 1 -- start start 2023-11-04T01:43:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f35806640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f300b4990 0x7f3f300b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f35806640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f300b6070 con 0x7f3f300b74f0 2023-11-04T01:43:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f35806640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f300b8ed0 con 0x7f3f300d0690 2023-11-04T01:43:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f35806640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f300ce590 con 0x7f3f300b4990 2023-11-04T01:43:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f2effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3f300b4990 0x7f3f300b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f2f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3f300b74f0 0x7f3f300cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58028/0 (socket says 172.21.15.2:58028) 2023-11-04T01:43:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f2f7fe640 1 -- 172.21.15.2:0/1729474045 learned_addr learned my addr 172.21.15.2:0/1729474045 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:50.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f2effd640 1 -- 172.21.15.2:0/1729474045 >> v1:172.21.15.90:6789/0 conn(0x7f3f300d0690 legacy=0x7f3f300cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f2effd640 1 -- 172.21.15.2:0/1729474045 >> v1:172.21.15.2:6789/0 conn(0x7f3f300b74f0 legacy=0x7f3f300cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.576+0000 7f3f2effd640 1 -- 172.21.15.2:0/1729474045 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300b52b0 con 0x7f3f300b4990 2023-11-04T01:43:50.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f2effd640 1 --2- 172.21.15.2:0/1729474045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300b4990 0x7f3f300b4d70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3f200097c0 tx=0x7f3f2001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8dda4bd7b86a19 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f2dffb640 1 -- 172.21.15.2:0/1729474045 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200a8930 con 0x7f3f300b4990 2023-11-04T01:43:50.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f2dffb640 1 -- 172.21.15.2:0/1729474045 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f200a8a90 con 0x7f3f300b4990 2023-11-04T01:43:50.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f2dffb640 1 -- 172.21.15.2:0/1729474045 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200a8e20 con 0x7f3f300b4990 2023-11-04T01:43:50.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 -- 172.21.15.2:0/1729474045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300b4990 msgr2=0x7f3f300b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 --2- 172.21.15.2:0/1729474045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300b4990 0x7f3f300b4d70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3f200097c0 tx=0x7f3f2001ec30 comp rx=0 tx=0).stop 2023-11-04T01:43:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 -- 172.21.15.2:0/1729474045 shutdown_connections 2023-11-04T01:43:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 --2- 172.21.15.2:0/1729474045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300b4990 0x7f3f300b4d70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 -- 172.21.15.2:0/1729474045 >> 172.21.15.2:0/1729474045 conn(0x7f3f300cf990 msgr2=0x7f3f300cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 -- 172.21.15.2:0/1729474045 shutdown_connections 2023-11-04T01:43:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 -- 172.21.15.2:0/1729474045 wait complete. 2023-11-04T01:43:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 Processor -- start 2023-11-04T01:43:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.580+0000 7f3f35806640 1 -- start start 2023-11-04T01:43:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f300b4990 0x7f3f300c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f300b74f0 0x7f3f3015e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300d0690 0x7f3f300cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3015d8b0 con 0x7f3f300d0690 2023-11-04T01:43:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3015db90 con 0x7f3f300b74f0 2023-11-04T01:43:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3015de70 con 0x7f3f300b4990 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300d0690 0x7f3f300cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300d0690 0x7f3f300cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54170/0 (socket says 172.21.15.2:54170) 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 -- 172.21.15.2:0/2576388743 learned_addr learned my addr 172.21.15.2:0/2576388743 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 -- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f300b4990 msgr2=0x7f3f300c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f300b4990 0x7f3f300c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 -- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f300b74f0 msgr2=0x7f3f3015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f300b74f0 0x7f3f3015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 -- 172.21.15.2:0/2576388743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009420 con 0x7f3f300d0690 2023-11-04T01:43:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f2f7fe640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300d0690 0x7f3f300cac90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800caf0 tx=0x7f3f2800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f17fff640 1 -- 172.21.15.2:0/2576388743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800aca0 con 0x7f3f300d0690 2023-11-04T01:43:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f17fff640 1 -- 172.21.15.2:0/2576388743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2800ae00 con 0x7f3f300d0690 2023-11-04T01:43:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f17fff640 1 -- 172.21.15.2:0/2576388743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28012600 con 0x7f3f300d0690 2023-11-04T01:43:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3015e150 con 0x7f3f300d0690 2023-11-04T01:43:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.588+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f300c8fa0 con 0x7f3f300d0690 2023-11-04T01:43:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.592+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f300744a0 con 0x7f3f300d0690 2023-11-04T01:43:50.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.592+0000 7f3f17fff640 1 -- 172.21.15.2:0/2576388743 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3f28007070 con 0x7f3f300d0690 2023-11-04T01:43:50.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.592+0000 7f3f17fff640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f1c0664a0 0x7f3f1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.592+0000 7f3f17fff640 1 -- 172.21.15.2:0/2576388743 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3f28083b80 con 0x7f3f300d0690 2023-11-04T01:43:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.592+0000 7f3f2effd640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f1c0664a0 0x7f3f1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.596+0000 7f3f2effd640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f1c0664a0 0x7f3f1c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3f200b2000 tx=0x7f3f20004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.600+0000 7f3f17fff640 1 -- 172.21.15.2:0/2576388743 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3f280511d0 con 0x7f3f300d0690 2023-11-04T01:43:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.748+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f3015e600 con 0x7f3f300d0690 2023-11-04T01:43:50.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f17fff640 1 -- 172.21.15.2:0/2576388743 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+14623 (secure 0 0 0) 0x7f3f28017090 con 0x7f3f300d0690 2023-11-04T01:43:50.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:50.756 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":41,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:49.430128+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/610836033":"2023-11-05T01:43:46.410187+0000","172.21.15.2:6833/610836033":"2023-11-05T01:43:46.410187+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f1c0664a0 msgr2=0x7f3f1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f1c0664a0 0x7f3f1c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3f200b2000 tx=0x7f3f20004740 comp rx=0 tx=0).stop 2023-11-04T01:43:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300d0690 msgr2=0x7f3f300cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300d0690 0x7f3f300cac90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800caf0 tx=0x7f3f2800a060 comp rx=0 tx=0).stop 2023-11-04T01:43:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 shutdown_connections 2023-11-04T01:43:50.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3f1c0664a0 0x7f3f1c068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f300d0690 0x7f3f300cac90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3f300b74f0 0x7f3f3015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 --2- 172.21.15.2:0/2576388743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3f300b4990 0x7f3f300c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 >> 172.21.15.2:0/2576388743 conn(0x7f3f300cf990 msgr2=0x7f3f300cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 shutdown_connections 2023-11-04T01:43:50.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.752+0000 7f3f35806640 1 -- 172.21.15.2:0/2576388743 wait complete. 2023-11-04T01:43:50.773 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:50.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:50.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.896+0000 7f06c688e640 1 Processor -- start 2023-11-04T01:43:50.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.896+0000 7f06c688e640 1 -- start start 2023-11-04T01:43:50.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c688e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f06c006c5c0 0x7f06c006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c688e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c006cf50 con 0x7f06c0159ec0 2023-11-04T01:43:50.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c688e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c015e260 con 0x7f06c00c93b0 2023-11-04T01:43:50.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c688e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c00c9820 con 0x7f06c006c5c0 2023-11-04T01:43:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c4e2b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f06c006c5c0 0x7f06c006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06bffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f06c0159ec0 0x7f06c015da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58038/0 (socket says 172.21.15.2:58038) 2023-11-04T01:43:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06bffff640 1 -- 172.21.15.2:0/1890732800 learned_addr learned my addr 172.21.15.2:0/1890732800 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c4e2b640 1 -- 172.21.15.2:0/1890732800 >> v1:172.21.15.90:6789/0 conn(0x7f06c00c93b0 legacy=0x7f06c00cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c4e2b640 1 -- 172.21.15.2:0/1890732800 >> v1:172.21.15.2:6789/0 conn(0x7f06c0159ec0 legacy=0x7f06c015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c4e2b640 1 -- 172.21.15.2:0/1890732800 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c015e540 con 0x7f06c006c5c0 2023-11-04T01:43:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06beffd640 1 -- 172.21.15.2:0/1890732800 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826934359 0 0) 0x7f06b0001120 con 0x7f06c0159ec0 2023-11-04T01:43:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06c4e2b640 1 --2- 172.21.15.2:0/1890732800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c006c5c0 0x7f06c006ca10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009d90 tx=0x7f06b801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7fe51b4d381e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06beffd640 1 -- 172.21.15.2:0/1890732800 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80a59a0 con 0x7f06c006c5c0 2023-11-04T01:43:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06beffd640 1 -- 172.21.15.2:0/1890732800 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b80a5b00 con 0x7f06c006c5c0 2023-11-04T01:43:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.900+0000 7f06beffd640 1 -- 172.21.15.2:0/1890732800 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80a5e90 con 0x7f06c006c5c0 2023-11-04T01:43:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- 172.21.15.2:0/1890732800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c006c5c0 msgr2=0x7f06c006ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 --2- 172.21.15.2:0/1890732800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c006c5c0 0x7f06c006ca10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009d90 tx=0x7f06b801c8e0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- 172.21.15.2:0/1890732800 shutdown_connections 2023-11-04T01:43:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 --2- 172.21.15.2:0/1890732800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c006c5c0 0x7f06c006ca10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- 172.21.15.2:0/1890732800 >> 172.21.15.2:0/1890732800 conn(0x7f06c00cb420 msgr2=0x7f06c00cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- 172.21.15.2:0/1890732800 shutdown_connections 2023-11-04T01:43:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- 172.21.15.2:0/1890732800 wait complete. 2023-11-04T01:43:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 Processor -- start 2023-11-04T01:43:50.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- start start 2023-11-04T01:43:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06c006c5c0 0x7f06c00c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c00c93b0 0x7f06c0150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06c0159ec0 0x7f06c014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0150b40 con 0x7f06c00c93b0 2023-11-04T01:43:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00c7520 con 0x7f06c006c5c0 2023-11-04T01:43:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c014f880 con 0x7f06c0159ec0 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c00c93b0 0x7f06c0150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c00c93b0 0x7f06c0150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54194/0 (socket says 172.21.15.2:54194) 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 -- 172.21.15.2:0/2088780254 learned_addr learned my addr 172.21.15.2:0/2088780254 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bffff640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06c006c5c0 0x7f06c00c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c4e2b640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06c0159ec0 0x7f06c014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 -- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06c0159ec0 msgr2=0x7f06c014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06c0159ec0 0x7f06c014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 -- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06c006c5c0 msgr2=0x7f06c00c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06c006c5c0 0x7f06c00c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 -- 172.21.15.2:0/2088780254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b8009a70 con 0x7f06c00c93b0 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c4e2b640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06c0159ec0 0x7f06c014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bf7fe640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c00c93b0 0x7f06c0150600 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f06a800c450 tx=0x7f06a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bcff9640 1 -- 172.21.15.2:0/2088780254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8012830 con 0x7f06c00c93b0 2023-11-04T01:43:50.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bcff9640 1 -- 172.21.15.2:0/2088780254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a80129b0 con 0x7f06c00c93b0 2023-11-04T01:43:50.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06bcff9640 1 -- 172.21.15.2:0/2088780254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8012d60 con 0x7f06c00c93b0 2023-11-04T01:43:50.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c014fb20 con 0x7f06c00c93b0 2023-11-04T01:43:50.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.904+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c01500e0 con 0x7f06c00c93b0 2023-11-04T01:43:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.908+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c0150300 con 0x7f06c00c93b0 2023-11-04T01:43:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.908+0000 7f06bcff9640 1 -- 172.21.15.2:0/2088780254 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06a801c460 con 0x7f06c00c93b0 2023-11-04T01:43:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.908+0000 7f06bcff9640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06a00664d0 0x7f06a0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.908+0000 7f06bcff9640 1 -- 172.21.15.2:0/2088780254 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f06a8083a50 con 0x7f06c00c93b0 2023-11-04T01:43:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.908+0000 7f06bffff640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06a00664d0 0x7f06a0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.908+0000 7f06bffff640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06a00664d0 0x7f06a0068990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000f70 tx=0x7f06b0007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:50.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:50.912+0000 7f06bcff9640 1 -- 172.21.15.2:0/2088780254 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06a8051100 con 0x7f06c00c93b0 2023-11-04T01:43:51.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.068+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06c00744a0 con 0x7f06c00c93b0 2023-11-04T01:43:51.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.068+0000 7f06bcff9640 1 -- 172.21.15.2:0/2088780254 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06a8054720 con 0x7f06c00c93b0 2023-11-04T01:43:51.073 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:51.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.068+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06a00664d0 msgr2=0x7f06a0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.068+0000 7f06c688e640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06a00664d0 0x7f06a0068990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000f70 tx=0x7f06b0007c10 comp rx=0 tx=0).stop 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.068+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c00c93b0 msgr2=0x7f06c0150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.068+0000 7f06c688e640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c00c93b0 0x7f06c0150600 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f06a800c450 tx=0x7f06a800c910 comp rx=0 tx=0).stop 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 shutdown_connections 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06a00664d0 0x7f06a0068990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06c0159ec0 0x7f06c014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06c00c93b0 0x7f06c0150600 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 --2- 172.21.15.2:0/2088780254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06c006c5c0 0x7f06c00c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 >> 172.21.15.2:0/2088780254 conn(0x7f06c00cb420 msgr2=0x7f06c0159060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 shutdown_connections 2023-11-04T01:43:51.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.072+0000 7f06c688e640 1 -- 172.21.15.2:0/2088780254 wait complete. 2023-11-04T01:43:51.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:51.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 Processor -- start 2023-11-04T01:43:51.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 -- start start 2023-11-04T01:43:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbb900b26c0 0x7fbb900b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb9006c1c0 0x7fbb900ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb90160cb0 con 0x7fbb9006c1c0 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb900b2fe0 con 0x7fbb900b26c0 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb9687e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90160f50 con 0x7fbb9006b580 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb9006c1c0 0x7fbb900ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb9006c1c0 0x7fbb900ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54204/0 (socket says 172.21.15.2:54204) 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 -- 172.21.15.2:0/2715732509 learned_addr learned my addr 172.21.15.2:0/2715732509 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb8ffff640 1 --2- 172.21.15.2:0/2715732509 >> v2:172.21.15.90:3300/0 conn(0x7fbb900b26c0 0x7fbb900b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb8f7fe640 1 --2- 172.21.15.2:0/2715732509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 -- 172.21.15.2:0/2715732509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 msgr2=0x7fbb9006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 --2- 172.21.15.2:0/2715732509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9006bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 -- 172.21.15.2:0/2715732509 >> v2:172.21.15.90:3300/0 conn(0x7fbb900b26c0 msgr2=0x7fbb900b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 --2- 172.21.15.2:0/2715732509 >> v2:172.21.15.90:3300/0 conn(0x7fbb900b26c0 0x7fbb900b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.212+0000 7fbb94e1b640 1 -- 172.21.15.2:0/2715732509 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90161230 con 0x7fbb9006c1c0 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb94e1b640 1 --2- 172.21.15.2:0/2715732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb900ceee0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbb90071040 tx=0x7fbb8801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0770ec06ef98758 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb8effd640 1 -- 172.21.15.2:0/2715732509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880a5750 con 0x7fbb9006c1c0 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb8effd640 1 -- 172.21.15.2:0/2715732509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880a58b0 con 0x7fbb9006c1c0 2023-11-04T01:43:51.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb8effd640 1 -- 172.21.15.2:0/2715732509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880a5c40 con 0x7fbb9006c1c0 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- 172.21.15.2:0/2715732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 msgr2=0x7fbb900ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 --2- 172.21.15.2:0/2715732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb900ceee0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fbb90071040 tx=0x7fbb8801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- 172.21.15.2:0/2715732509 shutdown_connections 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 --2- 172.21.15.2:0/2715732509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb900ceee0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 --2- 172.21.15.2:0/2715732509 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9006bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 --2- 172.21.15.2:0/2715732509 >> v2:172.21.15.90:3300/0 conn(0x7fbb900b26c0 0x7fbb900b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- 172.21.15.2:0/2715732509 >> 172.21.15.2:0/2715732509 conn(0x7fbb9009a030 msgr2=0x7fbb900d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- 172.21.15.2:0/2715732509 shutdown_connections 2023-11-04T01:43:51.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- 172.21.15.2:0/2715732509 wait complete. 2023-11-04T01:43:51.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 Processor -- start 2023-11-04T01:43:51.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- start start 2023-11-04T01:43:51.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb90151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb900b26c0 0x7fbb900b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900b5b20 con 0x7fbb9006c1c0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90151b60 con 0x7fbb900b26c0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb9687e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb90153910 con 0x7fbb9006b580 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb8f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb90151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb8f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb90151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54216/0 (socket says 172.21.15.2:54216) 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.216+0000 7fbb8f7fe640 1 -- 172.21.15.2:0/1889778018 learned_addr learned my addr 172.21.15.2:0/1889778018 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8ffff640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb94e1b640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb900b26c0 0x7fbb900b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8f7fe640 1 -- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 msgr2=0x7fbb9015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8f7fe640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8f7fe640 1 -- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb900b26c0 msgr2=0x7fbb900b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8f7fe640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb900b26c0 0x7fbb900b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8f7fe640 1 -- 172.21.15.2:0/1889778018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb88009b30 con 0x7fbb9006c1c0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8f7fe640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb90151620 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400d830 tx=0x7fbb8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8cff9640 1 -- 172.21.15.2:0/1889778018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840096a0 con 0x7fbb9006c1c0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8cff9640 1 -- 172.21.15.2:0/1889778018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84009800 con 0x7fbb9006c1c0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8cff9640 1 -- 172.21.15.2:0/1889778018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84009b70 con 0x7fbb9006c1c0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb900b5280 con 0x7fbb9006c1c0 2023-11-04T01:43:51.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb900b5840 con 0x7fbb9006c1c0 2023-11-04T01:43:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb90153ac0 con 0x7fbb9006c1c0 2023-11-04T01:43:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8cff9640 1 -- 172.21.15.2:0/1889778018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbb84027480 con 0x7fbb9006c1c0 2023-11-04T01:43:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8cff9640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb7c0664a0 0x7fbb7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8cff9640 1 -- 172.21.15.2:0/1889778018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fbb84084830 con 0x7fbb9006c1c0 2023-11-04T01:43:51.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.220+0000 7fbb8ffff640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb7c0664a0 0x7fbb7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.224+0000 7fbb8ffff640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb7c0664a0 0x7fbb7c068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb80008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.224+0000 7fbb8cff9640 1 -- 172.21.15.2:0/1889778018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbb84052000 con 0x7fbb9006c1c0 2023-11-04T01:43:51.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.380+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fbb90153a80 con 0x7fbb9006c1c0 2023-11-04T01:43:51.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb8cff9640 1 -- 172.21.15.2:0/1889778018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v41) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbb84055620 con 0x7fbb9006c1c0 2023-11-04T01:43:51.387 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb7c0664a0 msgr2=0x7fbb7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb7c0664a0 0x7fbb7c068960 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006fd0 tx=0x7fbb80008040 comp rx=0 tx=0).stop 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 msgr2=0x7fbb90151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb90151620 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbb8400d830 tx=0x7fbb8400dcf0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 shutdown_connections 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb7c0664a0 0x7fbb7c068960 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb900b26c0 0x7fbb900b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9006c1c0 0x7fbb90151620 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 --2- 172.21.15.2:0/1889778018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb9006b580 0x7fbb9015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 >> 172.21.15.2:0/1889778018 conn(0x7fbb9009a030 msgr2=0x7fbb900b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 shutdown_connections 2023-11-04T01:43:51.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.384+0000 7fbb9687e640 1 -- 172.21.15.2:0/1889778018 wait complete. 2023-11-04T01:43:51.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:43:51.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e89c95640 1 Processor -- start 2023-11-04T01:43:51.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e89c95640 1 -- start start 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e89c95640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159a50 0x7f4e840cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e89c95640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e8406c1a0 0x7f4e8406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e89c95640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e84159e30 con 0x7f4e840ce720 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e89c95640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e840ccfd0 con 0x7f4e8406c1a0 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e89c95640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840cd2b0 con 0x7f4e84159a50 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e83fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4e8406c1a0 0x7f4e8406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e82ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4e840ce720 0x7f4e8406ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53978/0 (socket says 172.21.15.2:53978) 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e82ffd640 1 -- 172.21.15.2:0/1166029476 learned_addr learned my addr 172.21.15.2:0/1166029476 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e837fe640 1 --2- 172.21.15.2:0/1166029476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159a50 0x7f4e840cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e83fff640 1 -- 172.21.15.2:0/1166029476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159a50 msgr2=0x7f4e840cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e83fff640 1 --2- 172.21.15.2:0/1166029476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159a50 0x7f4e840cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e83fff640 1 -- 172.21.15.2:0/1166029476 >> v1:172.21.15.2:6789/0 conn(0x7f4e840ce720 legacy=0x7f4e8406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.528+0000 7f4e83fff640 1 -- 172.21.15.2:0/1166029476 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840cd590 con 0x7f4e8406c1a0 2023-11-04T01:43:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e83fff640 1 --2- 172.21.15.2:0/1166029476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8406c1a0 0x7f4e8406fb70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009d90 tx=0x7f4e7c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c22c7a9ae3b7cb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e827fc640 1 -- 172.21.15.2:0/1166029476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0af600 con 0x7f4e8406c1a0 2023-11-04T01:43:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e827fc640 1 -- 172.21.15.2:0/1166029476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7c0ab050 con 0x7f4e8406c1a0 2023-11-04T01:43:51.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e827fc640 1 -- 172.21.15.2:0/1166029476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c0af980 con 0x7f4e8406c1a0 2023-11-04T01:43:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- 172.21.15.2:0/1166029476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8406c1a0 msgr2=0x7f4e8406fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 --2- 172.21.15.2:0/1166029476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8406c1a0 0x7f4e8406fb70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009d90 tx=0x7f4e7c01f130 comp rx=0 tx=0).stop 2023-11-04T01:43:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- 172.21.15.2:0/1166029476 shutdown_connections 2023-11-04T01:43:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 --2- 172.21.15.2:0/1166029476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e8406c1a0 0x7f4e8406fb70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 --2- 172.21.15.2:0/1166029476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e84159a50 0x7f4e840cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- 172.21.15.2:0/1166029476 >> 172.21.15.2:0/1166029476 conn(0x7f4e840cebb0 msgr2=0x7f4e840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:51.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- 172.21.15.2:0/1166029476 shutdown_connections 2023-11-04T01:43:51.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- 172.21.15.2:0/1166029476 wait complete. 2023-11-04T01:43:51.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 Processor -- start 2023-11-04T01:43:51.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- start start 2023-11-04T01:43:51.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e8406c1a0 0x7f4e84153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e840ce720 0x7f4e841e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e84159a50 0x7f4e841e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c66a0 con 0x7f4e840ce720 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c8940 con 0x7f4e84159a50 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c5d00 con 0x7f4e8406c1a0 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e840ce720 0x7f4e841e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e840ce720 0x7f4e841e43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33716/0 (socket says 172.21.15.2:33716) 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 -- 172.21.15.2:0/294016358 learned_addr learned my addr 172.21.15.2:0/294016358 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e83fff640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e84159a50 0x7f4e841e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e837fe640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e8406c1a0 0x7f4e84153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 -- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e8406c1a0 msgr2=0x7f4e84153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e8406c1a0 0x7f4e84153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 -- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e84159a50 msgr2=0x7f4e841e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e84159a50 0x7f4e841e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 -- 172.21.15.2:0/294016358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c009a70 con 0x7f4e840ce720 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e83fff640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e84159a50 0x7f4e841e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e82ffd640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e840ce720 0x7f4e841e43d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c500 tx=0x7f4e6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e7bfff640 1 -- 172.21.15.2:0/294016358 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c005cf0 con 0x7f4e840ce720 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840c5fe0 con 0x7f4e840ce720 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e7bfff640 1 -- 172.21.15.2:0/294016358 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c005e50 con 0x7f4e840ce720 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e7bfff640 1 -- 172.21.15.2:0/294016358 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0072f0 con 0x7f4e840ce720 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.532+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e840c7bd0 con 0x7f4e840ce720 2023-11-04T01:43:51.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.536+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e840744a0 con 0x7f4e840ce720 2023-11-04T01:43:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.536+0000 7f4e7bfff640 1 -- 172.21.15.2:0/294016358 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4e6c007450 con 0x7f4e840ce720 2023-11-04T01:43:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.536+0000 7f4e7bfff640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4e640664a0 0x7f4e64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.536+0000 7f4e7bfff640 1 -- 172.21.15.2:0/294016358 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4e6c083080 con 0x7f4e840ce720 2023-11-04T01:43:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.536+0000 7f4e837fe640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4e640664a0 0x7f4e64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:51.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.536+0000 7f4e837fe640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4e640664a0 0x7f4e64068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e74006aa0 tx=0x7f4e74006a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:51.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.540+0000 7f4e7bfff640 1 -- 172.21.15.2:0/294016358 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e6c0b4090 con 0x7f4e840ce720 2023-11-04T01:43:51.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:51.744+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f4e840b4b30 con 0x7f4e840ce720 2023-11-04T01:43:52.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.452+0000 7f4e7bfff640 1 -- 172.21.15.2:0/294016358 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v102) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e6c054170 con 0x7f4e840ce720 2023-11-04T01:43:52.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4e640664a0 msgr2=0x7f4e64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4e640664a0 0x7f4e64068960 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e74006aa0 tx=0x7f4e74006a30 comp rx=0 tx=0).stop 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e840ce720 msgr2=0x7f4e841e43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e840ce720 0x7f4e841e43d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c500 tx=0x7f4e6c00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 shutdown_connections 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4e640664a0 0x7f4e64068960 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e84159a50 0x7f4e841e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e840ce720 0x7f4e841e43d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 --2- 172.21.15.2:0/294016358 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4e8406c1a0 0x7f4e84153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 >> 172.21.15.2:0/294016358 conn(0x7f4e840cebb0 msgr2=0x7f4e840cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 shutdown_connections 2023-11-04T01:43:52.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.456+0000 7f4e89c95640 1 -- 172.21.15.2:0/294016358 wait complete. 2023-11-04T01:43:52.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:43:52.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfb018f640 1 Processor -- start 2023-11-04T01:43:52.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfb018f640 1 -- start start 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfb018f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfa815d0b0 0x7fcfa8160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfb018f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcfa80cff20 0x7fcfa80d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfb018f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa80b5e00 con 0x7fcfa81610f0 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfb018f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa80d1520 con 0x7fcfa815d0b0 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfb018f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa815d490 con 0x7fcfa80cff20 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfadf2b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfa815d0b0 0x7fcfa8160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfadf2b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfa815d0b0 0x7fcfa8160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33728/0 (socket says 172.21.15.2:33728) 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfadf2b640 1 -- 172.21.15.2:0/1848060011 learned_addr learned my addr 172.21.15.2:0/1848060011 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:52.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfae72c640 1 --2- 172.21.15.2:0/1848060011 >> v2:172.21.15.90:3300/0 conn(0x7fcfa80cff20 0x7fcfa80d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfadf2b640 1 -- 172.21.15.2:0/1848060011 >> v2:172.21.15.90:3300/0 conn(0x7fcfa80cff20 msgr2=0x7fcfa80d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfadf2b640 1 --2- 172.21.15.2:0/1848060011 >> v2:172.21.15.90:3300/0 conn(0x7fcfa80cff20 0x7fcfa80d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfadf2b640 1 -- 172.21.15.2:0/1848060011 >> v1:172.21.15.90:6789/0 conn(0x7fcfa81610f0 legacy=0x7fcfa80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.616+0000 7fcfadf2b640 1 -- 172.21.15.2:0/1848060011 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80b8930 con 0x7fcfa815d0b0 2023-11-04T01:43:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfadf2b640 1 --2- 172.21.15.2:0/1848060011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa815d0b0 0x7fcfa8160bb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80cf1b0 tx=0x7fcfa401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec166a5a36ea9051 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfacf29640 1 -- 172.21.15.2:0/1848060011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40ab610 con 0x7fcfa815d0b0 2023-11-04T01:43:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfacf29640 1 -- 172.21.15.2:0/1848060011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa40ab770 con 0x7fcfa815d0b0 2023-11-04T01:43:52.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfacf29640 1 -- 172.21.15.2:0/1848060011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40abb00 con 0x7fcfa815d0b0 2023-11-04T01:43:52.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 -- 172.21.15.2:0/1848060011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa815d0b0 msgr2=0x7fcfa8160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 --2- 172.21.15.2:0/1848060011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa815d0b0 0x7fcfa8160bb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80cf1b0 tx=0x7fcfa401c500 comp rx=0 tx=0).stop 2023-11-04T01:43:52.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 -- 172.21.15.2:0/1848060011 shutdown_connections 2023-11-04T01:43:52.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 --2- 172.21.15.2:0/1848060011 >> v2:172.21.15.90:3300/0 conn(0x7fcfa80cff20 0x7fcfa80d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 --2- 172.21.15.2:0/1848060011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa815d0b0 0x7fcfa8160bb0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 -- 172.21.15.2:0/1848060011 >> 172.21.15.2:0/1848060011 conn(0x7fcfa806a890 msgr2=0x7fcfa806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 -- 172.21.15.2:0/1848060011 shutdown_connections 2023-11-04T01:43:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 -- 172.21.15.2:0/1848060011 wait complete. 2023-11-04T01:43:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 Processor -- start 2023-11-04T01:43:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.620+0000 7fcfb018f640 1 -- start start 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfa80cff20 0x7fcfa80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfa815d0b0 0x7fcfa814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa81610f0 0x7fcfa814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa80c9180 con 0x7fcfa81610f0 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8154280 con 0x7fcfa815d0b0 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa814e630 con 0x7fcfa80cff20 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa81610f0 0x7fcfa814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa81610f0 0x7fcfa814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33742/0 (socket says 172.21.15.2:33742) 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 -- 172.21.15.2:0/3202667838 learned_addr learned my addr 172.21.15.2:0/3202667838 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfadf2b640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfa80cff20 0x7fcfa80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfad72a640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfa815d0b0 0x7fcfa814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 -- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfa80cff20 msgr2=0x7fcfa80c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfa80cff20 0x7fcfa80c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 -- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfa815d0b0 msgr2=0x7fcfa814dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfa815d0b0 0x7fcfa814dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 -- 172.21.15.2:0/3202667838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa40094d0 con 0x7fcfa81610f0 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfadf2b640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfa80cff20 0x7fcfa80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfae72c640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa81610f0 0x7fcfa814e0f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007e40 tx=0x7fcfa000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcf9e7fc640 1 -- 172.21.15.2:0/3202667838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0014620 con 0x7fcfa81610f0 2023-11-04T01:43:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcf9e7fc640 1 -- 172.21.15.2:0/3202667838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000ee90 con 0x7fcfa81610f0 2023-11-04T01:43:52.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcf9e7fc640 1 -- 172.21.15.2:0/3202667838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00149e0 con 0x7fcfa81610f0 2023-11-04T01:43:52.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa8153cc0 con 0x7fcfa81610f0 2023-11-04T01:43:52.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa81525f0 con 0x7fcfa81610f0 2023-11-04T01:43:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa80c92c0 con 0x7fcfa81610f0 2023-11-04T01:43:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcf9e7fc640 1 -- 172.21.15.2:0/3202667838 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfa0014b40 con 0x7fcfa81610f0 2023-11-04T01:43:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcf9e7fc640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf8c0664a0 0x7fcf8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.624+0000 7fcf9e7fc640 1 -- 172.21.15.2:0/3202667838 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcfa0084700 con 0x7fcfa81610f0 2023-11-04T01:43:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.628+0000 7fcfadf2b640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf8c0664a0 0x7fcf8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:52.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.628+0000 7fcfadf2b640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf8c0664a0 0x7fcf8c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40af000 tx=0x7fcfa40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:52.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.628+0000 7fcf9e7fc640 1 -- 172.21.15.2:0/3202667838 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcfa80c92c0 con 0x7fcfa81610f0 2023-11-04T01:43:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.788+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcfa80c92c0 con 0x7fcfa81610f0 2023-11-04T01:43:52.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.792+0000 7fcf9e7fc640 1 -- 172.21.15.2:0/3202667838 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v13)=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcfa80c92c0 con 0x7fcfa81610f0 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf8c0664a0 msgr2=0x7fcf8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf8c0664a0 0x7fcf8c068960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40af000 tx=0x7fcfa40a7000 comp rx=0 tx=0).stop 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa81610f0 msgr2=0x7fcfa814e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa81610f0 0x7fcfa814e0f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007e40 tx=0x7fcfa000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 shutdown_connections 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf8c0664a0 0x7fcf8c068960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfa81610f0 0x7fcfa814e0f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfa815d0b0 0x7fcfa814dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 --2- 172.21.15.2:0/3202667838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfa80cff20 0x7fcfa80c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 >> 172.21.15.2:0/3202667838 conn(0x7fcfa806a890 msgr2=0x7fcfa80b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 shutdown_connections 2023-11-04T01:43:52.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:52.796+0000 7fcfb018f640 1 -- 172.21.15.2:0/3202667838 wait complete. 2023-11-04T01:43:52.817 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:43:52.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:52.869 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:43:52.913 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:43:52.913 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:52.913 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:52.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:52.919 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:52.919 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:52.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:52.964 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:43:52.964 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:52.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:43:52.970 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:43:52.970 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:43:53.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:43:53.012 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:43:53.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:43:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.140+0000 7f55599d1640 1 Processor -- start 2023-11-04T01:43:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.140+0000 7f55599d1640 1 -- start start 2023-11-04T01:43:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f55599d1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f555415afd0 0x7f55540715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f55599d1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55540b0d40 0x7f555415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f55599d1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55540c2670 con 0x7f555406f8f0 2023-11-04T01:43:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f55599d1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5554070140 con 0x7f555415afd0 2023-11-04T01:43:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f55599d1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555406c9f0 con 0x7f55540b0d40 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f555415afd0 0x7f55540715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f555415afd0 0x7f55540715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33746/0 (socket says 172.21.15.2:33746) 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f55527fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f555406f8f0 0x7f55540b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53982/0 (socket says 172.21.15.2:53982) 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 -- 172.21.15.2:0/2167525053 learned_addr learned my addr 172.21.15.2:0/2167525053 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 -- 172.21.15.2:0/2167525053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55540b0d40 msgr2=0x7f555415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 --2- 172.21.15.2:0/2167525053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55540b0d40 0x7f555415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 -- 172.21.15.2:0/2167525053 >> v1:172.21.15.2:6789/0 conn(0x7f555406f8f0 legacy=0x7f55540b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 -- 172.21.15.2:0/2167525053 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555406bc30 con 0x7f555415afd0 2023-11-04T01:43:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5552ffd640 1 --2- 172.21.15.2:0/2167525053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555415afd0 0x7f55540715d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5544009870 tx=0x7f554401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2499b6833cfe821 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5551ffb640 1 -- 172.21.15.2:0/2167525053 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440ab600 con 0x7f555415afd0 2023-11-04T01:43:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5551ffb640 1 -- 172.21.15.2:0/2167525053 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55440a7050 con 0x7f555415afd0 2023-11-04T01:43:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.144+0000 7f5551ffb640 1 -- 172.21.15.2:0/2167525053 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440ab980 con 0x7f555415afd0 2023-11-04T01:43:53.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- 172.21.15.2:0/2167525053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555415afd0 msgr2=0x7f55540715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 --2- 172.21.15.2:0/2167525053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555415afd0 0x7f55540715d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5544009870 tx=0x7f554401c3d0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- 172.21.15.2:0/2167525053 shutdown_connections 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 --2- 172.21.15.2:0/2167525053 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55540b0d40 0x7f555415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 --2- 172.21.15.2:0/2167525053 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f555415afd0 0x7f55540715d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- 172.21.15.2:0/2167525053 >> 172.21.15.2:0/2167525053 conn(0x7f55540cebb0 msgr2=0x7f55540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- 172.21.15.2:0/2167525053 shutdown_connections 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- 172.21.15.2:0/2167525053 wait complete. 2023-11-04T01:43:53.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 Processor -- start 2023-11-04T01:43:53.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- start start 2023-11-04T01:43:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f555406f8f0 0x7f5554150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55540b0d40 0x7f55540c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f555415afd0 0x7f55540c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540c7320 con 0x7f55540b0d40 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55540c75c0 con 0x7f555415afd0 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55540c78a0 con 0x7f555406f8f0 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55540b0d40 0x7f55540c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55540b0d40 0x7f55540c8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33760/0 (socket says 172.21.15.2:33760) 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 -- 172.21.15.2:0/1130995521 learned_addr learned my addr 172.21.15.2:0/1130995521 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f5552ffd640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f555406f8f0 0x7f5554150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55537fe640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f555415afd0 0x7f55540c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 -- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f555406f8f0 msgr2=0x7f5554150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f555406f8f0 0x7f5554150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 -- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f555415afd0 msgr2=0x7f55540c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f555415afd0 0x7f55540c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 -- 172.21.15.2:0/1130995521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440094d0 con 0x7f55540b0d40 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55537fe640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f555415afd0 0x7f55540c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f5552ffd640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f555406f8f0 0x7f5554150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55527fc640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55540b0d40 0x7f55540c8380 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5548009e70 tx=0x7f554800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f553bfff640 1 -- 172.21.15.2:0/1130995521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548007830 con 0x7f55540b0d40 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f553bfff640 1 -- 172.21.15.2:0/1130995521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548007990 con 0x7f55540b0d40 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f553bfff640 1 -- 172.21.15.2:0/1130995521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548007d20 con 0x7f55540b0d40 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55540c7b80 con 0x7f55540b0d40 2023-11-04T01:43:53.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.148+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5554157420 con 0x7f55540b0d40 2023-11-04T01:43:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.152+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55540744a0 con 0x7f55540b0d40 2023-11-04T01:43:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.152+0000 7f553bfff640 1 -- 172.21.15.2:0/1130995521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5548009070 con 0x7f55540b0d40 2023-11-04T01:43:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.152+0000 7f553bfff640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55400664a0 0x7f5540068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.152+0000 7f553bfff640 1 -- 172.21.15.2:0/1130995521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5548085c50 con 0x7f55540b0d40 2023-11-04T01:43:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.152+0000 7f5552ffd640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55400664a0 0x7f5540068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.152+0000 7f5552ffd640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55400664a0 0x7f5540068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f55440ad000 tx=0x7f5544008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.156+0000 7f553bfff640 1 -- 172.21.15.2:0/1130995521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5548053280 con 0x7f55540b0d40 2023-11-04T01:43:53.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.344+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f555406cba0 con 0x7f55540b0d40 2023-11-04T01:43:53.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f553bfff640 1 -- 172.21.15.2:0/1130995521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3683 (secure 0 0 0) 0x7f5548019020 con 0x7f55540b0d40 2023-11-04T01:43:53.351 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:53.351 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4718,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/926400153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":926400153},{"type":"v1","addr":"172.21.15.90:6837","nonce":926400153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4721,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/1780832630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1780832630},{"type":"v1","addr":"172.21.15.90:6836","nonce":1780832630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/763530639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":763530639},{"type":"v1","addr":"172.21.15.2:6834","nonce":763530639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":5661,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/787213573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":787213573},{"type":"v1","addr":"172.21.15.2:6835","nonce":787213573}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[]} 2023-11-04T01:43:53.352 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 16 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55400664a0 msgr2=0x7f5540068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55400664a0 0x7f5540068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f55440ad000 tx=0x7f5544008040 comp rx=0 tx=0).stop 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55540b0d40 msgr2=0x7f55540c8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55540b0d40 0x7f55540c8380 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5548009e70 tx=0x7f554800c430 comp rx=0 tx=0).stop 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 shutdown_connections 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55400664a0 0x7f5540068960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f555415afd0 0x7f55540c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55540b0d40 0x7f55540c8380 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 --2- 172.21.15.2:0/1130995521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f555406f8f0 0x7f5554150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 >> 172.21.15.2:0/1130995521 conn(0x7f55540cebb0 msgr2=0x7f55540ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 shutdown_connections 2023-11-04T01:43:53.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.348+0000 7f55599d1640 1 -- 172.21.15.2:0/1130995521 wait complete. 2023-11-04T01:43:53.371 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:43:53.371 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:43:53.371 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:43:53.371 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:53.371 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:43:53.372 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:43:53.372 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:43:53.372 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:53.372 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:43:53.372 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:43:53.372 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:43:53.372 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:53.373 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:43:53.373 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:43:53.373 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:43:53.373 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:43:53.382 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:43:53.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:43:53.383 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:43:53.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:43:53.390 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:43:53.390 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:43:53.392 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:43:53.393 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:43:53.428 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:43:53.428 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:53.429 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:43:53.429 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:53.436 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:43:53.436 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:53.437 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:43:53.437 DEBUG:teuthology.parallel:result is None 2023-11-04T01:43:53.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:43:53.492 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:43:53.492 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:43:53.506 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:43:53.512 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:43:53.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e64d83640 1 Processor -- start 2023-11-04T01:43:53.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e64d83640 1 -- start start 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e64d83640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7e6015a080 0x7f7e60065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e64d83640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e6006a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e64d83640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e600cc740 con 0x7f7e6015e7f0 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e64d83640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e60066510 con 0x7f7e6015a080 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e64d83640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6006c300 con 0x7f7e6015e340 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5e59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7e6015a080 0x7f7e60065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5dd9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7e6015e7f0 0x7f7e6015dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54006/0 (socket says 172.21.15.2:54006) 2023-11-04T01:43:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5dd9b640 1 -- 172.21.15.2:0/313389898 learned_addr learned my addr 172.21.15.2:0/313389898 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:53.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5ed9d640 1 --2- 172.21.15.2:0/313389898 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e6006a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5e59c640 1 -- 172.21.15.2:0/313389898 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 msgr2=0x7f7e6006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:53.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5e59c640 1 --2- 172.21.15.2:0/313389898 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e6006a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5e59c640 1 -- 172.21.15.2:0/313389898 >> v1:172.21.15.2:6789/0 conn(0x7f7e6015e7f0 legacy=0x7f7e6015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5e59c640 1 -- 172.21.15.2:0/313389898 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6006c020 con 0x7f7e6015a080 2023-11-04T01:43:53.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.556+0000 7f7e5d59a640 1 -- 172.21.15.2:0/313389898 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114449420 0 0) 0x7f7e600cc740 con 0x7f7e6015e7f0 2023-11-04T01:43:53.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5e59c640 1 --2- 172.21.15.2:0/313389898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015a080 0x7f7e60065fd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097c0 tx=0x7f7e5001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cc2782653b9ba5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5d59a640 1 -- 172.21.15.2:0/313389898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500a8970 con 0x7f7e6015a080 2023-11-04T01:43:53.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5d59a640 1 -- 172.21.15.2:0/313389898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e500a8ad0 con 0x7f7e6015a080 2023-11-04T01:43:53.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5d59a640 1 -- 172.21.15.2:0/313389898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e500a8e60 con 0x7f7e6015a080 2023-11-04T01:43:53.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- 172.21.15.2:0/313389898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015a080 msgr2=0x7f7e60065fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 --2- 172.21.15.2:0/313389898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015a080 0x7f7e60065fd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097c0 tx=0x7f7e5001ec70 comp rx=0 tx=0).stop 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- 172.21.15.2:0/313389898 shutdown_connections 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 --2- 172.21.15.2:0/313389898 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e6006a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 --2- 172.21.15.2:0/313389898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015a080 0x7f7e60065fd0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- 172.21.15.2:0/313389898 >> 172.21.15.2:0/313389898 conn(0x7f7e600716a0 msgr2=0x7f7e60071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- 172.21.15.2:0/313389898 shutdown_connections 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- 172.21.15.2:0/313389898 wait complete. 2023-11-04T01:43:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 Processor -- start 2023-11-04T01:43:53.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- start start 2023-11-04T01:43:53.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e6015a080 0x7f7e60151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e600ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015e7f0 0x7f7e6015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600ac010 con 0x7f7e6015e7f0 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60152d90 con 0x7f7e6015a080 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e64d83640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e600ac220 con 0x7f7e6015e340 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015e7f0 0x7f7e6015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015e7f0 0x7f7e6015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33798/0 (socket says 172.21.15.2:33798) 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 -- 172.21.15.2:0/2464143871 learned_addr learned my addr 172.21.15.2:0/2464143871 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5dd9b640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e600ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5e59c640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e6015a080 0x7f7e60151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 -- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 msgr2=0x7f7e600ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e600ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 -- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e6015a080 msgr2=0x7f7e60151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:53.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e6015a080 0x7f7e60151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 -- 172.21.15.2:0/2464143871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50009420 con 0x7f7e6015e7f0 2023-11-04T01:43:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.560+0000 7f7e5ed9d640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015e7f0 0x7f7e6015bee0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009dd0 tx=0x7f7e5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e4effd640 1 -- 172.21.15.2:0/2464143871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58014480 con 0x7f7e6015e7f0 2023-11-04T01:43:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e4effd640 1 -- 172.21.15.2:0/2464143871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5800f040 con 0x7f7e6015e7f0 2023-11-04T01:43:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e600ac500 con 0x7f7e6015e7f0 2023-11-04T01:43:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e4effd640 1 -- 172.21.15.2:0/2464143871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58014840 con 0x7f7e6015e7f0 2023-11-04T01:43:53.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e600acac0 con 0x7f7e6015e7f0 2023-11-04T01:43:53.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e600675f0 con 0x7f7e6015e7f0 2023-11-04T01:43:53.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e4effd640 1 -- 172.21.15.2:0/2464143871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e580149a0 con 0x7f7e6015e7f0 2023-11-04T01:43:53.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e4effd640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e400664a0 0x7f7e40068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:53.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e4effd640 1 -- 172.21.15.2:0/2464143871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7e58084a20 con 0x7f7e6015e7f0 2023-11-04T01:43:53.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e5e59c640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e400664a0 0x7f7e40068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:53.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.564+0000 7f7e5e59c640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e400664a0 0x7f7e40068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e500b2000 tx=0x7f7e50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:53.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.568+0000 7f7e4effd640 1 -- 172.21.15.2:0/2464143871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7e580520f0 con 0x7f7e6015e7f0 2023-11-04T01:43:53.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:53.736+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7e600aeb60 con 0x7f7e6015e7f0 2023-11-04T01:43:54.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:54.702 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.824+0000 7f7e4effd640 1 -- 172.21.15.2:0/2464143871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e58055710 con 0x7f7e6015e7f0 2023-11-04T01:43:54.830 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e400664a0 msgr2=0x7f7e40068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e400664a0 0x7f7e40068960 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e500b2000 tx=0x7f7e50008040 comp rx=0 tx=0).stop 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015e7f0 msgr2=0x7f7e6015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015e7f0 0x7f7e6015bee0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009dd0 tx=0x7f7e5800c490 comp rx=0 tx=0).stop 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 shutdown_connections 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7e400664a0 0x7f7e40068960 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e6015e7f0 0x7f7e6015bee0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7e6015e340 0x7f7e600ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 --2- 172.21.15.2:0/2464143871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e6015a080 0x7f7e60151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 >> 172.21.15.2:0/2464143871 conn(0x7f7e600716a0 msgr2=0x7f7e600cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 shutdown_connections 2023-11-04T01:43:54.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.828+0000 7f7e64d83640 1 -- 172.21.15.2:0/2464143871 wait complete. 2023-11-04T01:43:54.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.960+0000 7ff1a6c65640 1 Processor -- start 2023-11-04T01:43:54.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a6c65640 1 -- start start 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a6c65640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a006c630 0x7ff1a00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a6c65640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a00cd400 con 0x7ff1a015d690 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a6c65640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a00cd6e0 con 0x7ff1a015d2b0 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a6c65640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00ad450 con 0x7ff1a006c630 2023-11-04T01:43:54.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff1a015d690 0x7ff1a006f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54022/0 (socket says 172.21.15.2:54022) 2023-11-04T01:43:54.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19ffff640 1 -- 172.21.15.2:0/3238256354 learned_addr learned my addr 172.21.15.2:0/3238256354 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a5202640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a006c630 0x7ff1a00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447945241 0 0) 0x7ff1a00cd400 con 0x7ff1a015d690 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff18c003530 con 0x7ff1a015d690 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1495538372 0 0) 0x7ff18c003530 con 0x7ff1a015d690 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a006c630 msgr2=0x7ff1a00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a006c630 0x7ff1a00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 >> v1:172.21.15.90:6789/0 conn(0x7ff1a015d2b0 legacy=0x7ff1a00ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00ad070 con 0x7ff1a015d690 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff1880016a0 con 0x7ff1a015d690 2023-11-04T01:43:54.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 >> v1:172.21.15.2:6789/0 conn(0x7ff1a015d690 legacy=0x7ff1a006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff18c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a006c630 0x7ff18c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c004d10 0x7ff18c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00ad450 con 0x7ff18c0039b0 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c00baf0 con 0x7ff18c004d10 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c00bcb0 con 0x7ff1a006c630 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a4a01640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff18c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a4a01640 1 -- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a006c630 msgr2=0x7ff18c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a4a01640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a006c630 0x7ff18c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a4a01640 1 -- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c004d10 msgr2=0x7ff18c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a4a01640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff18c004d10 0x7ff18c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.964+0000 7ff1a4a01640 1 -- 172.21.15.2:0/3238256354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c003530 con 0x7ff18c0039b0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff18c003dd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff190001780 tx=0x7ff19001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573c4bf6124e3730 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1900050d0 con 0x7ff18c0039b0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1900a7050 con 0x7ff18c0039b0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff19f7fe640 1 -- 172.21.15.2:0/3238256354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190005490 con 0x7ff18c0039b0 2023-11-04T01:43:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- 172.21.15.2:0/3238256354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 msgr2=0x7ff18c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 --2- 172.21.15.2:0/3238256354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff18c003dd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff190001780 tx=0x7ff19001c340 comp rx=0 tx=0).stop 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a5202640 1 -- 172.21.15.2:0/3238256354 reap_dead start 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- 172.21.15.2:0/3238256354 shutdown_connections 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- 172.21.15.2:0/3238256354 >> 172.21.15.2:0/3238256354 conn(0x7ff1a00cebb0 msgr2=0x7ff1a00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- 172.21.15.2:0/3238256354 shutdown_connections 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- 172.21.15.2:0/3238256354 wait complete. 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 Processor -- start 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- start start 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff1a01480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a00cabf0 0x7ff1a00c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a00cb070 0x7ff1a00c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00ca760 con 0x7ff18c0039b0 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a0160580 con 0x7ff1a00cb070 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a6c65640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00c9e30 con 0x7ff1a00cabf0 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff1a01480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff1a01480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33808/0 (socket says 172.21.15.2:33808) 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 -- 172.21.15.2:0/772614480 learned_addr learned my addr 172.21.15.2:0/772614480 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff19ffff640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a00cabf0 0x7ff1a00c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a5202640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a00cb070 0x7ff1a00c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 -- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a00cabf0 msgr2=0x7ff1a00c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a00cabf0 0x7ff1a00c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 -- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a00cb070 msgr2=0x7ff1a00c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a00cb070 0x7ff1a00c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:54.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 -- 172.21.15.2:0/772614480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00ca110 con 0x7ff18c0039b0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a5202640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a00cb070 0x7ff1a00c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.968+0000 7ff1a4a01640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff1a01480d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff190005040 tx=0x7ff18c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19d7fa640 1 -- 172.21.15.2:0/772614480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190007250 con 0x7ff18c0039b0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19d7fa640 1 -- 172.21.15.2:0/772614480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1900073b0 con 0x7ff18c0039b0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a00ca3f0 con 0x7ff18c0039b0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19d7fa640 1 -- 172.21.15.2:0/772614480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1900067e0 con 0x7ff18c0039b0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a01594e0 con 0x7ff18c0039b0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a00744a0 con 0x7ff18c0039b0 2023-11-04T01:43:54.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19d7fa640 1 -- 172.21.15.2:0/772614480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff190006940 con 0x7ff18c0039b0 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19d7fa640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1800664a0 0x7ff180068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19d7fa640 1 -- 172.21.15.2:0/772614480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff19011e0b0 con 0x7ff18c0039b0 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19ffff640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1800664a0 0x7ff180068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:54.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.972+0000 7ff19ffff640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1800664a0 0x7ff180068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff188001850 tx=0x7ff1880015e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:54.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:54.976+0000 7ff19d7fa640 1 -- 172.21.15.2:0/772614480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff1900eb720 con 0x7ff18c0039b0 2023-11-04T01:43:55.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.188+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff1a00ca5b0 con 0x7ff18c0039b0 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.188+0000 7ff19d7fa640 1 -- 172.21.15.2:0/772614480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff1900eed40 con 0x7ff18c0039b0 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-04T01:43:55.194 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlnFZCMBAAsgGcwY3jbh9F9NEVwbamwg==", 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-04T01:43:55.195 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDZRuAxAA6zx8mu5wQEvvcICXPTXZZQ==", 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlFSvMOBAA0k4I7A+4TRIrxBOwUdIZLw==", 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.196 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl/PDbCxAA+6y8He/9gQZa1vvdJH+iCg==", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:55.197 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBIoUVlnpFvJBAAAyqa0u7D+cz+Gy4XpppWYQ==", 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBLoUVlObtjKhAAbf3wgZ9mpp8+pI1IGyIwdg==", 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-04T01:43:55.199 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBOoUVlOF4QMxAANdCz1HMyMGzyFpUv9xawYA==", 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBRoUVlMnFiOxAA2d7ZoQEhtXkAMhu0yPh4iw==", 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.200 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBYoUVlfe9FCBAA3oVMNubThpWJoxlqFzaAfg==", 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.201 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBboUVlTfGNEBAA2FNXiCKGJ2s4XeH+paqrNw==", 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-04T01:43:55.202 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBeoUVluX7oGBAAh+/toMBPGjq99EonfWEPtQ==", 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBhoUVlGhEAIhAAO8mqoIPekhVmAxnR1VKXeQ==", 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:43:55.203 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ==", 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDtmNGRAAFXXp/X0fnL9uuEIfj1Eadw==", 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.205 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlPzfyFhAAbCRYmyHHFu2GDtyZOL2ISw==", 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl1jK2HhAAH1E38zcrKticBLLRR/8IuA==", 2023-11-04T01:43:55.206 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlCj8pFxAApTKY8a6VcYBWkCLKrKHorQ==", 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:43:55.207 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlcZ/jKhAAWDrmzYgapIV+SBRNrXWAjg==", 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.208 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlhYtpKBAAn1snUSz1+SKC8frnVuvFdA==", 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-04T01:43:55.209 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1800664a0 msgr2=0x7ff180068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1800664a0 0x7ff180068960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff188001850 tx=0x7ff1880015e0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 msgr2=0x7ff1a01480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff1a01480d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff190005040 tx=0x7ff18c005800 comp rx=0 tx=0).stop 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 shutdown_connections 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1800664a0 0x7ff180068960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1a00cb070 0x7ff1a00c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1a00cabf0 0x7ff1a00c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 --2- 172.21.15.2:0/772614480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff18c0039b0 0x7ff1a01480d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 >> 172.21.15.2:0/772614480 conn(0x7ff1a00cebb0 msgr2=0x7ff1a015abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 shutdown_connections 2023-11-04T01:43:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.192+0000 7ff1a6c65640 1 -- 172.21.15.2:0/772614480 wait complete. 2023-11-04T01:43:55.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.320+0000 7f6608d45640 1 Processor -- start 2023-11-04T01:43:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.320+0000 7f6608d45640 1 -- start start 2023-11-04T01:43:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6608d45640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f660415af80 0x7f66040ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6608d45640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f660406ace0 0x7f66040b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6608d45640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660415b360 con 0x7f660406f280 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6608d45640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6604071880 con 0x7f660406ace0 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6608d45640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6604071b60 con 0x7f660415af80 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6602d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f660406f280 0x7f660415eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54028/0 (socket says 172.21.15.2:54028) 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6602d9d640 1 -- 172.21.15.2:0/3724432359 learned_addr learned my addr 172.21.15.2:0/3724432359 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6601d9b640 1 --2- 172.21.15.2:0/3724432359 >> v2:172.21.15.2:3300/0 conn(0x7f660406ace0 0x7f66040b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f660259c640 1 --2- 172.21.15.2:0/3724432359 >> v2:172.21.15.90:3300/0 conn(0x7f660415af80 0x7f66040ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f660159a640 1 -- 172.21.15.2:0/3724432359 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831279033 0 0) 0x7f660415b360 con 0x7f660406f280 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f660159a640 1 -- 172.21.15.2:0/3724432359 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ec003530 con 0x7f660406f280 2023-11-04T01:43:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6601d9b640 1 -- 172.21.15.2:0/3724432359 >> v2:172.21.15.90:3300/0 conn(0x7f660415af80 msgr2=0x7f66040ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6601d9b640 1 --2- 172.21.15.2:0/3724432359 >> v2:172.21.15.90:3300/0 conn(0x7f660415af80 0x7f66040ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6601d9b640 1 -- 172.21.15.2:0/3724432359 >> v1:172.21.15.2:6789/0 conn(0x7f660406f280 legacy=0x7f660415eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6601d9b640 1 -- 172.21.15.2:0/3724432359 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660406a200 con 0x7f660406ace0 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f660259c640 1 --2- 172.21.15.2:0/3724432359 >> v2:172.21.15.90:3300/0 conn(0x7f660415af80 0x7f66040ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f6601d9b640 1 --2- 172.21.15.2:0/3724432359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66040b1700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f66040cfae0 tx=0x7f65f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218fdba2d0fa4a32 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f660159a640 1 -- 172.21.15.2:0/3724432359 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f80ab600 con 0x7f660406ace0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f660159a640 1 -- 172.21.15.2:0/3724432359 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f80a7050 con 0x7f660406ace0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.324+0000 7f660159a640 1 -- 172.21.15.2:0/3724432359 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f80ab980 con 0x7f660406ace0 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- 172.21.15.2:0/3724432359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 msgr2=0x7f66040b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 --2- 172.21.15.2:0/3724432359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66040b1700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f66040cfae0 tx=0x7f65f801c3d0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- 172.21.15.2:0/3724432359 shutdown_connections 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 --2- 172.21.15.2:0/3724432359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66040b1700 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 --2- 172.21.15.2:0/3724432359 >> v2:172.21.15.90:3300/0 conn(0x7f660415af80 0x7f66040ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- 172.21.15.2:0/3724432359 >> 172.21.15.2:0/3724432359 conn(0x7f660406e760 msgr2=0x7f660406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- 172.21.15.2:0/3724432359 shutdown_connections 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- 172.21.15.2:0/3724432359 wait complete. 2023-11-04T01:43:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 Processor -- start 2023-11-04T01:43:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- start start 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66041563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f660406f280 0x7f660415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660415af80 0x7f660415ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604163800 con 0x7f660406ace0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66040c9650 con 0x7f660415af80 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6604163a30 con 0x7f660406f280 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66041563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66041563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33828/0 (socket says 172.21.15.2:33828) 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 -- 172.21.15.2:0/3373225586 learned_addr learned my addr 172.21.15.2:0/3373225586 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6602d9d640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660415af80 0x7f660415ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6601d9b640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f660406f280 0x7f660415fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 -- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f660406f280 msgr2=0x7f660415fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f660406f280 0x7f660415fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 -- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660415af80 msgr2=0x7f660415ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660415af80 0x7f660415ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 -- 172.21.15.2:0/3373225586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8009420 con 0x7f660406ace0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6602d9d640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660415af80 0x7f660415ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f660259c640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66041563f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f65f400d800 tx=0x7f65f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f65f2ffd640 1 -- 172.21.15.2:0/3373225586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f40096c0 con 0x7f660406ace0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f65f2ffd640 1 -- 172.21.15.2:0/3373225586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4009820 con 0x7f660406ace0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66040c9090 con 0x7f660406ace0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f65f2ffd640 1 -- 172.21.15.2:0/3373225586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4009bd0 con 0x7f660406ace0 2023-11-04T01:43:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.328+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6604163cd0 con 0x7f660406ace0 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.332+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66040675f0 con 0x7f660406ace0 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.332+0000 7f65f2ffd640 1 -- 172.21.15.2:0/3373225586 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65f4009d30 con 0x7f660406ace0 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.332+0000 7f65f2ffd640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f65e40664a0 0x7f65e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.332+0000 7f65f2ffd640 1 -- 172.21.15.2:0/3373225586 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f65f4084380 con 0x7f660406ace0 2023-11-04T01:43:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.332+0000 7f6601d9b640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f65e40664a0 0x7f65e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.332+0000 7f6601d9b640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f65e40664a0 0x7f65e4068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f65f80ad000 tx=0x7f65f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.336+0000 7f65f2ffd640 1 -- 172.21.15.2:0/3373225586 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65f40519e0 con 0x7f660406ace0 2023-11-04T01:43:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.492+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66040b3730 con 0x7f660406ace0 2023-11-04T01:43:55.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f65f2ffd640 1 -- 172.21.15.2:0/3373225586 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14498 (secure 0 0 0) 0x7f65f4055000 con 0x7f660406ace0 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:55.500 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":46,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:54.826341+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f65e40664a0 msgr2=0x7f65e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f65e40664a0 0x7f65e4068960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f65f80ad000 tx=0x7f65f8008040 comp rx=0 tx=0).stop 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 msgr2=0x7f66041563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66041563f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f65f400d800 tx=0x7f65f400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 shutdown_connections 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f65e40664a0 0x7f65e4068960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f660415af80 0x7f660415ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f660406f280 0x7f660415fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 --2- 172.21.15.2:0/3373225586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f660406ace0 0x7f66041563f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 >> 172.21.15.2:0/3373225586 conn(0x7f660406e760 msgr2=0x7f660415bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 shutdown_connections 2023-11-04T01:43:55.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.496+0000 7f6608d45640 1 -- 172.21.15.2:0/3373225586 wait complete. 2023-11-04T01:43:55.518 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:43:55.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2f651640 1 Processor -- start 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2f651640 1 -- start start 2023-11-04T01:43:55.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2f651640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d280ce1b0 0x7f0d28159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2f651640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2815abd0 con 0x7f0d280b1040 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2f651640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2815aeb0 con 0x7f0d28159c10 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2f651640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2815b190 con 0x7f0d280ce1b0 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0d280b1040 0x7f0d280cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54030/0 (socket says 172.21.15.2:54030) 2023-11-04T01:43:55.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 -- 172.21.15.2:0/1368659197 learned_addr learned my addr 172.21.15.2:0/1368659197 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2dbee640 1 --2- 172.21.15.2:0/1368659197 >> v2:172.21.15.90:3300/0 conn(0x7f0d280ce1b0 0x7f0d28159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975631511 0 0) 0x7f0d2815abd0 con 0x7f0d280b1040 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d14003530 con 0x7f0d280b1040 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20733622 0 0) 0x7f0d14003530 con 0x7f0d280b1040 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 >> v2:172.21.15.90:3300/0 conn(0x7f0d280ce1b0 msgr2=0x7f0d28159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 --2- 172.21.15.2:0/1368659197 >> v2:172.21.15.90:3300/0 conn(0x7f0d280ce1b0 0x7f0d28159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 >> v1:172.21.15.90:6789/0 conn(0x7f0d28159c10 legacy=0x7f0d2815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2815d8c0 con 0x7f0d280b1040 2023-11-04T01:43:55.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f0d18001680 con 0x7f0d280b1040 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 >> v1:172.21.15.2:6789/0 conn(0x7f0d280b1040 legacy=0x7f0d280cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d14003980 0x7f0d14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d14005190 0x7f0d1400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2815b190 con 0x7f0d140047d0 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1400c030 con 0x7f0d14003980 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1400c1f0 con 0x7f0d14005190 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 -- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d14005190 msgr2=0x7f0d1400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d14005190 0x7f0d1400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2d3ed640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d14003980 0x7f0d14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 -- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d14003980 msgr2=0x7f0d14003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d14003980 0x7f0d14003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2dbee640 1 -- 172.21.15.2:0/1368659197 reap_dead start 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2cbec640 1 -- 172.21.15.2:0/1368659197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14003530 con 0x7f0d140047d0 2023-11-04T01:43:55.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.632+0000 7f0d2d3ed640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d14003980 0x7f0d14003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2cbec640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d14004c50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c240 tx=0x7f0d1801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3823446fc637d542 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18005ae0 con 0x7f0d140047d0 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d180ab070 con 0x7f0d140047d0 2023-11-04T01:43:55.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d1ffff640 1 -- 172.21.15.2:0/1368659197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18007070 con 0x7f0d140047d0 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 -- 172.21.15.2:0/1368659197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 msgr2=0x7f0d14004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d14004c50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800c240 tx=0x7f0d1801f370 comp rx=0 tx=0).stop 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 -- 172.21.15.2:0/1368659197 shutdown_connections 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 --2- 172.21.15.2:0/1368659197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d14004c50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 -- 172.21.15.2:0/1368659197 >> 172.21.15.2:0/1368659197 conn(0x7f0d280cb510 msgr2=0x7f0d280cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 -- 172.21.15.2:0/1368659197 shutdown_connections 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 -- 172.21.15.2:0/1368659197 wait complete. 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 Processor -- start 2023-11-04T01:43:55.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 -- start start 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d280afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.636+0000 7f0d2f651640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c45a0 0x7f0d281f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2f651640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d281f6260 0x7f0d280c25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2f651640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d281f6cc0 con 0x7f0d140047d0 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2f651640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280b3350 con 0x7f0d280c45a0 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2f651640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d280b2d40 con 0x7f0d281f6260 2023-11-04T01:43:55.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d280afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d280afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33844/0 (socket says 172.21.15.2:33844) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 -- 172.21.15.2:0/4226950546 learned_addr learned my addr 172.21.15.2:0/4226950546 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2dbee640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d281f6260 0x7f0d280c25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2cbec640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c45a0 0x7f0d281f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 -- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d281f6260 msgr2=0x7f0d280c25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d281f6260 0x7f0d280c25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 -- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c45a0 msgr2=0x7f0d281f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c45a0 0x7f0d281f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 -- 172.21.15.2:0/4226950546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d281f6700 con 0x7f0d140047d0 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2d3ed640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d280afea0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0d24007fd0 tx=0x7f0d2400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d1dffb640 1 -- 172.21.15.2:0/4226950546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400b070 con 0x7f0d140047d0 2023-11-04T01:43:55.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d1dffb640 1 -- 172.21.15.2:0/4226950546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24003620 con 0x7f0d140047d0 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d281f69e0 con 0x7f0d140047d0 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d1dffb640 1 -- 172.21.15.2:0/4226950546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24005500 con 0x7f0d140047d0 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d280b03e0 con 0x7f0d140047d0 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d280744a0 con 0x7f0d140047d0 2023-11-04T01:43:55.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d1dffb640 1 -- 172.21.15.2:0/4226950546 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d24003a10 con 0x7f0d140047d0 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d1dffb640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d0c0664a0 0x7f0d0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d1dffb640 1 -- 172.21.15.2:0/4226950546 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d240838e0 con 0x7f0d140047d0 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2cbec640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d0c0664a0 0x7f0d0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.640+0000 7f0d2cbec640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d0c0664a0 0x7f0d0c068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d180af000 tx=0x7f0d180aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.644+0000 7f0d1dffb640 1 -- 172.21.15.2:0/4226950546 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d240510e0 con 0x7f0d140047d0 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.792+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d2806b910 con 0x7f0d140047d0 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.792+0000 7f0d1dffb640 1 -- 172.21.15.2:0/4226950546 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d24054700 con 0x7f0d140047d0 2023-11-04T01:43:55.798 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d0c0664a0 msgr2=0x7f0d0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d0c0664a0 0x7f0d0c068960 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d180af000 tx=0x7f0d180aa000 comp rx=0 tx=0).stop 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 msgr2=0x7f0d280afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d280afea0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0d24007fd0 tx=0x7f0d2400d890 comp rx=0 tx=0).stop 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 shutdown_connections 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d0c0664a0 0x7f0d0c068960 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d281f6260 0x7f0d280c25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c45a0 0x7f0d281f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 --2- 172.21.15.2:0/4226950546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d140047d0 0x7f0d280afea0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 >> 172.21.15.2:0/4226950546 conn(0x7f0d280cb510 msgr2=0x7f0d280716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 shutdown_connections 2023-11-04T01:43:55.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.796+0000 7f0d2f651640 1 -- 172.21.15.2:0/4226950546 wait complete. 2023-11-04T01:43:55.816 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc6d92640 1 Processor -- start 2023-11-04T01:43:55.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc6d92640 1 -- start start 2023-11-04T01:43:55.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc6d92640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5bc015d0b0 0x7f5bc0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc6d92640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5bc01610f0 0x7f5bc00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc6d92640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc00b5e00 con 0x7f5bc00cfd50 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc6d92640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00d1520 con 0x7f5bc01610f0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc6d92640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00d01e0 con 0x7f5bc015d0b0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bbffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5bc01610f0 0x7f5bc00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc532f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5bc00cfd50 0x7f5bc00b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54040/0 (socket says 172.21.15.2:54040) 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc532f640 1 -- 172.21.15.2:0/2422362484 learned_addr learned my addr 172.21.15.2:0/2422362484 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bc4b2e640 1 --2- 172.21.15.2:0/2422362484 >> v2:172.21.15.90:3300/0 conn(0x7f5bc015d0b0 0x7f5bc0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bbf7fe640 1 -- 172.21.15.2:0/2422362484 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336410520 0 0) 0x7f5bc00b5e00 con 0x7f5bc00cfd50 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bbf7fe640 1 -- 172.21.15.2:0/2422362484 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bac003530 con 0x7f5bc00cfd50 2023-11-04T01:43:55.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bbffff640 1 -- 172.21.15.2:0/2422362484 >> v2:172.21.15.90:3300/0 conn(0x7f5bc015d0b0 msgr2=0x7f5bc0160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bbffff640 1 --2- 172.21.15.2:0/2422362484 >> v2:172.21.15.90:3300/0 conn(0x7f5bc015d0b0 0x7f5bc0160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bbffff640 1 -- 172.21.15.2:0/2422362484 >> v1:172.21.15.2:6789/0 conn(0x7f5bc00cfd50 legacy=0x7f5bc00b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.936+0000 7f5bbffff640 1 -- 172.21.15.2:0/2422362484 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc015d490 con 0x7f5bc01610f0 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bbffff640 1 --2- 172.21.15.2:0/2422362484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00cf810 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006b900 tx=0x7f5ba801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cdc23141db8afb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bbf7fe640 1 -- 172.21.15.2:0/2422362484 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80ab660 con 0x7f5bc01610f0 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bbf7fe640 1 -- 172.21.15.2:0/2422362484 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba80ab7c0 con 0x7f5bc01610f0 2023-11-04T01:43:55.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bbf7fe640 1 -- 172.21.15.2:0/2422362484 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80abb50 con 0x7f5bc01610f0 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- 172.21.15.2:0/2422362484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 msgr2=0x7f5bc00cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/2422362484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00cf810 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006b900 tx=0x7f5ba801c460 comp rx=0 tx=0).stop 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- 172.21.15.2:0/2422362484 shutdown_connections 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/2422362484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00cf810 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/2422362484 >> v2:172.21.15.90:3300/0 conn(0x7f5bc015d0b0 0x7f5bc0160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- 172.21.15.2:0/2422362484 >> 172.21.15.2:0/2422362484 conn(0x7f5bc006a890 msgr2=0x7f5bc006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- 172.21.15.2:0/2422362484 shutdown_connections 2023-11-04T01:43:55.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- 172.21.15.2:0/2422362484 wait complete. 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 Processor -- start 2023-11-04T01:43:55.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- start start 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bc00cfd50 0x7f5bc00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5bc015d0b0 0x7f5bc014cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc014bd60 con 0x7f5bc01610f0 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00c9f10 con 0x7f5bc00cfd50 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc6d92640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00cc340 con 0x7f5bc015d0b0 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33860/0 (socket says 172.21.15.2:33860) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 -- 172.21.15.2:0/1995366761 learned_addr learned my addr 172.21.15.2:0/1995366761 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc4b2e640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bc00cfd50 0x7f5bc00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bbffff640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5bc015d0b0 0x7f5bc014cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 -- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5bc015d0b0 msgr2=0x7f5bc014cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5bc015d0b0 0x7f5bc014cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 -- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bc00cfd50 msgr2=0x7f5bc00cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bc00cfd50 0x7f5bc00cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.940+0000 7f5bc532f640 1 -- 172.21.15.2:0/1995366761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8009420 con 0x7f5bc01610f0 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bc4b2e640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bc00cfd50 0x7f5bc00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bc532f640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00b3120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800cb70 tx=0x7f5bb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bbd7fa640 1 -- 172.21.15.2:0/1995366761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800ad40 con 0x7f5bc01610f0 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bbd7fa640 1 -- 172.21.15.2:0/1995366761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8012400 con 0x7f5bc01610f0 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc015e550 con 0x7f5bc01610f0 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bbd7fa640 1 -- 172.21.15.2:0/1995366761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800aea0 con 0x7f5bc01610f0 2023-11-04T01:43:55.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc015eb10 con 0x7f5bc01610f0 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc00744a0 con 0x7f5bc01610f0 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bbd7fa640 1 -- 172.21.15.2:0/1995366761 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5bb8007070 con 0x7f5bc01610f0 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bbd7fa640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ba00664a0 0x7f5ba0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bbd7fa640 1 -- 172.21.15.2:0/1995366761 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5bb8083d90 con 0x7f5bc01610f0 2023-11-04T01:43:55.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bc4b2e640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ba00664a0 0x7f5ba0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.944+0000 7f5bc4b2e640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ba00664a0 0x7f5ba0068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00b4950 tx=0x7f5bb0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:55.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:55.948+0000 7f5bbd7fa640 1 -- 172.21.15.2:0/1995366761 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5bb8051360 con 0x7f5bc01610f0 2023-11-04T01:43:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f5bc00ca050 con 0x7f5bc01610f0 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bbd7fa640 1 -- 172.21.15.2:0/1995366761 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v46) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5bb80170a0 con 0x7f5bc01610f0 2023-11-04T01:43:56.108 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ba00664a0 msgr2=0x7f5ba0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ba00664a0 0x7f5ba0068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5bc00b4950 tx=0x7f5bb0008040 comp rx=0 tx=0).stop 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 msgr2=0x7f5bc00b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00b3120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800cb70 tx=0x7f5bb800a430 comp rx=0 tx=0).stop 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 shutdown_connections 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ba00664a0 0x7f5ba0068960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5bc01610f0 0x7f5bc00b3120 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5bc015d0b0 0x7f5bc014cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 --2- 172.21.15.2:0/1995366761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5bc00cfd50 0x7f5bc00cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 >> 172.21.15.2:0/1995366761 conn(0x7f5bc006a890 msgr2=0x7f5bc01598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 shutdown_connections 2023-11-04T01:43:56.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.104+0000 7f5bc6d92640 1 -- 172.21.15.2:0/1995366761 wait complete. 2023-11-04T01:43:56.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:43:56.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ec481640 1 Processor -- start 2023-11-04T01:43:56.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ec481640 1 -- start start 2023-11-04T01:43:56.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ec481640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 0x7f69e40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ec481640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f69e40ca990 0x7f69e40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ec481640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e40b0fa0 con 0x7f69e40b0b70 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ec481640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e40ca030 con 0x7f69e40ca990 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ec481640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e406cfd0 con 0x7f69e4159fc0 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f69e40b0b70 0x7f69e415dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54048/0 (socket says 172.21.15.2:54048) 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 -- 172.21.15.2:0/1399966875 learned_addr learned my addr 172.21.15.2:0/1399966875 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e9a1c640 1 --2- 172.21.15.2:0/1399966875 >> v2:172.21.15.90:3300/0 conn(0x7f69e40ca990 0x7f69e40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ea21d640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 0x7f69e40ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901372670 0 0) 0x7f69e40b0fa0 con 0x7f69e40b0b70 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d0005740 con 0x7f69e40b0b70 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 658846417 0 0) 0x7f69d0005740 con 0x7f69e40b0b70 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 msgr2=0x7f69e40ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 0x7f69e40ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 >> v2:172.21.15.90:3300/0 conn(0x7f69e40ca990 msgr2=0x7f69e40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 --2- 172.21.15.2:0/1399966875 >> v2:172.21.15.90:3300/0 conn(0x7f69e40ca990 0x7f69e40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e415e830 con 0x7f69e40b0b70 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f69dc001a00 con 0x7f69e40b0b70 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 >> v1:172.21.15.2:6789/0 conn(0x7f69e40b0b70 legacy=0x7f69e415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69d0005b90 0x7f69d0005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 0x7f69d00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69d0006f20 0x7f69d00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40ca030 con 0x7f69d0006f20 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e406cfd0 con 0x7f69d0005b90 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d000dba0 con 0x7f69e4159fc0 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69d0006f20 0x7f69d00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69e9a1c640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 0x7f69d00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69ea21d640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69d0005b90 0x7f69d0005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 -- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 msgr2=0x7f69d00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e4159fc0 0x7f69d00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 -- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69d0005b90 msgr2=0x7f69d0005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69d0005b90 0x7f69d0005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.248+0000 7f69eaa1e640 1 -- 172.21.15.2:0/1399966875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0005740 con 0x7f69d0006f20 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69eaa1e640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69d0006f20 0x7f69d00073a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00a860 tx=0x7f69dc01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cc0f844eee5552 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0ad630 con 0x7f69d0006f20 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc0a8070 con 0x7f69d0006f20 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69e921b640 1 -- 172.21.15.2:0/1399966875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0ad9f0 con 0x7f69d0006f20 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 -- 172.21.15.2:0/1399966875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69d0006f20 msgr2=0x7f69d00073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 --2- 172.21.15.2:0/1399966875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69d0006f20 0x7f69d00073a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00a860 tx=0x7f69dc01d360 comp rx=0 tx=0).stop 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69eaa1e640 1 -- 172.21.15.2:0/1399966875 reap_dead start 2023-11-04T01:43:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 -- 172.21.15.2:0/1399966875 shutdown_connections 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 -- 172.21.15.2:0/1399966875 >> 172.21.15.2:0/1399966875 conn(0x7f69e40cebb0 msgr2=0x7f69e40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 -- 172.21.15.2:0/1399966875 shutdown_connections 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 -- 172.21.15.2:0/1399966875 wait complete. 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 Processor -- start 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.252+0000 7f69ec481640 1 -- start start 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69e414ffc0 0x7f69e415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69e40cc6f0 0x7f69e40ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e40c2220 0x7f69e40c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40cd0b0 con 0x7f69e414ffc0 2023-11-04T01:43:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40c3110 con 0x7f69e40cc6f0 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e415b880 con 0x7f69e40c2220 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69e414ffc0 0x7f69e415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69e414ffc0 0x7f69e415c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33878/0 (socket says 172.21.15.2:33878) 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 -- 172.21.15.2:0/2294101586 learned_addr learned my addr 172.21.15.2:0/2294101586 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69e9a1c640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69e40cc6f0 0x7f69e40ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69eaa1e640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e40c2220 0x7f69e40c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 -- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e40c2220 msgr2=0x7f69e40c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e40c2220 0x7f69e40c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 -- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69e40cc6f0 msgr2=0x7f69e40ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69e40cc6f0 0x7f69e40ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 -- 172.21.15.2:0/2294101586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40c2be0 con 0x7f69e414ffc0 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69eaa1e640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e40c2220 0x7f69e40c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:56.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ea21d640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69e414ffc0 0x7f69e415c5b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f69e0011640 tx=0x7f69e0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69daffd640 1 -- 172.21.15.2:0/2294101586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000f8c0 con 0x7f69e414ffc0 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69daffd640 1 -- 172.21.15.2:0/2294101586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000fa20 con 0x7f69e414ffc0 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4157320 con 0x7f69e414ffc0 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69daffd640 1 -- 172.21.15.2:0/2294101586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000fd90 con 0x7f69e414ffc0 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e40c2e30 con 0x7f69e414ffc0 2023-11-04T01:43:56.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e40744a0 con 0x7f69e414ffc0 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69daffd640 1 -- 172.21.15.2:0/2294101586 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69e0015460 con 0x7f69e414ffc0 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69daffd640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69c80664d0 0x7f69c8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69daffd640 1 -- 172.21.15.2:0/2294101586 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f69e0084520 con 0x7f69e414ffc0 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.256+0000 7f69e9a1c640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69c80664d0 0x7f69c8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.260+0000 7f69e9a1c640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69c80664d0 0x7f69c8068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f69e4156f60 tx=0x7f69d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.260+0000 7f69daffd640 1 -- 172.21.15.2:0/2294101586 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69e0051b90 con 0x7f69e414ffc0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.416+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f69e4070700 con 0x7f69e414ffc0 2023-11-04T01:43:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69daffd640 1 -- 172.21.15.2:0/2294101586 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+137 (secure 0 0 0) 0x7f69e00551b0 con 0x7f69e414ffc0 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 6, 2023-11-04T01:43:56.424 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "snap-test-pool" 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:43:56.425 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69c80664d0 msgr2=0x7f69c8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69c80664d0 0x7f69c8068990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f69e4156f60 tx=0x7f69d4008040 comp rx=0 tx=0).stop 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69e414ffc0 msgr2=0x7f69e415c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69e414ffc0 0x7f69e415c5b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f69e0011640 tx=0x7f69e0011b00 comp rx=0 tx=0).stop 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 shutdown_connections 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69c80664d0 0x7f69c8068990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69e40c2220 0x7f69e40c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69e40cc6f0 0x7f69e40ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 --2- 172.21.15.2:0/2294101586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69e414ffc0 0x7f69e415c5b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 >> 172.21.15.2:0/2294101586 conn(0x7f69e40cebb0 msgr2=0x7f69e40ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 shutdown_connections 2023-11-04T01:43:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.420+0000 7f69ec481640 1 -- 172.21.15.2:0/2294101586 wait complete. 2023-11-04T01:43:56.442 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:43:56.442 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec3aae640 1 Processor -- start 2023-11-04T01:43:56.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec3aae640 1 -- start start 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec3aae640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbebc06b980 0x7fbebc162a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec3aae640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc06d2d0 con 0x7fbebc0c4240 2023-11-04T01:43:56.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec3aae640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc0cecd0 con 0x7fbebc162fe0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec3aae640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc0c4620 con 0x7fbebc06b980 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec184a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbebc0c4240 0x7fbebc0d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54064/0 (socket says 172.21.15.2:54064) 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec184a640 1 -- 172.21.15.2:0/3239303123 learned_addr learned my addr 172.21.15.2:0/3239303123 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec204b640 1 --2- 172.21.15.2:0/3239303123 >> v2:172.21.15.90:3300/0 conn(0x7fbebc06b980 0x7fbebc162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567865281 0 0) 0x7fbebc06d2d0 con 0x7fbebc0c4240 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbea8003530 con 0x7fbebc0c4240 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591220566 0 0) 0x7fbea8003530 con 0x7fbebc0c4240 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 >> v2:172.21.15.90:3300/0 conn(0x7fbebc06b980 msgr2=0x7fbebc162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 --2- 172.21.15.2:0/3239303123 >> v2:172.21.15.90:3300/0 conn(0x7fbebc06b980 0x7fbebc162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 >> v1:172.21.15.90:6789/0 conn(0x7fbebc162fe0 legacy=0x7fbebc06b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc06cd10 con 0x7fbebc0c4240 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fbeb4001a00 con 0x7fbebc0c4240 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 >> v1:172.21.15.2:6789/0 conn(0x7fbebc0c4240 legacy=0x7fbebc0d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbea8003980 0x7fbea8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea80047d0 0x7fbea8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea8005190 0x7fbea800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0c4620 con 0x7fbea8005190 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea800c090 con 0x7fbea80047d0 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea800c250 con 0x7fbea8003980 2023-11-04T01:43:56.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec204b640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea8005190 0x7fbea800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec184a640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbea8003980 0x7fbea8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec204b640 1 -- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbea8003980 msgr2=0x7fbea8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec1049640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea80047d0 0x7fbea8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec204b640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbea8003980 0x7fbea8003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec204b640 1 -- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea80047d0 msgr2=0x7fbea8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec204b640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea80047d0 0x7fbea8004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.556+0000 7fbec204b640 1 -- 172.21.15.2:0/3239303123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc06cd10 con 0x7fbea8005190 2023-11-04T01:43:56.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec204b640 1 -- 172.21.15.2:0/3239303123 reap_dead start 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec204b640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea8005190 0x7fbea800b990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbebc06c430 tx=0x7fbeb801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f376a6fe97c44cef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8004020 con 0x7fbea8005190 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb8004180 con 0x7fbea8005190 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec0848640 1 -- 172.21.15.2:0/3239303123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8003620 con 0x7fbea8005190 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 -- 172.21.15.2:0/3239303123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea8005190 msgr2=0x7fbea800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea8005190 0x7fbea800b990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbebc06c430 tx=0x7fbeb801ca30 comp rx=0 tx=0).stop 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 -- 172.21.15.2:0/3239303123 shutdown_connections 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3239303123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbea8005190 0x7fbea800b990 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 -- 172.21.15.2:0/3239303123 >> 172.21.15.2:0/3239303123 conn(0x7fbebc06dc90 msgr2=0x7fbebc06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 -- 172.21.15.2:0/3239303123 shutdown_connections 2023-11-04T01:43:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 -- 172.21.15.2:0/3239303123 wait complete. 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 Processor -- start 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.560+0000 7fbec3aae640 1 -- start start 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea8005190 0x7fbebc1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbebc0c71c0 0x7fbebc159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbebc0c4dc0 0x7fbebc0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0c5c20 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc0c57b0 con 0x7fbea8005190 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc15a890 con 0x7fbebc0c71c0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbebc0c4dc0 0x7fbebc0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbebc0c4dc0 0x7fbebc0c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33898/0 (socket says 172.21.15.2:33898) 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 -- 172.21.15.2:0/3973388596 learned_addr learned my addr 172.21.15.2:0/3973388596 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec184a640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea8005190 0x7fbebc1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec1049640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbebc0c71c0 0x7fbebc159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 -- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbebc0c71c0 msgr2=0x7fbebc159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbebc0c71c0 0x7fbebc159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 -- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea8005190 msgr2=0x7fbebc1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea8005190 0x7fbebc1542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 -- 172.21.15.2:0/3973388596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc15ab70 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec204b640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbebc0c4dc0 0x7fbebc0c5270 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbeb801c860 tx=0x7fbea8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbeb27fc640 1 -- 172.21.15.2:0/3973388596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8004020 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbeb27fc640 1 -- 172.21.15.2:0/3973388596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb80042f0 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc15ae50 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbeb27fc640 1 -- 172.21.15.2:0/3973388596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80a5c20 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc15b410 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc15b600 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbeb27fc640 1 -- 172.21.15.2:0/3973388596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbeb8003620 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbeb27fc640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbea00664a0 0x7fbea0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbeb27fc640 1 -- 172.21.15.2:0/3973388596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbeb811d460 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.564+0000 7fbec184a640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbea00664a0 0x7fbea0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.568+0000 7fbec184a640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbea00664a0 0x7fbea0068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4000f90 tx=0x7fbeb40018a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:56.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.568+0000 7fbeb27fc640 1 -- 172.21.15.2:0/3973388596 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbeb80eab60 con 0x7fbebc0c4dc0 2023-11-04T01:43:56.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:56.716+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbebc0675f0 con 0x7fbebc0c4dc0 2023-11-04T01:43:57.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.480+0000 7fbeb27fc640 1 -- 172.21.15.2:0/3973388596 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbeb80ee180 con 0x7fbebc0c4dc0 2023-11-04T01:43:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbea00664a0 msgr2=0x7fbea0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbea00664a0 0x7fbea0068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4000f90 tx=0x7fbeb40018a0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbebc0c4dc0 msgr2=0x7fbebc0c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbebc0c4dc0 0x7fbebc0c5270 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbeb801c860 tx=0x7fbea8005800 comp rx=0 tx=0).stop 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 shutdown_connections 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbea00664a0 0x7fbea0068960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbebc0c4dc0 0x7fbebc0c5270 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbebc0c71c0 0x7fbebc159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 --2- 172.21.15.2:0/3973388596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbea8005190 0x7fbebc1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 >> 172.21.15.2:0/3973388596 conn(0x7fbebc06dc90 msgr2=0x7fbebc0ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 shutdown_connections 2023-11-04T01:43:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.484+0000 7fbec3aae640 1 -- 172.21.15.2:0/3973388596 wait complete. 2023-11-04T01:43:57.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.648+0000 7f9f75670640 1 Processor -- start 2023-11-04T01:43:57.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.648+0000 7f9f75670640 1 -- start start 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f75670640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f7015e760 0x7f9f70065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f75670640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f700b0c60 0x7f9f700ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f75670640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700ac1b0 con 0x7f9f700ae930 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f75670640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7006aff0 con 0x7f9f7015e760 2023-11-04T01:43:57.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f75670640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b0870 con 0x7f9f700b0c60 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f7015e760 0x7f9f70065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f7015e760 0x7f9f70065dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33904/0 (socket says 172.21.15.2:33904) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6effd640 1 -- 172.21.15.2:0/3355354428 learned_addr learned my addr 172.21.15.2:0/3355354428 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6e7fc640 1 --2- 172.21.15.2:0/3355354428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f700b0c60 0x7f9f700ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6effd640 1 -- 172.21.15.2:0/3355354428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f700b0c60 msgr2=0x7f9f700ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6effd640 1 --2- 172.21.15.2:0/3355354428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f700b0c60 0x7f9f700ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6effd640 1 -- 172.21.15.2:0/3355354428 >> v1:172.21.15.90:6789/0 conn(0x7f9f700ae930 legacy=0x7f9f70071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:57.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.652+0000 7f9f6effd640 1 -- 172.21.15.2:0/3355354428 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700727b0 con 0x7f9f7015e760 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f6effd640 1 --2- 172.21.15.2:0/3355354428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f7015e760 0x7f9f70065dc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009870 tx=0x7f9f6401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e914215bace7382a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f6dffb640 1 -- 172.21.15.2:0/3355354428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640ab600 con 0x7f9f7015e760 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f6dffb640 1 -- 172.21.15.2:0/3355354428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f640a7050 con 0x7f9f7015e760 2023-11-04T01:43:57.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f6dffb640 1 -- 172.21.15.2:0/3355354428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640ab980 con 0x7f9f7015e760 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 -- 172.21.15.2:0/3355354428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f7015e760 msgr2=0x7f9f70065dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 --2- 172.21.15.2:0/3355354428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f7015e760 0x7f9f70065dc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009870 tx=0x7f9f6401c4b0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 -- 172.21.15.2:0/3355354428 shutdown_connections 2023-11-04T01:43:57.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 --2- 172.21.15.2:0/3355354428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f700b0c60 0x7f9f700ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 --2- 172.21.15.2:0/3355354428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f7015e760 0x7f9f70065dc0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 -- 172.21.15.2:0/3355354428 >> 172.21.15.2:0/3355354428 conn(0x7f9f700cf560 msgr2=0x7f9f700cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 -- 172.21.15.2:0/3355354428 shutdown_connections 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 -- 172.21.15.2:0/3355354428 wait complete. 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 Processor -- start 2023-11-04T01:43:57.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.656+0000 7f9f75670640 1 -- start start 2023-11-04T01:43:57.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f700ae930 0x7f9f70155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f7015e760 0x7f9f70159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f7015a390 0x7f9f70099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7015ba90 con 0x7f9f700ae930 2023-11-04T01:43:57.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70158df0 con 0x7f9f7015e760 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70156180 con 0x7f9f7015a390 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f700ae930 0x7f9f70155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f700ae930 0x7f9f70155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33918/0 (socket says 172.21.15.2:33918) 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 -- 172.21.15.2:0/817451360 learned_addr learned my addr 172.21.15.2:0/817451360 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6e7fc640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f7015e760 0x7f9f70159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6f7fe640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f7015a390 0x7f9f70099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:57.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 -- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f7015a390 msgr2=0x7f9f70099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f7015a390 0x7f9f70099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 -- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f7015e760 msgr2=0x7f9f70159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f7015e760 0x7f9f70159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 -- 172.21.15.2:0/817451360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f640094d0 con 0x7f9f700ae930 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6f7fe640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f7015a390 0x7f9f70099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f6effd640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f700ae930 0x7f9f70155c40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ae040 tx=0x7f9f6401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f577fe640 1 -- 172.21.15.2:0/817451360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b6420 con 0x7f9f700ae930 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f577fe640 1 -- 172.21.15.2:0/817451360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f640b6580 con 0x7f9f700ae930 2023-11-04T01:43:57.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f577fe640 1 -- 172.21.15.2:0/817451360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b6910 con 0x7f9f700ae930 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f70159090 con 0x7f9f700ae930 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f70159650 con 0x7f9f700ae930 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f700675f0 con 0x7f9f700ae930 2023-11-04T01:43:57.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.660+0000 7f9f577fe640 1 -- 172.21.15.2:0/817451360 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f640b2040 con 0x7f9f700ae930 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.664+0000 7f9f577fe640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f5c0664a0 0x7f9f5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.664+0000 7f9f577fe640 1 -- 172.21.15.2:0/817451360 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f9f6411e470 con 0x7f9f700ae930 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.664+0000 7f9f6e7fc640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f5c0664a0 0x7f9f5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:57.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.664+0000 7f9f6e7fc640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f5c0664a0 0x7f9f5c068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9f7006aaa0 tx=0x7f9f60008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:57.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.668+0000 7f9f577fe640 1 -- 172.21.15.2:0/817451360 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f640eba50 con 0x7f9f700ae930 2023-11-04T01:43:57.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:57.824+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f700cf340 con 0x7f9f700ae930 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.484+0000 7f9f577fe640 1 -- 172.21.15.2:0/817451360 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f640ef070 con 0x7f9f700ae930 2023-11-04T01:43:58.491 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f5c0664a0 msgr2=0x7f9f5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f5c0664a0 0x7f9f5c068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9f7006aaa0 tx=0x7f9f60008040 comp rx=0 tx=0).stop 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f700ae930 msgr2=0x7f9f70155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f700ae930 0x7f9f70155c40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ae040 tx=0x7f9f6401acf0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 shutdown_connections 2023-11-04T01:43:58.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f5c0664a0 0x7f9f5c068960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f7015a390 0x7f9f70099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f7015e760 0x7f9f70159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 --2- 172.21.15.2:0/817451360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f700ae930 0x7f9f70155c40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 >> 172.21.15.2:0/817451360 conn(0x7f9f700cf560 msgr2=0x7f9f7015c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 shutdown_connections 2023-11-04T01:43:58.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.488+0000 7f9f75670640 1 -- 172.21.15.2:0/817451360 wait complete. 2023-11-04T01:43:58.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d54e67640 1 Processor -- start 2023-11-04T01:43:58.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d54e67640 1 -- start start 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d54e67640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 0x7f1d5015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d54e67640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5006c0c0 con 0x7f1d5015af70 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d54e67640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5006c3a0 con 0x7f1d5006d160 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d54e67640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d50071200 con 0x7f1d500ce1b0 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4e59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1d5015af70 0x7f1d500cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54068/0 (socket says 172.21.15.2:54068) 2023-11-04T01:43:58.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4e59c640 1 -- 172.21.15.2:0/3158626841 learned_addr learned my addr 172.21.15.2:0/3158626841 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4dd9b640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 0x7f1d5015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699585566 0 0) 0x7f1d5006c0c0 con 0x7f1d5015af70 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d38003530 con 0x7f1d5015af70 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173488516 0 0) 0x7f1d38003530 con 0x7f1d5015af70 2023-11-04T01:43:58.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 msgr2=0x7f1d5015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 0x7f1d5015dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 >> v1:172.21.15.90:6789/0 conn(0x7f1d5006d160 legacy=0x7f1d5015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5006c680 con 0x7f1d5015af70 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f1d40001680 con 0x7f1d5015af70 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 >> v1:172.21.15.2:6789/0 conn(0x7f1d5015af70 legacy=0x7f1d500cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 0x7f1d380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d38003f30 0x7f1d380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d38004d10 0x7f1d38005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d50071200 con 0x7f1d38004d10 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3800dc80 con 0x7f1d38003f30 2023-11-04T01:43:58.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3800de40 con 0x7f1d500ce1b0 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4ed9d640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d38004d10 0x7f1d38005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4e59c640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 0x7f1d380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4dd9b640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d38003f30 0x7f1d380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4ed9d640 1 -- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 msgr2=0x7f1d380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4ed9d640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d500ce1b0 0x7f1d380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4ed9d640 1 -- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d38003f30 msgr2=0x7f1d380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4ed9d640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d38003f30 0x7f1d380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.648+0000 7f1d4ed9d640 1 -- 172.21.15.2:0/3158626841 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38003530 con 0x7f1d38004d10 2023-11-04T01:43:58.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d4ed9d640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d38004d10 0x7f1d38005190 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1d500c5b10 tx=0x7f1d4801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566ae0afabe0621e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48003b80 con 0x7f1d38004d10 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48003ce0 con 0x7f1d38004d10 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d4d59a640 1 -- 172.21.15.2:0/3158626841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48005310 con 0x7f1d38004d10 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 -- 172.21.15.2:0/3158626841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d38004d10 msgr2=0x7f1d38005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 --2- 172.21.15.2:0/3158626841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d38004d10 0x7f1d38005190 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1d500c5b10 tx=0x7f1d4801c700 comp rx=0 tx=0).stop 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d4ed9d640 1 -- 172.21.15.2:0/3158626841 reap_dead start 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 -- 172.21.15.2:0/3158626841 shutdown_connections 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 -- 172.21.15.2:0/3158626841 >> 172.21.15.2:0/3158626841 conn(0x7f1d500cb510 msgr2=0x7f1d500cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 -- 172.21.15.2:0/3158626841 shutdown_connections 2023-11-04T01:43:58.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 -- 172.21.15.2:0/3158626841 wait complete. 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 Processor -- start 2023-11-04T01:43:58.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.652+0000 7f1d54e67640 1 -- start start 2023-11-04T01:43:58.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d38004d10 0x7f1d500c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d500a84b0 0x7f1d501593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d501598f0 0x7f1d500aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500c7b40 con 0x7f1d500a84b0 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d50159d70 con 0x7f1d501598f0 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500c6f50 con 0x7f1d38004d10 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d500a84b0 0x7f1d501593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d500a84b0 0x7f1d501593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33940/0 (socket says 172.21.15.2:33940) 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 -- 172.21.15.2:0/4077843077 learned_addr learned my addr 172.21.15.2:0/4077843077 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4e59c640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d38004d10 0x7f1d500c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4ed9d640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d501598f0 0x7f1d500aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 -- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d38004d10 msgr2=0x7f1d500c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d38004d10 0x7f1d500c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 -- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d501598f0 msgr2=0x7f1d500aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d501598f0 0x7f1d500aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 -- 172.21.15.2:0/4077843077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500c7210 con 0x7f1d500a84b0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4dd9b640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d500a84b0 0x7f1d501593b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1d44011610 tx=0x7f1d44011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d3effd640 1 -- 172.21.15.2:0/4077843077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400f8f0 con 0x7f1d500a84b0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d3effd640 1 -- 172.21.15.2:0/4077843077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4400fa50 con 0x7f1d500a84b0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d500c74f0 con 0x7f1d500a84b0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d3effd640 1 -- 172.21.15.2:0/4077843077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400fdc0 con 0x7f1d500a84b0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d500c5310 con 0x7f1d500a84b0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d500c7cf0 con 0x7f1d500a84b0 2023-11-04T01:43:58.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d3effd640 1 -- 172.21.15.2:0/4077843077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d44015460 con 0x7f1d500a84b0 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d3effd640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1d300664a0 0x7f1d30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d3effd640 1 -- 172.21.15.2:0/4077843077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f1d44084790 con 0x7f1d500a84b0 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.656+0000 7f1d4e59c640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1d300664a0 0x7f1d30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:58.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.660+0000 7f1d4e59c640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1d300664a0 0x7f1d30068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d40001ca0 tx=0x7f1d40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:58.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.664+0000 7f1d3effd640 1 -- 172.21.15.2:0/4077843077 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1d500c7cf0 con 0x7f1d500a84b0 2023-11-04T01:43:58.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:58.852+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1d500744a0 con 0x7f1d500a84b0 2023-11-04T01:43:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.584+0000 7f1d3effd640 1 -- 172.21.15.2:0/4077843077 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v18) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1d44051ba0 con 0x7f1d500a84b0 2023-11-04T01:43:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 7 and data pool 8 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1d300664a0 msgr2=0x7f1d30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1d300664a0 0x7f1d30068960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1d40001ca0 tx=0x7f1d40009040 comp rx=0 tx=0).stop 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d500a84b0 msgr2=0x7f1d501593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d500a84b0 0x7f1d501593b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1d44011610 tx=0x7f1d44011ad0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 shutdown_connections 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1d300664a0 0x7f1d30068960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d501598f0 0x7f1d500aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d500a84b0 0x7f1d501593b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 --2- 172.21.15.2:0/4077843077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1d38004d10 0x7f1d500c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 >> 172.21.15.2:0/4077843077 conn(0x7f1d500cb510 msgr2=0x7f1d500ca2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 shutdown_connections 2023-11-04T01:43:59.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.588+0000 7f1d54e67640 1 -- 172.21.15.2:0/4077843077 wait complete. 2023-11-04T01:43:59.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa171d70640 1 Processor -- start 2023-11-04T01:43:59.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa171d70640 1 -- start start 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa171d70640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 0x7fa16c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa171d70640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c0c2670 con 0x7fa16c0b0d40 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa171d70640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c06bc30 con 0x7fa16c06f8f0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa171d70640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c070140 con 0x7fa16c15afd0 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa16c0b0d40 0x7fa16c15ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54078/0 (socket says 172.21.15.2:54078) 2023-11-04T01:43:59.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16bfff640 1 -- 172.21.15.2:0/2653918816 learned_addr learned my addr 172.21.15.2:0/2653918816 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16b7fe640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 0x7fa16c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031925535 0 0) 0x7fa16c0c2670 con 0x7fa16c0b0d40 2023-11-04T01:43:59.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa154003530 con 0x7fa16c0b0d40 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2797345061 0 0) 0x7fa154003530 con 0x7fa16c0b0d40 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 msgr2=0x7fa16c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 0x7fa16c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 >> v1:172.21.15.90:6789/0 conn(0x7fa16c06f8f0 legacy=0x7fa16c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c06bf10 con 0x7fa16c0b0d40 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa164001a00 con 0x7fa16c0b0d40 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 >> v1:172.21.15.2:6789/0 conn(0x7fa16c0b0d40 legacy=0x7fa16c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 0x7fa1540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa1540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa154004d10 0x7fa154005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c070140 con 0x7fa154003f30 2023-11-04T01:43:59.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15400ba70 con 0x7fa154004d10 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15400bc30 con 0x7fa16c15afd0 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16affd640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa1540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16b7fe640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 0x7fa1540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16bfff640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa154004d10 0x7fa154005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16affd640 1 -- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 msgr2=0x7fa1540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16affd640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c15afd0 0x7fa1540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16affd640 1 -- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa154004d10 msgr2=0x7fa154005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16affd640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa154004d10 0x7fa154005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16affd640 1 -- 172.21.15.2:0/2653918816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa154003530 con 0x7fa154003f30 2023-11-04T01:43:59.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.732+0000 7fa16bfff640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa154004d10 0x7fa154005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa16affd640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa1540047d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa160001780 tx=0x7fa16001c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a053cd2bba3942b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600052d0 con 0x7fa154003f30 2023-11-04T01:43:59.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1600a7050 con 0x7fa154003f30 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa16a7fc640 1 -- 172.21.15.2:0/2653918816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160003600 con 0x7fa154003f30 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 -- 172.21.15.2:0/2653918816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 msgr2=0x7fa1540047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 --2- 172.21.15.2:0/2653918816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa1540047d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa160001780 tx=0x7fa16001c220 comp rx=0 tx=0).stop 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa16bfff640 1 -- 172.21.15.2:0/2653918816 reap_dead start 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 -- 172.21.15.2:0/2653918816 shutdown_connections 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 -- 172.21.15.2:0/2653918816 >> 172.21.15.2:0/2653918816 conn(0x7fa16c0cebb0 msgr2=0x7fa16c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 -- 172.21.15.2:0/2653918816 shutdown_connections 2023-11-04T01:43:59.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 -- 172.21.15.2:0/2653918816 wait complete. 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 Processor -- start 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.736+0000 7fa171d70640 1 -- start start 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa16c1f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c152ef0 0x7fa16c150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c153370 0x7fa16c1edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0b2820 con 0x7fa154003f30 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0c9df0 con 0x7fa16c152ef0 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c1508a0 con 0x7fa16c153370 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa16c1f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa16c1f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33966/0 (socket says 172.21.15.2:33966) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 -- 172.21.15.2:0/1667145546 learned_addr learned my addr 172.21.15.2:0/1667145546 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16affd640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c152ef0 0x7fa16c150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16bfff640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c153370 0x7fa16c1edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 -- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c153370 msgr2=0x7fa16c1edbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c153370 0x7fa16c1edbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 -- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c152ef0 msgr2=0x7fa16c150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c152ef0 0x7fa16c150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 -- 172.21.15.2:0/1667145546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c153820 con 0x7fa154003f30 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16bfff640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c153370 0x7fa16c1edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16b7fe640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa16c1f0b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa15c011a00 tx=0x7fa15c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa153fff640 1 -- 172.21.15.2:0/1667145546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00fb50 con 0x7fa154003f30 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa153fff640 1 -- 172.21.15.2:0/1667145546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c00fcb0 con 0x7fa154003f30 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c153b00 con 0x7fa154003f30 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa153fff640 1 -- 172.21.15.2:0/1667145546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c014440 con 0x7fa154003f30 2023-11-04T01:43:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c0ca000 con 0x7fa154003f30 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c068310 con 0x7fa154003f30 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa153fff640 1 -- 172.21.15.2:0/1667145546 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa15c0145a0 con 0x7fa154003f30 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa153fff640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1580664a0 0x7fa158068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa153fff640 1 -- 172.21.15.2:0/1667145546 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa15c084900 con 0x7fa154003f30 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.740+0000 7fa16affd640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1580664a0 0x7fa158068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:43:59.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.744+0000 7fa16affd640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1580664a0 0x7fa158068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa160001750 tx=0x7fa1600011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:43:59.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.744+0000 7fa153fff640 1 -- 172.21.15.2:0/1667145546 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa15c051ce0 con 0x7fa154003f30 2023-11-04T01:43:59.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.904+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa16c0744a0 con 0x7fa154003f30 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.904+0000 7fa153fff640 1 -- 172.21.15.2:0/1667145546 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18163 (secure 0 0 0) 0x7fa15c055300 con 0x7fa154003f30 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:43:59.910 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:58.858374+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:56.762181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:57.868403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1580664a0 msgr2=0x7fa158068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1580664a0 0x7fa158068960 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa160001750 tx=0x7fa1600011a0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 msgr2=0x7fa16c1f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa16c1f0b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa15c011a00 tx=0x7fa15c011ec0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 shutdown_connections 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1580664a0 0x7fa158068960 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa16c153370 0x7fa16c1edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa16c152ef0 0x7fa16c150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 --2- 172.21.15.2:0/1667145546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa154003f30 0x7fa16c1f0b00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 >> 172.21.15.2:0/1667145546 conn(0x7fa16c0cebb0 msgr2=0x7fa16c0c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 shutdown_connections 2023-11-04T01:43:59.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:43:59.908+0000 7fa171d70640 1 -- 172.21.15.2:0/1667145546 wait complete. 2023-11-04T01:43:59.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f25172dc640 1 Processor -- start 2023-11-04T01:44:00.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f25172dc640 1 -- start start 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f25172dc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f25100d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f25172dc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25100cdf00 0x7f251015b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f25172dc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251015fa20 con 0x7f25100cfe80 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f25172dc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25100d0ca0 con 0x7f25100cdf00 2023-11-04T01:44:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f25172dc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251006daf0 con 0x7f251015b050 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515879640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25100cdf00 0x7f251015b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515078640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f25100d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515078640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f25100d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:55134/0 (socket says 172.21.15.2:55134) 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2514877640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f25100cfe80 0x7f25100cd7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:45412/0 (socket says 172.21.15.2:45412) 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515078640 1 -- 172.21.15.2:0/4033430200 learned_addr learned my addr 172.21.15.2:0/4033430200 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:00.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515879640 1 -- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 msgr2=0x7f25100d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515879640 1 --2- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f25100d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515879640 1 -- 172.21.15.2:0/4033430200 >> v1:172.21.15.90:6789/0 conn(0x7f25100cfe80 legacy=0x7f25100cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515879640 1 -- 172.21.15.2:0/4033430200 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251015ec60 con 0x7f25100cdf00 2023-11-04T01:44:00.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.044+0000 7f2515078640 1 --2- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f25100d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f2515879640 1 --2- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cdf00 0x7f251015b430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2508009d90 tx=0x7f250801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d96a0fba224893 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f2507fff640 1 -- 172.21.15.2:0/4033430200 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25080a5950 con 0x7f25100cdf00 2023-11-04T01:44:00.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f2507fff640 1 -- 172.21.15.2:0/4033430200 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25080a5ab0 con 0x7f25100cdf00 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f2507fff640 1 -- 172.21.15.2:0/4033430200 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25080a5e40 con 0x7f25100cdf00 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 -- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cdf00 msgr2=0x7f251015b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 --2- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cdf00 0x7f251015b430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2508009d90 tx=0x7f250801c890 comp rx=0 tx=0).stop 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 -- 172.21.15.2:0/4033430200 shutdown_connections 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 --2- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cdf00 0x7f251015b430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 --2- 172.21.15.2:0/4033430200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f25100d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 -- 172.21.15.2:0/4033430200 >> 172.21.15.2:0/4033430200 conn(0x7f25100b28f0 msgr2=0x7f25100b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 -- 172.21.15.2:0/4033430200 shutdown_connections 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 -- 172.21.15.2:0/4033430200 wait complete. 2023-11-04T01:44:00.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 Processor -- start 2023-11-04T01:44:00.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.048+0000 7f25172dc640 1 -- start start 2023-11-04T01:44:00.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25100cdf00 0x7f25101557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cfe80 0x7f2510164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f2510164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251006b3a0 con 0x7f25100cdf00 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251006b680 con 0x7f25100cfe80 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251006b960 con 0x7f251015b050 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25100cdf00 0x7f25101557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25100cdf00 0x7f25101557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33976/0 (socket says 172.21.15.2:33976) 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 -- 172.21.15.2:0/1573014935 learned_addr learned my addr 172.21.15.2:0/1573014935 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2514877640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cfe80 0x7f2510164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515879640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f2510164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 -- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 msgr2=0x7f2510164540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f2510164540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 -- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cfe80 msgr2=0x7f2510164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cfe80 0x7f2510164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 -- 172.21.15.2:0/1573014935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c0094d0 con 0x7f25100cdf00 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515879640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f2510164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2515078640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25100cdf00 0x7f25101557c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f250c00e930 tx=0x7f250c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2505ffb640 1 -- 172.21.15.2:0/1573014935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00ca00 con 0x7f25100cdf00 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2505ffb640 1 -- 172.21.15.2:0/1573014935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00cb60 con 0x7f25100cdf00 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2508009a70 con 0x7f25100cdf00 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2505ffb640 1 -- 172.21.15.2:0/1573014935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c013470 con 0x7f25100cdf00 2023-11-04T01:44:00.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251006bf20 con 0x7f25100cdf00 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251015df10 con 0x7f25100cdf00 2023-11-04T01:44:00.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2505ffb640 1 -- 172.21.15.2:0/1573014935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f250c0135d0 con 0x7f25100cdf00 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2505ffb640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24f40664a0 0x7f24f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2505ffb640 1 -- 172.21.15.2:0/1573014935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f250c0841e0 con 0x7f25100cdf00 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.052+0000 7f2514877640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24f40664a0 0x7f24f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.056+0000 7f2514877640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24f40664a0 0x7f24f4068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f251015cd60 tx=0x7f2500007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.056+0000 7f2505ffb640 1 -- 172.21.15.2:0/1573014935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f250c051590 con 0x7f25100cdf00 2023-11-04T01:44:00.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.216+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25100ce5a0 con 0x7f25100cdf00 2023-11-04T01:44:00.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f2505ffb640 1 -- 172.21.15.2:0/1573014935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18163 (secure 0 0 0) 0x7f250c054bb0 con 0x7f25100cdf00 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:00.224 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:43:58.858374+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:56.762181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:57.868403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24f40664a0 msgr2=0x7f24f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24f40664a0 0x7f24f4068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f251015cd60 tx=0x7f2500007c90 comp rx=0 tx=0).stop 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25100cdf00 msgr2=0x7f25101557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25100cdf00 0x7f25101557c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f250c00e930 tx=0x7f250c00edf0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 shutdown_connections 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24f40664a0 0x7f24f4068960 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f251015b050 0x7f2510164540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25100cfe80 0x7f2510164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 --2- 172.21.15.2:0/1573014935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25100cdf00 0x7f25101557c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 >> 172.21.15.2:0/1573014935 conn(0x7f25100b28f0 msgr2=0x7f25100b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 shutdown_connections 2023-11-04T01:44:00.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.220+0000 7f25172dc640 1 -- 172.21.15.2:0/1573014935 wait complete. 2023-11-04T01:44:00.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbac5426640 1 Processor -- start 2023-11-04T01:44:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbac5426640 1 -- start start 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbac5426640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbac006de30 0x7fbac00719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbac5426640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbac0071250 0x7fbac00b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbac5426640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac00b3c10 con 0x7fbac0159f00 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbac5426640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00cdb70 con 0x7fbac006de30 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbac5426640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00cde50 con 0x7fbac0071250 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabe7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbac006de30 0x7fbac00719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabe7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbac006de30 0x7fbac00719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33982/0 (socket says 172.21.15.2:33982) 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabe7fc640 1 -- 172.21.15.2:0/1564919983 learned_addr learned my addr 172.21.15.2:0/1564919983 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:00.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabf7fe640 1 --2- 172.21.15.2:0/1564919983 >> v2:172.21.15.90:3300/0 conn(0x7fbac0071250 0x7fbac00b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabe7fc640 1 -- 172.21.15.2:0/1564919983 >> v2:172.21.15.90:3300/0 conn(0x7fbac0071250 msgr2=0x7fbac00b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabe7fc640 1 --2- 172.21.15.2:0/1564919983 >> v2:172.21.15.90:3300/0 conn(0x7fbac0071250 0x7fbac00b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabe7fc640 1 -- 172.21.15.2:0/1564919983 >> v1:172.21.15.90:6789/0 conn(0x7fbac0159f00 legacy=0x7fbac0070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabe7fc640 1 -- 172.21.15.2:0/1564919983 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac015a2e0 con 0x7fbac006de30 2023-11-04T01:44:00.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.364+0000 7fbabf7fe640 1 --2- 172.21.15.2:0/1564919983 >> v2:172.21.15.90:3300/0 conn(0x7fbac0071250 0x7fbac00b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:00.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbabe7fc640 1 --2- 172.21.15.2:0/1564919983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006de30 0x7fbac00719e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbac006eb10 tx=0x7fbaa801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5b967750796641 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbabdffb640 1 -- 172.21.15.2:0/1564919983 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80ab640 con 0x7fbac006de30 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbabdffb640 1 -- 172.21.15.2:0/1564919983 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa80a7070 con 0x7fbac006de30 2023-11-04T01:44:00.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbabdffb640 1 -- 172.21.15.2:0/1564919983 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80ab9c0 con 0x7fbac006de30 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 -- 172.21.15.2:0/1564919983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006de30 msgr2=0x7fbac00719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 --2- 172.21.15.2:0/1564919983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006de30 0x7fbac00719e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fbac006eb10 tx=0x7fbaa801c440 comp rx=0 tx=0).stop 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 -- 172.21.15.2:0/1564919983 shutdown_connections 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 --2- 172.21.15.2:0/1564919983 >> v2:172.21.15.90:3300/0 conn(0x7fbac0071250 0x7fbac00b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 --2- 172.21.15.2:0/1564919983 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac006de30 0x7fbac00719e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 -- 172.21.15.2:0/1564919983 >> 172.21.15.2:0/1564919983 conn(0x7fbac00cfc70 msgr2=0x7fbac00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 -- 172.21.15.2:0/1564919983 shutdown_connections 2023-11-04T01:44:00.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 -- 172.21.15.2:0/1564919983 wait complete. 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 Processor -- start 2023-11-04T01:44:00.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.368+0000 7fbac5426640 1 -- start start 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0071250 0x7fbac013b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac0159f00 0x7fbac01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac0155430 0x7fbac00af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0138700 con 0x7fbac0155430 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0155d20 con 0x7fbac0071250 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0156000 con 0x7fbac0159f00 2023-11-04T01:44:00.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac0155430 0x7fbac00af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac0155430 0x7fbac00af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33992/0 (socket says 172.21.15.2:33992) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 -- 172.21.15.2:0/3645020539 learned_addr learned my addr 172.21.15.2:0/3645020539 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabeffd640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0071250 0x7fbac013b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabe7fc640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac0159f00 0x7fbac01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 -- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac0159f00 msgr2=0x7fbac01381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac0159f00 0x7fbac01381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 -- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0071250 msgr2=0x7fbac013b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0071250 0x7fbac013b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 -- 172.21.15.2:0/3645020539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa80094d0 con 0x7fbac0155430 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbabf7fe640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac0155430 0x7fbac00af8f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbab000e7e0 tx=0x7fbab000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbab77fe640 1 -- 172.21.15.2:0/3645020539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab000c6d0 con 0x7fbac0155430 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbab77fe640 1 -- 172.21.15.2:0/3645020539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab000c850 con 0x7fbac0155430 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbab77fe640 1 -- 172.21.15.2:0/3645020539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab000cc00 con 0x7fbac0155430 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac01562e0 con 0x7fbac0155430 2023-11-04T01:44:00.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac01568a0 con 0x7fbac0155430 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.372+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac00675f0 con 0x7fbac0155430 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.376+0000 7fbab77fe640 1 -- 172.21.15.2:0/3645020539 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbab0013410 con 0x7fbac0155430 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.376+0000 7fbab77fe640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa00664a0 0x7fbaa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.376+0000 7fbab77fe640 1 -- 172.21.15.2:0/3645020539 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbab0083f00 con 0x7fbac0155430 2023-11-04T01:44:00.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.376+0000 7fbabeffd640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa00664a0 0x7fbaa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.376+0000 7fbabeffd640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa00664a0 0x7fbaa0068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbab8001cb0 tx=0x7fbab8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.380+0000 7fbab77fe640 1 -- 172.21.15.2:0/3645020539 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbab0051180 con 0x7fbac0155430 2023-11-04T01:44:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.572+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbac0073400 con 0x7fbac0155430 2023-11-04T01:44:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbab77fe640 1 -- 172.21.15.2:0/3645020539 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v19) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbab00210b0 con 0x7fbac0155430 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa00664a0 msgr2=0x7fbaa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa00664a0 0x7fbaa0068960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbab8001cb0 tx=0x7fbab8009040 comp rx=0 tx=0).stop 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac0155430 msgr2=0x7fbac00af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac0155430 0x7fbac00af8f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbab000e7e0 tx=0x7fbab000eca0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 shutdown_connections 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbaa00664a0 0x7fbaa0068960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbac0155430 0x7fbac00af8f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbac0159f00 0x7fbac01381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 --2- 172.21.15.2:0/3645020539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbac0071250 0x7fbac013b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 >> 172.21.15.2:0/3645020539 conn(0x7fbac00cfc70 msgr2=0x7fbac00b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 shutdown_connections 2023-11-04T01:44:00.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.588+0000 7fbac5426640 1 -- 172.21.15.2:0/3645020539 wait complete. 2023-11-04T01:44:00.612 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:44:00.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 Processor -- start 2023-11-04T01:44:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 -- start start 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb940adb50 0x7fcb940adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb940cc990 0x7fcb940ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb940b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940cce40 con 0x7fcb940cc990 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9406c840 con 0x7fcb940adb50 2023-11-04T01:44:00.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb9ac83640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940cd020 con 0x7fcb9406c3d0 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb940cc990 0x7fcb940ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb940cc990 0x7fcb940ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33998/0 (socket says 172.21.15.2:33998) 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 -- 172.21.15.2:0/1617757713 learned_addr learned my addr 172.21.15.2:0/1617757713 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb98a1f640 1 --2- 172.21.15.2:0/1617757713 >> v2:172.21.15.90:3300/0 conn(0x7fcb940adb50 0x7fcb940adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb99220640 1 --2- 172.21.15.2:0/1617757713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb940b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 -- 172.21.15.2:0/1617757713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 msgr2=0x7fcb940b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 --2- 172.21.15.2:0/1617757713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb940b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 -- 172.21.15.2:0/1617757713 >> v2:172.21.15.90:3300/0 conn(0x7fcb940adb50 msgr2=0x7fcb940adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 --2- 172.21.15.2:0/1617757713 >> v2:172.21.15.90:3300/0 conn(0x7fcb940adb50 0x7fcb940adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.732+0000 7fcb93fff640 1 -- 172.21.15.2:0/1617757713 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940cd300 con 0x7fcb940cc990 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb93fff640 1 --2- 172.21.15.2:0/1617757713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ce0c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcb940b0fa0 tx=0x7fcb8801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f241820b8c8a09b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb937fe640 1 -- 172.21.15.2:0/1617757713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb880aa5f0 con 0x7fcb940cc990 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb937fe640 1 -- 172.21.15.2:0/1617757713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb880aa750 con 0x7fcb940cc990 2023-11-04T01:44:00.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb937fe640 1 -- 172.21.15.2:0/1617757713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb880aaae0 con 0x7fcb940cc990 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1617757713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 msgr2=0x7fcb940ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1617757713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ce0c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcb940b0fa0 tx=0x7fcb8801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1617757713 shutdown_connections 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1617757713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb940b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1617757713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ce0c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1617757713 >> v2:172.21.15.90:3300/0 conn(0x7fcb940adb50 0x7fcb940adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1617757713 >> 172.21.15.2:0/1617757713 conn(0x7fcb940cb510 msgr2=0x7fcb940cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1617757713 shutdown_connections 2023-11-04T01:44:00.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1617757713 wait complete. 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 Processor -- start 2023-11-04T01:44:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- start start 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb94155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb940adb50 0x7fcb940ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94168650 con 0x7fcb940cc990 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94168930 con 0x7fcb940adb50 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb9ac83640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94168c10 con 0x7fcb9406c3d0 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34002/0 (socket says 172.21.15.2:34002) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 -- 172.21.15.2:0/1450899736 learned_addr learned my addr 172.21.15.2:0/1450899736 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb93fff640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb940adb50 0x7fcb940ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb98a1f640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb94155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 -- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 msgr2=0x7fcb94155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb94155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 -- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb940adb50 msgr2=0x7fcb940ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb940adb50 0x7fcb940ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.736+0000 7fcb99220640 1 -- 172.21.15.2:0/1450899736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb880094d0 con 0x7fcb940cc990 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb99220640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ace00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00efc0 tx=0x7fcb8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb917fa640 1 -- 172.21.15.2:0/1450899736 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c009ba0 con 0x7fcb940cc990 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb917fa640 1 -- 172.21.15.2:0/1450899736 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00f040 con 0x7fcb940cc990 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb94168ef0 con 0x7fcb940cc990 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb917fa640 1 -- 172.21.15.2:0/1450899736 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0146c0 con 0x7fcb940cc990 2023-11-04T01:44:00.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb941691d0 con 0x7fcb940cc990 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb940744a0 con 0x7fcb940cc990 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb917fa640 1 -- 172.21.15.2:0/1450899736 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb8c014820 con 0x7fcb940cc990 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb917fa640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb800664a0 0x7fcb80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb917fa640 1 -- 172.21.15.2:0/1450899736 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb8c084b40 con 0x7fcb940cc990 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb98a1f640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb800664a0 0x7fcb80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.740+0000 7fcb98a1f640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb800664a0 0x7fcb80068960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009a70 tx=0x7fcb84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:00.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.744+0000 7fcb917fa640 1 -- 172.21.15.2:0/1450899736 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb8c051dc0 con 0x7fcb940cc990 2023-11-04T01:44:00.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:00.948+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcb940c9050 con 0x7fcb940cc990 2023-11-04T01:44:01.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.600+0000 7fcb917fa640 1 -- 172.21.15.2:0/1450899736 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb8c0180c0 con 0x7fcb940cc990 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb800664a0 msgr2=0x7fcb80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb800664a0 0x7fcb80068960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009a70 tx=0x7fcb84008040 comp rx=0 tx=0).stop 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 msgr2=0x7fcb940ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ace00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00efc0 tx=0x7fcb8c00c490 comp rx=0 tx=0).stop 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 shutdown_connections 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb800664a0 0x7fcb80068960 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb940cc990 0x7fcb940ace00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb940adb50 0x7fcb940ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 --2- 172.21.15.2:0/1450899736 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb9406c3d0 0x7fcb94155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 >> 172.21.15.2:0/1450899736 conn(0x7fcb940cb510 msgr2=0x7fcb940708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 shutdown_connections 2023-11-04T01:44:01.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.604+0000 7fcb9ac83640 1 -- 172.21.15.2:0/1450899736 wait complete. 2023-11-04T01:44:01.631 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:44:01.632 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:01.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fadaaf4d640 1 Processor -- start 2023-11-04T01:44:01.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fadaaf4d640 1 -- start start 2023-11-04T01:44:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fadaaf4d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fada406d040 0x7fada40b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fadaaf4d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada406f480 con 0x7fada40ce920 2023-11-04T01:44:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fadaaf4d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada406c280 con 0x7fada406cc60 2023-11-04T01:44:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fadaaf4d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada40ce7c0 con 0x7fada406d040 2023-11-04T01:44:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fada406d040 0x7fada40b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada94ea640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fada40ce920 0x7fada415c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44030/0 (socket says 172.21.15.2:44030) 2023-11-04T01:44:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada94ea640 1 -- 172.21.15.2:0/2606560839 learned_addr learned my addr 172.21.15.2:0/2606560839 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada37fe640 1 -- 172.21.15.2:0/2606560839 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034762022 0 0) 0x7fada406f480 con 0x7fada40ce920 2023-11-04T01:44:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada37fe640 1 -- 172.21.15.2:0/2606560839 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad8c003530 con 0x7fada40ce920 2023-11-04T01:44:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada3fff640 1 -- 172.21.15.2:0/2606560839 >> v1:172.21.15.90:6789/0 conn(0x7fada406cc60 legacy=0x7fada40d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada3fff640 1 -- 172.21.15.2:0/2606560839 >> v1:172.21.15.2:6789/0 conn(0x7fada40ce920 legacy=0x7fada415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.752+0000 7fada3fff640 1 -- 172.21.15.2:0/2606560839 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada406f6d0 con 0x7fada406d040 2023-11-04T01:44:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fada3fff640 1 --2- 172.21.15.2:0/2606560839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada406d040 0x7fada40b27d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fad940097c0 tx=0x7fad9401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf290905e1910cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fada37fe640 1 -- 172.21.15.2:0/2606560839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940ab600 con 0x7fada406d040 2023-11-04T01:44:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fada37fe640 1 -- 172.21.15.2:0/2606560839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad940a7050 con 0x7fada406d040 2023-11-04T01:44:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fada37fe640 1 -- 172.21.15.2:0/2606560839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad940ab960 con 0x7fada406d040 2023-11-04T01:44:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- 172.21.15.2:0/2606560839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada406d040 msgr2=0x7fada40b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/2606560839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada406d040 0x7fada40b27d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fad940097c0 tx=0x7fad9401c480 comp rx=0 tx=0).stop 2023-11-04T01:44:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- 172.21.15.2:0/2606560839 shutdown_connections 2023-11-04T01:44:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/2606560839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada406d040 0x7fada40b27d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- 172.21.15.2:0/2606560839 >> 172.21.15.2:0/2606560839 conn(0x7fada40cd7d0 msgr2=0x7fada40cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- 172.21.15.2:0/2606560839 shutdown_connections 2023-11-04T01:44:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- 172.21.15.2:0/2606560839 wait complete. 2023-11-04T01:44:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 Processor -- start 2023-11-04T01:44:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- start start 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada406cc60 0x7fada40b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada406d040 0x7fada40af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada40ce920 0x7fada41527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada40af770 con 0x7fada40ce920 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada4152d10 con 0x7fada406d040 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.756+0000 7fadaaf4d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada40ae8a0 con 0x7fada406cc60 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada40ce920 0x7fada41527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada40ce920 0x7fada41527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49248/0 (socket says 172.21.15.2:49248) 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 -- 172.21.15.2:0/610559399 learned_addr learned my addr 172.21.15.2:0/610559399 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada3fff640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada406d040 0x7fada40af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada8ce9640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada406cc60 0x7fada40b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 -- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada406cc60 msgr2=0x7fada40b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada406cc60 0x7fada40b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 -- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada406d040 msgr2=0x7fada40af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada406d040 0x7fada40af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 -- 172.21.15.2:0/610559399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94009420 con 0x7fada40ce920 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada8ce9640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada406cc60 0x7fada40b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada3fff640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada406d040 0x7fada40af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada94ea640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada40ce920 0x7fada41527d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00cb40 tx=0x7fad9c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada17fa640 1 -- 172.21.15.2:0/610559399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00aca0 con 0x7fada40ce920 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada17fa640 1 -- 172.21.15.2:0/610559399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c00ae00 con 0x7fada40ce920 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada40aeb80 con 0x7fada40ce920 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada17fa640 1 -- 172.21.15.2:0/610559399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c012620 con 0x7fada40ce920 2023-11-04T01:44:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada40b3cf0 con 0x7fada40ce920 2023-11-04T01:44:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada40b3860 con 0x7fada40ce920 2023-11-04T01:44:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada17fa640 1 -- 172.21.15.2:0/610559399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fad9c007070 con 0x7fada40ce920 2023-11-04T01:44:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada17fa640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad900664a0 0x7fad90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada17fa640 1 -- 172.21.15.2:0/610559399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad9c084020 con 0x7fada40ce920 2023-11-04T01:44:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada8ce9640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad900664a0 0x7fad90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.760+0000 7fada8ce9640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad900664a0 0x7fad90068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fada40ae210 tx=0x7fad98009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:01.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.764+0000 7fada17fa640 1 -- 172.21.15.2:0/610559399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad9c051340 con 0x7fada40ce920 2023-11-04T01:44:01.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.952+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fada40744a0 con 0x7fada40ce920 2023-11-04T01:44:01.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fada17fa640 1 -- 172.21.15.2:0/610559399 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4901 (secure 0 0 0) 0x7fad9c054960 con 0x7fada40ce920 2023-11-04T01:44:01.960 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:01.960 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/47038667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":47038667},{"type":"v1","addr":"172.21.15.90:6835","nonce":47038667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3742811104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3742811104},{"type":"v1","addr":"172.21.15.90:6837","nonce":3742811104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2057053526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2057053526},{"type":"v1","addr":"172.21.15.2:6835","nonce":2057053526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:58.858818+0000","modified":"2023-11-04T01:44:00.951631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6834/1138444248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1138444248},{"type":"v1","addr":"172.21.15.2:6834","nonce":1138444248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:44:01.960 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad900664a0 msgr2=0x7fad90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad900664a0 0x7fad90068960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fada40ae210 tx=0x7fad98009040 comp rx=0 tx=0).stop 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada40ce920 msgr2=0x7fada41527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada40ce920 0x7fada41527d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00cb40 tx=0x7fad9c00a060 comp rx=0 tx=0).stop 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 shutdown_connections 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fad900664a0 0x7fad90068960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fada40ce920 0x7fada41527d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fada406d040 0x7fada40af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 --2- 172.21.15.2:0/610559399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fada406cc60 0x7fada40b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 >> 172.21.15.2:0/610559399 conn(0x7fada40cd7d0 msgr2=0x7fada40b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 shutdown_connections 2023-11-04T01:44:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:01.956+0000 7fadaaf4d640 1 -- 172.21.15.2:0/610559399 wait complete. 2023-11-04T01:44:01.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:02.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f072af5a640 1 Processor -- start 2023-11-04T01:44:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f072af5a640 1 -- start start 2023-11-04T01:44:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f072af5a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f07240cb400 0x7f07240cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f072af5a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07240cd6d0 0x7f07240cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f072af5a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07240ce040 con 0x7f072415afb0 2023-11-04T01:44:02.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f072af5a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072415b390 con 0x7f07240cb400 2023-11-04T01:44:02.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f072af5a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240d0a60 con 0x7f07240cd6d0 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f0723fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f07240cb400 0x7f07240cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f07294f7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07240cd6d0 0x7f07240cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f0723fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f07240cb400 0x7f07240cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:53416/0 (socket says 172.21.15.2:53416) 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f0723fff640 1 -- 172.21.15.2:0/1391229272 learned_addr learned my addr 172.21.15.2:0/1391229272 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f07294f7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07240cd6d0 0x7f07240cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:57948/0 (socket says 172.21.15.2:57948) 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f07294f7640 1 -- 172.21.15.2:0/1391229272 >> v2:172.21.15.90:3300/0 conn(0x7f07240cb400 msgr2=0x7f07240cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f07294f7640 1 --2- 172.21.15.2:0/1391229272 >> v2:172.21.15.90:3300/0 conn(0x7f07240cb400 0x7f07240cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f07294f7640 1 -- 172.21.15.2:0/1391229272 >> v1:172.21.15.90:6789/0 conn(0x7f072415afb0 legacy=0x7f07240b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f07294f7640 1 -- 172.21.15.2:0/1391229272 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240d04a0 con 0x7f07240cd6d0 2023-11-04T01:44:02.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.096+0000 7f0723fff640 1 --2- 172.21.15.2:0/1391229272 >> v2:172.21.15.90:3300/0 conn(0x7f07240cb400 0x7f07240cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:02.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f07294f7640 1 --2- 172.21.15.2:0/1391229272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07240cd6d0 0x7f07240cdb00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f071c0097c0 tx=0x7f071c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccee257e9a09f4c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f07237fe640 1 -- 172.21.15.2:0/1391229272 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ab600 con 0x7f07240cd6d0 2023-11-04T01:44:02.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f07237fe640 1 -- 172.21.15.2:0/1391229272 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0a7050 con 0x7f07240cd6d0 2023-11-04T01:44:02.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f07237fe640 1 -- 172.21.15.2:0/1391229272 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ab980 con 0x7f07240cd6d0 2023-11-04T01:44:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 -- 172.21.15.2:0/1391229272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07240cd6d0 msgr2=0x7f07240cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 --2- 172.21.15.2:0/1391229272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07240cd6d0 0x7f07240cdb00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f071c0097c0 tx=0x7f071c01c3f0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 -- 172.21.15.2:0/1391229272 shutdown_connections 2023-11-04T01:44:02.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 --2- 172.21.15.2:0/1391229272 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07240cd6d0 0x7f07240cdb00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 --2- 172.21.15.2:0/1391229272 >> v2:172.21.15.90:3300/0 conn(0x7f07240cb400 0x7f07240cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 -- 172.21.15.2:0/1391229272 >> 172.21.15.2:0/1391229272 conn(0x7f0724065dc0 msgr2=0x7f07240661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 -- 172.21.15.2:0/1391229272 shutdown_connections 2023-11-04T01:44:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 -- 172.21.15.2:0/1391229272 wait complete. 2023-11-04T01:44:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 Processor -- start 2023-11-04T01:44:02.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.100+0000 7f072af5a640 1 -- start start 2023-11-04T01:44:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07240cb400 0x7f07240c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07240cd6d0 0x7f0724156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f072415afb0 0x7f0724155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072415d730 con 0x7f07240cb400 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072415d960 con 0x7f07240cd6d0 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072415dc40 con 0x7f072415afb0 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07240cb400 0x7f07240c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07240cb400 0x7f07240c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49256/0 (socket says 172.21.15.2:49256) 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 -- 172.21.15.2:0/2254655016 learned_addr learned my addr 172.21.15.2:0/2254655016 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0723fff640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07240cd6d0 0x7f0724156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f07294f7640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f072415afb0 0x7f0724155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 -- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f072415afb0 msgr2=0x7f0724155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f072415afb0 0x7f0724155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 -- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07240cd6d0 msgr2=0x7f0724156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07240cd6d0 0x7f0724156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 -- 172.21.15.2:0/2254655016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07180094d0 con 0x7f07240cb400 2023-11-04T01:44:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0728cf6640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07240cb400 0x7f07240c46a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f071400c7c0 tx=0x7f071400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f07217fa640 1 -- 172.21.15.2:0/2254655016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714003ba0 con 0x7f07240cb400 2023-11-04T01:44:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f07217fa640 1 -- 172.21.15.2:0/2254655016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714003d00 con 0x7f07240cb400 2023-11-04T01:44:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c009420 con 0x7f07240cb400 2023-11-04T01:44:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f07217fa640 1 -- 172.21.15.2:0/2254655016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071400aa90 con 0x7f07240cb400 2023-11-04T01:44:02.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240c7df0 con 0x7f07240cb400 2023-11-04T01:44:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07240675f0 con 0x7f07240cb400 2023-11-04T01:44:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f07217fa640 1 -- 172.21.15.2:0/2254655016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f071400abf0 con 0x7f07240cb400 2023-11-04T01:44:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f07217fa640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07100664a0 0x7f0710068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f07217fa640 1 -- 172.21.15.2:0/2254655016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0714083de0 con 0x7f07240cb400 2023-11-04T01:44:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.104+0000 7f0723fff640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07100664a0 0x7f0710068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.108+0000 7f0723fff640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07100664a0 0x7f0710068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07241654d0 tx=0x7f0718008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.108+0000 7f07217fa640 1 -- 172.21.15.2:0/2254655016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0714051190 con 0x7f07240cb400 2023-11-04T01:44:02.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.268+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f072415deb0 con 0x7f07240cb400 2023-11-04T01:44:02.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.268+0000 7f07217fa640 1 -- 172.21.15.2:0/2254655016 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18150 (secure 0 0 0) 0x7f07140547b0 con 0x7f07240cb400 2023-11-04T01:44:02.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:02.273 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:00.542175+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:56.762181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:57.868403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:02.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07100664a0 msgr2=0x7f0710068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07100664a0 0x7f0710068960 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07241654d0 tx=0x7f0718008040 comp rx=0 tx=0).stop 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07240cb400 msgr2=0x7f07240c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07240cb400 0x7f07240c46a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f071400c7c0 tx=0x7f071400cc80 comp rx=0 tx=0).stop 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 shutdown_connections 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07100664a0 0x7f0710068960 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f072415afb0 0x7f0724155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07240cd6d0 0x7f0724156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 --2- 172.21.15.2:0/2254655016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07240cb400 0x7f07240c46a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 >> 172.21.15.2:0/2254655016 conn(0x7f0724065dc0 msgr2=0x7f072406e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 shutdown_connections 2023-11-04T01:44:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.272+0000 7f072af5a640 1 -- 172.21.15.2:0/2254655016 wait complete. 2023-11-04T01:44:02.293 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:44:02.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:44:02.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cdd21a640 1 Processor -- start 2023-11-04T01:44:02.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cdd21a640 1 -- start start 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cdd21a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6cd815afd0 0x7f6cd80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cdd21a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd80c2670 con 0x7f6cd806f8f0 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cdd21a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd806bc30 con 0x7f6cd80b0d40 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cdd21a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd8070140 con 0x7f6cd815afd0 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cd6d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6cd815afd0 0x7f6cd80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cd6d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6cd815afd0 0x7f6cd80715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49260/0 (socket says 172.21.15.2:49260) 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cce59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6cd806f8f0 0x7f6cd80b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44038/0 (socket says 172.21.15.2:44038) 2023-11-04T01:44:02.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cd6d9d640 1 -- 172.21.15.2:0/3813962066 learned_addr learned my addr 172.21.15.2:0/3813962066 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:02.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cd6d9d640 1 -- 172.21.15.2:0/3813962066 >> v1:172.21.15.90:6789/0 conn(0x7f6cd80b0d40 legacy=0x7f6cd815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:02.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cd6d9d640 1 -- 172.21.15.2:0/3813962066 >> v1:172.21.15.2:6789/0 conn(0x7f6cd806f8f0 legacy=0x7f6cd80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cd6d9d640 1 -- 172.21.15.2:0/3813962066 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd806bf10 con 0x7f6cd815afd0 2023-11-04T01:44:02.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.408+0000 7f6cd659c640 1 -- 172.21.15.2:0/3813962066 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496438248 0 0) 0x7f6cd80c2670 con 0x7f6cd806f8f0 2023-11-04T01:44:02.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cd6d9d640 1 --2- 172.21.15.2:0/3813962066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd815afd0 0x7f6cd80715d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009870 tx=0x7f6cc001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbc31a89bd348c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cd659c640 1 -- 172.21.15.2:0/3813962066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00ab5f0 con 0x7f6cd815afd0 2023-11-04T01:44:02.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cd659c640 1 -- 172.21.15.2:0/3813962066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc00ab750 con 0x7f6cd815afd0 2023-11-04T01:44:02.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cd659c640 1 -- 172.21.15.2:0/3813962066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00abae0 con 0x7f6cd815afd0 2023-11-04T01:44:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3813962066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd815afd0 msgr2=0x7f6cd80715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3813962066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd815afd0 0x7f6cd80715d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009870 tx=0x7f6cc001c500 comp rx=0 tx=0).stop 2023-11-04T01:44:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3813962066 shutdown_connections 2023-11-04T01:44:02.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3813962066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd815afd0 0x7f6cd80715d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3813962066 >> 172.21.15.2:0/3813962066 conn(0x7f6cd80cebb0 msgr2=0x7f6cd80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:02.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3813962066 shutdown_connections 2023-11-04T01:44:02.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3813962066 wait complete. 2023-11-04T01:44:02.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 Processor -- start 2023-11-04T01:44:02.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- start start 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6cd806f8f0 0x7f6cd81519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd80b0d40 0x7f6cd80ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cd815afd0 0x7f6cd80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd8151f30 con 0x7f6cd80b0d40 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80ad640 con 0x7f6cd815afd0 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.412+0000 7f6cdd21a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80ad920 con 0x7f6cd806f8f0 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd80b0d40 0x7f6cd80ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd80b0d40 0x7f6cd80ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49274/0 (socket says 172.21.15.2:49274) 2023-11-04T01:44:02.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 -- 172.21.15.2:0/3500139427 learned_addr learned my addr 172.21.15.2:0/3500139427 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cd6d9d640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6cd806f8f0 0x7f6cd81519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cd759e640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cd815afd0 0x7f6cd80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 -- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6cd806f8f0 msgr2=0x7f6cd81519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6cd806f8f0 0x7f6cd81519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 -- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cd815afd0 msgr2=0x7f6cd80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cd815afd0 0x7f6cd80cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 -- 172.21.15.2:0/3500139427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00094d0 con 0x7f6cd80b0d40 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cce59c640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd80b0d40 0x7f6cd80ccfd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c480 tx=0x7f6cc800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6ccffff640 1 -- 172.21.15.2:0/3500139427 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80074e0 con 0x7f6cd80b0d40 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6ccffff640 1 -- 172.21.15.2:0/3500139427 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc8007660 con 0x7f6cd80b0d40 2023-11-04T01:44:02.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd80adc00 con 0x7f6cd80b0d40 2023-11-04T01:44:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6ccffff640 1 -- 172.21.15.2:0/3500139427 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8004a30 con 0x7f6cd80b0d40 2023-11-04T01:44:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd80ae1c0 con 0x7f6cd80b0d40 2023-11-04T01:44:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd80744a0 con 0x7f6cd80b0d40 2023-11-04T01:44:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6ccffff640 1 -- 172.21.15.2:0/3500139427 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6cc8004b90 con 0x7f6cd80b0d40 2023-11-04T01:44:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6ccffff640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6cbc0664a0 0x7f6cbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6ccffff640 1 -- 172.21.15.2:0/3500139427 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6cc80833d0 con 0x7f6cd80b0d40 2023-11-04T01:44:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.416+0000 7f6cd6d9d640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6cbc0664a0 0x7f6cbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.420+0000 7f6cd6d9d640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6cbc0664a0 0x7f6cbc068960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00af000 tx=0x7f6cc00b6040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.420+0000 7f6ccffff640 1 -- 172.21.15.2:0/3500139427 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6cc8050830 con 0x7f6cd80b0d40 2023-11-04T01:44:02.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.576+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6cd806fd40 con 0x7f6cbc0664a0 2023-11-04T01:44:02.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.604+0000 7f6ccffff640 1 -- 172.21.15.2:0/3500139427 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+363537 (secure 0 0 0) 0x7f6cc00ab940 con 0x7f6cbc0664a0 2023-11-04T01:44:02.610 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:02.614 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6cbc0664a0 msgr2=0x7f6cbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6cbc0664a0 0x7f6cbc068960 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00af000 tx=0x7f6cc00b6040 comp rx=0 tx=0).stop 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd80b0d40 msgr2=0x7f6cd80ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd80b0d40 0x7f6cd80ccfd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c480 tx=0x7f6cc800c940 comp rx=0 tx=0).stop 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 shutdown_connections 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6cbc0664a0 0x7f6cbc068960 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6cd815afd0 0x7f6cd80cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd80b0d40 0x7f6cd80ccfd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 --2- 172.21.15.2:0/3500139427 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6cd806f8f0 0x7f6cd81519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 >> 172.21.15.2:0/3500139427 conn(0x7f6cd80cebb0 msgr2=0x7f6cd8158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:02.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 shutdown_connections 2023-11-04T01:44:02.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.608+0000 7f6cdd21a640 1 -- 172.21.15.2:0/3500139427 wait complete. 2023-11-04T01:44:02.632 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-11-04T01:44:00.804826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":202,"acting":202,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":129,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242552,"kb_used_data":5552,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732168,"statfs":{"total":773094113280,"available":772845740032,"internally_reserved":0,"allocated":5685248,"data_stored":3051793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001293"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.773080+0000","last_change":"2023-11-04T01:43:59.588912+0000","last_active":"2023-11-04T01:44:00.773080+0000","last_peered":"2023-11-04T01:44:00.773080+0000","last_clean":"2023-11-04T01:44:00.773080+0000","last_became_active":"2023-11-04T01:43:59.588070+0000","last_became_peered":"2023-11-04T01:43:59.588070+0000","last_unstale":"2023-11-04T01:44:00.773080+0000","last_undegraded":"2023-11-04T01:44:00.773080+0000","last_fullsized":"2023-11-04T01:44:00.773080+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:56:46.907230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768988+0000","last_change":"2023-11-04T01:43:59.569582+0000","last_active":"2023-11-04T01:44:00.768988+0000","last_peered":"2023-11-04T01:44:00.768988+0000","last_clean":"2023-11-04T01:44:00.768988+0000","last_became_active":"2023-11-04T01:43:59.568610+0000","last_became_peered":"2023-11-04T01:43:59.568610+0000","last_unstale":"2023-11-04T01:44:00.768988+0000","last_undegraded":"2023-11-04T01:44:00.768988+0000","last_fullsized":"2023-11-04T01:44:00.768988+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:14.693026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564385+0000","last_change":"2023-11-04T01:43:59.578822+0000","last_active":"2023-11-04T01:44:00.564385+0000","last_peered":"2023-11-04T01:44:00.564385+0000","last_clean":"2023-11-04T01:44:00.564385+0000","last_became_active":"2023-11-04T01:43:59.578118+0000","last_became_peered":"2023-11-04T01:43:59.578118+0000","last_unstale":"2023-11-04T01:44:00.564385+0000","last_undegraded":"2023-11-04T01:44:00.564385+0000","last_fullsized":"2023-11-04T01:44:00.564385+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:10.243322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768982+0000","last_change":"2023-11-04T01:43:59.569750+0000","last_active":"2023-11-04T01:44:00.768982+0000","last_peered":"2023-11-04T01:44:00.768982+0000","last_clean":"2023-11-04T01:44:00.768982+0000","last_became_active":"2023-11-04T01:43:59.569028+0000","last_became_peered":"2023-11-04T01:43:59.569028+0000","last_unstale":"2023-11-04T01:44:00.768982+0000","last_undegraded":"2023-11-04T01:44:00.768982+0000","last_fullsized":"2023-11-04T01:44:00.768982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:08.173970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771545+0000","last_change":"2023-11-04T01:43:59.580893+0000","last_active":"2023-11-04T01:44:00.771545+0000","last_peered":"2023-11-04T01:44:00.771545+0000","last_clean":"2023-11-04T01:44:00.771545+0000","last_became_active":"2023-11-04T01:43:59.579744+0000","last_became_peered":"2023-11-04T01:43:59.579744+0000","last_unstale":"2023-11-04T01:44:00.771545+0000","last_undegraded":"2023-11-04T01:44:00.771545+0000","last_fullsized":"2023-11-04T01:44:00.771545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:50.426988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559653+0000","last_change":"2023-11-04T01:43:59.576275+0000","last_active":"2023-11-04T01:44:00.559653+0000","last_peered":"2023-11-04T01:44:00.559653+0000","last_clean":"2023-11-04T01:44:00.559653+0000","last_became_active":"2023-11-04T01:43:59.575220+0000","last_became_peered":"2023-11-04T01:43:59.575220+0000","last_unstale":"2023-11-04T01:44:00.559653+0000","last_undegraded":"2023-11-04T01:44:00.559653+0000","last_fullsized":"2023-11-04T01:44:00.559653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:44.058812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770702+0000","last_change":"2023-11-04T01:43:59.580501+0000","last_active":"2023-11-04T01:44:00.770702+0000","last_peered":"2023-11-04T01:44:00.770702+0000","last_clean":"2023-11-04T01:44:00.770702+0000","last_became_active":"2023-11-04T01:43:59.579714+0000","last_became_peered":"2023-11-04T01:43:59.579714+0000","last_unstale":"2023-11-04T01:44:00.770702+0000","last_undegraded":"2023-11-04T01:44:00.770702+0000","last_fullsized":"2023-11-04T01:44:00.770702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:46.736218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564701+0000","last_change":"2023-11-04T01:43:59.584156+0000","last_active":"2023-11-04T01:44:00.564701+0000","last_peered":"2023-11-04T01:44:00.564701+0000","last_clean":"2023-11-04T01:44:00.564701+0000","last_became_active":"2023-11-04T01:43:59.583023+0000","last_became_peered":"2023-11-04T01:43:59.583023+0000","last_unstale":"2023-11-04T01:44:00.564701+0000","last_undegraded":"2023-11-04T01:44:00.564701+0000","last_fullsized":"2023-11-04T01:44:00.564701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:10:28.616489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560860+0000","last_change":"2023-11-04T01:43:59.575591+0000","last_active":"2023-11-04T01:44:00.560860+0000","last_peered":"2023-11-04T01:44:00.560860+0000","last_clean":"2023-11-04T01:44:00.560860+0000","last_became_active":"2023-11-04T01:43:59.574148+0000","last_became_peered":"2023-11-04T01:43:59.574148+0000","last_unstale":"2023-11-04T01:44:00.560860+0000","last_undegraded":"2023-11-04T01:44:00.560860+0000","last_fullsized":"2023-11-04T01:44:00.560860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:50.229236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772591+0000","last_change":"2023-11-04T01:43:59.577182+0000","last_active":"2023-11-04T01:44:00.772591+0000","last_peered":"2023-11-04T01:44:00.772591+0000","last_clean":"2023-11-04T01:44:00.772591+0000","last_became_active":"2023-11-04T01:43:59.576079+0000","last_became_peered":"2023-11-04T01:43:59.576079+0000","last_unstale":"2023-11-04T01:44:00.772591+0000","last_undegraded":"2023-11-04T01:44:00.772591+0000","last_fullsized":"2023-11-04T01:44:00.772591+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:11.273133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772015+0000","last_change":"2023-11-04T01:43:59.588720+0000","last_active":"2023-11-04T01:44:00.772015+0000","last_peered":"2023-11-04T01:44:00.772015+0000","last_clean":"2023-11-04T01:44:00.772015+0000","last_became_active":"2023-11-04T01:43:59.588159+0000","last_became_peered":"2023-11-04T01:43:59.588159+0000","last_unstale":"2023-11-04T01:44:00.772015+0000","last_undegraded":"2023-11-04T01:44:00.772015+0000","last_fullsized":"2023-11-04T01:44:00.772015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:17.353223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771440+0000","last_change":"2023-11-04T01:43:59.568958+0000","last_active":"2023-11-04T01:44:00.771440+0000","last_peered":"2023-11-04T01:44:00.771440+0000","last_clean":"2023-11-04T01:44:00.771440+0000","last_became_active":"2023-11-04T01:43:59.568192+0000","last_became_peered":"2023-11-04T01:43:59.568192+0000","last_unstale":"2023-11-04T01:44:00.771440+0000","last_undegraded":"2023-11-04T01:44:00.771440+0000","last_fullsized":"2023-11-04T01:44:00.771440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:34:55.520333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771261+0000","last_change":"2023-11-04T01:43:59.567673+0000","last_active":"2023-11-04T01:44:00.771261+0000","last_peered":"2023-11-04T01:44:00.771261+0000","last_clean":"2023-11-04T01:44:00.771261+0000","last_became_active":"2023-11-04T01:43:59.566908+0000","last_became_peered":"2023-11-04T01:43:59.566908+0000","last_unstale":"2023-11-04T01:44:00.771261+0000","last_undegraded":"2023-11-04T01:44:00.771261+0000","last_fullsized":"2023-11-04T01:44:00.771261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:27.386024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771547+0000","last_change":"2023-11-04T01:43:59.589039+0000","last_active":"2023-11-04T01:44:00.771547+0000","last_peered":"2023-11-04T01:44:00.771547+0000","last_clean":"2023-11-04T01:44:00.771547+0000","last_became_active":"2023-11-04T01:43:59.588357+0000","last_became_peered":"2023-11-04T01:43:59.588357+0000","last_unstale":"2023-11-04T01:44:00.771547+0000","last_undegraded":"2023-11-04T01:44:00.771547+0000","last_fullsized":"2023-11-04T01:44:00.771547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:18.880660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.773694+0000","last_change":"2023-11-04T01:43:59.580164+0000","last_active":"2023-11-04T01:44:00.773694+0000","last_peered":"2023-11-04T01:44:00.773694+0000","last_clean":"2023-11-04T01:44:00.773694+0000","last_became_active":"2023-11-04T01:43:59.578819+0000","last_became_peered":"2023-11-04T01:43:59.578819+0000","last_unstale":"2023-11-04T01:44:00.773694+0000","last_undegraded":"2023-11-04T01:44:00.773694+0000","last_fullsized":"2023-11-04T01:44:00.773694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:18.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.565161+0000","last_change":"2023-11-04T01:43:59.548706+0000","last_active":"2023-11-04T01:44:00.565161+0000","last_peered":"2023-11-04T01:44:00.565161+0000","last_clean":"2023-11-04T01:44:00.565161+0000","last_became_active":"2023-11-04T01:43:59.547619+0000","last_became_peered":"2023-11-04T01:43:59.547619+0000","last_unstale":"2023-11-04T01:44:00.565161+0000","last_undegraded":"2023-11-04T01:44:00.565161+0000","last_fullsized":"2023-11-04T01:44:00.565161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:02.878241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768951+0000","last_change":"2023-11-04T01:43:59.581793+0000","last_active":"2023-11-04T01:44:00.768951+0000","last_peered":"2023-11-04T01:44:00.768951+0000","last_clean":"2023-11-04T01:44:00.768951+0000","last_became_active":"2023-11-04T01:43:59.580936+0000","last_became_peered":"2023-11-04T01:43:59.580936+0000","last_unstale":"2023-11-04T01:44:00.768951+0000","last_undegraded":"2023-11-04T01:44:00.768951+0000","last_fullsized":"2023-11-04T01:44:00.768951+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:18.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564244+0000","last_change":"2023-11-04T01:43:59.581216+0000","last_active":"2023-11-04T01:44:00.564244+0000","last_peered":"2023-11-04T01:44:00.564244+0000","last_clean":"2023-11-04T01:44:00.564244+0000","last_became_active":"2023-11-04T01:43:59.580399+0000","last_became_peered":"2023-11-04T01:43:59.580399+0000","last_unstale":"2023-11-04T01:44:00.564244+0000","last_undegraded":"2023-11-04T01:44:00.564244+0000","last_fullsized":"2023-11-04T01:44:00.564244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:04.867632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563605+0000","last_change":"2023-11-04T01:43:59.583162+0000","last_active":"2023-11-04T01:44:00.563605+0000","last_peered":"2023-11-04T01:44:00.563605+0000","last_clean":"2023-11-04T01:44:00.563605+0000","last_became_active":"2023-11-04T01:43:59.582216+0000","last_became_peered":"2023-11-04T01:43:59.582216+0000","last_unstale":"2023-11-04T01:44:00.563605+0000","last_undegraded":"2023-11-04T01:44:00.563605+0000","last_fullsized":"2023-11-04T01:44:00.563605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:07.832056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563370+0000","last_change":"2023-11-04T01:43:59.576887+0000","last_active":"2023-11-04T01:44:00.563370+0000","last_peered":"2023-11-04T01:44:00.563370+0000","last_clean":"2023-11-04T01:44:00.563370+0000","last_became_active":"2023-11-04T01:43:59.576108+0000","last_became_peered":"2023-11-04T01:43:59.576108+0000","last_unstale":"2023-11-04T01:44:00.563370+0000","last_undegraded":"2023-11-04T01:44:00.563370+0000","last_fullsized":"2023-11-04T01:44:00.563370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:10:45.510378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.773386+0000","last_change":"2023-11-04T01:43:59.578503+0000","last_active":"2023-11-04T01:44:00.773386+0000","last_peered":"2023-11-04T01:44:00.773386+0000","last_clean":"2023-11-04T01:44:00.773386+0000","last_became_active":"2023-11-04T01:43:59.577586+0000","last_became_peered":"2023-11-04T01:43:59.577586+0000","last_unstale":"2023-11-04T01:44:00.773386+0000","last_undegraded":"2023-11-04T01:44:00.773386+0000","last_fullsized":"2023-11-04T01:44:00.773386+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:38.596636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564790+0000","last_change":"2023-11-04T01:43:59.567964+0000","last_active":"2023-11-04T01:44:00.564790+0000","last_peered":"2023-11-04T01:44:00.564790+0000","last_clean":"2023-11-04T01:44:00.564790+0000","last_became_active":"2023-11-04T01:43:59.567217+0000","last_became_peered":"2023-11-04T01:43:59.567217+0000","last_unstale":"2023-11-04T01:44:00.564790+0000","last_undegraded":"2023-11-04T01:44:00.564790+0000","last_fullsized":"2023-11-04T01:44:00.564790+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:23.736077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772294+0000","last_change":"2023-11-04T01:43:59.591488+0000","last_active":"2023-11-04T01:44:00.772294+0000","last_peered":"2023-11-04T01:44:00.772294+0000","last_clean":"2023-11-04T01:44:00.772294+0000","last_became_active":"2023-11-04T01:43:59.590918+0000","last_became_peered":"2023-11-04T01:43:59.590918+0000","last_unstale":"2023-11-04T01:44:00.772294+0000","last_undegraded":"2023-11-04T01:44:00.772294+0000","last_fullsized":"2023-11-04T01:44:00.772294+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:35:32.746550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768860+0000","last_change":"2023-11-04T01:43:59.588352+0000","last_active":"2023-11-04T01:44:00.768860+0000","last_peered":"2023-11-04T01:44:00.768860+0000","last_clean":"2023-11-04T01:44:00.768860+0000","last_became_active":"2023-11-04T01:43:59.587584+0000","last_became_peered":"2023-11-04T01:43:59.587584+0000","last_unstale":"2023-11-04T01:44:00.768860+0000","last_undegraded":"2023-11-04T01:44:00.768860+0000","last_fullsized":"2023-11-04T01:44:00.768860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:38.596636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772293+0000","last_change":"2023-11-04T01:43:59.567815+0000","last_active":"2023-11-04T01:44:00.772293+0000","last_peered":"2023-11-04T01:44:00.772293+0000","last_clean":"2023-11-04T01:44:00.772293+0000","last_became_active":"2023-11-04T01:43:59.566956+0000","last_became_peered":"2023-11-04T01:43:59.566956+0000","last_unstale":"2023-11-04T01:44:00.772293+0000","last_undegraded":"2023-11-04T01:44:00.772293+0000","last_fullsized":"2023-11-04T01:44:00.772293+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:04.259155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563639+0000","last_change":"2023-11-04T01:43:59.580166+0000","last_active":"2023-11-04T01:44:00.563639+0000","last_peered":"2023-11-04T01:44:00.563639+0000","last_clean":"2023-11-04T01:44:00.563639+0000","last_became_active":"2023-11-04T01:43:59.579371+0000","last_became_peered":"2023-11-04T01:43:59.579371+0000","last_unstale":"2023-11-04T01:44:00.563639+0000","last_undegraded":"2023-11-04T01:44:00.563639+0000","last_fullsized":"2023-11-04T01:44:00.563639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:18.301112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768447+0000","last_change":"2023-11-04T01:43:59.577665+0000","last_active":"2023-11-04T01:44:00.768447+0000","last_peered":"2023-11-04T01:44:00.768447+0000","last_clean":"2023-11-04T01:44:00.768447+0000","last_became_active":"2023-11-04T01:43:59.576866+0000","last_became_peered":"2023-11-04T01:43:59.576866+0000","last_unstale":"2023-11-04T01:44:00.768447+0000","last_undegraded":"2023-11-04T01:44:00.768447+0000","last_fullsized":"2023-11-04T01:44:00.768447+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:11.273133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561683+0000","last_change":"2023-11-04T01:43:58.543196+0000","last_active":"2023-11-04T01:44:00.561683+0000","last_peered":"2023-11-04T01:44:00.561683+0000","last_clean":"2023-11-04T01:44:00.561683+0000","last_became_active":"2023-11-04T01:43:58.542375+0000","last_became_peered":"2023-11-04T01:43:58.542375+0000","last_unstale":"2023-11-04T01:44:00.561683+0000","last_undegraded":"2023-11-04T01:44:00.561683+0000","last_fullsized":"2023-11-04T01:44:00.561683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.681195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.829922+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:43:53.829922+0000","last_peered":"2023-11-04T01:43:53.829922+0000","last_clean":"2023-11-04T01:43:53.829922+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:43:53.829922+0000","last_undegraded":"2023-11-04T01:43:53.829922+0000","last_fullsized":"2023-11-04T01:43:53.829922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.947003+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:43:53.947003+0000","last_peered":"2023-11-04T01:43:53.947003+0000","last_clean":"2023-11-04T01:43:53.947003+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:43:53.947003+0000","last_undegraded":"2023-11-04T01:43:53.947003+0000","last_fullsized":"2023-11-04T01:43:53.947003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560854+0000","last_change":"2023-11-04T01:43:59.585132+0000","last_active":"2023-11-04T01:44:00.560854+0000","last_peered":"2023-11-04T01:44:00.560854+0000","last_clean":"2023-11-04T01:44:00.560854+0000","last_became_active":"2023-11-04T01:43:59.582345+0000","last_became_peered":"2023-11-04T01:43:59.582345+0000","last_unstale":"2023-11-04T01:44:00.560854+0000","last_undegraded":"2023-11-04T01:44:00.560854+0000","last_fullsized":"2023-11-04T01:44:00.560854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:11.658042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560490+0000","last_change":"2023-11-04T01:43:58.542866+0000","last_active":"2023-11-04T01:44:00.560490+0000","last_peered":"2023-11-04T01:44:00.560490+0000","last_clean":"2023-11-04T01:44:00.560490+0000","last_became_active":"2023-11-04T01:43:58.542289+0000","last_became_peered":"2023-11-04T01:43:58.542289+0000","last_unstale":"2023-11-04T01:44:00.560490+0000","last_undegraded":"2023-11-04T01:44:00.560490+0000","last_fullsized":"2023-11-04T01:44:00.560490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:07.162139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.946868+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:43:53.946868+0000","last_peered":"2023-11-04T01:43:53.946868+0000","last_clean":"2023-11-04T01:43:53.946868+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:43:53.946868+0000","last_undegraded":"2023-11-04T01:43:53.946868+0000","last_fullsized":"2023-11-04T01:43:53.946868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768845+0000","last_change":"2023-11-04T01:43:59.574547+0000","last_active":"2023-11-04T01:44:00.768845+0000","last_peered":"2023-11-04T01:44:00.768845+0000","last_clean":"2023-11-04T01:44:00.768845+0000","last_became_active":"2023-11-04T01:43:59.573750+0000","last_became_peered":"2023-11-04T01:43:59.573750+0000","last_unstale":"2023-11-04T01:44:00.768845+0000","last_undegraded":"2023-11-04T01:44:00.768845+0000","last_fullsized":"2023-11-04T01:44:00.768845+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:56:46.907230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564454+0000","last_change":"2023-11-04T01:43:58.528399+0000","last_active":"2023-11-04T01:44:00.564454+0000","last_peered":"2023-11-04T01:44:00.564454+0000","last_clean":"2023-11-04T01:44:00.564454+0000","last_became_active":"2023-11-04T01:43:58.527827+0000","last_became_peered":"2023-11-04T01:43:58.527827+0000","last_unstale":"2023-11-04T01:44:00.564454+0000","last_undegraded":"2023-11-04T01:44:00.564454+0000","last_fullsized":"2023-11-04T01:44:00.564454+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.547975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.834318+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:43:53.834318+0000","last_peered":"2023-11-04T01:43:53.834318+0000","last_clean":"2023-11-04T01:43:53.834318+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:43:53.834318+0000","last_undegraded":"2023-11-04T01:43:53.834318+0000","last_fullsized":"2023-11-04T01:43:53.834318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561487+0000","last_change":"2023-11-04T01:43:59.557416+0000","last_active":"2023-11-04T01:44:00.561487+0000","last_peered":"2023-11-04T01:44:00.561487+0000","last_clean":"2023-11-04T01:44:00.561487+0000","last_became_active":"2023-11-04T01:43:59.556529+0000","last_became_peered":"2023-11-04T01:43:59.556529+0000","last_unstale":"2023-11-04T01:44:00.561487+0000","last_undegraded":"2023-11-04T01:44:00.561487+0000","last_fullsized":"2023-11-04T01:44:00.561487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:36.137352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768581+0000","last_change":"2023-11-04T01:43:58.516910+0000","last_active":"2023-11-04T01:44:00.768581+0000","last_peered":"2023-11-04T01:44:00.768581+0000","last_clean":"2023-11-04T01:44:00.768581+0000","last_became_active":"2023-11-04T01:43:58.516498+0000","last_became_peered":"2023-11-04T01:43:58.516498+0000","last_unstale":"2023-11-04T01:44:00.768581+0000","last_undegraded":"2023-11-04T01:44:00.768581+0000","last_fullsized":"2023-11-04T01:44:00.768581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:23.710321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.555809+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:43:59.555809+0000","last_peered":"2023-11-04T01:43:59.555809+0000","last_clean":"2023-11-04T01:43:59.555809+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:43:59.555809+0000","last_undegraded":"2023-11-04T01:43:59.555809+0000","last_fullsized":"2023-11-04T01:43:59.555809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771342+0000","last_change":"2023-11-04T01:43:59.585477+0000","last_active":"2023-11-04T01:44:00.771342+0000","last_peered":"2023-11-04T01:44:00.771342+0000","last_clean":"2023-11-04T01:44:00.771342+0000","last_became_active":"2023-11-04T01:43:59.584758+0000","last_became_peered":"2023-11-04T01:43:59.584758+0000","last_unstale":"2023-11-04T01:44:00.771342+0000","last_undegraded":"2023-11-04T01:44:00.771342+0000","last_fullsized":"2023-11-04T01:44:00.771342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:21.194987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.551844+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:43:59.551844+0000","last_peered":"2023-11-04T01:43:59.551844+0000","last_clean":"2023-11-04T01:43:59.551844+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:43:59.551844+0000","last_undegraded":"2023-11-04T01:43:59.551844+0000","last_fullsized":"2023-11-04T01:43:59.551844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.550497+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:43:59.550497+0000","last_peered":"2023-11-04T01:43:59.550497+0000","last_clean":"2023-11-04T01:43:59.550497+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:43:59.550497+0000","last_undegraded":"2023-11-04T01:43:59.550497+0000","last_fullsized":"2023-11-04T01:43:59.550497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560264+0000","last_change":"2023-11-04T01:43:59.575639+0000","last_active":"2023-11-04T01:44:00.560264+0000","last_peered":"2023-11-04T01:44:00.560264+0000","last_clean":"2023-11-04T01:44:00.560264+0000","last_became_active":"2023-11-04T01:43:59.573722+0000","last_became_peered":"2023-11-04T01:43:59.573722+0000","last_unstale":"2023-11-04T01:44:00.560264+0000","last_undegraded":"2023-11-04T01:44:00.560264+0000","last_fullsized":"2023-11-04T01:44:00.560264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:48:14.353726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.554091+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:43:59.554091+0000","last_peered":"2023-11-04T01:43:59.554091+0000","last_clean":"2023-11-04T01:43:59.554091+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:43:59.554091+0000","last_undegraded":"2023-11-04T01:43:59.554091+0000","last_fullsized":"2023-11-04T01:43:59.554091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564051+0000","last_change":"2023-11-04T01:43:59.541332+0000","last_active":"2023-11-04T01:44:00.564051+0000","last_peered":"2023-11-04T01:44:00.564051+0000","last_clean":"2023-11-04T01:44:00.564051+0000","last_became_active":"2023-11-04T01:43:59.538297+0000","last_became_peered":"2023-11-04T01:43:59.538297+0000","last_unstale":"2023-11-04T01:44:00.564051+0000","last_undegraded":"2023-11-04T01:44:00.564051+0000","last_fullsized":"2023-11-04T01:44:00.564051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:08.220607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564094+0000","last_change":"2023-11-04T01:43:58.531808+0000","last_active":"2023-11-04T01:44:00.564094+0000","last_peered":"2023-11-04T01:44:00.564094+0000","last_clean":"2023-11-04T01:44:00.564094+0000","last_became_active":"2023-11-04T01:43:58.529724+0000","last_became_peered":"2023-11-04T01:43:58.529724+0000","last_unstale":"2023-11-04T01:44:00.564094+0000","last_undegraded":"2023-11-04T01:44:00.564094+0000","last_fullsized":"2023-11-04T01:44:00.564094+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:43.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.834410+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:43:53.834410+0000","last_peered":"2023-11-04T01:43:53.834410+0000","last_clean":"2023-11-04T01:43:53.834410+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:43:53.834410+0000","last_undegraded":"2023-11-04T01:43:53.834410+0000","last_fullsized":"2023-11-04T01:43:53.834410+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769001+0000","last_change":"2023-11-04T01:43:59.574903+0000","last_active":"2023-11-04T01:44:00.769001+0000","last_peered":"2023-11-04T01:44:00.769001+0000","last_clean":"2023-11-04T01:44:00.769001+0000","last_became_active":"2023-11-04T01:43:59.573224+0000","last_became_peered":"2023-11-04T01:43:59.573224+0000","last_unstale":"2023-11-04T01:44:00.769001+0000","last_undegraded":"2023-11-04T01:44:00.769001+0000","last_fullsized":"2023-11-04T01:44:00.769001+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:58.002097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772541+0000","last_change":"2023-11-04T01:43:58.527902+0000","last_active":"2023-11-04T01:44:00.772541+0000","last_peered":"2023-11-04T01:44:00.772541+0000","last_clean":"2023-11-04T01:44:00.772541+0000","last_became_active":"2023-11-04T01:43:58.527100+0000","last_became_peered":"2023-11-04T01:43:58.527100+0000","last_unstale":"2023-11-04T01:44:00.772541+0000","last_undegraded":"2023-11-04T01:44:00.772541+0000","last_fullsized":"2023-11-04T01:44:00.772541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:19.612720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.834166+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:43:53.834166+0000","last_peered":"2023-11-04T01:43:53.834166+0000","last_clean":"2023-11-04T01:43:53.834166+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:43:53.834166+0000","last_undegraded":"2023-11-04T01:43:53.834166+0000","last_fullsized":"2023-11-04T01:43:53.834166+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564375+0000","last_change":"2023-11-04T01:43:58.539873+0000","last_active":"2023-11-04T01:44:00.564375+0000","last_peered":"2023-11-04T01:44:00.564375+0000","last_clean":"2023-11-04T01:44:00.564375+0000","last_became_active":"2023-11-04T01:43:58.539139+0000","last_became_peered":"2023-11-04T01:43:58.539139+0000","last_unstale":"2023-11-04T01:44:00.564375+0000","last_undegraded":"2023-11-04T01:44:00.564375+0000","last_fullsized":"2023-11-04T01:44:00.564375+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:31.866067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.533705+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:43:59.533705+0000","last_peered":"2023-11-04T01:43:59.533705+0000","last_clean":"2023-11-04T01:43:59.533705+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:43:59.533705+0000","last_undegraded":"2023-11-04T01:43:59.533705+0000","last_fullsized":"2023-11-04T01:43:59.533705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772378+0000","last_change":"2023-11-04T01:43:59.565302+0000","last_active":"2023-11-04T01:44:00.772378+0000","last_peered":"2023-11-04T01:44:00.772378+0000","last_clean":"2023-11-04T01:44:00.772378+0000","last_became_active":"2023-11-04T01:43:59.564500+0000","last_became_peered":"2023-11-04T01:43:59.564500+0000","last_unstale":"2023-11-04T01:44:00.772378+0000","last_undegraded":"2023-11-04T01:44:00.772378+0000","last_fullsized":"2023-11-04T01:44:00.772378+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:24.722152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559609+0000","last_change":"2023-11-04T01:43:58.540644+0000","last_active":"2023-11-04T01:44:00.559609+0000","last_peered":"2023-11-04T01:44:00.559609+0000","last_clean":"2023-11-04T01:44:00.559609+0000","last_became_active":"2023-11-04T01:43:58.539879+0000","last_became_peered":"2023-11-04T01:43:58.539879+0000","last_unstale":"2023-11-04T01:44:00.559609+0000","last_undegraded":"2023-11-04T01:44:00.559609+0000","last_fullsized":"2023-11-04T01:44:00.559609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:56.990266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.946794+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:43:53.946794+0000","last_peered":"2023-11-04T01:43:53.946794+0000","last_clean":"2023-11-04T01:43:53.946794+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:43:53.946794+0000","last_undegraded":"2023-11-04T01:43:53.946794+0000","last_fullsized":"2023-11-04T01:43:53.946794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772091+0000","last_change":"2023-11-04T01:43:59.580759+0000","last_active":"2023-11-04T01:44:00.772091+0000","last_peered":"2023-11-04T01:44:00.772091+0000","last_clean":"2023-11-04T01:44:00.772091+0000","last_became_active":"2023-11-04T01:43:59.579983+0000","last_became_peered":"2023-11-04T01:43:59.579983+0000","last_unstale":"2023-11-04T01:44:00.772091+0000","last_undegraded":"2023-11-04T01:44:00.772091+0000","last_fullsized":"2023-11-04T01:44:00.772091+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:37:43.050852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559894+0000","last_change":"2023-11-04T01:43:58.534410+0000","last_active":"2023-11-04T01:44:00.559894+0000","last_peered":"2023-11-04T01:44:00.559894+0000","last_clean":"2023-11-04T01:44:00.559894+0000","last_became_active":"2023-11-04T01:43:58.533705+0000","last_became_peered":"2023-11-04T01:43:58.533705+0000","last_unstale":"2023-11-04T01:44:00.559894+0000","last_undegraded":"2023-11-04T01:44:00.559894+0000","last_fullsized":"2023-11-04T01:44:00.559894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:08.778650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.533709+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:43:59.533709+0000","last_peered":"2023-11-04T01:43:59.533709+0000","last_clean":"2023-11-04T01:43:59.533709+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:43:59.533709+0000","last_undegraded":"2023-11-04T01:43:59.533709+0000","last_fullsized":"2023-11-04T01:43:59.533709+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559586+0000","last_change":"2023-11-04T01:43:59.561060+0000","last_active":"2023-11-04T01:44:00.559586+0000","last_peered":"2023-11-04T01:44:00.559586+0000","last_clean":"2023-11-04T01:44:00.559586+0000","last_became_active":"2023-11-04T01:43:59.557477+0000","last_became_peered":"2023-11-04T01:43:59.557477+0000","last_unstale":"2023-11-04T01:44:00.559586+0000","last_undegraded":"2023-11-04T01:44:00.559586+0000","last_fullsized":"2023-11-04T01:44:00.559586+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.438063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772259+0000","last_change":"2023-11-04T01:43:58.541530+0000","last_active":"2023-11-04T01:44:00.772259+0000","last_peered":"2023-11-04T01:44:00.772259+0000","last_clean":"2023-11-04T01:44:00.772259+0000","last_became_active":"2023-11-04T01:43:58.540749+0000","last_became_peered":"2023-11-04T01:43:58.540749+0000","last_unstale":"2023-11-04T01:44:00.772259+0000","last_undegraded":"2023-11-04T01:44:00.772259+0000","last_fullsized":"2023-11-04T01:44:00.772259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:34.335722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.830379+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:43:53.830379+0000","last_peered":"2023-11-04T01:43:53.830379+0000","last_clean":"2023-11-04T01:43:53.830379+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:43:53.830379+0000","last_undegraded":"2023-11-04T01:43:53.830379+0000","last_fullsized":"2023-11-04T01:43:53.830379+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770572+0000","last_change":"2023-11-04T01:43:59.566532+0000","last_active":"2023-11-04T01:44:00.770572+0000","last_peered":"2023-11-04T01:44:00.770572+0000","last_clean":"2023-11-04T01:44:00.770572+0000","last_became_active":"2023-11-04T01:43:59.564132+0000","last_became_peered":"2023-11-04T01:43:59.564132+0000","last_unstale":"2023-11-04T01:44:00.770572+0000","last_undegraded":"2023-11-04T01:44:00.770572+0000","last_fullsized":"2023-11-04T01:44:00.770572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:22.847874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772567+0000","last_change":"2023-11-04T01:43:58.524544+0000","last_active":"2023-11-04T01:44:00.772567+0000","last_peered":"2023-11-04T01:44:00.772567+0000","last_clean":"2023-11-04T01:44:00.772567+0000","last_became_active":"2023-11-04T01:43:58.523405+0000","last_became_peered":"2023-11-04T01:43:58.523405+0000","last_unstale":"2023-11-04T01:44:00.772567+0000","last_undegraded":"2023-11-04T01:44:00.772567+0000","last_fullsized":"2023-11-04T01:44:00.772567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:28.931527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.544608+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:43:59.544608+0000","last_peered":"2023-11-04T01:43:59.544608+0000","last_clean":"2023-11-04T01:43:59.544608+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:43:59.544608+0000","last_undegraded":"2023-11-04T01:43:59.544608+0000","last_fullsized":"2023-11-04T01:43:59.544608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768651+0000","last_change":"2023-11-04T01:43:59.576399+0000","last_active":"2023-11-04T01:44:00.768651+0000","last_peered":"2023-11-04T01:44:00.768651+0000","last_clean":"2023-11-04T01:44:00.768651+0000","last_became_active":"2023-11-04T01:43:59.574132+0000","last_became_peered":"2023-11-04T01:43:59.574132+0000","last_unstale":"2023-11-04T01:44:00.768651+0000","last_undegraded":"2023-11-04T01:44:00.768651+0000","last_fullsized":"2023-11-04T01:44:00.768651+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:13.614324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.553538+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:43:59.553538+0000","last_peered":"2023-11-04T01:43:59.553538+0000","last_clean":"2023-11-04T01:43:59.553538+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:43:59.553538+0000","last_undegraded":"2023-11-04T01:43:59.553538+0000","last_fullsized":"2023-11-04T01:43:59.553538+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771120+0000","last_change":"2023-11-04T01:43:59.590180+0000","last_active":"2023-11-04T01:44:00.771120+0000","last_peered":"2023-11-04T01:44:00.771120+0000","last_clean":"2023-11-04T01:44:00.771120+0000","last_became_active":"2023-11-04T01:43:59.589504+0000","last_became_peered":"2023-11-04T01:43:59.589504+0000","last_unstale":"2023-11-04T01:44:00.771120+0000","last_undegraded":"2023-11-04T01:44:00.771120+0000","last_fullsized":"2023-11-04T01:44:00.771120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:32.157944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769136+0000","last_change":"2023-11-04T01:43:58.544378+0000","last_active":"2023-11-04T01:44:00.769136+0000","last_peered":"2023-11-04T01:44:00.769136+0000","last_clean":"2023-11-04T01:44:00.769136+0000","last_became_active":"2023-11-04T01:43:58.544037+0000","last_became_peered":"2023-11-04T01:43:58.544037+0000","last_unstale":"2023-11-04T01:44:00.769136+0000","last_undegraded":"2023-11-04T01:44:00.769136+0000","last_fullsized":"2023-11-04T01:44:00.769136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:11.204322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.830189+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:43:53.830189+0000","last_peered":"2023-11-04T01:43:53.830189+0000","last_clean":"2023-11-04T01:43:53.830189+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:43:53.830189+0000","last_undegraded":"2023-11-04T01:43:53.830189+0000","last_fullsized":"2023-11-04T01:43:53.830189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771511+0000","last_change":"2023-11-04T01:43:58.524546+0000","last_active":"2023-11-04T01:44:00.771511+0000","last_peered":"2023-11-04T01:44:00.771511+0000","last_clean":"2023-11-04T01:44:00.771511+0000","last_became_active":"2023-11-04T01:43:58.524078+0000","last_became_peered":"2023-11-04T01:43:58.524078+0000","last_unstale":"2023-11-04T01:44:00.771511+0000","last_undegraded":"2023-11-04T01:44:00.771511+0000","last_fullsized":"2023-11-04T01:44:00.771511+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:47.772617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.834372+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:43:53.834372+0000","last_peered":"2023-11-04T01:43:53.834372+0000","last_clean":"2023-11-04T01:43:53.834372+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:43:53.834372+0000","last_undegraded":"2023-11-04T01:43:53.834372+0000","last_fullsized":"2023-11-04T01:43:53.834372+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772795+0000","last_change":"2023-11-04T01:43:59.576733+0000","last_active":"2023-11-04T01:44:00.772795+0000","last_peered":"2023-11-04T01:44:00.772795+0000","last_clean":"2023-11-04T01:44:00.772795+0000","last_became_active":"2023-11-04T01:43:59.574036+0000","last_became_peered":"2023-11-04T01:43:59.574036+0000","last_unstale":"2023-11-04T01:44:00.772795+0000","last_undegraded":"2023-11-04T01:44:00.772795+0000","last_fullsized":"2023-11-04T01:44:00.772795+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:13.614324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.556476+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:43:59.556476+0000","last_peered":"2023-11-04T01:43:59.556476+0000","last_clean":"2023-11-04T01:43:59.556476+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:43:59.556476+0000","last_undegraded":"2023-11-04T01:43:59.556476+0000","last_fullsized":"2023-11-04T01:43:59.556476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772515+0000","last_change":"2023-11-04T01:43:59.580555+0000","last_active":"2023-11-04T01:44:00.772515+0000","last_peered":"2023-11-04T01:44:00.772515+0000","last_clean":"2023-11-04T01:44:00.772515+0000","last_became_active":"2023-11-04T01:43:59.579848+0000","last_became_peered":"2023-11-04T01:43:59.579848+0000","last_unstale":"2023-11-04T01:44:00.772515+0000","last_undegraded":"2023-11-04T01:44:00.772515+0000","last_fullsized":"2023-11-04T01:44:00.772515+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:45:41.989713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768568+0000","last_change":"2023-11-04T01:43:58.510294+0000","last_active":"2023-11-04T01:44:00.768568+0000","last_peered":"2023-11-04T01:44:00.768568+0000","last_clean":"2023-11-04T01:44:00.768568+0000","last_became_active":"2023-11-04T01:43:58.509164+0000","last_became_peered":"2023-11-04T01:43:58.509164+0000","last_unstale":"2023-11-04T01:44:00.768568+0000","last_undegraded":"2023-11-04T01:44:00.768568+0000","last_fullsized":"2023-11-04T01:44:00.768568+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:03.247324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.532404+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:43:59.532404+0000","last_peered":"2023-11-04T01:43:59.532404+0000","last_clean":"2023-11-04T01:43:59.532404+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:43:59.532404+0000","last_undegraded":"2023-11-04T01:43:59.532404+0000","last_fullsized":"2023-11-04T01:43:59.532404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564910+0000","last_change":"2023-11-04T01:43:59.576138+0000","last_active":"2023-11-04T01:44:00.564910+0000","last_peered":"2023-11-04T01:44:00.564910+0000","last_clean":"2023-11-04T01:44:00.564910+0000","last_became_active":"2023-11-04T01:43:59.573609+0000","last_became_peered":"2023-11-04T01:43:59.573609+0000","last_unstale":"2023-11-04T01:44:00.564910+0000","last_undegraded":"2023-11-04T01:44:00.564910+0000","last_fullsized":"2023-11-04T01:44:00.564910+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:54.809376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771019+0000","last_change":"2023-11-04T01:43:58.541418+0000","last_active":"2023-11-04T01:44:00.771019+0000","last_peered":"2023-11-04T01:44:00.771019+0000","last_clean":"2023-11-04T01:44:00.771019+0000","last_became_active":"2023-11-04T01:43:58.540716+0000","last_became_peered":"2023-11-04T01:43:58.540716+0000","last_unstale":"2023-11-04T01:44:00.771019+0000","last_undegraded":"2023-11-04T01:44:00.771019+0000","last_fullsized":"2023-11-04T01:44:00.771019+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:14.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.546463+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:43:59.546463+0000","last_peered":"2023-11-04T01:43:59.546463+0000","last_clean":"2023-11-04T01:43:59.546463+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:43:59.546463+0000","last_undegraded":"2023-11-04T01:43:59.546463+0000","last_fullsized":"2023-11-04T01:43:59.546463+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.536586+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:43:59.536586+0000","last_peered":"2023-11-04T01:43:59.536586+0000","last_clean":"2023-11-04T01:43:59.536586+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:43:59.536586+0000","last_undegraded":"2023-11-04T01:43:59.536586+0000","last_fullsized":"2023-11-04T01:43:59.536586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":24,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.830297+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:43:53.830297+0000","last_peered":"2023-11-04T01:43:53.830297+0000","last_clean":"2023-11-04T01:43:53.830297+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:43:53.830297+0000","last_undegraded":"2023-11-04T01:43:53.830297+0000","last_fullsized":"2023-11-04T01:43:53.830297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771729+0000","last_change":"2023-11-04T01:43:59.572108+0000","last_active":"2023-11-04T01:44:00.771729+0000","last_peered":"2023-11-04T01:44:00.771729+0000","last_clean":"2023-11-04T01:44:00.771729+0000","last_became_active":"2023-11-04T01:43:59.571467+0000","last_became_peered":"2023-11-04T01:43:59.571467+0000","last_unstale":"2023-11-04T01:44:00.771729+0000","last_undegraded":"2023-11-04T01:44:00.771729+0000","last_fullsized":"2023-11-04T01:44:00.771729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:12.216153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.535828+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:43:59.535828+0000","last_peered":"2023-11-04T01:43:59.535828+0000","last_clean":"2023-11-04T01:43:59.535828+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:43:59.535828+0000","last_undegraded":"2023-11-04T01:43:59.535828+0000","last_fullsized":"2023-11-04T01:43:59.535828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768959+0000","last_change":"2023-11-04T01:43:59.566828+0000","last_active":"2023-11-04T01:44:00.768959+0000","last_peered":"2023-11-04T01:44:00.768959+0000","last_clean":"2023-11-04T01:44:00.768959+0000","last_became_active":"2023-11-04T01:43:59.565932+0000","last_became_peered":"2023-11-04T01:43:59.565932+0000","last_unstale":"2023-11-04T01:44:00.768959+0000","last_undegraded":"2023-11-04T01:44:00.768959+0000","last_fullsized":"2023-11-04T01:44:00.768959+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:09.790481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561084+0000","last_change":"2023-11-04T01:43:58.543677+0000","last_active":"2023-11-04T01:44:00.561084+0000","last_peered":"2023-11-04T01:44:00.561084+0000","last_clean":"2023-11-04T01:44:00.561084+0000","last_became_active":"2023-11-04T01:43:58.542920+0000","last_became_peered":"2023-11-04T01:43:58.542920+0000","last_unstale":"2023-11-04T01:44:00.561084+0000","last_undegraded":"2023-11-04T01:44:00.561084+0000","last_fullsized":"2023-11-04T01:44:00.561084+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:03.247324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.549109+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:43:59.549109+0000","last_peered":"2023-11-04T01:43:59.549109+0000","last_clean":"2023-11-04T01:43:59.549109+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:43:59.549109+0000","last_undegraded":"2023-11-04T01:43:59.549109+0000","last_fullsized":"2023-11-04T01:43:59.549109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564080+0000","last_change":"2023-11-04T01:43:58.546713+0000","last_active":"2023-11-04T01:44:00.564080+0000","last_peered":"2023-11-04T01:44:00.564080+0000","last_clean":"2023-11-04T01:44:00.564080+0000","last_became_active":"2023-11-04T01:43:58.546023+0000","last_became_peered":"2023-11-04T01:43:58.546023+0000","last_unstale":"2023-11-04T01:44:00.564080+0000","last_undegraded":"2023-11-04T01:44:00.564080+0000","last_fullsized":"2023-11-04T01:44:00.564080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:39.233107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.947135+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:43:53.947135+0000","last_peered":"2023-11-04T01:43:53.947135+0000","last_clean":"2023-11-04T01:43:53.947135+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:43:53.947135+0000","last_undegraded":"2023-11-04T01:43:53.947135+0000","last_fullsized":"2023-11-04T01:43:53.947135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.553510+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:43:59.553510+0000","last_peered":"2023-11-04T01:43:59.553510+0000","last_clean":"2023-11-04T01:43:59.553510+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:43:59.553510+0000","last_undegraded":"2023-11-04T01:43:59.553510+0000","last_fullsized":"2023-11-04T01:43:59.553510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561181+0000","last_change":"2023-11-04T01:43:59.576200+0000","last_active":"2023-11-04T01:44:00.561181+0000","last_peered":"2023-11-04T01:44:00.561181+0000","last_clean":"2023-11-04T01:44:00.561181+0000","last_became_active":"2023-11-04T01:43:59.574913+0000","last_became_peered":"2023-11-04T01:43:59.574913+0000","last_unstale":"2023-11-04T01:44:00.561181+0000","last_undegraded":"2023-11-04T01:44:00.561181+0000","last_fullsized":"2023-11-04T01:44:00.561181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:18:30.245340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.533998+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:43:59.533998+0000","last_peered":"2023-11-04T01:43:59.533998+0000","last_clean":"2023-11-04T01:43:59.533998+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:43:59.533998+0000","last_undegraded":"2023-11-04T01:43:59.533998+0000","last_fullsized":"2023-11-04T01:43:59.533998+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563028+0000","last_change":"2023-11-04T01:43:58.529030+0000","last_active":"2023-11-04T01:44:00.563028+0000","last_peered":"2023-11-04T01:44:00.563028+0000","last_clean":"2023-11-04T01:44:00.563028+0000","last_became_active":"2023-11-04T01:43:58.528325+0000","last_became_peered":"2023-11-04T01:43:58.528325+0000","last_unstale":"2023-11-04T01:44:00.563028+0000","last_undegraded":"2023-11-04T01:44:00.563028+0000","last_fullsized":"2023-11-04T01:44:00.563028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:36.518722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.834164+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:43:53.834164+0000","last_peered":"2023-11-04T01:43:53.834164+0000","last_clean":"2023-11-04T01:43:53.834164+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:43:53.834164+0000","last_undegraded":"2023-11-04T01:43:53.834164+0000","last_fullsized":"2023-11-04T01:43:53.834164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:57.472947+0000","last_change":"2023-11-04T01:43:57.472947+0000","last_active":"2023-11-04T01:43:57.472947+0000","last_peered":"2023-11-04T01:43:57.472947+0000","last_clean":"2023-11-04T01:43:57.472947+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:57.472947+0000","last_undegraded":"2023-11-04T01:43:57.472947+0000","last_fullsized":"2023-11-04T01:43:57.472947+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.946895+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:43:53.946895+0000","last_peered":"2023-11-04T01:43:53.946895+0000","last_clean":"2023-11-04T01:43:53.946895+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:43:53.946895+0000","last_undegraded":"2023-11-04T01:43:53.946895+0000","last_fullsized":"2023-11-04T01:43:53.946895+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772169+0000","last_change":"2023-11-04T01:43:58.539825+0000","last_active":"2023-11-04T01:44:00.772169+0000","last_peered":"2023-11-04T01:44:00.772169+0000","last_clean":"2023-11-04T01:44:00.772169+0000","last_became_active":"2023-11-04T01:43:58.539306+0000","last_became_peered":"2023-11-04T01:43:58.539306+0000","last_unstale":"2023-11-04T01:44:00.772169+0000","last_undegraded":"2023-11-04T01:44:00.772169+0000","last_fullsized":"2023-11-04T01:44:00.772169+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:15.058931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.557677+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:43:59.557677+0000","last_peered":"2023-11-04T01:43:59.557677+0000","last_clean":"2023-11-04T01:43:59.557677+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:43:59.557677+0000","last_undegraded":"2023-11-04T01:43:59.557677+0000","last_fullsized":"2023-11-04T01:43:59.557677+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:43:58.484778+0000","last_change":"2023-11-04T01:43:58.484778+0000","last_active":"2023-11-04T01:43:58.484778+0000","last_peered":"2023-11-04T01:43:58.484778+0000","last_clean":"2023-11-04T01:43:58.484778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:43:58.484778+0000","last_undegraded":"2023-11-04T01:43:58.484778+0000","last_fullsized":"2023-11-04T01:43:58.484778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560729+0000","last_change":"2023-11-04T01:43:58.529607+0000","last_active":"2023-11-04T01:44:00.560729+0000","last_peered":"2023-11-04T01:44:00.560729+0000","last_clean":"2023-11-04T01:44:00.560729+0000","last_became_active":"2023-11-04T01:43:58.528232+0000","last_became_peered":"2023-11-04T01:43:58.528232+0000","last_unstale":"2023-11-04T01:44:00.560729+0000","last_undegraded":"2023-11-04T01:44:00.560729+0000","last_fullsized":"2023-11-04T01:44:00.560729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:10.261302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":22,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-04T01:43:53.947138+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:43:53.947138+0000","last_peered":"2023-11-04T01:43:53.947138+0000","last_clean":"2023-11-04T01:43:53.947138+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:43:53.947138+0000","last_undegraded":"2023-11-04T01:43:53.947138+0000","last_fullsized":"2023-11-04T01:43:53.947138+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560318+0000","last_change":"2023-11-04T01:43:59.575329+0000","last_active":"2023-11-04T01:44:00.560318+0000","last_peered":"2023-11-04T01:44:00.560318+0000","last_clean":"2023-11-04T01:44:00.560318+0000","last_became_active":"2023-11-04T01:43:59.574544+0000","last_became_peered":"2023-11-04T01:43:59.574544+0000","last_unstale":"2023-11-04T01:44:00.560318+0000","last_undegraded":"2023-11-04T01:44:00.560318+0000","last_fullsized":"2023-11-04T01:44:00.560318+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:41.249719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769093+0000","last_change":"2023-11-04T01:43:58.532478+0000","last_active":"2023-11-04T01:44:00.769093+0000","last_peered":"2023-11-04T01:44:00.769093+0000","last_clean":"2023-11-04T01:44:00.769093+0000","last_became_active":"2023-11-04T01:43:58.532050+0000","last_became_peered":"2023-11-04T01:43:58.532050+0000","last_unstale":"2023-11-04T01:44:00.769093+0000","last_undegraded":"2023-11-04T01:44:00.769093+0000","last_fullsized":"2023-11-04T01:44:00.769093+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:26.374193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.557650+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:43:59.557650+0000","last_peered":"2023-11-04T01:43:59.557650+0000","last_clean":"2023-11-04T01:43:59.557650+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:43:59.557650+0000","last_undegraded":"2023-11-04T01:43:59.557650+0000","last_fullsized":"2023-11-04T01:43:59.557650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":5},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":42,"acting":42,"num_store_stats":5},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509464,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1126400,"data_stored":811140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.434}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.99199999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.753}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.0600000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.86699999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.147},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.026}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":532480,"data_stored":220772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.501},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.71699999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.083},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.879}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.90200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.141}]}]},{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":240754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.085},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.232}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.1150000000000002,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.117},{"interface":"front","average":{"1min":2.786,"5min":2.786,"15min":2.786},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":40.195,"5min":40.195,"15min":40.195},"last":1.3080000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.268}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":241280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.202}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.444},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.66200000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.298}]},{"osd":3,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.546}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.002}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.484}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1539999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1191936,"data_stored":839421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.159}]},{"osd":1,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0920000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.002}]},{"osd":3,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.052}]},{"osd":4,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.288}]},{"osd":7,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.1950000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":242402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.2470000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.46},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.546}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1279999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.3859999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.292},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.8220000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":520192,"data_stored":215292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.748},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.85099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.5629999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.1890000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.0029999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.718}]},{"osd":6,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.7709999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.6499999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":240732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70299999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.075}]},{"osd":6,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0169999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.755},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.97999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:44:02.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:44:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.796+0000 7f7a78f43640 1 Processor -- start 2023-11-04T01:44:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.796+0000 7f7a78f43640 1 -- start start 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a78f43640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7a7415e360 0x7f7a740b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a78f43640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7406cfd0 con 0x7f7a740b0630 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a78f43640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7415e830 con 0x7f7a74159fc0 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a78f43640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740ca030 con 0x7f7a7415e360 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a71d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7a740b0630 0x7f7a7415dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44046/0 (socket says 172.21.15.2:44046) 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a71d9b640 1 -- 172.21.15.2:0/1731947751 learned_addr learned my addr 172.21.15.2:0/1731947751 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a72d9d640 1 --2- 172.21.15.2:0/1731947751 >> v2:172.21.15.90:3300/0 conn(0x7f7a7415e360 0x7f7a740b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878035537 0 0) 0x7f7a7406cfd0 con 0x7f7a740b0630 2023-11-04T01:44:02.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a5c003530 con 0x7f7a740b0630 2023-11-04T01:44:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3363399786 0 0) 0x7f7a5c003530 con 0x7f7a740b0630 2023-11-04T01:44:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 >> v2:172.21.15.90:3300/0 conn(0x7f7a7415e360 msgr2=0x7f7a740b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 --2- 172.21.15.2:0/1731947751 >> v2:172.21.15.90:3300/0 conn(0x7f7a7415e360 0x7f7a740b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 >> v1:172.21.15.90:6789/0 conn(0x7f7a74159fc0 legacy=0x7f7a740ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7415eb10 con 0x7f7a740b0630 2023-11-04T01:44:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f7a68001680 con 0x7f7a740b0630 2023-11-04T01:44:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 >> v1:172.21.15.2:6789/0 conn(0x7f7a740b0630 legacy=0x7f7a7415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a5c003980 0x7f7a5c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c0047d0 0x7f7a5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a5c005190 0x7f7a5c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740ca030 con 0x7f7a5c003980 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c00c0e0 con 0x7f7a5c005190 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c00c2a0 con 0x7f7a5c0047d0 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7259c640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a5c003980 0x7f7a5c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a72d9d640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a5c005190 0x7f7a5c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a71d9b640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c0047d0 0x7f7a5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7259c640 1 -- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c0047d0 msgr2=0x7f7a5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7259c640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c0047d0 0x7f7a5c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7259c640 1 -- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a5c005190 msgr2=0x7f7a5c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7259c640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a5c005190 0x7f7a5c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a7259c640 1 -- 172.21.15.2:0/1731947751 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c003530 con 0x7f7a5c003980 2023-11-04T01:44:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a72d9d640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a5c005190 0x7f7a5c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.800+0000 7f7a72d9d640 1 -- 172.21.15.2:0/1731947751 reap_dead start 2023-11-04T01:44:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a7259c640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a5c003980 0x7f7a5c003da0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001780 tx=0x7f7a6401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e082b1d746cc2593 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640052d0 con 0x7f7a5c003980 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640a7050 con 0x7f7a5c003980 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a7159a640 1 -- 172.21.15.2:0/1731947751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64003600 con 0x7f7a5c003980 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- 172.21.15.2:0/1731947751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a5c003980 msgr2=0x7f7a5c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a5c003980 0x7f7a5c003da0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001780 tx=0x7f7a6401c3b0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- 172.21.15.2:0/1731947751 shutdown_connections 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 --2- 172.21.15.2:0/1731947751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a5c003980 0x7f7a5c003da0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- 172.21.15.2:0/1731947751 >> 172.21.15.2:0/1731947751 conn(0x7f7a740cebb0 msgr2=0x7f7a740cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- 172.21.15.2:0/1731947751 shutdown_connections 2023-11-04T01:44:02.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- 172.21.15.2:0/1731947751 wait complete. 2023-11-04T01:44:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 Processor -- start 2023-11-04T01:44:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- start start 2023-11-04T01:44:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003980 0x7f7a741f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415b3f0 0x7f7a740c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a74070c50 0x7f7a740c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74152410 con 0x7f7a7415b3f0 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a741520c0 con 0x7f7a74070c50 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a78f43640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740c6df0 con 0x7f7a5c003980 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415b3f0 0x7f7a740c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415b3f0 0x7f7a740c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49294/0 (socket says 172.21.15.2:49294) 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 -- 172.21.15.2:0/3967657300 learned_addr learned my addr 172.21.15.2:0/3967657300 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a72d9d640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a74070c50 0x7f7a740c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a7259c640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003980 0x7f7a741f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 -- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003980 msgr2=0x7f7a741f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003980 0x7f7a741f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 -- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a74070c50 msgr2=0x7f7a740c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a74070c50 0x7f7a740c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a71d9b640 1 -- 172.21.15.2:0/3967657300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7415bbd0 con 0x7f7a7415b3f0 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.804+0000 7f7a7259c640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003980 0x7f7a741f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:02.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a71d9b640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415b3f0 0x7f7a740c68b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800d810 tx=0x7f7a6800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a62ffd640 1 -- 172.21.15.2:0/3967657300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a680074e0 con 0x7f7a7415b3f0 2023-11-04T01:44:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a62ffd640 1 -- 172.21.15.2:0/3967657300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a68007640 con 0x7f7a7415b3f0 2023-11-04T01:44:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7415beb0 con 0x7f7a7415b3f0 2023-11-04T01:44:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a62ffd640 1 -- 172.21.15.2:0/3967657300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68004a10 con 0x7f7a7415b3f0 2023-11-04T01:44:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7415b870 con 0x7f7a7415b3f0 2023-11-04T01:44:02.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a74152550 con 0x7f7a7415b3f0 2023-11-04T01:44:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a62ffd640 1 -- 172.21.15.2:0/3967657300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a68004b70 con 0x7f7a7415b3f0 2023-11-04T01:44:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a62ffd640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a62ffd640 1 -- 172.21.15.2:0/3967657300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a68083c80 con 0x7f7a7415b3f0 2023-11-04T01:44:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a7259c640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:02.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.808+0000 7f7a7259c640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001750 tx=0x7f7a640011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:02.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.812+0000 7f7a62ffd640 1 -- 172.21.15.2:0/3967657300 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a74152550 con 0x7f7a7415b3f0 2023-11-04T01:44:02.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.960+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a740b0e70 con 0x7f7a540664a0 2023-11-04T01:44:02.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.988+0000 7f7a62ffd640 1 -- 172.21.15.2:0/3967657300 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368163 (secure 0 0 0) 0x7f7a64005330 con 0x7f7a540664a0 2023-11-04T01:44:02.995 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:02.997 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 msgr2=0x7f7a54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001750 tx=0x7f7a640011a0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415b3f0 msgr2=0x7f7a740c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415b3f0 0x7f7a740c68b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800d810 tx=0x7f7a6800dcd0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 shutdown_connections 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a74070c50 0x7f7a740c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415b3f0 0x7f7a740c68b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 --2- 172.21.15.2:0/3967657300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a5c003980 0x7f7a741f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 >> 172.21.15.2:0/3967657300 conn(0x7f7a740cebb0 msgr2=0x7f7a740b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 shutdown_connections 2023-11-04T01:44:02.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:02.992+0000 7f7a78f43640 1 -- 172.21.15.2:0/3967657300 wait complete. 2023-11-04T01:44:03.012 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-11-04T01:44:02.805615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":242704,"kb_used_data":5708,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732016,"statfs":{"total":773094113280,"available":772845584384,"internally_reserved":0,"allocated":5844992,"data_stored":3131099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.317246"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.773080+0000","last_change":"2023-11-04T01:43:59.588912+0000","last_active":"2023-11-04T01:44:00.773080+0000","last_peered":"2023-11-04T01:44:00.773080+0000","last_clean":"2023-11-04T01:44:00.773080+0000","last_became_active":"2023-11-04T01:43:59.588070+0000","last_became_peered":"2023-11-04T01:43:59.588070+0000","last_unstale":"2023-11-04T01:44:00.773080+0000","last_undegraded":"2023-11-04T01:44:00.773080+0000","last_fullsized":"2023-11-04T01:44:00.773080+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:56:46.907230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768988+0000","last_change":"2023-11-04T01:43:59.569582+0000","last_active":"2023-11-04T01:44:00.768988+0000","last_peered":"2023-11-04T01:44:00.768988+0000","last_clean":"2023-11-04T01:44:00.768988+0000","last_became_active":"2023-11-04T01:43:59.568610+0000","last_became_peered":"2023-11-04T01:43:59.568610+0000","last_unstale":"2023-11-04T01:44:00.768988+0000","last_undegraded":"2023-11-04T01:44:00.768988+0000","last_fullsized":"2023-11-04T01:44:00.768988+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:14.693026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564385+0000","last_change":"2023-11-04T01:43:59.578822+0000","last_active":"2023-11-04T01:44:00.564385+0000","last_peered":"2023-11-04T01:44:00.564385+0000","last_clean":"2023-11-04T01:44:00.564385+0000","last_became_active":"2023-11-04T01:43:59.578118+0000","last_became_peered":"2023-11-04T01:43:59.578118+0000","last_unstale":"2023-11-04T01:44:00.564385+0000","last_undegraded":"2023-11-04T01:44:00.564385+0000","last_fullsized":"2023-11-04T01:44:00.564385+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:12:10.243322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770243+0000","last_change":"2023-11-04T01:43:59.563205+0000","last_active":"2023-11-04T01:44:00.770243+0000","last_peered":"2023-11-04T01:44:00.770243+0000","last_clean":"2023-11-04T01:44:00.770243+0000","last_became_active":"2023-11-04T01:43:59.562400+0000","last_became_peered":"2023-11-04T01:43:59.562400+0000","last_unstale":"2023-11-04T01:44:00.770243+0000","last_undegraded":"2023-11-04T01:44:00.770243+0000","last_fullsized":"2023-11-04T01:44:00.770243+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:32.648560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768982+0000","last_change":"2023-11-04T01:43:59.569750+0000","last_active":"2023-11-04T01:44:00.768982+0000","last_peered":"2023-11-04T01:44:00.768982+0000","last_clean":"2023-11-04T01:44:00.768982+0000","last_became_active":"2023-11-04T01:43:59.569028+0000","last_became_peered":"2023-11-04T01:43:59.569028+0000","last_unstale":"2023-11-04T01:44:00.768982+0000","last_undegraded":"2023-11-04T01:44:00.768982+0000","last_fullsized":"2023-11-04T01:44:00.768982+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:08.173970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771545+0000","last_change":"2023-11-04T01:43:59.580893+0000","last_active":"2023-11-04T01:44:00.771545+0000","last_peered":"2023-11-04T01:44:00.771545+0000","last_clean":"2023-11-04T01:44:00.771545+0000","last_became_active":"2023-11-04T01:43:59.579744+0000","last_became_peered":"2023-11-04T01:43:59.579744+0000","last_unstale":"2023-11-04T01:44:00.771545+0000","last_undegraded":"2023-11-04T01:44:00.771545+0000","last_fullsized":"2023-11-04T01:44:00.771545+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:07:50.426988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559653+0000","last_change":"2023-11-04T01:43:59.576275+0000","last_active":"2023-11-04T01:44:00.559653+0000","last_peered":"2023-11-04T01:44:00.559653+0000","last_clean":"2023-11-04T01:44:00.559653+0000","last_became_active":"2023-11-04T01:43:59.575220+0000","last_became_peered":"2023-11-04T01:43:59.575220+0000","last_unstale":"2023-11-04T01:44:00.559653+0000","last_undegraded":"2023-11-04T01:44:00.559653+0000","last_fullsized":"2023-11-04T01:44:00.559653+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:42:44.058812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770702+0000","last_change":"2023-11-04T01:43:59.580501+0000","last_active":"2023-11-04T01:44:00.770702+0000","last_peered":"2023-11-04T01:44:00.770702+0000","last_clean":"2023-11-04T01:44:00.770702+0000","last_became_active":"2023-11-04T01:43:59.579714+0000","last_became_peered":"2023-11-04T01:43:59.579714+0000","last_unstale":"2023-11-04T01:44:00.770702+0000","last_undegraded":"2023-11-04T01:44:00.770702+0000","last_fullsized":"2023-11-04T01:44:00.770702+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:46.736218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564701+0000","last_change":"2023-11-04T01:43:59.584156+0000","last_active":"2023-11-04T01:44:00.564701+0000","last_peered":"2023-11-04T01:44:00.564701+0000","last_clean":"2023-11-04T01:44:00.564701+0000","last_became_active":"2023-11-04T01:43:59.583023+0000","last_became_peered":"2023-11-04T01:43:59.583023+0000","last_unstale":"2023-11-04T01:44:00.564701+0000","last_undegraded":"2023-11-04T01:44:00.564701+0000","last_fullsized":"2023-11-04T01:44:00.564701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:10:28.616489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560860+0000","last_change":"2023-11-04T01:43:59.575591+0000","last_active":"2023-11-04T01:44:00.560860+0000","last_peered":"2023-11-04T01:44:00.560860+0000","last_clean":"2023-11-04T01:44:00.560860+0000","last_became_active":"2023-11-04T01:43:59.574148+0000","last_became_peered":"2023-11-04T01:43:59.574148+0000","last_unstale":"2023-11-04T01:44:00.560860+0000","last_undegraded":"2023-11-04T01:44:00.560860+0000","last_fullsized":"2023-11-04T01:44:00.560860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:14:50.229236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772591+0000","last_change":"2023-11-04T01:43:59.577182+0000","last_active":"2023-11-04T01:44:00.772591+0000","last_peered":"2023-11-04T01:44:00.772591+0000","last_clean":"2023-11-04T01:44:00.772591+0000","last_became_active":"2023-11-04T01:43:59.576079+0000","last_became_peered":"2023-11-04T01:43:59.576079+0000","last_unstale":"2023-11-04T01:44:00.772591+0000","last_undegraded":"2023-11-04T01:44:00.772591+0000","last_fullsized":"2023-11-04T01:44:00.772591+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:11.273133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772015+0000","last_change":"2023-11-04T01:43:59.588720+0000","last_active":"2023-11-04T01:44:00.772015+0000","last_peered":"2023-11-04T01:44:00.772015+0000","last_clean":"2023-11-04T01:44:00.772015+0000","last_became_active":"2023-11-04T01:43:59.588159+0000","last_became_peered":"2023-11-04T01:43:59.588159+0000","last_unstale":"2023-11-04T01:44:00.772015+0000","last_undegraded":"2023-11-04T01:44:00.772015+0000","last_fullsized":"2023-11-04T01:44:00.772015+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:37:17.353223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771440+0000","last_change":"2023-11-04T01:43:59.568958+0000","last_active":"2023-11-04T01:44:00.771440+0000","last_peered":"2023-11-04T01:44:00.771440+0000","last_clean":"2023-11-04T01:44:00.771440+0000","last_became_active":"2023-11-04T01:43:59.568192+0000","last_became_peered":"2023-11-04T01:43:59.568192+0000","last_unstale":"2023-11-04T01:44:00.771440+0000","last_undegraded":"2023-11-04T01:44:00.771440+0000","last_fullsized":"2023-11-04T01:44:00.771440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:34:55.520333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771261+0000","last_change":"2023-11-04T01:43:59.567673+0000","last_active":"2023-11-04T01:44:00.771261+0000","last_peered":"2023-11-04T01:44:00.771261+0000","last_clean":"2023-11-04T01:44:00.771261+0000","last_became_active":"2023-11-04T01:43:59.566908+0000","last_became_peered":"2023-11-04T01:43:59.566908+0000","last_unstale":"2023-11-04T01:44:00.771261+0000","last_undegraded":"2023-11-04T01:44:00.771261+0000","last_fullsized":"2023-11-04T01:44:00.771261+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:27.386024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769808+0000","last_change":"2023-11-04T01:43:59.582620+0000","last_active":"2023-11-04T01:44:00.769808+0000","last_peered":"2023-11-04T01:44:00.769808+0000","last_clean":"2023-11-04T01:44:00.769808+0000","last_became_active":"2023-11-04T01:43:59.581979+0000","last_became_peered":"2023-11-04T01:43:59.581979+0000","last_unstale":"2023-11-04T01:44:00.769808+0000","last_undegraded":"2023-11-04T01:44:00.769808+0000","last_fullsized":"2023-11-04T01:44:00.769808+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:10:34.360267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771547+0000","last_change":"2023-11-04T01:43:59.589039+0000","last_active":"2023-11-04T01:44:00.771547+0000","last_peered":"2023-11-04T01:44:00.771547+0000","last_clean":"2023-11-04T01:44:00.771547+0000","last_became_active":"2023-11-04T01:43:59.588357+0000","last_became_peered":"2023-11-04T01:43:59.588357+0000","last_unstale":"2023-11-04T01:44:00.771547+0000","last_undegraded":"2023-11-04T01:44:00.771547+0000","last_fullsized":"2023-11-04T01:44:00.771547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:45:18.880660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.773694+0000","last_change":"2023-11-04T01:43:59.580164+0000","last_active":"2023-11-04T01:44:00.773694+0000","last_peered":"2023-11-04T01:44:00.773694+0000","last_clean":"2023-11-04T01:44:00.773694+0000","last_became_active":"2023-11-04T01:43:59.578819+0000","last_became_peered":"2023-11-04T01:43:59.578819+0000","last_unstale":"2023-11-04T01:44:00.773694+0000","last_undegraded":"2023-11-04T01:44:00.773694+0000","last_fullsized":"2023-11-04T01:44:00.773694+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:18.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770206+0000","last_change":"2023-11-04T01:43:59.563215+0000","last_active":"2023-11-04T01:44:00.770206+0000","last_peered":"2023-11-04T01:44:00.770206+0000","last_clean":"2023-11-04T01:44:00.770206+0000","last_became_active":"2023-11-04T01:43:59.562225+0000","last_became_peered":"2023-11-04T01:43:59.562225+0000","last_unstale":"2023-11-04T01:44:00.770206+0000","last_undegraded":"2023-11-04T01:44:00.770206+0000","last_fullsized":"2023-11-04T01:44:00.770206+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:31.071314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.565161+0000","last_change":"2023-11-04T01:43:59.548706+0000","last_active":"2023-11-04T01:44:00.565161+0000","last_peered":"2023-11-04T01:44:00.565161+0000","last_clean":"2023-11-04T01:44:00.565161+0000","last_became_active":"2023-11-04T01:43:59.547619+0000","last_became_peered":"2023-11-04T01:43:59.547619+0000","last_unstale":"2023-11-04T01:44:00.565161+0000","last_undegraded":"2023-11-04T01:44:00.565161+0000","last_fullsized":"2023-11-04T01:44:00.565161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:02.878241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768951+0000","last_change":"2023-11-04T01:43:59.581793+0000","last_active":"2023-11-04T01:44:00.768951+0000","last_peered":"2023-11-04T01:44:00.768951+0000","last_clean":"2023-11-04T01:44:00.768951+0000","last_became_active":"2023-11-04T01:43:59.580936+0000","last_became_peered":"2023-11-04T01:43:59.580936+0000","last_unstale":"2023-11-04T01:44:00.768951+0000","last_undegraded":"2023-11-04T01:44:00.768951+0000","last_fullsized":"2023-11-04T01:44:00.768951+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:18.732219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770011+0000","last_change":"2023-11-04T01:43:59.556358+0000","last_active":"2023-11-04T01:44:00.770011+0000","last_peered":"2023-11-04T01:44:00.770011+0000","last_clean":"2023-11-04T01:44:00.770011+0000","last_became_active":"2023-11-04T01:43:59.555481+0000","last_became_peered":"2023-11-04T01:43:59.555481+0000","last_unstale":"2023-11-04T01:44:00.770011+0000","last_undegraded":"2023-11-04T01:44:00.770011+0000","last_fullsized":"2023-11-04T01:44:00.770011+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:22.964087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564244+0000","last_change":"2023-11-04T01:43:59.581216+0000","last_active":"2023-11-04T01:44:00.564244+0000","last_peered":"2023-11-04T01:44:00.564244+0000","last_clean":"2023-11-04T01:44:00.564244+0000","last_became_active":"2023-11-04T01:43:59.580399+0000","last_became_peered":"2023-11-04T01:43:59.580399+0000","last_unstale":"2023-11-04T01:44:00.564244+0000","last_undegraded":"2023-11-04T01:44:00.564244+0000","last_fullsized":"2023-11-04T01:44:00.564244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:04.867632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563605+0000","last_change":"2023-11-04T01:43:59.583162+0000","last_active":"2023-11-04T01:44:00.563605+0000","last_peered":"2023-11-04T01:44:00.563605+0000","last_clean":"2023-11-04T01:44:00.563605+0000","last_became_active":"2023-11-04T01:43:59.582216+0000","last_became_peered":"2023-11-04T01:43:59.582216+0000","last_unstale":"2023-11-04T01:44:00.563605+0000","last_undegraded":"2023-11-04T01:44:00.563605+0000","last_fullsized":"2023-11-04T01:44:00.563605+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:56:07.832056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563370+0000","last_change":"2023-11-04T01:43:59.576887+0000","last_active":"2023-11-04T01:44:00.563370+0000","last_peered":"2023-11-04T01:44:00.563370+0000","last_clean":"2023-11-04T01:44:00.563370+0000","last_became_active":"2023-11-04T01:43:59.576108+0000","last_became_peered":"2023-11-04T01:43:59.576108+0000","last_unstale":"2023-11-04T01:44:00.563370+0000","last_undegraded":"2023-11-04T01:44:00.563370+0000","last_fullsized":"2023-11-04T01:44:00.563370+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:10:45.510378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.773386+0000","last_change":"2023-11-04T01:43:59.578503+0000","last_active":"2023-11-04T01:44:00.773386+0000","last_peered":"2023-11-04T01:44:00.773386+0000","last_clean":"2023-11-04T01:44:00.773386+0000","last_became_active":"2023-11-04T01:43:59.577586+0000","last_became_peered":"2023-11-04T01:43:59.577586+0000","last_unstale":"2023-11-04T01:44:00.773386+0000","last_undegraded":"2023-11-04T01:44:00.773386+0000","last_fullsized":"2023-11-04T01:44:00.773386+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:38.596636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564790+0000","last_change":"2023-11-04T01:43:59.567964+0000","last_active":"2023-11-04T01:44:00.564790+0000","last_peered":"2023-11-04T01:44:00.564790+0000","last_clean":"2023-11-04T01:44:00.564790+0000","last_became_active":"2023-11-04T01:43:59.567217+0000","last_became_peered":"2023-11-04T01:43:59.567217+0000","last_unstale":"2023-11-04T01:44:00.564790+0000","last_undegraded":"2023-11-04T01:44:00.564790+0000","last_fullsized":"2023-11-04T01:44:00.564790+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:23.736077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772294+0000","last_change":"2023-11-04T01:43:59.591488+0000","last_active":"2023-11-04T01:44:00.772294+0000","last_peered":"2023-11-04T01:44:00.772294+0000","last_clean":"2023-11-04T01:44:00.772294+0000","last_became_active":"2023-11-04T01:43:59.590918+0000","last_became_peered":"2023-11-04T01:43:59.590918+0000","last_unstale":"2023-11-04T01:44:00.772294+0000","last_undegraded":"2023-11-04T01:44:00.772294+0000","last_fullsized":"2023-11-04T01:44:00.772294+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:35:32.746550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768860+0000","last_change":"2023-11-04T01:43:59.588352+0000","last_active":"2023-11-04T01:44:00.768860+0000","last_peered":"2023-11-04T01:44:00.768860+0000","last_clean":"2023-11-04T01:44:00.768860+0000","last_became_active":"2023-11-04T01:43:59.587584+0000","last_became_peered":"2023-11-04T01:43:59.587584+0000","last_unstale":"2023-11-04T01:44:00.768860+0000","last_undegraded":"2023-11-04T01:44:00.768860+0000","last_fullsized":"2023-11-04T01:44:00.768860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:38.596636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772293+0000","last_change":"2023-11-04T01:43:59.567815+0000","last_active":"2023-11-04T01:44:00.772293+0000","last_peered":"2023-11-04T01:44:00.772293+0000","last_clean":"2023-11-04T01:44:00.772293+0000","last_became_active":"2023-11-04T01:43:59.566956+0000","last_became_peered":"2023-11-04T01:43:59.566956+0000","last_unstale":"2023-11-04T01:44:00.772293+0000","last_undegraded":"2023-11-04T01:44:00.772293+0000","last_fullsized":"2023-11-04T01:44:00.772293+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:04.259155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769504+0000","last_change":"2023-11-04T01:43:59.564471+0000","last_active":"2023-11-04T01:44:00.769504+0000","last_peered":"2023-11-04T01:44:00.769504+0000","last_clean":"2023-11-04T01:44:00.769504+0000","last_became_active":"2023-11-04T01:43:59.563722+0000","last_became_peered":"2023-11-04T01:43:59.563722+0000","last_unstale":"2023-11-04T01:44:00.769504+0000","last_undegraded":"2023-11-04T01:44:00.769504+0000","last_fullsized":"2023-11-04T01:44:00.769504+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:39:50.351146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563639+0000","last_change":"2023-11-04T01:43:59.580166+0000","last_active":"2023-11-04T01:44:00.563639+0000","last_peered":"2023-11-04T01:44:00.563639+0000","last_clean":"2023-11-04T01:44:00.563639+0000","last_became_active":"2023-11-04T01:43:59.579371+0000","last_became_peered":"2023-11-04T01:43:59.579371+0000","last_unstale":"2023-11-04T01:44:00.563639+0000","last_undegraded":"2023-11-04T01:44:00.563639+0000","last_fullsized":"2023-11-04T01:44:00.563639+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:48:18.301112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768447+0000","last_change":"2023-11-04T01:43:59.577665+0000","last_active":"2023-11-04T01:44:00.768447+0000","last_peered":"2023-11-04T01:44:00.768447+0000","last_clean":"2023-11-04T01:44:00.768447+0000","last_became_active":"2023-11-04T01:43:59.576866+0000","last_became_peered":"2023-11-04T01:43:59.576866+0000","last_unstale":"2023-11-04T01:44:00.768447+0000","last_undegraded":"2023-11-04T01:44:00.768447+0000","last_fullsized":"2023-11-04T01:44:00.768447+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:11.273133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560453+0000","last_change":"2023-11-04T01:43:59.583250+0000","last_active":"2023-11-04T01:44:00.560453+0000","last_peered":"2023-11-04T01:44:00.560453+0000","last_clean":"2023-11-04T01:44:00.560453+0000","last_became_active":"2023-11-04T01:43:59.582397+0000","last_became_peered":"2023-11-04T01:43:59.582397+0000","last_unstale":"2023-11-04T01:44:00.560453+0000","last_undegraded":"2023-11-04T01:44:00.560453+0000","last_fullsized":"2023-11-04T01:44:00.560453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:56:46.907230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561683+0000","last_change":"2023-11-04T01:43:58.543196+0000","last_active":"2023-11-04T01:44:00.561683+0000","last_peered":"2023-11-04T01:44:00.561683+0000","last_clean":"2023-11-04T01:44:00.561683+0000","last_became_active":"2023-11-04T01:43:58.542375+0000","last_became_peered":"2023-11-04T01:43:58.542375+0000","last_unstale":"2023-11-04T01:44:00.561683+0000","last_undegraded":"2023-11-04T01:44:00.561683+0000","last_fullsized":"2023-11-04T01:44:00.561683+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:14:13.681195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":191,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.529847+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:43:59.529847+0000","last_peered":"2023-11-04T01:43:59.529847+0000","last_clean":"2023-11-04T01:43:59.529847+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:43:59.529847+0000","last_undegraded":"2023-11-04T01:43:59.529847+0000","last_fullsized":"2023-11-04T01:43:59.529847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.539855+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:43:59.539855+0000","last_peered":"2023-11-04T01:43:59.539855+0000","last_clean":"2023-11-04T01:43:59.539855+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:43:59.539855+0000","last_undegraded":"2023-11-04T01:43:59.539855+0000","last_fullsized":"2023-11-04T01:43:59.539855+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560854+0000","last_change":"2023-11-04T01:43:59.585132+0000","last_active":"2023-11-04T01:44:00.560854+0000","last_peered":"2023-11-04T01:44:00.560854+0000","last_clean":"2023-11-04T01:44:00.560854+0000","last_became_active":"2023-11-04T01:43:59.582345+0000","last_became_peered":"2023-11-04T01:43:59.582345+0000","last_unstale":"2023-11-04T01:44:00.560854+0000","last_undegraded":"2023-11-04T01:44:00.560854+0000","last_fullsized":"2023-11-04T01:44:00.560854+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:11.658042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560490+0000","last_change":"2023-11-04T01:43:58.542866+0000","last_active":"2023-11-04T01:44:00.560490+0000","last_peered":"2023-11-04T01:44:00.560490+0000","last_clean":"2023-11-04T01:44:00.560490+0000","last_became_active":"2023-11-04T01:43:58.542289+0000","last_became_peered":"2023-11-04T01:43:58.542289+0000","last_unstale":"2023-11-04T01:44:00.560490+0000","last_undegraded":"2023-11-04T01:44:00.560490+0000","last_fullsized":"2023-11-04T01:44:00.560490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:07.162139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.541769+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:43:59.541769+0000","last_peered":"2023-11-04T01:43:59.541769+0000","last_clean":"2023-11-04T01:43:59.541769+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:43:59.541769+0000","last_undegraded":"2023-11-04T01:43:59.541769+0000","last_fullsized":"2023-11-04T01:43:59.541769+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768845+0000","last_change":"2023-11-04T01:43:59.574547+0000","last_active":"2023-11-04T01:44:00.768845+0000","last_peered":"2023-11-04T01:44:00.768845+0000","last_clean":"2023-11-04T01:44:00.768845+0000","last_became_active":"2023-11-04T01:43:59.573750+0000","last_became_peered":"2023-11-04T01:43:59.573750+0000","last_unstale":"2023-11-04T01:44:00.768845+0000","last_undegraded":"2023-11-04T01:44:00.768845+0000","last_fullsized":"2023-11-04T01:44:00.768845+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:56:46.907230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564454+0000","last_change":"2023-11-04T01:43:58.528399+0000","last_active":"2023-11-04T01:44:00.564454+0000","last_peered":"2023-11-04T01:44:00.564454+0000","last_clean":"2023-11-04T01:44:00.564454+0000","last_became_active":"2023-11-04T01:43:58.527827+0000","last_became_peered":"2023-11-04T01:43:58.527827+0000","last_unstale":"2023-11-04T01:44:00.564454+0000","last_undegraded":"2023-11-04T01:44:00.564454+0000","last_fullsized":"2023-11-04T01:44:00.564454+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.547975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.530445+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:43:59.530445+0000","last_peered":"2023-11-04T01:43:59.530445+0000","last_clean":"2023-11-04T01:43:59.530445+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:43:59.530445+0000","last_undegraded":"2023-11-04T01:43:59.530445+0000","last_fullsized":"2023-11-04T01:43:59.530445+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561487+0000","last_change":"2023-11-04T01:43:59.557416+0000","last_active":"2023-11-04T01:44:00.561487+0000","last_peered":"2023-11-04T01:44:00.561487+0000","last_clean":"2023-11-04T01:44:00.561487+0000","last_became_active":"2023-11-04T01:43:59.556529+0000","last_became_peered":"2023-11-04T01:43:59.556529+0000","last_unstale":"2023-11-04T01:44:00.561487+0000","last_undegraded":"2023-11-04T01:44:00.561487+0000","last_fullsized":"2023-11-04T01:44:00.561487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:43:36.137352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768581+0000","last_change":"2023-11-04T01:43:58.516910+0000","last_active":"2023-11-04T01:44:00.768581+0000","last_peered":"2023-11-04T01:44:00.768581+0000","last_clean":"2023-11-04T01:44:00.768581+0000","last_became_active":"2023-11-04T01:43:58.516498+0000","last_became_peered":"2023-11-04T01:43:58.516498+0000","last_unstale":"2023-11-04T01:44:00.768581+0000","last_undegraded":"2023-11-04T01:44:00.768581+0000","last_fullsized":"2023-11-04T01:44:00.768581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:23.710321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.555809+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:43:59.555809+0000","last_peered":"2023-11-04T01:43:59.555809+0000","last_clean":"2023-11-04T01:43:59.555809+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:43:59.555809+0000","last_undegraded":"2023-11-04T01:43:59.555809+0000","last_fullsized":"2023-11-04T01:43:59.555809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771342+0000","last_change":"2023-11-04T01:43:59.585477+0000","last_active":"2023-11-04T01:44:00.771342+0000","last_peered":"2023-11-04T01:44:00.771342+0000","last_clean":"2023-11-04T01:44:00.771342+0000","last_became_active":"2023-11-04T01:43:59.584758+0000","last_became_peered":"2023-11-04T01:43:59.584758+0000","last_unstale":"2023-11-04T01:44:00.771342+0000","last_undegraded":"2023-11-04T01:44:00.771342+0000","last_fullsized":"2023-11-04T01:44:00.771342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:42:21.194987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769908+0000","last_change":"2023-11-04T01:43:58.549541+0000","last_active":"2023-11-04T01:44:00.769908+0000","last_peered":"2023-11-04T01:44:00.769908+0000","last_clean":"2023-11-04T01:44:00.769908+0000","last_became_active":"2023-11-04T01:43:58.549189+0000","last_became_peered":"2023-11-04T01:43:58.549189+0000","last_unstale":"2023-11-04T01:44:00.769908+0000","last_undegraded":"2023-11-04T01:44:00.769908+0000","last_fullsized":"2023-11-04T01:44:00.769908+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:27:56.529927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.551844+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:43:59.551844+0000","last_peered":"2023-11-04T01:43:59.551844+0000","last_clean":"2023-11-04T01:43:59.551844+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:43:59.551844+0000","last_undegraded":"2023-11-04T01:43:59.551844+0000","last_fullsized":"2023-11-04T01:43:59.551844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769811+0000","last_change":"2023-11-04T01:43:59.569428+0000","last_active":"2023-11-04T01:44:00.769811+0000","last_peered":"2023-11-04T01:44:00.769811+0000","last_clean":"2023-11-04T01:44:00.769811+0000","last_became_active":"2023-11-04T01:43:59.568645+0000","last_became_peered":"2023-11-04T01:43:59.568645+0000","last_unstale":"2023-11-04T01:44:00.769811+0000","last_undegraded":"2023-11-04T01:44:00.769811+0000","last_fullsized":"2023-11-04T01:44:00.769811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:26.084028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770887+0000","last_change":"2023-11-04T01:43:58.524016+0000","last_active":"2023-11-04T01:44:00.770887+0000","last_peered":"2023-11-04T01:44:00.770887+0000","last_clean":"2023-11-04T01:44:00.770887+0000","last_became_active":"2023-11-04T01:43:58.523546+0000","last_became_peered":"2023-11-04T01:43:58.523546+0000","last_unstale":"2023-11-04T01:44:00.770887+0000","last_undegraded":"2023-11-04T01:44:00.770887+0000","last_fullsized":"2023-11-04T01:44:00.770887+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:46.924774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.550497+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:43:59.550497+0000","last_peered":"2023-11-04T01:43:59.550497+0000","last_clean":"2023-11-04T01:43:59.550497+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:43:59.550497+0000","last_undegraded":"2023-11-04T01:43:59.550497+0000","last_fullsized":"2023-11-04T01:43:59.550497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560264+0000","last_change":"2023-11-04T01:43:59.575639+0000","last_active":"2023-11-04T01:44:00.560264+0000","last_peered":"2023-11-04T01:44:00.560264+0000","last_clean":"2023-11-04T01:44:00.560264+0000","last_became_active":"2023-11-04T01:43:59.573722+0000","last_became_peered":"2023-11-04T01:43:59.573722+0000","last_unstale":"2023-11-04T01:44:00.560264+0000","last_undegraded":"2023-11-04T01:44:00.560264+0000","last_fullsized":"2023-11-04T01:44:00.560264+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:48:14.353726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770965+0000","last_change":"2023-11-04T01:43:58.529479+0000","last_active":"2023-11-04T01:44:00.770965+0000","last_peered":"2023-11-04T01:44:00.770965+0000","last_clean":"2023-11-04T01:44:00.770965+0000","last_became_active":"2023-11-04T01:43:58.528346+0000","last_became_peered":"2023-11-04T01:43:58.528346+0000","last_unstale":"2023-11-04T01:44:00.770965+0000","last_undegraded":"2023-11-04T01:44:00.770965+0000","last_fullsized":"2023-11-04T01:44:00.770965+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:18.656170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.554091+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:43:59.554091+0000","last_peered":"2023-11-04T01:43:59.554091+0000","last_clean":"2023-11-04T01:43:59.554091+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:43:59.554091+0000","last_undegraded":"2023-11-04T01:43:59.554091+0000","last_fullsized":"2023-11-04T01:43:59.554091+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564051+0000","last_change":"2023-11-04T01:43:59.541332+0000","last_active":"2023-11-04T01:44:00.564051+0000","last_peered":"2023-11-04T01:44:00.564051+0000","last_clean":"2023-11-04T01:44:00.564051+0000","last_became_active":"2023-11-04T01:43:59.538297+0000","last_became_peered":"2023-11-04T01:43:59.538297+0000","last_unstale":"2023-11-04T01:44:00.564051+0000","last_undegraded":"2023-11-04T01:44:00.564051+0000","last_fullsized":"2023-11-04T01:44:00.564051+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:09:08.220607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564094+0000","last_change":"2023-11-04T01:43:58.531808+0000","last_active":"2023-11-04T01:44:00.564094+0000","last_peered":"2023-11-04T01:44:00.564094+0000","last_clean":"2023-11-04T01:44:00.564094+0000","last_became_active":"2023-11-04T01:43:58.529724+0000","last_became_peered":"2023-11-04T01:43:58.529724+0000","last_unstale":"2023-11-04T01:44:00.564094+0000","last_undegraded":"2023-11-04T01:44:00.564094+0000","last_fullsized":"2023-11-04T01:44:00.564094+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:38:43.616135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.530547+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:43:59.530547+0000","last_peered":"2023-11-04T01:43:59.530547+0000","last_clean":"2023-11-04T01:43:59.530547+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:43:59.530547+0000","last_undegraded":"2023-11-04T01:43:59.530547+0000","last_fullsized":"2023-11-04T01:43:59.530547+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769001+0000","last_change":"2023-11-04T01:43:59.574903+0000","last_active":"2023-11-04T01:44:00.769001+0000","last_peered":"2023-11-04T01:44:00.769001+0000","last_clean":"2023-11-04T01:44:00.769001+0000","last_became_active":"2023-11-04T01:43:59.573224+0000","last_became_peered":"2023-11-04T01:43:59.573224+0000","last_unstale":"2023-11-04T01:44:00.769001+0000","last_undegraded":"2023-11-04T01:44:00.769001+0000","last_fullsized":"2023-11-04T01:44:00.769001+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:58.002097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772541+0000","last_change":"2023-11-04T01:43:58.527902+0000","last_active":"2023-11-04T01:44:00.772541+0000","last_peered":"2023-11-04T01:44:00.772541+0000","last_clean":"2023-11-04T01:44:00.772541+0000","last_became_active":"2023-11-04T01:43:58.527100+0000","last_became_peered":"2023-11-04T01:43:58.527100+0000","last_unstale":"2023-11-04T01:44:00.772541+0000","last_undegraded":"2023-11-04T01:44:00.772541+0000","last_fullsized":"2023-11-04T01:44:00.772541+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:19.612720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.529972+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:43:59.529972+0000","last_peered":"2023-11-04T01:43:59.529972+0000","last_clean":"2023-11-04T01:43:59.529972+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:43:59.529972+0000","last_undegraded":"2023-11-04T01:43:59.529972+0000","last_fullsized":"2023-11-04T01:43:59.529972+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770070+0000","last_change":"2023-11-04T01:43:59.556823+0000","last_active":"2023-11-04T01:44:00.770070+0000","last_peered":"2023-11-04T01:44:00.770070+0000","last_clean":"2023-11-04T01:44:00.770070+0000","last_became_active":"2023-11-04T01:43:59.556031+0000","last_became_peered":"2023-11-04T01:43:59.556031+0000","last_unstale":"2023-11-04T01:44:00.770070+0000","last_undegraded":"2023-11-04T01:44:00.770070+0000","last_fullsized":"2023-11-04T01:44:00.770070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:21.053449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564375+0000","last_change":"2023-11-04T01:43:58.539873+0000","last_active":"2023-11-04T01:44:00.564375+0000","last_peered":"2023-11-04T01:44:00.564375+0000","last_clean":"2023-11-04T01:44:00.564375+0000","last_became_active":"2023-11-04T01:43:58.539139+0000","last_became_peered":"2023-11-04T01:43:58.539139+0000","last_unstale":"2023-11-04T01:44:00.564375+0000","last_undegraded":"2023-11-04T01:44:00.564375+0000","last_fullsized":"2023-11-04T01:44:00.564375+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:52:31.866067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.533705+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:43:59.533705+0000","last_peered":"2023-11-04T01:43:59.533705+0000","last_clean":"2023-11-04T01:43:59.533705+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:43:59.533705+0000","last_undegraded":"2023-11-04T01:43:59.533705+0000","last_fullsized":"2023-11-04T01:43:59.533705+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772378+0000","last_change":"2023-11-04T01:43:59.565302+0000","last_active":"2023-11-04T01:44:00.772378+0000","last_peered":"2023-11-04T01:44:00.772378+0000","last_clean":"2023-11-04T01:44:00.772378+0000","last_became_active":"2023-11-04T01:43:59.564500+0000","last_became_peered":"2023-11-04T01:43:59.564500+0000","last_unstale":"2023-11-04T01:44:00.772378+0000","last_undegraded":"2023-11-04T01:44:00.772378+0000","last_fullsized":"2023-11-04T01:44:00.772378+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:24.722152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559609+0000","last_change":"2023-11-04T01:43:58.540644+0000","last_active":"2023-11-04T01:44:00.559609+0000","last_peered":"2023-11-04T01:44:00.559609+0000","last_clean":"2023-11-04T01:44:00.559609+0000","last_became_active":"2023-11-04T01:43:58.539879+0000","last_became_peered":"2023-11-04T01:43:58.539879+0000","last_unstale":"2023-11-04T01:44:00.559609+0000","last_undegraded":"2023-11-04T01:44:00.559609+0000","last_fullsized":"2023-11-04T01:44:00.559609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:56.990266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.541751+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:43:59.541751+0000","last_peered":"2023-11-04T01:43:59.541751+0000","last_clean":"2023-11-04T01:43:59.541751+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:43:59.541751+0000","last_undegraded":"2023-11-04T01:43:59.541751+0000","last_fullsized":"2023-11-04T01:43:59.541751+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772091+0000","last_change":"2023-11-04T01:43:59.580759+0000","last_active":"2023-11-04T01:44:00.772091+0000","last_peered":"2023-11-04T01:44:00.772091+0000","last_clean":"2023-11-04T01:44:00.772091+0000","last_became_active":"2023-11-04T01:43:59.579983+0000","last_became_peered":"2023-11-04T01:43:59.579983+0000","last_unstale":"2023-11-04T01:44:00.772091+0000","last_undegraded":"2023-11-04T01:44:00.772091+0000","last_fullsized":"2023-11-04T01:44:00.772091+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:37:43.050852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559894+0000","last_change":"2023-11-04T01:43:58.534410+0000","last_active":"2023-11-04T01:44:00.559894+0000","last_peered":"2023-11-04T01:44:00.559894+0000","last_clean":"2023-11-04T01:44:00.559894+0000","last_became_active":"2023-11-04T01:43:58.533705+0000","last_became_peered":"2023-11-04T01:43:58.533705+0000","last_unstale":"2023-11-04T01:44:00.559894+0000","last_undegraded":"2023-11-04T01:44:00.559894+0000","last_fullsized":"2023-11-04T01:44:00.559894+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:08.778650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.533709+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:43:59.533709+0000","last_peered":"2023-11-04T01:43:59.533709+0000","last_clean":"2023-11-04T01:43:59.533709+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:43:59.533709+0000","last_undegraded":"2023-11-04T01:43:59.533709+0000","last_fullsized":"2023-11-04T01:43:59.533709+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.559586+0000","last_change":"2023-11-04T01:43:59.561060+0000","last_active":"2023-11-04T01:44:00.559586+0000","last_peered":"2023-11-04T01:44:00.559586+0000","last_clean":"2023-11-04T01:44:00.559586+0000","last_became_active":"2023-11-04T01:43:59.557477+0000","last_became_peered":"2023-11-04T01:43:59.557477+0000","last_unstale":"2023-11-04T01:44:00.559586+0000","last_undegraded":"2023-11-04T01:44:00.559586+0000","last_fullsized":"2023-11-04T01:44:00.559586+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:19:29.438063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772259+0000","last_change":"2023-11-04T01:43:58.541530+0000","last_active":"2023-11-04T01:44:00.772259+0000","last_peered":"2023-11-04T01:44:00.772259+0000","last_clean":"2023-11-04T01:44:00.772259+0000","last_became_active":"2023-11-04T01:43:58.540749+0000","last_became_peered":"2023-11-04T01:43:58.540749+0000","last_unstale":"2023-11-04T01:44:00.772259+0000","last_undegraded":"2023-11-04T01:44:00.772259+0000","last_fullsized":"2023-11-04T01:44:00.772259+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:34.335722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.534870+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:43:59.534870+0000","last_peered":"2023-11-04T01:43:59.534870+0000","last_clean":"2023-11-04T01:43:59.534870+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:43:59.534870+0000","last_undegraded":"2023-11-04T01:43:59.534870+0000","last_fullsized":"2023-11-04T01:43:59.534870+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770572+0000","last_change":"2023-11-04T01:43:59.566532+0000","last_active":"2023-11-04T01:44:00.770572+0000","last_peered":"2023-11-04T01:44:00.770572+0000","last_clean":"2023-11-04T01:44:00.770572+0000","last_became_active":"2023-11-04T01:43:59.564132+0000","last_became_peered":"2023-11-04T01:43:59.564132+0000","last_unstale":"2023-11-04T01:44:00.770572+0000","last_undegraded":"2023-11-04T01:44:00.770572+0000","last_fullsized":"2023-11-04T01:44:00.770572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:22.847874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772567+0000","last_change":"2023-11-04T01:43:58.524544+0000","last_active":"2023-11-04T01:44:00.772567+0000","last_peered":"2023-11-04T01:44:00.772567+0000","last_clean":"2023-11-04T01:44:00.772567+0000","last_became_active":"2023-11-04T01:43:58.523405+0000","last_became_peered":"2023-11-04T01:43:58.523405+0000","last_unstale":"2023-11-04T01:44:00.772567+0000","last_undegraded":"2023-11-04T01:44:00.772567+0000","last_fullsized":"2023-11-04T01:44:00.772567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:28.931527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.544608+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:43:59.544608+0000","last_peered":"2023-11-04T01:43:59.544608+0000","last_clean":"2023-11-04T01:43:59.544608+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:43:59.544608+0000","last_undegraded":"2023-11-04T01:43:59.544608+0000","last_fullsized":"2023-11-04T01:43:59.544608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768651+0000","last_change":"2023-11-04T01:43:59.576399+0000","last_active":"2023-11-04T01:44:00.768651+0000","last_peered":"2023-11-04T01:44:00.768651+0000","last_clean":"2023-11-04T01:44:00.768651+0000","last_became_active":"2023-11-04T01:43:59.574132+0000","last_became_peered":"2023-11-04T01:43:59.574132+0000","last_unstale":"2023-11-04T01:44:00.768651+0000","last_undegraded":"2023-11-04T01:44:00.768651+0000","last_fullsized":"2023-11-04T01:44:00.768651+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:13.614324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770169+0000","last_change":"2023-11-04T01:43:58.539602+0000","last_active":"2023-11-04T01:44:00.770169+0000","last_peered":"2023-11-04T01:44:00.770169+0000","last_clean":"2023-11-04T01:44:00.770169+0000","last_became_active":"2023-11-04T01:43:58.539188+0000","last_became_peered":"2023-11-04T01:43:58.539188+0000","last_unstale":"2023-11-04T01:44:00.770169+0000","last_undegraded":"2023-11-04T01:44:00.770169+0000","last_fullsized":"2023-11-04T01:44:00.770169+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:45:09.284622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.553538+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:43:59.553538+0000","last_peered":"2023-11-04T01:43:59.553538+0000","last_clean":"2023-11-04T01:43:59.553538+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:43:59.553538+0000","last_undegraded":"2023-11-04T01:43:59.553538+0000","last_fullsized":"2023-11-04T01:43:59.553538+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771120+0000","last_change":"2023-11-04T01:43:59.590180+0000","last_active":"2023-11-04T01:44:00.771120+0000","last_peered":"2023-11-04T01:44:00.771120+0000","last_clean":"2023-11-04T01:44:00.771120+0000","last_became_active":"2023-11-04T01:43:59.589504+0000","last_became_peered":"2023-11-04T01:43:59.589504+0000","last_unstale":"2023-11-04T01:44:00.771120+0000","last_undegraded":"2023-11-04T01:44:00.771120+0000","last_fullsized":"2023-11-04T01:44:00.771120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:32.157944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769136+0000","last_change":"2023-11-04T01:43:58.544378+0000","last_active":"2023-11-04T01:44:00.769136+0000","last_peered":"2023-11-04T01:44:00.769136+0000","last_clean":"2023-11-04T01:44:00.769136+0000","last_became_active":"2023-11-04T01:43:58.544037+0000","last_became_peered":"2023-11-04T01:43:58.544037+0000","last_unstale":"2023-11-04T01:44:00.769136+0000","last_undegraded":"2023-11-04T01:44:00.769136+0000","last_fullsized":"2023-11-04T01:44:00.769136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:11.204322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.534603+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:43:59.534603+0000","last_peered":"2023-11-04T01:43:59.534603+0000","last_clean":"2023-11-04T01:43:59.534603+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:43:59.534603+0000","last_undegraded":"2023-11-04T01:43:59.534603+0000","last_fullsized":"2023-11-04T01:43:59.534603+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770754+0000","last_change":"2023-11-04T01:43:59.586051+0000","last_active":"2023-11-04T01:44:00.770754+0000","last_peered":"2023-11-04T01:44:00.770754+0000","last_clean":"2023-11-04T01:44:00.770754+0000","last_became_active":"2023-11-04T01:43:59.585282+0000","last_became_peered":"2023-11-04T01:43:59.585282+0000","last_unstale":"2023-11-04T01:44:00.770754+0000","last_undegraded":"2023-11-04T01:44:00.770754+0000","last_fullsized":"2023-11-04T01:44:00.770754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:19.396136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771511+0000","last_change":"2023-11-04T01:43:58.524546+0000","last_active":"2023-11-04T01:44:00.771511+0000","last_peered":"2023-11-04T01:44:00.771511+0000","last_clean":"2023-11-04T01:44:00.771511+0000","last_became_active":"2023-11-04T01:43:58.524078+0000","last_became_peered":"2023-11-04T01:43:58.524078+0000","last_unstale":"2023-11-04T01:44:00.771511+0000","last_undegraded":"2023-11-04T01:44:00.771511+0000","last_fullsized":"2023-11-04T01:44:00.771511+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:30:47.772617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.530195+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:43:59.530195+0000","last_peered":"2023-11-04T01:43:59.530195+0000","last_clean":"2023-11-04T01:43:59.530195+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:43:59.530195+0000","last_undegraded":"2023-11-04T01:43:59.530195+0000","last_fullsized":"2023-11-04T01:43:59.530195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772795+0000","last_change":"2023-11-04T01:43:59.576733+0000","last_active":"2023-11-04T01:44:00.772795+0000","last_peered":"2023-11-04T01:44:00.772795+0000","last_clean":"2023-11-04T01:44:00.772795+0000","last_became_active":"2023-11-04T01:43:59.574036+0000","last_became_peered":"2023-11-04T01:43:59.574036+0000","last_unstale":"2023-11-04T01:44:00.772795+0000","last_undegraded":"2023-11-04T01:44:00.772795+0000","last_fullsized":"2023-11-04T01:44:00.772795+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:13.614324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769788+0000","last_change":"2023-11-04T01:43:58.545295+0000","last_active":"2023-11-04T01:44:00.769788+0000","last_peered":"2023-11-04T01:44:00.769788+0000","last_clean":"2023-11-04T01:44:00.769788+0000","last_became_active":"2023-11-04T01:43:58.544848+0000","last_became_peered":"2023-11-04T01:43:58.544848+0000","last_unstale":"2023-11-04T01:44:00.769788+0000","last_undegraded":"2023-11-04T01:44:00.769788+0000","last_fullsized":"2023-11-04T01:44:00.769788+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:20.356199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.556476+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:43:59.556476+0000","last_peered":"2023-11-04T01:43:59.556476+0000","last_clean":"2023-11-04T01:43:59.556476+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:43:59.556476+0000","last_undegraded":"2023-11-04T01:43:59.556476+0000","last_fullsized":"2023-11-04T01:43:59.556476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772515+0000","last_change":"2023-11-04T01:43:59.580555+0000","last_active":"2023-11-04T01:44:00.772515+0000","last_peered":"2023-11-04T01:44:00.772515+0000","last_clean":"2023-11-04T01:44:00.772515+0000","last_became_active":"2023-11-04T01:43:59.579848+0000","last_became_peered":"2023-11-04T01:43:59.579848+0000","last_unstale":"2023-11-04T01:44:00.772515+0000","last_undegraded":"2023-11-04T01:44:00.772515+0000","last_fullsized":"2023-11-04T01:44:00.772515+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:45:41.989713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768568+0000","last_change":"2023-11-04T01:43:58.510294+0000","last_active":"2023-11-04T01:44:00.768568+0000","last_peered":"2023-11-04T01:44:00.768568+0000","last_clean":"2023-11-04T01:44:00.768568+0000","last_became_active":"2023-11-04T01:43:58.509164+0000","last_became_peered":"2023-11-04T01:43:58.509164+0000","last_unstale":"2023-11-04T01:44:00.768568+0000","last_undegraded":"2023-11-04T01:44:00.768568+0000","last_fullsized":"2023-11-04T01:44:00.768568+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:03.247324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.532404+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:43:59.532404+0000","last_peered":"2023-11-04T01:43:59.532404+0000","last_clean":"2023-11-04T01:43:59.532404+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:43:59.532404+0000","last_undegraded":"2023-11-04T01:43:59.532404+0000","last_fullsized":"2023-11-04T01:43:59.532404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564910+0000","last_change":"2023-11-04T01:43:59.576138+0000","last_active":"2023-11-04T01:44:00.564910+0000","last_peered":"2023-11-04T01:44:00.564910+0000","last_clean":"2023-11-04T01:44:00.564910+0000","last_became_active":"2023-11-04T01:43:59.573609+0000","last_became_peered":"2023-11-04T01:43:59.573609+0000","last_unstale":"2023-11-04T01:44:00.564910+0000","last_undegraded":"2023-11-04T01:44:00.564910+0000","last_fullsized":"2023-11-04T01:44:00.564910+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:05:54.809376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"49'8","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771019+0000","last_change":"2023-11-04T01:43:58.541418+0000","last_active":"2023-11-04T01:44:00.771019+0000","last_peered":"2023-11-04T01:44:00.771019+0000","last_clean":"2023-11-04T01:44:00.771019+0000","last_became_active":"2023-11-04T01:43:58.540716+0000","last_became_peered":"2023-11-04T01:43:58.540716+0000","last_unstale":"2023-11-04T01:44:00.771019+0000","last_undegraded":"2023-11-04T01:44:00.771019+0000","last_fullsized":"2023-11-04T01:44:00.771019+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:14.748175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.546463+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:43:59.546463+0000","last_peered":"2023-11-04T01:43:59.546463+0000","last_clean":"2023-11-04T01:43:59.546463+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:43:59.546463+0000","last_undegraded":"2023-11-04T01:43:59.546463+0000","last_fullsized":"2023-11-04T01:43:59.546463+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560251+0000","last_change":"2023-11-04T01:43:59.548777+0000","last_active":"2023-11-04T01:44:00.560251+0000","last_peered":"2023-11-04T01:44:00.560251+0000","last_clean":"2023-11-04T01:44:00.560251+0000","last_became_active":"2023-11-04T01:43:59.548078+0000","last_became_peered":"2023-11-04T01:43:59.548078+0000","last_unstale":"2023-11-04T01:44:00.560251+0000","last_undegraded":"2023-11-04T01:44:00.560251+0000","last_fullsized":"2023-11-04T01:44:00.560251+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:18:13.614324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770544+0000","last_change":"2023-11-04T01:43:58.517913+0000","last_active":"2023-11-04T01:44:00.770544+0000","last_peered":"2023-11-04T01:44:00.770544+0000","last_clean":"2023-11-04T01:44:00.770544+0000","last_became_active":"2023-11-04T01:43:58.517163+0000","last_became_peered":"2023-11-04T01:43:58.517163+0000","last_unstale":"2023-11-04T01:44:00.770544+0000","last_undegraded":"2023-11-04T01:44:00.770544+0000","last_fullsized":"2023-11-04T01:44:00.770544+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:27.050301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.536586+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:43:59.536586+0000","last_peered":"2023-11-04T01:43:59.536586+0000","last_clean":"2023-11-04T01:43:59.536586+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:43:59.536586+0000","last_undegraded":"2023-11-04T01:43:59.536586+0000","last_fullsized":"2023-11-04T01:43:59.536586+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769950+0000","last_change":"2023-11-04T01:43:59.570046+0000","last_active":"2023-11-04T01:44:00.769950+0000","last_peered":"2023-11-04T01:44:00.769950+0000","last_clean":"2023-11-04T01:44:00.769950+0000","last_became_active":"2023-11-04T01:43:59.567794+0000","last_became_peered":"2023-11-04T01:43:59.567794+0000","last_unstale":"2023-11-04T01:44:00.769950+0000","last_undegraded":"2023-11-04T01:44:00.769950+0000","last_fullsized":"2023-11-04T01:44:00.769950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:47.480419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770252+0000","last_change":"2023-11-04T01:43:58.521321+0000","last_active":"2023-11-04T01:44:00.770252+0000","last_peered":"2023-11-04T01:44:00.770252+0000","last_clean":"2023-11-04T01:44:00.770252+0000","last_became_active":"2023-11-04T01:43:58.519491+0000","last_became_peered":"2023-11-04T01:43:58.519491+0000","last_unstale":"2023-11-04T01:44:00.770252+0000","last_undegraded":"2023-11-04T01:44:00.770252+0000","last_fullsized":"2023-11-04T01:44:00.770252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:53.433754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.534604+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:43:59.534604+0000","last_peered":"2023-11-04T01:43:59.534604+0000","last_clean":"2023-11-04T01:43:59.534604+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:43:59.534604+0000","last_undegraded":"2023-11-04T01:43:59.534604+0000","last_fullsized":"2023-11-04T01:43:59.534604+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771729+0000","last_change":"2023-11-04T01:43:59.572108+0000","last_active":"2023-11-04T01:44:00.771729+0000","last_peered":"2023-11-04T01:44:00.771729+0000","last_clean":"2023-11-04T01:44:00.771729+0000","last_became_active":"2023-11-04T01:43:59.571467+0000","last_became_peered":"2023-11-04T01:43:59.571467+0000","last_unstale":"2023-11-04T01:44:00.771729+0000","last_undegraded":"2023-11-04T01:44:00.771729+0000","last_fullsized":"2023-11-04T01:44:00.771729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:26:12.216153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":15,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770861+0000","last_change":"2023-11-04T01:43:58.544524+0000","last_active":"2023-11-04T01:44:00.770861+0000","last_peered":"2023-11-04T01:44:00.770861+0000","last_clean":"2023-11-04T01:44:00.770861+0000","last_became_active":"2023-11-04T01:43:58.544097+0000","last_became_peered":"2023-11-04T01:43:58.544097+0000","last_unstale":"2023-11-04T01:44:00.770861+0000","last_undegraded":"2023-11-04T01:44:00.770861+0000","last_fullsized":"2023-11-04T01:44:00.770861+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:25.072558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.535828+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:43:59.535828+0000","last_peered":"2023-11-04T01:43:59.535828+0000","last_clean":"2023-11-04T01:43:59.535828+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:43:59.535828+0000","last_undegraded":"2023-11-04T01:43:59.535828+0000","last_fullsized":"2023-11-04T01:43:59.535828+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.768959+0000","last_change":"2023-11-04T01:43:59.566828+0000","last_active":"2023-11-04T01:44:00.768959+0000","last_peered":"2023-11-04T01:44:00.768959+0000","last_clean":"2023-11-04T01:44:00.768959+0000","last_became_active":"2023-11-04T01:43:59.565932+0000","last_became_peered":"2023-11-04T01:43:59.565932+0000","last_unstale":"2023-11-04T01:44:00.768959+0000","last_undegraded":"2023-11-04T01:44:00.768959+0000","last_fullsized":"2023-11-04T01:44:00.768959+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:54:09.790481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"49'6","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561084+0000","last_change":"2023-11-04T01:43:58.543677+0000","last_active":"2023-11-04T01:44:00.561084+0000","last_peered":"2023-11-04T01:44:00.561084+0000","last_clean":"2023-11-04T01:44:00.561084+0000","last_became_active":"2023-11-04T01:43:58.542920+0000","last_became_peered":"2023-11-04T01:43:58.542920+0000","last_unstale":"2023-11-04T01:44:00.561084+0000","last_undegraded":"2023-11-04T01:44:00.561084+0000","last_fullsized":"2023-11-04T01:44:00.561084+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:03.247324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.549109+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:43:59.549109+0000","last_peered":"2023-11-04T01:43:59.549109+0000","last_clean":"2023-11-04T01:43:59.549109+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:43:59.549109+0000","last_undegraded":"2023-11-04T01:43:59.549109+0000","last_fullsized":"2023-11-04T01:43:59.549109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560816+0000","last_change":"2023-11-04T01:43:59.572390+0000","last_active":"2023-11-04T01:44:00.560816+0000","last_peered":"2023-11-04T01:44:00.560816+0000","last_clean":"2023-11-04T01:44:00.560816+0000","last_became_active":"2023-11-04T01:43:59.571490+0000","last_became_peered":"2023-11-04T01:43:59.571490+0000","last_unstale":"2023-11-04T01:44:00.560816+0000","last_undegraded":"2023-11-04T01:44:00.560816+0000","last_fullsized":"2023-11-04T01:44:00.560816+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:38.596636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.564080+0000","last_change":"2023-11-04T01:43:58.546713+0000","last_active":"2023-11-04T01:44:00.564080+0000","last_peered":"2023-11-04T01:44:00.564080+0000","last_clean":"2023-11-04T01:44:00.564080+0000","last_became_active":"2023-11-04T01:43:58.546023+0000","last_became_peered":"2023-11-04T01:43:58.546023+0000","last_unstale":"2023-11-04T01:44:00.564080+0000","last_undegraded":"2023-11-04T01:44:00.564080+0000","last_fullsized":"2023-11-04T01:44:00.564080+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:22:39.233107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.541548+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:43:59.541548+0000","last_peered":"2023-11-04T01:43:59.541548+0000","last_clean":"2023-11-04T01:43:59.541548+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:43:59.541548+0000","last_undegraded":"2023-11-04T01:43:59.541548+0000","last_fullsized":"2023-11-04T01:43:59.541548+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.771016+0000","last_change":"2023-11-04T01:43:59.582827+0000","last_active":"2023-11-04T01:44:00.771016+0000","last_peered":"2023-11-04T01:44:00.771016+0000","last_clean":"2023-11-04T01:44:00.771016+0000","last_became_active":"2023-11-04T01:43:59.582020+0000","last_became_peered":"2023-11-04T01:43:59.582020+0000","last_unstale":"2023-11-04T01:44:00.771016+0000","last_undegraded":"2023-11-04T01:44:00.771016+0000","last_fullsized":"2023-11-04T01:44:00.771016+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:00.040338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769589+0000","last_change":"2023-11-04T01:43:58.513440+0000","last_active":"2023-11-04T01:44:00.769589+0000","last_peered":"2023-11-04T01:44:00.769589+0000","last_clean":"2023-11-04T01:44:00.769589+0000","last_became_active":"2023-11-04T01:43:58.513069+0000","last_became_peered":"2023-11-04T01:43:58.513069+0000","last_unstale":"2023-11-04T01:44:00.769589+0000","last_undegraded":"2023-11-04T01:44:00.769589+0000","last_fullsized":"2023-11-04T01:44:00.769589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:33:56.439122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.553510+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:43:59.553510+0000","last_peered":"2023-11-04T01:43:59.553510+0000","last_clean":"2023-11-04T01:43:59.553510+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:43:59.553510+0000","last_undegraded":"2023-11-04T01:43:59.553510+0000","last_fullsized":"2023-11-04T01:43:59.553510+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561181+0000","last_change":"2023-11-04T01:43:59.576200+0000","last_active":"2023-11-04T01:44:00.561181+0000","last_peered":"2023-11-04T01:44:00.561181+0000","last_clean":"2023-11-04T01:44:00.561181+0000","last_became_active":"2023-11-04T01:43:59.574913+0000","last_became_peered":"2023-11-04T01:43:59.574913+0000","last_unstale":"2023-11-04T01:44:00.561181+0000","last_undegraded":"2023-11-04T01:44:00.561181+0000","last_fullsized":"2023-11-04T01:44:00.561181+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:18:30.245340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769172+0000","last_change":"2023-11-04T01:43:58.524325+0000","last_active":"2023-11-04T01:44:00.769172+0000","last_peered":"2023-11-04T01:44:00.769172+0000","last_clean":"2023-11-04T01:44:00.769172+0000","last_became_active":"2023-11-04T01:43:58.523564+0000","last_became_peered":"2023-11-04T01:43:58.523564+0000","last_unstale":"2023-11-04T01:44:00.769172+0000","last_undegraded":"2023-11-04T01:44:00.769172+0000","last_fullsized":"2023-11-04T01:44:00.769172+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:19:23.517570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.533998+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:43:59.533998+0000","last_peered":"2023-11-04T01:43:59.533998+0000","last_clean":"2023-11-04T01:43:59.533998+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:43:59.533998+0000","last_undegraded":"2023-11-04T01:43:59.533998+0000","last_fullsized":"2023-11-04T01:43:59.533998+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.770464+0000","last_change":"2023-11-04T01:43:59.569045+0000","last_active":"2023-11-04T01:44:00.770464+0000","last_peered":"2023-11-04T01:44:00.770464+0000","last_clean":"2023-11-04T01:44:00.770464+0000","last_became_active":"2023-11-04T01:43:59.568332+0000","last_became_peered":"2023-11-04T01:43:59.568332+0000","last_unstale":"2023-11-04T01:44:00.770464+0000","last_undegraded":"2023-11-04T01:44:00.770464+0000","last_fullsized":"2023-11-04T01:44:00.770464+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:37:33.623496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.563028+0000","last_change":"2023-11-04T01:43:58.529030+0000","last_active":"2023-11-04T01:44:00.563028+0000","last_peered":"2023-11-04T01:44:00.563028+0000","last_clean":"2023-11-04T01:44:00.563028+0000","last_became_active":"2023-11-04T01:43:58.528325+0000","last_became_peered":"2023-11-04T01:43:58.528325+0000","last_unstale":"2023-11-04T01:44:00.563028+0000","last_undegraded":"2023-11-04T01:44:00.563028+0000","last_fullsized":"2023-11-04T01:44:00.563028+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:35:36.518722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":29,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.531847+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:43:59.531847+0000","last_peered":"2023-11-04T01:43:59.531847+0000","last_clean":"2023-11-04T01:43:59.531847+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:43:59.531847+0000","last_undegraded":"2023-11-04T01:43:59.531847+0000","last_fullsized":"2023-11-04T01:43:59.531847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769219+0000","last_change":"2023-11-04T01:43:59.554899+0000","last_active":"2023-11-04T01:44:00.769219+0000","last_peered":"2023-11-04T01:44:00.769219+0000","last_clean":"2023-11-04T01:44:00.769219+0000","last_became_active":"2023-11-04T01:43:59.554101+0000","last_became_peered":"2023-11-04T01:43:59.554101+0000","last_unstale":"2023-11-04T01:44:00.769219+0000","last_undegraded":"2023-11-04T01:44:00.769219+0000","last_fullsized":"2023-11-04T01:44:00.769219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:34:41.213935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"49'4","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.561092+0000","last_change":"2023-11-04T01:43:58.523691+0000","last_active":"2023-11-04T01:44:00.561092+0000","last_peered":"2023-11-04T01:44:00.561092+0000","last_clean":"2023-11-04T01:44:00.561092+0000","last_became_active":"2023-11-04T01:43:58.523301+0000","last_became_peered":"2023-11-04T01:43:58.523301+0000","last_unstale":"2023-11-04T01:44:00.561092+0000","last_undegraded":"2023-11-04T01:44:00.561092+0000","last_fullsized":"2023-11-04T01:44:00.561092+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:10.261302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.538609+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:43:59.538609+0000","last_peered":"2023-11-04T01:43:59.538609+0000","last_clean":"2023-11-04T01:43:59.538609+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:43:59.538609+0000","last_undegraded":"2023-11-04T01:43:59.538609+0000","last_fullsized":"2023-11-04T01:43:59.538609+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769359+0000","last_change":"2023-11-04T01:43:59.572561+0000","last_active":"2023-11-04T01:44:00.769359+0000","last_peered":"2023-11-04T01:44:00.769359+0000","last_clean":"2023-11-04T01:44:00.769359+0000","last_became_active":"2023-11-04T01:43:59.571781+0000","last_became_peered":"2023-11-04T01:43:59.571781+0000","last_unstale":"2023-11-04T01:44:00.769359+0000","last_undegraded":"2023-11-04T01:44:00.769359+0000","last_fullsized":"2023-11-04T01:44:00.769359+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:08.090453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.772169+0000","last_change":"2023-11-04T01:43:58.539825+0000","last_active":"2023-11-04T01:44:00.772169+0000","last_peered":"2023-11-04T01:44:00.772169+0000","last_clean":"2023-11-04T01:44:00.772169+0000","last_became_active":"2023-11-04T01:43:58.539306+0000","last_became_peered":"2023-11-04T01:43:58.539306+0000","last_unstale":"2023-11-04T01:44:00.772169+0000","last_undegraded":"2023-11-04T01:44:00.772169+0000","last_fullsized":"2023-11-04T01:44:00.772169+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:26:15.058931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.557677+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:43:59.557677+0000","last_peered":"2023-11-04T01:43:59.557677+0000","last_clean":"2023-11-04T01:43:59.557677+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:43:59.557677+0000","last_undegraded":"2023-11-04T01:43:59.557677+0000","last_fullsized":"2023-11-04T01:43:59.557677+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769552+0000","last_change":"2023-11-04T01:43:59.564953+0000","last_active":"2023-11-04T01:44:00.769552+0000","last_peered":"2023-11-04T01:44:00.769552+0000","last_clean":"2023-11-04T01:44:00.769552+0000","last_became_active":"2023-11-04T01:43:59.564169+0000","last_became_peered":"2023-11-04T01:43:59.564169+0000","last_unstale":"2023-11-04T01:44:00.769552+0000","last_undegraded":"2023-11-04T01:44:00.769552+0000","last_fullsized":"2023-11-04T01:44:00.769552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:01.461356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560729+0000","last_change":"2023-11-04T01:43:58.529607+0000","last_active":"2023-11-04T01:44:00.560729+0000","last_peered":"2023-11-04T01:44:00.560729+0000","last_clean":"2023-11-04T01:44:00.560729+0000","last_became_active":"2023-11-04T01:43:58.528232+0000","last_became_peered":"2023-11-04T01:43:58.528232+0000","last_unstale":"2023-11-04T01:44:00.560729+0000","last_undegraded":"2023-11-04T01:44:00.560729+0000","last_fullsized":"2023-11-04T01:44:00.560729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:10.261302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.541277+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:43:59.541277+0000","last_peered":"2023-11-04T01:43:59.541277+0000","last_clean":"2023-11-04T01:43:59.541277+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:43:59.541277+0000","last_undegraded":"2023-11-04T01:43:59.541277+0000","last_fullsized":"2023-11-04T01:43:59.541277+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.560318+0000","last_change":"2023-11-04T01:43:59.575329+0000","last_active":"2023-11-04T01:44:00.560318+0000","last_peered":"2023-11-04T01:44:00.560318+0000","last_clean":"2023-11-04T01:44:00.560318+0000","last_became_active":"2023-11-04T01:43:59.574544+0000","last_became_peered":"2023-11-04T01:43:59.574544+0000","last_unstale":"2023-11-04T01:44:00.560318+0000","last_undegraded":"2023-11-04T01:44:00.560318+0000","last_fullsized":"2023-11-04T01:44:00.560318+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:58.484778+0000","last_clean_scrub_stamp":"2023-11-04T01:43:58.484778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:20:41.249719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"49'2","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-11-04T01:44:00.769093+0000","last_change":"2023-11-04T01:43:58.532478+0000","last_active":"2023-11-04T01:44:00.769093+0000","last_peered":"2023-11-04T01:44:00.769093+0000","last_clean":"2023-11-04T01:44:00.769093+0000","last_became_active":"2023-11-04T01:43:58.532050+0000","last_became_peered":"2023-11-04T01:43:58.532050+0000","last_unstale":"2023-11-04T01:44:00.769093+0000","last_undegraded":"2023-11-04T01:44:00.769093+0000","last_fullsized":"2023-11-04T01:44:00.769093+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:57.472947+0000","last_clean_scrub_stamp":"2023-11-04T01:43:57.472947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:11:26.374193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":26,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-11-04T01:43:59.557650+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:43:59.557650+0000","last_peered":"2023-11-04T01:43:59.557650+0000","last_clean":"2023-11-04T01:43:59.557650+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:43:59.557650+0000","last_undegraded":"2023-11-04T01:43:59.557650+0000","last_fullsized":"2023-11-04T01:43:59.557650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509465,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1179648,"data_stored":837789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.308},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42499999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.35199999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.371}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.77400000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.76300000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":585728,"data_stored":247933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.48599999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.501},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.71699999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7909999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.083},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.0299999999999998,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.879}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.90200000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.141}]}]},{"osd":7,"up_from":14,"seq":60129542169,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":577536,"data_stored":240754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.65600000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.085},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79400000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.84599999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.609,"5min":2.609,"15min":2.609},"last":1.232}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":5.1150000000000002,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.117},{"interface":"front","average":{"1min":2.786,"5min":2.786,"15min":2.786},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":40.195,"5min":40.195,"15min":40.195},"last":1.3080000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":5.5549999999999997,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.268}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":241280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.202}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.444},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.66200000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.298}]},{"osd":3,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.546}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.002}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.484}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.8919999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1539999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1191936,"data_stored":839421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.159}]},{"osd":1,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0920000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.002}]},{"osd":3,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.052}]},{"osd":4,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.81799999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.288}]},{"osd":7,"last update":"Sat Nov 4 01:43:14 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":1.1950000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27604,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":589824,"data_stored":242402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.2470000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.46},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.833,"5min":1.833,"15min":1.833},"last":1.546}]},{"osd":5,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1279999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":1.3859999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.292},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.8220000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":240788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.32200000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.376},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.499}]},{"osd":5,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.65700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Sat Nov 4 01:43:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.72899999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":240732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.70299999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.63900000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.86099999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.075}]},{"osd":6,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.0169999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:43:10 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":0.755},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.97999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:44:03.018 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:44:03.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:44:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f82c18640 1 Processor -- start 2023-11-04T01:44:03.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f82c18640 1 -- start start 2023-11-04T01:44:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f82c18640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7f7c15d390 0x7f7f7c0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f82c18640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7f7c0d17a0 0x7f7f7c0d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f82c18640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7c15d770 con 0x7f7f7c0cf800 2023-11-04T01:44:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f82c18640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c0d2140 con 0x7f7f7c0d17a0 2023-11-04T01:44:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f82c18640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7c0cecd0 con 0x7f7f7c15d390 2023-11-04T01:44:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f7bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7f7c0d17a0 0x7f7f7c0d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f811b5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7f7c0cf800 0x7f7f7c0b5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44058/0 (socket says 172.21.15.2:44058) 2023-11-04T01:44:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f811b5640 1 -- 172.21.15.2:0/749535566 learned_addr learned my addr 172.21.15.2:0/749535566 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.184+0000 7f7f7bfff640 1 --2- 172.21.15.2:0/749535566 >> v2:172.21.15.2:3300/0 conn(0x7f7f7c0d17a0 0x7f7f7c0d1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49296/0 (socket says 172.21.15.2:49296) 2023-11-04T01:44:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f809b4640 1 --2- 172.21.15.2:0/749535566 >> v2:172.21.15.90:3300/0 conn(0x7f7f7c15d390 0x7f7f7c0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7bfff640 1 -- 172.21.15.2:0/749535566 >> v2:172.21.15.90:3300/0 conn(0x7f7f7c15d390 msgr2=0x7f7f7c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7bfff640 1 --2- 172.21.15.2:0/749535566 >> v2:172.21.15.90:3300/0 conn(0x7f7f7c15d390 0x7f7f7c0cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7bfff640 1 -- 172.21.15.2:0/749535566 >> v1:172.21.15.2:6789/0 conn(0x7f7f7c0cf800 legacy=0x7f7f7c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7bfff640 1 -- 172.21.15.2:0/749535566 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c0ce0c0 con 0x7f7f7c0d17a0 2023-11-04T01:44:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7bfff640 1 --2- 172.21.15.2:0/749535566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0d17a0 0x7f7f7c0d1c00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c08bce0 tx=0x7f7f6801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c32f3d539b9023 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7b7fe640 1 -- 172.21.15.2:0/749535566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680ac600 con 0x7f7f7c0d17a0 2023-11-04T01:44:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7b7fe640 1 -- 172.21.15.2:0/749535566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f680a8050 con 0x7f7f7c0d17a0 2023-11-04T01:44:03.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f7b7fe640 1 -- 172.21.15.2:0/749535566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f680ac980 con 0x7f7f7c0d17a0 2023-11-04T01:44:03.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 -- 172.21.15.2:0/749535566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0d17a0 msgr2=0x7f7f7c0d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 --2- 172.21.15.2:0/749535566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0d17a0 0x7f7f7c0d1c00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c08bce0 tx=0x7f7f6801c3a0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 -- 172.21.15.2:0/749535566 shutdown_connections 2023-11-04T01:44:03.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 --2- 172.21.15.2:0/749535566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0d17a0 0x7f7f7c0d1c00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 --2- 172.21.15.2:0/749535566 >> v2:172.21.15.90:3300/0 conn(0x7f7f7c15d390 0x7f7f7c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 -- 172.21.15.2:0/749535566 >> 172.21.15.2:0/749535566 conn(0x7f7f7c0d2e60 msgr2=0x7f7f7c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:03.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 -- 172.21.15.2:0/749535566 shutdown_connections 2023-11-04T01:44:03.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.188+0000 7f7f82c18640 1 -- 172.21.15.2:0/749535566 wait complete. 2023-11-04T01:44:03.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 Processor -- start 2023-11-04T01:44:03.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 -- start start 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0cf800 0x7f7f7c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f7c0d17a0 0x7f7f7c0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f7c15d390 0x7f7f7c0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0c97d0 con 0x7f7f7c0cf800 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0c8730 con 0x7f7f7c15d390 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0c8a10 con 0x7f7f7c0d17a0 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0cf800 0x7f7f7c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0cf800 0x7f7f7c0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49310/0 (socket says 172.21.15.2:49310) 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 -- 172.21.15.2:0/3373979153 learned_addr learned my addr 172.21.15.2:0/3373979153 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f811b5640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f7c15d390 0x7f7f7c0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f7bfff640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f7c0d17a0 0x7f7f7c0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 -- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f7c0d17a0 msgr2=0x7f7f7c0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f7c0d17a0 0x7f7f7c0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 -- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f7c15d390 msgr2=0x7f7f7c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f7c15d390 0x7f7f7c0d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 -- 172.21.15.2:0/3373979153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68009420 con 0x7f7f7c0cf800 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f7bfff640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f7c0d17a0 0x7f7f7c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f809b4640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0cf800 0x7f7f7c0cc7d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000d800 tx=0x7f7f7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f797fa640 1 -- 172.21.15.2:0/3373979153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70018070 con 0x7f7f7c0cf800 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f797fa640 1 -- 172.21.15.2:0/3373979153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700059a0 con 0x7f7f7c0cf800 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f797fa640 1 -- 172.21.15.2:0/3373979153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70005b50 con 0x7f7f7c0cf800 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c0d01a0 con 0x7f7f7c0cf800 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c0c8fd0 con 0x7f7f7c0cf800 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c0744a0 con 0x7f7f7c0cf800 2023-11-04T01:44:03.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.192+0000 7f7f797fa640 1 -- 172.21.15.2:0/3373979153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7f70005cb0 con 0x7f7f7c0cf800 2023-11-04T01:44:03.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.196+0000 7f7f797fa640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7f600664a0 0x7f7f60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.196+0000 7f7f797fa640 1 -- 172.21.15.2:0/3373979153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f70083e50 con 0x7f7f7c0cf800 2023-11-04T01:44:03.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.196+0000 7f7f7bfff640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7f600664a0 0x7f7f60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.196+0000 7f7f7bfff640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7f600664a0 0x7f7f60068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f680ae000 tx=0x7f7f68008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:03.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.200+0000 7f7f797fa640 1 -- 172.21.15.2:0/3373979153 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7f70051200 con 0x7f7f7c0cf800 2023-11-04T01:44:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.408+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7f7c06c640 con 0x7f7f7c0cf800 2023-11-04T01:44:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f797fa640 1 -- 172.21.15.2:0/3373979153 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7f70054820 con 0x7f7f7c0cf800 2023-11-04T01:44:03.416 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-04T01:44:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ== 2023-11-04T01:44:03.416 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-04T01:44:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-04T01:44:03.417 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:44:03.417 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-04T01:44:03.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7f600664a0 msgr2=0x7f7f60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7f600664a0 0x7f7f60068960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f680ae000 tx=0x7f7f68008040 comp rx=0 tx=0).stop 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0cf800 msgr2=0x7f7f7c0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0cf800 0x7f7f7c0cc7d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000d800 tx=0x7f7f7000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 shutdown_connections 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7f600664a0 0x7f7f60068960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f7c15d390 0x7f7f7c0d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7f7c0d17a0 0x7f7f7c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 --2- 172.21.15.2:0/3373979153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7c0cf800 0x7f7f7c0cc7d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 >> 172.21.15.2:0/3373979153 conn(0x7f7f7c0d2e60 msgr2=0x7f7f7c15bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 shutdown_connections 2023-11-04T01:44:03.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.412+0000 7f7f82c18640 1 -- 172.21.15.2:0/3373979153 wait complete. 2023-11-04T01:44:03.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.540+0000 7ffa4d7a0640 1 Processor -- start 2023-11-04T01:44:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.540+0000 7ffa4d7a0640 1 -- start start 2023-11-04T01:44:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa4d7a0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 0x7ffa480cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa4d7a0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa480ce320 con 0x7ffa480c9960 2023-11-04T01:44:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa4d7a0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa480ce600 con 0x7ffa480b0890 2023-11-04T01:44:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa4d7a0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4806d2f0 con 0x7ffa480cd6a0 2023-11-04T01:44:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa467fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa480c9960 0x7ffa480ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44066/0 (socket says 172.21.15.2:44066) 2023-11-04T01:44:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa467fc640 1 -- 172.21.15.2:0/1559443675 learned_addr learned my addr 172.21.15.2:0/1559443675 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537286540 0 0) 0x7ffa480ce320 con 0x7ffa480c9960 2023-11-04T01:44:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa34003530 con 0x7ffa480c9960 2023-11-04T01:44:03.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 0x7ffa480cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3535460645 0 0) 0x7ffa34003530 con 0x7ffa480c9960 2023-11-04T01:44:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 msgr2=0x7ffa480cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 0x7ffa480cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 >> v1:172.21.15.90:6789/0 conn(0x7ffa480b0890 legacy=0x7ffa480704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa480ce8e0 con 0x7ffa480c9960 2023-11-04T01:44:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ffa30001680 con 0x7ffa480c9960 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 0x7ffa480cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 >> v1:172.21.15.2:6789/0 conn(0x7ffa480c9960 legacy=0x7ffa480ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 0x7ffa340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34003fa0 0x7ffa340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa34004d10 0x7ffa34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4806d2f0 con 0x7ffa34004d10 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3400baf0 con 0x7ffa34003fa0 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3400bcb0 con 0x7ffa480cd6a0 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa34004d10 0x7ffa34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa467fc640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34003fa0 0x7ffa340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa46ffd640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 0x7ffa340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 -- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 msgr2=0x7ffa340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa480cd6a0 0x7ffa340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 -- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34003fa0 msgr2=0x7ffa340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34003fa0 0x7ffa340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 -- 172.21.15.2:0/1559443675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34003530 con 0x7ffa34004d10 2023-11-04T01:44:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa477fe640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa34004d10 0x7ffa34005190 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ffa400073e0 tx=0x7ffa4001cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b710879fe030dd38 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400a5da0 con 0x7ffa34004d10 2023-11-04T01:44:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa400ad440 con 0x7ffa34004d10 2023-11-04T01:44:03.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.544+0000 7ffa45ffb640 1 -- 172.21.15.2:0/1559443675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400ad7b0 con 0x7ffa34004d10 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/1559443675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa34004d10 msgr2=0x7ffa34005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 --2- 172.21.15.2:0/1559443675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa34004d10 0x7ffa34005190 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ffa400073e0 tx=0x7ffa4001cea0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 -- 172.21.15.2:0/1559443675 reap_dead start 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/1559443675 shutdown_connections 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/1559443675 >> 172.21.15.2:0/1559443675 conn(0x7ffa480cebb0 msgr2=0x7ffa480cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/1559443675 shutdown_connections 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/1559443675 wait complete. 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 Processor -- start 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- start start 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34004d10 0x7ffa480c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa481f3ad0 0x7ffa48158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa48158f00 0x7ffa480cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa481f37c0 con 0x7ffa48158f00 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa48158d40 con 0x7ffa34004d10 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa481f28f0 con 0x7ffa481f3ad0 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa48158f00 0x7ffa480cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa48158f00 0x7ffa480cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49334/0 (socket says 172.21.15.2:49334) 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 -- 172.21.15.2:0/4080777280 learned_addr learned my addr 172.21.15.2:0/4080777280 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa467fc640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa481f3ad0 0x7ffa48158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa46ffd640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34004d10 0x7ffa480c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 -- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa481f3ad0 msgr2=0x7ffa48158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa481f3ad0 0x7ffa48158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 -- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34004d10 msgr2=0x7ffa480c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34004d10 0x7ffa480c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 -- 172.21.15.2:0/4080777280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa480c59a0 con 0x7ffa48158f00 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa467fc640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa481f3ad0 0x7ffa48158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa477fe640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa48158f00 0x7ffa480cb370 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffa400073e0 tx=0x7ffa34005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa3f7fe640 1 -- 172.21.15.2:0/4080777280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400adc70 con 0x7ffa48158f00 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa3f7fe640 1 -- 172.21.15.2:0/4080777280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa400addd0 con 0x7ffa48158f00 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa481f2b40 con 0x7ffa48158f00 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa3f7fe640 1 -- 172.21.15.2:0/4080777280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa400b8640 con 0x7ffa48158f00 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.548+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa481f3100 con 0x7ffa48158f00 2023-11-04T01:44:03.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.552+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa480ce320 con 0x7ffa48158f00 2023-11-04T01:44:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.552+0000 7ffa3f7fe640 1 -- 172.21.15.2:0/4080777280 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa400b4040 con 0x7ffa48158f00 2023-11-04T01:44:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.552+0000 7ffa3f7fe640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa280664a0 0x7ffa28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:03.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.552+0000 7ffa3f7fe640 1 -- 172.21.15.2:0/4080777280 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffa4011e410 con 0x7ffa48158f00 2023-11-04T01:44:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.552+0000 7ffa46ffd640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa280664a0 0x7ffa28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.552+0000 7ffa46ffd640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa280664a0 0x7ffa28068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffa38000c10 tx=0x7ffa38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:03.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.556+0000 7ffa3f7fe640 1 -- 172.21.15.2:0/4080777280 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa400eb870 con 0x7ffa48158f00 2023-11-04T01:44:03.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.744+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa480744a0 con 0x7ffa48158f00 2023-11-04T01:44:03.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.744+0000 7ffa3f7fe640 1 -- 172.21.15.2:0/4080777280 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4901 (secure 0 0 0) 0x7ffa400eee90 con 0x7ffa48158f00 2023-11-04T01:44:03.750 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:03.750 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/47038667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":47038667},{"type":"v1","addr":"172.21.15.90:6835","nonce":47038667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3742811104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3742811104},{"type":"v1","addr":"172.21.15.90:6837","nonce":3742811104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2057053526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2057053526},{"type":"v1","addr":"172.21.15.2:6835","nonce":2057053526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:58.858818+0000","modified":"2023-11-04T01:44:00.951631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6834/1138444248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1138444248},{"type":"v1","addr":"172.21.15.2:6834","nonce":1138444248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:44:03.751 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2023-11-04T01:44:03.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa280664a0 msgr2=0x7ffa28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa280664a0 0x7ffa28068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffa38000c10 tx=0x7ffa38009040 comp rx=0 tx=0).stop 2023-11-04T01:44:03.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa48158f00 msgr2=0x7ffa480cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa48158f00 0x7ffa480cb370 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffa400073e0 tx=0x7ffa34005800 comp rx=0 tx=0).stop 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 shutdown_connections 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa280664a0 0x7ffa28068960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa48158f00 0x7ffa480cb370 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa481f3ad0 0x7ffa48158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 --2- 172.21.15.2:0/4080777280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa34004d10 0x7ffa480c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 >> 172.21.15.2:0/4080777280 conn(0x7ffa480cebb0 msgr2=0x7ffa480704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 shutdown_connections 2023-11-04T01:44:03.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:03.748+0000 7ffa4d7a0640 1 -- 172.21.15.2:0/4080777280 wait complete. 2023-11-04T01:44:04.170 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:43:58.858818+0000', 'modified': '2023-11-04T01:44:00.951631+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5757}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5757': {'gid': 5757, 'name': 'a', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6834/1138444248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 1138444248}, {'type': 'v1', 'addr': '172.21.15.2:6834', 'nonce': 1138444248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:44:04.170 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:44:04.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:44:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.300+0000 7ff55cbda640 1 Processor -- start 2023-11-04T01:44:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55cbda640 1 -- start start 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55cbda640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 0x7ff5580b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55cbda640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5580d0690 0x7ff5580cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55cbda640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580b6070 con 0x7ff5580d0ae0 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55cbda640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5580b8ed0 con 0x7ff5580d0690 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55cbda640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580b52b0 con 0x7ff5580b4990 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff555d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5580d0690 0x7ff5580cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff556d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff5580d0ae0 0x7ff5580cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44080/0 (socket says 172.21.15.2:44080) 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff556d9d640 1 -- 172.21.15.2:0/190314837 learned_addr learned my addr 172.21.15.2:0/190314837 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:04.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55659c640 1 --2- 172.21.15.2:0/190314837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 0x7ff5580b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff555d9b640 1 -- 172.21.15.2:0/190314837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 msgr2=0x7ff5580b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff555d9b640 1 --2- 172.21.15.2:0/190314837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 0x7ff5580b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff555d9b640 1 -- 172.21.15.2:0/190314837 >> v1:172.21.15.2:6789/0 conn(0x7ff5580d0ae0 legacy=0x7ff5580cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff555d9b640 1 -- 172.21.15.2:0/190314837 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580d1ce0 con 0x7ff5580d0690 2023-11-04T01:44:04.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff55559a640 1 -- 172.21.15.2:0/190314837 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502227950 0 0) 0x7ff5580b6070 con 0x7ff5580d0ae0 2023-11-04T01:44:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.304+0000 7ff555d9b640 1 --2- 172.21.15.2:0/190314837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff5580cd770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0097c0 tx=0x7ff54c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7d4645eb2f96f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55559a640 1 -- 172.21.15.2:0/190314837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0a8970 con 0x7ff5580d0690 2023-11-04T01:44:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55559a640 1 -- 172.21.15.2:0/190314837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c0a8ad0 con 0x7ff5580d0690 2023-11-04T01:44:04.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55559a640 1 -- 172.21.15.2:0/190314837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0a8e60 con 0x7ff5580d0690 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- 172.21.15.2:0/190314837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 msgr2=0x7ff5580cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 --2- 172.21.15.2:0/190314837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff5580cd770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0097c0 tx=0x7ff54c01ec70 comp rx=0 tx=0).stop 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- 172.21.15.2:0/190314837 shutdown_connections 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 --2- 172.21.15.2:0/190314837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff5580cd770 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 --2- 172.21.15.2:0/190314837 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 0x7ff5580b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- 172.21.15.2:0/190314837 >> 172.21.15.2:0/190314837 conn(0x7ff5580cf990 msgr2=0x7ff5580cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- 172.21.15.2:0/190314837 shutdown_connections 2023-11-04T01:44:04.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- 172.21.15.2:0/190314837 wait complete. 2023-11-04T01:44:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 Processor -- start 2023-11-04T01:44:04.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- start start 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 0x7ff5581544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff558155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5580d0ae0 0x7ff55815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580ca420 con 0x7ff5580d0690 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff558154a10 con 0x7ff5580d0ae0 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580ca080 con 0x7ff5580b4990 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff558155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff558155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49354/0 (socket says 172.21.15.2:49354) 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 -- 172.21.15.2:0/2617073011 learned_addr learned my addr 172.21.15.2:0/2617073011 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:04.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 -- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 msgr2=0x7ff5581544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 0x7ff5581544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 -- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5580d0ae0 msgr2=0x7ff55815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5580d0ae0 0x7ff55815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 -- 172.21.15.2:0/2617073011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c009420 con 0x7ff5580d0690 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff555d9b640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff558155df0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0b3040 tx=0x7ff54c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff546ffd640 1 -- 172.21.15.2:0/2617073011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0b9630 con 0x7ff5580d0690 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff546ffd640 1 -- 172.21.15.2:0/2617073011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c0b97b0 con 0x7ff5580d0690 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55815efe0 con 0x7ff5580d0690 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff546ffd640 1 -- 172.21.15.2:0/2617073011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0b9b60 con 0x7ff5580d0690 2023-11-04T01:44:04.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.308+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55815f5a0 con 0x7ff5580d0690 2023-11-04T01:44:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff546ffd640 1 -- 172.21.15.2:0/2617073011 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff54c0b7040 con 0x7ff5580d0690 2023-11-04T01:44:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff546ffd640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5380664d0 0x7ff538068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff546ffd640 1 -- 172.21.15.2:0/2617073011 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff54c1220a0 con 0x7ff5580d0690 2023-11-04T01:44:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5380664d0 0x7ff538068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 Processor -- start 2023-11-04T01:44:04.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 -- start start 2023-11-04T01:44:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5380664d0 0x7ff538068990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5480070b0 tx=0x7ff548007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e09fa0 0x561885e0a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dbd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885dbdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561885c88460 con 0x561885e09fa0 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561885c19690 con 0x561885e0a8c0 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561885c16bc0 con 0x561885dbdb40 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e09fa0 0x561885e0a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e09fa0 0x561885e0a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49362/0 (socket says 172.21.15.2:49362) 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 -- 172.21.15.2:0/3049484133 learned_addr learned my addr 172.21.15.2:0/3049484133 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff555d9b640 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dbd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff556d9d640 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885dbdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 -- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 msgr2=0x561885dbdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885dbdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 -- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 msgr2=0x561885dbd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dbd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.312+0000 7ff55659c640 1 -- 172.21.15.2:0/3049484133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56188590a890 con 0x561885e09fa0 2023-11-04T01:44:04.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e09fa0 0x561885e0a380 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff548017780 tx=0x7ff548011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71eec26f9c84ffd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff537fff640 1 -- 172.21.15.2:0/3049484133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54801c070 con 0x561885e09fa0 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff537fff640 1 -- 172.21.15.2:0/3049484133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548017c40 con 0x561885e09fa0 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff537fff640 1 -- 172.21.15.2:0/3049484133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480158b0 con 0x561885e09fa0 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/3049484133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e09fa0 msgr2=0x561885e0a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e09fa0 0x561885e0a380 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff548017780 tx=0x7ff548011000 comp rx=0 tx=0).stop 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/3049484133 shutdown_connections 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885dbdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dbd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3049484133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e09fa0 0x561885e0a380 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/3049484133 >> 172.21.15.2:0/3049484133 conn(0x561885dead40 msgr2=0x561885ded130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/3049484133 shutdown_connections 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/3049484133 wait complete. 2023-11-04T01:44:04.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- start start 2023-11-04T01:44:04.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 Processor -- start 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885dc60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e09fa0 0x561885dc2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dc30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561885c124b0 con 0x561885dbdb40 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561885bcaaa0 con 0x561885e0a8c0 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561885bd0940 con 0x561885e09fa0 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 10 client.0 _ll_register_callbacks cb 0x561885dab460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:04.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885dc60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885dc60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49364/0 (socket says 172.21.15.2:49364) 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 -- 172.21.15.2:0/1668256986 learned_addr learned my addr 172.21.15.2:0/1668256986 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff555d9b640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e09fa0 0x561885dc2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff556d9d640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dc30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 -- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e09fa0 msgr2=0x561885dc2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e09fa0 0x561885dc2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 -- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 msgr2=0x561885dc30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dc30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 -- 172.21.15.2:0/1668256986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff548017430 con 0x561885dbdb40 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff555d9b640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e09fa0 0x561885dc2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff556d9d640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dc30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:04.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55659c640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885dc60e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x561885d92aa0 tx=0x7ff548009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bb51854edd9974 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff5357fa640 1 -- 172.21.15.2:0/1668256986 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54802d650 con 0x561885dbdb40 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff5357fa640 1 -- 172.21.15.2:0/1668256986 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff548015e70 con 0x561885dbdb40 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561885bcfe10 con 0x561885dbdb40 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff5357fa640 1 -- 172.21.15.2:0/1668256986 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff54802d7b0 con 0x561885dbdb40 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 10 client.5913 fetch_fsmap learned FSMap version 20 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x561885bd31a0 con 0x561885dbdb40 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff5357fa640 1 -- 172.21.15.2:0/1668256986 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561885bcfe10 con 0x561885dbdb40 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff5357fa640 1 -- 172.21.15.2:0/1668256986 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 20) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff548034060 con 0x561885dbdb40 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 10 client.5913 fetch_fsmap finished waiting for FSMap version 20 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 10 client.5913 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 20 client.5913 populate_metadata read hostname 'smithi002' 2023-11-04T01:44:04.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885dc3df0 0x561885e1b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 4 client.5913 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 --> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561885c10e00 con 0x561885dc3df0 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.316+0000 7ff555d9b640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885dc3df0 0x561885e1b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff555d9b640 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885dc3df0 0x561885e1b250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a341a1c9c6e7b0b server_cookie=9b2a566a0477a358 in_seq=0 out_seq=0 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff5357fa640 10 client.5913 ms_handle_connect on v2:172.21.15.2:6832/1138444248 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff5357fa640 1 -- 172.21.15.2:0/1668256986 <== mds.0 v2:172.21.15.2:6832/1138444248 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561885c10e00 con 0x561885dc3df0 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff5357fa640 10 client.5913 handle_command_reply: tid=0 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 client.5913 shutdown 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 msgr2=0x561885dc60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885dc60e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x561885d92aa0 tx=0x7ff548009450 comp rx=0 tx=0).stop 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 shutdown_connections 2023-11-04T01:44:04.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885dc3df0 0x561885e1b250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e0a8c0 0x561885dc30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e09fa0 0x561885dc2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff5357fa640 0 client.5913 ms_handle_reset on v2:172.21.15.2:6832/1138444248 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 --2- 172.21.15.2:0/1668256986 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885dc60e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 >> 172.21.15.2:0/1668256986 conn(0x561885dead40 msgr2=0x561885ded130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 shutdown_connections 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 1 -- 172.21.15.2:0/1668256986 wait complete. 2023-11-04T01:44:04.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.320+0000 7ff55fd07000 20 client.5913 trim_cache size 0 max 16384 2023-11-04T01:44:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 Processor -- start 2023-11-04T01:44:04.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- start start 2023-11-04T01:44:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885e1d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e08050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e0a8c0 0x561885e08590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618858cb940 con 0x561885dbdb40 2023-11-04T01:44:04.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561885dc0390 con 0x561885e09fa0 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561885c0f8b0 con 0x561885e0a8c0 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885e1d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885e1d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49372/0 (socket says 172.21.15.2:49372) 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 -- 172.21.15.2:0/3982705596 learned_addr learned my addr 172.21.15.2:0/3982705596 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 -- 172.21.15.2:0/3982705596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e0a8c0 msgr2=0x561885e08590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 --2- 172.21.15.2:0/3982705596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e0a8c0 0x561885e08590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 -- 172.21.15.2:0/3982705596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 msgr2=0x561885e08050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 --2- 172.21.15.2:0/3982705596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e08050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 -- 172.21.15.2:0/3982705596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561885bb94a0 con 0x561885dbdb40 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55659c640 1 --2- 172.21.15.2:0/3982705596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885e1d480 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff548007e40 tx=0x7ff548029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca20ef7d483f9f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff544ff9640 1 -- 172.21.15.2:0/3982705596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54802dd90 con 0x561885dbdb40 2023-11-04T01:44:04.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff544ff9640 1 -- 172.21.15.2:0/3982705596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548015e70 con 0x561885dbdb40 2023-11-04T01:44:04.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff544ff9640 1 -- 172.21.15.2:0/3982705596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54802d690 con 0x561885dbdb40 2023-11-04T01:44:04.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- 172.21.15.2:0/3982705596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 msgr2=0x561885e1d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3982705596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885e1d480 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff548007e40 tx=0x7ff548029000 comp rx=0 tx=0).stop 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- 172.21.15.2:0/3982705596 shutdown_connections 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3982705596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885e0a8c0 0x561885e08590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3982705596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e08050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 --2- 172.21.15.2:0/3982705596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885dbdb40 0x561885e1d480 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- 172.21.15.2:0/3982705596 >> 172.21.15.2:0/3982705596 conn(0x561885dead40 msgr2=0x561885dc2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- 172.21.15.2:0/3982705596 shutdown_connections 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- 172.21.15.2:0/3982705596 wait complete. 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 -- start start 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.336+0000 7ff55fd07000 1 Processor -- start 2023-11-04T01:44:04.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885e1c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e26ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e0a8c0 0x561885e27220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561885dbda00 con 0x561885e0a8c0 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561885dc6130 con 0x561885e09fa0 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561885c10480 con 0x561885dbdb40 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 10 client.0 _ll_register_callbacks cb 0x7ff548009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e0a8c0 0x561885e27220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e0a8c0 0x561885e27220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49374/0 (socket says 172.21.15.2:49374) 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 -- 172.21.15.2:0/2257264204 learned_addr learned my addr 172.21.15.2:0/2257264204 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55659c640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885e1c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff555d9b640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e26ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 -- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 msgr2=0x561885e1c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885e1c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 -- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 msgr2=0x561885e26ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e26ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 -- 172.21.15.2:0/2257264204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561885bd31a0 con 0x561885e0a8c0 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff555d9b640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e26ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff556d9d640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e0a8c0 0x561885e27220 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff550001da0 tx=0x7ff55000e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a693aadfba4a03 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 1 -- 172.21.15.2:0/2257264204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500072d0 con 0x561885e0a8c0 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 1 -- 172.21.15.2:0/2257264204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff550014c50 con 0x561885e0a8c0 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561885bdcd10 con 0x561885e0a8c0 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 1 -- 172.21.15.2:0/2257264204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff55000ee90 con 0x561885e0a8c0 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 10 client.5919 fetch_fsmap learned FSMap version 20 2023-11-04T01:44:04.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x56188590acc0 con 0x561885e0a8c0 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 1 -- 172.21.15.2:0/2257264204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561885bdcd10 con 0x561885e0a8c0 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 1 -- 172.21.15.2:0/2257264204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 20) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff550007430 con 0x561885e0a8c0 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 10 client.5919 fetch_fsmap finished waiting for FSMap version 20 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 10 client.5919 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 20 client.5919 populate_metadata read hostname 'smithi002' 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885e6aa70 0x561885e6ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 4 client.5919 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 --> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561885c0b490 con 0x561885e6aa70 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55659c640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885e6aa70 0x561885e6ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55659c640 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885e6aa70 0x561885e6ae50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=700547a69532a4c7 server_cookie=4679bdb1ab43f8b2 in_seq=0 out_seq=0 2023-11-04T01:44:04.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 10 client.5919 ms_handle_connect on v2:172.21.15.2:6832/1138444248 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 1 -- 172.21.15.2:0/2257264204 <== mds.0 v2:172.21.15.2:6832/1138444248 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561885c0b490 con 0x561885e6aa70 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 10 client.5919 handle_command_reply: tid=0 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 client.5919 shutdown 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e0a8c0 msgr2=0x561885e27220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e0a8c0 0x561885e27220 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff550001da0 tx=0x7ff55000e590 comp rx=0 tx=0).stop 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 shutdown_connections 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:6832/1138444248,v1:172.21.15.2:6834/1138444248] conn(0x561885e6aa70 0x561885e6ae50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561885e0a8c0 0x561885e27220 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561885e09fa0 0x561885e26ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff5357fa640 0 client.5919 ms_handle_reset on v2:172.21.15.2:6832/1138444248 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 --2- 172.21.15.2:0/2257264204 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561885dbdb40 0x561885e1c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 >> 172.21.15.2:0/2257264204 conn(0x561885dead40 msgr2=0x561885dc41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 shutdown_connections 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 1 -- 172.21.15.2:0/2257264204 wait complete. 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55fd07000 20 client.5919 trim_cache size 0 max 16384 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5757, 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:44:04.352 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:44:04.353 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 4.7547329170000001, 2023-11-04T01:44:04.353 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 20, 2023-11-04T01:44:04.353 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 50, 2023-11-04T01:44:04.353 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 50, 2023-11-04T01:44:04.353 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 10.852106882999999 2023-11-04T01:44:04.353 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5380664d0 msgr2=0x7ff538068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5380664d0 0x7ff538068990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5480070b0 tx=0x7ff548007040 comp rx=0 tx=0).stop 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 msgr2=0x7ff558155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff558155df0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0b3040 tx=0x7ff54c01ba10 comp rx=0 tx=0).stop 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 shutdown_connections 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5380664d0 0x7ff538068990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5580d0ae0 0x7ff55815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5580d0690 0x7ff558155df0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 --2- 172.21.15.2:0/2617073011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5580b4990 0x7ff5581544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 >> 172.21.15.2:0/2617073011 conn(0x7ff5580cf990 msgr2=0x7ff5580b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 shutdown_connections 2023-11-04T01:44:04.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.340+0000 7ff55cbda640 1 -- 172.21.15.2:0/2617073011 wait complete. 2023-11-04T01:44:04.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:44:04.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa915149640 1 Processor -- start 2023-11-04T01:44:04.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa915149640 1 -- start start 2023-11-04T01:44:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa915149640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 0x7fa9100715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa915149640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9100c2670 con 0x7fa91006f8f0 2023-11-04T01:44:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa915149640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91006bc30 con 0x7fa9100b0d40 2023-11-04T01:44:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa915149640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa910070140 con 0x7fa91015afd0 2023-11-04T01:44:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa91006f8f0 0x7fa9100b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44088/0 (socket says 172.21.15.2:44088) 2023-11-04T01:44:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 -- 172.21.15.2:0/2237335624 learned_addr learned my addr 172.21.15.2:0/2237335624 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:04.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90ed9d640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 0x7fa9100715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262257289 0 0) 0x7fa9100c2670 con 0x7fa91006f8f0 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f8003530 con 0x7fa91006f8f0 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 434135234 0 0) 0x7fa8f8003530 con 0x7fa91006f8f0 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 msgr2=0x7fa9100715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 0x7fa9100715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 >> v1:172.21.15.90:6789/0 conn(0x7fa9100b0d40 legacy=0x7fa91015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91006bf10 con 0x7fa91006f8f0 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa900001680 con 0x7fa91006f8f0 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 >> v1:172.21.15.2:6789/0 conn(0x7fa91006f8f0 legacy=0x7fa9100b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 0x7fa8f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa8f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f8004d10 0x7fa8f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa910070140 con 0x7fa8f8003f30 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f800ba70 con 0x7fa8f8004d10 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f800bc30 con 0x7fa91015afd0 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa8f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90f59e640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f8004d10 0x7fa8f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90ed9d640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 0x7fa8f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 -- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 msgr2=0x7fa8f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa91015afd0 0x7fa8f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 -- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f8004d10 msgr2=0x7fa8f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8f8004d10 0x7fa8f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.468+0000 7fa90e59c640 1 -- 172.21.15.2:0/2237335624 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8003530 con 0x7fa8f8003f30 2023-11-04T01:44:04.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90e59c640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa8f80047d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c1c0 tx=0x7fa90001f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab7179baa036d37 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900005ae0 con 0x7fa8f8003f30 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9000ab070 con 0x7fa8f8003f30 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90dd9b640 1 -- 172.21.15.2:0/2237335624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900007070 con 0x7fa8f8003f30 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- 172.21.15.2:0/2237335624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 msgr2=0x7fa8f80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 --2- 172.21.15.2:0/2237335624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa8f80047d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c1c0 tx=0x7fa90001f390 comp rx=0 tx=0).stop 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90f59e640 1 -- 172.21.15.2:0/2237335624 reap_dead start 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- 172.21.15.2:0/2237335624 shutdown_connections 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- 172.21.15.2:0/2237335624 >> 172.21.15.2:0/2237335624 conn(0x7fa9100cebb0 msgr2=0x7fa9100cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- 172.21.15.2:0/2237335624 shutdown_connections 2023-11-04T01:44:04.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- 172.21.15.2:0/2237335624 wait complete. 2023-11-04T01:44:04.479 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:44:04.472+0000 7f584d888640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:04.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 Processor -- start 2023-11-04T01:44:04.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- start start 2023-11-04T01:44:04.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa9101535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa910146b10 0x7fa910146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9100b2b80 0x7fa9100b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9101f1ce0 con 0x7fa8f8003f30 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9101474d0 con 0x7fa9100b2b80 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa915149640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100b38b0 con 0x7fa910146b10 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa9101535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa9101535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49392/0 (socket says 172.21.15.2:49392) 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.472+0000 7fa90ed9d640 1 -- 172.21.15.2:0/1225790555 learned_addr learned my addr 172.21.15.2:0/1225790555 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90f59e640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9100b2b80 0x7fa9100b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90e59c640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa910146b10 0x7fa910146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90ed9d640 1 -- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa910146b10 msgr2=0x7fa910146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90ed9d640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa910146b10 0x7fa910146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90ed9d640 1 -- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9100b2b80 msgr2=0x7fa9100b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90ed9d640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9100b2b80 0x7fa9100b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90ed9d640 1 -- 172.21.15.2:0/1225790555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9100b3b90 con 0x7fa8f8003f30 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90ed9d640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa9101535e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa9040115e0 tx=0x7fa904011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa8f77fe640 1 -- 172.21.15.2:0/1225790555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400f8f0 con 0x7fa8f8003f30 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa8f77fe640 1 -- 172.21.15.2:0/1225790555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400fa50 con 0x7fa8f8003f30 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9100b3e70 con 0x7fa8f8003f30 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa8f77fe640 1 -- 172.21.15.2:0/1225790555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400fdc0 con 0x7fa8f8003f30 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9100b3570 con 0x7fa8f8003f30 2023-11-04T01:44:04.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9100744a0 con 0x7fa8f8003f30 2023-11-04T01:44:04.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa8f77fe640 1 -- 172.21.15.2:0/1225790555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa904015460 con 0x7fa8f8003f30 2023-11-04T01:44:04.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa8f77fe640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8fc0664d0 0x7fa8fc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:04.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa8f77fe640 1 -- 172.21.15.2:0/1225790555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa904084820 con 0x7fa8f8003f30 2023-11-04T01:44:04.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90e59c640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8fc0664d0 0x7fa8fc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:04.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.476+0000 7fa90e59c640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8fc0664d0 0x7fa8fc068990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9000af000 tx=0x7fa9000aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:04.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.480+0000 7fa8f77fe640 1 -- 172.21.15.2:0/1225790555 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa904051c20 con 0x7fa8f8003f30 2023-11-04T01:44:04.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.664+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa91006cba0 con 0x7fa8f8003f30 2023-11-04T01:44:04.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.664+0000 7fa8f77fe640 1 -- 172.21.15.2:0/1225790555 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa904055240 con 0x7fa8f8003f30 2023-11-04T01:44:04.669 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:44:04.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8fc0664d0 msgr2=0x7fa8fc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8fc0664d0 0x7fa8fc068990 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa9000af000 tx=0x7fa9000aa000 comp rx=0 tx=0).stop 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 msgr2=0x7fa9101535e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa9101535e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa9040115e0 tx=0x7fa904011aa0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 shutdown_connections 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8fc0664d0 0x7fa8fc068990 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9100b2b80 0x7fa9100b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa910146b10 0x7fa910146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 --2- 172.21.15.2:0/1225790555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8f8003f30 0x7fa9101535e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 >> 172.21.15.2:0/1225790555 conn(0x7fa9100cebb0 msgr2=0x7fa9100c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 shutdown_connections 2023-11-04T01:44:04.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:04.668+0000 7fa915149640 1 -- 172.21.15.2:0/1225790555 wait complete. 2023-11-04T01:44:04.686 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:44:04.687 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:04.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:04.687 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:44:04.693 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:44:04.694 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42100sec preferred_lft 42100sec 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:44:04.695 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:44:04.696 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.697 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:44:04.697 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:04.697 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:44:04.697 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:04.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:04.697 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:44:04.743 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:44:04.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:04.745 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:44:04.797 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:44:04.797 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:44:04.797 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:44:04.797 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:44:04.797 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:44:04.798 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:44:04.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:04.798 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:44:04.798 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:44:04.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:44:04.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:44:04.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:44:04.798 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:44:04.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:04.871 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:44:04.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:44:04.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:44:04.920 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:04.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:04.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:44:04.976 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:44:04.976 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:44:04.977 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:05.024 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:05.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:44:05.024 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:05.072 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:44:05.125 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:44:05.126 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:05.127 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:05.128 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:05.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:05.129 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:44:05.176 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:44:05.176 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:44:05.221 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:05.227 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:44:05.227 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:44:05.227 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:44:05.228 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:05.229 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:05.230 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:44:05.230 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:05.230 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:05.230 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:05.230 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:05.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:05.231 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:44:05.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:44:05.300+0000 7f9168a05580 -1 init, newargv = 0x562603b41740 newargc=15 2023-11-04T01:44:05.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[49617]: starting ceph client 2023-11-04T01:44:05.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[49617]: starting fuse 2023-11-04T01:44:06.381 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:44:06.389 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:44:06.390 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:44:06.391 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:06.392 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:06.392 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:06.392 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:06.392 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:06.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:06.393 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:44:06.441 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:44:06.441 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:44:06.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:44:06.441 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:44:06.441 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:44:06.441 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:44:06.441 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:44:06.442 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:44:06.443 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:44:06.572 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.49617.asok 2023-11-04T01:44:06.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:06.585 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49617.asok 2023-11-04T01:44:06.585 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:06.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.49617.asok status 2023-11-04T01:44:06.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:06.784 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "49617", 2023-11-04T01:44:06.785 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5934, 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 5934 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:44:06.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1417063518 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1417063518 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.5934 192.168.0.1:0/1417063518", 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/1417063518", 2023-11-04T01:44:06.787 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:44:06.788 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 20, 2023-11-04T01:44:06.788 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 50, 2023-11-04T01:44:06.788 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:44:06.788 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:44:06.788 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:44:06.788 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:44:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:06.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:06.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:44:06.805 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:06.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:06.850 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:44:06.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:06.857 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:06.857 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:06.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:06.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:06.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:06.959 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data mksnap snap1 2023-11-04T01:44:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 Processor -- start 2023-11-04T01:44:06.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- start start 2023-11-04T01:44:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133c316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133c19270 0x557133c31c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133cc2750 0x557133cbe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557133b99190 con 0x7fc4980030c0 2023-11-04T01:44:06.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557133b50fc0 con 0x557133cc2750 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x557133b50cc0 con 0x557133c19270 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133c316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133c316d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49406/0 (socket says 172.21.15.2:49406) 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 -- 172.21.15.2:0/2416363518 learned_addr learned my addr 172.21.15.2:0/2416363518 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3133640 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133c19270 0x557133c31c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b4135640 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133cc2750 0x557133cbe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 -- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133c19270 msgr2=0x557133c31c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133c19270 0x557133c31c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 -- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133cc2750 msgr2=0x557133cbe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:06.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133cc2750 0x557133cbe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 -- 172.21.15.2:0/2416363518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557133b3f420 con 0x7fc4980030c0 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b4135640 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133cc2750 0x557133cbe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b3934640 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133c316d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009860 tx=0x7fc4a4005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9058066ac825a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b2131640 1 -- 172.21.15.2:0/2416363518 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4019070 con 0x7fc4980030c0 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b2131640 1 -- 172.21.15.2:0/2416363518 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4010040 con 0x7fc4980030c0 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b2131640 1 -- 172.21.15.2:0/2416363518 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400f050 con 0x7fc4980030c0 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- 172.21.15.2:0/2416363518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 msgr2=0x557133c316d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133c316d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009860 tx=0x7fc4a4005a10 comp rx=0 tx=0).stop 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- 172.21.15.2:0/2416363518 shutdown_connections 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133cc2750 0x557133cbe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133c19270 0x557133c31c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/2416363518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133c316d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- 172.21.15.2:0/2416363518 >> 172.21.15.2:0/2416363518 conn(0x557133c157c0 msgr2=0x557133cbf510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- 172.21.15.2:0/2416363518 shutdown_connections 2023-11-04T01:44:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.988+0000 7fc4b5e15080 1 -- 172.21.15.2:0/2416363518 wait complete. 2023-11-04T01:44:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 Processor -- start 2023-11-04T01:44:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 -- start start 2023-11-04T01:44:07.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133c19270 0x557133ca8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133cc2750 0x557133cac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133caccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557133b272c0 con 0x7fc4980030c0 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x557133ca7b60 con 0x557133c19270 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x557133ca7e00 con 0x557133cc2750 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133caccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133caccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49408/0 (socket says 172.21.15.2:49408) 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 -- 172.21.15.2:0/53863279 learned_addr learned my addr 172.21.15.2:0/53863279 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b3133640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133cc2750 0x557133cac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b3934640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133c19270 0x557133ca8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 -- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133cc2750 msgr2=0x557133cac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133cc2750 0x557133cac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 -- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133c19270 msgr2=0x557133ca8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133c19270 0x557133ca8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 -- 172.21.15.2:0/53863279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a4009460 con 0x7fc4980030c0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b3934640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133c19270 0x557133ca8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b4135640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133caccf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005b00 tx=0x7fc4ac010630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b112f640 1 -- 172.21.15.2:0/53863279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac014660 con 0x7fc4980030c0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b112f640 1 -- 172.21.15.2:0/53863279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac0147c0 con 0x7fc4980030c0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557133b325d0 con 0x7fc4980030c0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b112f640 1 -- 172.21.15.2:0/53863279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac014b30 con 0x7fc4980030c0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557133b32030 con 0x7fc4980030c0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b112f640 1 -- 172.21.15.2:0/53863279 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4ac014c90 con 0x7fc4980030c0 2023-11-04T01:44:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b112f640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc49c064e80 0x7fc49c067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b112f640 1 -- 172.21.15.2:0/53863279 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fc4ac0832d0 con 0x7fc4980030c0 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.992+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(create snap pool 8 tid 1 name snap1 v0) v4 -- 0x557133ba3110 con 0x7fc4980030c0 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b3934640 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc49c064e80 0x7fc49c067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b112f640 1 -- 172.21.15.2:0/53863279 <== mon.0 v2:172.21.15.2:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v52) v1 ==== 43+0+0 (secure 0 0 0) 0x7fc4ac050660 con 0x7fc4980030c0 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:error creating pool cephfs_data snapshot snap1: (95) Operation not supported 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc49c064e80 msgr2=0x7fc49c067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc49c064e80 0x7fc49c067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 msgr2=0x557133caccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133caccf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005b00 tx=0x7fc4ac010630 comp rx=0 tx=0).stop 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 shutdown_connections 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc49c064e80 0x7fc49c067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4980030c0 0x557133caccf0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x557133cc2750 0x557133cac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 --2- 172.21.15.2:0/53863279 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x557133c19270 0x557133ca8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 >> 172.21.15.2:0/53863279 conn(0x557133c157c0 msgr2=0x557133c318e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 shutdown_connections 2023-11-04T01:44:07.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:06.996+0000 7fc4b5e15080 1 -- 172.21.15.2:0/53863279 wait complete. 2023-11-04T01:44:07.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:07.005 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata mksnap snap2 2023-11-04T01:44:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.072+0000 7fd0e7e36080 1 Processor -- start 2023-11-04T01:44:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.072+0000 7fd0e7e36080 1 -- start start 2023-11-04T01:44:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de515a30 0x55e7de5c0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a19b0 0x55e7de5bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de5a22d0 0x55e7de5c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7de498190 con 0x55e7de515a30 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7de44ffc0 con 0x55e7de5a22d0 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7de44fcc0 con 0x55e7de5a19b0 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de515a30 0x55e7de5c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de515a30 0x55e7de5c0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49420/0 (socket says 172.21.15.2:49420) 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 -- 172.21.15.2:0/2321476713 learned_addr learned my addr 172.21.15.2:0/2321476713 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e6156640 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de5a22d0 0x55e7de5c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5154640 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a19b0 0x55e7de5bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 -- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a19b0 msgr2=0x55e7de5bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a19b0 0x55e7de5bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 -- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de5a22d0 msgr2=0x55e7de5c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de5a22d0 0x55e7de5c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 -- 172.21.15.2:0/2321476713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc005d30 con 0x55e7de515a30 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e6156640 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de5a22d0 0x55e7de5c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e5955640 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de515a30 0x55e7de5c0010 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001da0 tx=0x7fd0d800b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594a9a1d7c6f0737 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0d7fff640 1 -- 172.21.15.2:0/2321476713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8014070 con 0x55e7de515a30 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0d7fff640 1 -- 172.21.15.2:0/2321476713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800f460 con 0x55e7de515a30 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0d7fff640 1 -- 172.21.15.2:0/2321476713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8007040 con 0x55e7de515a30 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- 172.21.15.2:0/2321476713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de515a30 msgr2=0x55e7de5c0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de515a30 0x55e7de5c0010 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001da0 tx=0x7fd0d800b610 comp rx=0 tx=0).stop 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- 172.21.15.2:0/2321476713 shutdown_connections 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de5a22d0 0x55e7de5c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a19b0 0x55e7de5bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/2321476713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de515a30 0x55e7de5c0010 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- 172.21.15.2:0/2321476713 >> 172.21.15.2:0/2321476713 conn(0x55e7de513f00 msgr2=0x55e7de4ec520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- 172.21.15.2:0/2321476713 shutdown_connections 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- 172.21.15.2:0/2321476713 wait complete. 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 Processor -- start 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- start start 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de515a30 0x55e7de4ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de5a19b0 0x55e7de4eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a22d0 0x55e7de5293e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7de4262c0 con 0x55e7de5a19b0 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7de4eb9c0 con 0x55e7de515a30 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.076+0000 7fd0e7e36080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7de4ebc60 con 0x55e7de5a22d0 2023-11-04T01:44:07.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de5a19b0 0x55e7de4eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de5a19b0 0x55e7de4eaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49424/0 (socket says 172.21.15.2:49424) 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 -- 172.21.15.2:0/249445638 learned_addr learned my addr 172.21.15.2:0/249445638 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5955640 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de515a30 0x55e7de4ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e6156640 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a22d0 0x55e7de5293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 -- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a22d0 msgr2=0x55e7de5293e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a22d0 0x55e7de5293e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 -- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de515a30 msgr2=0x55e7de4ec8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de515a30 0x55e7de4ec8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 -- 172.21.15.2:0/249445638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7de431240 con 0x55e7de5a19b0 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5154640 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de5a19b0 0x55e7de4eaff0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0088a0 tx=0x7fd0dc008d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0d6ffd640 1 -- 172.21.15.2:0/249445638 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00f050 con 0x55e7de5a19b0 2023-11-04T01:44:07.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0d6ffd640 1 -- 172.21.15.2:0/249445638 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc010040 con 0x55e7de5a19b0 2023-11-04T01:44:07.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0d6ffd640 1 -- 172.21.15.2:0/249445638 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc015460 con 0x55e7de5a19b0 2023-11-04T01:44:07.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e000a1c0 con 0x55e7de5a19b0 2023-11-04T01:44:07.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7de43e420 con 0x55e7de5a19b0 2023-11-04T01:44:07.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0d6ffd640 1 -- 172.21.15.2:0/249445638 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd0dc0155c0 con 0x55e7de5a19b0 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0d6ffd640 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0c8064e80 0x7fd0c8067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0d6ffd640 1 -- 172.21.15.2:0/249445638 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd0dc083680 con 0x55e7de5a19b0 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(create snap pool 7 tid 1 name snap2 v0) v4 -- 0x55e7de4a2110 con 0x55e7de5a19b0 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e5955640 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0c8064e80 0x7fd0c8067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0d6ffd640 1 -- 172.21.15.2:0/249445638 <== mon.0 v2:172.21.15.2:3300/0 6 ==== pool_op_reply(tid 1 (95) Operation not supported v52) v1 ==== 43+0+0 (secure 0 0 0) 0x7fd0dc050ac0 con 0x55e7de5a19b0 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:error creating pool cephfs_metadata snapshot snap2: (95) Operation not supported 2023-11-04T01:44:07.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0c8064e80 msgr2=0x7fd0c8067340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0c8064e80 0x7fd0c8067340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de5a19b0 msgr2=0x55e7de4eaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.080+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de5a19b0 0x55e7de4eaff0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0088a0 tx=0x7fd0dc008d60 comp rx=0 tx=0).stop 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 shutdown_connections 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0c8064e80 0x7fd0c8067340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55e7de5a22d0 0x55e7de5293e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7de5a19b0 0x55e7de4eaff0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 --2- 172.21.15.2:0/249445638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55e7de515a30 0x55e7de4ec8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 >> 172.21.15.2:0/249445638 conn(0x55e7de513f00 msgr2=0x55e7de5ba380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 shutdown_connections 2023-11-04T01:44:07.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.084+0000 7fd0e7e36080 1 -- 172.21.15.2:0/249445638 wait complete. 2023-11-04T01:44:07.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_data snap3 2023-11-04T01:44:07.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.252+0000 7f9b84c00640 1 Processor -- start 2023-11-04T01:44:07.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b84c00640 1 -- start start 2023-11-04T01:44:07.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b84c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b800b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b84c00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b8006ba10 0x7f9b80160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b84c00640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b800b0eb0 con 0x7f9b800b0a50 2023-11-04T01:44:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b84c00640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800c90e0 con 0x7f9b8006ba10 2023-11-04T01:44:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b84c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8006c010 con 0x7f9b8015d290 2023-11-04T01:44:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7e59c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b800b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7ed9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b8006ba10 0x7f9b80160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7dd9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9b800b0a50 0x7f9b8006b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:54348/0 (socket says 172.21.15.2:54348) 2023-11-04T01:44:07.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7dd9b640 1 -- 172.21.15.2:0/2986570777 learned_addr learned my addr 172.21.15.2:0/2986570777 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7e59c640 1 -- 172.21.15.2:0/2986570777 >> v2:172.21.15.90:3300/0 conn(0x7f9b8006ba10 msgr2=0x7f9b80160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7e59c640 1 --2- 172.21.15.2:0/2986570777 >> v2:172.21.15.90:3300/0 conn(0x7f9b8006ba10 0x7f9b80160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7e59c640 1 -- 172.21.15.2:0/2986570777 >> v1:172.21.15.90:6789/0 conn(0x7f9b800b0a50 legacy=0x7f9b8006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7e59c640 1 -- 172.21.15.2:0/2986570777 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800ac960 con 0x7f9b8015d290 2023-11-04T01:44:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.256+0000 7f9b7ed9d640 1 --2- 172.21.15.2:0/2986570777 >> v2:172.21.15.90:3300/0 conn(0x7f9b8006ba10 0x7f9b80160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:07.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b7e59c640 1 --2- 172.21.15.2:0/2986570777 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b800b0510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b680097c0 tx=0x7f9b6801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71b589bf43f88cbd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b7d59a640 1 -- 172.21.15.2:0/2986570777 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680ad660 con 0x7f9b8015d290 2023-11-04T01:44:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b7d59a640 1 -- 172.21.15.2:0/2986570777 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680ad7c0 con 0x7f9b8015d290 2023-11-04T01:44:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b7d59a640 1 -- 172.21.15.2:0/2986570777 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680adb50 con 0x7f9b8015d290 2023-11-04T01:44:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 -- 172.21.15.2:0/2986570777 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 msgr2=0x7f9b800b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 --2- 172.21.15.2:0/2986570777 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b800b0510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b680097c0 tx=0x7f9b6801c450 comp rx=0 tx=0).stop 2023-11-04T01:44:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 -- 172.21.15.2:0/2986570777 shutdown_connections 2023-11-04T01:44:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 --2- 172.21.15.2:0/2986570777 >> v2:172.21.15.90:3300/0 conn(0x7f9b8006ba10 0x7f9b80160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 --2- 172.21.15.2:0/2986570777 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b800b0510 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 -- 172.21.15.2:0/2986570777 >> 172.21.15.2:0/2986570777 conn(0x7f9b800cb510 msgr2=0x7f9b800cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 -- 172.21.15.2:0/2986570777 shutdown_connections 2023-11-04T01:44:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 -- 172.21.15.2:0/2986570777 wait complete. 2023-11-04T01:44:07.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 Processor -- start 2023-11-04T01:44:07.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 -- start start 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8006ba10 0x7f9b80151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.260+0000 7f9b84c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b800b0a50 0x7f9b8014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b84c00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b80150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b84c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800b29a0 con 0x7f9b800b0a50 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b84c00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800b4680 con 0x7f9b8006ba10 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b84c00640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80160250 con 0x7f9b8015d290 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b800b0a50 0x7f9b8014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b800b0a50 0x7f9b8014fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49432/0 (socket says 172.21.15.2:49432) 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 -- 172.21.15.2:0/4083863617 learned_addr learned my addr 172.21.15.2:0/4083863617 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:07.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7e59c640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8006ba10 0x7f9b80151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7ed9d640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b80150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 -- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 msgr2=0x7f9b80150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b8015d290 0x7f9b80150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 -- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8006ba10 msgr2=0x7f9b80151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8006ba10 0x7f9b80151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 -- 172.21.15.2:0/4083863617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78009420 con 0x7f9b800b0a50 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7e59c640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b8006ba10 0x7f9b80151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7dd9b640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b800b0a50 0x7f9b8014fec0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000cb10 tx=0x7f9b7000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b76ffd640 1 -- 172.21.15.2:0/4083863617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7000ac70 con 0x7f9b800b0a50 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b76ffd640 1 -- 172.21.15.2:0/4083863617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7000add0 con 0x7f9b800b0a50 2023-11-04T01:44:07.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b76ffd640 1 -- 172.21.15.2:0/4083863617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70012620 con 0x7f9b800b0a50 2023-11-04T01:44:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b84c00640 1 -- 172.21.15.2:0/4083863617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b68009420 con 0x7f9b800b0a50 2023-11-04T01:44:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b84c00640 1 -- 172.21.15.2:0/4083863617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800b2c60 con 0x7f9b800b0a50 2023-11-04T01:44:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b84c00640 1 -- 172.21.15.2:0/4083863617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b800744a0 con 0x7f9b800b0a50 2023-11-04T01:44:07.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b76ffd640 1 -- 172.21.15.2:0/4083863617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b70007070 con 0x7f9b800b0a50 2023-11-04T01:44:07.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b76ffd640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b600664a0 0x7f9b60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b76ffd640 1 -- 172.21.15.2:0/4083863617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f9b70083fd0 con 0x7f9b800b0a50 2023-11-04T01:44:07.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.264+0000 7f9b7e59c640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b600664a0 0x7f9b60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.268+0000 7f9b7e59c640 1 --2- 172.21.15.2:0/4083863617 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b600664a0 0x7f9b60068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b680af000 tx=0x7f9b68008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.268+0000 7f9b76ffd640 1 -- 172.21.15.2:0/4083863617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b700512d0 con 0x7f9b800b0a50 2023-11-04T01:44:07.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.424+0000 7f9b84c00640 1 -- 172.21.15.2:0/4083863617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"} v 0) v1 -- 0x7f9b800ade30 con 0x7f9b800b0a50 2023-11-04T01:44:07.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.428+0000 7f9b76ffd640 1 -- 172.21.15.2:0/4083863617 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_data", "snap": "snap3"}]=-95 (95) Operation not supported v52) v1 ==== 131+0+0 (secure 0 0 0) 0x7f9b700170a0 con 0x7f9b800b0a50 2023-11-04T01:44:07.431 INFO:teuthology.orchestra.run.smithi002.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:44:07.436 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:44:07.437 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool mksnap cephfs_metadata snap4 2023-11-04T01:44:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.564+0000 7f87bfa06640 1 Processor -- start 2023-11-04T01:44:07.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.564+0000 7f87bfa06640 1 -- start start 2023-11-04T01:44:07.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.564+0000 7f87bfa06640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87b8070270 0x7f87b80cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.564+0000 7f87bfa06640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80ca460 con 0x7f87b815aed0 2023-11-04T01:44:07.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.564+0000 7f87bfa06640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80cbb90 con 0x7f87b80ca8f0 2023-11-04T01:44:07.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.564+0000 7f87bfa06640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b80c9810 con 0x7f87b8070270 2023-11-04T01:44:07.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87bd7a2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f87b815aed0 0x7f87b80c6410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44114/0 (socket says 172.21.15.2:44114) 2023-11-04T01:44:07.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87bd7a2640 1 -- 172.21.15.2:0/3183960160 learned_addr learned my addr 172.21.15.2:0/3183960160 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:07.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87bcfa1640 1 --2- 172.21.15.2:0/3183960160 >> v2:172.21.15.2:3300/0 conn(0x7f87b8070270 0x7f87b80cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87affff640 1 -- 172.21.15.2:0/3183960160 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168196942 0 0) 0x7f87b80ca460 con 0x7f87b815aed0 2023-11-04T01:44:07.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87affff640 1 -- 172.21.15.2:0/3183960160 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a4003530 con 0x7f87b815aed0 2023-11-04T01:44:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87bcfa1640 1 -- 172.21.15.2:0/3183960160 >> v1:172.21.15.90:6789/0 conn(0x7f87b80ca8f0 legacy=0x7f87b806c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87bcfa1640 1 -- 172.21.15.2:0/3183960160 >> v1:172.21.15.2:6789/0 conn(0x7f87b815aed0 legacy=0x7f87b80c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87bcfa1640 1 -- 172.21.15.2:0/3183960160 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80c9b30 con 0x7f87b8070270 2023-11-04T01:44:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87bcfa1640 1 --2- 172.21.15.2:0/3183960160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b8070270 0x7f87b80cb4d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f87a80097c0 tx=0x7f87a801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661bbce9b5b1c8fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87affff640 1 -- 172.21.15.2:0/3183960160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80ac620 con 0x7f87b8070270 2023-11-04T01:44:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87affff640 1 -- 172.21.15.2:0/3183960160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a80ac780 con 0x7f87b8070270 2023-11-04T01:44:07.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.568+0000 7f87affff640 1 -- 172.21.15.2:0/3183960160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80acaf0 con 0x7f87b8070270 2023-11-04T01:44:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- 172.21.15.2:0/3183960160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b8070270 msgr2=0x7f87b80cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 --2- 172.21.15.2:0/3183960160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b8070270 0x7f87b80cb4d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f87a80097c0 tx=0x7f87a801c3c0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- 172.21.15.2:0/3183960160 shutdown_connections 2023-11-04T01:44:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 --2- 172.21.15.2:0/3183960160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b8070270 0x7f87b80cb4d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- 172.21.15.2:0/3183960160 >> 172.21.15.2:0/3183960160 conn(0x7f87b80cf340 msgr2=0x7f87b80cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- 172.21.15.2:0/3183960160 shutdown_connections 2023-11-04T01:44:07.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- 172.21.15.2:0/3183960160 wait complete. 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 Processor -- start 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- start start 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87b8070270 0x7f87b80c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b80ca8f0 0x7f87b815b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87b815aed0 0x7f87b80af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80c53f0 con 0x7f87b80ca8f0 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b80b2620 con 0x7f87b815aed0 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b814f790 con 0x7f87b8070270 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b80ca8f0 0x7f87b815b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b80ca8f0 0x7f87b815b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49450/0 (socket says 172.21.15.2:49450) 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 -- 172.21.15.2:0/566317844 learned_addr learned my addr 172.21.15.2:0/566317844 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:07.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bdfa3640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87b815aed0 0x7f87b80af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bd7a2640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87b8070270 0x7f87b80c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 -- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87b8070270 msgr2=0x7f87b80c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87b8070270 0x7f87b80c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 -- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87b815aed0 msgr2=0x7f87b80af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87b815aed0 0x7f87b80af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 -- 172.21.15.2:0/566317844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8009420 con 0x7f87b80ca8f0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bcfa1640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87b80ca8f0 0x7f87b815b640 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f87a8018fd0 tx=0x7f87a8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87adffb640 1 -- 172.21.15.2:0/566317844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80ac620 con 0x7f87b80ca8f0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87adffb640 1 -- 172.21.15.2:0/566317844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8004020 con 0x7f87b80ca8f0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- 172.21.15.2:0/566317844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b814fa70 con 0x7f87b80ca8f0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87adffb640 1 -- 172.21.15.2:0/566317844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8004390 con 0x7f87b80ca8f0 2023-11-04T01:44:07.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.572+0000 7f87bfa06640 1 -- 172.21.15.2:0/566317844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b80b22b0 con 0x7f87b80ca8f0 2023-11-04T01:44:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.576+0000 7f87bfa06640 1 -- 172.21.15.2:0/566317844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b80744a0 con 0x7f87b80ca8f0 2023-11-04T01:44:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.576+0000 7f87adffb640 1 -- 172.21.15.2:0/566317844 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87a80b3040 con 0x7f87b80ca8f0 2023-11-04T01:44:07.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.576+0000 7f87adffb640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f879c0664a0 0x7f879c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:07.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.576+0000 7f87adffb640 1 -- 172.21.15.2:0/566317844 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f87a811e130 con 0x7f87b80ca8f0 2023-11-04T01:44:07.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.576+0000 7f87bd7a2640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f879c0664a0 0x7f879c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:07.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.576+0000 7f87bd7a2640 1 --2- 172.21.15.2:0/566317844 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f879c0664a0 0x7f879c068960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87b40011f0 tx=0x7f87b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:07.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.580+0000 7f87adffb640 1 -- 172.21.15.2:0/566317844 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87a80eb420 con 0x7f87b80ca8f0 2023-11-04T01:44:07.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.740+0000 7f87bfa06640 1 -- 172.21.15.2:0/566317844 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"} v 0) v1 -- 0x7f87b80717b0 con 0x7f87b80ca8f0 2023-11-04T01:44:07.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:07.740+0000 7f87adffb640 1 -- 172.21.15.2:0/566317844 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool mksnap", "pool": "cephfs_metadata", "snap": "snap4"}]=-95 (95) Operation not supported v52) v1 ==== 135+0+0 (secure 0 0 0) 0x7f87a80044f0 con 0x7f87b80ca8f0 2023-11-04T01:44:07.746 INFO:teuthology.orchestra.run.smithi002.stderr:Error ENOTSUP: (95) Operation not supported 2023-11-04T01:44:07.753 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:44:07.753 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:44:07.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:07.800 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:07.837 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:44:07.837 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:07.837 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:07.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:08.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.008+0000 7f3485a56640 1 Processor -- start 2023-11-04T01:44:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.008+0000 7f3485a56640 1 -- start start 2023-11-04T01:44:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3480159a50 0x7f34800cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3480159e30 con 0x7f34800ce720 2023-11-04T01:44:08.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34800ccfd0 con 0x7f348006c1a0 2023-11-04T01:44:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34800cd2b0 con 0x7f3480159a50 2023-11-04T01:44:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3480159a50 0x7f34800cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347e7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f34800ce720 0x7f348006ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44122/0 (socket says 172.21.15.2:44122) 2023-11-04T01:44:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347e7fc640 1 -- 172.21.15.2:0/1389911688 learned_addr learned my addr 172.21.15.2:0/1389911688 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347effd640 1 -- 172.21.15.2:0/1389911688 >> v1:172.21.15.90:6789/0 conn(0x7f348006c1a0 legacy=0x7f348006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347effd640 1 -- 172.21.15.2:0/1389911688 >> v1:172.21.15.2:6789/0 conn(0x7f34800ce720 legacy=0x7f348006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347effd640 1 -- 172.21.15.2:0/1389911688 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800cd590 con 0x7f3480159a50 2023-11-04T01:44:08.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347effd640 1 --2- 172.21.15.2:0/1389911688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480159a50 0x7f34800cc6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3470009d90 tx=0x7f3470021310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da31625c57a9b82 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347dffb640 1 -- 172.21.15.2:0/1389911688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700b1600 con 0x7f3480159a50 2023-11-04T01:44:08.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347dffb640 1 -- 172.21.15.2:0/1389911688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34700ad050 con 0x7f3480159a50 2023-11-04T01:44:08.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f347dffb640 1 -- 172.21.15.2:0/1389911688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700b1980 con 0x7f3480159a50 2023-11-04T01:44:08.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 -- 172.21.15.2:0/1389911688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480159a50 msgr2=0x7f34800cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 --2- 172.21.15.2:0/1389911688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480159a50 0x7f34800cc6f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3470009d90 tx=0x7f3470021310 comp rx=0 tx=0).stop 2023-11-04T01:44:08.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 -- 172.21.15.2:0/1389911688 shutdown_connections 2023-11-04T01:44:08.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 --2- 172.21.15.2:0/1389911688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3480159a50 0x7f34800cc6f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 -- 172.21.15.2:0/1389911688 >> 172.21.15.2:0/1389911688 conn(0x7f34800cebb0 msgr2=0x7f34800cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.012+0000 7f3485a56640 1 -- 172.21.15.2:0/1389911688 shutdown_connections 2023-11-04T01:44:08.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- 172.21.15.2:0/1389911688 wait complete. 2023-11-04T01:44:08.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 Processor -- start 2023-11-04T01:44:08.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- start start 2023-11-04T01:44:08.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348006c1a0 0x7f34801589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34800ce720 0x7f34800b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3480159a50 0x7f3480153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b3c90 con 0x7f348006c1a0 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b3f30 con 0x7f34800ce720 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34800b4210 con 0x7f3480159a50 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348006c1a0 0x7f34801589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348006c1a0 0x7f34801589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49470/0 (socket says 172.21.15.2:49470) 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 -- 172.21.15.2:0/3873853377 learned_addr learned my addr 172.21.15.2:0/3873853377 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347e7fc640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34800ce720 0x7f34800b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 -- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3480159a50 msgr2=0x7f3480153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3480159a50 0x7f3480153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 -- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34800ce720 msgr2=0x7f34800b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34800ce720 0x7f34800b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 -- 172.21.15.2:0/3873853377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470009a70 con 0x7f348006c1a0 2023-11-04T01:44:08.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f347effd640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348006c1a0 0x7f34801589e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f34700b4040 tx=0x7f347001e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3477fff640 1 -- 172.21.15.2:0/3873853377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700b1e00 con 0x7f348006c1a0 2023-11-04T01:44:08.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3477fff640 1 -- 172.21.15.2:0/3873853377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34700bc470 con 0x7f348006c1a0 2023-11-04T01:44:08.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34800b44f0 con 0x7f348006c1a0 2023-11-04T01:44:08.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3477fff640 1 -- 172.21.15.2:0/3873853377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700bc820 con 0x7f348006c1a0 2023-11-04T01:44:08.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34800b2550 con 0x7f348006c1a0 2023-11-04T01:44:08.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.016+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34800744a0 con 0x7f348006c1a0 2023-11-04T01:44:08.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.020+0000 7f3477fff640 1 -- 172.21.15.2:0/3873853377 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f34700b8070 con 0x7f348006c1a0 2023-11-04T01:44:08.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.020+0000 7f3477fff640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34600664a0 0x7f3460068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.020+0000 7f3477fff640 1 -- 172.21.15.2:0/3873853377 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f34701228e0 con 0x7f348006c1a0 2023-11-04T01:44:08.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.020+0000 7f347e7fc640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34600664a0 0x7f3460068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.020+0000 7f347e7fc640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34600664a0 0x7f3460068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3468007fd0 tx=0x7f3468009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.024+0000 7f3477fff640 1 -- 172.21.15.2:0/3873853377 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34700efbf0 con 0x7f348006c1a0 2023-11-04T01:44:08.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.184+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34800b4b30 con 0x7f348006c1a0 2023-11-04T01:44:08.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3477fff640 1 -- 172.21.15.2:0/3873853377 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18198 (secure 0 0 0) 0x7f34700f3210 con 0x7f348006c1a0 2023-11-04T01:44:08.191 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:08.192 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:06.629365+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:56.762181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:57.868403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.d","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34600664a0 msgr2=0x7f3460068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34600664a0 0x7f3460068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3468007fd0 tx=0x7f3468009040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348006c1a0 msgr2=0x7f34801589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348006c1a0 0x7f34801589e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f34700b4040 tx=0x7f347001e0b0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 shutdown_connections 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34600664a0 0x7f3460068960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3480159a50 0x7f3480153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34800ce720 0x7f34800b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 --2- 172.21.15.2:0/3873853377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f348006c1a0 0x7f34801589e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 >> 172.21.15.2:0/3873853377 conn(0x7f34800cebb0 msgr2=0x7f348015d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 shutdown_connections 2023-11-04T01:44:08.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.188+0000 7f3485a56640 1 -- 172.21.15.2:0/3873853377 wait complete. 2023-11-04T01:44:08.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:56.762181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:57.868403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:08.211 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:08.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.332+0000 7ff99d8f6640 1 Processor -- start 2023-11-04T01:44:08.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.332+0000 7ff99d8f6640 1 -- start start 2023-11-04T01:44:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.332+0000 7ff99d8f6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff99815d0b0 0x7ff998160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.332+0000 7ff99d8f6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff9980cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff99d8f6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9980b5e00 con 0x7ff9980cfd50 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff99d8f6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9980d1520 con 0x7ff99815d0b0 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff99d8f6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980d01e0 con 0x7ff9981610f0 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff996ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff99815d0b0 0x7ff998160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff9977fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff9980cfd50 0x7ff9980b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44130/0 (socket says 172.21.15.2:44130) 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff9977fe640 1 -- 172.21.15.2:0/3391225475 learned_addr learned my addr 172.21.15.2:0/3391225475 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff9967fc640 1 --2- 172.21.15.2:0/3391225475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff9980cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff995ffb640 1 -- 172.21.15.2:0/3391225475 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461284097 0 0) 0x7ff9980b5e00 con 0x7ff9980cfd50 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff995ffb640 1 -- 172.21.15.2:0/3391225475 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff980003530 con 0x7ff9980cfd50 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff996ffd640 1 -- 172.21.15.2:0/3391225475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 msgr2=0x7ff9980cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff996ffd640 1 --2- 172.21.15.2:0/3391225475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff9980cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff996ffd640 1 -- 172.21.15.2:0/3391225475 >> v1:172.21.15.2:6789/0 conn(0x7ff9980cfd50 legacy=0x7ff9980b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.336+0000 7ff996ffd640 1 -- 172.21.15.2:0/3391225475 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99815d490 con 0x7ff99815d0b0 2023-11-04T01:44:08.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff996ffd640 1 --2- 172.21.15.2:0/3391225475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff99815d0b0 0x7ff998160bb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff9880097c0 tx=0x7ff98801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9af037b3b61ffdb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff995ffb640 1 -- 172.21.15.2:0/3391225475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880ad640 con 0x7ff99815d0b0 2023-11-04T01:44:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff995ffb640 1 -- 172.21.15.2:0/3391225475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880ad7a0 con 0x7ff99815d0b0 2023-11-04T01:44:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff995ffb640 1 -- 172.21.15.2:0/3391225475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880adb30 con 0x7ff99815d0b0 2023-11-04T01:44:08.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 -- 172.21.15.2:0/3391225475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff99815d0b0 msgr2=0x7ff998160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/3391225475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff99815d0b0 0x7ff998160bb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff9880097c0 tx=0x7ff98801c480 comp rx=0 tx=0).stop 2023-11-04T01:44:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 -- 172.21.15.2:0/3391225475 shutdown_connections 2023-11-04T01:44:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/3391225475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff9980cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/3391225475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff99815d0b0 0x7ff998160bb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 -- 172.21.15.2:0/3391225475 >> 172.21.15.2:0/3391225475 conn(0x7ff99806a890 msgr2=0x7ff99806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 -- 172.21.15.2:0/3391225475 shutdown_connections 2023-11-04T01:44:08.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 -- 172.21.15.2:0/3391225475 wait complete. 2023-11-04T01:44:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 Processor -- start 2023-11-04T01:44:08.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.340+0000 7ff99d8f6640 1 -- start start 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9980cfd50 0x7ff9980c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff99815d0b0 0x7ff99814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff99814bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9980c9080 con 0x7ff9980cfd50 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99814b3d0 con 0x7ff99815d0b0 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99814b6b0 con 0x7ff9981610f0 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9980cfd50 0x7ff9980c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9980cfd50 0x7ff9980c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49490/0 (socket says 172.21.15.2:49490) 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 -- 172.21.15.2:0/1486030479 learned_addr learned my addr 172.21.15.2:0/1486030479 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff9977fe640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff99814bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff9967fc640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff99815d0b0 0x7ff99814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 -- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 msgr2=0x7ff99814bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff99814bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 -- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff99815d0b0 msgr2=0x7ff99814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff99815d0b0 0x7ff99814ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 -- 172.21.15.2:0/1486030479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009420 con 0x7ff9980cfd50 2023-11-04T01:44:08.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff996ffd640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9980cfd50 0x7ff9980c8b40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff9880b0040 tx=0x7ff988019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff97ffff640 1 -- 172.21.15.2:0/1486030479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880b6610 con 0x7ff9980cfd50 2023-11-04T01:44:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff97ffff640 1 -- 172.21.15.2:0/1486030479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880a6040 con 0x7ff9980cfd50 2023-11-04T01:44:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff97ffff640 1 -- 172.21.15.2:0/1486030479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880b69d0 con 0x7ff9980cfd50 2023-11-04T01:44:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99814b990 con 0x7ff9980cfd50 2023-11-04T01:44:08.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99815ad00 con 0x7ff9980cfd50 2023-11-04T01:44:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99815aef0 con 0x7ff9980cfd50 2023-11-04T01:44:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff97ffff640 1 -- 172.21.15.2:0/1486030479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9880b4040 con 0x7ff9980cfd50 2023-11-04T01:44:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff97ffff640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9840664d0 0x7ff984068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff97ffff640 1 -- 172.21.15.2:0/1486030479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7ff98811e000 con 0x7ff9980cfd50 2023-11-04T01:44:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.344+0000 7ff9967fc640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9840664d0 0x7ff984068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.348+0000 7ff9967fc640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9840664d0 0x7ff984068990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff9981f9550 tx=0x7ff98c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.348+0000 7ff97ffff640 1 -- 172.21.15.2:0/1486030479 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff9880eb300 con 0x7ff9980cfd50 2023-11-04T01:44:08.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9980744a0 con 0x7ff9980cfd50 2023-11-04T01:44:08.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff97ffff640 1 -- 172.21.15.2:0/1486030479 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9880b20a0 con 0x7ff9980cfd50 2023-11-04T01:44:08.509 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9840664d0 msgr2=0x7ff984068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9840664d0 0x7ff984068990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff9981f9550 tx=0x7ff98c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9980cfd50 msgr2=0x7ff9980c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9980cfd50 0x7ff9980c8b40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff9880b0040 tx=0x7ff988019220 comp rx=0 tx=0).stop 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 shutdown_connections 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff9840664d0 0x7ff984068990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9981610f0 0x7ff99814bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff99815d0b0 0x7ff99814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 --2- 172.21.15.2:0/1486030479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9980cfd50 0x7ff9980c8b40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 >> 172.21.15.2:0/1486030479 conn(0x7ff99806a890 msgr2=0x7ff9980b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 shutdown_connections 2023-11-04T01:44:08.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.504+0000 7ff99d8f6640 1 -- 172.21.15.2:0/1486030479 wait complete. 2023-11-04T01:44:08.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:08.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e99484640 1 Processor -- start 2023-11-04T01:44:08.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e99484640 1 -- start start 2023-11-04T01:44:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e99484640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e940cf810 0x7f3e940cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e99484640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e940d1940 0x7f3e940d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e99484640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e940b5e00 con 0x7f3e9415d0b0 2023-11-04T01:44:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e99484640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e940d1520 con 0x7f3e940cf810 2023-11-04T01:44:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e99484640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940d01c0 con 0x7f3e940d1940 2023-11-04T01:44:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e927fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e940cf810 0x7f3e940cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e927fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e940cf810 0x7f3e940cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49496/0 (socket says 172.21.15.2:49496) 2023-11-04T01:44:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e927fc640 1 -- 172.21.15.2:0/754831965 learned_addr learned my addr 172.21.15.2:0/754831965 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e937fe640 1 --2- 172.21.15.2:0/754831965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e940d1940 0x7f3e940d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e927fc640 1 -- 172.21.15.2:0/754831965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e940d1940 msgr2=0x7f3e940d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e927fc640 1 --2- 172.21.15.2:0/754831965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e940d1940 0x7f3e940d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e927fc640 1 -- 172.21.15.2:0/754831965 >> v1:172.21.15.90:6789/0 conn(0x7f3e9415d0b0 legacy=0x7f3e94160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.640+0000 7f3e927fc640 1 -- 172.21.15.2:0/754831965 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9415d490 con 0x7f3e940cf810 2023-11-04T01:44:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e927fc640 1 --2- 172.21.15.2:0/754831965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e940cfc80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0098a0 tx=0x7f3e7c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f34b4037d5c425c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e91ffb640 1 -- 172.21.15.2:0/754831965 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0aa680 con 0x7f3e940cf810 2023-11-04T01:44:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e91ffb640 1 -- 172.21.15.2:0/754831965 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c0aa7e0 con 0x7f3e940cf810 2023-11-04T01:44:08.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e91ffb640 1 -- 172.21.15.2:0/754831965 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0aab70 con 0x7f3e940cf810 2023-11-04T01:44:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- 172.21.15.2:0/754831965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 msgr2=0x7f3e940cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 --2- 172.21.15.2:0/754831965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e940cfc80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0098a0 tx=0x7f3e7c01c520 comp rx=0 tx=0).stop 2023-11-04T01:44:08.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- 172.21.15.2:0/754831965 shutdown_connections 2023-11-04T01:44:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 --2- 172.21.15.2:0/754831965 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e940d1940 0x7f3e940d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 --2- 172.21.15.2:0/754831965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e940cfc80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- 172.21.15.2:0/754831965 >> 172.21.15.2:0/754831965 conn(0x7f3e9406a890 msgr2=0x7f3e9406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- 172.21.15.2:0/754831965 shutdown_connections 2023-11-04T01:44:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- 172.21.15.2:0/754831965 wait complete. 2023-11-04T01:44:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 Processor -- start 2023-11-04T01:44:08.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- start start 2023-11-04T01:44:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e94153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e940d1940 0x7f3e940b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e9415d0b0 0x7f3e940b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9415a4e0 con 0x7f3e940cf810 2023-11-04T01:44:08.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940b3620 con 0x7f3e940d1940 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940b3900 con 0x7f3e9415d0b0 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e94153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e94153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49498/0 (socket says 172.21.15.2:49498) 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 -- 172.21.15.2:0/3517395120 learned_addr learned my addr 172.21.15.2:0/3517395120 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e937fe640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e9415d0b0 0x7f3e940b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e927fc640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e940d1940 0x7f3e940b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 -- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e9415d0b0 msgr2=0x7f3e940b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e9415d0b0 0x7f3e940b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 -- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e940d1940 msgr2=0x7f3e940b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e940d1940 0x7f3e940b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 -- 172.21.15.2:0/3517395120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0094d0 con 0x7f3e940cf810 2023-11-04T01:44:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e927fc640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e940d1940 0x7f3e940b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e92ffd640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e94153560 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c370 tx=0x7f3e8400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e8b7fe640 1 -- 172.21.15.2:0/3517395120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840052d0 con 0x7f3e940cf810 2023-11-04T01:44:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e8b7fe640 1 -- 172.21.15.2:0/3517395120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e84005430 con 0x7f3e940cf810 2023-11-04T01:44:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e940b3be0 con 0x7f3e940cf810 2023-11-04T01:44:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.644+0000 7f3e8b7fe640 1 -- 172.21.15.2:0/3517395120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84007260 con 0x7f3e940cf810 2023-11-04T01:44:08.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.648+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e94153aa0 con 0x7f3e940cf810 2023-11-04T01:44:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.648+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e940744a0 con 0x7f3e940cf810 2023-11-04T01:44:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.648+0000 7f3e8b7fe640 1 -- 172.21.15.2:0/3517395120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e840073c0 con 0x7f3e940cf810 2023-11-04T01:44:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.648+0000 7f3e8b7fe640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e740664a0 0x7f3e74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.648+0000 7f3e8b7fe640 1 -- 172.21.15.2:0/3517395120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f3e84083320 con 0x7f3e940cf810 2023-11-04T01:44:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.648+0000 7f3e927fc640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e740664a0 0x7f3e74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.648+0000 7f3e927fc640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e740664a0 0x7f3e74068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0ae000 tx=0x7f3e7c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.652+0000 7f3e8b7fe640 1 -- 172.21.15.2:0/3517395120 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e840506b0 con 0x7f3e940cf810 2023-11-04T01:44:08.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f3e940c97a0 con 0x7f3e940cf810 2023-11-04T01:44:08.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e8b7fe640 1 -- 172.21.15.2:0/3517395120 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v52) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3e84053cd0 con 0x7f3e940cf810 2023-11-04T01:44:08.813 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e740664a0 msgr2=0x7f3e74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e740664a0 0x7f3e74068960 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0ae000 tx=0x7f3e7c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 msgr2=0x7f3e94153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e94153560 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400c370 tx=0x7f3e8400c830 comp rx=0 tx=0).stop 2023-11-04T01:44:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 shutdown_connections 2023-11-04T01:44:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e740664a0 0x7f3e74068960 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e9415d0b0 0x7f3e940b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e940d1940 0x7f3e940b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 --2- 172.21.15.2:0/3517395120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e940cf810 0x7f3e94153560 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 >> 172.21.15.2:0/3517395120 conn(0x7f3e9406a890 msgr2=0x7f3e941565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 shutdown_connections 2023-11-04T01:44:08.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.808+0000 7f3e99484640 1 -- 172.21.15.2:0/3517395120 wait complete. 2023-11-04T01:44:08.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503af90640 1 Processor -- start 2023-11-04T01:44:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503af90640 1 -- start start 2023-11-04T01:44:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503af90640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f503415af70 0x7f50340cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503af90640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f503406d160 0x7f50340cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503af90640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503415e890 con 0x7f503415dd80 2023-11-04T01:44:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503af90640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5034071200 con 0x7f503415af70 2023-11-04T01:44:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503af90640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503406c0c0 con 0x7f503406d160 2023-11-04T01:44:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f5038d2c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f503415af70 0x7f50340cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503952d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f503415dd80 0x7f503415e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44146/0 (socket says 172.21.15.2:44146) 2023-11-04T01:44:08.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f503952d640 1 -- 172.21.15.2:0/1721661693 learned_addr learned my addr 172.21.15.2:0/1721661693 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:08.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f50337fe640 1 -- 172.21.15.2:0/1721661693 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351298575 0 0) 0x7f502c0014a0 con 0x7f503415dd80 2023-11-04T01:44:08.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f5033fff640 1 --2- 172.21.15.2:0/1721661693 >> v2:172.21.15.90:3300/0 conn(0x7f503406d160 0x7f50340cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f50337fe640 1 -- 172.21.15.2:0/1721661693 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5024005740 con 0x7f503415dd80 2023-11-04T01:44:08.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f5038d2c640 1 -- 172.21.15.2:0/1721661693 >> v2:172.21.15.90:3300/0 conn(0x7f503406d160 msgr2=0x7f50340cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:08.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f5038d2c640 1 --2- 172.21.15.2:0/1721661693 >> v2:172.21.15.90:3300/0 conn(0x7f503406d160 0x7f50340cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f5038d2c640 1 -- 172.21.15.2:0/1721661693 >> v1:172.21.15.2:6789/0 conn(0x7f503415dd80 legacy=0x7f503415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f5038d2c640 1 -- 172.21.15.2:0/1721661693 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503406c3a0 con 0x7f503415af70 2023-11-04T01:44:08.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.952+0000 7f5033fff640 1 --2- 172.21.15.2:0/1721661693 >> v2:172.21.15.90:3300/0 conn(0x7f503406d160 0x7f50340cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f5038d2c640 1 --2- 172.21.15.2:0/1721661693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415af70 0x7f50340cdaa0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f50340cfb90 tx=0x7f502801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71a8c50a37d1d7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f50337fe640 1 -- 172.21.15.2:0/1721661693 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028004230 con 0x7f503415af70 2023-11-04T01:44:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f50337fe640 1 -- 172.21.15.2:0/1721661693 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50280a7050 con 0x7f503415af70 2023-11-04T01:44:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f50337fe640 1 -- 172.21.15.2:0/1721661693 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028003620 con 0x7f503415af70 2023-11-04T01:44:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 -- 172.21.15.2:0/1721661693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415af70 msgr2=0x7f50340cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 --2- 172.21.15.2:0/1721661693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415af70 0x7f50340cdaa0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f50340cfb90 tx=0x7f502801c460 comp rx=0 tx=0).stop 2023-11-04T01:44:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 -- 172.21.15.2:0/1721661693 shutdown_connections 2023-11-04T01:44:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 --2- 172.21.15.2:0/1721661693 >> v2:172.21.15.90:3300/0 conn(0x7f503406d160 0x7f50340cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 --2- 172.21.15.2:0/1721661693 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415af70 0x7f50340cdaa0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 -- 172.21.15.2:0/1721661693 >> 172.21.15.2:0/1721661693 conn(0x7f50340cb510 msgr2=0x7f50340cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 -- 172.21.15.2:0/1721661693 shutdown_connections 2023-11-04T01:44:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 -- 172.21.15.2:0/1721661693 wait complete. 2023-11-04T01:44:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 Processor -- start 2023-11-04T01:44:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.956+0000 7f503af90640 1 -- start start 2023-11-04T01:44:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f503406d160 0x7f50340aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f503415af70 0x7f50340b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415dd80 0x7f503415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b0370 con 0x7f503415dd80 2023-11-04T01:44:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c2240 con 0x7f503415af70 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b0eb0 con 0x7f503406d160 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415dd80 0x7f503415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415dd80 0x7f503415b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49514/0 (socket says 172.21.15.2:49514) 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 -- 172.21.15.2:0/3637962200 learned_addr learned my addr 172.21.15.2:0/3637962200 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f5033fff640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f503415af70 0x7f50340b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f5038d2c640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f503406d160 0x7f50340aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 -- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f503406d160 msgr2=0x7f50340aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f503406d160 0x7f50340aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 -- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f503415af70 msgr2=0x7f50340b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f503415af70 0x7f50340b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 -- 172.21.15.2:0/3637962200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028009420 con 0x7f503415dd80 2023-11-04T01:44:08.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503952d640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415dd80 0x7f503415b4d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f502c00cb10 tx=0x7f502c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f50317fa640 1 -- 172.21.15.2:0/3637962200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00ac70 con 0x7f503415dd80 2023-11-04T01:44:08.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f50317fa640 1 -- 172.21.15.2:0/3637962200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00add0 con 0x7f503415dd80 2023-11-04T01:44:08.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f50317fa640 1 -- 172.21.15.2:0/3637962200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c012620 con 0x7f503415dd80 2023-11-04T01:44:08.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340b2620 con 0x7f503415dd80 2023-11-04T01:44:08.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340b0860 con 0x7f503415dd80 2023-11-04T01:44:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340b1060 con 0x7f503415dd80 2023-11-04T01:44:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f50317fa640 1 -- 172.21.15.2:0/3637962200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f502c007070 con 0x7f503415dd80 2023-11-04T01:44:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f50317fa640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50180664a0 0x7f5018068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f50317fa640 1 -- 172.21.15.2:0/3637962200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f502c083de0 con 0x7f503415dd80 2023-11-04T01:44:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.960+0000 7f5038d2c640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50180664a0 0x7f5018068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:08.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.964+0000 7f5038d2c640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50180664a0 0x7f5018068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50280ad000 tx=0x7f50280a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:08.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:08.964+0000 7f50317fa640 1 -- 172.21.15.2:0/3637962200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f50340b1060 con 0x7f503415dd80 2023-11-04T01:44:09.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f503415d8c0 con 0x7f503415dd80 2023-11-04T01:44:09.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f50317fa640 1 -- 172.21.15.2:0/3637962200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f502c017020 con 0x7f503415dd80 2023-11-04T01:44:09.120 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50180664a0 msgr2=0x7f5018068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50180664a0 0x7f5018068960 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50280ad000 tx=0x7f50280a6000 comp rx=0 tx=0).stop 2023-11-04T01:44:09.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415dd80 msgr2=0x7f503415b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415dd80 0x7f503415b4d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f502c00cb10 tx=0x7f502c00a060 comp rx=0 tx=0).stop 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 shutdown_connections 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50180664a0 0x7f5018068960 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f503415dd80 0x7f503415b4d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f503415af70 0x7f50340b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 --2- 172.21.15.2:0/3637962200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f503406d160 0x7f50340aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 >> 172.21.15.2:0/3637962200 conn(0x7f50340cb510 msgr2=0x7f503415a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 shutdown_connections 2023-11-04T01:44:09.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.116+0000 7f503af90640 1 -- 172.21.15.2:0/3637962200 wait complete. 2023-11-04T01:44:09.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:09.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.256+0000 7f50220b1640 1 Processor -- start 2023-11-04T01:44:09.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.256+0000 7f50220b1640 1 -- start start 2023-11-04T01:44:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f50220b1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 0x7f501c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f50220b1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f501c15d290 0x7f501c0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f50220b1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c160c50 con 0x7f501c06cfc0 2023-11-04T01:44:09.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f50220b1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0cedf0 con 0x7f501c15d290 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f50220b1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c160ef0 con 0x7f501c0cd670 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501affd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f501c06cfc0 0x7f501c15cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44160/0 (socket says 172.21.15.2:44160) 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501affd640 1 -- 172.21.15.2:0/4086854033 learned_addr learned my addr 172.21.15.2:0/4086854033 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501bfff640 1 --2- 172.21.15.2:0/4086854033 >> v2:172.21.15.90:3300/0 conn(0x7f501c15d290 0x7f501c0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501b7fe640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 0x7f501c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962412661 0 0) 0x7f501c160c50 con 0x7f501c06cfc0 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5004003530 con 0x7f501c06cfc0 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393309192 0 0) 0x7f5004003530 con 0x7f501c06cfc0 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 msgr2=0x7f501c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 0x7f501c0ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 >> v2:172.21.15.90:3300/0 conn(0x7f501c15d290 msgr2=0x7f501c0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 --2- 172.21.15.2:0/4086854033 >> v2:172.21.15.90:3300/0 conn(0x7f501c15d290 0x7f501c0af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c1611d0 con 0x7f501c06cfc0 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f5010001680 con 0x7f501c06cfc0 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 >> v1:172.21.15.2:6789/0 conn(0x7f501c06cfc0 legacy=0x7f501c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 0x7f5004003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5004003f00 0x7f50040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5004004d10 0x7f5004005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0cedf0 con 0x7f5004004d10 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c160ef0 con 0x7f5004003f00 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500400b990 con 0x7f501c0cd670 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501bfff640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5004004d10 0x7f5004005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501b7fe640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 0x7f5004003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501affd640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5004003f00 0x7f50040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501bfff640 1 -- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 msgr2=0x7f5004003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501bfff640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 0x7f5004003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501bfff640 1 -- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5004003f00 msgr2=0x7f50040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501bfff640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5004003f00 0x7f50040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501bfff640 1 -- 172.21.15.2:0/4086854033 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5004003530 con 0x7f5004004d10 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501affd640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5004003f00 0x7f50040047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:09.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.260+0000 7f501b7fe640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f501c0cd670 0x7f5004003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501bfff640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5004004d10 0x7f5004005190 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5014009f90 tx=0x7f501401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b54fe3e64e2b81 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140a5c70 con 0x7f5004004d10 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501400f040 con 0x7f5004004d10 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501a7fc640 1 -- 172.21.15.2:0/4086854033 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50140ad440 con 0x7f5004004d10 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- 172.21.15.2:0/4086854033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5004004d10 msgr2=0x7f5004005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 --2- 172.21.15.2:0/4086854033 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5004004d10 0x7f5004005190 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5014009f90 tx=0x7f501401cc00 comp rx=0 tx=0).stop 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501bfff640 1 -- 172.21.15.2:0/4086854033 reap_dead start 2023-11-04T01:44:09.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- 172.21.15.2:0/4086854033 shutdown_connections 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- 172.21.15.2:0/4086854033 >> 172.21.15.2:0/4086854033 conn(0x7f501c065dc0 msgr2=0x7f501c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- 172.21.15.2:0/4086854033 shutdown_connections 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- 172.21.15.2:0/4086854033 wait complete. 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 Processor -- start 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- start start 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5004004d10 0x7f501c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1595c0 0x7f501c0b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f501c0b6040 0x7f501c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0b4a20 con 0x7f501c1595c0 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0b3da0 con 0x7f501c0b6040 2023-11-04T01:44:09.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0b4080 con 0x7f5004004d10 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1595c0 0x7f501c0b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1595c0 0x7f501c0b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49524/0 (socket says 172.21.15.2:49524) 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 -- 172.21.15.2:0/2891832994 learned_addr learned my addr 172.21.15.2:0/2891832994 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501bfff640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f501c0b6040 0x7f501c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501b7fe640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5004004d10 0x7f501c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 -- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5004004d10 msgr2=0x7f501c0b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5004004d10 0x7f501c0b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 -- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f501c0b6040 msgr2=0x7f501c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f501c0b6040 0x7f501c14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 -- 172.21.15.2:0/2891832994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0b4360 con 0x7f501c1595c0 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f501affd640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1595c0 0x7f501c0b34a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5010007fd0 tx=0x7f501000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f5003fff640 1 -- 172.21.15.2:0/2891832994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100074e0 con 0x7f501c1595c0 2023-11-04T01:44:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f5003fff640 1 -- 172.21.15.2:0/2891832994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5010007640 con 0x7f501c1595c0 2023-11-04T01:44:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c0b4640 con 0x7f501c1595c0 2023-11-04T01:44:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f5003fff640 1 -- 172.21.15.2:0/2891832994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100049f0 con 0x7f501c1595c0 2023-11-04T01:44:09.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.264+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c0b64c0 con 0x7f501c1595c0 2023-11-04T01:44:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.268+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c0b4b60 con 0x7f501c1595c0 2023-11-04T01:44:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.268+0000 7f5003fff640 1 -- 172.21.15.2:0/2891832994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5010004b50 con 0x7f501c1595c0 2023-11-04T01:44:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.268+0000 7f5003fff640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50080664a0 0x7f5008068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.268+0000 7f5003fff640 1 -- 172.21.15.2:0/2891832994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f5010083bb0 con 0x7f501c1595c0 2023-11-04T01:44:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.268+0000 7f501b7fe640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50080664a0 0x7f5008068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.268+0000 7f501b7fe640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50080664a0 0x7f5008068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f500c0099c0 tx=0x7f500c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.272+0000 7f5003fff640 1 -- 172.21.15.2:0/2891832994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f501c0b4b60 con 0x7f501c1595c0 2023-11-04T01:44:09.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.420+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f501c0b4b60 con 0x7f501c1595c0 2023-11-04T01:44:09.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.420+0000 7f5003fff640 1 -- 172.21.15.2:0/2891832994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f501c0b4b60 con 0x7f501c1595c0 2023-11-04T01:44:09.426 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:44:09.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50080664a0 msgr2=0x7f5008068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50080664a0 0x7f5008068960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f500c0099c0 tx=0x7f500c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1595c0 msgr2=0x7f501c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1595c0 0x7f501c0b34a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5010007fd0 tx=0x7f501000dd40 comp rx=0 tx=0).stop 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 shutdown_connections 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50080664a0 0x7f5008068960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f501c0b6040 0x7f501c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c1595c0 0x7f501c0b34a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 --2- 172.21.15.2:0/2891832994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5004004d10 0x7f501c0b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 >> 172.21.15.2:0/2891832994 conn(0x7f501c065dc0 msgr2=0x7f501c0cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 shutdown_connections 2023-11-04T01:44:09.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.424+0000 7f50220b1640 1 -- 172.21.15.2:0/2891832994 wait complete. 2023-11-04T01:44:09.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:44:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68fe13640 1 Processor -- start 2023-11-04T01:44:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68fe13640 1 -- start start 2023-11-04T01:44:09.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68fe13640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 0x7fd6880cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68fe13640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd688159e30 con 0x7fd6880ce720 2023-11-04T01:44:09.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68fe13640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6880ccfd0 con 0x7fd68806c1a0 2023-11-04T01:44:09.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68fe13640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880cd2b0 con 0x7fd688159a50 2023-11-04T01:44:09.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68d3ae640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd6880ce720 0x7fd68806ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44166/0 (socket says 172.21.15.2:44166) 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68d3ae640 1 -- 172.21.15.2:0/2466900430 learned_addr learned my addr 172.21.15.2:0/2466900430 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68dbaf640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 0x7fd6880cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623417242 0 0) 0x7fd678001120 con 0x7fd6880ce720 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd674003530 con 0x7fd6880ce720 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2020917655 0 0) 0x7fd674003530 con 0x7fd6880ce720 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 msgr2=0x7fd6880cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 0x7fd6880cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 >> v1:172.21.15.90:6789/0 conn(0x7fd68806c1a0 legacy=0x7fd68806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880cd590 con 0x7fd6880ce720 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fd678001810 con 0x7fd6880ce720 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 >> v1:172.21.15.2:6789/0 conn(0x7fd6880ce720 legacy=0x7fd68806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 0x7fd6740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd674003f30 0x7fd6740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd674005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880cd2b0 con 0x7fd674004d10 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67400bb00 con 0x7fd674003f30 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67400bcc0 con 0x7fd688159a50 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68e3b0640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd674005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68dbaf640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 0x7fd6740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68d3ae640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd674003f30 0x7fd6740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68e3b0640 1 -- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 msgr2=0x7fd6740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68e3b0640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd688159a50 0x7fd6740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68e3b0640 1 -- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd674003f30 msgr2=0x7fd6740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68e3b0640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd674003f30 0x7fd6740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.556+0000 7fd68e3b0640 1 -- 172.21.15.2:0/2466900430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd674003530 con 0x7fd674004d10 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68e3b0640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd674005190 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd680001e70 tx=0x7fd68001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9824bb51467b41aa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680003b80 con 0x7fd674004d10 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680003ce0 con 0x7fd674004d10 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68cbad640 1 -- 172.21.15.2:0/2466900430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6800052c0 con 0x7fd674004d10 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68fe13640 1 -- 172.21.15.2:0/2466900430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 msgr2=0x7fd674005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68fe13640 1 --2- 172.21.15.2:0/2466900430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd674005190 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd680001e70 tx=0x7fd68001c760 comp rx=0 tx=0).stop 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68e3b0640 1 -- 172.21.15.2:0/2466900430 reap_dead start 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68fe13640 1 -- 172.21.15.2:0/2466900430 shutdown_connections 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68fe13640 1 -- 172.21.15.2:0/2466900430 >> 172.21.15.2:0/2466900430 conn(0x7fd6880cebb0 msgr2=0x7fd6880cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68fe13640 1 -- 172.21.15.2:0/2466900430 shutdown_connections 2023-11-04T01:44:09.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.560+0000 7fd68fe13640 1 -- 172.21.15.2:0/2466900430 wait complete. 2023-11-04T01:44:09.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 Processor -- start 2023-11-04T01:44:09.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 -- start start 2023-11-04T01:44:09.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd6880c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6880c8610 0x7fd688146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68814a6f0 0x7fd6880c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880c9150 con 0x7fd674004d10 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880c8c20 con 0x7fd68814a6f0 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880c6600 con 0x7fd6880c8610 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd6880c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd6880c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49540/0 (socket says 172.21.15.2:49540) 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 -- 172.21.15.2:0/3553530322 learned_addr learned my addr 172.21.15.2:0/3553530322 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68e3b0640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68814a6f0 0x7fd6880c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68d3ae640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6880c8610 0x7fd688146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 -- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6880c8610 msgr2=0x7fd688146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6880c8610 0x7fd688146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 -- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68814a6f0 msgr2=0x7fd6880c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68814a6f0 0x7fd6880c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 -- 172.21.15.2:0/3553530322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880c8e70 con 0x7fd674004d10 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68e3b0640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68814a6f0 0x7fd6880c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68dbaf640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd6880c4630 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd684011610 tx=0x7fd684011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd67e7fc640 1 -- 172.21.15.2:0/3553530322 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684015870 con 0x7fd674004d10 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd67e7fc640 1 -- 172.21.15.2:0/3553530322 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6840159d0 con 0x7fd674004d10 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd67e7fc640 1 -- 172.21.15.2:0/3553530322 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684015d40 con 0x7fd674004d10 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd688148d30 con 0x7fd674004d10 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd688147100 con 0x7fd674004d10 2023-11-04T01:44:09.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6880744a0 con 0x7fd674004d10 2023-11-04T01:44:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd67e7fc640 1 -- 172.21.15.2:0/3553530322 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd68400f480 con 0x7fd674004d10 2023-11-04T01:44:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd67e7fc640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd66c0664d0 0x7fd66c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.564+0000 7fd67e7fc640 1 -- 172.21.15.2:0/3553530322 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd684084420 con 0x7fd674004d10 2023-11-04T01:44:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.568+0000 7fd68d3ae640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd66c0664d0 0x7fd66c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:09.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.568+0000 7fd68d3ae640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd66c0664d0 0x7fd66c068990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd6780013a0 tx=0x7fd6780012f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:09.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.572+0000 7fd67e7fc640 1 -- 172.21.15.2:0/3553530322 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd684051710 con 0x7fd674004d10 2023-11-04T01:44:09.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.740+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd68806bb20 con 0x7fd674004d10 2023-11-04T01:44:09.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.740+0000 7fd67e7fc640 1 -- 172.21.15.2:0/3553530322 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd684054d30 con 0x7fd674004d10 2023-11-04T01:44:09.745 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:44:09.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd66c0664d0 msgr2=0x7fd66c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd66c0664d0 0x7fd66c068990 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd6780013a0 tx=0x7fd6780012f0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 msgr2=0x7fd6880c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd6880c4630 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd684011610 tx=0x7fd684011ad0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 shutdown_connections 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd66c0664d0 0x7fd66c068990 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68814a6f0 0x7fd6880c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd6880c8610 0x7fd688146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 --2- 172.21.15.2:0/3553530322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd674004d10 0x7fd6880c4630 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 >> 172.21.15.2:0/3553530322 conn(0x7fd6880cebb0 msgr2=0x7fd688159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 shutdown_connections 2023-11-04T01:44:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09.744+0000 7fd68fe13640 1 -- 172.21.15.2:0/3553530322 wait complete. 2023-11-04T01:44:09.765 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:44:09.765 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:09.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:09.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[49617]: fuse finished with error 0 and tester_r 0 2023-11-04T01:44:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:09.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:44:09.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:09.827 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:44:09.828 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:44:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:09.835 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:09.835 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:09.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:09.842 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:44:09.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:09.842 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:44:09.887 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:44:09.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:09.889 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:09.889 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:09.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:44:09.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:44:09.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:09.894 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:44:09.939 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:44:09.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:09.941 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:09.941 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:09.947 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:09.947 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:44:09.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:09.947 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:44:09.996 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:44:09.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:09.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 Processor -- start 2023-11-04T01:44:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 -- start start 2023-11-04T01:44:10.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f6c15a1f0 0x7f1f6c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c0cdea0 0x7f1f6c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1f6c0ca400 0x7f1f6c0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c0ccee0 con 0x7f1f6c15a1f0 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6c15a5d0 con 0x7f1f6c0ca400 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f71a02640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0ca900 con 0x7f1f6c0cdea0 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f6c15a1f0 0x7f1f6c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f6c15a1f0 0x7f1f6c0cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49554/0 (socket says 172.21.15.2:49554) 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 -- 172.21.15.2:0/3329447026 learned_addr learned my addr 172.21.15.2:0/3329447026 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6b7fe640 1 --2- 172.21.15.2:0/3329447026 >> v2:172.21.15.90:3300/0 conn(0x7f1f6c0ca400 0x7f1f6c0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f63fff640 1 --2- 172.21.15.2:0/3329447026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c0cdea0 0x7f1f6c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 -- 172.21.15.2:0/3329447026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c0cdea0 msgr2=0x7f1f6c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 --2- 172.21.15.2:0/3329447026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c0cdea0 0x7f1f6c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 -- 172.21.15.2:0/3329447026 >> v2:172.21.15.90:3300/0 conn(0x7f1f6c0ca400 msgr2=0x7f1f6c0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 --2- 172.21.15.2:0/3329447026 >> v2:172.21.15.90:3300/0 conn(0x7f1f6c0ca400 0x7f1f6c0b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6affd640 1 -- 172.21.15.2:0/3329447026 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0cabe0 con 0x7f1f6c15a1f0 2023-11-04T01:44:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f6b7fe640 1 --2- 172.21.15.2:0/3329447026 >> v2:172.21.15.90:3300/0 conn(0x7f1f6c0ca400 0x7f1f6c0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.128+0000 7f1f63fff640 1 --2- 172.21.15.2:0/3329447026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c0cdea0 0x7f1f6c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f6affd640 1 --2- 172.21.15.2:0/3329447026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c15a1f0 0x7f1f6c0cd370 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0cfc00 tx=0x7f1f5c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990dcbb54d3d2b81 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f6a7fc640 1 -- 172.21.15.2:0/3329447026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0aa5f0 con 0x7f1f6c15a1f0 2023-11-04T01:44:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f6a7fc640 1 -- 172.21.15.2:0/3329447026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0aa750 con 0x7f1f6c15a1f0 2023-11-04T01:44:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f6a7fc640 1 -- 172.21.15.2:0/3329447026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0aaae0 con 0x7f1f6c15a1f0 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 -- 172.21.15.2:0/3329447026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c15a1f0 msgr2=0x7f1f6c0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3329447026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c15a1f0 0x7f1f6c0cd370 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0cfc00 tx=0x7f1f5c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 -- 172.21.15.2:0/3329447026 shutdown_connections 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3329447026 >> v2:172.21.15.90:3300/0 conn(0x7f1f6c0ca400 0x7f1f6c0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3329447026 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c0cdea0 0x7f1f6c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3329447026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c15a1f0 0x7f1f6c0cd370 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 -- 172.21.15.2:0/3329447026 >> 172.21.15.2:0/3329447026 conn(0x7f1f6c0cebb0 msgr2=0x7f1f6c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 -- 172.21.15.2:0/3329447026 shutdown_connections 2023-11-04T01:44:10.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 -- 172.21.15.2:0/3329447026 wait complete. 2023-11-04T01:44:10.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 Processor -- start 2023-11-04T01:44:10.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.132+0000 7f1f71a02640 1 -- start start 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c0ca400 0x7f1f6c0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f6c0cdea0 0x7f1f6c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c15a1f0 0x7f1f6c0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c0c7b60 con 0x7f1f6c0ca400 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c1556f0 con 0x7f1f6c0cdea0 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c154c70 con 0x7f1f6c15a1f0 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c0ca400 0x7f1f6c0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c0ca400 0x7f1f6c0c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49568/0 (socket says 172.21.15.2:49568) 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 -- 172.21.15.2:0/3746846383 learned_addr learned my addr 172.21.15.2:0/3746846383 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f63fff640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f6c0cdea0 0x7f1f6c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6b7fe640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c15a1f0 0x7f1f6c0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 -- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c15a1f0 msgr2=0x7f1f6c0c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c15a1f0 0x7f1f6c0c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 -- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f6c0cdea0 msgr2=0x7f1f6c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f6c0cdea0 0x7f1f6c154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 -- 172.21.15.2:0/3746846383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0094d0 con 0x7f1f6c0ca400 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f6affd640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c0ca400 0x7f1f6c0c7460 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c01c9b0 tx=0x7f1f5c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f68ff9640 1 -- 172.21.15.2:0/3746846383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b3800 con 0x7f1f6c0ca400 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f68ff9640 1 -- 172.21.15.2:0/3746846383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0b3980 con 0x7f1f6c0ca400 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c15b380 con 0x7f1f6c0ca400 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f68ff9640 1 -- 172.21.15.2:0/3746846383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b3d30 con 0x7f1f6c0ca400 2023-11-04T01:44:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c15b900 con 0x7f1f6c0ca400 2023-11-04T01:44:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c0744a0 con 0x7f1f6c0ca400 2023-11-04T01:44:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f68ff9640 1 -- 172.21.15.2:0/3746846383 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f5c0c6390 con 0x7f1f6c0ca400 2023-11-04T01:44:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f68ff9640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f4c0664a0 0x7f1f4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f68ff9640 1 -- 172.21.15.2:0/3746846383 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f1f5c0a7070 con 0x7f1f6c0ca400 2023-11-04T01:44:10.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.136+0000 7f1f63fff640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f4c0664a0 0x7f1f4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.140+0000 7f1f63fff640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f4c0664a0 0x7f1f4c068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0c8c20 tx=0x7f1f54008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.140+0000 7f1f68ff9640 1 -- 172.21.15.2:0/3746846383 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f5c0ebc60 con 0x7f1f6c0ca400 2023-11-04T01:44:10.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.332+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f6c06cfb0 con 0x7f1f6c0ca400 2023-11-04T01:44:10.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.332+0000 7f1f68ff9640 1 -- 172.21.15.2:0/3746846383 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4901 (secure 0 0 0) 0x7f1f5c0ef280 con 0x7f1f6c0ca400 2023-11-04T01:44:10.337 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:10.337 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/47038667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":47038667},{"type":"v1","addr":"172.21.15.90:6835","nonce":47038667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3742811104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3742811104},{"type":"v1","addr":"172.21.15.90:6837","nonce":3742811104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2057053526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2057053526},{"type":"v1","addr":"172.21.15.2:6835","nonce":2057053526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:58.858818+0000","modified":"2023-11-04T01:44:00.951631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6834/1138444248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1138444248},{"type":"v1","addr":"172.21.15.2:6834","nonce":1138444248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:44:10.337 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2023-11-04T01:44:10.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.332+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f4c0664a0 msgr2=0x7f1f4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.332+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f4c0664a0 0x7f1f4c068960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c0c8c20 tx=0x7f1f54008040 comp rx=0 tx=0).stop 2023-11-04T01:44:10.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.332+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c0ca400 msgr2=0x7f1f6c0c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.332+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c0ca400 0x7f1f6c0c7460 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c01c9b0 tx=0x7f1f5c01ad10 comp rx=0 tx=0).stop 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 shutdown_connections 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f4c0664a0 0x7f1f4c068960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f6c15a1f0 0x7f1f6c0c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f6c0cdea0 0x7f1f6c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 --2- 172.21.15.2:0/3746846383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f6c0ca400 0x7f1f6c0c7460 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 >> 172.21.15.2:0/3746846383 conn(0x7f1f6c0cebb0 msgr2=0x7f1f6c162060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 shutdown_connections 2023-11-04T01:44:10.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.336+0000 7f1f71a02640 1 -- 172.21.15.2:0/3746846383 wait complete. 2023-11-04T01:44:10.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.472+0000 7f665a317640 1 Processor -- start 2023-11-04T01:44:10.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.472+0000 7f665a317640 1 -- start start 2023-11-04T01:44:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f665a317640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665415afd0 0x7f66540715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f665a317640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66540b0d40 0x7f665415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f665a317640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540c2670 con 0x7f665406f8f0 2023-11-04T01:44:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f665a317640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6654070140 con 0x7f66540b0d40 2023-11-04T01:44:10.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f665a317640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665406c9f0 con 0x7f665415afd0 2023-11-04T01:44:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66588b4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66540b0d40 0x7f665415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f6653fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665415afd0 0x7f66540715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66588b4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66540b0d40 0x7f665415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:53806/0 (socket says 172.21.15.2:53806) 2023-11-04T01:44:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66537fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f665406f8f0 0x7f66540b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:54392/0 (socket says 172.21.15.2:54392) 2023-11-04T01:44:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66588b4640 1 -- 172.21.15.2:0/228427280 learned_addr learned my addr 172.21.15.2:0/228427280 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f6653fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665415afd0 0x7f66540715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:58338/0 (socket says 172.21.15.2:58338) 2023-11-04T01:44:10.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66588b4640 1 -- 172.21.15.2:0/228427280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665415afd0 msgr2=0x7f66540715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66588b4640 1 --2- 172.21.15.2:0/228427280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665415afd0 0x7f66540715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66588b4640 1 -- 172.21.15.2:0/228427280 >> v1:172.21.15.90:6789/0 conn(0x7f665406f8f0 legacy=0x7f66540b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.476+0000 7f66588b4640 1 -- 172.21.15.2:0/228427280 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665406bc30 con 0x7f66540b0d40 2023-11-04T01:44:10.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 --2- 172.21.15.2:0/228427280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f665415ec80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6644009e80 tx=0x7f664401c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76076b846a2ba31d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f6652ffd640 1 -- 172.21.15.2:0/228427280 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440a5880 con 0x7f66540b0d40 2023-11-04T01:44:10.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f6652ffd640 1 -- 172.21.15.2:0/228427280 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66440a59e0 con 0x7f66540b0d40 2023-11-04T01:44:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f6652ffd640 1 -- 172.21.15.2:0/228427280 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440a5d70 con 0x7f66540b0d40 2023-11-04T01:44:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- 172.21.15.2:0/228427280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 msgr2=0x7f665415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 --2- 172.21.15.2:0/228427280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f665415ec80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6644009e80 tx=0x7f664401c9c0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- 172.21.15.2:0/228427280 shutdown_connections 2023-11-04T01:44:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 --2- 172.21.15.2:0/228427280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f665415ec80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 --2- 172.21.15.2:0/228427280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665415afd0 0x7f66540715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- 172.21.15.2:0/228427280 >> 172.21.15.2:0/228427280 conn(0x7f66540cebb0 msgr2=0x7f66540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- 172.21.15.2:0/228427280 shutdown_connections 2023-11-04T01:44:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- 172.21.15.2:0/228427280 wait complete. 2023-11-04T01:44:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 Processor -- start 2023-11-04T01:44:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- start start 2023-11-04T01:44:10.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665406f8f0 0x7f6654152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f6654153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f665415afd0 0x7f6654154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66540c8820 con 0x7f665415afd0 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66540c7e80 con 0x7f66540b0d40 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f665a317640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66540c8160 con 0x7f665406f8f0 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f665415afd0 0x7f6654154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f665415afd0 0x7f6654154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49578/0 (socket says 172.21.15.2:49578) 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 -- 172.21.15.2:0/3607055023 learned_addr learned my addr 172.21.15.2:0/3607055023 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66537fe640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f6654153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f6653fff640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665406f8f0 0x7f6654152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 -- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665406f8f0 msgr2=0x7f6654152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665406f8f0 0x7f6654152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 -- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 msgr2=0x7f6654153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f6654153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66588b4640 1 -- 172.21.15.2:0/3607055023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009b30 con 0x7f665415afd0 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.480+0000 7f66537fe640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f6654153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f66588b4640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f665415afd0 0x7f6654154020 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f664401a5f0 tx=0x7f6644019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6650ff9640 1 -- 172.21.15.2:0/3607055023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440b8670 con 0x7f665415afd0 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6650ff9640 1 -- 172.21.15.2:0/3607055023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66440b87d0 con 0x7f665415afd0 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66540c8440 con 0x7f665415afd0 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6650ff9640 1 -- 172.21.15.2:0/3607055023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66440b8b80 con 0x7f665415afd0 2023-11-04T01:44:10.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6654152dd0 con 0x7f665415afd0 2023-11-04T01:44:10.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66540c8960 con 0x7f665415afd0 2023-11-04T01:44:10.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6650ff9640 1 -- 172.21.15.2:0/3607055023 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66440b8ce0 con 0x7f665415afd0 2023-11-04T01:44:10.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6650ff9640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66340664a0 0x7f6634068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6650ff9640 1 -- 172.21.15.2:0/3607055023 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f664411f6e0 con 0x7f665415afd0 2023-11-04T01:44:10.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6653fff640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66340664a0 0x7f6634068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.484+0000 7f6653fff640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66340664a0 0x7f6634068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f664c009a50 tx=0x7f664c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.488+0000 7f6650ff9640 1 -- 172.21.15.2:0/3607055023 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66540c8960 con 0x7f665415afd0 2023-11-04T01:44:10.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.644+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66540c8960 con 0x7f665415afd0 2023-11-04T01:44:10.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.644+0000 7f6650ff9640 1 -- 172.21.15.2:0/3607055023 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18198 (secure 0 0 0) 0x7f66540c8960 con 0x7f665415afd0 2023-11-04T01:44:10.651 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:10.651 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:06.629365+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:56.762181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:57.868403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.d","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:10.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66340664a0 msgr2=0x7f6634068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66340664a0 0x7f6634068960 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f664c009a50 tx=0x7f664c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f665415afd0 msgr2=0x7f6654154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f665415afd0 0x7f6654154020 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f664401a5f0 tx=0x7f6644019760 comp rx=0 tx=0).stop 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 shutdown_connections 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66340664a0 0x7f6634068960 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f665415afd0 0x7f6654154020 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66540b0d40 0x7f6654153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 --2- 172.21.15.2:0/3607055023 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f665406f8f0 0x7f6654152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 >> 172.21.15.2:0/3607055023 conn(0x7f66540cebb0 msgr2=0x7f66540ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 shutdown_connections 2023-11-04T01:44:10.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.648+0000 7f665a317640 1 -- 172.21.15.2:0/3607055023 wait complete. 2023-11-04T01:44:10.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:43:56.762181+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:43:57.868403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:10.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.788+0000 7f749d5bb640 1 Processor -- start 2023-11-04T01:44:10.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.788+0000 7f749d5bb640 1 -- start start 2023-11-04T01:44:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.788+0000 7f749d5bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74980b32f0 0x7f74980cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.788+0000 7f749d5bb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74980cd830 con 0x7f74980cf4c0 2023-11-04T01:44:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.788+0000 7f749d5bb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74980cdad0 con 0x7f749815af50 2023-11-04T01:44:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.788+0000 7f749d5bb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74980b3780 con 0x7f74980b32f0 2023-11-04T01:44:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f74967fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74980b32f0 0x7f74980cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f74977fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f74980cf4c0 0x7f74980d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44176/0 (socket says 172.21.15.2:44176) 2023-11-04T01:44:10.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f74977fe640 1 -- 172.21.15.2:0/1854673804 learned_addr learned my addr 172.21.15.2:0/1854673804 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:10.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f74967fc640 1 -- 172.21.15.2:0/1854673804 >> v1:172.21.15.90:6789/0 conn(0x7f749815af50 legacy=0x7f74980ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:10.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f74967fc640 1 -- 172.21.15.2:0/1854673804 >> v1:172.21.15.2:6789/0 conn(0x7f74980cf4c0 legacy=0x7f74980d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f74967fc640 1 -- 172.21.15.2:0/1854673804 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74980cddb0 con 0x7f74980b32f0 2023-11-04T01:44:10.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f74967fc640 1 --2- 172.21.15.2:0/1854673804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980b32f0 0x7f74980cb330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f748c0097c0 tx=0x7f748c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd166e1822d63253 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f7495ffb640 1 -- 172.21.15.2:0/1854673804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0ac630 con 0x7f74980b32f0 2023-11-04T01:44:10.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f7495ffb640 1 -- 172.21.15.2:0/1854673804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c0ac790 con 0x7f74980b32f0 2023-11-04T01:44:10.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f7495ffb640 1 -- 172.21.15.2:0/1854673804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c0acb20 con 0x7f74980b32f0 2023-11-04T01:44:10.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f749d5bb640 1 -- 172.21.15.2:0/1854673804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980b32f0 msgr2=0x7f74980cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1854673804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980b32f0 0x7f74980cb330 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f748c0097c0 tx=0x7f748c01c3b0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f749d5bb640 1 -- 172.21.15.2:0/1854673804 shutdown_connections 2023-11-04T01:44:10.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1854673804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980b32f0 0x7f74980cb330 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f749d5bb640 1 -- 172.21.15.2:0/1854673804 >> 172.21.15.2:0/1854673804 conn(0x7f7498065dc0 msgr2=0x7f74980661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f749d5bb640 1 -- 172.21.15.2:0/1854673804 shutdown_connections 2023-11-04T01:44:10.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.792+0000 7f749d5bb640 1 -- 172.21.15.2:0/1854673804 wait complete. 2023-11-04T01:44:10.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 Processor -- start 2023-11-04T01:44:10.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 -- start start 2023-11-04T01:44:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980cf4c0 0x7f749815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f749815af50 0x7f749815b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74980b1a60 0x7f74980b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749815bc30 con 0x7f74980cf4c0 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74980b2430 con 0x7f749815af50 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749815dc90 con 0x7f74980b1a60 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980cf4c0 0x7f749815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980cf4c0 0x7f749815e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49594/0 (socket says 172.21.15.2:49594) 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 -- 172.21.15.2:0/1036166408 learned_addr learned my addr 172.21.15.2:0/1036166408 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f74967fc640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f749815af50 0x7f749815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f74977fe640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74980b1a60 0x7f74980b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 -- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74980b1a60 msgr2=0x7f74980b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74980b1a60 0x7f74980b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 -- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f749815af50 msgr2=0x7f749815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f749815af50 0x7f749815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 -- 172.21.15.2:0/1036166408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c009420 con 0x7f74980cf4c0 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f74977fe640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74980b1a60 0x7f74980b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f7496ffd640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980cf4c0 0x7f749815e120 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f748800b420 tx=0x7f748800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f747f7fe640 1 -- 172.21.15.2:0/1036166408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488011830 con 0x7f74980cf4c0 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f747f7fe640 1 -- 172.21.15.2:0/1036166408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74880119b0 con 0x7f74980cf4c0 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749815d0c0 con 0x7f74980cf4c0 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f747f7fe640 1 -- 172.21.15.2:0/1036166408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488011d60 con 0x7f74980cf4c0 2023-11-04T01:44:10.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749815d360 con 0x7f74980cf4c0 2023-11-04T01:44:10.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74980675f0 con 0x7f74980cf4c0 2023-11-04T01:44:10.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.796+0000 7f747f7fe640 1 -- 172.21.15.2:0/1036166408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f748801a410 con 0x7f74980cf4c0 2023-11-04T01:44:10.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.800+0000 7f747f7fe640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74840664d0 0x7f7484068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:10.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.800+0000 7f747f7fe640 1 -- 172.21.15.2:0/1036166408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f74880839b0 con 0x7f74980cf4c0 2023-11-04T01:44:10.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.800+0000 7f74967fc640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74840664d0 0x7f7484068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:10.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.800+0000 7f74967fc640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74840664d0 0x7f7484068990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f748c0ae000 tx=0x7f748c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:10.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.804+0000 7f747f7fe640 1 -- 172.21.15.2:0/1036166408 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7488050cb0 con 0x7f74980cf4c0 2023-11-04T01:44:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.964+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f749815a780 con 0x7f74980cf4c0 2023-11-04T01:44:10.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.964+0000 7f747f7fe640 1 -- 172.21.15.2:0/1036166408 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74880542d0 con 0x7f74980cf4c0 2023-11-04T01:44:10.969 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74840664d0 msgr2=0x7f7484068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74840664d0 0x7f7484068990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f748c0ae000 tx=0x7f748c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980cf4c0 msgr2=0x7f749815e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980cf4c0 0x7f749815e120 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f748800b420 tx=0x7f748800b8e0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 shutdown_connections 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74840664d0 0x7f7484068990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f74980b1a60 0x7f74980b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f749815af50 0x7f749815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 --2- 172.21.15.2:0/1036166408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74980cf4c0 0x7f749815e120 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 >> 172.21.15.2:0/1036166408 conn(0x7f7498065dc0 msgr2=0x7f74980c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 shutdown_connections 2023-11-04T01:44:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:10.968+0000 7f749d5bb640 1 -- 172.21.15.2:0/1036166408 wait complete. 2023-11-04T01:44:10.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:11.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa6054f8640 1 Processor -- start 2023-11-04T01:44:11.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa6054f8640 1 -- start start 2023-11-04T01:44:11.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa6054f8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa60015af70 0x7fa6000cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa6054f8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60015e890 con 0x7fa60015e490 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa6054f8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60006c0c0 con 0x7fa60006d160 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa6054f8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60006c3a0 con 0x7fa60015af70 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5ff7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa60015e490 0x7fa6000701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44184/0 (socket says 172.21.15.2:44184) 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5ff7fe640 1 -- 172.21.15.2:0/56737253 learned_addr learned my addr 172.21.15.2:0/56737253 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5feffd640 1 --2- 172.21.15.2:0/56737253 >> v2:172.21.15.90:3300/0 conn(0x7fa60015af70 0x7fa6000cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276864461 0 0) 0x7fa5f80014a0 con 0x7fa60015e490 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e8003530 con 0x7fa60015e490 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134127451 0 0) 0x7fa5e8003530 con 0x7fa60015e490 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 >> v2:172.21.15.90:3300/0 conn(0x7fa60015af70 msgr2=0x7fa6000cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 --2- 172.21.15.2:0/56737253 >> v2:172.21.15.90:3300/0 conn(0x7fa60015af70 0x7fa6000cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 >> v1:172.21.15.90:6789/0 conn(0x7fa60006d160 legacy=0x7fa60015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60006c680 con 0x7fa60015e490 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa5f8001b90 con 0x7fa60015e490 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 >> v1:172.21.15.2:6789/0 conn(0x7fa60015e490 legacy=0x7fa6000701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa5e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5e80047d0 0x7fa5e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e8005190 0x7fa5e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60006c3a0 con 0x7fa5e8003980 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e800c030 con 0x7fa5e8005190 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e800c1f0 con 0x7fa5e80047d0 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5feffd640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa5e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5ff7fe640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e8005190 0x7fa5e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5fe7fc640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5e80047d0 0x7fa5e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5feffd640 1 -- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5e80047d0 msgr2=0x7fa5e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5feffd640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5e80047d0 0x7fa5e8004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5feffd640 1 -- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e8005190 msgr2=0x7fa5e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5feffd640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e8005190 0x7fa5e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5feffd640 1 -- 172.21.15.2:0/56737253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8003530 con 0x7fa5e8003980 2023-11-04T01:44:11.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.116+0000 7fa5ff7fe640 1 -- 172.21.15.2:0/56737253 reap_dead start 2023-11-04T01:44:11.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa5feffd640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa5e8003da0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009ae0 tx=0x7fa5f001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b55513b2f3b5bcd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00a5510 con 0x7fa5e8003980 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f00a5670 con 0x7fa5e8003980 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa5fdffb640 1 -- 172.21.15.2:0/56737253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00a5a20 con 0x7fa5e8003980 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 -- 172.21.15.2:0/56737253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 msgr2=0x7fa5e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa5e8003da0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009ae0 tx=0x7fa5f001ca50 comp rx=0 tx=0).stop 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 -- 172.21.15.2:0/56737253 shutdown_connections 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 --2- 172.21.15.2:0/56737253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa5e8003da0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 -- 172.21.15.2:0/56737253 >> 172.21.15.2:0/56737253 conn(0x7fa6000cb510 msgr2=0x7fa6000cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 -- 172.21.15.2:0/56737253 shutdown_connections 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 -- 172.21.15.2:0/56737253 wait complete. 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 Processor -- start 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.120+0000 7fa6054f8640 1 -- start start 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa60014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa600152c00 0x7fa600153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa600158920 0x7fa600158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6001535c0 con 0x7fa5e8003980 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60014a820 con 0x7fa600152c00 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60014f250 con 0x7fa600158920 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa60014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa60014df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49618/0 (socket says 172.21.15.2:49618) 2023-11-04T01:44:11.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 -- 172.21.15.2:0/1144776758 learned_addr learned my addr 172.21.15.2:0/1144776758 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5ff7fe640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa600158920 0x7fa600158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5fe7fc640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa600152c00 0x7fa600153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 -- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa600158920 msgr2=0x7fa600158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa600158920 0x7fa600158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 -- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa600152c00 msgr2=0x7fa600153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa600152c00 0x7fa600153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 -- 172.21.15.2:0/1144776758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60014e640 con 0x7fa5e8003980 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5fe7fc640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa600152c00 0x7fa600153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5feffd640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa60014df40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa5f001c880 tx=0x7fa5e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5e77fe640 1 -- 172.21.15.2:0/1144776758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00bc070 con 0x7fa5e8003980 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5e77fe640 1 -- 172.21.15.2:0/1144776758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f000f000 con 0x7fa5e8003980 2023-11-04T01:44:11.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60014e920 con 0x7fa5e8003980 2023-11-04T01:44:11.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5e77fe640 1 -- 172.21.15.2:0/1144776758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00a5510 con 0x7fa5e8003980 2023-11-04T01:44:11.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60014eee0 con 0x7fa5e8003980 2023-11-04T01:44:11.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6000744a0 con 0x7fa5e8003980 2023-11-04T01:44:11.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5e77fe640 1 -- 172.21.15.2:0/1144776758 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5f00b4040 con 0x7fa5e8003980 2023-11-04T01:44:11.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5e77fe640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5ec0664d0 0x7fa5ec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5e77fe640 1 -- 172.21.15.2:0/1144776758 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa5f011d7c0 con 0x7fa5e8003980 2023-11-04T01:44:11.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.124+0000 7fa5fe7fc640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5ec0664d0 0x7fa5ec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.128+0000 7fa5fe7fc640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5ec0664d0 0x7fa5ec068990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6000b45b0 tx=0x7fa5f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.128+0000 7fa5e77fe640 1 -- 172.21.15.2:0/1144776758 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5f00eab50 con 0x7fa5e8003980 2023-11-04T01:44:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fa6000b2c00 con 0x7fa5e8003980 2023-11-04T01:44:11.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa5e77fe640 1 -- 172.21.15.2:0/1144776758 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v52) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa5f00ee170 con 0x7fa5e8003980 2023-11-04T01:44:11.293 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5ec0664d0 msgr2=0x7fa5ec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5ec0664d0 0x7fa5ec068990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa6000b45b0 tx=0x7fa5f4009040 comp rx=0 tx=0).stop 2023-11-04T01:44:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 msgr2=0x7fa60014df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa60014df40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa5f001c880 tx=0x7fa5e8005800 comp rx=0 tx=0).stop 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 shutdown_connections 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5ec0664d0 0x7fa5ec068990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa600158920 0x7fa600158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa600152c00 0x7fa600153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 --2- 172.21.15.2:0/1144776758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e8003980 0x7fa60014df40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.288+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 >> 172.21.15.2:0/1144776758 conn(0x7fa6000cb510 msgr2=0x7fa600153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.292+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 shutdown_connections 2023-11-04T01:44:11.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.292+0000 7fa6054f8640 1 -- 172.21.15.2:0/1144776758 wait complete. 2023-11-04T01:44:11.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a7105640 1 Processor -- start 2023-11-04T01:44:11.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a7105640 1 -- start start 2023-11-04T01:44:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a7105640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 0x7f46a00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a7105640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f46a00b54d0 0x7f46a00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a7105640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a006cc10 con 0x7f46a0144840 2023-11-04T01:44:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a7105640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00b5960 con 0x7f46a00b54d0 2023-11-04T01:44:11.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a7105640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0071d10 con 0x7f46a0070b40 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a4ea1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f46a0144840 0x7f46a015f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36826/0 (socket says 172.21.15.2:36826) 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a4ea1640 1 -- 172.21.15.2:0/1043064095 learned_addr learned my addr 172.21.15.2:0/1043064095 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a56a2640 1 --2- 172.21.15.2:0/1043064095 >> v2:172.21.15.90:3300/0 conn(0x7f46a00b54d0 0x7f46a00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469ffff640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 0x7f46a00b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754416830 0 0) 0x7f46a006cc10 con 0x7f46a0144840 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4690003530 con 0x7f46a0144840 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3089606814 0 0) 0x7f4690003530 con 0x7f46a0144840 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 msgr2=0x7f46a00b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 0x7f46a00b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 >> v2:172.21.15.90:3300/0 conn(0x7f46a00b54d0 msgr2=0x7f46a00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 --2- 172.21.15.2:0/1043064095 >> v2:172.21.15.90:3300/0 conn(0x7f46a00b54d0 0x7f46a00ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0071100 con 0x7f46a0144840 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f4694001680 con 0x7f46a0144840 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 >> v1:172.21.15.2:6789/0 conn(0x7f46a0144840 legacy=0x7f46a015f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4690003980 0x7f4690003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 0x7f46900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4690004d10 0x7f4690005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00b5960 con 0x7f4690004d10 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0071d10 con 0x7f4690003980 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469000b990 con 0x7f46a0070b40 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a56a2640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4690004d10 0x7f4690005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a4ea1640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4690003980 0x7f4690003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469ffff640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 0x7f46900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a56a2640 1 -- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 msgr2=0x7f46900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a56a2640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 0x7f46900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a56a2640 1 -- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4690003980 msgr2=0x7f4690003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a56a2640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4690003980 0x7f4690003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f46a56a2640 1 -- 172.21.15.2:0/1043064095 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4690003530 con 0x7f4690004d10 2023-11-04T01:44:11.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.436+0000 7f469ffff640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a0070b40 0x7f46900047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:11.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a56a2640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4690004d10 0x7f4690005190 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4698009fc0 tx=0x7f469801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23951d5d974eddd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980a5cb0 con 0x7f4690004d10 2023-11-04T01:44:11.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800f040 con 0x7f4690004d10 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f469f7fe640 1 -- 172.21.15.2:0/1043064095 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980ad680 con 0x7f4690004d10 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 -- 172.21.15.2:0/1043064095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4690004d10 msgr2=0x7f4690005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 --2- 172.21.15.2:0/1043064095 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4690004d10 0x7f4690005190 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4698009fc0 tx=0x7f469801cca0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a56a2640 1 -- 172.21.15.2:0/1043064095 reap_dead start 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 -- 172.21.15.2:0/1043064095 shutdown_connections 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 -- 172.21.15.2:0/1043064095 >> 172.21.15.2:0/1043064095 conn(0x7f46a00cfc70 msgr2=0x7f46a00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 -- 172.21.15.2:0/1043064095 shutdown_connections 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 -- 172.21.15.2:0/1043064095 wait complete. 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 Processor -- start 2023-11-04T01:44:11.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.440+0000 7f46a7105640 1 -- start start 2023-11-04T01:44:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a013a6e0 0x7f46a01428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a01f6d60 0x7f46a00b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46a0136130 0x7f46a00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0142de0 con 0x7f46a013a6e0 2023-11-04T01:44:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01430b0 con 0x7f46a0136130 2023-11-04T01:44:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01f6280 con 0x7f46a01f6d60 2023-11-04T01:44:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a013a6e0 0x7f46a01428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a013a6e0 0x7f46a01428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36828/0 (socket says 172.21.15.2:36828) 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 -- 172.21.15.2:0/2755884013 learned_addr learned my addr 172.21.15.2:0/2755884013 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f469ffff640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a01f6d60 0x7f46a00b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a56a2640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46a0136130 0x7f46a00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 -- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a01f6d60 msgr2=0x7f46a00b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a01f6d60 0x7f46a00b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 -- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46a0136130 msgr2=0x7f46a00b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46a0136130 0x7f46a00b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 -- 172.21.15.2:0/2755884013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a01f6560 con 0x7f46a013a6e0 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a4ea1640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a013a6e0 0x7f46a01428a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4694012510 tx=0x7f4694012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f469d7fa640 1 -- 172.21.15.2:0/2755884013 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940148d0 con 0x7f46a013a6e0 2023-11-04T01:44:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f469d7fa640 1 -- 172.21.15.2:0/2755884013 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694014a30 con 0x7f46a013a6e0 2023-11-04T01:44:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f469d7fa640 1 -- 172.21.15.2:0/2755884013 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694014de0 con 0x7f46a013a6e0 2023-11-04T01:44:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a01f6840 con 0x7f46a013a6e0 2023-11-04T01:44:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a0157f60 con 0x7f46a013a6e0 2023-11-04T01:44:11.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a01f6a80 con 0x7f46a013a6e0 2023-11-04T01:44:11.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f469d7fa640 1 -- 172.21.15.2:0/2755884013 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f46940153e0 con 0x7f46a013a6e0 2023-11-04T01:44:11.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f469d7fa640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46840664a0 0x7f4684068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.444+0000 7f469d7fa640 1 -- 172.21.15.2:0/2755884013 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f4694086860 con 0x7f46a013a6e0 2023-11-04T01:44:11.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.448+0000 7f469ffff640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46840664a0 0x7f4684068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.448+0000 7f469ffff640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46840664a0 0x7f4684068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f46a01435c0 tx=0x7f468c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.448+0000 7f469d7fa640 1 -- 172.21.15.2:0/2755884013 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f46a01f6a80 con 0x7f46a013a6e0 2023-11-04T01:44:11.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.596+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46a00675f0 con 0x7f46a013a6e0 2023-11-04T01:44:11.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f469d7fa640 1 -- 172.21.15.2:0/2755884013 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f469401c020 con 0x7f46a013a6e0 2023-11-04T01:44:11.604 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46840664a0 msgr2=0x7f4684068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46840664a0 0x7f4684068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f46a01435c0 tx=0x7f468c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a013a6e0 msgr2=0x7f46a01428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a013a6e0 0x7f46a01428a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4694012510 tx=0x7f4694012910 comp rx=0 tx=0).stop 2023-11-04T01:44:11.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 shutdown_connections 2023-11-04T01:44:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46840664a0 0x7f4684068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46a0136130 0x7f46a00b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f46a01f6d60 0x7f46a00b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 --2- 172.21.15.2:0/2755884013 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46a013a6e0 0x7f46a01428a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 >> 172.21.15.2:0/2755884013 conn(0x7f46a00cfc70 msgr2=0x7f46a006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 shutdown_connections 2023-11-04T01:44:11.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.600+0000 7f46a7105640 1 -- 172.21.15.2:0/2755884013 wait complete. 2023-11-04T01:44:11.622 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff930802640 1 Processor -- start 2023-11-04T01:44:11.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff930802640 1 -- start start 2023-11-04T01:44:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff930802640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff92c15b190 0x7ff92c15f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff930802640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff92c0ca590 0x7ff92c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff930802640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92c0cb220 con 0x7ff92c15adb0 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff930802640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c06fcd0 con 0x7ff92c0ca590 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff930802640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92c0cac60 con 0x7ff92c15b190 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff92a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff92c15adb0 0x7ff92c0cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36840/0 (socket says 172.21.15.2:36840) 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.744+0000 7ff92a59c640 1 -- 172.21.15.2:0/3171690575 learned_addr learned my addr 172.21.15.2:0/3171690575 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92ad9d640 1 --2- 172.21.15.2:0/3171690575 >> v2:172.21.15.2:3300/0 conn(0x7ff92c0ca590 0x7ff92c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92959a640 1 -- 172.21.15.2:0/3171690575 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681914666 0 0) 0x7ff92c0cb220 con 0x7ff92c15adb0 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff929d9b640 1 --2- 172.21.15.2:0/3171690575 >> v2:172.21.15.90:3300/0 conn(0x7ff92c15b190 0x7ff92c15f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92959a640 1 -- 172.21.15.2:0/3171690575 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff914003530 con 0x7ff92c15adb0 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92ad9d640 1 -- 172.21.15.2:0/3171690575 >> v2:172.21.15.90:3300/0 conn(0x7ff92c15b190 msgr2=0x7ff92c15f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92ad9d640 1 --2- 172.21.15.2:0/3171690575 >> v2:172.21.15.90:3300/0 conn(0x7ff92c15b190 0x7ff92c15f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92ad9d640 1 -- 172.21.15.2:0/3171690575 >> v1:172.21.15.2:6789/0 conn(0x7ff92c15adb0 legacy=0x7ff92c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92ad9d640 1 -- 172.21.15.2:0/3171690575 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c0caf40 con 0x7ff92c0ca590 2023-11-04T01:44:11.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92ad9d640 1 --2- 172.21.15.2:0/3171690575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c15f570 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0cfb00 tx=0x7ff92401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625e7be848b93635 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92959a640 1 -- 172.21.15.2:0/3171690575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240ab600 con 0x7ff92c0ca590 2023-11-04T01:44:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92959a640 1 -- 172.21.15.2:0/3171690575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240a7050 con 0x7ff92c0ca590 2023-11-04T01:44:11.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff92959a640 1 -- 172.21.15.2:0/3171690575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240ab980 con 0x7ff92c0ca590 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 -- 172.21.15.2:0/3171690575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 msgr2=0x7ff92c15f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 --2- 172.21.15.2:0/3171690575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c15f570 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0cfb00 tx=0x7ff92401c430 comp rx=0 tx=0).stop 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 -- 172.21.15.2:0/3171690575 shutdown_connections 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 --2- 172.21.15.2:0/3171690575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c15f570 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 --2- 172.21.15.2:0/3171690575 >> v2:172.21.15.90:3300/0 conn(0x7ff92c15b190 0x7ff92c15f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 -- 172.21.15.2:0/3171690575 >> 172.21.15.2:0/3171690575 conn(0x7ff92c0cb510 msgr2=0x7ff92c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 -- 172.21.15.2:0/3171690575 shutdown_connections 2023-11-04T01:44:11.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.748+0000 7ff930802640 1 -- 172.21.15.2:0/3171690575 wait complete. 2023-11-04T01:44:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 Processor -- start 2023-11-04T01:44:11.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 -- start start 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff92c15adb0 0x7ff92c0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff92c15b190 0x7ff92c1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0adb10 con 0x7ff92c0ca590 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0addf0 con 0x7ff92c15b190 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92c0ae0d0 con 0x7ff92c15adb0 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c06bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36846/0 (socket says 172.21.15.2:36846) 2023-11-04T01:44:11.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 -- 172.21.15.2:0/1580848718 learned_addr learned my addr 172.21.15.2:0/1580848718 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 -- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff92c15adb0 msgr2=0x7ff92c0af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff92c15adb0 0x7ff92c0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92ad9d640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff92c15b190 0x7ff92c1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 -- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff92c15b190 msgr2=0x7ff92c1f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff92c15b190 0x7ff92c1f9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 -- 172.21.15.2:0/1580848718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924009420 con 0x7ff92c0ca590 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff92a59c640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c06bd80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c4d0 tx=0x7ff92000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff91affd640 1 -- 172.21.15.2:0/1580848718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920005cf0 con 0x7ff92c0ca590 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff91affd640 1 -- 172.21.15.2:0/1580848718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920005e50 con 0x7ff92c0ca590 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff91affd640 1 -- 172.21.15.2:0/1580848718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920007290 con 0x7ff92c0ca590 2023-11-04T01:44:11.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92c0ae3b0 con 0x7ff92c0ca590 2023-11-04T01:44:11.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92c0af740 con 0x7ff92c0ca590 2023-11-04T01:44:11.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.752+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff92c0ae8d0 con 0x7ff92c0ca590 2023-11-04T01:44:11.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.756+0000 7ff91affd640 1 -- 172.21.15.2:0/1580848718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9200073f0 con 0x7ff92c0ca590 2023-11-04T01:44:11.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.756+0000 7ff91affd640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff90c0664a0 0x7ff90c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:11.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.756+0000 7ff91affd640 1 -- 172.21.15.2:0/1580848718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7ff920083650 con 0x7ff92c0ca590 2023-11-04T01:44:11.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.756+0000 7ff929d9b640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff90c0664a0 0x7ff90c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:11.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.756+0000 7ff929d9b640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff90c0664a0 0x7ff90c068960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0070b0 tx=0x7ff91c007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:11.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.760+0000 7ff91affd640 1 -- 172.21.15.2:0/1580848718 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff92c0ae8d0 con 0x7ff92c0ca590 2023-11-04T01:44:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.916+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff92c071970 con 0x7ff92c0ca590 2023-11-04T01:44:11.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.916+0000 7ff91affd640 1 -- 172.21.15.2:0/1580848718 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9200543d0 con 0x7ff92c0ca590 2023-11-04T01:44:11.921 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff90c0664a0 msgr2=0x7ff90c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff90c0664a0 0x7ff90c068960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0070b0 tx=0x7ff91c007040 comp rx=0 tx=0).stop 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 msgr2=0x7ff92c06bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c06bd80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c4d0 tx=0x7ff92000c990 comp rx=0 tx=0).stop 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 shutdown_connections 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff90c0664a0 0x7ff90c068960 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff92c15b190 0x7ff92c1f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff92c15adb0 0x7ff92c0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 --2- 172.21.15.2:0/1580848718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff92c0ca590 0x7ff92c06bd80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:11.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 >> 172.21.15.2:0/1580848718 conn(0x7ff92c0cb510 msgr2=0x7ff92c0c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:11.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 shutdown_connections 2023-11-04T01:44:11.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:11.920+0000 7ff930802640 1 -- 172.21.15.2:0/1580848718 wait complete. 2023-11-04T01:44:11.941 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:12.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.052+0000 7f5600892640 1 Processor -- start 2023-11-04T01:44:12.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.052+0000 7f5600892640 1 -- start start 2023-11-04T01:44:12.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f5600892640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f55fc06c1a0 0x7f55fc164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f5600892640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc159e30 con 0x7f55fc0ce720 2023-11-04T01:44:12.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f5600892640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0ccfd0 con 0x7f55fc159a50 2023-11-04T01:44:12.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f5600892640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc070b80 con 0x7f55fc06c1a0 2023-11-04T01:44:12.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f9d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f55fc0ce720 0x7f55fc06ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36854/0 (socket says 172.21.15.2:36854) 2023-11-04T01:44:12.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f9d9b640 1 -- 172.21.15.2:0/3711767685 learned_addr learned my addr 172.21.15.2:0/3711767685 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fad9d640 1 --2- 172.21.15.2:0/3711767685 >> v2:172.21.15.90:3300/0 conn(0x7f55fc06c1a0 0x7f55fc164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097515858 0 0) 0x7f55f0001120 con 0x7f55fc0ce720 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e4003530 con 0x7f55fc0ce720 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1152229903 0 0) 0x7f55e4003530 con 0x7f55fc0ce720 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 >> v2:172.21.15.90:3300/0 conn(0x7f55fc06c1a0 msgr2=0x7f55fc164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 --2- 172.21.15.2:0/3711767685 >> v2:172.21.15.90:3300/0 conn(0x7f55fc06c1a0 0x7f55fc164800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 >> v1:172.21.15.90:6789/0 conn(0x7f55fc159a50 legacy=0x7f55fc0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0cd2b0 con 0x7f55fc0ce720 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f55f0001810 con 0x7f55fc0ce720 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 >> v1:172.21.15.2:6789/0 conn(0x7f55fc0ce720 legacy=0x7f55fc06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55e4003980 0x7f55e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40047d0 0x7f55e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc070b80 con 0x7f55e4005190 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400c040 con 0x7f55e40047d0 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e400c200 con 0x7f55e4003980 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fad9d640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55f9d9b640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40047d0 0x7f55e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fa59c640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55e4003980 0x7f55e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fad9d640 1 -- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55e4003980 msgr2=0x7f55e4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:12.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fad9d640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55e4003980 0x7f55e4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fad9d640 1 -- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40047d0 msgr2=0x7f55e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:12.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fad9d640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40047d0 0x7f55e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fad9d640 1 -- 172.21.15.2:0/3711767685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e4003530 con 0x7f55e4005190 2023-11-04T01:44:12.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.056+0000 7f55fa59c640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55e4003980 0x7f55e4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:12.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fad9d640 1 -- 172.21.15.2:0/3711767685 reap_dead start 2023-11-04T01:44:12.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fad9d640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55e400b990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06dc00 tx=0x7f55f401cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fb6bc52ad393e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40a5ce0 con 0x7f55e4005190 2023-11-04T01:44:12.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f40a5e40 con 0x7f55e4005190 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55f959a640 1 -- 172.21.15.2:0/3711767685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40af620 con 0x7f55e4005190 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- 172.21.15.2:0/3711767685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 msgr2=0x7f55e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55e400b990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f55fc06dc00 tx=0x7f55f401cdd0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- 172.21.15.2:0/3711767685 shutdown_connections 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 --2- 172.21.15.2:0/3711767685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55e400b990 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- 172.21.15.2:0/3711767685 >> 172.21.15.2:0/3711767685 conn(0x7f55fc0cebb0 msgr2=0x7f55fc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- 172.21.15.2:0/3711767685 shutdown_connections 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- 172.21.15.2:0/3711767685 wait complete. 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 Processor -- start 2023-11-04T01:44:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- start start 2023-11-04T01:44:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55fc14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55fc0c7050 0x7f55fc0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55fc0c8030 0x7f55fc0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c84b0 con 0x7f55e4005190 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c8ca0 con 0x7f55fc0c8030 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f5600892640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0c6bc0 con 0x7f55fc0c7050 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55fc14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55fc14dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36872/0 (socket says 172.21.15.2:36872) 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 -- 172.21.15.2:0/1106203858 learned_addr learned my addr 172.21.15.2:0/1106203858 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fad9d640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55fc0c8030 0x7f55fc0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55f9d9b640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55fc0c7050 0x7f55fc0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 -- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55fc0c7050 msgr2=0x7f55fc0c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55fc0c7050 0x7f55fc0c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 -- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55fc0c8030 msgr2=0x7f55fc0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55fc0c8030 0x7f55fc0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 -- 172.21.15.2:0/1106203858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc14e290 con 0x7f55e4005190 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fad9d640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55fc0c8030 0x7f55fc0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55f9d9b640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55fc0c7050 0x7f55fc0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55fa59c640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55fc14dd50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00d7a0 tx=0x7f55ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.060+0000 7f55eaffd640 1 -- 172.21.15.2:0/1106203858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec005270 con 0x7f55e4005190 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f55eaffd640 1 -- 172.21.15.2:0/1106203858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0053f0 con 0x7f55e4005190 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc14e7d0 con 0x7f55e4005190 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f55eaffd640 1 -- 172.21.15.2:0/1106203858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00b8f0 con 0x7f55e4005190 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc0c89c0 con 0x7f55e4005190 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc0744a0 con 0x7f55e4005190 2023-11-04T01:44:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f55eaffd640 1 -- 172.21.15.2:0/1106203858 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55ec00ba50 con 0x7f55e4005190 2023-11-04T01:44:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f55eaffd640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55dc0664a0 0x7f55dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f55eaffd640 1 -- 172.21.15.2:0/1106203858 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f55ec083f80 con 0x7f55e4005190 2023-11-04T01:44:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f55f9d9b640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55dc0664a0 0x7f55dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.064+0000 7f55f9d9b640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55dc0664a0 0x7f55dc068960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f55f0001e30 tx=0x7f55f0001140 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.068+0000 7f55eaffd640 1 -- 172.21.15.2:0/1106203858 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f55ec0b5090 con 0x7f55e4005190 2023-11-04T01:44:12.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.256+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55fc159280 con 0x7f55e4005190 2023-11-04T01:44:12.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f55eaffd640 1 -- 172.21.15.2:0/1106203858 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4901 (secure 0 0 0) 0x7f55ec051280 con 0x7f55e4005190 2023-11-04T01:44:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:12.264 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/47038667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":47038667},{"type":"v1","addr":"172.21.15.90:6835","nonce":47038667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3742811104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3742811104},{"type":"v1","addr":"172.21.15.90:6837","nonce":3742811104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2057053526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2057053526},{"type":"v1","addr":"172.21.15.2:6835","nonce":2057053526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:58.858818+0000","modified":"2023-11-04T01:44:00.951631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6834/1138444248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1138444248},{"type":"v1","addr":"172.21.15.2:6834","nonce":1138444248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:44:12.264 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2023-11-04T01:44:12.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55dc0664a0 msgr2=0x7f55dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55dc0664a0 0x7f55dc068960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f55f0001e30 tx=0x7f55f0001140 comp rx=0 tx=0).stop 2023-11-04T01:44:12.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 msgr2=0x7f55fc14dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55fc14dd50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00d7a0 tx=0x7f55ec00dc60 comp rx=0 tx=0).stop 2023-11-04T01:44:12.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 shutdown_connections 2023-11-04T01:44:12.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55dc0664a0 0x7f55dc068960 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55fc0c8030 0x7f55fc0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55fc0c7050 0x7f55fc0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 --2- 172.21.15.2:0/1106203858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55e4005190 0x7f55fc14dd50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 >> 172.21.15.2:0/1106203858 conn(0x7f55fc0cebb0 msgr2=0x7f55fc15da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:12.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 shutdown_connections 2023-11-04T01:44:12.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.260+0000 7f5600892640 1 -- 172.21.15.2:0/1106203858 wait complete. 2023-11-04T01:44:12.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7950c7f640 1 Processor -- start 2023-11-04T01:44:12.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7950c7f640 1 -- start start 2023-11-04T01:44:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7950c7f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f794c15afb0 0x7f794c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7950c7f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0d0a60 con 0x7f794c0cb400 2023-11-04T01:44:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7950c7f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0d04a0 con 0x7f794c0cd6d0 2023-11-04T01:44:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7950c7f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c15b390 con 0x7f794c15afb0 2023-11-04T01:44:12.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f794a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f794c15afb0 0x7f794c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7949d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f794c0cb400 0x7f794c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36862/0 (socket says 172.21.15.2:36862) 2023-11-04T01:44:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f794a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f794c15afb0 0x7f794c0b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36876/0 (socket says 172.21.15.2:36876) 2023-11-04T01:44:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f7949d9b640 1 -- 172.21.15.2:0/2290465176 learned_addr learned my addr 172.21.15.2:0/2290465176 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f794a59c640 1 -- 172.21.15.2:0/2290465176 >> v1:172.21.15.90:6789/0 conn(0x7f794c0cd6d0 legacy=0x7f794c0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f794a59c640 1 -- 172.21.15.2:0/2290465176 >> v1:172.21.15.2:6789/0 conn(0x7f794c0cb400 legacy=0x7f794c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.388+0000 7f794a59c640 1 -- 172.21.15.2:0/2290465176 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0d0780 con 0x7f794c15afb0 2023-11-04T01:44:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794a59c640 1 --2- 172.21.15.2:0/2290465176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c0b3050 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f79400097c0 tx=0x7f794001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa4cea2696442d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794959a640 1 -- 172.21.15.2:0/2290465176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400ab600 con 0x7f794c15afb0 2023-11-04T01:44:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794959a640 1 -- 172.21.15.2:0/2290465176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79400a7050 con 0x7f794c15afb0 2023-11-04T01:44:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794959a640 1 -- 172.21.15.2:0/2290465176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79400ab980 con 0x7f794c15afb0 2023-11-04T01:44:12.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- 172.21.15.2:0/2290465176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 msgr2=0x7f794c0b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 --2- 172.21.15.2:0/2290465176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c0b3050 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f79400097c0 tx=0x7f794001c3b0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- 172.21.15.2:0/2290465176 shutdown_connections 2023-11-04T01:44:12.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 --2- 172.21.15.2:0/2290465176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c0b3050 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- 172.21.15.2:0/2290465176 >> 172.21.15.2:0/2290465176 conn(0x7f794c065dc0 msgr2=0x7f794c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- 172.21.15.2:0/2290465176 shutdown_connections 2023-11-04T01:44:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- 172.21.15.2:0/2290465176 wait complete. 2023-11-04T01:44:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 Processor -- start 2023-11-04T01:44:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- start start 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794c0cb400 0x7f794c152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f794c0cd6d0 0x7f794c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c13f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c13f890 con 0x7f794c15afb0 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0ca360 con 0x7f794c0cd6d0 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0ca640 con 0x7f794c0cb400 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c13f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c13f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36882/0 (socket says 172.21.15.2:36882) 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 -- 172.21.15.2:0/3752849302 learned_addr learned my addr 172.21.15.2:0/3752849302 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7949d9b640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f794c0cd6d0 0x7f794c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794a59c640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794c0cb400 0x7f794c152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 -- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794c0cb400 msgr2=0x7f794c152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794c0cb400 0x7f794c152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 -- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f794c0cd6d0 msgr2=0x7f794c0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f794c0cd6d0 0x7f794c0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 -- 172.21.15.2:0/3752849302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009420 con 0x7f794c15afb0 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f794ad9d640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c13f350 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f794400c780 tx=0x7f794400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f793affd640 1 -- 172.21.15.2:0/3752849302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944003d90 con 0x7f794c15afb0 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f793affd640 1 -- 172.21.15.2:0/3752849302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794400ce90 con 0x7f794c15afb0 2023-11-04T01:44:12.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c0ca920 con 0x7f794c15afb0 2023-11-04T01:44:12.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f793affd640 1 -- 172.21.15.2:0/3752849302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440052b0 con 0x7f794c15afb0 2023-11-04T01:44:12.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.392+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c0caee0 con 0x7f794c15afb0 2023-11-04T01:44:12.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.396+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0cb0d0 con 0x7f794c15afb0 2023-11-04T01:44:12.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.396+0000 7f793affd640 1 -- 172.21.15.2:0/3752849302 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7944005410 con 0x7f794c15afb0 2023-11-04T01:44:12.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.396+0000 7f793affd640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f792c0664a0 0x7f792c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.396+0000 7f793affd640 1 -- 172.21.15.2:0/3752849302 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f7944083940 con 0x7f794c15afb0 2023-11-04T01:44:12.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.396+0000 7f794a59c640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f792c0664a0 0x7f792c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.396+0000 7f794a59c640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f792c0664a0 0x7f792c068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f79400ad000 tx=0x7f7940008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.400+0000 7f793affd640 1 -- 172.21.15.2:0/3752849302 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7944050ba0 con 0x7f794c15afb0 2023-11-04T01:44:12.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.556+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f794c0675f0 con 0x7f794c15afb0 2023-11-04T01:44:12.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f793affd640 1 -- 172.21.15.2:0/3752849302 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18198 (secure 0 0 0) 0x7f7944017070 con 0x7f794c15afb0 2023-11-04T01:44:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:12.565 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:06.629365+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:56.762181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:57.868403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.d","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f792c0664a0 msgr2=0x7f792c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f792c0664a0 0x7f792c068960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f79400ad000 tx=0x7f7940008040 comp rx=0 tx=0).stop 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 msgr2=0x7f794c13f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c13f350 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f794400c780 tx=0x7f794400cc40 comp rx=0 tx=0).stop 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 shutdown_connections 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f792c0664a0 0x7f792c068960 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f794c15afb0 0x7f794c13f350 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f794c0cd6d0 0x7f794c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 --2- 172.21.15.2:0/3752849302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f794c0cb400 0x7f794c152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 >> 172.21.15.2:0/3752849302 conn(0x7f794c065dc0 msgr2=0x7f794c0661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 shutdown_connections 2023-11-04T01:44:12.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.560+0000 7f7950c7f640 1 -- 172.21.15.2:0/3752849302 wait complete. 2023-11-04T01:44:12.584 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:44:12.584 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:12.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a1330a640 1 Processor -- start 2023-11-04T01:44:12.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a1330a640 1 -- start start 2023-11-04T01:44:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a1330a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2a0c15afd0 0x7f2a0c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a1330a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c0c2670 con 0x7f2a0c0b0d40 2023-11-04T01:44:12.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a1330a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0c06bc30 con 0x7f2a0c06f8f0 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a1330a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0c070140 con 0x7f2a0c15afd0 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a118a7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2a0c0b0d40 0x7f2a0c15ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36864/0 (socket says 172.21.15.2:36864) 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a118a7640 1 -- 172.21.15.2:0/2679722005 learned_addr learned my addr 172.21.15.2:0/2679722005 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a110a6640 1 --2- 172.21.15.2:0/2679722005 >> v2:172.21.15.90:3300/0 conn(0x7f2a0c15afd0 0x7f2a0c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834994244 0 0) 0x7f2a0c0c2670 con 0x7f2a0c0b0d40 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f8003530 con 0x7f2a0c0b0d40 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2608392931 0 0) 0x7f29f8003530 con 0x7f2a0c0b0d40 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 >> v2:172.21.15.90:3300/0 conn(0x7f2a0c15afd0 msgr2=0x7f2a0c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 --2- 172.21.15.2:0/2679722005 >> v2:172.21.15.90:3300/0 conn(0x7f2a0c15afd0 0x7f2a0c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 >> v1:172.21.15.90:6789/0 conn(0x7f2a0c06f8f0 legacy=0x7f2a0c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c06bf10 con 0x7f2a0c0b0d40 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2a04001a00 con 0x7f2a0c0b0d40 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 >> v1:172.21.15.2:6789/0 conn(0x7f2a0c0b0d40 legacy=0x7f2a0c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29f8003980 0x7f29f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29f80047d0 0x7f29f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8005190 0x7f29f800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c070140 con 0x7f29f8003980 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f800c030 con 0x7f29f8005190 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f800c1f0 con 0x7f29f80047d0 2023-11-04T01:44:12.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a110a6640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29f8003980 0x7f29f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a108a5640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29f80047d0 0x7f29f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a110a6640 1 -- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29f80047d0 msgr2=0x7f29f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a110a6640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29f80047d0 0x7f29f8004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a110a6640 1 -- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8005190 msgr2=0x7f29f800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a118a7640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8005190 0x7f29f800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a110a6640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8005190 0x7f29f800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a110a6640 1 -- 172.21.15.2:0/2679722005 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8003530 con 0x7f29f8003980 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a118a7640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8005190 0x7f29f800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:12.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.708+0000 7f2a118a7640 1 -- 172.21.15.2:0/2679722005 reap_dead start 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a110a6640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29f8003980 0x7f29f8003da0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009ae0 tx=0x7f2a0801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d43fa35fec1e64 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080a5530 con 0x7f29f8003980 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a080a5690 con 0x7f29f8003980 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a03fff640 1 -- 172.21.15.2:0/2679722005 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080a5a40 con 0x7f29f8003980 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- 172.21.15.2:0/2679722005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29f8003980 msgr2=0x7f29f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29f8003980 0x7f29f8003da0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009ae0 tx=0x7f2a0801ca50 comp rx=0 tx=0).stop 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- 172.21.15.2:0/2679722005 shutdown_connections 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 --2- 172.21.15.2:0/2679722005 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f29f8003980 0x7f29f8003da0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- 172.21.15.2:0/2679722005 >> 172.21.15.2:0/2679722005 conn(0x7f2a0c0cebb0 msgr2=0x7f2a0c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:12.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- 172.21.15.2:0/2679722005 shutdown_connections 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- 172.21.15.2:0/2679722005 wait complete. 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 Processor -- start 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- start start 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8003980 0x7f2a0c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a0c0b1d10 0x7f2a0c1f9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a0c1fa430 0x7f2a0c0b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c150810 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c0b2190 con 0x7f29f8003980 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a1330a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0c1f6810 con 0x7f2a0c1fa430 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a108a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a0c0b1d10 0x7f2a0c1f9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a108a5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a0c0b1d10 0x7f2a0c1f9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36900/0 (socket says 172.21.15.2:36900) 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.712+0000 7f2a108a5640 1 -- 172.21.15.2:0/3813951381 learned_addr learned my addr 172.21.15.2:0/3813951381 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a110a6640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8003980 0x7f2a0c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a118a7640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a0c1fa430 0x7f2a0c0b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a108a5640 1 -- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a0c1fa430 msgr2=0x7f2a0c0b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a108a5640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a0c1fa430 0x7f2a0c0b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a108a5640 1 -- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8003980 msgr2=0x7f2a0c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a108a5640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8003980 0x7f2a0c0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a108a5640 1 -- 172.21.15.2:0/3813951381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c1f6af0 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a108a5640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a0c0b1d10 0x7f2a0c1f9ef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00d570 tx=0x7f29fc00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a01ffb640 1 -- 172.21.15.2:0/3813951381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc005480 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a01ffb640 1 -- 172.21.15.2:0/3813951381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc003620 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a0c1f6dd0 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a01ffb640 1 -- 172.21.15.2:0/3813951381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003990 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0c1f7390 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0c0744a0 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a01ffb640 1 -- 172.21.15.2:0/3813951381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29fc003af0 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a01ffb640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29f00664d0 0x7f29f0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:12.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a01ffb640 1 -- 172.21.15.2:0/3813951381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f29fc083d60 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.716+0000 7f2a110a6640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29f00664d0 0x7f29f0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:12.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.720+0000 7f2a110a6640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29f00664d0 0x7f29f0068990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2a080af000 tx=0x7f2a080046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:12.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.720+0000 7f2a01ffb640 1 -- 172.21.15.2:0/3813951381 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f29fc051110 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.900+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a0c0ca180 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a01ffb640 1 -- 172.21.15.2:0/3813951381 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4901 (secure 0 0 0) 0x7f29fc054730 con 0x7f2a0c0b1d10 2023-11-04T01:44:12.908 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:12.908 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/47038667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":47038667},{"type":"v1","addr":"172.21.15.90:6835","nonce":47038667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3742811104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3742811104},{"type":"v1","addr":"172.21.15.90:6837","nonce":3742811104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2057053526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2057053526},{"type":"v1","addr":"172.21.15.2:6835","nonce":2057053526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:58.858818+0000","modified":"2023-11-04T01:44:00.951631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6834/1138444248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1138444248},{"type":"v1","addr":"172.21.15.2:6834","nonce":1138444248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:44:12.908 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29f00664d0 msgr2=0x7f29f0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29f00664d0 0x7f29f0068990 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2a080af000 tx=0x7f2a080046d0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a0c0b1d10 msgr2=0x7f2a0c1f9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a0c0b1d10 0x7f2a0c1f9ef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00d570 tx=0x7f29fc00da30 comp rx=0 tx=0).stop 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 shutdown_connections 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29f00664d0 0x7f29f0068990 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2a0c1fa430 0x7f2a0c0b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a0c0b1d10 0x7f2a0c1f9ef0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 --2- 172.21.15.2:0/3813951381 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29f8003980 0x7f2a0c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 >> 172.21.15.2:0/3813951381 conn(0x7f2a0c0cebb0 msgr2=0x7f2a0c0c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 shutdown_connections 2023-11-04T01:44:12.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:12.904+0000 7f2a1330a640 1 -- 172.21.15.2:0/3813951381 wait complete. 2023-11-04T01:44:12.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:13.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.040+0000 7fd009bd9640 1 Processor -- start 2023-11-04T01:44:13.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.040+0000 7fd009bd9640 1 -- start start 2023-11-04T01:44:13.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.040+0000 7fd009bd9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0040ccf50 0x7fd0040cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.040+0000 7fd009bd9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd004065e70 0x7fd0040cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.040+0000 7fd009bd9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0040cddb0 con 0x7fd00415d2f0 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.040+0000 7fd009bd9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0040cb530 con 0x7fd0040ccf50 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.040+0000 7fd009bd9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0040cb7b0 con 0x7fd004065e70 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0040ccf50 0x7fd0040cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0040ccf50 0x7fd0040cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36902/0 (socket says 172.21.15.2:36902) 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 -- 172.21.15.2:0/984447354 learned_addr learned my addr 172.21.15.2:0/984447354 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd003fff640 1 --2- 172.21.15.2:0/984447354 >> v2:172.21.15.90:3300/0 conn(0x7fd004065e70 0x7fd0040cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 -- 172.21.15.2:0/984447354 >> v2:172.21.15.90:3300/0 conn(0x7fd004065e70 msgr2=0x7fd0040cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 --2- 172.21.15.2:0/984447354 >> v2:172.21.15.90:3300/0 conn(0x7fd004065e70 0x7fd0040cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 -- 172.21.15.2:0/984447354 >> v1:172.21.15.90:6789/0 conn(0x7fd00415d2f0 legacy=0x7fd004160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 -- 172.21.15.2:0/984447354 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0040cba90 con 0x7fd0040ccf50 2023-11-04T01:44:13.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0037fe640 1 --2- 172.21.15.2:0/984447354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0040ccf50 0x7fd0040cd330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd0040b52b0 tx=0x7fcff401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc67f00245dfc8bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0027fc640 1 -- 172.21.15.2:0/984447354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff40aa5f0 con 0x7fd0040ccf50 2023-11-04T01:44:13.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0027fc640 1 -- 172.21.15.2:0/984447354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff40aa750 con 0x7fd0040ccf50 2023-11-04T01:44:13.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd0027fc640 1 -- 172.21.15.2:0/984447354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff40aaae0 con 0x7fd0040ccf50 2023-11-04T01:44:13.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 -- 172.21.15.2:0/984447354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0040ccf50 msgr2=0x7fd0040cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 --2- 172.21.15.2:0/984447354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0040ccf50 0x7fd0040cd330 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd0040b52b0 tx=0x7fcff401c490 comp rx=0 tx=0).stop 2023-11-04T01:44:13.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 -- 172.21.15.2:0/984447354 shutdown_connections 2023-11-04T01:44:13.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 --2- 172.21.15.2:0/984447354 >> v2:172.21.15.90:3300/0 conn(0x7fd004065e70 0x7fd0040cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 --2- 172.21.15.2:0/984447354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0040ccf50 0x7fd0040cd330 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 -- 172.21.15.2:0/984447354 >> 172.21.15.2:0/984447354 conn(0x7fd0040b0e70 msgr2=0x7fd0040b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:13.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 -- 172.21.15.2:0/984447354 shutdown_connections 2023-11-04T01:44:13.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.044+0000 7fd009bd9640 1 -- 172.21.15.2:0/984447354 wait complete. 2023-11-04T01:44:13.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 Processor -- start 2023-11-04T01:44:13.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 -- start start 2023-11-04T01:44:13.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004065e70 0x7fd0041fa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0040ccf50 0x7fd0040c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd00415d2f0 0x7fd0040c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd004157700 con 0x7fd00415d2f0 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd004156830 con 0x7fd004065e70 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0041fa8e0 con 0x7fd0040ccf50 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd00415d2f0 0x7fd0040c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd00415d2f0 0x7fd0040c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36914/0 (socket says 172.21.15.2:36914) 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 -- 172.21.15.2:0/2749528004 learned_addr learned my addr 172.21.15.2:0/2749528004 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd0037fe640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004065e70 0x7fd0041fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 -- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0040ccf50 msgr2=0x7fd0040c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0040ccf50 0x7fd0040c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 -- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004065e70 msgr2=0x7fd0041fa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004065e70 0x7fd0041fa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 -- 172.21.15.2:0/2749528004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40094d0 con 0x7fd00415d2f0 2023-11-04T01:44:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd003fff640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd00415d2f0 0x7fd0040c8bf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007e40 tx=0x7fcffc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fcfebfff640 1 -- 172.21.15.2:0/2749528004 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc014620 con 0x7fd00415d2f0 2023-11-04T01:44:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fcfebfff640 1 -- 172.21.15.2:0/2749528004 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc00ee90 con 0x7fd00415d2f0 2023-11-04T01:44:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd004156a80 con 0x7fd00415d2f0 2023-11-04T01:44:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fcfebfff640 1 -- 172.21.15.2:0/2749528004 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0149e0 con 0x7fd00415d2f0 2023-11-04T01:44:13.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd004157040 con 0x7fd00415d2f0 2023-11-04T01:44:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd004157840 con 0x7fd00415d2f0 2023-11-04T01:44:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fcfebfff640 1 -- 172.21.15.2:0/2749528004 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcffc014b40 con 0x7fd00415d2f0 2023-11-04T01:44:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fcfebfff640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcff00664a0 0x7fcff0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.048+0000 7fcfebfff640 1 -- 172.21.15.2:0/2749528004 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fcffc084a10 con 0x7fd00415d2f0 2023-11-04T01:44:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.052+0000 7fd0037fe640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcff00664a0 0x7fcff0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.052+0000 7fd0037fe640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcff00664a0 0x7fcff0068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ae000 tx=0x7fcff40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.052+0000 7fcfebfff640 1 -- 172.21.15.2:0/2749528004 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd004157840 con 0x7fd00415d2f0 2023-11-04T01:44:13.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd004157840 con 0x7fd00415d2f0 2023-11-04T01:44:13.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fcfebfff640 1 -- 172.21.15.2:0/2749528004 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4901 (secure 0 0 0) 0x7fd004157840 con 0x7fd00415d2f0 2023-11-04T01:44:13.241 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:13.241 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/47038667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":47038667},{"type":"v1","addr":"172.21.15.90:6835","nonce":47038667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3742811104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3742811104},{"type":"v1","addr":"172.21.15.90:6837","nonce":3742811104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2057053526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2057053526},{"type":"v1","addr":"172.21.15.2:6835","nonce":2057053526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:43:58.858818+0000","modified":"2023-11-04T01:44:00.951631+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6834/1138444248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1138444248},{"type":"v1","addr":"172.21.15.2:6834","nonce":1138444248}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-04T01:44:13.241 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcff00664a0 msgr2=0x7fcff0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcff00664a0 0x7fcff0068960 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcff40ae000 tx=0x7fcff40a7000 comp rx=0 tx=0).stop 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd00415d2f0 msgr2=0x7fd0040c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd00415d2f0 0x7fd0040c8bf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcffc007e40 tx=0x7fcffc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 shutdown_connections 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcff00664a0 0x7fcff0068960 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd00415d2f0 0x7fd0040c8bf0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0040ccf50 0x7fd0040c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 --2- 172.21.15.2:0/2749528004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd004065e70 0x7fd0041fa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 >> 172.21.15.2:0/2749528004 conn(0x7fd0040b0e70 msgr2=0x7fd0040cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 shutdown_connections 2023-11-04T01:44:13.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.236+0000 7fd009bd9640 1 -- 172.21.15.2:0/2749528004 wait complete. 2023-11-04T01:44:13.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:13.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.372+0000 7f92795a4640 1 Processor -- start 2023-11-04T01:44:13.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.372+0000 7f92795a4640 1 -- start start 2023-11-04T01:44:13.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f92795a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 0x7f92740cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f92795a4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927415f980 con 0x7f92740b27d0 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f92795a4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927415f4f0 con 0x7f927415b150 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f92795a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740d0af0 con 0x7f92740d0510 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f92740b27d0 0x7f92740b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36874/0 (socket says 172.21.15.2:36874) 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 -- 172.21.15.2:0/713949210 learned_addr learned my addr 172.21.15.2:0/713949210 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f92737fe640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 0x7f92740cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467675028 0 0) 0x7f927415f980 con 0x7f92740b27d0 2023-11-04T01:44:13.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f925c003530 con 0x7f92740b27d0 2023-11-04T01:44:13.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1743218767 0 0) 0x7f925c003530 con 0x7f92740b27d0 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 msgr2=0x7f92740cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 0x7f92740cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 >> v1:172.21.15.90:6789/0 conn(0x7f927415b150 legacy=0x7f927406f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740cb6d0 con 0x7f92740b27d0 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f9264001680 con 0x7f92740b27d0 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 >> v1:172.21.15.2:6789/0 conn(0x7f92740b27d0 legacy=0x7f92740b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925c0039b0 0x7f925c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0047d0 0x7f925c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 0x7f925c005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92740d0af0 con 0x7f925c0039b0 2023-11-04T01:44:13.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c00bb80 con 0x7f925c0047d0 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c00bd40 con 0x7f92740d0510 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925c0039b0 0x7f925c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f92737fe640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 0x7f925c005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f92727fc640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0047d0 0x7f925c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 -- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 msgr2=0x7f925c005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f92740d0510 0x7f925c005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 -- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0047d0 msgr2=0x7f925c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0047d0 0x7f925c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.376+0000 7f9272ffd640 1 -- 172.21.15.2:0/713949210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c003530 con 0x7f925c0039b0 2023-11-04T01:44:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f9272ffd640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925c0039b0 0x7f925c003dd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f926400c240 tx=0x7f926401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea583164dec8b8b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92640a5b20 con 0x7f925c0039b0 2023-11-04T01:44:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92640a5ca0 con 0x7f925c0039b0 2023-11-04T01:44:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f9271ffb640 1 -- 172.21.15.2:0/713949210 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264005b20 con 0x7f925c0039b0 2023-11-04T01:44:13.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- 172.21.15.2:0/713949210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925c0039b0 msgr2=0x7f925c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 --2- 172.21.15.2:0/713949210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925c0039b0 0x7f925c003dd0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f926400c240 tx=0x7f926401cc40 comp rx=0 tx=0).stop 2023-11-04T01:44:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92737fe640 1 -- 172.21.15.2:0/713949210 reap_dead start 2023-11-04T01:44:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- 172.21.15.2:0/713949210 shutdown_connections 2023-11-04T01:44:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- 172.21.15.2:0/713949210 >> 172.21.15.2:0/713949210 conn(0x7f92740cd7d0 msgr2=0x7f92740cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- 172.21.15.2:0/713949210 shutdown_connections 2023-11-04T01:44:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- 172.21.15.2:0/713949210 wait complete. 2023-11-04T01:44:13.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 Processor -- start 2023-11-04T01:44:13.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- start start 2023-11-04T01:44:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925c0039b0 0x7f92741473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f927415ddf0 0x7f927415c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9274157510 0x7f92740b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274147900 con 0x7f927415ddf0 2023-11-04T01:44:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927415b590 con 0x7f9274157510 2023-11-04T01:44:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92795a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927415cae0 con 0x7f925c0039b0 2023-11-04T01:44:13.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f927415ddf0 0x7f927415c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92727fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f927415ddf0 0x7f927415c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36926/0 (socket says 172.21.15.2:36926) 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92727fc640 1 -- 172.21.15.2:0/2574330789 learned_addr learned my addr 172.21.15.2:0/2574330789 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f9272ffd640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925c0039b0 0x7f92741473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.380+0000 7f92737fe640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9274157510 0x7f92740b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92727fc640 1 -- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925c0039b0 msgr2=0x7f92741473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92727fc640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925c0039b0 0x7f92741473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92727fc640 1 -- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9274157510 msgr2=0x7f92740b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92727fc640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9274157510 0x7f92740b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92727fc640 1 -- 172.21.15.2:0/2574330789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927415b7e0 con 0x7f927415ddf0 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92727fc640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f927415ddf0 0x7f927415c5a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f926800e4d0 tx=0x7f926800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f925b7fe640 1 -- 172.21.15.2:0/2574330789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680052e0 con 0x7f927415ddf0 2023-11-04T01:44:13.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f925b7fe640 1 -- 172.21.15.2:0/2574330789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268005440 con 0x7f927415ddf0 2023-11-04T01:44:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927415bac0 con 0x7f927415ddf0 2023-11-04T01:44:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f925b7fe640 1 -- 172.21.15.2:0/2574330789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268003820 con 0x7f927415ddf0 2023-11-04T01:44:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927415c080 con 0x7f927415ddf0 2023-11-04T01:44:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927415c240 con 0x7f927415ddf0 2023-11-04T01:44:13.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f925b7fe640 1 -- 172.21.15.2:0/2574330789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9268003980 con 0x7f927415ddf0 2023-11-04T01:44:13.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f925b7fe640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92600664d0 0x7f9260068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f925b7fe640 1 -- 172.21.15.2:0/2574330789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f9268083980 con 0x7f927415ddf0 2023-11-04T01:44:13.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f9272ffd640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92600664d0 0x7f9260068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.384+0000 7f9272ffd640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92600664d0 0x7f9260068990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f92640ab000 tx=0x7f92640a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.388+0000 7f925b7fe640 1 -- 172.21.15.2:0/2574330789 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9268050cf0 con 0x7f927415ddf0 2023-11-04T01:44:13.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92740744a0 con 0x7f927415ddf0 2023-11-04T01:44:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f925b7fe640 1 -- 172.21.15.2:0/2574330789 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+18198 (secure 0 0 0) 0x7f9268054310 con 0x7f927415ddf0 2023-11-04T01:44:13.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:13.553 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:06.629365+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:43:56.762181+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-04T01:43:57.868403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.d","mappings":[{"from":2,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92600664d0 msgr2=0x7f9260068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92600664d0 0x7f9260068990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f92640ab000 tx=0x7f92640a7070 comp rx=0 tx=0).stop 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f927415ddf0 msgr2=0x7f927415c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f927415ddf0 0x7f927415c5a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f926800e4d0 tx=0x7f926800e990 comp rx=0 tx=0).stop 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 shutdown_connections 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92600664d0 0x7f9260068990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9274157510 0x7f92740b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f927415ddf0 0x7f927415c5a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 --2- 172.21.15.2:0/2574330789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925c0039b0 0x7f92741473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 >> 172.21.15.2:0/2574330789 conn(0x7f92740cd7d0 msgr2=0x7f9274154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:13.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 shutdown_connections 2023-11-04T01:44:13.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.548+0000 7f92795a4640 1 -- 172.21.15.2:0/2574330789 wait complete. 2023-11-04T01:44:13.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:44:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5fdc3c640 1 Processor -- start 2023-11-04T01:44:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5fdc3c640 1 -- start start 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5fdc3c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 0x7fa5f80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5fdc3c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f80b4270 con 0x7fa5f80722e0 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5fdc3c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f806cb40 con 0x7fa5f806a370 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5fdc3c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f806ce20 con 0x7fa5f815d540 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5f6ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa5f80722e0 0x7fa5f806d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36890/0 (socket says 172.21.15.2:36890) 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.688+0000 7fa5f6ffd640 1 -- 172.21.15.2:0/2014853168 learned_addr learned my addr 172.21.15.2:0/2014853168 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f77fe640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 0x7fa5f80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857906601 0 0) 0x7fa5f80b4270 con 0x7fa5f80722e0 2023-11-04T01:44:13.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e0003530 con 0x7fa5f80722e0 2023-11-04T01:44:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2984750659 0 0) 0x7fa5e0003530 con 0x7fa5f80722e0 2023-11-04T01:44:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 msgr2=0x7fa5f80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 0x7fa5f80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 >> v1:172.21.15.90:6789/0 conn(0x7fa5f806a370 legacy=0x7fa5f80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f806d100 con 0x7fa5f80722e0 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa5ec001680 con 0x7fa5f80722e0 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 >> v1:172.21.15.2:6789/0 conn(0x7fa5f80722e0 legacy=0x7fa5f806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 0x7fa5e00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e0004d10 0x7fa5e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f806ce20 con 0x7fa5e0003f30 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e000bbd0 con 0x7fa5e0004d10 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e000bd90 con 0x7fa5f815d540 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f6ffd640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f77fe640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 0x7fa5e00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f7fff640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e0004d10 0x7fa5e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f6ffd640 1 -- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 msgr2=0x7fa5e00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f6ffd640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815d540 0x7fa5e00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f6ffd640 1 -- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e0004d10 msgr2=0x7fa5e0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f6ffd640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e0004d10 0x7fa5e0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f6ffd640 1 -- 172.21.15.2:0/2014853168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0003530 con 0x7fa5e0003f30 2023-11-04T01:44:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f7fff640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5e0004d10 0x7fa5e0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f6ffd640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5e00047d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00c240 tx=0x7fa5ec01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707b29ff8a199dfa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec005ae0 con 0x7fa5e0003f30 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0a7070 con 0x7fa5e0003f30 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.692+0000 7fa5f67fc640 1 -- 172.21.15.2:0/2014853168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec007070 con 0x7fa5e0003f30 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/2014853168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 msgr2=0x7fa5e00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 --2- 172.21.15.2:0/2014853168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5e00047d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00c240 tx=0x7fa5ec01c920 comp rx=0 tx=0).stop 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f7fff640 1 -- 172.21.15.2:0/2014853168 reap_dead start 2023-11-04T01:44:13.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/2014853168 shutdown_connections 2023-11-04T01:44:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/2014853168 >> 172.21.15.2:0/2014853168 conn(0x7fa5f80716a0 msgr2=0x7fa5f8071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/2014853168 shutdown_connections 2023-11-04T01:44:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/2014853168 wait complete. 2023-11-04T01:44:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 Processor -- start 2023-11-04T01:44:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- start start 2023-11-04T01:44:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5f80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815c620 0x7fa5f815de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f81602f0 0x7fa5f815e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8160b40 con 0x7fa5e0003f30 2023-11-04T01:44:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f8160860 con 0x7fa5f81602f0 2023-11-04T01:44:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f80af8d0 con 0x7fa5f815c620 2023-11-04T01:44:13.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5f80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5f80c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36946/0 (socket says 172.21.15.2:36946) 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 -- 172.21.15.2:0/1821589229 learned_addr learned my addr 172.21.15.2:0/1821589229 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f7fff640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f81602f0 0x7fa5f815e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f6ffd640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815c620 0x7fa5f815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 -- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815c620 msgr2=0x7fa5f815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815c620 0x7fa5f815de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 -- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f81602f0 msgr2=0x7fa5f815e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f81602f0 0x7fa5f815e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 -- 172.21.15.2:0/1821589229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f806ad10 con 0x7fa5e0003f30 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f7fff640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f81602f0 0x7fa5f815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5f77fe640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5f80c8180 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80115e0 tx=0x7fa5e8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5dffff640 1 -- 172.21.15.2:0/1821589229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800f8f0 con 0x7fa5e0003f30 2023-11-04T01:44:13.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5dffff640 1 -- 172.21.15.2:0/1821589229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e800fa50 con 0x7fa5e0003f30 2023-11-04T01:44:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5dffff640 1 -- 172.21.15.2:0/1821589229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800fdc0 con 0x7fa5e0003f30 2023-11-04T01:44:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f80afbb0 con 0x7fa5e0003f30 2023-11-04T01:44:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.696+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f80c86c0 con 0x7fa5e0003f30 2023-11-04T01:44:13.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.700+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f80675f0 con 0x7fa5e0003f30 2023-11-04T01:44:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.700+0000 7fa5dffff640 1 -- 172.21.15.2:0/1821589229 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5e8015460 con 0x7fa5e0003f30 2023-11-04T01:44:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.700+0000 7fa5dffff640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5e40664a0 0x7fa5e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.700+0000 7fa5dffff640 1 -- 172.21.15.2:0/1821589229 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fa5e8084540 con 0x7fa5e0003f30 2023-11-04T01:44:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.700+0000 7fa5f6ffd640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5e40664a0 0x7fa5e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:13.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.700+0000 7fa5f6ffd640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5e40664a0 0x7fa5e4068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0ab000 tx=0x7fa5ec0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:13.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.704+0000 7fa5dffff640 1 -- 172.21.15.2:0/1821589229 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5e8051830 con 0x7fa5e0003f30 2023-11-04T01:44:13.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.892+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa5f8161d90 con 0x7fa5e0003f30 2023-11-04T01:44:13.900 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-04T01:44:13.896+0000 7f4b9aa78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:44:13.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5dffff640 1 -- 172.21.15.2:0/1821589229 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa5e8054e50 con 0x7fa5e0003f30 2023-11-04T01:44:13.903 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5e40664a0 msgr2=0x7fa5e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5e40664a0 0x7fa5e4068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0ab000 tx=0x7fa5ec0a6000 comp rx=0 tx=0).stop 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 msgr2=0x7fa5f80c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5f80c8180 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80115e0 tx=0x7fa5e8011aa0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 shutdown_connections 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5e40664a0 0x7fa5e4068960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5f81602f0 0x7fa5f815e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5f815c620 0x7fa5f815de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 --2- 172.21.15.2:0/1821589229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5e0003f30 0x7fa5f80c8180 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:13.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 >> 172.21.15.2:0/1821589229 conn(0x7fa5f80716a0 msgr2=0x7fa5f806d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:13.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 shutdown_connections 2023-11-04T01:44:13.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:13.900+0000 7fa5fdc3c640 1 -- 172.21.15.2:0/1821589229 wait complete. 2023-11-04T01:44:13.913 INFO:tasks.ceph.mds.a.smithi002.stderr: -535> 2023-11-04T01:44:04.472+0000 7f584d888640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:13.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:44:13.942 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:44:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.052+0000 7fb5b5649640 1 Processor -- start 2023-11-04T01:44:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.052+0000 7fb5b5649640 1 -- start start 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5b5649640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5b00c9a00 0x7fb5b00adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5b5649640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00cd020 con 0x7fb5b00cc990 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5b5649640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b00cd300 con 0x7fb5b00adb50 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5b5649640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b00cce00 con 0x7fb5b00c9a00 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5af7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb5b00cc990 0x7fb5b006f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36896/0 (socket says 172.21.15.2:36896) 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5af7fe640 1 -- 172.21.15.2:0/3362339037 learned_addr learned my addr 172.21.15.2:0/3362339037 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765486498 0 0) 0x7fb5b00cd020 con 0x7fb5b00cc990 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5ae7fc640 1 --2- 172.21.15.2:0/3362339037 >> v2:172.21.15.90:3300/0 conn(0x7fb5b00c9a00 0x7fb5b00adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb598003530 con 0x7fb5b00cc990 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026771841 0 0) 0x7fb598003530 con 0x7fb5b00cc990 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 >> v2:172.21.15.90:3300/0 conn(0x7fb5b00c9a00 msgr2=0x7fb5b00adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 --2- 172.21.15.2:0/3362339037 >> v2:172.21.15.90:3300/0 conn(0x7fb5b00c9a00 0x7fb5b00adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 >> v1:172.21.15.90:6789/0 conn(0x7fb5b00adb50 legacy=0x7fb5b00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b00cd5e0 con 0x7fb5b00cc990 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fb5a8001680 con 0x7fb5b00cc990 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5ae7fc640 1 --2- 172.21.15.2:0/3362339037 >> v2:172.21.15.90:3300/0 conn(0x7fb5b00c9a00 0x7fb5b00adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 >> v1:172.21.15.2:6789/0 conn(0x7fb5b00cc990 legacy=0x7fb5b006f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598003980 0x7fb598003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5980047d0 0x7fb598004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598005190 0x7fb59800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00cce00 con 0x7fb598003980 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59800c0e0 con 0x7fb5980047d0 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59800c2a0 con 0x7fb598005190 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5aeffd640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598003980 0x7fb598003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5ae7fc640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5980047d0 0x7fb598004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5af7fe640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598005190 0x7fb59800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5aeffd640 1 -- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598005190 msgr2=0x7fb59800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5aeffd640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598005190 0x7fb59800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5aeffd640 1 -- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5980047d0 msgr2=0x7fb598004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5aeffd640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5980047d0 0x7fb598004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5aeffd640 1 -- 172.21.15.2:0/3362339037 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598003530 con 0x7fb598003980 2023-11-04T01:44:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5af7fe640 1 -- 172.21.15.2:0/3362339037 reap_dead start 2023-11-04T01:44:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.056+0000 7fb5aeffd640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598003980 0x7fb598003da0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0001e70 tx=0x7fb5a001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aef5992040659f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0003980 con 0x7fb598003980 2023-11-04T01:44:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a0003ae0 con 0x7fb598003980 2023-11-04T01:44:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5adffb640 1 -- 172.21.15.2:0/3362339037 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0003e90 con 0x7fb598003980 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- 172.21.15.2:0/3362339037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598003980 msgr2=0x7fb598003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598003980 0x7fb598003da0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0001e70 tx=0x7fb5a001c710 comp rx=0 tx=0).stop 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- 172.21.15.2:0/3362339037 shutdown_connections 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 --2- 172.21.15.2:0/3362339037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb598003980 0x7fb598003da0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- 172.21.15.2:0/3362339037 >> 172.21.15.2:0/3362339037 conn(0x7fb5b00cb510 msgr2=0x7fb5b00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- 172.21.15.2:0/3362339037 shutdown_connections 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- 172.21.15.2:0/3362339037 wait complete. 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 Processor -- start 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- start start 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598003980 0x7fb5b00c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b00c5b60 0x7fb5b00c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b0070150 0x7fb5b00705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b01f6340 con 0x7fb5b00c5b60 2023-11-04T01:44:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b00c60d0 con 0x7fb5b0070150 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5b5649640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b0070b10 con 0x7fb598003980 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b00c5b60 0x7fb5b00c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b00c5b60 0x7fb5b00c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36980/0 (socket says 172.21.15.2:36980) 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 -- 172.21.15.2:0/1820402176 learned_addr learned my addr 172.21.15.2:0/1820402176 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5aeffd640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598003980 0x7fb5b00c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5af7fe640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b0070150 0x7fb5b00705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 -- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598003980 msgr2=0x7fb5b00c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598003980 0x7fb5b00c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 -- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b0070150 msgr2=0x7fb5b00705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b0070150 0x7fb5b00705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 -- 172.21.15.2:0/1820402176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b014b770 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.060+0000 7fb5ae7fc640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b00c5b60 0x7fb5b00c6a90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40108c0 tx=0x7fb5a4010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5977fe640 1 -- 172.21.15.2:0/1820402176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4004440 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5977fe640 1 -- 172.21.15.2:0/1820402176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a400c050 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b00c8a30 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5977fe640 1 -- 172.21.15.2:0/1820402176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400e8b0 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b01f5860 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b00744a0 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5977fe640 1 -- 172.21.15.2:0/1820402176 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5a400ea10 con 0x7fb5b00c5b60 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5977fe640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb59c0664a0 0x7fb59c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:14.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5977fe640 1 -- 172.21.15.2:0/1820402176 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fb5a4084b00 con 0x7fb5b00c5b60 2023-11-04T01:44:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.064+0000 7fb5aeffd640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb59c0664a0 0x7fb59c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:14.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.068+0000 7fb5aeffd640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb59c0664a0 0x7fb59c068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0005000 tx=0x7fb5a0001520 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:14.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.068+0000 7fb5977fe640 1 -- 172.21.15.2:0/1820402176 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5a4051e80 con 0x7fb5b00c5b60 2023-11-04T01:44:14.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.260+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb5b00b1420 con 0x7fb5b00c5b60 2023-11-04T01:44:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.900+0000 7fb5977fe640 1 -- 172.21.15.2:0/1820402176 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb5a40554a0 con 0x7fb5b00c5b60 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb59c0664a0 msgr2=0x7fb59c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb59c0664a0 0x7fb59c068960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0005000 tx=0x7fb5a0001520 comp rx=0 tx=0).stop 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b00c5b60 msgr2=0x7fb5b00c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b00c5b60 0x7fb5b00c6a90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40108c0 tx=0x7fb5a4010d80 comp rx=0 tx=0).stop 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 shutdown_connections 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb59c0664a0 0x7fb59c068960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5b0070150 0x7fb5b00705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5b00c5b60 0x7fb5b00c6a90 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 --2- 172.21.15.2:0/1820402176 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb598003980 0x7fb5b00c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 >> 172.21.15.2:0/1820402176 conn(0x7fb5b00cb510 msgr2=0x7fb5b0158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 shutdown_connections 2023-11-04T01:44:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:14.904+0000 7fb5b5649640 1 -- 172.21.15.2:0/1820402176 wait complete. 2023-11-04T01:44:14.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:44:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d328c640 1 Processor -- start 2023-11-04T01:44:15.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d328c640 1 -- start start 2023-11-04T01:44:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d328c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20cc159df0 0x7f20cc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d328c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f20cc0cca30 0x7f20cc0cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d328c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc070c60 con 0x7f20cc0cd740 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d328c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0ca2f0 con 0x7f20cc159df0 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d328c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0c9d30 con 0x7f20cc0cca30 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d1829640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f20cc0cd740 0x7f20cc06b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36898/0 (socket says 172.21.15.2:36898) 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d1829640 1 -- 172.21.15.2:0/4142562585 learned_addr learned my addr 172.21.15.2:0/4142562585 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d1028640 1 --2- 172.21.15.2:0/4142562585 >> v2:172.21.15.2:3300/0 conn(0x7f20cc159df0 0x7f20cc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d0827640 1 --2- 172.21.15.2:0/4142562585 >> v2:172.21.15.90:3300/0 conn(0x7f20cc0cca30 0x7f20cc0cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20cbfff640 1 -- 172.21.15.2:0/4142562585 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459470714 0 0) 0x7f20cc070c60 con 0x7f20cc0cd740 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20cbfff640 1 -- 172.21.15.2:0/4142562585 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b8003530 con 0x7f20cc0cd740 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d1028640 1 -- 172.21.15.2:0/4142562585 >> v2:172.21.15.90:3300/0 conn(0x7f20cc0cca30 msgr2=0x7f20cc0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d1028640 1 --2- 172.21.15.2:0/4142562585 >> v2:172.21.15.90:3300/0 conn(0x7f20cc0cca30 0x7f20cc0cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d1028640 1 -- 172.21.15.2:0/4142562585 >> v1:172.21.15.2:6789/0 conn(0x7f20cc0cd740 legacy=0x7f20cc06b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d1028640 1 -- 172.21.15.2:0/4142562585 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0ca010 con 0x7f20cc159df0 2023-11-04T01:44:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.104+0000 7f20d0827640 1 --2- 172.21.15.2:0/4142562585 >> v2:172.21.15.90:3300/0 conn(0x7f20cc0cca30 0x7f20cc0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d1028640 1 --2- 172.21.15.2:0/4142562585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc159df0 0x7f20cc0cae90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0aec10 tx=0x7f20bc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4911a821a8250fbb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20cbfff640 1 -- 172.21.15.2:0/4142562585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a5910 con 0x7f20cc159df0 2023-11-04T01:44:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20cbfff640 1 -- 172.21.15.2:0/4142562585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0a5a70 con 0x7f20cc159df0 2023-11-04T01:44:15.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20cbfff640 1 -- 172.21.15.2:0/4142562585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a5e00 con 0x7f20cc159df0 2023-11-04T01:44:15.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 -- 172.21.15.2:0/4142562585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc159df0 msgr2=0x7f20cc0cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 --2- 172.21.15.2:0/4142562585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc159df0 0x7f20cc0cae90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0aec10 tx=0x7f20bc01c850 comp rx=0 tx=0).stop 2023-11-04T01:44:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 -- 172.21.15.2:0/4142562585 shutdown_connections 2023-11-04T01:44:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 --2- 172.21.15.2:0/4142562585 >> v2:172.21.15.90:3300/0 conn(0x7f20cc0cca30 0x7f20cc0cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 --2- 172.21.15.2:0/4142562585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc159df0 0x7f20cc0cae90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 -- 172.21.15.2:0/4142562585 >> 172.21.15.2:0/4142562585 conn(0x7f20cc0cbd80 msgr2=0x7f20cc0cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 -- 172.21.15.2:0/4142562585 shutdown_connections 2023-11-04T01:44:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 -- 172.21.15.2:0/4142562585 wait complete. 2023-11-04T01:44:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 Processor -- start 2023-11-04T01:44:15.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.108+0000 7f20d328c640 1 -- start start 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc0cca30 0x7f20cc1f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20cc159df0 0x7f20cc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20cc0b37d0 0x7f20cc155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc06cf80 con 0x7f20cc0cca30 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc14f0d0 con 0x7f20cc159df0 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0b3440 con 0x7f20cc0b37d0 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc0cca30 0x7f20cc1f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc0cca30 0x7f20cc1f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36998/0 (socket says 172.21.15.2:36998) 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 -- 172.21.15.2:0/3141290691 learned_addr learned my addr 172.21.15.2:0/3141290691 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1829640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20cc0b37d0 0x7f20cc155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 -- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20cc0b37d0 msgr2=0x7f20cc155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20cc0b37d0 0x7f20cc155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 -- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20cc159df0 msgr2=0x7f20cc06ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20cc159df0 0x7f20cc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 -- 172.21.15.2:0/3141290691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc009a70 con 0x7f20cc0cca30 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1829640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20cc0b37d0 0x7f20cc155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d1028640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc0cca30 0x7f20cc1f54a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f20bc019460 tx=0x7f20bc0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20c9ffb640 1 -- 172.21.15.2:0/3141290691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0ad850 con 0x7f20cc0cca30 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20c9ffb640 1 -- 172.21.15.2:0/3141290691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0ad9b0 con 0x7f20cc0cca30 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20c9ffb640 1 -- 172.21.15.2:0/3141290691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0add40 con 0x7f20cc0cca30 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc163b00 con 0x7f20cc0cca30 2023-11-04T01:44:15.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc1640c0 con 0x7f20cc0cca30 2023-11-04T01:44:15.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc1642b0 con 0x7f20cc0cca30 2023-11-04T01:44:15.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20c9ffb640 1 -- 172.21.15.2:0/3141290691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20bc0b4050 con 0x7f20cc0cca30 2023-11-04T01:44:15.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20c9ffb640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20ac0664a0 0x7f20ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.112+0000 7f20c9ffb640 1 -- 172.21.15.2:0/3141290691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f20bc11ef60 con 0x7f20cc0cca30 2023-11-04T01:44:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.116+0000 7f20d0827640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20ac0664a0 0x7f20ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:15.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.116+0000 7f20d0827640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20ac0664a0 0x7f20ac068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20c4006f10 tx=0x7f20c4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:15.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.116+0000 7f20c9ffb640 1 -- 172.21.15.2:0/3141290691 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f20bc0ec320 con 0x7f20cc0cca30 2023-11-04T01:44:15.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.276+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20cc0675f0 con 0x7f20cc0cca30 2023-11-04T01:44:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.903+0000 7f20c9ffb640 1 -- 172.21.15.2:0/3141290691 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7f20bc0b20d0 con 0x7f20cc0cca30 2023-11-04T01:44:15.910 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:44:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.911+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20ac0664a0 msgr2=0x7f20ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.911+0000 7f20d328c640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20ac0664a0 0x7f20ac068960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20c4006f10 tx=0x7f20c4008040 comp rx=0 tx=0).stop 2023-11-04T01:44:15.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.911+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc0cca30 msgr2=0x7f20cc1f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:15.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.911+0000 7f20d328c640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc0cca30 0x7f20cc1f54a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f20bc019460 tx=0x7f20bc0195f0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.915+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 shutdown_connections 2023-11-04T01:44:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.915+0000 7f20d328c640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20ac0664a0 0x7f20ac068960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.915+0000 7f20d328c640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20cc0b37d0 0x7f20cc155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.915+0000 7f20d328c640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20cc159df0 0x7f20cc06ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.915+0000 7f20d328c640 1 --2- 172.21.15.2:0/3141290691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20cc0cca30 0x7f20cc1f54a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.915+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 >> 172.21.15.2:0/3141290691 conn(0x7f20cc0cbd80 msgr2=0x7f20cc0ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.919+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 shutdown_connections 2023-11-04T01:44:15.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:15.919+0000 7f20d328c640 1 -- 172.21.15.2:0/3141290691 wait complete. 2023-11-04T01:44:15.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:44:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0be2162640 1 Processor -- start 2023-11-04T01:44:16.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0be2162640 1 -- start start 2023-11-04T01:44:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0be2162640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bdc0cf9c0 0x7f0bdc0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0be2162640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0be2162640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc0cf0e0 con 0x7f0bdc15b170 2023-11-04T01:44:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0be2162640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc15b550 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0be2162640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0cee00 con 0x7f0bdc0b1e00 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdaffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bdc0cf9c0 0x7f0bdc0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdaffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bdc0cf9c0 0x7f0bdc0cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37000/0 (socket says 172.21.15.2:37000) 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdaffd640 1 -- 172.21.15.2:0/3679931389 learned_addr learned my addr 172.21.15.2:0/3679931389 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdbfff640 1 --2- 172.21.15.2:0/3679931389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdaffd640 1 -- 172.21.15.2:0/3679931389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 msgr2=0x7f0bdc0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdaffd640 1 --2- 172.21.15.2:0/3679931389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdaffd640 1 -- 172.21.15.2:0/3679931389 >> v1:172.21.15.90:6789/0 conn(0x7f0bdc15b170 legacy=0x7f0bdc0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:16.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.075+0000 7f0bdaffd640 1 -- 172.21.15.2:0/3679931389 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0b0310 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 --2- 172.21.15.2:0/3679931389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc0cb8e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009870 tx=0x7f0bd001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeee8b96a267efd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bda7fc640 1 -- 172.21.15.2:0/3679931389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00aa5f0 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bda7fc640 1 -- 172.21.15.2:0/3679931389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd00aa750 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bda7fc640 1 -- 172.21.15.2:0/3679931389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00aaae0 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- 172.21.15.2:0/3679931389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 msgr2=0x7f0bdc0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 --2- 172.21.15.2:0/3679931389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc0cb8e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009870 tx=0x7f0bd001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- 172.21.15.2:0/3679931389 shutdown_connections 2023-11-04T01:44:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 --2- 172.21.15.2:0/3679931389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc0cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 --2- 172.21.15.2:0/3679931389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc0cb8e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- 172.21.15.2:0/3679931389 >> 172.21.15.2:0/3679931389 conn(0x7f0bdc0d0cd0 msgr2=0x7f0bdc0d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- 172.21.15.2:0/3679931389 shutdown_connections 2023-11-04T01:44:16.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- 172.21.15.2:0/3679931389 wait complete. 2023-11-04T01:44:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 Processor -- start 2023-11-04T01:44:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- start start 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bdc15b170 0x7f0bdc153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1592f0 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc1510a0 con 0x7f0bdc15b170 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0be2162640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc159710 con 0x7f0bdc0b1e00 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc15a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37004/0 (socket says 172.21.15.2:37004) 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 -- 172.21.15.2:0/1136668705 learned_addr learned my addr 172.21.15.2:0/1136668705 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdbfff640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bdc15b170 0x7f0bdc153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdb7fe640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 -- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 msgr2=0x7f0bdc150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 -- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bdc15b170 msgr2=0x7f0bdc153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bdc15b170 0x7f0bdc153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdaffd640 1 -- 172.21.15.2:0/1136668705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00094d0 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.079+0000 7f0bdb7fe640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bdaffd640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc15a300 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0bd001cd70 tx=0x7f0bd001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1136668705 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b3800 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1136668705 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd00b3980 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc158670 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1136668705 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b3d30 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc158c30 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc159430 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1136668705 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0bd00b2380 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bc3fff640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bc80664a0 0x7f0bc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1136668705 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5739+0+0 (secure 0 0 0) 0x7f0bd00a7070 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bdb7fe640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bc80664a0 0x7f0bc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.083+0000 7f0bdb7fe640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bc80664a0 0x7f0bc8068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b6c40 tx=0x7f0bcc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.087+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1136668705 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0bdc159430 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.247+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0bdc159430 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.915+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1136668705 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0bdc159430 con 0x7f0bdc0cf9c0 2023-11-04T01:44:16.920 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-04T01:44:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bc80664a0 msgr2=0x7f0bc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bc80664a0 0x7f0bc8068960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b6c40 tx=0x7f0bcc009040 comp rx=0 tx=0).stop 2023-11-04T01:44:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 msgr2=0x7f0bdc15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc15a300 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0bd001cd70 tx=0x7f0bd001ad10 comp rx=0 tx=0).stop 2023-11-04T01:44:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 shutdown_connections 2023-11-04T01:44:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bc80664a0 0x7f0bc8068960 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b6c40 tx=0x7f0bcc009040 comp rx=0 tx=0).stop 2023-11-04T01:44:16.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bdc15b170 0x7f0bdc153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bdc0cf9c0 0x7f0bdc15a300 secure :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0bd001cd70 tx=0x7f0bd001ad10 comp rx=0 tx=0).stop 2023-11-04T01:44:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 --2- 172.21.15.2:0/1136668705 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bdc0b1e00 0x7f0bdc150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 >> 172.21.15.2:0/1136668705 conn(0x7f0bdc0d0cd0 msgr2=0x7f0bdc0d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 shutdown_connections 2023-11-04T01:44:16.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:16.919+0000 7f0be2162640 1 -- 172.21.15.2:0/1136668705 wait complete. 2023-11-04T01:44:16.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:44:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.079+0000 7f24da1c6640 1 Processor -- start 2023-11-04T01:44:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.079+0000 7f24da1c6640 1 -- start start 2023-11-04T01:44:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24da1c6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f24d40cf810 0x7f24d40cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24da1c6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d40b5e00 con 0x7f24d415d0b0 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24da1c6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d415d490 con 0x7f24d40d1940 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24da1c6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d40d1520 con 0x7f24d40cf810 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f24d415d0b0 0x7f24d4160bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36900/0 (socket says 172.21.15.2:36900) 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 -- 172.21.15.2:0/3839012892 learned_addr learned my addr 172.21.15.2:0/3839012892 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d2ffd640 1 --2- 172.21.15.2:0/3839012892 >> v2:172.21.15.90:3300/0 conn(0x7f24d40cf810 0x7f24d40cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999418564 0 0) 0x7f24d40b5e00 con 0x7f24d415d0b0 2023-11-04T01:44:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24bc003530 con 0x7f24d415d0b0 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 283165356 0 0) 0x7f24bc003530 con 0x7f24d415d0b0 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 >> v2:172.21.15.90:3300/0 conn(0x7f24d40cf810 msgr2=0x7f24d40cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 --2- 172.21.15.2:0/3839012892 >> v2:172.21.15.90:3300/0 conn(0x7f24d40cf810 0x7f24d40cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 >> v1:172.21.15.90:6789/0 conn(0x7f24d40d1940 legacy=0x7f24d40d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d40b8930 con 0x7f24d415d0b0 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f24c4001680 con 0x7f24d415d0b0 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 >> v1:172.21.15.2:6789/0 conn(0x7f24d415d0b0 legacy=0x7f24d4160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc0047d0 0x7f24bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24bc005190 0x7f24bc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40d1520 con 0x7f24bc003980 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc00c030 con 0x7f24bc005190 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc00c1f0 con 0x7f24bc0047d0 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d3fff640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24bc005190 0x7f24bc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d2ffd640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc0047d0 0x7f24bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 -- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc0047d0 msgr2=0x7f24bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc0047d0 0x7f24bc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 -- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24bc005190 msgr2=0x7f24bc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24bc005190 0x7f24bc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d37fe640 1 -- 172.21.15.2:0/3839012892 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc003530 con 0x7f24bc003980 2023-11-04T01:44:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d3fff640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24bc005190 0x7f24bc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.083+0000 7f24d3fff640 1 -- 172.21.15.2:0/3839012892 reap_dead start 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d37fe640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c1c0 tx=0x7f24c401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2ff58ddc877138 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40a5b00 con 0x7f24bc003980 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c40a5c80 con 0x7f24bc003980 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d27fc640 1 -- 172.21.15.2:0/3839012892 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40058e0 con 0x7f24bc003980 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- 172.21.15.2:0/3839012892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24bc003980 msgr2=0x7f24bc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f24c400c1c0 tx=0x7f24c401cc20 comp rx=0 tx=0).stop 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- 172.21.15.2:0/3839012892 shutdown_connections 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 --2- 172.21.15.2:0/3839012892 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24bc003980 0x7f24bc003da0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- 172.21.15.2:0/3839012892 >> 172.21.15.2:0/3839012892 conn(0x7f24d406a890 msgr2=0x7f24d406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- 172.21.15.2:0/3839012892 shutdown_connections 2023-11-04T01:44:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- 172.21.15.2:0/3839012892 wait complete. 2023-11-04T01:44:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 Processor -- start 2023-11-04T01:44:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- start start 2023-11-04T01:44:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc003980 0x7f24d415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24d40b4400 0x7f24d40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d41f98e0 0x7f24d41f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d415e000 con 0x7f24d41f98e0 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d415e2e0 con 0x7f24d40b4400 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24da1c6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d415e5c0 con 0x7f24bc003980 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d41f98e0 0x7f24d41f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d41f98e0 0x7f24d41f9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37034/0 (socket says 172.21.15.2:37034) 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d3fff640 1 -- 172.21.15.2:0/2147704303 learned_addr learned my addr 172.21.15.2:0/2147704303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.087+0000 7f24d2ffd640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24d40b4400 0x7f24d40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d37fe640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc003980 0x7f24d415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d3fff640 1 -- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc003980 msgr2=0x7f24d415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d3fff640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc003980 0x7f24d415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d3fff640 1 -- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24d40b4400 msgr2=0x7f24d40b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d3fff640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24d40b4400 0x7f24d40b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d3fff640 1 -- 172.21.15.2:0/2147704303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d415e8a0 con 0x7f24d41f98e0 2023-11-04T01:44:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d37fe640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc003980 0x7f24d415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d3fff640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d41f98e0 0x7f24d41f9d50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f24d4072390 tx=0x7f24cc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24bbfff640 1 -- 172.21.15.2:0/2147704303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc00eed0 con 0x7f24d41f98e0 2023-11-04T01:44:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24bbfff640 1 -- 172.21.15.2:0/2147704303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc003980 con 0x7f24d41f98e0 2023-11-04T01:44:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24bbfff640 1 -- 172.21.15.2:0/2147704303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc003d10 con 0x7f24d41f98e0 2023-11-04T01:44:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d415eb80 con 0x7f24d41f98e0 2023-11-04T01:44:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d415ddc0 con 0x7f24d41f98e0 2023-11-04T01:44:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d40d0e20 con 0x7f24d41f98e0 2023-11-04T01:44:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24bbfff640 1 -- 172.21.15.2:0/2147704303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f24cc0050d0 con 0x7f24d41f98e0 2023-11-04T01:44:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24bbfff640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24c00664d0 0x7f24c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24bbfff640 1 -- 172.21.15.2:0/2147704303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f24cc0836f0 con 0x7f24d41f98e0 2023-11-04T01:44:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.091+0000 7f24d37fe640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24c00664d0 0x7f24c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.095+0000 7f24d37fe640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24c00664d0 0x7f24c0068990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24c40ab000 tx=0x7f24c4006040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.095+0000 7f24bbfff640 1 -- 172.21.15.2:0/2147704303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24cc050d10 con 0x7f24d41f98e0 2023-11-04T01:44:17.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.255+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f24d415ddc0 con 0x7f24d41f98e0 2023-11-04T01:44:17.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.259+0000 7f24bbfff640 1 -- 172.21.15.2:0/2147704303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f24d415ddc0 con 0x7f24d41f98e0 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24c00664d0 msgr2=0x7f24c0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24c00664d0 0x7f24c0068990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f24c40ab000 tx=0x7f24c4006040 comp rx=0 tx=0).stop 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d41f98e0 msgr2=0x7f24d41f9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d41f98e0 0x7f24d41f9d50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f24d4072390 tx=0x7f24cc00eb90 comp rx=0 tx=0).stop 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 shutdown_connections 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24c00664d0 0x7f24c0068990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d41f98e0 0x7f24d41f9d50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24d40b4400 0x7f24d40b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 --2- 172.21.15.2:0/2147704303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f24bc003980 0x7f24d415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 >> 172.21.15.2:0/2147704303 conn(0x7f24d406a890 msgr2=0x7f24d40b6020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 shutdown_connections 2023-11-04T01:44:17.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.263+0000 7f24da1c6640 1 -- 172.21.15.2:0/2147704303 wait complete. 2023-11-04T01:44:17.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools' 2023-11-04T01:44:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f4a43f640 1 Processor -- start 2023-11-04T01:44:17.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f4a43f640 1 -- start start 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f4a43f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f440715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f4a43f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f440b0d40 0x7f9f4415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f4a43f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440c2670 con 0x7f9f4406f8f0 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f4a43f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f44070140 con 0x7f9f440b0d40 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f4a43f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4406c9f0 con 0x7f9f4415afd0 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f489dc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f440b0d40 0x7f9f4415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f489dc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f440b0d40 0x7f9f4415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37044/0 (socket says 172.21.15.2:37044) 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f489dc640 1 -- 172.21.15.2:0/2947549036 learned_addr learned my addr 172.21.15.2:0/2947549036 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f43fff640 1 --2- 172.21.15.2:0/2947549036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f440715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f489dc640 1 -- 172.21.15.2:0/2947549036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 msgr2=0x7f9f440715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f489dc640 1 --2- 172.21.15.2:0/2947549036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f440715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f489dc640 1 -- 172.21.15.2:0/2947549036 >> v1:172.21.15.90:6789/0 conn(0x7f9f4406f8f0 legacy=0x7f9f440b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:17.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.395+0000 7f9f489dc640 1 -- 172.21.15.2:0/2947549036 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4406bc30 con 0x7f9f440b0d40 2023-11-04T01:44:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f489dc640 1 --2- 172.21.15.2:0/2947549036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f440b0d40 0x7f9f4415ec80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9f340098a0 tx=0x7f9f3401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f238d199185690 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f42ffd640 1 -- 172.21.15.2:0/2947549036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340ab670 con 0x7f9f440b0d40 2023-11-04T01:44:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f42ffd640 1 -- 172.21.15.2:0/2947549036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f340ab7d0 con 0x7f9f440b0d40 2023-11-04T01:44:17.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f42ffd640 1 -- 172.21.15.2:0/2947549036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340abb60 con 0x7f9f440b0d40 2023-11-04T01:44:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 -- 172.21.15.2:0/2947549036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f440b0d40 msgr2=0x7f9f4415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/2947549036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f440b0d40 0x7f9f4415ec80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9f340098a0 tx=0x7f9f3401c4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 -- 172.21.15.2:0/2947549036 shutdown_connections 2023-11-04T01:44:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/2947549036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f440b0d40 0x7f9f4415ec80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/2947549036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f440715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 -- 172.21.15.2:0/2947549036 >> 172.21.15.2:0/2947549036 conn(0x7f9f440cebb0 msgr2=0x7f9f440cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 -- 172.21.15.2:0/2947549036 shutdown_connections 2023-11-04T01:44:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.399+0000 7f9f4a43f640 1 -- 172.21.15.2:0/2947549036 wait complete. 2023-11-04T01:44:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 Processor -- start 2023-11-04T01:44:17.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 -- start start 2023-11-04T01:44:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4406f8f0 0x7f9f441405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f440b0d40 0x7f9f440c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f44151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440c24c0 con 0x7f9f4406f8f0 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44151fd0 con 0x7f9f440b0d40 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44152db0 con 0x7f9f4415afd0 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4406f8f0 0x7f9f441405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4406f8f0 0x7f9f441405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37060/0 (socket says 172.21.15.2:37060) 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 -- 172.21.15.2:0/1499716170 learned_addr learned my addr 172.21.15.2:0/1499716170 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f489dc640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f44151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f437fe640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f440b0d40 0x7f9f440c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 -- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 msgr2=0x7f9f44151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f44151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 -- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f440b0d40 msgr2=0x7f9f440c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f440b0d40 0x7f9f440c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 -- 172.21.15.2:0/1499716170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f340094d0 con 0x7f9f4406f8f0 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f437fe640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f440b0d40 0x7f9f440c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f43fff640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4406f8f0 0x7f9f441405b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c007e40 tx=0x7f9f3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f40ff9640 1 -- 172.21.15.2:0/1499716170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c014620 con 0x7f9f4406f8f0 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f40ff9640 1 -- 172.21.15.2:0/1499716170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00ee90 con 0x7f9f4406f8f0 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f44152230 con 0x7f9f4406f8f0 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f40ff9640 1 -- 172.21.15.2:0/1499716170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0149c0 con 0x7f9f4406f8f0 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f441527f0 con 0x7f9f4406f8f0 2023-11-04T01:44:17.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f440744a0 con 0x7f9f4406f8f0 2023-11-04T01:44:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.403+0000 7f9f40ff9640 1 -- 172.21.15.2:0/1499716170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f3c014b20 con 0x7f9f4406f8f0 2023-11-04T01:44:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.407+0000 7f9f40ff9640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f240664d0 0x7f9f24068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.407+0000 7f9f40ff9640 1 -- 172.21.15.2:0/1499716170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9f3c085400 con 0x7f9f4406f8f0 2023-11-04T01:44:17.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.407+0000 7f9f437fe640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f240664d0 0x7f9f24068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:17.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.407+0000 7f9f437fe640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f240664d0 0x7f9f24068990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b4330 tx=0x7f9f2c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:17.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.407+0000 7f9f40ff9640 1 -- 172.21.15.2:0/1499716170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f3c052b20 con 0x7f9f4406f8f0 2023-11-04T01:44:17.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.623+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]} v 0) v1 -- 0x7f9f4406cba0 con 0x7f9f4406f8f0 2023-11-04T01:44:17.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.915+0000 7f9f40ff9640 1 -- 172.21.15.2:0/1499716170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_disallow_monitor_managed_snaps_for_fs_pools"]}]=0 v127) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9f3c056140 con 0x7f9f4406f8f0 2023-11-04T01:44:17.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f240664d0 msgr2=0x7f9f24068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f240664d0 0x7f9f24068990 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b4330 tx=0x7f9f2c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4406f8f0 msgr2=0x7f9f441405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4406f8f0 0x7f9f441405b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c007e40 tx=0x7f9f3c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 shutdown_connections 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f240664d0 0x7f9f24068990 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9f4415afd0 0x7f9f44151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f440b0d40 0x7f9f440c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 --2- 172.21.15.2:0/1499716170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f4406f8f0 0x7f9f441405b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 >> 172.21.15.2:0/1499716170 conn(0x7f9f440cebb0 msgr2=0x7f9f440cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:17.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 shutdown_connections 2023-11-04T01:44:17.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:17.923+0000 7f9f4a43f640 1 -- 172.21.15.2:0/1499716170 wait complete. 2023-11-04T01:44:17.953 INFO:tasks.cephfs_test_runner:Test that creation of monitor managed snaps fails for pools attached ... ok 2023-11-04T01:44:17.953 INFO:tasks.cephfs_test_runner:Starting test: test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) Test that using a pool with snaps for fs creation fails 2023-11-04T01:44:17.953 INFO:tasks.cephfs_test_runner:test_using_pool_with_snap_fails_fs_creation (tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools) 2023-11-04T01:44:17.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:18.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.075+0000 7fc6323da640 1 Processor -- start 2023-11-04T01:44:18.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc6323da640 1 -- start start 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc6323da640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc62c0b4990 0x7fc62c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc6323da640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c0b6070 con 0x7fc62c0b74f0 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc6323da640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c0b8ed0 con 0x7fc62c0d0690 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc6323da640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c0ce590 con 0x7fc62c0b4990 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc62c0b74f0 0x7fc62c0cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36914/0 (socket says 172.21.15.2:36914) 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 -- 172.21.15.2:0/3586410422 learned_addr learned my addr 172.21.15.2:0/3586410422 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62bfff640 1 --2- 172.21.15.2:0/3586410422 >> v2:172.21.15.90:3300/0 conn(0x7fc62c0b4990 0x7fc62c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915326097 0 0) 0x7fc62c0b6070 con 0x7fc62c0b74f0 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc618003530 con 0x7fc62c0b74f0 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587964057 0 0) 0x7fc618003530 con 0x7fc62c0b74f0 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 >> v2:172.21.15.90:3300/0 conn(0x7fc62c0b4990 msgr2=0x7fc62c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 --2- 172.21.15.2:0/3586410422 >> v2:172.21.15.90:3300/0 conn(0x7fc62c0b4990 0x7fc62c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 >> v1:172.21.15.90:6789/0 conn(0x7fc62c0d0690 legacy=0x7fc62c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0b52b0 con 0x7fc62c0b74f0 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc624001680 con 0x7fc62c0b74f0 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 >> v1:172.21.15.2:6789/0 conn(0x7fc62c0b74f0 legacy=0x7fc62c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618003980 0x7fc618003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6180047d0 0x7fc618004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc618005190 0x7fc61800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0ce590 con 0x7fc618005190 2023-11-04T01:44:18.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61800c040 con 0x7fc618003980 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61800c200 con 0x7fc6180047d0 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc618005190 0x7fc61800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62bfff640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618003980 0x7fc618003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc62b7fe640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6180047d0 0x7fc618004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 -- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6180047d0 msgr2=0x7fc618004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc6180047d0 0x7fc618004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 -- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618003980 msgr2=0x7fc618003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618003980 0x7fc618003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.079+0000 7fc630977640 1 -- 172.21.15.2:0/3586410422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc618003530 con 0x7fc618005190 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc630977640 1 -- 172.21.15.2:0/3586410422 reap_dead start 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc630977640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc618005190 0x7fc61800b990 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc62400c210 tx=0x7fc62401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5cab785288ed30 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240a5b20 con 0x7fc618005190 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6240a5ca0 con 0x7fc618005190 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc62affd640 1 -- 172.21.15.2:0/3586410422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624005b20 con 0x7fc618005190 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- 172.21.15.2:0/3586410422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc618005190 msgr2=0x7fc61800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc618005190 0x7fc61800b990 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc62400c210 tx=0x7fc62401cc20 comp rx=0 tx=0).stop 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- 172.21.15.2:0/3586410422 shutdown_connections 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 --2- 172.21.15.2:0/3586410422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc618005190 0x7fc61800b990 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- 172.21.15.2:0/3586410422 >> 172.21.15.2:0/3586410422 conn(0x7fc62c0cf990 msgr2=0x7fc62c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- 172.21.15.2:0/3586410422 shutdown_connections 2023-11-04T01:44:18.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- 172.21.15.2:0/3586410422 wait complete. 2023-11-04T01:44:18.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 Processor -- start 2023-11-04T01:44:18.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- start start 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618005190 0x7fc62c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc62c1594b0 0x7fc62c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc62c0cac20 0x7fc62c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0ca520 con 0x7fc62c1594b0 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0cb610 con 0x7fc618005190 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc6323da640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c15d9c0 con 0x7fc62c0cac20 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc62b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc62c1594b0 0x7fc62c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc62b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc62c1594b0 0x7fc62c14d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37068/0 (socket says 172.21.15.2:37068) 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc62b7fe640 1 -- 172.21.15.2:0/4043458012 learned_addr learned my addr 172.21.15.2:0/4043458012 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:18.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc630977640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc62c0cac20 0x7fc62c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.083+0000 7fc62bfff640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618005190 0x7fc62c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62b7fe640 1 -- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc62c0cac20 msgr2=0x7fc62c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62b7fe640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc62c0cac20 0x7fc62c0cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62b7fe640 1 -- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618005190 msgr2=0x7fc62c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62b7fe640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618005190 0x7fc62c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62b7fe640 1 -- 172.21.15.2:0/4043458012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c15a310 con 0x7fc62c1594b0 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62bfff640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618005190 0x7fc62c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62b7fe640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc62c1594b0 0x7fc62c14d210 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00d840 tx=0x7fc61c00dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc628ff9640 1 -- 172.21.15.2:0/4043458012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c003db0 con 0x7fc62c1594b0 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc628ff9640 1 -- 172.21.15.2:0/4043458012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00b6b0 con 0x7fc62c1594b0 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc628ff9640 1 -- 172.21.15.2:0/4043458012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00ba20 con 0x7fc62c1594b0 2023-11-04T01:44:18.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c15a5f0 con 0x7fc62c1594b0 2023-11-04T01:44:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c15d650 con 0x7fc62c1594b0 2023-11-04T01:44:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c15ab10 con 0x7fc62c1594b0 2023-11-04T01:44:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc628ff9640 1 -- 172.21.15.2:0/4043458012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc61c00bb80 con 0x7fc62c1594b0 2023-11-04T01:44:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc628ff9640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc60c0664d0 0x7fc60c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc628ff9640 1 -- 172.21.15.2:0/4043458012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc61c083ef0 con 0x7fc62c1594b0 2023-11-04T01:44:18.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62bfff640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc60c0664d0 0x7fc60c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.087+0000 7fc62bfff640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc60c0664d0 0x7fc60c068990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6140099a0 tx=0x7fc614008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.091+0000 7fc628ff9640 1 -- 172.21.15.2:0/4043458012 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc61c051480 con 0x7fc62c1594b0 2023-11-04T01:44:18.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.247+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc62c0744a0 con 0x7fc62c1594b0 2023-11-04T01:44:18.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc628ff9640 1 -- 172.21.15.2:0/4043458012 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+14625 (secure 0 0 0) 0x7fc61c054aa0 con 0x7fc62c1594b0 2023-11-04T01:44:18.257 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:18.257 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":55,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:16.909529+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6834/1138444248":"2023-11-05T01:44:13.899573+0000","172.21.15.2:6832/1138444248":"2023-11-05T01:44:13.899573+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc60c0664d0 msgr2=0x7fc60c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc60c0664d0 0x7fc60c068990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6140099a0 tx=0x7fc614008040 comp rx=0 tx=0).stop 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc62c1594b0 msgr2=0x7fc62c14d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc62c1594b0 0x7fc62c14d210 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00d840 tx=0x7fc61c00dd00 comp rx=0 tx=0).stop 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 shutdown_connections 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc60c0664d0 0x7fc60c068990 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc62c0cac20 0x7fc62c0cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc62c1594b0 0x7fc62c14d210 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 --2- 172.21.15.2:0/4043458012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc618005190 0x7fc62c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 >> 172.21.15.2:0/4043458012 conn(0x7fc62c0cf990 msgr2=0x7fc62c0b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 shutdown_connections 2023-11-04T01:44:18.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.251+0000 7fc6323da640 1 -- 172.21.15.2:0/4043458012 wait complete. 2023-11-04T01:44:18.276 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:18.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.395+0000 7f28ca8fb640 1 Processor -- start 2023-11-04T01:44:18.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.395+0000 7f28ca8fb640 1 -- start start 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28ca8fb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f28c406d160 0x7f28c415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28ca8fb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c406c0c0 con 0x7f28c415af70 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28ca8fb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c406c3a0 con 0x7f28c40ce1b0 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28ca8fb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c4071200 con 0x7f28c406d160 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c3fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f28c415af70 0x7f28c40cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36916/0 (socket says 172.21.15.2:36916) 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c3fff640 1 -- 172.21.15.2:0/1465954421 learned_addr learned my addr 172.21.15.2:0/1465954421 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c8e98640 1 --2- 172.21.15.2:0/1465954421 >> v2:172.21.15.90:3300/0 conn(0x7f28c406d160 0x7f28c415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158655090 0 0) 0x7f28c406c0c0 con 0x7f28c415af70 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b0003530 con 0x7f28c415af70 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 873300555 0 0) 0x7f28b0003530 con 0x7f28c415af70 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 >> v2:172.21.15.90:3300/0 conn(0x7f28c406d160 msgr2=0x7f28c415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 --2- 172.21.15.2:0/1465954421 >> v2:172.21.15.90:3300/0 conn(0x7f28c406d160 0x7f28c415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 >> v1:172.21.15.90:6789/0 conn(0x7f28c40ce1b0 legacy=0x7f28c415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c406c680 con 0x7f28c415af70 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f28bc001a20 con 0x7f28c415af70 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 >> v1:172.21.15.2:6789/0 conn(0x7f28c415af70 legacy=0x7f28c40cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28b0003980 0x7f28b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28b00047d0 0x7f28b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4071200 con 0x7f28b0005190 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b000c030 con 0x7f28b0003980 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b000c1f0 con 0x7f28b00047d0 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c8e98640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c3fff640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28b0003980 0x7f28b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c37fe640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28b00047d0 0x7f28b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c8e98640 1 -- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28b00047d0 msgr2=0x7f28b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c8e98640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28b00047d0 0x7f28b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c8e98640 1 -- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28b0003980 msgr2=0x7f28b0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c8e98640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28b0003980 0x7f28b0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c8e98640 1 -- 172.21.15.2:0/1465954421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0003530 con 0x7f28b0005190 2023-11-04T01:44:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.399+0000 7f28c3fff640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28b0003980 0x7f28b0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c8e98640 1 -- 172.21.15.2:0/1465954421 reap_dead start 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c8e98640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28b000b990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009ae0 tx=0x7f28b401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108a6421193e2728 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4004020 con 0x7f28b0005190 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b40041c0 con 0x7f28b0005190 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c2ffd640 1 -- 172.21.15.2:0/1465954421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40a5680 con 0x7f28b0005190 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- 172.21.15.2:0/1465954421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 msgr2=0x7f28b000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28b000b990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f28b4009ae0 tx=0x7f28b401ca90 comp rx=0 tx=0).stop 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- 172.21.15.2:0/1465954421 shutdown_connections 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/1465954421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28b000b990 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- 172.21.15.2:0/1465954421 >> 172.21.15.2:0/1465954421 conn(0x7f28c40cb510 msgr2=0x7f28c40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- 172.21.15.2:0/1465954421 shutdown_connections 2023-11-04T01:44:18.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- 172.21.15.2:0/1465954421 wait complete. 2023-11-04T01:44:18.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 Processor -- start 2023-11-04T01:44:18.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- start start 2023-11-04T01:44:18.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28c414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28c41520b0 0x7f28c40b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28c40b3060 0x7f28c40c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c414f5f0 con 0x7f28b0005190 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40b2690 con 0x7f28c41520b0 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28ca8fb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40b1a80 con 0x7f28c40b3060 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28c414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28c414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37088/0 (socket says 172.21.15.2:37088) 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28c41520b0 0x7f28c40b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.403+0000 7f28c3fff640 1 -- 172.21.15.2:0/2724852990 learned_addr learned my addr 172.21.15.2:0/2724852990 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c8e98640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28c40b3060 0x7f28c40c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c3fff640 1 -- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28c40b3060 msgr2=0x7f28c40c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c3fff640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28c40b3060 0x7f28c40c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c3fff640 1 -- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28c41520b0 msgr2=0x7f28c40b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c3fff640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28c41520b0 0x7f28c40b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c3fff640 1 -- 172.21.15.2:0/2724852990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40b1d60 con 0x7f28b0005190 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c3fff640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28c414f0b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f28bc007a40 tx=0x7f28bc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c0ff9640 1 -- 172.21.15.2:0/2724852990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00edf0 con 0x7f28b0005190 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c0ff9640 1 -- 172.21.15.2:0/2724852990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc013420 con 0x7f28b0005190 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c40b2040 con 0x7f28b0005190 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c0ff9640 1 -- 172.21.15.2:0/2724852990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0137b0 con 0x7f28b0005190 2023-11-04T01:44:18.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c4151440 con 0x7f28b0005190 2023-11-04T01:44:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c40c8dc0 con 0x7f28b0005190 2023-11-04T01:44:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c0ff9640 1 -- 172.21.15.2:0/2724852990 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f28bc013910 con 0x7f28b0005190 2023-11-04T01:44:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c0ff9640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28a40664a0 0x7f28a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c0ff9640 1 -- 172.21.15.2:0/2724852990 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f28bc0841f0 con 0x7f28b0005190 2023-11-04T01:44:18.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c37fe640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28a40664a0 0x7f28a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.407+0000 7f28c37fe640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28a40664a0 0x7f28a4068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f28c40b0720 tx=0x7f28ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.411+0000 7f28c0ff9640 1 -- 172.21.15.2:0/2724852990 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f28bc051950 con 0x7f28b0005190 2023-11-04T01:44:18.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.563+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28c40744a0 con 0x7f28b0005190 2023-11-04T01:44:18.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28c0ff9640 1 -- 172.21.15.2:0/2724852990 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28bc054f70 con 0x7f28b0005190 2023-11-04T01:44:18.572 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:44:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28a40664a0 msgr2=0x7f28a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28a40664a0 0x7f28a4068960 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f28c40b0720 tx=0x7f28ac009040 comp rx=0 tx=0).stop 2023-11-04T01:44:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 msgr2=0x7f28c414f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28c414f0b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f28bc007a40 tx=0x7f28bc00e530 comp rx=0 tx=0).stop 2023-11-04T01:44:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 shutdown_connections 2023-11-04T01:44:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f28a40664a0 0x7f28a4068960 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f28c40b3060 0x7f28c40c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28c41520b0 0x7f28c40b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 --2- 172.21.15.2:0/2724852990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f28b0005190 0x7f28c414f0b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 >> 172.21.15.2:0/2724852990 conn(0x7f28c40cb510 msgr2=0x7f28c4158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 shutdown_connections 2023-11-04T01:44:18.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.567+0000 7f28ca8fb640 1 -- 172.21.15.2:0/2724852990 wait complete. 2023-11-04T01:44:18.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5c20c5640 1 Processor -- start 2023-11-04T01:44:18.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5c20c5640 1 -- start start 2023-11-04T01:44:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5c20c5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5bc15acb0 0x7fc5bc15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5c20c5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5c20c5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5bc0cb130 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5c20c5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5bc15bd40 con 0x7fc5bc15acb0 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5c20c5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc06fd80 con 0x7fc5bc15c160 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5bb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5bc15acb0 0x7fc5bc15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5bb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5bc15acb0 0x7fc5bc15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37094/0 (socket says 172.21.15.2:37094) 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4084241121 learned_addr learned my addr 172.21.15.2:0/4084241121 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5baffd640 1 --2- 172.21.15.2:0/4084241121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4084241121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 msgr2=0x7fc5bc0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5bb7fe640 1 --2- 172.21.15.2:0/4084241121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4084241121 >> v1:172.21.15.90:6789/0 conn(0x7fc5bc0b0a50 legacy=0x7fc5bc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4084241121 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc15b680 con 0x7fc5bc15acb0 2023-11-04T01:44:18.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.711+0000 7fc5baffd640 1 --2- 172.21.15.2:0/4084241121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:18.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 --2- 172.21.15.2:0/4084241121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc15b090 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009870 tx=0x7fc5b001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80758cf7c91fb55a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5ba7fc640 1 -- 172.21.15.2:0/4084241121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00ac630 con 0x7fc5bc15acb0 2023-11-04T01:44:18.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5ba7fc640 1 -- 172.21.15.2:0/4084241121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b00ac790 con 0x7fc5bc15acb0 2023-11-04T01:44:18.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5ba7fc640 1 -- 172.21.15.2:0/4084241121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00acb20 con 0x7fc5bc15acb0 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4084241121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc15acb0 msgr2=0x7fc5bc15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4084241121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc15b090 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009870 tx=0x7fc5b001c500 comp rx=0 tx=0).stop 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4084241121 shutdown_connections 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4084241121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4084241121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc15b090 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4084241121 >> 172.21.15.2:0/4084241121 conn(0x7fc5bc0cb510 msgr2=0x7fc5bc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4084241121 shutdown_connections 2023-11-04T01:44:18.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4084241121 wait complete. 2023-11-04T01:44:18.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 Processor -- start 2023-11-04T01:44:18.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- start start 2023-11-04T01:44:18.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc0b0a50 0x7fc5bc06b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc1535b0 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc06b8e0 con 0x7fc5bc15acb0 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5c20c5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5bc06bbc0 con 0x7fc5bc15c160 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc0b0a50 0x7fc5bc06b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc0b0a50 0x7fc5bc06b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37106/0 (socket says 172.21.15.2:37106) 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4007572643 learned_addr learned my addr 172.21.15.2:0/4007572643 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5baffd640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bbfff640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 msgr2=0x7fc5bc153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5bc15acb0 msgr2=0x7fc5bc0c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc0c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5bb7fe640 1 -- 172.21.15.2:0/4007572643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00094d0 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.715+0000 7fc5baffd640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5bb7fe640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc0b0a50 0x7fc5bc06b300 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00af040 tx=0x7fc5b001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5a3fff640 1 -- 172.21.15.2:0/4007572643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00ab8e0 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5a3fff640 1 -- 172.21.15.2:0/4007572643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b00aba60 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5bc06bea0 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5a3fff640 1 -- 172.21.15.2:0/4007572643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00abe10 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5bc06c460 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5bc0744a0 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5a3fff640 1 -- 172.21.15.2:0/4007572643 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5b00b3040 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5a3fff640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5a80664a0 0x7fc5a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:18.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5a3fff640 1 -- 172.21.15.2:0/4007572643 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc5b011e8b0 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5baffd640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5a80664a0 0x7fc5a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:18.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.719+0000 7fc5baffd640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5a80664a0 0x7fc5a8068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc15ef60 tx=0x7fc5ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:18.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.723+0000 7fc5a3fff640 1 -- 172.21.15.2:0/4007572643 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc5b00ebf60 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.883+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fc5bc0cde30 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.883+0000 7fc5a3fff640 1 -- 172.21.15.2:0/4007572643 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v55) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5b00c50a0 con 0x7fc5bc0b0a50 2023-11-04T01:44:18.890 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5a80664a0 msgr2=0x7fc5a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5a80664a0 0x7fc5a8068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc15ef60 tx=0x7fc5ac008040 comp rx=0 tx=0).stop 2023-11-04T01:44:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc0b0a50 msgr2=0x7fc5bc06b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc0b0a50 0x7fc5bc06b300 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00af040 tx=0x7fc5b001ad40 comp rx=0 tx=0).stop 2023-11-04T01:44:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 shutdown_connections 2023-11-04T01:44:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5a80664a0 0x7fc5a8068960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5bc15c160 0x7fc5bc153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5bc15acb0 0x7fc5bc0c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 --2- 172.21.15.2:0/4007572643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5bc0b0a50 0x7fc5bc06b300 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 >> 172.21.15.2:0/4007572643 conn(0x7fc5bc0cb510 msgr2=0x7fc5bc0ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 shutdown_connections 2023-11-04T01:44:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:18.887+0000 7fc5c20c5640 1 -- 172.21.15.2:0/4007572643 wait complete. 2023-11-04T01:44:18.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:44:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e36143640 1 Processor -- start 2023-11-04T01:44:19.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e36143640 1 -- start start 2023-11-04T01:44:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e36143640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e300b0630 0x7f0e300b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e36143640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0e3015dc50 0x7f0e3015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e36143640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300b0fd0 con 0x7f0e30159fc0 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e36143640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e300ca030 con 0x7f0e3015dc50 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e36143640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3015e5e0 con 0x7f0e300b0630 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0e30159fc0 0x7f0e300ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36928/0 (socket says 172.21.15.2:36928) 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2f7fe640 1 -- 172.21.15.2:0/1935298252 learned_addr learned my addr 172.21.15.2:0/1935298252 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2ffff640 1 --2- 172.21.15.2:0/1935298252 >> v2:172.21.15.2:3300/0 conn(0x7f0e3015dc50 0x7f0e3015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e26ffd640 1 --2- 172.21.15.2:0/1935298252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e300b0630 0x7f0e300b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2effd640 1 -- 172.21.15.2:0/1935298252 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822993412 0 0) 0x7f0e300b0fd0 con 0x7f0e30159fc0 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2effd640 1 -- 172.21.15.2:0/1935298252 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e1c003530 con 0x7f0e30159fc0 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2ffff640 1 -- 172.21.15.2:0/1935298252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e300b0630 msgr2=0x7f0e300b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2ffff640 1 --2- 172.21.15.2:0/1935298252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e300b0630 0x7f0e300b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2ffff640 1 -- 172.21.15.2:0/1935298252 >> v1:172.21.15.2:6789/0 conn(0x7f0e30159fc0 legacy=0x7f0e300ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.023+0000 7f0e2ffff640 1 -- 172.21.15.2:0/1935298252 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3006cfd0 con 0x7f0e3015dc50 2023-11-04T01:44:19.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e2ffff640 1 --2- 172.21.15.2:0/1935298252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e3015e0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e2801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b826851ef14de0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e2effd640 1 -- 172.21.15.2:0/1935298252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280a59e0 con 0x7f0e3015dc50 2023-11-04T01:44:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e2effd640 1 -- 172.21.15.2:0/1935298252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280a5b40 con 0x7f0e3015dc50 2023-11-04T01:44:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e2effd640 1 -- 172.21.15.2:0/1935298252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280ad440 con 0x7f0e3015dc50 2023-11-04T01:44:19.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 -- 172.21.15.2:0/1935298252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 msgr2=0x7f0e3015e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 --2- 172.21.15.2:0/1935298252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e3015e0a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e2801c920 comp rx=0 tx=0).stop 2023-11-04T01:44:19.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 -- 172.21.15.2:0/1935298252 shutdown_connections 2023-11-04T01:44:19.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 --2- 172.21.15.2:0/1935298252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e3015e0a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 --2- 172.21.15.2:0/1935298252 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e300b0630 0x7f0e300b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 -- 172.21.15.2:0/1935298252 >> 172.21.15.2:0/1935298252 conn(0x7f0e300cebb0 msgr2=0x7f0e300cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:19.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 -- 172.21.15.2:0/1935298252 shutdown_connections 2023-11-04T01:44:19.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 -- 172.21.15.2:0/1935298252 wait complete. 2023-11-04T01:44:19.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 Processor -- start 2023-11-04T01:44:19.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 -- start start 2023-11-04T01:44:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e300b0630 0x7f0e30158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e30159fc0 0x7f0e301494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.027+0000 7f0e36143640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e300cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e36143640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3015cfd0 con 0x7f0e3015dc50 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e36143640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3015c6a0 con 0x7f0e300b0630 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e36143640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3015c980 con 0x7f0e30159fc0 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e300cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e300cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37132/0 (socket says 172.21.15.2:37132) 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 -- 172.21.15.2:0/1433381121 learned_addr learned my addr 172.21.15.2:0/1433381121 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2f7fe640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e300b0630 0x7f0e30158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e26ffd640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e30159fc0 0x7f0e301494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 -- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e30159fc0 msgr2=0x7f0e301494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e30159fc0 0x7f0e301494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 -- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e300b0630 msgr2=0x7f0e30158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e300b0630 0x7f0e30158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 -- 172.21.15.2:0/1433381121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28009a70 con 0x7f0e3015dc50 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e26ffd640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e30159fc0 0x7f0e301494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2f7fe640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e300b0630 0x7f0e30158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2ffff640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e300cb5c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0e280b0040 tx=0x7f0e280196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2cff9640 1 -- 172.21.15.2:0/1433381121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280add90 con 0x7f0e3015dc50 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2cff9640 1 -- 172.21.15.2:0/1433381121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28009450 con 0x7f0e3015dc50 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3015cc60 con 0x7f0e3015dc50 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2cff9640 1 -- 172.21.15.2:0/1433381121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b9690 con 0x7f0e3015dc50 2023-11-04T01:44:19.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3014a210 con 0x7f0e3015dc50 2023-11-04T01:44:19.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3015d140 con 0x7f0e3015dc50 2023-11-04T01:44:19.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2cff9640 1 -- 172.21.15.2:0/1433381121 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e280b97f0 con 0x7f0e3015dc50 2023-11-04T01:44:19.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2cff9640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e100664d0 0x7f0e10068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:19.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2cff9640 1 -- 172.21.15.2:0/1433381121 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0e2811f050 con 0x7f0e3015dc50 2023-11-04T01:44:19.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.031+0000 7f0e2f7fe640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e100664d0 0x7f0e10068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:19.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.035+0000 7f0e2f7fe640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e100664d0 0x7f0e10068990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0e200011f0 tx=0x7f0e20009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:19.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.035+0000 7f0e2cff9640 1 -- 172.21.15.2:0/1433381121 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e280ec670 con 0x7f0e3015dc50 2023-11-04T01:44:19.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.251+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f0e300744a0 con 0x7f0e3015dc50 2023-11-04T01:44:19.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.927+0000 7f0e2cff9640 1 -- 172.21.15.2:0/1433381121 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v129) v1 ==== 176+0+0 (secure 0 0 0) 0x7f0e280efc90 con 0x7f0e3015dc50 2023-11-04T01:44:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e100664d0 msgr2=0x7f0e10068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e100664d0 0x7f0e10068990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0e200011f0 tx=0x7f0e20009040 comp rx=0 tx=0).stop 2023-11-04T01:44:19.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 msgr2=0x7f0e300cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e300cb5c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0e280b0040 tx=0x7f0e280196c0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 shutdown_connections 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e100664d0 0x7f0e10068990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e3015dc50 0x7f0e300cb5c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e30159fc0 0x7f0e301494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 --2- 172.21.15.2:0/1433381121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e300b0630 0x7f0e30158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 >> 172.21.15.2:0/1433381121 conn(0x7f0e300cebb0 msgr2=0x7f0e300c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 shutdown_connections 2023-11-04T01:44:19.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:19.931+0000 7f0e36143640 1 -- 172.21.15.2:0/1433381121 wait complete. 2023-11-04T01:44:19.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:44:20.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.087+0000 7fed4d138640 1 Processor -- start 2023-11-04T01:44:20.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.087+0000 7fed4d138640 1 -- start start 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4d138640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 0x7fed480b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4d138640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fed480b0a50 0x7fed4806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4d138640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480b0eb0 con 0x7fed4806b840 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4d138640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed48161cc0 con 0x7fed480b0a50 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4d138640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480c90e0 con 0x7fed4815d290 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fed480b0a50 0x7fed4806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fed480b0a50 0x7fed4806b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37138/0 (socket says 172.21.15.2:37138) 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 -- 172.21.15.2:0/3760402646 learned_addr learned my addr 172.21.15.2:0/3760402646 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed46d9d640 1 --2- 172.21.15.2:0/3760402646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 0x7fed480b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 -- 172.21.15.2:0/3760402646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 msgr2=0x7fed480b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 --2- 172.21.15.2:0/3760402646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 0x7fed480b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 -- 172.21.15.2:0/3760402646 >> v1:172.21.15.90:6789/0 conn(0x7fed4806b840 legacy=0x7fed480cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 -- 172.21.15.2:0/3760402646 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4806c010 con 0x7fed480b0a50 2023-11-04T01:44:20.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.091+0000 7fed4659c640 1 --2- 172.21.15.2:0/3760402646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed480b0a50 0x7fed4806b300 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009870 tx=0x7fed3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcefc53a4f3ec167 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed45d9b640 1 -- 172.21.15.2:0/3760402646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0ac410 con 0x7fed480b0a50 2023-11-04T01:44:20.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed45d9b640 1 -- 172.21.15.2:0/3760402646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c0ac570 con 0x7fed480b0a50 2023-11-04T01:44:20.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed45d9b640 1 -- 172.21.15.2:0/3760402646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0ac900 con 0x7fed480b0a50 2023-11-04T01:44:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- 172.21.15.2:0/3760402646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed480b0a50 msgr2=0x7fed4806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 --2- 172.21.15.2:0/3760402646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed480b0a50 0x7fed4806b300 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009870 tx=0x7fed3c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- 172.21.15.2:0/3760402646 shutdown_connections 2023-11-04T01:44:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 --2- 172.21.15.2:0/3760402646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed480b0a50 0x7fed4806b300 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 --2- 172.21.15.2:0/3760402646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 0x7fed480b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- 172.21.15.2:0/3760402646 >> 172.21.15.2:0/3760402646 conn(0x7fed480cb510 msgr2=0x7fed480cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- 172.21.15.2:0/3760402646 shutdown_connections 2023-11-04T01:44:20.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- 172.21.15.2:0/3760402646 wait complete. 2023-11-04T01:44:20.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 Processor -- start 2023-11-04T01:44:20.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- start start 2023-11-04T01:44:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4806b840 0x7fed48153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed480b0a50 0x7fed48153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 0x7fed48154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4815e420 con 0x7fed4806b840 2023-11-04T01:44:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4815d810 con 0x7fed480b0a50 2023-11-04T01:44:20.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4815daf0 con 0x7fed4815d290 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4806b840 0x7fed48153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4806b840 0x7fed48153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37154/0 (socket says 172.21.15.2:37154) 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 -- 172.21.15.2:0/1818106075 learned_addr learned my addr 172.21.15.2:0/1818106075 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 -- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 msgr2=0x7fed48154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 0x7fed48154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 -- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed480b0a50 msgr2=0x7fed48153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed480b0a50 0x7fed48153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 -- 172.21.15.2:0/1818106075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c0094d0 con 0x7fed4806b840 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed46d9d640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4806b840 0x7fed48153080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fed3800d5f0 tx=0x7fed3800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed2f7fe640 1 -- 172.21.15.2:0/1818106075 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380125f0 con 0x7fed4806b840 2023-11-04T01:44:20.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed2f7fe640 1 -- 172.21.15.2:0/1818106075 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38012750 con 0x7fed4806b840 2023-11-04T01:44:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4815ddd0 con 0x7fed4806b840 2023-11-04T01:44:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed2f7fe640 1 -- 172.21.15.2:0/1818106075 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38012b00 con 0x7fed4806b840 2023-11-04T01:44:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.095+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed481535c0 con 0x7fed4806b840 2023-11-04T01:44:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.099+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed480744a0 con 0x7fed4806b840 2023-11-04T01:44:20.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.099+0000 7fed2f7fe640 1 -- 172.21.15.2:0/1818106075 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed38012c60 con 0x7fed4806b840 2023-11-04T01:44:20.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.099+0000 7fed2f7fe640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fed340664a0 0x7fed34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.099+0000 7fed2f7fe640 1 -- 172.21.15.2:0/1818106075 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fed38084170 con 0x7fed4806b840 2023-11-04T01:44:20.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.099+0000 7fed4659c640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fed340664a0 0x7fed34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.099+0000 7fed4659c640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fed340664a0 0x7fed34068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ae000 tx=0x7fed3c004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.103+0000 7fed2f7fe640 1 -- 172.21.15.2:0/1818106075 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fed38051820 con 0x7fed4806b840 2023-11-04T01:44:20.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.255+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fed480ade30 con 0x7fed4806b840 2023-11-04T01:44:20.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.259+0000 7fed2f7fe640 1 -- 172.21.15.2:0/1818106075 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v15)=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed38007380 con 0x7fed4806b840 2023-11-04T01:44:20.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fed340664a0 msgr2=0x7fed34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fed340664a0 0x7fed34068960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ae000 tx=0x7fed3c004740 comp rx=0 tx=0).stop 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4806b840 msgr2=0x7fed48153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4806b840 0x7fed48153080 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fed3800d5f0 tx=0x7fed3800dab0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 shutdown_connections 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fed340664a0 0x7fed34068960 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fed4815d290 0x7fed48154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fed480b0a50 0x7fed48153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 --2- 172.21.15.2:0/1818106075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fed4806b840 0x7fed48153080 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 >> 172.21.15.2:0/1818106075 conn(0x7fed480cb510 msgr2=0x7fed480cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 shutdown_connections 2023-11-04T01:44:20.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.263+0000 7fed4d138640 1 -- 172.21.15.2:0/1818106075 wait complete. 2023-11-04T01:44:20.285 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:44:20.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:20.320 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:20.361 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:44:20.361 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:20.361 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:20.371 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:44:20.372 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:20.372 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:20.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:20.409 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:20.409 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:20.419 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:44:20.420 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:20.420 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:20.456 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:20.456 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:44:20.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:20.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.579+0000 7fb182074640 1 Processor -- start 2023-11-04T01:44:20.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb182074640 1 -- start start 2023-11-04T01:44:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb182074640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb17c0cd6a0 0x7fb17c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb182074640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0ce320 con 0x7fb17c0b0890 2023-11-04T01:44:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb182074640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0ce600 con 0x7fb17c0c9960 2023-11-04T01:44:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb182074640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c06d2f0 con 0x7fb17c0cd6a0 2023-11-04T01:44:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb17c0b0890 0x7fb17c0704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36932/0 (socket says 172.21.15.2:36932) 2023-11-04T01:44:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 -- 172.21.15.2:0/2725861194 learned_addr learned my addr 172.21.15.2:0/2725861194 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:20.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372159498 0 0) 0x7fb17c0ce320 con 0x7fb17c0b0890 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb164003530 con 0x7fb17c0b0890 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17bfff640 1 --2- 172.21.15.2:0/2725861194 >> v2:172.21.15.90:3300/0 conn(0x7fb17c0cd6a0 0x7fb17c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1496716394 0 0) 0x7fb164003530 con 0x7fb17c0b0890 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 >> v2:172.21.15.90:3300/0 conn(0x7fb17c0cd6a0 msgr2=0x7fb17c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 --2- 172.21.15.2:0/2725861194 >> v2:172.21.15.90:3300/0 conn(0x7fb17c0cd6a0 0x7fb17c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 >> v1:172.21.15.90:6789/0 conn(0x7fb17c0c9960 legacy=0x7fb17c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0ce8e0 con 0x7fb17c0b0890 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fb16c001a00 con 0x7fb17c0b0890 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 >> v1:172.21.15.2:6789/0 conn(0x7fb17c0b0890 legacy=0x7fb17c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb164003980 0x7fb164003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1640047d0 0x7fb164004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164005190 0x7fb16400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c06d2f0 con 0x7fb164003980 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c130 con 0x7fb1640047d0 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c2f0 con 0x7fb164005190 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb164003980 0x7fb164003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17affd640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1640047d0 0x7fb164004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 -- 172.21.15.2:0/2725861194 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164005190 msgr2=0x7fb16400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164005190 0x7fb16400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 -- 172.21.15.2:0/2725861194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1640047d0 msgr2=0x7fb164004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1640047d0 0x7fb164004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17b7fe640 1 -- 172.21.15.2:0/2725861194 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164003530 con 0x7fb164003980 2023-11-04T01:44:20.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.583+0000 7fb17bfff640 1 -- 172.21.15.2:0/2725861194 reap_dead start 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb17b7fe640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb164003980 0x7fb164003da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00a820 tx=0x7fb16c01d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16e6777c8df13e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0072d0 con 0x7fb164003980 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c0a8070 con 0x7fb164003980 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb17a7fc640 1 -- 172.21.15.2:0/2725861194 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0076f0 con 0x7fb164003980 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 -- 172.21.15.2:0/2725861194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb164003980 msgr2=0x7fb164003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb164003980 0x7fb164003da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00a820 tx=0x7fb16c01d2b0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 -- 172.21.15.2:0/2725861194 shutdown_connections 2023-11-04T01:44:20.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 --2- 172.21.15.2:0/2725861194 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb164003980 0x7fb164003da0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 -- 172.21.15.2:0/2725861194 >> 172.21.15.2:0/2725861194 conn(0x7fb17c0cebb0 msgr2=0x7fb17c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 -- 172.21.15.2:0/2725861194 shutdown_connections 2023-11-04T01:44:20.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 -- 172.21.15.2:0/2725861194 wait complete. 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 Processor -- start 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 -- start start 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164003980 0x7fb17c14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb17c0c4b40 0x7fb17c0c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.587+0000 7fb182074640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb17c0aea60 0x7fb17c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb182074640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c14f610 con 0x7fb17c0aea60 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb182074640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0c5500 con 0x7fb17c0c4b40 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb182074640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0af420 con 0x7fb164003980 2023-11-04T01:44:20.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb17c0aea60 0x7fb17c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb17c0aea60 0x7fb17c0aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37174/0 (socket says 172.21.15.2:37174) 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 -- 172.21.15.2:0/2224744640 learned_addr learned my addr 172.21.15.2:0/2224744640 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17b7fe640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164003980 0x7fb17c14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17affd640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb17c0c4b40 0x7fb17c0c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 -- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164003980 msgr2=0x7fb17c14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164003980 0x7fb17c14f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 -- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb17c0c4b40 msgr2=0x7fb17c0c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb17c0c4b40 0x7fb17c0c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 -- 172.21.15.2:0/2224744640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0c3160 con 0x7fb17c0aea60 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17bfff640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb17c0aea60 0x7fb17c0aeee0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb17c070020 tx=0x7fb17400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb163fff640 1 -- 172.21.15.2:0/2224744640 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400c620 con 0x7fb17c0aea60 2023-11-04T01:44:20.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb163fff640 1 -- 172.21.15.2:0/2224744640 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400c7a0 con 0x7fb17c0aea60 2023-11-04T01:44:20.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb163fff640 1 -- 172.21.15.2:0/2224744640 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400cb50 con 0x7fb17c0aea60 2023-11-04T01:44:20.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c0c6d10 con 0x7fb17c0aea60 2023-11-04T01:44:20.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c0c2830 con 0x7fb17c0aea60 2023-11-04T01:44:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c0c32f0 con 0x7fb17c0aea60 2023-11-04T01:44:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb163fff640 1 -- 172.21.15.2:0/2224744640 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb17400ccb0 con 0x7fb17c0aea60 2023-11-04T01:44:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb163fff640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1680664d0 0x7fb168068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb163fff640 1 -- 172.21.15.2:0/2224744640 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb1740839c0 con 0x7fb17c0aea60 2023-11-04T01:44:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.591+0000 7fb17b7fe640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1680664d0 0x7fb168068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.595+0000 7fb17b7fe640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1680664d0 0x7fb168068990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ad000 tx=0x7fb16c009050 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.595+0000 7fb163fff640 1 -- 172.21.15.2:0/2224744640 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb174051120 con 0x7fb17c0aea60 2023-11-04T01:44:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb17c0744a0 con 0x7fb17c0aea60 2023-11-04T01:44:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb163fff640 1 -- 172.21.15.2:0/2224744640 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3687 (secure 0 0 0) 0x7fb174054740 con 0x7fb17c0aea60 2023-11-04T01:44:20.793 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:20.793 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5215,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/47038667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":47038667},{"type":"v1","addr":"172.21.15.90:6835","nonce":47038667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5221,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3742811104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3742811104},{"type":"v1","addr":"172.21.15.90:6837","nonce":3742811104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5754,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2057053526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":2057053526},{"type":"v1","addr":"172.21.15.2:6835","nonce":2057053526}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":6087,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/1507587000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1507587000},{"type":"v1","addr":"172.21.15.2:6834","nonce":1507587000}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[]} 2023-11-04T01:44:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 22 2023-11-04T01:44:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1680664d0 msgr2=0x7fb168068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1680664d0 0x7fb168068990 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ad000 tx=0x7fb16c009050 comp rx=0 tx=0).stop 2023-11-04T01:44:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb17c0aea60 msgr2=0x7fb17c0aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb17c0aea60 0x7fb17c0aeee0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb17c070020 tx=0x7fb17400ec00 comp rx=0 tx=0).stop 2023-11-04T01:44:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 shutdown_connections 2023-11-04T01:44:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1680664d0 0x7fb168068990 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb17c0aea60 0x7fb17c0aeee0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb17c0c4b40 0x7fb17c0c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 --2- 172.21.15.2:0/2224744640 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb164003980 0x7fb17c14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.787+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 >> 172.21.15.2:0/2224744640 conn(0x7fb17c0cebb0 msgr2=0x7fb17c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.791+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 shutdown_connections 2023-11-04T01:44:20.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.791+0000 7fb182074640 1 -- 172.21.15.2:0/2224744640 wait complete. 2023-11-04T01:44:20.811 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:44:20.811 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:44:20.811 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:44:20.812 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:20.812 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:44:20.812 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:44:20.812 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:44:20.812 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:20.812 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:44:20.812 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:44:20.813 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:44:20.813 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:20.813 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:44:20.813 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:44:20.813 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:44:20.813 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:20.822 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:44:20.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:44:20.823 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:44:20.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:44:20.829 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:44:20.829 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:44:20.833 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:44:20.833 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:44:20.865 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:44:20.865 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:20.865 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:44:20.866 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:20.876 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:44:20.876 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:20.878 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:44:20.878 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:20.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:44:20.924 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:44:20.924 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:44:20.949 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:44:20.950 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:44:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.983+0000 7f9b26c11640 1 Processor -- start 2023-11-04T01:44:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.983+0000 7f9b26c11640 1 -- start start 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b2015a080 0x7f9b20065fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b2015e7f0 0x7f9b2015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2015e5c0 con 0x7f9b2015e170 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b20066510 con 0x7f9b2015a080 2023-11-04T01:44:20.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2006b170 con 0x7f9b2015e7f0 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b2015a080 0x7f9b20065fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b2015a080 0x7f9b20065fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37232/0 (socket says 172.21.15.2:37232) 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 -- 172.21.15.2:0/1424584279 learned_addr learned my addr 172.21.15.2:0/1424584279 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b1ffff640 1 --2- 172.21.15.2:0/1424584279 >> v2:172.21.15.90:3300/0 conn(0x7f9b2015e7f0 0x7f9b2015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 -- 172.21.15.2:0/1424584279 >> v2:172.21.15.90:3300/0 conn(0x7f9b2015e7f0 msgr2=0x7f9b2015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 --2- 172.21.15.2:0/1424584279 >> v2:172.21.15.90:3300/0 conn(0x7f9b2015e7f0 0x7f9b2015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 -- 172.21.15.2:0/1424584279 >> v1:172.21.15.90:6789/0 conn(0x7f9b2015e170 legacy=0x7f9b200b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 -- 172.21.15.2:0/1424584279 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200cc740 con 0x7f9b2015a080 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b249ad640 1 --2- 172.21.15.2:0/1424584279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015a080 0x7f9b20065fd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9b200c9720 tx=0x7f9b1401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46706d1a6455265d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b1f7fe640 1 -- 172.21.15.2:0/1424584279 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b140a89b0 con 0x7f9b2015a080 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b1f7fe640 1 -- 172.21.15.2:0/1424584279 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b140a8b10 con 0x7f9b2015a080 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b1f7fe640 1 -- 172.21.15.2:0/1424584279 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b140a8ea0 con 0x7f9b2015a080 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- 172.21.15.2:0/1424584279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015a080 msgr2=0x7f9b20065fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1424584279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015a080 0x7f9b20065fd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9b200c9720 tx=0x7f9b1401ecb0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- 172.21.15.2:0/1424584279 shutdown_connections 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1424584279 >> v2:172.21.15.90:3300/0 conn(0x7f9b2015e7f0 0x7f9b2015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1424584279 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015a080 0x7f9b20065fd0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- 172.21.15.2:0/1424584279 >> 172.21.15.2:0/1424584279 conn(0x7f9b200716a0 msgr2=0x7f9b20071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- 172.21.15.2:0/1424584279 shutdown_connections 2023-11-04T01:44:20.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.987+0000 7f9b26c11640 1 -- 172.21.15.2:0/1424584279 wait complete. 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 Processor -- start 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 -- start start 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2015a080 0x7f9b20155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b2015e170 0x7f9b200c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015e7f0 0x7f9b20154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200c6c60 con 0x7f9b2015e7f0 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20155ff0 con 0x7f9b2015e170 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b200c6a30 con 0x7f9b2015a080 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015e7f0 0x7f9b20154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015e7f0 0x7f9b20154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37248/0 (socket says 172.21.15.2:37248) 2023-11-04T01:44:20.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 -- 172.21.15.2:0/1324059960 learned_addr learned my addr 172.21.15.2:0/1324059960 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b249ad640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2015a080 0x7f9b20155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b1ffff640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b2015e170 0x7f9b200c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 -- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2015a080 msgr2=0x7f9b20155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2015a080 0x7f9b20155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 -- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b2015e170 msgr2=0x7f9b200c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b2015e170 0x7f9b200c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 -- 172.21.15.2:0/1324059960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140094d0 con 0x7f9b2015e7f0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b251ae640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015e7f0 0x7f9b20154f70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800c780 tx=0x7f9b1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b1d7fa640 1 -- 172.21.15.2:0/1324059960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18004b70 con 0x7f9b2015e7f0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b1d7fa640 1 -- 172.21.15.2:0/1324059960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1800ce90 con 0x7f9b2015e7f0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b200af310 con 0x7f9b2015e7f0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b1d7fa640 1 -- 172.21.15.2:0/1324059960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800a850 con 0x7f9b2015e7f0 2023-11-04T01:44:20.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b200c91a0 con 0x7f9b2015e7f0 2023-11-04T01:44:21.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b200af4a0 con 0x7f9b2015e7f0 2023-11-04T01:44:21.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.991+0000 7f9b1d7fa640 1 -- 172.21.15.2:0/1324059960 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b1800a9b0 con 0x7f9b2015e7f0 2023-11-04T01:44:21.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.995+0000 7f9b1d7fa640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b040664a0 0x7f9b04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:21.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.995+0000 7f9b1d7fa640 1 -- 172.21.15.2:0/1324059960 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9b18083dd0 con 0x7f9b2015e7f0 2023-11-04T01:44:21.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.995+0000 7f9b249ad640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b040664a0 0x7f9b04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:21.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.995+0000 7f9b249ad640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b040664a0 0x7f9b04068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b2000 tx=0x7f9b14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:21.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:20.999+0000 7f9b1d7fa640 1 -- 172.21.15.2:0/1324059960 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b180513f0 con 0x7f9b2015e7f0 2023-11-04T01:44:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:21.155+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9b200675f0 con 0x7f9b2015e7f0 2023-11-04T01:44:22.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.291+0000 7f9b1d7fa640 1 -- 172.21.15.2:0/1324059960 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9b18054a10 con 0x7f9b2015e7f0 2023-11-04T01:44:22.299 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-04T01:44:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b040664a0 msgr2=0x7f9b04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b040664a0 0x7f9b04068960 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b2000 tx=0x7f9b14009040 comp rx=0 tx=0).stop 2023-11-04T01:44:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015e7f0 msgr2=0x7f9b20154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015e7f0 0x7f9b20154f70 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800c780 tx=0x7f9b1800cc40 comp rx=0 tx=0).stop 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 shutdown_connections 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b040664a0 0x7f9b04068960 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2015e7f0 0x7f9b20154f70 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b2015e170 0x7f9b200c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 --2- 172.21.15.2:0/1324059960 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2015a080 0x7f9b20155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 >> 172.21.15.2:0/1324059960 conn(0x7f9b200716a0 msgr2=0x7f9b200b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 shutdown_connections 2023-11-04T01:44:22.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.295+0000 7f9b26c11640 1 -- 172.21.15.2:0/1324059960 wait complete. 2023-11-04T01:44:22.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:44:22.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d50019640 1 Processor -- start 2023-11-04T01:44:22.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d50019640 1 -- start start 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d50019640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d480ce720 0x7f3d48159a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d50019640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3d480b06a0 0x7f3d4806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d50019640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480ccfd0 con 0x7f3d480ce070 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d50019640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480cd2b0 con 0x7f3d480ce720 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d50019640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480cd590 con 0x7f3d480b06a0 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d480ce720 0x7f3d48159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3d480ce720 0x7f3d48159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36276/0 (socket says 172.21.15.2:36276) 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 -- 172.21.15.2:0/418838418 learned_addr learned my addr 172.21.15.2:0/418838418 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 -- 172.21.15.2:0/418838418 >> v2:172.21.15.90:3300/0 conn(0x7f3d480b06a0 msgr2=0x7f3d4806ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 --2- 172.21.15.2:0/418838418 >> v2:172.21.15.90:3300/0 conn(0x7f3d480b06a0 0x7f3d4806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 -- 172.21.15.2:0/418838418 >> v1:172.21.15.90:6789/0 conn(0x7f3d480ce070 legacy=0x7f3d480cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 -- 172.21.15.2:0/418838418 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480cd870 con 0x7f3d480ce720 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.439+0000 7f3d4ddb5640 1 --2- 172.21.15.2:0/418838418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce720 0x7f3d48159a50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b1740 tx=0x7f3d4401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d64a08f5d412df7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4cdb3640 1 -- 172.21.15.2:0/418838418 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440a89b0 con 0x7f3d480ce720 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4cdb3640 1 -- 172.21.15.2:0/418838418 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d440a8b10 con 0x7f3d480ce720 2023-11-04T01:44:22.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4cdb3640 1 -- 172.21.15.2:0/418838418 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d440a8ea0 con 0x7f3d480ce720 2023-11-04T01:44:22.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- 172.21.15.2:0/418838418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce720 msgr2=0x7f3d48159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 --2- 172.21.15.2:0/418838418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce720 0x7f3d48159a50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b1740 tx=0x7f3d4401ecb0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- 172.21.15.2:0/418838418 shutdown_connections 2023-11-04T01:44:22.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 --2- 172.21.15.2:0/418838418 >> v2:172.21.15.90:3300/0 conn(0x7f3d480b06a0 0x7f3d4806ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 --2- 172.21.15.2:0/418838418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce720 0x7f3d48159a50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- 172.21.15.2:0/418838418 >> 172.21.15.2:0/418838418 conn(0x7f3d480cebb0 msgr2=0x7f3d480cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- 172.21.15.2:0/418838418 shutdown_connections 2023-11-04T01:44:22.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- 172.21.15.2:0/418838418 wait complete. 2023-11-04T01:44:22.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 Processor -- start 2023-11-04T01:44:22.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- start start 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d480b06a0 0x7f3d480714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce070 0x7f3d4806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480ce720 0x7f3d4806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48164700 con 0x7f3d480ce070 2023-11-04T01:44:22.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48163b80 con 0x7f3d480ce720 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d48163e60 con 0x7f3d480b06a0 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce070 0x7f3d4806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce070 0x7f3d4806ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36292/0 (socket says 172.21.15.2:36292) 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 -- 172.21.15.2:0/2152898308 learned_addr learned my addr 172.21.15.2:0/2152898308 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4ddb5640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d480b06a0 0x7f3d480714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 -- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d480b06a0 msgr2=0x7f3d480714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d480b06a0 0x7f3d480714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 -- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480ce720 msgr2=0x7f3d4806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480ce720 0x7f3d4806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 -- 172.21.15.2:0/2152898308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440094d0 con 0x7f3d480ce070 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4ddb5640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d480b06a0 0x7f3d480714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:22.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d4d5b4640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce070 0x7f3d4806ba90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c490 tx=0x7f3d38001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d3e7fc640 1 -- 172.21.15.2:0/2152898308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38003600 con 0x7f3d480ce070 2023-11-04T01:44:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d3e7fc640 1 -- 172.21.15.2:0/2152898308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38003780 con 0x7f3d480ce070 2023-11-04T01:44:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d48164140 con 0x7f3d480ce070 2023-11-04T01:44:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d3e7fc640 1 -- 172.21.15.2:0/2152898308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38003b70 con 0x7f3d480ce070 2023-11-04T01:44:22.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.443+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d481f69b0 con 0x7f3d480ce070 2023-11-04T01:44:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.447+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d48165810 con 0x7f3d480ce070 2023-11-04T01:44:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.447+0000 7f3d3e7fc640 1 -- 172.21.15.2:0/2152898308 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d38003cd0 con 0x7f3d480ce070 2023-11-04T01:44:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.447+0000 7f3d3e7fc640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3d2c0664a0 0x7f3d2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.447+0000 7f3d3e7fc640 1 -- 172.21.15.2:0/2152898308 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3d38082e20 con 0x7f3d480ce070 2023-11-04T01:44:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.447+0000 7f3d4ddb5640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3d2c0664a0 0x7f3d2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.447+0000 7f3d4ddb5640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3d2c0664a0 0x7f3d2c068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3d440b2000 tx=0x7f3d44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.451+0000 7f3d3e7fc640 1 -- 172.21.15.2:0/2152898308 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3d48165810 con 0x7f3d480ce070 2023-11-04T01:44:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.663+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3d48165810 con 0x7f3d480ce070 2023-11-04T01:44:22.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.663+0000 7f3d3e7fc640 1 -- 172.21.15.2:0/2152898308 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3d48165810 con 0x7f3d480ce070 2023-11-04T01:44:22.669 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlnFZCMBAAsgGcwY3jbh9F9NEVwbamwg==", 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.670 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDZRuAxAA6zx8mu5wQEvvcICXPTXZZQ==", 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlFSvMOBAA0k4I7A+4TRIrxBOwUdIZLw==", 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:22.672 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl/PDbCxAA+6y8He/9gQZa1vvdJH+iCg==", 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.673 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBIoUVlnpFvJBAAAyqa0u7D+cz+Gy4XpppWYQ==", 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.674 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBLoUVlObtjKhAAbf3wgZ9mpp8+pI1IGyIwdg==", 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBOoUVlOF4QMxAANdCz1HMyMGzyFpUv9xawYA==", 2023-11-04T01:44:22.675 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBRoUVlMnFiOxAA2d7ZoQEhtXkAMhu0yPh4iw==", 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.676 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.677 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.677 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.677 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.677 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.677 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBYoUVlfe9FCBAA3oVMNubThpWJoxlqFzaAfg==", 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBboUVlTfGNEBAA2FNXiCKGJ2s4XeH+paqrNw==", 2023-11-04T01:44:22.678 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBeoUVluX7oGBAAh+/toMBPGjq99EonfWEPtQ==", 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.679 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBhoUVlGhEAIhAAO8mqoIPekhVmAxnR1VKXeQ==", 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ==", 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-04T01:44:22.681 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDtmNGRAAFXXp/X0fnL9uuEIfj1Eadw==", 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlPzfyFhAAbCRYmyHHFu2GDtyZOL2ISw==", 2023-11-04T01:44:22.682 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl1jK2HhAAH1E38zcrKticBLLRR/8IuA==", 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:22.683 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlCj8pFxAApTKY8a6VcYBWkCLKrKHorQ==", 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.684 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlcZ/jKhAAWDrmzYgapIV+SBRNrXWAjg==", 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlhYtpKBAAn1snUSz1+SKC8frnVuvFdA==", 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-04T01:44:22.686 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:44:22.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3d2c0664a0 msgr2=0x7f3d2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3d2c0664a0 0x7f3d2c068960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3d440b2000 tx=0x7f3d44008040 comp rx=0 tx=0).stop 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce070 msgr2=0x7f3d4806ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce070 0x7f3d4806ba90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800c490 tx=0x7f3d38001e80 comp rx=0 tx=0).stop 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 shutdown_connections 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3d2c0664a0 0x7f3d2c068960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480ce720 0x7f3d4806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3d480ce070 0x7f3d4806ba90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 --2- 172.21.15.2:0/2152898308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3d480b06a0 0x7f3d480714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 >> 172.21.15.2:0/2152898308 conn(0x7f3d480cebb0 msgr2=0x7f3d48159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 shutdown_connections 2023-11-04T01:44:22.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.667+0000 7f3d50019640 1 -- 172.21.15.2:0/2152898308 wait complete. 2023-11-04T01:44:22.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaaa569640 1 Processor -- start 2023-11-04T01:44:22.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaaa569640 1 -- start start 2023-11-04T01:44:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaaa569640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbaa40b0d40 0x7fbaa4166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaaa569640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40c2670 con 0x7fbaa415afd0 2023-11-04T01:44:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaaa569640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa406bc30 con 0x7fbaa40715d0 2023-11-04T01:44:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaaa569640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa4070140 con 0x7fbaa40b0d40 2023-11-04T01:44:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaa8b06640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbaa40b0d40 0x7fbaa4166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaa3fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbaa415afd0 0x7fbaa406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51976/0 (socket says 172.21.15.2:51976) 2023-11-04T01:44:22.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaa3fff640 1 -- 172.21.15.2:0/3826591639 learned_addr learned my addr 172.21.15.2:0/3826591639 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaa8b06640 1 -- 172.21.15.2:0/3826591639 >> v1:172.21.15.90:6789/0 conn(0x7fbaa40715d0 legacy=0x7fbaa40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaa8b06640 1 -- 172.21.15.2:0/3826591639 >> v1:172.21.15.2:6789/0 conn(0x7fbaa415afd0 legacy=0x7fbaa406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaa2ffd640 1 -- 172.21.15.2:0/3826591639 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380550987 0 0) 0x7fbaa40c2670 con 0x7fbaa415afd0 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.811+0000 7fbaa8b06640 1 -- 172.21.15.2:0/3826591639 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa406bf10 con 0x7fbaa40b0d40 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa8b06640 1 --2- 172.21.15.2:0/3826591639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40b0d40 0x7fbaa4166010 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009d90 tx=0x7fba9c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd64d27296d921e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa2ffd640 1 -- 172.21.15.2:0/3826591639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0a57d0 con 0x7fbaa40b0d40 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa2ffd640 1 -- 172.21.15.2:0/3826591639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c0a5930 con 0x7fbaa40b0d40 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa2ffd640 1 -- 172.21.15.2:0/3826591639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0a5cc0 con 0x7fbaa40b0d40 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- 172.21.15.2:0/3826591639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40b0d40 msgr2=0x7fbaa4166010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 --2- 172.21.15.2:0/3826591639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40b0d40 0x7fbaa4166010 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009d90 tx=0x7fba9c01c910 comp rx=0 tx=0).stop 2023-11-04T01:44:22.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- 172.21.15.2:0/3826591639 shutdown_connections 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 --2- 172.21.15.2:0/3826591639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40b0d40 0x7fbaa4166010 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- 172.21.15.2:0/3826591639 >> 172.21.15.2:0/3826591639 conn(0x7fbaa40cebb0 msgr2=0x7fbaa40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- 172.21.15.2:0/3826591639 shutdown_connections 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- 172.21.15.2:0/3826591639 wait complete. 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 Processor -- start 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- start start 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40715d0 0x7fbaa40b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa40b0d40 0x7fbaa40c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbaa415afd0 0x7fbaa40b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa415fc90 con 0x7fbaa40715d0 2023-11-04T01:44:22.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa414db10 con 0x7fbaa40b0d40 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaaa569640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4154e60 con 0x7fbaa415afd0 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40715d0 0x7fbaa40b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40715d0 0x7fbaa40b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36308/0 (socket says 172.21.15.2:36308) 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 -- 172.21.15.2:0/1904522430 learned_addr learned my addr 172.21.15.2:0/1904522430 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa8b06640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbaa415afd0 0x7fbaa40b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 -- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbaa415afd0 msgr2=0x7fbaa40b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbaa415afd0 0x7fbaa40b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 -- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa40b0d40 msgr2=0x7fbaa40c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa37fe640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa40b0d40 0x7fbaa40c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa40b0d40 0x7fbaa40c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.815+0000 7fbaa3fff640 1 -- 172.21.15.2:0/1904522430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c009a70 con 0x7fbaa40715d0 2023-11-04T01:44:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa3fff640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40715d0 0x7fbaa40b17d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c480 tx=0x7fba9400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa0ff9640 1 -- 172.21.15.2:0/1904522430 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba940074e0 con 0x7fbaa40715d0 2023-11-04T01:44:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa0ff9640 1 -- 172.21.15.2:0/1904522430 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94007660 con 0x7fbaa40715d0 2023-11-04T01:44:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4155140 con 0x7fbaa40715d0 2023-11-04T01:44:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa0ff9640 1 -- 172.21.15.2:0/1904522430 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94004a30 con 0x7fbaa40715d0 2023-11-04T01:44:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa4155420 con 0x7fbaa40715d0 2023-11-04T01:44:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa414dff0 con 0x7fbaa40715d0 2023-11-04T01:44:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa0ff9640 1 -- 172.21.15.2:0/1904522430 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fba94004b90 con 0x7fbaa40715d0 2023-11-04T01:44:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa0ff9640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fba900664a0 0x7fba90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa0ff9640 1 -- 172.21.15.2:0/1904522430 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fba94082e20 con 0x7fbaa40715d0 2023-11-04T01:44:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa37fe640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fba900664a0 0x7fba90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.819+0000 7fbaa37fe640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fba900664a0 0x7fba90068960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40cf630 tx=0x7fba98009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.823+0000 7fbaa0ff9640 1 -- 172.21.15.2:0/1904522430 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbaa414dff0 con 0x7fbaa40715d0 2023-11-04T01:44:22.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.979+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaa414dff0 con 0x7fbaa40715d0 2023-11-04T01:44:22.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.983+0000 7fbaa0ff9640 1 -- 172.21.15.2:0/1904522430 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+14498 (secure 0 0 0) 0x7fbaa414dff0 con 0x7fbaa40715d0 2023-11-04T01:44:22.990 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:22.990 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:22.293753+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:22.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fba900664a0 msgr2=0x7fba90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fba900664a0 0x7fba90068960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40cf630 tx=0x7fba98009040 comp rx=0 tx=0).stop 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40715d0 msgr2=0x7fbaa40b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40715d0 0x7fbaa40b17d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c480 tx=0x7fba9400c940 comp rx=0 tx=0).stop 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 shutdown_connections 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fba900664a0 0x7fba90068960 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbaa415afd0 0x7fbaa40b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa40b0d40 0x7fbaa40c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 --2- 172.21.15.2:0/1904522430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbaa40715d0 0x7fbaa40b17d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 >> 172.21.15.2:0/1904522430 conn(0x7fbaa40cebb0 msgr2=0x7fbaa4155f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:22.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 shutdown_connections 2023-11-04T01:44:22.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:22.987+0000 7fbaaa569640 1 -- 172.21.15.2:0/1904522430 wait complete. 2023-11-04T01:44:23.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:23.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:23.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fae0084e640 1 Processor -- start 2023-11-04T01:44:23.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fae0084e640 1 -- start start 2023-11-04T01:44:23.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fae0084e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fadfc15af50 0x7fadfc0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fae0084e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 0x7fadfc0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fae0084e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0cd830 con 0x7fadfc0b32f0 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fae0084e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadfc0b3780 con 0x7fadfc15af50 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fae0084e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0cdad0 con 0x7fadfc0cf4c0 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf9d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fadfc0b32f0 0x7fadfc0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51988/0 (socket says 172.21.15.2:51988) 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf9d9b640 1 -- 172.21.15.2:0/2298986802 learned_addr learned my addr 172.21.15.2:0/2298986802 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfad9d640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 0x7fadfc0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfa59c640 1 --2- 172.21.15.2:0/2298986802 >> v2:172.21.15.90:3300/0 conn(0x7fadfc15af50 0x7fadfc0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158407108 0 0) 0x7fadfc0cd830 con 0x7fadfc0b32f0 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fade4003530 con 0x7fadfc0b32f0 2023-11-04T01:44:23.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1454571592 0 0) 0x7fade4003530 con 0x7fadfc0b32f0 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 msgr2=0x7fadfc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 0x7fadfc0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 >> v2:172.21.15.90:3300/0 conn(0x7fadfc15af50 msgr2=0x7fadfc0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 --2- 172.21.15.2:0/2298986802 >> v2:172.21.15.90:3300/0 conn(0x7fadfc15af50 0x7fadfc0cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0cddb0 con 0x7fadfc0b32f0 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fadf0001680 con 0x7fadfc0b32f0 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 >> v1:172.21.15.2:6789/0 conn(0x7fadfc0b32f0 legacy=0x7fadfc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fade4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40047d0 0x7fade4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 0x7fade4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0b3780 con 0x7fade4003980 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0cdad0 con 0x7fade40047d0 2023-11-04T01:44:23.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade400b990 con 0x7fadfc0cf4c0 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfa59c640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fade4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadf9d9b640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40047d0 0x7fade4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfad9d640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 0x7fade4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfa59c640 1 -- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 msgr2=0x7fade4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfa59c640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc0cf4c0 0x7fade4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfa59c640 1 -- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40047d0 msgr2=0x7fade4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfa59c640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade40047d0 0x7fade4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.123+0000 7fadfa59c640 1 -- 172.21.15.2:0/2298986802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4003530 con 0x7fade4003980 2023-11-04T01:44:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fadfa59c640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fade4003da0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fadec009af0 tx=0x7fadec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e7142da2217dd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec0059a0 con 0x7fade4003980 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec005b00 con 0x7fade4003980 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fadf959a640 1 -- 172.21.15.2:0/2298986802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec006030 con 0x7fade4003980 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 -- 172.21.15.2:0/2298986802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 msgr2=0x7fade4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 --2- 172.21.15.2:0/2298986802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fade4003da0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fadec009af0 tx=0x7fadec01ca50 comp rx=0 tx=0).stop 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fadfad9d640 1 -- 172.21.15.2:0/2298986802 reap_dead start 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 -- 172.21.15.2:0/2298986802 shutdown_connections 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 -- 172.21.15.2:0/2298986802 >> 172.21.15.2:0/2298986802 conn(0x7fadfc065dc0 msgr2=0x7fadfc0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 -- 172.21.15.2:0/2298986802 shutdown_connections 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 -- 172.21.15.2:0/2298986802 wait complete. 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 Processor -- start 2023-11-04T01:44:23.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.127+0000 7fae0084e640 1 -- start start 2023-11-04T01:44:23.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fadfc1f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc06cd90 0x7fadfc1f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc162410 0x7fadfc162d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc1f5720 con 0x7fade4003980 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc1f84f0 con 0x7fadfc06cd90 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc06c500 con 0x7fadfc162410 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fadfc1f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fadfc1f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36322/0 (socket says 172.21.15.2:36322) 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 -- 172.21.15.2:0/4204991619 learned_addr learned my addr 172.21.15.2:0/4204991619 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadf9d9b640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc06cd90 0x7fadfc1f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfad9d640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc162410 0x7fadfc162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 -- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc162410 msgr2=0x7fadfc162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc162410 0x7fadfc162d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 -- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc06cd90 msgr2=0x7fadfc1f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc06cd90 0x7fadfc1f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 -- 172.21.15.2:0/4204991619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc06b980 con 0x7fade4003980 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfad9d640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc162410 0x7fadfc162d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadfa59c640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fadfc1f51e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fadec01c880 tx=0x7fade4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadeaffd640 1 -- 172.21.15.2:0/4204991619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec0be070 con 0x7fade4003980 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadeaffd640 1 -- 172.21.15.2:0/4204991619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00f000 con 0x7fade4003980 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc06bc60 con 0x7fade4003980 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadeaffd640 1 -- 172.21.15.2:0/4204991619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec005c70 con 0x7fade4003980 2023-11-04T01:44:23.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc06c220 con 0x7fade4003980 2023-11-04T01:44:23.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc0675f0 con 0x7fade4003980 2023-11-04T01:44:23.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadeaffd640 1 -- 172.21.15.2:0/4204991619 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fadec004020 con 0x7fade4003980 2023-11-04T01:44:23.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadeaffd640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faddc0664d0 0x7faddc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadeaffd640 1 -- 172.21.15.2:0/4204991619 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fadec11de10 con 0x7fade4003980 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.131+0000 7fadf9d9b640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faddc0664d0 0x7faddc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.135+0000 7fadf9d9b640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faddc0664d0 0x7faddc068990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0b65a0 tx=0x7fadf0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.135+0000 7fadeaffd640 1 -- 172.21.15.2:0/4204991619 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fadec0eb3f0 con 0x7fade4003980 2023-11-04T01:44:23.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadfc0b1c40 con 0x7fade4003980 2023-11-04T01:44:23.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fadeaffd640 1 -- 172.21.15.2:0/4204991619 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadec0eea10 con 0x7fade4003980 2023-11-04T01:44:23.296 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:44:23.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faddc0664d0 msgr2=0x7faddc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faddc0664d0 0x7faddc068990 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0b65a0 tx=0x7fadf0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 msgr2=0x7fadfc1f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fadfc1f51e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fadec01c880 tx=0x7fade4005800 comp rx=0 tx=0).stop 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 shutdown_connections 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faddc0664d0 0x7faddc068990 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fadfc162410 0x7fadfc162d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fadfc06cd90 0x7fadfc1f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 --2- 172.21.15.2:0/4204991619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fade4003980 0x7fadfc1f51e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 >> 172.21.15.2:0/4204991619 conn(0x7fadfc065dc0 msgr2=0x7fadfc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 shutdown_connections 2023-11-04T01:44:23.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.291+0000 7fae0084e640 1 -- 172.21.15.2:0/4204991619 wait complete. 2023-11-04T01:44:23.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:23.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc621fe8640 1 Processor -- start 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc621fe8640 1 -- start start 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc621fe8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc61c0b0c20 0x7fc61c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc621fe8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc61c15c160 0x7fc61c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc621fe8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c0cb130 con 0x7fc61c15acb0 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc621fe8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c15bd40 con 0x7fc61c0b0c20 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc621fe8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c06fd80 con 0x7fc61c15c160 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc61c0b0c20 0x7fc61c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc61c0b0c20 0x7fc61c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36328/0 (socket says 172.21.15.2:36328) 2023-11-04T01:44:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 -- 172.21.15.2:0/36598385 learned_addr learned my addr 172.21.15.2:0/36598385 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc61c15acb0 0x7fc61c0b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52002/0 (socket says 172.21.15.2:52002) 2023-11-04T01:44:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61bfff640 1 --2- 172.21.15.2:0/36598385 >> v2:172.21.15.90:3300/0 conn(0x7fc61c15c160 0x7fc61c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 -- 172.21.15.2:0/36598385 >> v2:172.21.15.90:3300/0 conn(0x7fc61c15c160 msgr2=0x7fc61c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 --2- 172.21.15.2:0/36598385 >> v2:172.21.15.90:3300/0 conn(0x7fc61c15c160 0x7fc61c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 -- 172.21.15.2:0/36598385 >> v1:172.21.15.2:6789/0 conn(0x7fc61c15acb0 legacy=0x7fc61c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 -- 172.21.15.2:0/36598385 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c15b680 con 0x7fc61c0b0c20 2023-11-04T01:44:23.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.427+0000 7fc61affd640 1 --2- 172.21.15.2:0/36598385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c15b090 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0b47e0 tx=0x7fc61001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeae2cbe1f6c3fe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61a7fc640 1 -- 172.21.15.2:0/36598385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100aa650 con 0x7fc61c0b0c20 2023-11-04T01:44:23.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61a7fc640 1 -- 172.21.15.2:0/36598385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6100aa7b0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61a7fc640 1 -- 172.21.15.2:0/36598385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100aab40 con 0x7fc61c0b0c20 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- 172.21.15.2:0/36598385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 msgr2=0x7fc61c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 --2- 172.21.15.2:0/36598385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c15b090 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0b47e0 tx=0x7fc61001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- 172.21.15.2:0/36598385 shutdown_connections 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 --2- 172.21.15.2:0/36598385 >> v2:172.21.15.90:3300/0 conn(0x7fc61c15c160 0x7fc61c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 --2- 172.21.15.2:0/36598385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c15b090 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- 172.21.15.2:0/36598385 >> 172.21.15.2:0/36598385 conn(0x7fc61c0cb510 msgr2=0x7fc61c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- 172.21.15.2:0/36598385 shutdown_connections 2023-11-04T01:44:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- 172.21.15.2:0/36598385 wait complete. 2023-11-04T01:44:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 Processor -- start 2023-11-04T01:44:23.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- start start 2023-11-04T01:44:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc61c15acb0 0x7fc61c14c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc61c15c160 0x7fc61c0b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0ae590 con 0x7fc61c0b0c20 2023-11-04T01:44:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c14ca20 con 0x7fc61c15c160 2023-11-04T01:44:23.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c1555f0 con 0x7fc61c15acb0 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36336/0 (socket says 172.21.15.2:36336) 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 -- 172.21.15.2:0/2005083268 learned_addr learned my addr 172.21.15.2:0/2005083268 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61bfff640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc61c15c160 0x7fc61c0b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 -- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc61c15acb0 msgr2=0x7fc61c14c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc61c15acb0 0x7fc61c14c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 -- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc61c15c160 msgr2=0x7fc61c0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc61c15c160 0x7fc61c0b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 -- 172.21.15.2:0/2005083268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100094d0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61bfff640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc61c15c160 0x7fc61c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc61b7fe640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c154d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c490 tx=0x7fc60c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc603fff640 1 -- 172.21.15.2:0/2005083268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c007480 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc603fff640 1 -- 172.21.15.2:0/2005083268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c0075e0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c1558d0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc603fff640 1 -- 172.21.15.2:0/2005083268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c004a10 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.431+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c155bb0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.435+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c0744a0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.435+0000 7fc603fff640 1 -- 172.21.15.2:0/2005083268 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc60c004b70 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.435+0000 7fc603fff640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc6080664a0 0x7fc608068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.435+0000 7fc603fff640 1 -- 172.21.15.2:0/2005083268 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc60c0830d0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.435+0000 7fc61affd640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc6080664a0 0x7fc608068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.435+0000 7fc61affd640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc6080664a0 0x7fc608068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc6100ae000 tx=0x7fc610008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.439+0000 7fc603fff640 1 -- 172.21.15.2:0/2005083268 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc60c050740 con 0x7fc61c0b0c20 2023-11-04T01:44:23.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.591+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fc61c0cbdb0 con 0x7fc61c0b0c20 2023-11-04T01:44:23.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.591+0000 7fc603fff640 1 -- 172.21.15.2:0/2005083268 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v60) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc60c053d60 con 0x7fc61c0b0c20 2023-11-04T01:44:23.599 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc6080664a0 msgr2=0x7fc608068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc6080664a0 0x7fc608068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc6100ae000 tx=0x7fc610008040 comp rx=0 tx=0).stop 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 msgr2=0x7fc61c154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c154d30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c490 tx=0x7fc60c00c950 comp rx=0 tx=0).stop 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 shutdown_connections 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc6080664a0 0x7fc608068960 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc61c15c160 0x7fc61c0b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc61c15acb0 0x7fc61c14c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 --2- 172.21.15.2:0/2005083268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc61c0b0c20 0x7fc61c154d30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 >> 172.21.15.2:0/2005083268 conn(0x7fc61c0cb510 msgr2=0x7fc61c155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 shutdown_connections 2023-11-04T01:44:23.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.595+0000 7fc621fe8640 1 -- 172.21.15.2:0/2005083268 wait complete. 2023-11-04T01:44:23.617 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:44:23.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8b504a640 1 Processor -- start 2023-11-04T01:44:23.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8b504a640 1 -- start start 2023-11-04T01:44:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8b504a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8b006c1a0 0x7ff8b0164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8b504a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b0159e30 con 0x7ff8b00ce720 2023-11-04T01:44:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8b504a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00ccfd0 con 0x7ff8b0159a50 2023-11-04T01:44:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8b504a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b0070b80 con 0x7ff8b006c1a0 2023-11-04T01:44:23.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8ae59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff8b00ce720 0x7ff8b006ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52006/0 (socket says 172.21.15.2:52006) 2023-11-04T01:44:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8ae59c640 1 -- 172.21.15.2:0/1268242624 learned_addr learned my addr 172.21.15.2:0/1268242624 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.723+0000 7ff8af59e640 1 --2- 172.21.15.2:0/1268242624 >> v2:172.21.15.2:3300/0 conn(0x7ff8b006c1a0 0x7ff8b0164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8add9b640 1 -- 172.21.15.2:0/1268242624 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789211138 0 0) 0x7ff8a4001120 con 0x7ff8b00ce720 2023-11-04T01:44:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8add9b640 1 -- 172.21.15.2:0/1268242624 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff898003530 con 0x7ff8b00ce720 2023-11-04T01:44:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8af59e640 1 -- 172.21.15.2:0/1268242624 >> v1:172.21.15.90:6789/0 conn(0x7ff8b0159a50 legacy=0x7ff8b00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8af59e640 1 -- 172.21.15.2:0/1268242624 >> v1:172.21.15.2:6789/0 conn(0x7ff8b00ce720 legacy=0x7ff8b006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8af59e640 1 -- 172.21.15.2:0/1268242624 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00cd2b0 con 0x7ff8b006c1a0 2023-11-04T01:44:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8af59e640 1 --2- 172.21.15.2:0/1268242624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b006c1a0 0x7ff8b0164800 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009d90 tx=0x7ff8a801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4705e88a8ddf33b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8add9b640 1 -- 172.21.15.2:0/1268242624 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80af600 con 0x7ff8b006c1a0 2023-11-04T01:44:23.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8add9b640 1 -- 172.21.15.2:0/1268242624 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a80ab050 con 0x7ff8b006c1a0 2023-11-04T01:44:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8add9b640 1 -- 172.21.15.2:0/1268242624 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80af980 con 0x7ff8b006c1a0 2023-11-04T01:44:23.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8b504a640 1 -- 172.21.15.2:0/1268242624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b006c1a0 msgr2=0x7ff8b0164800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8b504a640 1 --2- 172.21.15.2:0/1268242624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b006c1a0 0x7ff8b0164800 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009d90 tx=0x7ff8a801f130 comp rx=0 tx=0).stop 2023-11-04T01:44:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8b504a640 1 -- 172.21.15.2:0/1268242624 shutdown_connections 2023-11-04T01:44:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8b504a640 1 --2- 172.21.15.2:0/1268242624 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b006c1a0 0x7ff8b0164800 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8b504a640 1 -- 172.21.15.2:0/1268242624 >> 172.21.15.2:0/1268242624 conn(0x7ff8b00cebb0 msgr2=0x7ff8b00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8b504a640 1 -- 172.21.15.2:0/1268242624 shutdown_connections 2023-11-04T01:44:23.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.727+0000 7ff8b504a640 1 -- 172.21.15.2:0/1268242624 wait complete. 2023-11-04T01:44:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 Processor -- start 2023-11-04T01:44:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 -- start start 2023-11-04T01:44:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff8b006c1a0 0x7ff8b014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b00ce720 0x7ff8b00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8b0159a50 0x7ff8b00c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00b2780 con 0x7ff8b00ce720 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00c88e0 con 0x7ff8b0159a50 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00c90b0 con 0x7ff8b006c1a0 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b00ce720 0x7ff8b00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b00ce720 0x7ff8b00c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36354/0 (socket says 172.21.15.2:36354) 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 -- 172.21.15.2:0/2089375241 learned_addr learned my addr 172.21.15.2:0/2089375241 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 -- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff8b006c1a0 msgr2=0x7ff8b014e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8af59e640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8b0159a50 0x7ff8b00c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8aed9d640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff8b006c1a0 0x7ff8b014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff8b006c1a0 0x7ff8b014e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 -- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8b0159a50 msgr2=0x7ff8b00c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8b0159a50 0x7ff8b00c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 -- 172.21.15.2:0/2089375241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a8009a70 con 0x7ff8b00ce720 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8aed9d640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff8b006c1a0 0x7ff8b014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8af59e640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8b0159a50 0x7ff8b00c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8ae59c640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b00ce720 0x7ff8b00c83a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400c730 tx=0x7ff8a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8977fe640 1 -- 172.21.15.2:0/2089375241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4005ac0 con 0x7ff8b00ce720 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8977fe640 1 -- 172.21.15.2:0/2089375241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a4005c20 con 0x7ff8b00ce720 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8977fe640 1 -- 172.21.15.2:0/2089375241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4007070 con 0x7ff8b00ce720 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b00c6400 con 0x7ff8b00ce720 2023-11-04T01:44:23.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b00c8dd0 con 0x7ff8b00ce720 2023-11-04T01:44:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b00b28c0 con 0x7ff8b00ce720 2023-11-04T01:44:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8977fe640 1 -- 172.21.15.2:0/2089375241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff8a40071d0 con 0x7ff8b00ce720 2023-11-04T01:44:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8977fe640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff89c0664a0 0x7ff89c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8977fe640 1 -- 172.21.15.2:0/2089375241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff8a4082f10 con 0x7ff8b00ce720 2023-11-04T01:44:23.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.731+0000 7ff8aed9d640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff89c0664a0 0x7ff89c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:23.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.735+0000 7ff8aed9d640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff89c0664a0 0x7ff89c068960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000f70 tx=0x7ff8a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:23.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.735+0000 7ff8977fe640 1 -- 172.21.15.2:0/2089375241 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8b00b28c0 con 0x7ff8b00ce720 2023-11-04T01:44:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff8b0159e30 con 0x7ff8b00ce720 2023-11-04T01:44:23.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8977fe640 1 -- 172.21.15.2:0/2089375241 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+137 (secure 0 0 0) 0x7ff8b0159e30 con 0x7ff8b00ce720 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 6, 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "snap-test-pool" 2023-11-04T01:44:23.901 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:23.902 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff89c0664a0 msgr2=0x7ff89c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff89c0664a0 0x7ff89c068960 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0000f70 tx=0x7ff8a0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b00ce720 msgr2=0x7ff8b00c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b00ce720 0x7ff8b00c83a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400c730 tx=0x7ff8a400cbf0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 shutdown_connections 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff89c0664a0 0x7ff89c068960 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff8b0159a50 0x7ff8b00c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8b00ce720 0x7ff8b00c83a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 --2- 172.21.15.2:0/2089375241 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff8b006c1a0 0x7ff8b014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:23.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 >> 172.21.15.2:0/2089375241 conn(0x7ff8b00cebb0 msgr2=0x7ff8b00715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:23.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 shutdown_connections 2023-11-04T01:44:23.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:23.895+0000 7ff8b504a640 1 -- 172.21.15.2:0/2089375241 wait complete. 2023-11-04T01:44:23.920 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:44:23.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:44:24.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f81410be640 1 Processor -- start 2023-11-04T01:44:24.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f81410be640 1 -- start start 2023-11-04T01:44:24.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f81410be640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f813c159e00 0x7f813c0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f81410be640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c070180 0x7f813c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f81410be640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c15d9d0 con 0x7f813c0cb660 2023-11-04T01:44:24.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f81410be640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c15e650 con 0x7f813c159e00 2023-11-04T01:44:24.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f81410be640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c15a1e0 con 0x7f813c070180 2023-11-04T01:44:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813ad9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f813c159e00 0x7f813c0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813a59c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c070180 0x7f813c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813b59e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f813c0cb660 0x7f813c06c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:37720/0 (socket says 172.21.15.2:37720) 2023-11-04T01:44:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813b59e640 1 -- 172.21.15.2:0/2142613540 learned_addr learned my addr 172.21.15.2:0/2142613540 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813a59c640 1 -- 172.21.15.2:0/2142613540 >> v2:172.21.15.90:3300/0 conn(0x7f813c159e00 msgr2=0x7f813c0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813a59c640 1 --2- 172.21.15.2:0/2142613540 >> v2:172.21.15.90:3300/0 conn(0x7f813c159e00 0x7f813c0ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813a59c640 1 -- 172.21.15.2:0/2142613540 >> v1:172.21.15.90:6789/0 conn(0x7f813c0cb660 legacy=0x7f813c06c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813a59c640 1 -- 172.21.15.2:0/2142613540 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c15dcb0 con 0x7f813c070180 2023-11-04T01:44:24.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.035+0000 7f813ad9d640 1 --2- 172.21.15.2:0/2142613540 >> v2:172.21.15.90:3300/0 conn(0x7f813c159e00 0x7f813c0ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:24.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f813a59c640 1 --2- 172.21.15.2:0/2142613540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c070180 0x7f813c0cb120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81300097c0 tx=0x7f813001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f358203c717cbc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f8139d9b640 1 -- 172.21.15.2:0/2142613540 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300ab600 con 0x7f813c070180 2023-11-04T01:44:24.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f8139d9b640 1 -- 172.21.15.2:0/2142613540 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81300a7050 con 0x7f813c070180 2023-11-04T01:44:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f8139d9b640 1 -- 172.21.15.2:0/2142613540 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300ab980 con 0x7f813c070180 2023-11-04T01:44:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- 172.21.15.2:0/2142613540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c070180 msgr2=0x7f813c0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 --2- 172.21.15.2:0/2142613540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c070180 0x7f813c0cb120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81300097c0 tx=0x7f813001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- 172.21.15.2:0/2142613540 shutdown_connections 2023-11-04T01:44:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 --2- 172.21.15.2:0/2142613540 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c070180 0x7f813c0cb120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 --2- 172.21.15.2:0/2142613540 >> v2:172.21.15.90:3300/0 conn(0x7f813c159e00 0x7f813c0ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- 172.21.15.2:0/2142613540 >> 172.21.15.2:0/2142613540 conn(0x7f813c0b0630 msgr2=0x7f813c0b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- 172.21.15.2:0/2142613540 shutdown_connections 2023-11-04T01:44:24.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- 172.21.15.2:0/2142613540 wait complete. 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 Processor -- start 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- start start 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813c070180 0x7f813c14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c0cb660 0x7f813c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f813c159e00 0x7f813c1528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c14c2b0 con 0x7f813c159e00 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c150590 con 0x7f813c070180 2023-11-04T01:44:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.039+0000 7f81410be640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c15c270 con 0x7f813c0cb660 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f813c159e00 0x7f813c1528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f813c159e00 0x7f813c1528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36370/0 (socket says 172.21.15.2:36370) 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 -- 172.21.15.2:0/4218355278 learned_addr learned my addr 172.21.15.2:0/4218355278 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813ad9d640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813c070180 0x7f813c14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813a59c640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c0cb660 0x7f813c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 -- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c0cb660 msgr2=0x7f813c15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c0cb660 0x7f813c15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 -- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813c070180 msgr2=0x7f813c14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813c070180 0x7f813c14bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 -- 172.21.15.2:0/4218355278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009420 con 0x7f813c159e00 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813b59e640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f813c159e00 0x7f813c1528a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f813400ca80 tx=0x7f813400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81237fe640 1 -- 172.21.15.2:0/4218355278 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813400ac30 con 0x7f813c159e00 2023-11-04T01:44:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81237fe640 1 -- 172.21.15.2:0/4218355278 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813400ad90 con 0x7f813c159e00 2023-11-04T01:44:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81237fe640 1 -- 172.21.15.2:0/4218355278 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8134012600 con 0x7f813c159e00 2023-11-04T01:44:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8130009420 con 0x7f813c159e00 2023-11-04T01:44:24.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c0cbbf0 con 0x7f813c159e00 2023-11-04T01:44:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c150700 con 0x7f813c159e00 2023-11-04T01:44:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81237fe640 1 -- 172.21.15.2:0/4218355278 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8134007070 con 0x7f813c159e00 2023-11-04T01:44:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81237fe640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81280664a0 0x7f8128068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f81237fe640 1 -- 172.21.15.2:0/4218355278 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8134083a40 con 0x7f813c159e00 2023-11-04T01:44:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813ad9d640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81280664a0 0x7f8128068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:24.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.043+0000 7f813ad9d640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81280664a0 0x7f8128068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f812c009c80 tx=0x7f812c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:24.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.047+0000 7f81237fe640 1 -- 172.21.15.2:0/4218355278 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8134085e60 con 0x7f813c159e00 2023-11-04T01:44:24.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.203+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f813c0744a0 con 0x7f813c159e00 2023-11-04T01:44:24.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:24.745 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:24.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.959+0000 7f81237fe640 1 -- 172.21.15.2:0/4218355278 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7f81340170b0 con 0x7f813c159e00 2023-11-04T01:44:24.965 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81280664a0 msgr2=0x7f8128068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81280664a0 0x7f8128068960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f812c009c80 tx=0x7f812c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f813c159e00 msgr2=0x7f813c1528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f813c159e00 0x7f813c1528a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f813400ca80 tx=0x7f813400cf40 comp rx=0 tx=0).stop 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 shutdown_connections 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81280664a0 0x7f8128068960 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f813c159e00 0x7f813c1528a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f813c0cb660 0x7f813c15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 --2- 172.21.15.2:0/4218355278 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813c070180 0x7f813c14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 >> 172.21.15.2:0/4218355278 conn(0x7f813c0b0630 msgr2=0x7f813c0c1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 shutdown_connections 2023-11-04T01:44:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:24.963+0000 7f81410be640 1 -- 172.21.15.2:0/4218355278 wait complete. 2023-11-04T01:44:25.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:44:25.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 Processor -- start 2023-11-04T01:44:25.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 -- start start 2023-11-04T01:44:25.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c15d390 0x7fcb3c0cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb3c0d17a0 0x7fcb3c0d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb3c0cf800 0x7fcb3c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c0d2140 con 0x7fcb3c0cf800 2023-11-04T01:44:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c0d01d0 con 0x7fcb3c0d17a0 2023-11-04T01:44:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb42a05640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c15d770 con 0x7fcb3c15d390 2023-11-04T01:44:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb3c0cf800 0x7fcb3c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcb3c0cf800 0x7fcb3c0cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36384/0 (socket says 172.21.15.2:36384) 2023-11-04T01:44:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 -- 172.21.15.2:0/1386518845 learned_addr learned my addr 172.21.15.2:0/1386518845 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb3bfff640 1 --2- 172.21.15.2:0/1386518845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c15d390 0x7fcb3c0cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb3b7fe640 1 --2- 172.21.15.2:0/1386518845 >> v2:172.21.15.90:3300/0 conn(0x7fcb3c0d17a0 0x7fcb3c0d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 -- 172.21.15.2:0/1386518845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c15d390 msgr2=0x7fcb3c0cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 --2- 172.21.15.2:0/1386518845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c15d390 0x7fcb3c0cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 -- 172.21.15.2:0/1386518845 >> v2:172.21.15.90:3300/0 conn(0x7fcb3c0d17a0 msgr2=0x7fcb3c0d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 --2- 172.21.15.2:0/1386518845 >> v2:172.21.15.90:3300/0 conn(0x7fcb3c0d17a0 0x7fcb3c0d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb40fa2640 1 -- 172.21.15.2:0/1386518845 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0cecd0 con 0x7fcb3c0cf800 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.131+0000 7fcb3bfff640 1 --2- 172.21.15.2:0/1386518845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c15d390 0x7fcb3c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb40fa2640 1 --2- 172.21.15.2:0/1386518845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c0cf800 0x7fcb3c0cfc90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c08d130 tx=0x7fcb3401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99063f2d6e24f429 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb3affd640 1 -- 172.21.15.2:0/1386518845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340a5790 con 0x7fcb3c0cf800 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb3affd640 1 -- 172.21.15.2:0/1386518845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb340a58f0 con 0x7fcb3c0cf800 2023-11-04T01:44:25.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb3affd640 1 -- 172.21.15.2:0/1386518845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340a5c80 con 0x7fcb3c0cf800 2023-11-04T01:44:25.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 -- 172.21.15.2:0/1386518845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c0cf800 msgr2=0x7fcb3c0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 --2- 172.21.15.2:0/1386518845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c0cf800 0x7fcb3c0cfc90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c08d130 tx=0x7fcb3401c910 comp rx=0 tx=0).stop 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 -- 172.21.15.2:0/1386518845 shutdown_connections 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 --2- 172.21.15.2:0/1386518845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c0cf800 0x7fcb3c0cfc90 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 --2- 172.21.15.2:0/1386518845 >> v2:172.21.15.90:3300/0 conn(0x7fcb3c0d17a0 0x7fcb3c0d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 --2- 172.21.15.2:0/1386518845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c15d390 0x7fcb3c0cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 -- 172.21.15.2:0/1386518845 >> 172.21.15.2:0/1386518845 conn(0x7fcb3c0d2e60 msgr2=0x7fcb3c0d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 -- 172.21.15.2:0/1386518845 shutdown_connections 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 -- 172.21.15.2:0/1386518845 wait complete. 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 Processor -- start 2023-11-04T01:44:25.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.135+0000 7fcb42a05640 1 -- start start 2023-11-04T01:44:25.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c0cf800 0x7fcb3c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3c0d17a0 0x7fcb3c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c15d390 0x7fcb3c0c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c7d60 con 0x7fcb3c15d390 2023-11-04T01:44:25.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c8040 con 0x7fcb3c0d17a0 2023-11-04T01:44:25.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c8320 con 0x7fcb3c0cf800 2023-11-04T01:44:25.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c15d390 0x7fcb3c0c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c15d390 0x7fcb3c0c73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36398/0 (socket says 172.21.15.2:36398) 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 -- 172.21.15.2:0/2350420191 learned_addr learned my addr 172.21.15.2:0/2350420191 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb3bfff640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c0cf800 0x7fcb3c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb3b7fe640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3c0d17a0 0x7fcb3c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 -- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c0cf800 msgr2=0x7fcb3c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c0cf800 0x7fcb3c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 -- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3c0d17a0 msgr2=0x7fcb3c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3c0d17a0 0x7fcb3c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 -- 172.21.15.2:0/2350420191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb34009b30 con 0x7fcb3c15d390 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb3b7fe640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3c0d17a0 0x7fcb3c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb40fa2640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c15d390 0x7fcb3c0c73a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb340af040 tx=0x7fcb340196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb38ff9640 1 -- 172.21.15.2:0/2350420191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340b8670 con 0x7fcb3c15d390 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb38ff9640 1 -- 172.21.15.2:0/2350420191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb340b87d0 con 0x7fcb3c15d390 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c0c8600 con 0x7fcb3c15d390 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb38ff9640 1 -- 172.21.15.2:0/2350420191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340b8b60 con 0x7fcb3c15d390 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c1577d0 con 0x7fcb3c15d390 2023-11-04T01:44:25.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c0744a0 con 0x7fcb3c15d390 2023-11-04T01:44:25.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.139+0000 7fcb38ff9640 1 -- 172.21.15.2:0/2350420191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb340b8cc0 con 0x7fcb3c15d390 2023-11-04T01:44:25.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.143+0000 7fcb38ff9640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb280664a0 0x7fcb28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:25.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.143+0000 7fcb38ff9640 1 -- 172.21.15.2:0/2350420191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fcb3411f870 con 0x7fcb3c15d390 2023-11-04T01:44:25.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.143+0000 7fcb3bfff640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb280664a0 0x7fcb28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:25.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.143+0000 7fcb3bfff640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb280664a0 0x7fcb28068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcb30006fd0 tx=0x7fcb30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:25.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.143+0000 7fcb38ff9640 1 -- 172.21.15.2:0/2350420191 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb340ecfc0 con 0x7fcb3c15d390 2023-11-04T01:44:25.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.299+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcb3c0c8ab0 con 0x7fcb3c15d390 2023-11-04T01:44:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.963+0000 7fcb38ff9640 1 -- 172.21.15.2:0/2350420191 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcb340f05e0 con 0x7fcb3c15d390 2023-11-04T01:44:25.970 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-04T01:44:25.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb280664a0 msgr2=0x7fcb28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb280664a0 0x7fcb28068960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcb30006fd0 tx=0x7fcb30008040 comp rx=0 tx=0).stop 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c15d390 msgr2=0x7fcb3c0c73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c15d390 0x7fcb3c0c73a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb340af040 tx=0x7fcb340196b0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 shutdown_connections 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb280664a0 0x7fcb28068960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb3c15d390 0x7fcb3c0c73a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb3c0d17a0 0x7fcb3c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 --2- 172.21.15.2:0/2350420191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb3c0cf800 0x7fcb3c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:25.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 >> 172.21.15.2:0/2350420191 conn(0x7fcb3c0d2e60 msgr2=0x7fcb3c158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 shutdown_connections 2023-11-04T01:44:25.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:25.967+0000 7fcb42a05640 1 -- 172.21.15.2:0/2350420191 wait complete. 2023-11-04T01:44:26.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:44:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f7711a57640 1 Processor -- start 2023-11-04T01:44:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f7711a57640 1 -- start start 2023-11-04T01:44:26.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f7711a57640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f770c0cfc80 0x7f770c0d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f7711a57640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0b5e00 con 0x7f770c0cf810 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f7711a57640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c15d490 con 0x7f770c15d0b0 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f7711a57640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0d1520 con 0x7f770c0cfc80 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f770a7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f770c0cf810 0x7f770c0d1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52014/0 (socket says 172.21.15.2:52014) 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.127+0000 7f770a7fc640 1 -- 172.21.15.2:0/2146833697 learned_addr learned my addr 172.21.15.2:0/2146833697 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467219676 0 0) 0x7f770c0b5e00 con 0x7f770c0cf810 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f4003530 con 0x7f770c0cf810 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770b7fe640 1 --2- 172.21.15.2:0/2146833697 >> v2:172.21.15.90:3300/0 conn(0x7f770c0cfc80 0x7f770c0d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3090281695 0 0) 0x7f76f4003530 con 0x7f770c0cf810 2023-11-04T01:44:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 >> v2:172.21.15.90:3300/0 conn(0x7f770c0cfc80 msgr2=0x7f770c0d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 --2- 172.21.15.2:0/2146833697 >> v2:172.21.15.90:3300/0 conn(0x7f770c0cfc80 0x7f770c0d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 >> v1:172.21.15.90:6789/0 conn(0x7f770c15d0b0 legacy=0x7f770c160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0b8930 con 0x7f770c0cf810 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f76fc001a00 con 0x7f770c0cf810 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 >> v1:172.21.15.2:6789/0 conn(0x7f770c0cf810 legacy=0x7f770c0d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76f40039d0 0x7f76f4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f40047d0 0x7f76f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f4005190 0x7f76f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0d1520 con 0x7f76f40047d0 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f400c090 con 0x7f76f40039d0 2023-11-04T01:44:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f400c250 con 0x7f76f4005190 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770a7fc640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f40047d0 0x7f76f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770affd640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76f40039d0 0x7f76f4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770b7fe640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f4005190 0x7f76f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770a7fc640 1 -- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f4005190 msgr2=0x7f76f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770a7fc640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f4005190 0x7f76f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770a7fc640 1 -- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76f40039d0 msgr2=0x7f76f4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770a7fc640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76f40039d0 0x7f76f4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770a7fc640 1 -- 172.21.15.2:0/2146833697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4003530 con 0x7f76f40047d0 2023-11-04T01:44:26.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770b7fe640 1 -- 172.21.15.2:0/2146833697 reap_dead start 2023-11-04T01:44:26.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f770a7fc640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f40047d0 0x7f76f4004c50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00a750 tx=0x7f76fc01f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294ca6a9a9719728 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0ac5f0 con 0x7f76f40047d0 2023-11-04T01:44:26.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc0ac770 con 0x7f76f40047d0 2023-11-04T01:44:26.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.131+0000 7f7709ffb640 1 -- 172.21.15.2:0/2146833697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0acb20 con 0x7f76f40047d0 2023-11-04T01:44:26.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- 172.21.15.2:0/2146833697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f40047d0 msgr2=0x7f76f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f40047d0 0x7f76f4004c50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00a750 tx=0x7f76fc01f940 comp rx=0 tx=0).stop 2023-11-04T01:44:26.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- 172.21.15.2:0/2146833697 shutdown_connections 2023-11-04T01:44:26.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 --2- 172.21.15.2:0/2146833697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76f40047d0 0x7f76f4004c50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- 172.21.15.2:0/2146833697 >> 172.21.15.2:0/2146833697 conn(0x7f770c06a890 msgr2=0x7f770c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:26.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- 172.21.15.2:0/2146833697 shutdown_connections 2023-11-04T01:44:26.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- 172.21.15.2:0/2146833697 wait complete. 2023-11-04T01:44:26.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 Processor -- start 2023-11-04T01:44:26.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- start start 2023-11-04T01:44:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f40047d0 0x7f770c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c154640 0x7f770c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f770c0c8e00 0x7f770c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0b5770 con 0x7f770c0c8e00 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0c7d60 con 0x7f770c154640 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0c8040 con 0x7f76f40047d0 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f770c0c8e00 0x7f770c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f770c0c8e00 0x7f770c0c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36420/0 (socket says 172.21.15.2:36420) 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 -- 172.21.15.2:0/3886148034 learned_addr learned my addr 172.21.15.2:0/3886148034 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770a7fc640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c154640 0x7f770c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770affd640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f40047d0 0x7f770c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 -- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f40047d0 msgr2=0x7f770c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f40047d0 0x7f770c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 -- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c154640 msgr2=0x7f770c0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c154640 0x7f770c0b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 -- 172.21.15.2:0/3886148034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0c8320 con 0x7f770c0c8e00 2023-11-04T01:44:26.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f770b7fe640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f770c0c8e00 0x7f770c0c9280 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f770c0ceb40 tx=0x7f7704011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f76f3fff640 1 -- 172.21.15.2:0/3886148034 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704004440 con 0x7f770c0c8e00 2023-11-04T01:44:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f76f3fff640 1 -- 172.21.15.2:0/3886148034 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7704003620 con 0x7f770c0c8e00 2023-11-04T01:44:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c0c8600 con 0x7f770c0c8e00 2023-11-04T01:44:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.135+0000 7f76f3fff640 1 -- 172.21.15.2:0/3886148034 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704003a10 con 0x7f770c0c8e00 2023-11-04T01:44:26.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.139+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c0c79a0 con 0x7f770c0c8e00 2023-11-04T01:44:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.139+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0744a0 con 0x7f770c0c8e00 2023-11-04T01:44:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.139+0000 7f76f3fff640 1 -- 172.21.15.2:0/3886148034 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7704003b70 con 0x7f770c0c8e00 2023-11-04T01:44:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.139+0000 7f76f3fff640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76f80664a0 0x7f76f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.139+0000 7f76f3fff640 1 -- 172.21.15.2:0/3886148034 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7704084ec0 con 0x7f770c0c8e00 2023-11-04T01:44:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.139+0000 7f770affd640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76f80664a0 0x7f76f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:26.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.139+0000 7f770affd640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76f80664a0 0x7f76f8068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b7e60 tx=0x7f7700009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:26.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.143+0000 7f76f3fff640 1 -- 172.21.15.2:0/3886148034 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7704052320 con 0x7f770c0c8e00 2023-11-04T01:44:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:26.331+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f770c0d29c0 con 0x7f770c0c8e00 2023-11-04T01:44:27.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.023+0000 7f76f3fff640 1 -- 172.21.15.2:0/3886148034 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v24) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7704055940 con 0x7f770c0c8e00 2023-11-04T01:44:27.035 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 9 and data pool 10 2023-11-04T01:44:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76f80664a0 msgr2=0x7f76f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76f80664a0 0x7f76f8068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b7e60 tx=0x7f7700009040 comp rx=0 tx=0).stop 2023-11-04T01:44:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f770c0c8e00 msgr2=0x7f770c0c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f770c0c8e00 0x7f770c0c9280 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f770c0ceb40 tx=0x7f7704011920 comp rx=0 tx=0).stop 2023-11-04T01:44:27.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 shutdown_connections 2023-11-04T01:44:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76f80664a0 0x7f76f8068960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f770c0c8e00 0x7f770c0c9280 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f770c154640 0x7f770c0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 --2- 172.21.15.2:0/3886148034 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76f40047d0 0x7f770c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 >> 172.21.15.2:0/3886148034 conn(0x7f770c06a890 msgr2=0x7f770c0d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 shutdown_connections 2023-11-04T01:44:27.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.043+0000 7f7711a57640 1 -- 172.21.15.2:0/3886148034 wait complete. 2023-11-04T01:44:27.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:27.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601ef8b640 1 Processor -- start 2023-11-04T01:44:27.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601ef8b640 1 -- start start 2023-11-04T01:44:27.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601ef8b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f60180b4990 0x7f60180b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601ef8b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60180cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601ef8b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60180b6070 con 0x7f60180d0690 2023-11-04T01:44:27.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601ef8b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60180b8ed0 con 0x7f60180b4990 2023-11-04T01:44:27.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601ef8b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180b52b0 con 0x7f60180b74f0 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601cd27640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f60180b4990 0x7f60180b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601d528640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60180cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f6017fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f60180d0690 0x7f60180cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:37728/0 (socket says 172.21.15.2:37728) 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f6017fff640 1 -- 172.21.15.2:0/765807853 learned_addr learned my addr 172.21.15.2:0/765807853 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601cd27640 1 --2- 172.21.15.2:0/765807853 >> v2:172.21.15.90:3300/0 conn(0x7f60180b4990 0x7f60180b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:33630/0 (socket says 172.21.15.2:33630) 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601cd27640 1 -- 172.21.15.2:0/765807853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 msgr2=0x7f60180cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601cd27640 1 --2- 172.21.15.2:0/765807853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60180cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601cd27640 1 -- 172.21.15.2:0/765807853 >> v1:172.21.15.90:6789/0 conn(0x7f60180d0690 legacy=0x7f60180cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.187+0000 7f601cd27640 1 -- 172.21.15.2:0/765807853 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180d1ce0 con 0x7f60180b4990 2023-11-04T01:44:27.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601cd27640 1 --2- 172.21.15.2:0/765807853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180b4990 0x7f60180b4d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f60080097c0 tx=0x7f600801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3213d5aba0133cbd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f60177fe640 1 -- 172.21.15.2:0/765807853 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080a8970 con 0x7f60180b4990 2023-11-04T01:44:27.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f60177fe640 1 -- 172.21.15.2:0/765807853 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60080a8ad0 con 0x7f60180b4990 2023-11-04T01:44:27.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f60177fe640 1 -- 172.21.15.2:0/765807853 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080a8e60 con 0x7f60180b4990 2023-11-04T01:44:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- 172.21.15.2:0/765807853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180b4990 msgr2=0x7f60180b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 --2- 172.21.15.2:0/765807853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180b4990 0x7f60180b4d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f60080097c0 tx=0x7f600801ec70 comp rx=0 tx=0).stop 2023-11-04T01:44:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- 172.21.15.2:0/765807853 shutdown_connections 2023-11-04T01:44:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 --2- 172.21.15.2:0/765807853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60180cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 --2- 172.21.15.2:0/765807853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180b4990 0x7f60180b4d70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- 172.21.15.2:0/765807853 >> 172.21.15.2:0/765807853 conn(0x7f60180cf990 msgr2=0x7f60180cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- 172.21.15.2:0/765807853 shutdown_connections 2023-11-04T01:44:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- 172.21.15.2:0/765807853 wait complete. 2023-11-04T01:44:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 Processor -- start 2023-11-04T01:44:27.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- start start 2023-11-04T01:44:27.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60180b4990 0x7f60180a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60181f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180d0690 0x7f6018152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180ab030 con 0x7f60180b4990 2023-11-04T01:44:27.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60180a9f90 con 0x7f60180d0690 2023-11-04T01:44:27.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601ef8b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60180aa270 con 0x7f60180b74f0 2023-11-04T01:44:27.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.191+0000 7f601cd27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60180b4990 0x7f60180a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60180b4990 0x7f60180a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36436/0 (socket says 172.21.15.2:36436) 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 -- 172.21.15.2:0/512680976 learned_addr learned my addr 172.21.15.2:0/512680976 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f6017fff640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60181f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601d528640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180d0690 0x7f6018152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 -- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 msgr2=0x7f60181f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60181f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 -- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180d0690 msgr2=0x7f6018152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180d0690 0x7f6018152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 -- 172.21.15.2:0/512680976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6008009420 con 0x7f60180b4990 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601cd27640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60180b4990 0x7f60180a9900 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f600801d320 tx=0x7f600801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f60157fa640 1 -- 172.21.15.2:0/512680976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080b1e00 con 0x7f60180b4990 2023-11-04T01:44:27.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f60157fa640 1 -- 172.21.15.2:0/512680976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008006e20 con 0x7f60180b4990 2023-11-04T01:44:27.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60180aa550 con 0x7f60180b4990 2023-11-04T01:44:27.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f60157fa640 1 -- 172.21.15.2:0/512680976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080b9630 con 0x7f60180b4990 2023-11-04T01:44:27.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60180aab10 con 0x7f60180b4990 2023-11-04T01:44:27.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60180744a0 con 0x7f60180b4990 2023-11-04T01:44:27.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f60157fa640 1 -- 172.21.15.2:0/512680976 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f60080b7040 con 0x7f60180b4990 2023-11-04T01:44:27.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f60157fa640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60040664a0 0x7f6004068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f60157fa640 1 -- 172.21.15.2:0/512680976 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6008121b50 con 0x7f60180b4990 2023-11-04T01:44:27.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f6017fff640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60040664a0 0x7f6004068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.195+0000 7f6017fff640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60040664a0 0x7f6004068960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60180cc370 tx=0x7f600c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.199+0000 7f60157fa640 1 -- 172.21.15.2:0/512680976 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60080eef90 con 0x7f60180b4990 2023-11-04T01:44:27.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.355+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60180b6e10 con 0x7f60180b4990 2023-11-04T01:44:27.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.359+0000 7f60157fa640 1 -- 172.21.15.2:0/512680976 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18213 (secure 0 0 0) 0x7f60080b5020 con 0x7f60180b4990 2023-11-04T01:44:27.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:27.366 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":63,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:26.336898+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:44:24.247898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:44:25.345255+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60040664a0 msgr2=0x7f6004068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60040664a0 0x7f6004068960 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f60180cc370 tx=0x7f600c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60180b4990 msgr2=0x7f60180a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60180b4990 0x7f60180a9900 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f600801d320 tx=0x7f600801ba10 comp rx=0 tx=0).stop 2023-11-04T01:44:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 shutdown_connections 2023-11-04T01:44:27.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60040664a0 0x7f6004068960 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60180d0690 0x7f6018152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60180b74f0 0x7f60181f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 --2- 172.21.15.2:0/512680976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60180b4990 0x7f60180a9900 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 >> 172.21.15.2:0/512680976 conn(0x7f60180cf990 msgr2=0x7f60180cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 shutdown_connections 2023-11-04T01:44:27.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.363+0000 7f601ef8b640 1 -- 172.21.15.2:0/512680976 wait complete. 2023-11-04T01:44:27.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f52372cb640 1 Processor -- start 2023-11-04T01:44:27.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f52372cb640 1 -- start start 2023-11-04T01:44:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f52372cb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52300b4990 0x7f52300b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f52372cb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300d0690 0x7f52300cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f52372cb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300b6070 con 0x7f52300d0ae0 2023-11-04T01:44:27.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f52372cb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300b8ed0 con 0x7f52300b4990 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f52372cb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b52b0 con 0x7f52300d0690 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5235067640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52300b4990 0x7f52300b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5235067640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52300b4990 0x7f52300b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36452/0 (socket says 172.21.15.2:36452) 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5235067640 1 -- 172.21.15.2:0/1815351758 learned_addr learned my addr 172.21.15.2:0/1815351758 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5234866640 1 --2- 172.21.15.2:0/1815351758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300d0690 0x7f52300cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5235067640 1 -- 172.21.15.2:0/1815351758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300d0690 msgr2=0x7f52300cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5235067640 1 --2- 172.21.15.2:0/1815351758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300d0690 0x7f52300cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5235067640 1 -- 172.21.15.2:0/1815351758 >> v1:172.21.15.90:6789/0 conn(0x7f52300d0ae0 legacy=0x7f52300cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.499+0000 7f5235067640 1 -- 172.21.15.2:0/1815351758 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300d1ce0 con 0x7f52300b4990 2023-11-04T01:44:27.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5235067640 1 --2- 172.21.15.2:0/1815351758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300b4990 0x7f52300b4d70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f522c009870 tx=0x7f522c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201d00919fad42cc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5227fff640 1 -- 172.21.15.2:0/1815351758 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0a8a30 con 0x7f52300b4990 2023-11-04T01:44:27.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5227fff640 1 -- 172.21.15.2:0/1815351758 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0a8b90 con 0x7f52300b4990 2023-11-04T01:44:27.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5227fff640 1 -- 172.21.15.2:0/1815351758 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0b0440 con 0x7f52300b4990 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- 172.21.15.2:0/1815351758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300b4990 msgr2=0x7f52300b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 --2- 172.21.15.2:0/1815351758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300b4990 0x7f52300b4d70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f522c009870 tx=0x7f522c01ed30 comp rx=0 tx=0).stop 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- 172.21.15.2:0/1815351758 shutdown_connections 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 --2- 172.21.15.2:0/1815351758 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300d0690 0x7f52300cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 --2- 172.21.15.2:0/1815351758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300b4990 0x7f52300b4d70 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- 172.21.15.2:0/1815351758 >> 172.21.15.2:0/1815351758 conn(0x7f52300cf990 msgr2=0x7f52300cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- 172.21.15.2:0/1815351758 shutdown_connections 2023-11-04T01:44:27.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- 172.21.15.2:0/1815351758 wait complete. 2023-11-04T01:44:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 Processor -- start 2023-11-04T01:44:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- start start 2023-11-04T01:44:27.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300b4990 0x7f52301578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300d0690 0x7f52300cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52300d0ae0 0x7f52301f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300ca6d0 con 0x7f52300d0690 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300cc610 con 0x7f52300d0ae0 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f52372cb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300ca080 con 0x7f52300b4990 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300d0690 0x7f52300cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300d0690 0x7f52300cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36468/0 (socket says 172.21.15.2:36468) 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 -- 172.21.15.2:0/3199104990 learned_addr learned my addr 172.21.15.2:0/3199104990 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5235868640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52300d0ae0 0x7f52301f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5235067640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300b4990 0x7f52301578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 -- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300b4990 msgr2=0x7f52301578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300b4990 0x7f52301578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 -- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52300d0ae0 msgr2=0x7f52301f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52300d0ae0 0x7f52301f2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 -- 172.21.15.2:0/3199104990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c0094d0 con 0x7f52300d0690 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5235868640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52300d0ae0 0x7f52301f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.503+0000 7f5234866640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300d0690 0x7f52300cbcc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f522000d7d0 tx=0x7f522000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5225ffb640 1 -- 172.21.15.2:0/3199104990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000b6c0 con 0x7f52300d0690 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5225ffb640 1 -- 172.21.15.2:0/3199104990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000b820 con 0x7f52300d0690 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52300ca360 con 0x7f52300d0690 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5225ffb640 1 -- 172.21.15.2:0/3199104990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522000bbb0 con 0x7f52300d0690 2023-11-04T01:44:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52300ccac0 con 0x7f52300d0690 2023-11-04T01:44:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52300744a0 con 0x7f52300d0690 2023-11-04T01:44:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5225ffb640 1 -- 172.21.15.2:0/3199104990 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f522000bd10 con 0x7f52300d0690 2023-11-04T01:44:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5225ffb640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52140664a0 0x7f5214068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5225ffb640 1 -- 172.21.15.2:0/3199104990 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5220084ee0 con 0x7f52300d0690 2023-11-04T01:44:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5235067640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52140664a0 0x7f5214068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.507+0000 7f5235067640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52140664a0 0x7f5214068960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b2000 tx=0x7f522c0aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.511+0000 7f5225ffb640 1 -- 172.21.15.2:0/3199104990 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52200522e0 con 0x7f52300d0690 2023-11-04T01:44:27.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.659+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52300ca520 con 0x7f52300d0690 2023-11-04T01:44:27.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.663+0000 7f5225ffb640 1 -- 172.21.15.2:0/3199104990 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18213 (secure 0 0 0) 0x7f5220055900 con 0x7f52300d0690 2023-11-04T01:44:27.670 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:27.671 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":63,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:26.336898+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:44:24.247898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:44:25.345255+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:27.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52140664a0 msgr2=0x7f5214068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52140664a0 0x7f5214068960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f522c0b2000 tx=0x7f522c0aa070 comp rx=0 tx=0).stop 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300d0690 msgr2=0x7f52300cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300d0690 0x7f52300cbcc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f522000d7d0 tx=0x7f522000dc90 comp rx=0 tx=0).stop 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 shutdown_connections 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52140664a0 0x7f5214068960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52300d0ae0 0x7f52301f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52300d0690 0x7f52300cbcc0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 --2- 172.21.15.2:0/3199104990 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52300b4990 0x7f52301578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 >> 172.21.15.2:0/3199104990 conn(0x7f52300cf990 msgr2=0x7f52300d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 shutdown_connections 2023-11-04T01:44:27.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.667+0000 7f52372cb640 1 -- 172.21.15.2:0/3199104990 wait complete. 2023-11-04T01:44:27.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:44:27.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e9a0e640 1 Processor -- start 2023-11-04T01:44:27.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e9a0e640 1 -- start start 2023-11-04T01:44:27.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e9a0e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84e40cd670 0x7f84e40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e9a0e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84e406cfc0 0x7f84e415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e9a0e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e4160c50 con 0x7f84e40cda50 2023-11-04T01:44:27.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e9a0e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e40cedf0 con 0x7f84e40cd670 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e9a0e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e4160ef0 con 0x7f84e406cfc0 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e2ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84e40cd670 0x7f84e40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e2ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f84e40cd670 0x7f84e40ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36472/0 (socket says 172.21.15.2:36472) 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e2ffd640 1 -- 172.21.15.2:0/3663416658 learned_addr learned my addr 172.21.15.2:0/3663416658 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f84e40cda50 0x7f84e40af8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52028/0 (socket says 172.21.15.2:52028) 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e27fc640 1 --2- 172.21.15.2:0/3663416658 >> v2:172.21.15.90:3300/0 conn(0x7f84e406cfc0 0x7f84e415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e2ffd640 1 -- 172.21.15.2:0/3663416658 >> v2:172.21.15.90:3300/0 conn(0x7f84e406cfc0 msgr2=0x7f84e415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e2ffd640 1 --2- 172.21.15.2:0/3663416658 >> v2:172.21.15.90:3300/0 conn(0x7f84e406cfc0 0x7f84e415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e1ffb640 1 -- 172.21.15.2:0/3663416658 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461976195 0 0) 0x7f84e4160c50 con 0x7f84e40cda50 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e2ffd640 1 -- 172.21.15.2:0/3663416658 >> v1:172.21.15.2:6789/0 conn(0x7f84e40cda50 legacy=0x7f84e40af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.799+0000 7f84e2ffd640 1 -- 172.21.15.2:0/3663416658 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e41611d0 con 0x7f84e40cd670 2023-11-04T01:44:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e2ffd640 1 --2- 172.21.15.2:0/3663416658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40ce8b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f84e406f190 tx=0x7f84d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ed5be784a551a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e1ffb640 1 -- 172.21.15.2:0/3663416658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40aa430 con 0x7f84e40cd670 2023-11-04T01:44:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e1ffb640 1 -- 172.21.15.2:0/3663416658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d40aa590 con 0x7f84e40cd670 2023-11-04T01:44:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e1ffb640 1 -- 172.21.15.2:0/3663416658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40aa920 con 0x7f84e40cd670 2023-11-04T01:44:27.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- 172.21.15.2:0/3663416658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 msgr2=0x7f84e40ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/3663416658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40ce8b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f84e406f190 tx=0x7f84d401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- 172.21.15.2:0/3663416658 shutdown_connections 2023-11-04T01:44:27.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/3663416658 >> v2:172.21.15.90:3300/0 conn(0x7f84e406cfc0 0x7f84e415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/3663416658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40ce8b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- 172.21.15.2:0/3663416658 >> 172.21.15.2:0/3663416658 conn(0x7f84e4065dc0 msgr2=0x7f84e40661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:27.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- 172.21.15.2:0/3663416658 shutdown_connections 2023-11-04T01:44:27.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- 172.21.15.2:0/3663416658 wait complete. 2023-11-04T01:44:27.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 Processor -- start 2023-11-04T01:44:27.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- start start 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e406cfc0 0x7f84e4152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e40cda50 0x7f84e4153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40caba0 con 0x7f84e40cd670 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40c4b70 con 0x7f84e40cda50 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e9a0e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40ca5e0 con 0x7f84e406cfc0 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36488/0 (socket says 172.21.15.2:36488) 2023-11-04T01:44:27.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.803+0000 7f84e27fc640 1 -- 172.21.15.2:0/2054393499 learned_addr learned my addr 172.21.15.2:0/2054393499 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e37fe640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e40cda50 0x7f84e4153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e2ffd640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e406cfc0 0x7f84e4152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e27fc640 1 -- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e406cfc0 msgr2=0x7f84e4152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e27fc640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e406cfc0 0x7f84e4152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e27fc640 1 -- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e40cda50 msgr2=0x7f84e4153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e27fc640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e40cda50 0x7f84e4153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e27fc640 1 -- 172.21.15.2:0/2054393499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d4009480 con 0x7f84e40cd670 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e37fe640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e40cda50 0x7f84e4153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e27fc640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40c9cb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f84d800d5d0 tx=0x7f84d800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84cbfff640 1 -- 172.21.15.2:0/2054393499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8004240 con 0x7f84e40cd670 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84cbfff640 1 -- 172.21.15.2:0/2054393499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80043a0 con 0x7f84e40cd670 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e40ca8c0 con 0x7f84e40cd670 2023-11-04T01:44:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84cbfff640 1 -- 172.21.15.2:0/2054393499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8003840 con 0x7f84e40cd670 2023-11-04T01:44:27.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e415d650 con 0x7f84e40cd670 2023-11-04T01:44:27.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e40c4ce0 con 0x7f84e40cd670 2023-11-04T01:44:27.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84cbfff640 1 -- 172.21.15.2:0/2054393499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84d80039a0 con 0x7f84e40cd670 2023-11-04T01:44:27.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84cbfff640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84d00664d0 0x7f84d0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84cbfff640 1 -- 172.21.15.2:0/2054393499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84d8084050 con 0x7f84e40cd670 2023-11-04T01:44:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e2ffd640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84d00664d0 0x7f84d0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.807+0000 7f84e2ffd640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84d00664d0 0x7f84d0068990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f84d40ae000 tx=0x7f84d40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:27.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.811+0000 7f84cbfff640 1 -- 172.21.15.2:0/2054393499 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84d8051400 con 0x7f84e40cd670 2023-11-04T01:44:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:27.999+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f84e40675f0 con 0x7f84e40cd670 2023-11-04T01:44:28.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.035+0000 7f84cbfff640 1 -- 172.21.15.2:0/2054393499 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f84d8054a20 con 0x7f84e40cd670 2023-11-04T01:44:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84d00664d0 msgr2=0x7f84d0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84d00664d0 0x7f84d0068990 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f84d40ae000 tx=0x7f84d40a7000 comp rx=0 tx=0).stop 2023-11-04T01:44:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 msgr2=0x7f84e40c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40c9cb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f84d800d5d0 tx=0x7f84d800da90 comp rx=0 tx=0).stop 2023-11-04T01:44:28.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 shutdown_connections 2023-11-04T01:44:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f84d00664d0 0x7f84d0068990 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84e40cda50 0x7f84e4153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f84e40cd670 0x7f84e40c9cb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 --2- 172.21.15.2:0/2054393499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f84e406cfc0 0x7f84e4152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 >> 172.21.15.2:0/2054393499 conn(0x7f84e4065dc0 msgr2=0x7f84e406bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 shutdown_connections 2023-11-04T01:44:28.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.039+0000 7f84e9a0e640 1 -- 172.21.15.2:0/2054393499 wait complete. 2023-11-04T01:44:28.061 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:44:28.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:44:28.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f156ddaa640 1 Processor -- start 2023-11-04T01:44:28.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f156ddaa640 1 -- start start 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f156ddaa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f15680ce1b0 0x7f156815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f156ddaa640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f156806d160 0x7f156815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f156ddaa640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156815e800 con 0x7f156815af70 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f156ddaa640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1568071200 con 0x7f156806d160 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f156ddaa640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156806c0c0 con 0x7f15680ce1b0 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f1567fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f156806d160 0x7f156815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f15677fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f156815af70 0x7f15680cdaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52030/0 (socket says 172.21.15.2:52030) 2023-11-04T01:44:28.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f15677fe640 1 -- 172.21.15.2:0/3976384539 learned_addr learned my addr 172.21.15.2:0/3976384539 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:28.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f1566ffd640 1 --2- 172.21.15.2:0/3976384539 >> v2:172.21.15.90:3300/0 conn(0x7f15680ce1b0 0x7f156815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:28.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f1567fff640 1 -- 172.21.15.2:0/3976384539 >> v2:172.21.15.90:3300/0 conn(0x7f15680ce1b0 msgr2=0x7f156815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:28.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f1567fff640 1 --2- 172.21.15.2:0/3976384539 >> v2:172.21.15.90:3300/0 conn(0x7f15680ce1b0 0x7f156815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f1567fff640 1 -- 172.21.15.2:0/3976384539 >> v1:172.21.15.2:6789/0 conn(0x7f156815af70 legacy=0x7f15680cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:28.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.175+0000 7f1567fff640 1 -- 172.21.15.2:0/3976384539 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156806c3a0 con 0x7f156806d160 2023-11-04T01:44:28.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f1567fff640 1 --2- 172.21.15.2:0/3976384539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156806d160 0x7f156815e2c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f15680cfb90 tx=0x7f156001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a73208aeef0e2bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:28.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f15667fc640 1 -- 172.21.15.2:0/3976384539 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15600a58c0 con 0x7f156806d160 2023-11-04T01:44:28.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f15667fc640 1 -- 172.21.15.2:0/3976384539 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15600a5a20 con 0x7f156806d160 2023-11-04T01:44:28.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f15667fc640 1 -- 172.21.15.2:0/3976384539 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15600a5db0 con 0x7f156806d160 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 -- 172.21.15.2:0/3976384539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156806d160 msgr2=0x7f156815e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3976384539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156806d160 0x7f156815e2c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f15680cfb90 tx=0x7f156001c910 comp rx=0 tx=0).stop 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 -- 172.21.15.2:0/3976384539 shutdown_connections 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3976384539 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156806d160 0x7f156815e2c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3976384539 >> v2:172.21.15.90:3300/0 conn(0x7f15680ce1b0 0x7f156815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 -- 172.21.15.2:0/3976384539 >> 172.21.15.2:0/3976384539 conn(0x7f15680cb510 msgr2=0x7f15680cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 -- 172.21.15.2:0/3976384539 shutdown_connections 2023-11-04T01:44:28.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 -- 172.21.15.2:0/3976384539 wait complete. 2023-11-04T01:44:28.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 Processor -- start 2023-11-04T01:44:28.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.179+0000 7f156ddaa640 1 -- start start 2023-11-04T01:44:28.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f156806d160 0x7f15680c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:28.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15680ce1b0 0x7f1568150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156815af70 0x7f15680c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15680c4570 con 0x7f156815af70 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15680c2fd0 con 0x7f15680ce1b0 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15680c3270 con 0x7f156806d160 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156815af70 0x7f15680c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156815af70 0x7f15680c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36502/0 (socket says 172.21.15.2:36502) 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 -- 172.21.15.2:0/3592221565 learned_addr learned my addr 172.21.15.2:0/3592221565 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 -- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f156806d160 msgr2=0x7f15680c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1566ffd640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15680ce1b0 0x7f1568150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f15677fe640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f156806d160 0x7f15680c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:28.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f156806d160 0x7f15680c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 -- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15680ce1b0 msgr2=0x7f1568150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15680ce1b0 0x7f1568150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 -- 172.21.15.2:0/3592221565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560009a70 con 0x7f156815af70 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f1567fff640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156815af70 0x7f15680c48d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f15600b0040 tx=0x7f15600196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f154ffff640 1 -- 172.21.15.2:0/3592221565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15600b9860 con 0x7f156815af70 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f154ffff640 1 -- 172.21.15.2:0/3592221565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15600b99c0 con 0x7f156815af70 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15680c3550 con 0x7f156815af70 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f154ffff640 1 -- 172.21.15.2:0/3592221565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15600b9d70 con 0x7f156815af70 2023-11-04T01:44:28.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15680c3b10 con 0x7f156815af70 2023-11-04T01:44:28.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15680c3d00 con 0x7f156815af70 2023-11-04T01:44:28.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f154ffff640 1 -- 172.21.15.2:0/3592221565 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15600c4460 con 0x7f156815af70 2023-11-04T01:44:28.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f154ffff640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15540664a0 0x7f1554068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:28.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f154ffff640 1 -- 172.21.15.2:0/3592221565 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f156011fe40 con 0x7f156815af70 2023-11-04T01:44:28.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.183+0000 7f15677fe640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15540664a0 0x7f1554068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:28.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.187+0000 7f15677fe640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15540664a0 0x7f1554068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1558000f70 tx=0x7f1558009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:28.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.187+0000 7f154ffff640 1 -- 172.21.15.2:0/3592221565 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15600ed240 con 0x7f156815af70 2023-11-04T01:44:28.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:28.371+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f15680744a0 con 0x7f156815af70 2023-11-04T01:44:29.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.039+0000 7f154ffff640 1 -- 172.21.15.2:0/3592221565 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f15600f0860 con 0x7f156815af70 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15540664a0 msgr2=0x7f1554068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15540664a0 0x7f1554068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1558000f70 tx=0x7f1558009040 comp rx=0 tx=0).stop 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156815af70 msgr2=0x7f15680c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156815af70 0x7f15680c48d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f15600b0040 tx=0x7f15600196b0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 shutdown_connections 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15540664a0 0x7f1554068960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f156815af70 0x7f15680c48d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15680ce1b0 0x7f1568150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 --2- 172.21.15.2:0/3592221565 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f156806d160 0x7f15680c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 >> 172.21.15.2:0/3592221565 conn(0x7f15680cb510 msgr2=0x7f15680ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:29.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 shutdown_connections 2023-11-04T01:44:29.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.043+0000 7f156ddaa640 1 -- 172.21.15.2:0/3592221565 wait complete. 2023-11-04T01:44:29.073 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:44:29.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.195+0000 7efdb191b640 1 Processor -- start 2023-11-04T01:44:29.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.195+0000 7efdb191b640 1 -- start start 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdb191b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15aee0 0x7efdac06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdb191b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efdac0b1850 0x7efdac06c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdb191b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac06fe00 con 0x7efdac0cb040 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdb191b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdac0cabb0 con 0x7efdac0b1850 2023-11-04T01:44:29.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdb191b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0ca530 con 0x7efdac15aee0 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaa7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efdac0cb040 0x7efdac0c9050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52036/0 (socket says 172.21.15.2:52036) 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaa7fc640 1 -- 172.21.15.2:0/868083829 learned_addr learned my addr 172.21.15.2:0/868083829 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaaffd640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15aee0 0x7efdac06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdab7fe640 1 --2- 172.21.15.2:0/868083829 >> v2:172.21.15.90:3300/0 conn(0x7efdac0b1850 0x7efdac06c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138060308 0 0) 0x7efda0001120 con 0x7efdac0cb040 2023-11-04T01:44:29.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd94003530 con 0x7efdac0cb040 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3141958712 0 0) 0x7efd94003530 con 0x7efdac0cb040 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15aee0 msgr2=0x7efdac06f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15aee0 0x7efdac06f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 >> v2:172.21.15.90:3300/0 conn(0x7efdac0b1850 msgr2=0x7efdac06c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 --2- 172.21.15.2:0/868083829 >> v2:172.21.15.90:3300/0 conn(0x7efdac0b1850 0x7efdac06c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0c9d20 con 0x7efdac0cb040 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7efda0001810 con 0x7efdac0cb040 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 >> v1:172.21.15.2:6789/0 conn(0x7efdac0cb040 legacy=0x7efdac0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd94003980 0x7efd94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd940047d0 0x7efd94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15aee0 0x7efd94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0cabb0 con 0x7efd94003980 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0ca530 con 0x7efd940047d0 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400b990 con 0x7efdac15aee0 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaaffd640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd94003980 0x7efd94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaaffd640 1 -- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15aee0 msgr2=0x7efd94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaa7fc640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd940047d0 0x7efd94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaaffd640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15aee0 0x7efd94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaaffd640 1 -- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd940047d0 msgr2=0x7efd94004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaaffd640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd940047d0 0x7efd94004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.199+0000 7efdaaffd640 1 -- 172.21.15.2:0/868083829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94003530 con 0x7efd94003980 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd94003980 0x7efd94003da0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009ae0 tx=0x7efd9c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cfcf15ef0b7e01 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0a6470 con 0x7efd94003980 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c0a65d0 con 0x7efd94003980 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efda9ffb640 1 -- 172.21.15.2:0/868083829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0a6980 con 0x7efd94003980 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- 172.21.15.2:0/868083829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd94003980 msgr2=0x7efd94003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 --2- 172.21.15.2:0/868083829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd94003980 0x7efd94003da0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009ae0 tx=0x7efd9c01ca60 comp rx=0 tx=0).stop 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdab7fe640 1 -- 172.21.15.2:0/868083829 reap_dead start 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- 172.21.15.2:0/868083829 shutdown_connections 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- 172.21.15.2:0/868083829 >> 172.21.15.2:0/868083829 conn(0x7efdac0cea00 msgr2=0x7efdac0cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- 172.21.15.2:0/868083829 shutdown_connections 2023-11-04T01:44:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- 172.21.15.2:0/868083829 wait complete. 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 Processor -- start 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- start start 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdac0c7320 0x7efdac15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15e1a0 0x7efdac158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdac0c7700 0x7efdac158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0c86e0 con 0x7efdac0c7320 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac15b440 con 0x7efdac0c7700 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0b04a0 con 0x7efdac15e1a0 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdac0c7320 0x7efdac15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdac0c7320 0x7efdac15dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36520/0 (socket says 172.21.15.2:36520) 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 -- 172.21.15.2:0/3753350250 learned_addr learned my addr 172.21.15.2:0/3753350250 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdab7fe640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdac0c7700 0x7efdac158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaa7fc640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15e1a0 0x7efdac158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 -- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15e1a0 msgr2=0x7efdac158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15e1a0 0x7efdac158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 -- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdac0c7700 msgr2=0x7efdac158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdac0c7700 0x7efdac158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 -- 172.21.15.2:0/3753350250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0b0780 con 0x7efdac0c7320 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdaaffd640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdac0c7320 0x7efdac15dc60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009ae0 tx=0x7efd9c019800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efd93fff640 1 -- 172.21.15.2:0/3753350250 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0a6d40 con 0x7efdac0c7320 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efd93fff640 1 -- 172.21.15.2:0/3753350250 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c0bc450 con 0x7efdac0c7320 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac0c86e0 con 0x7efdac0c7320 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efd93fff640 1 -- 172.21.15.2:0/3753350250 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0a6ea0 con 0x7efdac0c7320 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.203+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac0b0d40 con 0x7efdac0c7320 2023-11-04T01:44:29.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.207+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac0c3800 con 0x7efdac0c7320 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.207+0000 7efd93fff640 1 -- 172.21.15.2:0/3753350250 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd9c0a7450 con 0x7efdac0c7320 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.207+0000 7efd93fff640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd980664a0 0x7efd98068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.207+0000 7efd93fff640 1 -- 172.21.15.2:0/3753350250 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd9c11e410 con 0x7efdac0c7320 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.207+0000 7efdaa7fc640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd980664a0 0x7efd98068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.207+0000 7efdaa7fc640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd980664a0 0x7efd98068960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efda00019c0 tx=0x7efda0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.211+0000 7efd93fff640 1 -- 172.21.15.2:0/3753350250 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd9c0ef1b0 con 0x7efdac0c7320 2023-11-04T01:44:29.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.391+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdac0b16c0 con 0x7efdac0c7320 2023-11-04T01:44:29.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.391+0000 7efd93fff640 1 -- 172.21.15.2:0/3753350250 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4908 (secure 0 0 0) 0x7efd9c0c1090 con 0x7efdac0c7320 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5518,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3645027182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3645027182},{"type":"v1","addr":"172.21.15.90:6835","nonce":3645027182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1098346949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1098346949},{"type":"v1","addr":"172.21.15.90:6837","nonce":1098346949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/4012044748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4012044748},{"type":"v1","addr":"172.21.15.2:6834","nonce":4012044748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:44:26.337328+0000","modified":"2023-11-04T01:44:28.379532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6171":{"gid":6171,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3559920390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3559920390},{"type":"v1","addr":"172.21.15.2:6835","nonce":3559920390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:44:29.399 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd980664a0 msgr2=0x7efd98068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd980664a0 0x7efd98068960 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efda00019c0 tx=0x7efda0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdac0c7320 msgr2=0x7efdac15dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdac0c7320 0x7efdac15dc60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009ae0 tx=0x7efd9c019800 comp rx=0 tx=0).stop 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 shutdown_connections 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd980664a0 0x7efd98068960 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdac0c7700 0x7efdac158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efdac15e1a0 0x7efdac158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 --2- 172.21.15.2:0/3753350250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdac0c7320 0x7efdac15dc60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 >> 172.21.15.2:0/3753350250 conn(0x7efdac0cea00 msgr2=0x7efdac0ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 shutdown_connections 2023-11-04T01:44:29.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.395+0000 7efdb191b640 1 -- 172.21.15.2:0/3753350250 wait complete. 2023-11-04T01:44:29.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.519+0000 7f5eaed9b640 1 Processor -- start 2023-11-04T01:44:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.519+0000 7f5eaed9b640 1 -- start start 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eaed9b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 0x7f5ea80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eaed9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5ea80cb400 0x7f5ea80cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eaed9b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80d0a60 con 0x7f5ea80cd6d0 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eaed9b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea815b390 con 0x7f5ea80cb400 2023-11-04T01:44:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eaed9b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80d04a0 con 0x7f5ea815afb0 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ead338640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5ea80cd6d0 0x7f5ea80cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52042/0 (socket says 172.21.15.2:52042) 2023-11-04T01:44:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ead338640 1 -- 172.21.15.2:0/1038936974 learned_addr learned my addr 172.21.15.2:0/1038936974 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea7fff640 1 --2- 172.21.15.2:0/1038936974 >> v2:172.21.15.90:3300/0 conn(0x7f5ea80cb400 0x7f5ea80cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 0x7f5ea80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044344473 0 0) 0x7f5ea80d0a60 con 0x7f5ea80cd6d0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e90003530 con 0x7f5ea80cd6d0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896256535 0 0) 0x7f5e90003530 con 0x7f5ea80cd6d0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 msgr2=0x7f5ea80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 0x7f5ea80b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 >> v2:172.21.15.90:3300/0 conn(0x7f5ea80cb400 msgr2=0x7f5ea80cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 --2- 172.21.15.2:0/1038936974 >> v2:172.21.15.90:3300/0 conn(0x7f5ea80cb400 0x7f5ea80cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80d0780 con 0x7f5ea80cd6d0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f5ea0001a00 con 0x7f5ea80cd6d0 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 >> v1:172.21.15.2:6789/0 conn(0x7f5ea80cd6d0 legacy=0x7f5ea80cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e90003980 0x7f5e90003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e900047d0 0x7f5e90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 0x7f5e90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea815b390 con 0x7f5e90003980 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80d04a0 con 0x7f5e900047d0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9000b990 con 0x7f5ea815afb0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e90003980 0x7f5e90003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ead338640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 0x7f5e90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5ea7fff640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e900047d0 0x7f5e90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eacb37640 1 -- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 msgr2=0x7f5e90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea815afb0 0x7f5e90005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eacb37640 1 -- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e900047d0 msgr2=0x7f5e90004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e900047d0 0x7f5e90004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.523+0000 7f5eacb37640 1 -- 172.21.15.2:0/1038936974 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90003530 con 0x7f5e90003980 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e90003980 0x7f5e90003da0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009b10 tx=0x7f5e9801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f386142e81196cdf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980a6420 con 0x7f5e90003980 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e980a6580 con 0x7f5e90003980 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5ea77fe640 1 -- 172.21.15.2:0/1038936974 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e980a6930 con 0x7f5e90003980 2023-11-04T01:44:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1038936974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e90003980 msgr2=0x7f5e90003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 --2- 172.21.15.2:0/1038936974 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e90003980 0x7f5e90003da0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009b10 tx=0x7f5e9801c9f0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5ead338640 1 -- 172.21.15.2:0/1038936974 reap_dead start 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1038936974 shutdown_connections 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1038936974 >> 172.21.15.2:0/1038936974 conn(0x7f5ea8065dc0 msgr2=0x7f5ea80661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1038936974 shutdown_connections 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1038936974 wait complete. 2023-11-04T01:44:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 Processor -- start 2023-11-04T01:44:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.527+0000 7f5eaed9b640 1 -- start start 2023-11-04T01:44:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e90003980 0x7f5ea815dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8157650 0x7f5ea815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea80c46a0 0x7f5ea80c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8157b80 con 0x7f5ea8157650 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8157e60 con 0x7f5e90003980 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8158140 con 0x7f5ea80c46a0 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8157650 0x7f5ea815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8157650 0x7f5ea815c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36544/0 (socket says 172.21.15.2:36544) 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 -- 172.21.15.2:0/1530698197 learned_addr learned my addr 172.21.15.2:0/1530698197 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ead338640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea80c46a0 0x7f5ea80c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e90003980 0x7f5ea815dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 -- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea80c46a0 msgr2=0x7f5ea80c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea80c46a0 0x7f5ea80c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 -- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e90003980 msgr2=0x7f5ea815dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e90003980 0x7f5ea815dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 -- 172.21.15.2:0/1530698197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea8158420 con 0x7f5ea8157650 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea7fff640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8157650 0x7f5ea815c040 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c011590 tx=0x7f5e9c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea57fa640 1 -- 172.21.15.2:0/1530698197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c004220 con 0x7f5ea8157650 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea57fa640 1 -- 172.21.15.2:0/1530698197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c004380 con 0x7f5ea8157650 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea8158700 con 0x7f5ea8157650 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea57fa640 1 -- 172.21.15.2:0/1530698197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c015870 con 0x7f5ea8157650 2023-11-04T01:44:29.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea815c580 con 0x7f5ea8157650 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea80675f0 con 0x7f5ea8157650 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea57fa640 1 -- 172.21.15.2:0/1530698197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e9c0159d0 con 0x7f5ea8157650 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea57fa640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5e940664a0 0x7f5e94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5ea57fa640 1 -- 172.21.15.2:0/1530698197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5e9c0840f0 con 0x7f5ea8157650 2023-11-04T01:44:29.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.531+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5e940664a0 0x7f5e94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.535+0000 7f5eacb37640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5e940664a0 0x7f5e94068960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ad000 tx=0x7f5e980b2040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.535+0000 7f5ea57fa640 1 -- 172.21.15.2:0/1530698197 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5e9c051410 con 0x7f5ea8157650 2023-11-04T01:44:29.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.687+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ea8066b00 con 0x7f5ea8157650 2023-11-04T01:44:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.687+0000 7f5ea57fa640 1 -- 172.21.15.2:0/1530698197 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18200 (secure 0 0 0) 0x7f5e9c054a30 con 0x7f5ea8157650 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:29.695 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":64,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:28.027104+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:44:24.247898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:44:25.345255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5e940664a0 msgr2=0x7f5e94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5e940664a0 0x7f5e94068960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5e980ad000 tx=0x7f5e980b2040 comp rx=0 tx=0).stop 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8157650 msgr2=0x7f5ea815c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8157650 0x7f5ea815c040 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c011590 tx=0x7f5e9c011a50 comp rx=0 tx=0).stop 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 shutdown_connections 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5e940664a0 0x7f5e94068960 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ea80c46a0 0x7f5ea80c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8157650 0x7f5ea815c040 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 --2- 172.21.15.2:0/1530698197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5e90003980 0x7f5ea815dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 >> 172.21.15.2:0/1530698197 conn(0x7f5ea8065dc0 msgr2=0x7f5ea81535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 shutdown_connections 2023-11-04T01:44:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.691+0000 7f5eaed9b640 1 -- 172.21.15.2:0/1530698197 wait complete. 2023-11-04T01:44:29.712 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:44:29.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa88dbca640 1 Processor -- start 2023-11-04T01:44:29.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa88dbca640 1 -- start start 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa88dbca640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 0x7fa8880cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa88dbca640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880cdc80 con 0x7fa8880b1960 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa88dbca640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880cf5a0 con 0x7fa8880b1d40 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa88dbca640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa888071e40 con 0x7fa88815d470 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa8880b1960 0x7fa8880ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52046/0 (socket says 172.21.15.2:52046) 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 -- 172.21.15.2:0/3052179425 learned_addr learned my addr 172.21.15.2:0/3052179425 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:29.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa887fff640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 0x7fa8880cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495768053 0 0) 0x7fa8880cdc80 con 0x7fa8880b1960 2023-11-04T01:44:29.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa870003530 con 0x7fa8880b1960 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 43788432 0 0) 0x7fa870003530 con 0x7fa8880b1960 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 msgr2=0x7fa8880cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 0x7fa8880cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 >> v1:172.21.15.90:6789/0 conn(0x7fa8880b1d40 legacy=0x7fa88815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880cf880 con 0x7fa8880b1960 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa880001a20 con 0x7fa8880b1960 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 >> v1:172.21.15.2:6789/0 conn(0x7fa8880b1960 legacy=0x7fa8880ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa870003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 0x7fa8700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa870004d10 0x7fa870005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa888071e40 con 0x7fa8700039b0 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87000ba40 con 0x7fa870004d10 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87000bc00 con 0x7fa88815d470 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa870003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa886ffd640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 0x7fa8700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa887fff640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa870004d10 0x7fa870005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 -- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 msgr2=0x7fa8700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d470 0x7fa8700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 -- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa870004d10 msgr2=0x7fa870005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa870004d10 0x7fa870005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa8877fe640 1 -- 172.21.15.2:0/3052179425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870003530 con 0x7fa8700039b0 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.827+0000 7fa887fff640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa870004d10 0x7fa870005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa870003dd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa880002240 tx=0x7fa88001d2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad92457605d63557 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800ad630 con 0x7fa8700039b0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800a8070 con 0x7fa8700039b0 2023-11-04T01:44:29.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa8867fc640 1 -- 172.21.15.2:0/3052179425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800ad990 con 0x7fa8700039b0 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa88dbca640 1 -- 172.21.15.2:0/3052179425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 msgr2=0x7fa870003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa88dbca640 1 --2- 172.21.15.2:0/3052179425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa870003dd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa880002240 tx=0x7fa88001d2d0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa887fff640 1 -- 172.21.15.2:0/3052179425 reap_dead start 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa88dbca640 1 -- 172.21.15.2:0/3052179425 shutdown_connections 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa88dbca640 1 -- 172.21.15.2:0/3052179425 >> 172.21.15.2:0/3052179425 conn(0x7fa88806e760 msgr2=0x7fa88806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa88dbca640 1 -- 172.21.15.2:0/3052179425 shutdown_connections 2023-11-04T01:44:29.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.831+0000 7fa88dbca640 1 -- 172.21.15.2:0/3052179425 wait complete. 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 Processor -- start 2023-11-04T01:44:29.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 -- start start 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa888160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d8e0 0x7fa8880b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88814be50 0x7fa8880b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880acba0 con 0x7fa8700039b0 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880ace80 con 0x7fa88814be50 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88815de50 con 0x7fa88815d8e0 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa888160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa888160050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36548/0 (socket says 172.21.15.2:36548) 2023-11-04T01:44:29.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 -- 172.21.15.2:0/3466344589 learned_addr learned my addr 172.21.15.2:0/3466344589 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa887fff640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88814be50 0x7fa8880b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa886ffd640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d8e0 0x7fa8880b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 -- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d8e0 msgr2=0x7fa8880b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d8e0 0x7fa8880b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 -- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88814be50 msgr2=0x7fa8880b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88814be50 0x7fa8880b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 -- 172.21.15.2:0/3466344589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88815e130 con 0x7fa8700039b0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa886ffd640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d8e0 0x7fa8880b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa8877fe640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa888160050 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa88001d100 tx=0x7fa870005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa86ffff640 1 -- 172.21.15.2:0/3466344589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa880004b70 con 0x7fa8700039b0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa86ffff640 1 -- 172.21.15.2:0/3466344589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa880004cd0 con 0x7fa8700039b0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88815e410 con 0x7fa8700039b0 2023-11-04T01:44:29.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa86ffff640 1 -- 172.21.15.2:0/3466344589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800b86b0 con 0x7fa8700039b0 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa888160590 con 0x7fa8700039b0 2023-11-04T01:44:29.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88815e650 con 0x7fa8700039b0 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.835+0000 7fa86ffff640 1 -- 172.21.15.2:0/3466344589 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8800aa030 con 0x7fa8700039b0 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.839+0000 7fa86ffff640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8740664a0 0x7fa874068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.839+0000 7fa86ffff640 1 -- 172.21.15.2:0/3466344589 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa88011e380 con 0x7fa8700039b0 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.839+0000 7fa886ffd640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8740664a0 0x7fa874068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:29.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.839+0000 7fa886ffd640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8740664a0 0x7fa874068960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8880c9700 tx=0x7fa87c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.843+0000 7fa86ffff640 1 -- 172.21.15.2:0/3466344589 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8800eb680 con 0x7fa8700039b0 2023-11-04T01:44:29.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:29.991+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa88815fa90 con 0x7fa8740664a0 2023-11-04T01:44:30.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.015+0000 7fa86ffff640 1 -- 172.21.15.2:0/3466344589 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358050 (secure 0 0 0) 0x7fa88815fa90 con 0x7fa8740664a0 2023-11-04T01:44:30.026 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:30.028 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8740664a0 msgr2=0x7fa874068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8740664a0 0x7fa874068960 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa8880c9700 tx=0x7fa87c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 msgr2=0x7fa888160050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa888160050 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa88001d100 tx=0x7fa870005800 comp rx=0 tx=0).stop 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 shutdown_connections 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8740664a0 0x7fa874068960 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa88814be50 0x7fa8880b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa88815d8e0 0x7fa8880b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 --2- 172.21.15.2:0/3466344589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8700039b0 0x7fa888160050 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 >> 172.21.15.2:0/3466344589 conn(0x7fa88806e760 msgr2=0x7fa888157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 shutdown_connections 2023-11-04T01:44:30.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.023+0000 7fa88dbca640 1 -- 172.21.15.2:0/3466344589 wait complete. 2023-11-04T01:44:30.043 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-04T01:44:28.815023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243816,"kb_used_data":6836,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730904,"statfs":{"total":773094113280,"available":772844445696,"internally_reserved":0,"allocated":7000064,"data_stored":3693334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001311"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982884+0000","last_change":"2023-11-04T01:44:25.982884+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982884+0000","last_undegraded":"2023-11-04T01:44:25.982884+0000","last_fullsized":"2023-11-04T01:44:25.982884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976187+0000","last_change":"2023-11-04T01:44:25.976187+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976187+0000","last_undegraded":"2023-11-04T01:44:25.976187+0000","last_fullsized":"2023-11-04T01:44:25.976187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979913+0000","last_change":"2023-11-04T01:44:25.979913+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979913+0000","last_undegraded":"2023-11-04T01:44:25.979913+0000","last_fullsized":"2023-11-04T01:44:25.979913+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982170+0000","last_change":"2023-11-04T01:44:25.982170+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982170+0000","last_undegraded":"2023-11-04T01:44:25.982170+0000","last_fullsized":"2023-11-04T01:44:25.982170+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981364+0000","last_change":"2023-11-04T01:44:25.981364+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981364+0000","last_undegraded":"2023-11-04T01:44:25.981364+0000","last_fullsized":"2023-11-04T01:44:25.981364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976612+0000","last_change":"2023-11-04T01:44:25.976612+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976612+0000","last_undegraded":"2023-11-04T01:44:25.976612+0000","last_fullsized":"2023-11-04T01:44:25.976612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.977361+0000","last_change":"2023-11-04T01:44:25.977361+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.977361+0000","last_undegraded":"2023-11-04T01:44:25.977361+0000","last_fullsized":"2023-11-04T01:44:25.977361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981221+0000","last_change":"2023-11-04T01:44:25.981221+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981221+0000","last_undegraded":"2023-11-04T01:44:25.981221+0000","last_fullsized":"2023-11-04T01:44:25.981221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.975915+0000","last_change":"2023-11-04T01:44:24.975915+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.975915+0000","last_undegraded":"2023-11-04T01:44:24.975915+0000","last_fullsized":"2023-11-04T01:44:24.975915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.983520+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:44:24.983520+0000","last_peered":"2023-11-04T01:44:24.983520+0000","last_clean":"2023-11-04T01:44:24.983520+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:44:24.983520+0000","last_undegraded":"2023-11-04T01:44:24.983520+0000","last_fullsized":"2023-11-04T01:44:24.983520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770136+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:44:22.770136+0000","last_peered":"2023-11-04T01:44:22.770136+0000","last_clean":"2023-11-04T01:44:22.770136+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:44:22.770136+0000","last_undegraded":"2023-11-04T01:44:22.770136+0000","last_fullsized":"2023-11-04T01:44:22.770136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979235+0000","last_change":"2023-11-04T01:44:25.979235+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979235+0000","last_undegraded":"2023-11-04T01:44:25.979235+0000","last_fullsized":"2023-11-04T01:44:25.979235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980411+0000","last_change":"2023-11-04T01:44:24.980411+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980411+0000","last_undegraded":"2023-11-04T01:44:24.980411+0000","last_fullsized":"2023-11-04T01:44:24.980411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770035+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:44:22.770035+0000","last_peered":"2023-11-04T01:44:22.770035+0000","last_clean":"2023-11-04T01:44:22.770035+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:44:22.770035+0000","last_undegraded":"2023-11-04T01:44:22.770035+0000","last_fullsized":"2023-11-04T01:44:22.770035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980153+0000","last_change":"2023-11-04T01:44:24.980153+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980153+0000","last_undegraded":"2023-11-04T01:44:24.980153+0000","last_fullsized":"2023-11-04T01:44:24.980153+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972522+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:44:24.972522+0000","last_peered":"2023-11-04T01:44:24.972522+0000","last_clean":"2023-11-04T01:44:24.972522+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:44:24.972522+0000","last_undegraded":"2023-11-04T01:44:24.972522+0000","last_fullsized":"2023-11-04T01:44:24.972522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980786+0000","last_change":"2023-11-04T01:44:24.980786+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980786+0000","last_undegraded":"2023-11-04T01:44:24.980786+0000","last_fullsized":"2023-11-04T01:44:24.980786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764205+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:44:22.764205+0000","last_peered":"2023-11-04T01:44:22.764205+0000","last_clean":"2023-11-04T01:44:22.764205+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:44:22.764205+0000","last_undegraded":"2023-11-04T01:44:22.764205+0000","last_fullsized":"2023-11-04T01:44:22.764205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976618+0000","last_change":"2023-11-04T01:44:25.976618+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976618+0000","last_undegraded":"2023-11-04T01:44:25.976618+0000","last_fullsized":"2023-11-04T01:44:25.976618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978975+0000","last_change":"2023-11-04T01:44:24.978975+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978975+0000","last_undegraded":"2023-11-04T01:44:24.978975+0000","last_fullsized":"2023-11-04T01:44:24.978975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594788+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:44:22.594788+0000","last_peered":"2023-11-04T01:44:22.594788+0000","last_clean":"2023-11-04T01:44:22.594788+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:44:22.594788+0000","last_undegraded":"2023-11-04T01:44:22.594788+0000","last_fullsized":"2023-11-04T01:44:22.594788+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.975970+0000","last_change":"2023-11-04T01:44:24.975970+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.975970+0000","last_undegraded":"2023-11-04T01:44:24.975970+0000","last_fullsized":"2023-11-04T01:44:24.975970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770394+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:44:22.770394+0000","last_peered":"2023-11-04T01:44:22.770394+0000","last_clean":"2023-11-04T01:44:22.770394+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:44:22.770394+0000","last_undegraded":"2023-11-04T01:44:22.770394+0000","last_fullsized":"2023-11-04T01:44:22.770394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976169+0000","last_change":"2023-11-04T01:44:24.976169+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976169+0000","last_undegraded":"2023-11-04T01:44:24.976169+0000","last_fullsized":"2023-11-04T01:44:24.976169+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764310+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:44:22.764310+0000","last_peered":"2023-11-04T01:44:22.764310+0000","last_clean":"2023-11-04T01:44:22.764310+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:44:22.764310+0000","last_undegraded":"2023-11-04T01:44:22.764310+0000","last_fullsized":"2023-11-04T01:44:22.764310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979257+0000","last_change":"2023-11-04T01:44:25.979257+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979257+0000","last_undegraded":"2023-11-04T01:44:25.979257+0000","last_fullsized":"2023-11-04T01:44:25.979257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.024696+0000","last_change":"2023-11-04T01:44:26.023958+0000","last_active":"2023-11-04T01:44:26.024696+0000","last_peered":"2023-11-04T01:44:26.024696+0000","last_clean":"2023-11-04T01:44:26.024696+0000","last_became_active":"2023-11-04T01:44:26.023597+0000","last_became_peered":"2023-11-04T01:44:26.023597+0000","last_unstale":"2023-11-04T01:44:26.024696+0000","last_undegraded":"2023-11-04T01:44:26.024696+0000","last_fullsized":"2023-11-04T01:44:26.024696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:38.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972667+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:44:24.972667+0000","last_peered":"2023-11-04T01:44:24.972667+0000","last_clean":"2023-11-04T01:44:24.972667+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:44:24.972667+0000","last_undegraded":"2023-11-04T01:44:24.972667+0000","last_fullsized":"2023-11-04T01:44:24.972667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.973273+0000","last_change":"2023-11-04T01:44:24.973273+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.973273+0000","last_undegraded":"2023-11-04T01:44:24.973273+0000","last_fullsized":"2023-11-04T01:44:24.973273+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971792+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:44:24.971792+0000","last_peered":"2023-11-04T01:44:24.971792+0000","last_clean":"2023-11-04T01:44:24.971792+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:44:24.971792+0000","last_undegraded":"2023-11-04T01:44:24.971792+0000","last_fullsized":"2023-11-04T01:44:24.971792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978475+0000","last_change":"2023-11-04T01:44:24.978475+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978475+0000","last_undegraded":"2023-11-04T01:44:24.978475+0000","last_fullsized":"2023-11-04T01:44:24.978475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305201+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:44:22.305201+0000","last_peered":"2023-11-04T01:44:22.305201+0000","last_clean":"2023-11-04T01:44:22.305201+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:44:22.305201+0000","last_undegraded":"2023-11-04T01:44:22.305201+0000","last_fullsized":"2023-11-04T01:44:22.305201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977940+0000","last_change":"2023-11-04T01:44:24.977940+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977940+0000","last_undegraded":"2023-11-04T01:44:24.977940+0000","last_fullsized":"2023-11-04T01:44:24.977940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.769898+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:44:22.769898+0000","last_peered":"2023-11-04T01:44:22.769898+0000","last_clean":"2023-11-04T01:44:22.769898+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:44:22.769898+0000","last_undegraded":"2023-11-04T01:44:22.769898+0000","last_fullsized":"2023-11-04T01:44:22.769898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978340+0000","last_change":"2023-11-04T01:44:24.978340+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978340+0000","last_undegraded":"2023-11-04T01:44:24.978340+0000","last_fullsized":"2023-11-04T01:44:24.978340+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305335+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:44:22.305335+0000","last_peered":"2023-11-04T01:44:22.305335+0000","last_clean":"2023-11-04T01:44:22.305335+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:44:22.305335+0000","last_undegraded":"2023-11-04T01:44:22.305335+0000","last_fullsized":"2023-11-04T01:44:22.305335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978224+0000","last_change":"2023-11-04T01:44:24.978224+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978224+0000","last_undegraded":"2023-11-04T01:44:24.978224+0000","last_fullsized":"2023-11-04T01:44:24.978224+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984868+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:44:24.984868+0000","last_peered":"2023-11-04T01:44:24.984868+0000","last_clean":"2023-11-04T01:44:24.984868+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:44:24.984868+0000","last_undegraded":"2023-11-04T01:44:24.984868+0000","last_fullsized":"2023-11-04T01:44:24.984868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.974235+0000","last_change":"2023-11-04T01:44:24.974235+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.974235+0000","last_undegraded":"2023-11-04T01:44:24.974235+0000","last_fullsized":"2023-11-04T01:44:24.974235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770577+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:44:22.770577+0000","last_peered":"2023-11-04T01:44:22.770577+0000","last_clean":"2023-11-04T01:44:22.770577+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:44:22.770577+0000","last_undegraded":"2023-11-04T01:44:22.770577+0000","last_fullsized":"2023-11-04T01:44:22.770577+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.016448+0000","last_change":"2023-11-04T01:44:26.015593+0000","last_active":"2023-11-04T01:44:26.016448+0000","last_peered":"2023-11-04T01:44:26.016448+0000","last_clean":"2023-11-04T01:44:26.016448+0000","last_became_active":"2023-11-04T01:44:26.015226+0000","last_became_peered":"2023-11-04T01:44:26.015226+0000","last_unstale":"2023-11-04T01:44:26.016448+0000","last_undegraded":"2023-11-04T01:44:26.016448+0000","last_fullsized":"2023-11-04T01:44:26.016448+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:39.263964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594711+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:44:22.594711+0000","last_peered":"2023-11-04T01:44:22.594711+0000","last_clean":"2023-11-04T01:44:22.594711+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:44:22.594711+0000","last_undegraded":"2023-11-04T01:44:22.594711+0000","last_fullsized":"2023-11-04T01:44:22.594711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976038+0000","last_change":"2023-11-04T01:44:25.976038+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976038+0000","last_undegraded":"2023-11-04T01:44:25.976038+0000","last_fullsized":"2023-11-04T01:44:25.976038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981339+0000","last_change":"2023-11-04T01:44:24.981339+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981339+0000","last_undegraded":"2023-11-04T01:44:24.981339+0000","last_fullsized":"2023-11-04T01:44:24.981339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984398+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:44:24.984398+0000","last_peered":"2023-11-04T01:44:24.984398+0000","last_clean":"2023-11-04T01:44:24.984398+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:44:24.984398+0000","last_undegraded":"2023-11-04T01:44:24.984398+0000","last_fullsized":"2023-11-04T01:44:24.984398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982198+0000","last_change":"2023-11-04T01:44:24.982198+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982198+0000","last_undegraded":"2023-11-04T01:44:24.982198+0000","last_fullsized":"2023-11-04T01:44:24.982198+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971917+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:44:24.971917+0000","last_peered":"2023-11-04T01:44:24.971917+0000","last_clean":"2023-11-04T01:44:24.971917+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:44:24.971917+0000","last_undegraded":"2023-11-04T01:44:24.971917+0000","last_fullsized":"2023-11-04T01:44:24.971917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977410+0000","last_change":"2023-11-04T01:44:24.977410+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977410+0000","last_undegraded":"2023-11-04T01:44:24.977410+0000","last_fullsized":"2023-11-04T01:44:24.977410+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764190+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:44:22.764190+0000","last_peered":"2023-11-04T01:44:22.764190+0000","last_clean":"2023-11-04T01:44:22.764190+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:44:22.764190+0000","last_undegraded":"2023-11-04T01:44:22.764190+0000","last_fullsized":"2023-11-04T01:44:22.764190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981356+0000","last_change":"2023-11-04T01:44:24.981356+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981356+0000","last_undegraded":"2023-11-04T01:44:24.981356+0000","last_fullsized":"2023-11-04T01:44:24.981356+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305020+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:44:22.305020+0000","last_peered":"2023-11-04T01:44:22.305020+0000","last_clean":"2023-11-04T01:44:22.305020+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:44:22.305020+0000","last_undegraded":"2023-11-04T01:44:22.305020+0000","last_fullsized":"2023-11-04T01:44:22.305020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982581+0000","last_change":"2023-11-04T01:44:24.982581+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982581+0000","last_undegraded":"2023-11-04T01:44:24.982581+0000","last_fullsized":"2023-11-04T01:44:24.982581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594658+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:44:22.594658+0000","last_peered":"2023-11-04T01:44:22.594658+0000","last_clean":"2023-11-04T01:44:22.594658+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:44:22.594658+0000","last_undegraded":"2023-11-04T01:44:22.594658+0000","last_fullsized":"2023-11-04T01:44:22.594658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.985508+0000","last_change":"2023-11-04T01:44:25.985508+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.985508+0000","last_undegraded":"2023-11-04T01:44:25.985508+0000","last_fullsized":"2023-11-04T01:44:25.985508+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981240+0000","last_change":"2023-11-04T01:44:24.981240+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981240+0000","last_undegraded":"2023-11-04T01:44:24.981240+0000","last_fullsized":"2023-11-04T01:44:24.981240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305451+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:44:22.305451+0000","last_peered":"2023-11-04T01:44:22.305451+0000","last_clean":"2023-11-04T01:44:22.305451+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:44:22.305451+0000","last_undegraded":"2023-11-04T01:44:22.305451+0000","last_fullsized":"2023-11-04T01:44:22.305451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978236+0000","last_change":"2023-11-04T01:44:24.978236+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978236+0000","last_undegraded":"2023-11-04T01:44:24.978236+0000","last_fullsized":"2023-11-04T01:44:24.978236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.985254+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:44:24.985254+0000","last_peered":"2023-11-04T01:44:24.985254+0000","last_clean":"2023-11-04T01:44:24.985254+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:44:24.985254+0000","last_undegraded":"2023-11-04T01:44:24.985254+0000","last_fullsized":"2023-11-04T01:44:24.985254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.972096+0000","last_change":"2023-11-04T01:44:24.972096+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.972096+0000","last_undegraded":"2023-11-04T01:44:24.972096+0000","last_fullsized":"2023-11-04T01:44:24.972096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305279+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:44:22.305279+0000","last_peered":"2023-11-04T01:44:22.305279+0000","last_clean":"2023-11-04T01:44:22.305279+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:44:22.305279+0000","last_undegraded":"2023-11-04T01:44:22.305279+0000","last_fullsized":"2023-11-04T01:44:22.305279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976253+0000","last_change":"2023-11-04T01:44:24.976253+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976253+0000","last_undegraded":"2023-11-04T01:44:24.976253+0000","last_fullsized":"2023-11-04T01:44:24.976253+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":35,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.303006+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:44:22.303006+0000","last_peered":"2023-11-04T01:44:22.303006+0000","last_clean":"2023-11-04T01:44:22.303006+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:44:22.303006+0000","last_undegraded":"2023-11-04T01:44:22.303006+0000","last_fullsized":"2023-11-04T01:44:22.303006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979976+0000","last_change":"2023-11-04T01:44:25.979976+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979976+0000","last_undegraded":"2023-11-04T01:44:25.979976+0000","last_fullsized":"2023-11-04T01:44:25.979976+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981141+0000","last_change":"2023-11-04T01:44:24.981141+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981141+0000","last_undegraded":"2023-11-04T01:44:24.981141+0000","last_fullsized":"2023-11-04T01:44:24.981141+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.769949+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:44:22.769949+0000","last_peered":"2023-11-04T01:44:22.769949+0000","last_clean":"2023-11-04T01:44:22.769949+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:44:22.769949+0000","last_undegraded":"2023-11-04T01:44:22.769949+0000","last_fullsized":"2023-11-04T01:44:22.769949+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976179+0000","last_change":"2023-11-04T01:44:24.976179+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976179+0000","last_undegraded":"2023-11-04T01:44:24.976179+0000","last_fullsized":"2023-11-04T01:44:24.976179+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594657+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:44:22.594657+0000","last_peered":"2023-11-04T01:44:22.594657+0000","last_clean":"2023-11-04T01:44:22.594657+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:44:22.594657+0000","last_undegraded":"2023-11-04T01:44:22.594657+0000","last_fullsized":"2023-11-04T01:44:22.594657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982018+0000","last_change":"2023-11-04T01:44:24.982018+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982018+0000","last_undegraded":"2023-11-04T01:44:24.982018+0000","last_fullsized":"2023-11-04T01:44:24.982018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305242+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:44:22.305242+0000","last_peered":"2023-11-04T01:44:22.305242+0000","last_clean":"2023-11-04T01:44:22.305242+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:44:22.305242+0000","last_undegraded":"2023-11-04T01:44:22.305242+0000","last_fullsized":"2023-11-04T01:44:22.305242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.002160+0000","last_change":"2023-11-04T01:44:25.996467+0000","last_active":"2023-11-04T01:44:26.002160+0000","last_peered":"2023-11-04T01:44:26.002160+0000","last_clean":"2023-11-04T01:44:26.002160+0000","last_became_active":"2023-11-04T01:44:25.995184+0000","last_became_peered":"2023-11-04T01:44:25.995184+0000","last_unstale":"2023-11-04T01:44:26.002160+0000","last_undegraded":"2023-11-04T01:44:26.002160+0000","last_fullsized":"2023-11-04T01:44:26.002160+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:02.603408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971694+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:44:24.971694+0000","last_peered":"2023-11-04T01:44:24.971694+0000","last_clean":"2023-11-04T01:44:24.971694+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:44:24.971694+0000","last_undegraded":"2023-11-04T01:44:24.971694+0000","last_fullsized":"2023-11-04T01:44:24.971694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.984663+0000","last_change":"2023-11-04T01:44:25.984663+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.984663+0000","last_undegraded":"2023-11-04T01:44:25.984663+0000","last_fullsized":"2023-11-04T01:44:25.984663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980271+0000","last_change":"2023-11-04T01:44:24.980271+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980271+0000","last_undegraded":"2023-11-04T01:44:24.980271+0000","last_fullsized":"2023-11-04T01:44:24.980271+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770216+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:44:22.770216+0000","last_peered":"2023-11-04T01:44:22.770216+0000","last_clean":"2023-11-04T01:44:22.770216+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:44:22.770216+0000","last_undegraded":"2023-11-04T01:44:22.770216+0000","last_fullsized":"2023-11-04T01:44:22.770216+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:25.997388+0000","last_change":"2023-11-04T01:44:25.991176+0000","last_active":"2023-11-04T01:44:25.997388+0000","last_peered":"2023-11-04T01:44:25.997388+0000","last_clean":"2023-11-04T01:44:25.997388+0000","last_became_active":"2023-11-04T01:44:25.990747+0000","last_became_peered":"2023-11-04T01:44:25.990747+0000","last_unstale":"2023-11-04T01:44:25.997388+0000","last_undegraded":"2023-11-04T01:44:25.997388+0000","last_fullsized":"2023-11-04T01:44:25.997388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:16.695292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594650+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:44:22.594650+0000","last_peered":"2023-11-04T01:44:22.594650+0000","last_clean":"2023-11-04T01:44:22.594650+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:44:22.594650+0000","last_undegraded":"2023-11-04T01:44:22.594650+0000","last_fullsized":"2023-11-04T01:44:22.594650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982646+0000","last_change":"2023-11-04T01:44:25.982646+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982646+0000","last_undegraded":"2023-11-04T01:44:25.982646+0000","last_fullsized":"2023-11-04T01:44:25.982646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977938+0000","last_change":"2023-11-04T01:44:24.977938+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977938+0000","last_undegraded":"2023-11-04T01:44:24.977938+0000","last_fullsized":"2023-11-04T01:44:24.977938+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770274+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:44:22.770274+0000","last_peered":"2023-11-04T01:44:22.770274+0000","last_clean":"2023-11-04T01:44:22.770274+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:44:22.770274+0000","last_undegraded":"2023-11-04T01:44:22.770274+0000","last_fullsized":"2023-11-04T01:44:22.770274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981465+0000","last_change":"2023-11-04T01:44:25.981465+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981465+0000","last_undegraded":"2023-11-04T01:44:25.981465+0000","last_fullsized":"2023-11-04T01:44:25.981465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.006150+0000","last_change":"2023-11-04T01:44:26.005066+0000","last_active":"2023-11-04T01:44:26.006150+0000","last_peered":"2023-11-04T01:44:26.006150+0000","last_clean":"2023-11-04T01:44:26.006150+0000","last_became_active":"2023-11-04T01:44:26.004633+0000","last_became_peered":"2023-11-04T01:44:26.004633+0000","last_unstale":"2023-11-04T01:44:26.006150+0000","last_undegraded":"2023-11-04T01:44:26.006150+0000","last_fullsized":"2023-11-04T01:44:26.006150+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:07.715775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594794+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:44:22.594794+0000","last_peered":"2023-11-04T01:44:22.594794+0000","last_clean":"2023-11-04T01:44:22.594794+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:44:22.594794+0000","last_undegraded":"2023-11-04T01:44:22.594794+0000","last_fullsized":"2023-11-04T01:44:22.594794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":910185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.628}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.35299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.371,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.499}]},{"osd":4,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.877},"min":{"1min":0.57299999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.65300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3640000000000001,"5min":1.365,"15min":1.365},"last":0.99299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3540000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.079}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0620000000000001,"15min":1.0720000000000001},"min":{"1min":0.70199999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.373,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4159999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.079,"15min":1.077},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.92200000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":319817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.607}]},{"osd":3,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.143,"5min":1.885,"15min":1.885},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.526,"15min":1.526},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.3380000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2410000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.0960000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0089999999999999,"15min":1.006},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.256}]},{"osd":7,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.095,"15min":1.0960000000000001},"min":{"1min":0.628,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.518},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.369,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.3779999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.89600000000000002},"min":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.276,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.84799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.333,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.875},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.137,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.86799999999999999,"15min":0.85699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1040000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90200000000000002},"min":{"1min":0.66700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2989999999999999,"5min":1.514,"15min":1.514},"last":1.032}]},{"osd":4,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.073,"15min":1.077},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2729999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.232,"5min":2.609,"15min":2.609},"last":0.997}]},{"osd":5,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.1539999999999999,"15min":1.1759999999999999},"min":{"1min":0.77800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.387,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.125,"5min":2.4529999999999998,"15min":2.6749999999999998},"min":{"1min":0.82899999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3660000000000001,"5min":40.195,"15min":40.195},"last":1.1200000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2909999999999999,"15min":1.319},"min":{"1min":0.94699999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2849999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1399999999999999,"15min":1.1499999999999999},"min":{"1min":0.77000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5529999999999999,"5min":1.637,"15min":1.637},"last":0.95099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.413,"5min":1.623,"15min":1.623},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.94699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4039999999999999,"5min":1.724,"15min":1.724},"last":0.83199999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.95399999999999996,"15min":0.96299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.444,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.244,"15min":1.244},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0089999999999999,"15min":1.0169999999999999},"min":{"1min":0.61899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4330000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.03},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.298,"5min":1.976,"15min":1.976},"last":0.96399999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0049999999999999},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.335,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.002},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.546,"5min":2.161,"15min":2.161},"last":0.745}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.63,"5min":0.495,"15min":0.495},"max":{"1min":1.333,"5min":1.538,"15min":1.538},"last":0.879},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.1220000000000001},"min":{"1min":0.70199999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.516,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.079}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0600000000000001},"min":{"1min":0.69799999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.204,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.038},{"interface":"front","average":{"1min":1.095,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.484,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.381}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8919999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1060000000000001,"15min":1.111},"min":{"1min":0.83299999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.387,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1439999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":903557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":0.876},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.23,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.321,"15min":1.321},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.28},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3320000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.4119999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.874,"15min":0.875},"min":{"1min":0.55600000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.1559999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.371},{"interface":"front","average":{"1min":1.024,"5min":0.93600000000000005,"15min":0.92200000000000004},"min":{"1min":0.72599999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.98499999999999999,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.343,"5min":1.401,"15min":1.401},"last":1.325},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0269999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3879999999999999,"5min":1.627,"15min":1.627},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.198,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":1.026,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.399,"5min":1.526,"15min":1.526},"last":1.4630000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.137,"15min":1.1459999999999999},"min":{"1min":0.81799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.409,"5min":1.49,"15min":1.49},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.22,"15min":1.23},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.496,"5min":1.536,"15min":1.536},"last":0.68799999999999994}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.758,"15min":1.758},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.46,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.755},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.173,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96499999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.65900000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1839999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2889999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":1.833,"15min":1.833},"last":0.84299999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3420000000000001,"5min":1.369,"15min":1.369},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.125},"min":{"1min":0.77200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7410000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.014},"min":{"1min":0.84599999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.4399999999999999,"5min":1.554,"15min":1.554},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.292,"5min":1.417,"15min":1.417},"last":0.877},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.202},"min":{"1min":0.96799999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0569999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":712704,"data_stored":307019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85999999999999999,"5min":1.167,"15min":1.167},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.252,"5min":1.429,"15min":1.429},"last":0.501}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1890000000000001,"5min":1.252,"15min":1.252},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4159999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.357,"5min":1.369,"15min":1.369},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.91800000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.0429999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.103,"5min":1.0469999999999999,"15min":1.0369999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.72499999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.1319999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.81799999999999995,"5min":1.022,"15min":1.022},"last":0.90800000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.38100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.054,"5min":1.181,"15min":1.181},"last":0.875}]},{"osd":4,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.173},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.411,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.879,"15min":0.877},"min":{"1min":0.61299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.329},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.282}]},{"osd":6,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2290000000000001,"5min":1.603,"15min":1.603},"last":1.034},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.367}]},{"osd":7,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.002,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.377,"5min":1.411,"15min":1.411},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.272,"5min":1.613,"15min":1.613},"last":1.2350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:44:30.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.191+0000 7f80c4c78640 1 Processor -- start 2023-11-04T01:44:30.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.191+0000 7f80c4c78640 1 -- start start 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80c4c78640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80c015d690 0x7f80c006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80c4c78640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c00cd400 con 0x7f80c006f8f0 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80c4c78640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c00cd6e0 con 0x7f80c015d2b0 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80c4c78640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c00ad450 con 0x7f80c015d690 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bdd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80c015d690 0x7f80c006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bed9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f80c006f8f0 0x7f80c00b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52048/0 (socket says 172.21.15.2:52048) 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bdd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80c015d690 0x7f80c006c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36556/0 (socket says 172.21.15.2:36556) 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bed9d640 1 -- 172.21.15.2:0/101859186 learned_addr learned my addr 172.21.15.2:0/101859186 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bdd9b640 1 -- 172.21.15.2:0/101859186 >> v1:172.21.15.90:6789/0 conn(0x7f80c015d2b0 legacy=0x7f80c00ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bdd9b640 1 -- 172.21.15.2:0/101859186 >> v1:172.21.15.2:6789/0 conn(0x7f80c006f8f0 legacy=0x7f80c00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bdd9b640 1 -- 172.21.15.2:0/101859186 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00ad070 con 0x7f80c015d690 2023-11-04T01:44:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bd59a640 1 -- 172.21.15.2:0/101859186 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323784227 0 0) 0x7f80c00cd400 con 0x7f80c006f8f0 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bdd9b640 1 --2- 172.21.15.2:0/101859186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c015d690 0x7f80c006c630 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f80b00097c0 tx=0x7f80b001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea3158d4f2e11ab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bd59a640 1 -- 172.21.15.2:0/101859186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00ac630 con 0x7f80c015d690 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bd59a640 1 -- 172.21.15.2:0/101859186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c006ff00 con 0x7f80c015d690 2023-11-04T01:44:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.195+0000 7f80bd59a640 1 -- 172.21.15.2:0/101859186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00ac9b0 con 0x7f80c015d690 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- 172.21.15.2:0/101859186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c015d690 msgr2=0x7f80c006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 --2- 172.21.15.2:0/101859186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c015d690 0x7f80c006c630 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f80b00097c0 tx=0x7f80b001c3b0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- 172.21.15.2:0/101859186 shutdown_connections 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 --2- 172.21.15.2:0/101859186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c015d690 0x7f80c006c630 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- 172.21.15.2:0/101859186 >> 172.21.15.2:0/101859186 conn(0x7f80c00cebb0 msgr2=0x7f80c00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- 172.21.15.2:0/101859186 shutdown_connections 2023-11-04T01:44:30.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- 172.21.15.2:0/101859186 wait complete. 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 Processor -- start 2023-11-04T01:44:30.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- start start 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c006f8f0 0x7f80c014c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c015d2b0 0x7f80c01fa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c015d690 0x7f80c00c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00c3f80 con 0x7f80c006f8f0 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014cb20 con 0x7f80c015d690 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80c4c78640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00c3640 con 0x7f80c015d2b0 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c006f8f0 0x7f80c014c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c006f8f0 0x7f80c014c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36564/0 (socket says 172.21.15.2:36564) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 -- 172.21.15.2:0/548909535 learned_addr learned my addr 172.21.15.2:0/548909535 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 -- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c015d2b0 msgr2=0x7f80c01fa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80bed9d640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c015d690 0x7f80c00c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c015d2b0 0x7f80c01fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 -- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c015d690 msgr2=0x7f80c00c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c015d690 0x7f80c00c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 -- 172.21.15.2:0/548909535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009420 con 0x7f80c006f8f0 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80be59c640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c006f8f0 0x7f80c014c5e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c490 tx=0x7f80a8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80b6ffd640 1 -- 172.21.15.2:0/548909535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8003600 con 0x7f80c006f8f0 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80b6ffd640 1 -- 172.21.15.2:0/548909535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a8003780 con 0x7f80c006f8f0 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.199+0000 7f80b6ffd640 1 -- 172.21.15.2:0/548909535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a8003b70 con 0x7f80c006f8f0 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c01fa7d0 con 0x7f80c006f8f0 2023-11-04T01:44:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c00c38c0 con 0x7f80c006f8f0 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c00c40c0 con 0x7f80c006f8f0 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80b6ffd640 1 -- 172.21.15.2:0/548909535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80a8003cd0 con 0x7f80c006f8f0 2023-11-04T01:44:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80b6ffd640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80a00664a0 0x7f80a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80b6ffd640 1 -- 172.21.15.2:0/548909535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80a8083110 con 0x7f80c006f8f0 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80bdd9b640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80a00664a0 0x7f80a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.203+0000 7f80bdd9b640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80a00664a0 0x7f80a0068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f80b00ae000 tx=0x7f80b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.207+0000 7f80b6ffd640 1 -- 172.21.15.2:0/548909535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80c00c40c0 con 0x7f80c006f8f0 2023-11-04T01:44:30.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.359+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80c00ae080 con 0x7f80a00664a0 2023-11-04T01:44:30.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.383+0000 7f80b6ffd640 1 -- 172.21.15.2:0/548909535 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358050 (secure 0 0 0) 0x7f80b00ac6d0 con 0x7f80a00664a0 2023-11-04T01:44:30.394 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:30.395 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80a00664a0 msgr2=0x7f80a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80a00664a0 0x7f80a0068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f80b00ae000 tx=0x7f80b0008040 comp rx=0 tx=0).stop 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c006f8f0 msgr2=0x7f80c014c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c006f8f0 0x7f80c014c5e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f80a800c490 tx=0x7f80a8001e80 comp rx=0 tx=0).stop 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 shutdown_connections 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80a00664a0 0x7f80a0068960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80c015d690 0x7f80c00c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f80c015d2b0 0x7f80c01fa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 --2- 172.21.15.2:0/548909535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80c006f8f0 0x7f80c014c5e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 >> 172.21.15.2:0/548909535 conn(0x7f80c00cebb0 msgr2=0x7f80c00b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 shutdown_connections 2023-11-04T01:44:30.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.387+0000 7f80c4c78640 1 -- 172.21.15.2:0/548909535 wait complete. 2023-11-04T01:44:30.412 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-04T01:44:28.815023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243816,"kb_used_data":6836,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730904,"statfs":{"total":773094113280,"available":772844445696,"internally_reserved":0,"allocated":7000064,"data_stored":3693334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001311"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982884+0000","last_change":"2023-11-04T01:44:25.982884+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982884+0000","last_undegraded":"2023-11-04T01:44:25.982884+0000","last_fullsized":"2023-11-04T01:44:25.982884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976187+0000","last_change":"2023-11-04T01:44:25.976187+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976187+0000","last_undegraded":"2023-11-04T01:44:25.976187+0000","last_fullsized":"2023-11-04T01:44:25.976187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979913+0000","last_change":"2023-11-04T01:44:25.979913+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979913+0000","last_undegraded":"2023-11-04T01:44:25.979913+0000","last_fullsized":"2023-11-04T01:44:25.979913+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982170+0000","last_change":"2023-11-04T01:44:25.982170+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982170+0000","last_undegraded":"2023-11-04T01:44:25.982170+0000","last_fullsized":"2023-11-04T01:44:25.982170+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981364+0000","last_change":"2023-11-04T01:44:25.981364+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981364+0000","last_undegraded":"2023-11-04T01:44:25.981364+0000","last_fullsized":"2023-11-04T01:44:25.981364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976612+0000","last_change":"2023-11-04T01:44:25.976612+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976612+0000","last_undegraded":"2023-11-04T01:44:25.976612+0000","last_fullsized":"2023-11-04T01:44:25.976612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.977361+0000","last_change":"2023-11-04T01:44:25.977361+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.977361+0000","last_undegraded":"2023-11-04T01:44:25.977361+0000","last_fullsized":"2023-11-04T01:44:25.977361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981221+0000","last_change":"2023-11-04T01:44:25.981221+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981221+0000","last_undegraded":"2023-11-04T01:44:25.981221+0000","last_fullsized":"2023-11-04T01:44:25.981221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.975915+0000","last_change":"2023-11-04T01:44:24.975915+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.975915+0000","last_undegraded":"2023-11-04T01:44:24.975915+0000","last_fullsized":"2023-11-04T01:44:24.975915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.983520+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:44:24.983520+0000","last_peered":"2023-11-04T01:44:24.983520+0000","last_clean":"2023-11-04T01:44:24.983520+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:44:24.983520+0000","last_undegraded":"2023-11-04T01:44:24.983520+0000","last_fullsized":"2023-11-04T01:44:24.983520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770136+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:44:22.770136+0000","last_peered":"2023-11-04T01:44:22.770136+0000","last_clean":"2023-11-04T01:44:22.770136+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:44:22.770136+0000","last_undegraded":"2023-11-04T01:44:22.770136+0000","last_fullsized":"2023-11-04T01:44:22.770136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979235+0000","last_change":"2023-11-04T01:44:25.979235+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979235+0000","last_undegraded":"2023-11-04T01:44:25.979235+0000","last_fullsized":"2023-11-04T01:44:25.979235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980411+0000","last_change":"2023-11-04T01:44:24.980411+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980411+0000","last_undegraded":"2023-11-04T01:44:24.980411+0000","last_fullsized":"2023-11-04T01:44:24.980411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770035+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:44:22.770035+0000","last_peered":"2023-11-04T01:44:22.770035+0000","last_clean":"2023-11-04T01:44:22.770035+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:44:22.770035+0000","last_undegraded":"2023-11-04T01:44:22.770035+0000","last_fullsized":"2023-11-04T01:44:22.770035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980153+0000","last_change":"2023-11-04T01:44:24.980153+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980153+0000","last_undegraded":"2023-11-04T01:44:24.980153+0000","last_fullsized":"2023-11-04T01:44:24.980153+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972522+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:44:24.972522+0000","last_peered":"2023-11-04T01:44:24.972522+0000","last_clean":"2023-11-04T01:44:24.972522+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:44:24.972522+0000","last_undegraded":"2023-11-04T01:44:24.972522+0000","last_fullsized":"2023-11-04T01:44:24.972522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980786+0000","last_change":"2023-11-04T01:44:24.980786+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980786+0000","last_undegraded":"2023-11-04T01:44:24.980786+0000","last_fullsized":"2023-11-04T01:44:24.980786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764205+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:44:22.764205+0000","last_peered":"2023-11-04T01:44:22.764205+0000","last_clean":"2023-11-04T01:44:22.764205+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:44:22.764205+0000","last_undegraded":"2023-11-04T01:44:22.764205+0000","last_fullsized":"2023-11-04T01:44:22.764205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976618+0000","last_change":"2023-11-04T01:44:25.976618+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976618+0000","last_undegraded":"2023-11-04T01:44:25.976618+0000","last_fullsized":"2023-11-04T01:44:25.976618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978975+0000","last_change":"2023-11-04T01:44:24.978975+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978975+0000","last_undegraded":"2023-11-04T01:44:24.978975+0000","last_fullsized":"2023-11-04T01:44:24.978975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594788+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:44:22.594788+0000","last_peered":"2023-11-04T01:44:22.594788+0000","last_clean":"2023-11-04T01:44:22.594788+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:44:22.594788+0000","last_undegraded":"2023-11-04T01:44:22.594788+0000","last_fullsized":"2023-11-04T01:44:22.594788+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.975970+0000","last_change":"2023-11-04T01:44:24.975970+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.975970+0000","last_undegraded":"2023-11-04T01:44:24.975970+0000","last_fullsized":"2023-11-04T01:44:24.975970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770394+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:44:22.770394+0000","last_peered":"2023-11-04T01:44:22.770394+0000","last_clean":"2023-11-04T01:44:22.770394+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:44:22.770394+0000","last_undegraded":"2023-11-04T01:44:22.770394+0000","last_fullsized":"2023-11-04T01:44:22.770394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976169+0000","last_change":"2023-11-04T01:44:24.976169+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976169+0000","last_undegraded":"2023-11-04T01:44:24.976169+0000","last_fullsized":"2023-11-04T01:44:24.976169+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764310+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:44:22.764310+0000","last_peered":"2023-11-04T01:44:22.764310+0000","last_clean":"2023-11-04T01:44:22.764310+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:44:22.764310+0000","last_undegraded":"2023-11-04T01:44:22.764310+0000","last_fullsized":"2023-11-04T01:44:22.764310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979257+0000","last_change":"2023-11-04T01:44:25.979257+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979257+0000","last_undegraded":"2023-11-04T01:44:25.979257+0000","last_fullsized":"2023-11-04T01:44:25.979257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.024696+0000","last_change":"2023-11-04T01:44:26.023958+0000","last_active":"2023-11-04T01:44:26.024696+0000","last_peered":"2023-11-04T01:44:26.024696+0000","last_clean":"2023-11-04T01:44:26.024696+0000","last_became_active":"2023-11-04T01:44:26.023597+0000","last_became_peered":"2023-11-04T01:44:26.023597+0000","last_unstale":"2023-11-04T01:44:26.024696+0000","last_undegraded":"2023-11-04T01:44:26.024696+0000","last_fullsized":"2023-11-04T01:44:26.024696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:38.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972667+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:44:24.972667+0000","last_peered":"2023-11-04T01:44:24.972667+0000","last_clean":"2023-11-04T01:44:24.972667+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:44:24.972667+0000","last_undegraded":"2023-11-04T01:44:24.972667+0000","last_fullsized":"2023-11-04T01:44:24.972667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.973273+0000","last_change":"2023-11-04T01:44:24.973273+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.973273+0000","last_undegraded":"2023-11-04T01:44:24.973273+0000","last_fullsized":"2023-11-04T01:44:24.973273+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971792+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:44:24.971792+0000","last_peered":"2023-11-04T01:44:24.971792+0000","last_clean":"2023-11-04T01:44:24.971792+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:44:24.971792+0000","last_undegraded":"2023-11-04T01:44:24.971792+0000","last_fullsized":"2023-11-04T01:44:24.971792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978475+0000","last_change":"2023-11-04T01:44:24.978475+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978475+0000","last_undegraded":"2023-11-04T01:44:24.978475+0000","last_fullsized":"2023-11-04T01:44:24.978475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305201+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:44:22.305201+0000","last_peered":"2023-11-04T01:44:22.305201+0000","last_clean":"2023-11-04T01:44:22.305201+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:44:22.305201+0000","last_undegraded":"2023-11-04T01:44:22.305201+0000","last_fullsized":"2023-11-04T01:44:22.305201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977940+0000","last_change":"2023-11-04T01:44:24.977940+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977940+0000","last_undegraded":"2023-11-04T01:44:24.977940+0000","last_fullsized":"2023-11-04T01:44:24.977940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.769898+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:44:22.769898+0000","last_peered":"2023-11-04T01:44:22.769898+0000","last_clean":"2023-11-04T01:44:22.769898+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:44:22.769898+0000","last_undegraded":"2023-11-04T01:44:22.769898+0000","last_fullsized":"2023-11-04T01:44:22.769898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978340+0000","last_change":"2023-11-04T01:44:24.978340+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978340+0000","last_undegraded":"2023-11-04T01:44:24.978340+0000","last_fullsized":"2023-11-04T01:44:24.978340+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305335+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:44:22.305335+0000","last_peered":"2023-11-04T01:44:22.305335+0000","last_clean":"2023-11-04T01:44:22.305335+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:44:22.305335+0000","last_undegraded":"2023-11-04T01:44:22.305335+0000","last_fullsized":"2023-11-04T01:44:22.305335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978224+0000","last_change":"2023-11-04T01:44:24.978224+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978224+0000","last_undegraded":"2023-11-04T01:44:24.978224+0000","last_fullsized":"2023-11-04T01:44:24.978224+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984868+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:44:24.984868+0000","last_peered":"2023-11-04T01:44:24.984868+0000","last_clean":"2023-11-04T01:44:24.984868+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:44:24.984868+0000","last_undegraded":"2023-11-04T01:44:24.984868+0000","last_fullsized":"2023-11-04T01:44:24.984868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.974235+0000","last_change":"2023-11-04T01:44:24.974235+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.974235+0000","last_undegraded":"2023-11-04T01:44:24.974235+0000","last_fullsized":"2023-11-04T01:44:24.974235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770577+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:44:22.770577+0000","last_peered":"2023-11-04T01:44:22.770577+0000","last_clean":"2023-11-04T01:44:22.770577+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:44:22.770577+0000","last_undegraded":"2023-11-04T01:44:22.770577+0000","last_fullsized":"2023-11-04T01:44:22.770577+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.016448+0000","last_change":"2023-11-04T01:44:26.015593+0000","last_active":"2023-11-04T01:44:26.016448+0000","last_peered":"2023-11-04T01:44:26.016448+0000","last_clean":"2023-11-04T01:44:26.016448+0000","last_became_active":"2023-11-04T01:44:26.015226+0000","last_became_peered":"2023-11-04T01:44:26.015226+0000","last_unstale":"2023-11-04T01:44:26.016448+0000","last_undegraded":"2023-11-04T01:44:26.016448+0000","last_fullsized":"2023-11-04T01:44:26.016448+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:39.263964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594711+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:44:22.594711+0000","last_peered":"2023-11-04T01:44:22.594711+0000","last_clean":"2023-11-04T01:44:22.594711+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:44:22.594711+0000","last_undegraded":"2023-11-04T01:44:22.594711+0000","last_fullsized":"2023-11-04T01:44:22.594711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976038+0000","last_change":"2023-11-04T01:44:25.976038+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976038+0000","last_undegraded":"2023-11-04T01:44:25.976038+0000","last_fullsized":"2023-11-04T01:44:25.976038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981339+0000","last_change":"2023-11-04T01:44:24.981339+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981339+0000","last_undegraded":"2023-11-04T01:44:24.981339+0000","last_fullsized":"2023-11-04T01:44:24.981339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984398+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:44:24.984398+0000","last_peered":"2023-11-04T01:44:24.984398+0000","last_clean":"2023-11-04T01:44:24.984398+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:44:24.984398+0000","last_undegraded":"2023-11-04T01:44:24.984398+0000","last_fullsized":"2023-11-04T01:44:24.984398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982198+0000","last_change":"2023-11-04T01:44:24.982198+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982198+0000","last_undegraded":"2023-11-04T01:44:24.982198+0000","last_fullsized":"2023-11-04T01:44:24.982198+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971917+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:44:24.971917+0000","last_peered":"2023-11-04T01:44:24.971917+0000","last_clean":"2023-11-04T01:44:24.971917+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:44:24.971917+0000","last_undegraded":"2023-11-04T01:44:24.971917+0000","last_fullsized":"2023-11-04T01:44:24.971917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977410+0000","last_change":"2023-11-04T01:44:24.977410+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977410+0000","last_undegraded":"2023-11-04T01:44:24.977410+0000","last_fullsized":"2023-11-04T01:44:24.977410+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764190+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:44:22.764190+0000","last_peered":"2023-11-04T01:44:22.764190+0000","last_clean":"2023-11-04T01:44:22.764190+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:44:22.764190+0000","last_undegraded":"2023-11-04T01:44:22.764190+0000","last_fullsized":"2023-11-04T01:44:22.764190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981356+0000","last_change":"2023-11-04T01:44:24.981356+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981356+0000","last_undegraded":"2023-11-04T01:44:24.981356+0000","last_fullsized":"2023-11-04T01:44:24.981356+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305020+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:44:22.305020+0000","last_peered":"2023-11-04T01:44:22.305020+0000","last_clean":"2023-11-04T01:44:22.305020+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:44:22.305020+0000","last_undegraded":"2023-11-04T01:44:22.305020+0000","last_fullsized":"2023-11-04T01:44:22.305020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982581+0000","last_change":"2023-11-04T01:44:24.982581+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982581+0000","last_undegraded":"2023-11-04T01:44:24.982581+0000","last_fullsized":"2023-11-04T01:44:24.982581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594658+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:44:22.594658+0000","last_peered":"2023-11-04T01:44:22.594658+0000","last_clean":"2023-11-04T01:44:22.594658+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:44:22.594658+0000","last_undegraded":"2023-11-04T01:44:22.594658+0000","last_fullsized":"2023-11-04T01:44:22.594658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.985508+0000","last_change":"2023-11-04T01:44:25.985508+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.985508+0000","last_undegraded":"2023-11-04T01:44:25.985508+0000","last_fullsized":"2023-11-04T01:44:25.985508+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981240+0000","last_change":"2023-11-04T01:44:24.981240+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981240+0000","last_undegraded":"2023-11-04T01:44:24.981240+0000","last_fullsized":"2023-11-04T01:44:24.981240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305451+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:44:22.305451+0000","last_peered":"2023-11-04T01:44:22.305451+0000","last_clean":"2023-11-04T01:44:22.305451+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:44:22.305451+0000","last_undegraded":"2023-11-04T01:44:22.305451+0000","last_fullsized":"2023-11-04T01:44:22.305451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978236+0000","last_change":"2023-11-04T01:44:24.978236+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978236+0000","last_undegraded":"2023-11-04T01:44:24.978236+0000","last_fullsized":"2023-11-04T01:44:24.978236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.985254+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:44:24.985254+0000","last_peered":"2023-11-04T01:44:24.985254+0000","last_clean":"2023-11-04T01:44:24.985254+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:44:24.985254+0000","last_undegraded":"2023-11-04T01:44:24.985254+0000","last_fullsized":"2023-11-04T01:44:24.985254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.972096+0000","last_change":"2023-11-04T01:44:24.972096+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.972096+0000","last_undegraded":"2023-11-04T01:44:24.972096+0000","last_fullsized":"2023-11-04T01:44:24.972096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305279+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:44:22.305279+0000","last_peered":"2023-11-04T01:44:22.305279+0000","last_clean":"2023-11-04T01:44:22.305279+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:44:22.305279+0000","last_undegraded":"2023-11-04T01:44:22.305279+0000","last_fullsized":"2023-11-04T01:44:22.305279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976253+0000","last_change":"2023-11-04T01:44:24.976253+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976253+0000","last_undegraded":"2023-11-04T01:44:24.976253+0000","last_fullsized":"2023-11-04T01:44:24.976253+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":35,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.303006+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:44:22.303006+0000","last_peered":"2023-11-04T01:44:22.303006+0000","last_clean":"2023-11-04T01:44:22.303006+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:44:22.303006+0000","last_undegraded":"2023-11-04T01:44:22.303006+0000","last_fullsized":"2023-11-04T01:44:22.303006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979976+0000","last_change":"2023-11-04T01:44:25.979976+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979976+0000","last_undegraded":"2023-11-04T01:44:25.979976+0000","last_fullsized":"2023-11-04T01:44:25.979976+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981141+0000","last_change":"2023-11-04T01:44:24.981141+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981141+0000","last_undegraded":"2023-11-04T01:44:24.981141+0000","last_fullsized":"2023-11-04T01:44:24.981141+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.769949+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:44:22.769949+0000","last_peered":"2023-11-04T01:44:22.769949+0000","last_clean":"2023-11-04T01:44:22.769949+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:44:22.769949+0000","last_undegraded":"2023-11-04T01:44:22.769949+0000","last_fullsized":"2023-11-04T01:44:22.769949+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976179+0000","last_change":"2023-11-04T01:44:24.976179+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976179+0000","last_undegraded":"2023-11-04T01:44:24.976179+0000","last_fullsized":"2023-11-04T01:44:24.976179+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594657+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:44:22.594657+0000","last_peered":"2023-11-04T01:44:22.594657+0000","last_clean":"2023-11-04T01:44:22.594657+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:44:22.594657+0000","last_undegraded":"2023-11-04T01:44:22.594657+0000","last_fullsized":"2023-11-04T01:44:22.594657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982018+0000","last_change":"2023-11-04T01:44:24.982018+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982018+0000","last_undegraded":"2023-11-04T01:44:24.982018+0000","last_fullsized":"2023-11-04T01:44:24.982018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305242+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:44:22.305242+0000","last_peered":"2023-11-04T01:44:22.305242+0000","last_clean":"2023-11-04T01:44:22.305242+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:44:22.305242+0000","last_undegraded":"2023-11-04T01:44:22.305242+0000","last_fullsized":"2023-11-04T01:44:22.305242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.002160+0000","last_change":"2023-11-04T01:44:25.996467+0000","last_active":"2023-11-04T01:44:26.002160+0000","last_peered":"2023-11-04T01:44:26.002160+0000","last_clean":"2023-11-04T01:44:26.002160+0000","last_became_active":"2023-11-04T01:44:25.995184+0000","last_became_peered":"2023-11-04T01:44:25.995184+0000","last_unstale":"2023-11-04T01:44:26.002160+0000","last_undegraded":"2023-11-04T01:44:26.002160+0000","last_fullsized":"2023-11-04T01:44:26.002160+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:02.603408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971694+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:44:24.971694+0000","last_peered":"2023-11-04T01:44:24.971694+0000","last_clean":"2023-11-04T01:44:24.971694+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:44:24.971694+0000","last_undegraded":"2023-11-04T01:44:24.971694+0000","last_fullsized":"2023-11-04T01:44:24.971694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.984663+0000","last_change":"2023-11-04T01:44:25.984663+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.984663+0000","last_undegraded":"2023-11-04T01:44:25.984663+0000","last_fullsized":"2023-11-04T01:44:25.984663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980271+0000","last_change":"2023-11-04T01:44:24.980271+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980271+0000","last_undegraded":"2023-11-04T01:44:24.980271+0000","last_fullsized":"2023-11-04T01:44:24.980271+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770216+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:44:22.770216+0000","last_peered":"2023-11-04T01:44:22.770216+0000","last_clean":"2023-11-04T01:44:22.770216+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:44:22.770216+0000","last_undegraded":"2023-11-04T01:44:22.770216+0000","last_fullsized":"2023-11-04T01:44:22.770216+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:25.997388+0000","last_change":"2023-11-04T01:44:25.991176+0000","last_active":"2023-11-04T01:44:25.997388+0000","last_peered":"2023-11-04T01:44:25.997388+0000","last_clean":"2023-11-04T01:44:25.997388+0000","last_became_active":"2023-11-04T01:44:25.990747+0000","last_became_peered":"2023-11-04T01:44:25.990747+0000","last_unstale":"2023-11-04T01:44:25.997388+0000","last_undegraded":"2023-11-04T01:44:25.997388+0000","last_fullsized":"2023-11-04T01:44:25.997388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:16.695292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594650+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:44:22.594650+0000","last_peered":"2023-11-04T01:44:22.594650+0000","last_clean":"2023-11-04T01:44:22.594650+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:44:22.594650+0000","last_undegraded":"2023-11-04T01:44:22.594650+0000","last_fullsized":"2023-11-04T01:44:22.594650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982646+0000","last_change":"2023-11-04T01:44:25.982646+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982646+0000","last_undegraded":"2023-11-04T01:44:25.982646+0000","last_fullsized":"2023-11-04T01:44:25.982646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977938+0000","last_change":"2023-11-04T01:44:24.977938+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977938+0000","last_undegraded":"2023-11-04T01:44:24.977938+0000","last_fullsized":"2023-11-04T01:44:24.977938+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770274+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:44:22.770274+0000","last_peered":"2023-11-04T01:44:22.770274+0000","last_clean":"2023-11-04T01:44:22.770274+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:44:22.770274+0000","last_undegraded":"2023-11-04T01:44:22.770274+0000","last_fullsized":"2023-11-04T01:44:22.770274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981465+0000","last_change":"2023-11-04T01:44:25.981465+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981465+0000","last_undegraded":"2023-11-04T01:44:25.981465+0000","last_fullsized":"2023-11-04T01:44:25.981465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.006150+0000","last_change":"2023-11-04T01:44:26.005066+0000","last_active":"2023-11-04T01:44:26.006150+0000","last_peered":"2023-11-04T01:44:26.006150+0000","last_clean":"2023-11-04T01:44:26.006150+0000","last_became_active":"2023-11-04T01:44:26.004633+0000","last_became_peered":"2023-11-04T01:44:26.004633+0000","last_unstale":"2023-11-04T01:44:26.006150+0000","last_undegraded":"2023-11-04T01:44:26.006150+0000","last_fullsized":"2023-11-04T01:44:26.006150+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:07.715775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594794+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:44:22.594794+0000","last_peered":"2023-11-04T01:44:22.594794+0000","last_clean":"2023-11-04T01:44:22.594794+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:44:22.594794+0000","last_undegraded":"2023-11-04T01:44:22.594794+0000","last_fullsized":"2023-11-04T01:44:22.594794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":910185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.628}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.35299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.371,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.499}]},{"osd":4,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.877},"min":{"1min":0.57299999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.65300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3640000000000001,"5min":1.365,"15min":1.365},"last":0.99299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3540000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.079}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0620000000000001,"15min":1.0720000000000001},"min":{"1min":0.70199999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.373,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4159999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.079,"15min":1.077},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.92200000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":319817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.607}]},{"osd":3,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.143,"5min":1.885,"15min":1.885},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.526,"15min":1.526},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.3380000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2410000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.0960000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0089999999999999,"15min":1.006},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.256}]},{"osd":7,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.095,"15min":1.0960000000000001},"min":{"1min":0.628,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.518},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.369,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.3779999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.89600000000000002},"min":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.276,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.84799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.333,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.875},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.137,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.86799999999999999,"15min":0.85699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1040000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90200000000000002},"min":{"1min":0.66700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2989999999999999,"5min":1.514,"15min":1.514},"last":1.032}]},{"osd":4,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.073,"15min":1.077},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2729999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.232,"5min":2.609,"15min":2.609},"last":0.997}]},{"osd":5,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.1539999999999999,"15min":1.1759999999999999},"min":{"1min":0.77800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.387,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.125,"5min":2.4529999999999998,"15min":2.6749999999999998},"min":{"1min":0.82899999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3660000000000001,"5min":40.195,"15min":40.195},"last":1.1200000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2909999999999999,"15min":1.319},"min":{"1min":0.94699999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2849999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1399999999999999,"15min":1.1499999999999999},"min":{"1min":0.77000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5529999999999999,"5min":1.637,"15min":1.637},"last":0.95099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.413,"5min":1.623,"15min":1.623},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.94699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4039999999999999,"5min":1.724,"15min":1.724},"last":0.83199999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.95399999999999996,"15min":0.96299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.444,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.244,"15min":1.244},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0089999999999999,"15min":1.0169999999999999},"min":{"1min":0.61899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4330000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.03},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.298,"5min":1.976,"15min":1.976},"last":0.96399999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0049999999999999},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.335,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.002},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.546,"5min":2.161,"15min":2.161},"last":0.745}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.63,"5min":0.495,"15min":0.495},"max":{"1min":1.333,"5min":1.538,"15min":1.538},"last":0.879},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.1220000000000001},"min":{"1min":0.70199999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.516,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.079}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0600000000000001},"min":{"1min":0.69799999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.204,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.038},{"interface":"front","average":{"1min":1.095,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.484,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.381}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8919999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1060000000000001,"15min":1.111},"min":{"1min":0.83299999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.387,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1439999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":903557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":0.876},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.23,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.321,"15min":1.321},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.28},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3320000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.4119999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.874,"15min":0.875},"min":{"1min":0.55600000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.1559999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.371},{"interface":"front","average":{"1min":1.024,"5min":0.93600000000000005,"15min":0.92200000000000004},"min":{"1min":0.72599999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.98499999999999999,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.343,"5min":1.401,"15min":1.401},"last":1.325},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0269999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3879999999999999,"5min":1.627,"15min":1.627},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.198,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":1.026,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.399,"5min":1.526,"15min":1.526},"last":1.4630000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.137,"15min":1.1459999999999999},"min":{"1min":0.81799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.409,"5min":1.49,"15min":1.49},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.22,"15min":1.23},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.496,"5min":1.536,"15min":1.536},"last":0.68799999999999994}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.758,"15min":1.758},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.46,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.755},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.173,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96499999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.65900000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1839999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2889999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":1.833,"15min":1.833},"last":0.84299999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3420000000000001,"5min":1.369,"15min":1.369},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.125},"min":{"1min":0.77200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7410000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.014},"min":{"1min":0.84599999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.4399999999999999,"5min":1.554,"15min":1.554},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.292,"5min":1.417,"15min":1.417},"last":0.877},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.202},"min":{"1min":0.96799999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0569999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":712704,"data_stored":307019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85999999999999999,"5min":1.167,"15min":1.167},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.252,"5min":1.429,"15min":1.429},"last":0.501}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1890000000000001,"5min":1.252,"15min":1.252},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4159999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.357,"5min":1.369,"15min":1.369},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.91800000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.0429999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.103,"5min":1.0469999999999999,"15min":1.0369999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.72499999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.1319999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.81799999999999995,"5min":1.022,"15min":1.022},"last":0.90800000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.38100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.054,"5min":1.181,"15min":1.181},"last":0.875}]},{"osd":4,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.173},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.411,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.879,"15min":0.877},"min":{"1min":0.61299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.329},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.282}]},{"osd":6,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2290000000000001,"5min":1.603,"15min":1.603},"last":1.034},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.367}]},{"osd":7,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.002,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.377,"5min":1.411,"15min":1.411},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.272,"5min":1.613,"15min":1.613},"last":1.2350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:44:30.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.575+0000 7f276e143640 1 Processor -- start 2023-11-04T01:44:30.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.575+0000 7f276e143640 1 -- start start 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f276e143640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f276815b320 0x7f276806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f276e143640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f276815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f276e143640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276806bb30 con 0x7f276806fe30 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f276e143640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276806c7b0 con 0x7f276815b320 2023-11-04T01:44:30.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f276e143640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276806be10 con 0x7f27680b0d40 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f27677fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f276815b320 0x7f276806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f2767fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f276815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f27677fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f276815b320 0x7f276806f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:33772/0 (socket says 172.21.15.2:33772) 2023-11-04T01:44:30.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f2767fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f276815ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:38440/0 (socket says 172.21.15.2:38440) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f275ffff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f276806fe30 0x7f27680b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:37762/0 (socket says 172.21.15.2:37762) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f27677fe640 1 -- 172.21.15.2:0/1511848036 learned_addr learned my addr 172.21.15.2:0/1511848036 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f27677fe640 1 -- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 msgr2=0x7f276815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f27677fe640 1 --2- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f276815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f27677fe640 1 -- 172.21.15.2:0/1511848036 >> v1:172.21.15.90:6789/0 conn(0x7f276806fe30 legacy=0x7f27680b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f27677fe640 1 -- 172.21.15.2:0/1511848036 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276806c0f0 con 0x7f276815b320 2023-11-04T01:44:30.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.579+0000 7f2767fff640 1 --2- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f276815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f27677fe640 1 --2- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276815b320 0x7f276806f8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2750009870 tx=0x7f275001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd052bf84902b501 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f2766ffd640 1 -- 172.21.15.2:0/1511848036 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500a6040 con 0x7f276815b320 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f2766ffd640 1 -- 172.21.15.2:0/1511848036 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500aa600 con 0x7f276815b320 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f2766ffd640 1 -- 172.21.15.2:0/1511848036 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500aa990 con 0x7f276815b320 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276815b320 msgr2=0x7f276806f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 --2- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276815b320 0x7f276806f8f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2750009870 tx=0x7f275001c480 comp rx=0 tx=0).stop 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- 172.21.15.2:0/1511848036 shutdown_connections 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 --2- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f276815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 --2- 172.21.15.2:0/1511848036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f276815b320 0x7f276806f8f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- 172.21.15.2:0/1511848036 >> 172.21.15.2:0/1511848036 conn(0x7f27680cebb0 msgr2=0x7f27680cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- 172.21.15.2:0/1511848036 shutdown_connections 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- 172.21.15.2:0/1511848036 wait complete. 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 Processor -- start 2023-11-04T01:44:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- start start 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f276806fe30 0x7f27680c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f2768156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2768154f80 0x7f27680af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27681565a0 con 0x7f276806fe30 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2768155990 con 0x7f2768154f80 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f276e143640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2768155c70 con 0x7f27680b0d40 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f27677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f276806fe30 0x7f27680c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f27677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f276806fe30 0x7f27680c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36578/0 (socket says 172.21.15.2:36578) 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f27677fe640 1 -- 172.21.15.2:0/2281638976 learned_addr learned my addr 172.21.15.2:0/2281638976 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.583+0000 7f2767fff640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2768154f80 0x7f27680af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f275ffff640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f2768156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f27677fe640 1 -- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 msgr2=0x7f2768156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f27677fe640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f2768156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f27677fe640 1 -- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2768154f80 msgr2=0x7f27680af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f27677fe640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2768154f80 0x7f27680af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f27677fe640 1 -- 172.21.15.2:0/2281638976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2760009a70 con 0x7f276806fe30 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f27677fe640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f276806fe30 0x7f27680c4f30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f275001ab30 tx=0x7f275001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f2764ff9640 1 -- 172.21.15.2:0/2281638976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500b3800 con 0x7f276806fe30 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f2764ff9640 1 -- 172.21.15.2:0/2281638976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500b3960 con 0x7f276806fe30 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f2764ff9640 1 -- 172.21.15.2:0/2281638976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500b3d10 con 0x7f276806fe30 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27500094d0 con 0x7f276806fe30 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2768156230 con 0x7f276806fe30 2023-11-04T01:44:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27680744a0 con 0x7f276806fe30 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f2764ff9640 1 -- 172.21.15.2:0/2281638976 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27500c8480 con 0x7f276806fe30 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f2764ff9640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27480664a0 0x7f2748068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f2764ff9640 1 -- 172.21.15.2:0/2281638976 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f275011e870 con 0x7f276806fe30 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f275ffff640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27480664a0 0x7f2748068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.587+0000 7f275ffff640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27480664a0 0x7f2748068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f276815d430 tx=0x7f2758007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.591+0000 7f2764ff9640 1 -- 172.21.15.2:0/2281638976 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f27500ebc20 con 0x7f276806fe30 2023-11-04T01:44:30.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.743+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27681680a0 con 0x7f27480664a0 2023-11-04T01:44:30.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.771+0000 7f2764ff9640 1 -- 172.21.15.2:0/2281638976 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358050 (secure 0 0 0) 0x7f2758005a60 con 0x7f27480664a0 2023-11-04T01:44:30.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27480664a0 msgr2=0x7f2748068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27480664a0 0x7f2748068960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f276815d430 tx=0x7f2758007c90 comp rx=0 tx=0).stop 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f276806fe30 msgr2=0x7f27680c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f276806fe30 0x7f27680c4f30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f275001ab30 tx=0x7f275001acc0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 shutdown_connections 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f27480664a0 0x7f2748068960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2768154f80 0x7f27680af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f27680b0d40 0x7f2768156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 --2- 172.21.15.2:0/2281638976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f276806fe30 0x7f27680c4f30 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 >> 172.21.15.2:0/2281638976 conn(0x7f27680cebb0 msgr2=0x7f2768153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 shutdown_connections 2023-11-04T01:44:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.775+0000 7f276e143640 1 -- 172.21.15.2:0/2281638976 wait complete. 2023-11-04T01:44:30.798 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-11-04T01:44:28.815023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":164,"acting":164,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243816,"kb_used_data":6836,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730904,"statfs":{"total":773094113280,"available":772844445696,"internally_reserved":0,"allocated":7000064,"data_stored":3693334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001311"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982884+0000","last_change":"2023-11-04T01:44:25.982884+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982884+0000","last_undegraded":"2023-11-04T01:44:25.982884+0000","last_fullsized":"2023-11-04T01:44:25.982884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976187+0000","last_change":"2023-11-04T01:44:25.976187+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976187+0000","last_undegraded":"2023-11-04T01:44:25.976187+0000","last_fullsized":"2023-11-04T01:44:25.976187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979913+0000","last_change":"2023-11-04T01:44:25.979913+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979913+0000","last_undegraded":"2023-11-04T01:44:25.979913+0000","last_fullsized":"2023-11-04T01:44:25.979913+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982170+0000","last_change":"2023-11-04T01:44:25.982170+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982170+0000","last_undegraded":"2023-11-04T01:44:25.982170+0000","last_fullsized":"2023-11-04T01:44:25.982170+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981364+0000","last_change":"2023-11-04T01:44:25.981364+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981364+0000","last_undegraded":"2023-11-04T01:44:25.981364+0000","last_fullsized":"2023-11-04T01:44:25.981364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976612+0000","last_change":"2023-11-04T01:44:25.976612+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976612+0000","last_undegraded":"2023-11-04T01:44:25.976612+0000","last_fullsized":"2023-11-04T01:44:25.976612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.977361+0000","last_change":"2023-11-04T01:44:25.977361+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.977361+0000","last_undegraded":"2023-11-04T01:44:25.977361+0000","last_fullsized":"2023-11-04T01:44:25.977361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981221+0000","last_change":"2023-11-04T01:44:25.981221+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981221+0000","last_undegraded":"2023-11-04T01:44:25.981221+0000","last_fullsized":"2023-11-04T01:44:25.981221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.975915+0000","last_change":"2023-11-04T01:44:24.975915+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.975915+0000","last_undegraded":"2023-11-04T01:44:24.975915+0000","last_fullsized":"2023-11-04T01:44:24.975915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.983520+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:44:24.983520+0000","last_peered":"2023-11-04T01:44:24.983520+0000","last_clean":"2023-11-04T01:44:24.983520+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:44:24.983520+0000","last_undegraded":"2023-11-04T01:44:24.983520+0000","last_fullsized":"2023-11-04T01:44:24.983520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770136+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:44:22.770136+0000","last_peered":"2023-11-04T01:44:22.770136+0000","last_clean":"2023-11-04T01:44:22.770136+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:44:22.770136+0000","last_undegraded":"2023-11-04T01:44:22.770136+0000","last_fullsized":"2023-11-04T01:44:22.770136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979235+0000","last_change":"2023-11-04T01:44:25.979235+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979235+0000","last_undegraded":"2023-11-04T01:44:25.979235+0000","last_fullsized":"2023-11-04T01:44:25.979235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980411+0000","last_change":"2023-11-04T01:44:24.980411+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980411+0000","last_undegraded":"2023-11-04T01:44:24.980411+0000","last_fullsized":"2023-11-04T01:44:24.980411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770035+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:44:22.770035+0000","last_peered":"2023-11-04T01:44:22.770035+0000","last_clean":"2023-11-04T01:44:22.770035+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:44:22.770035+0000","last_undegraded":"2023-11-04T01:44:22.770035+0000","last_fullsized":"2023-11-04T01:44:22.770035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980153+0000","last_change":"2023-11-04T01:44:24.980153+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980153+0000","last_undegraded":"2023-11-04T01:44:24.980153+0000","last_fullsized":"2023-11-04T01:44:24.980153+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972522+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:44:24.972522+0000","last_peered":"2023-11-04T01:44:24.972522+0000","last_clean":"2023-11-04T01:44:24.972522+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:44:24.972522+0000","last_undegraded":"2023-11-04T01:44:24.972522+0000","last_fullsized":"2023-11-04T01:44:24.972522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980786+0000","last_change":"2023-11-04T01:44:24.980786+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980786+0000","last_undegraded":"2023-11-04T01:44:24.980786+0000","last_fullsized":"2023-11-04T01:44:24.980786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764205+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:44:22.764205+0000","last_peered":"2023-11-04T01:44:22.764205+0000","last_clean":"2023-11-04T01:44:22.764205+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:44:22.764205+0000","last_undegraded":"2023-11-04T01:44:22.764205+0000","last_fullsized":"2023-11-04T01:44:22.764205+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976618+0000","last_change":"2023-11-04T01:44:25.976618+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976618+0000","last_undegraded":"2023-11-04T01:44:25.976618+0000","last_fullsized":"2023-11-04T01:44:25.976618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978975+0000","last_change":"2023-11-04T01:44:24.978975+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978975+0000","last_undegraded":"2023-11-04T01:44:24.978975+0000","last_fullsized":"2023-11-04T01:44:24.978975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594788+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:44:22.594788+0000","last_peered":"2023-11-04T01:44:22.594788+0000","last_clean":"2023-11-04T01:44:22.594788+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:44:22.594788+0000","last_undegraded":"2023-11-04T01:44:22.594788+0000","last_fullsized":"2023-11-04T01:44:22.594788+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.975970+0000","last_change":"2023-11-04T01:44:24.975970+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.975970+0000","last_undegraded":"2023-11-04T01:44:24.975970+0000","last_fullsized":"2023-11-04T01:44:24.975970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770394+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:44:22.770394+0000","last_peered":"2023-11-04T01:44:22.770394+0000","last_clean":"2023-11-04T01:44:22.770394+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:44:22.770394+0000","last_undegraded":"2023-11-04T01:44:22.770394+0000","last_fullsized":"2023-11-04T01:44:22.770394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976169+0000","last_change":"2023-11-04T01:44:24.976169+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976169+0000","last_undegraded":"2023-11-04T01:44:24.976169+0000","last_fullsized":"2023-11-04T01:44:24.976169+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764310+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:44:22.764310+0000","last_peered":"2023-11-04T01:44:22.764310+0000","last_clean":"2023-11-04T01:44:22.764310+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:44:22.764310+0000","last_undegraded":"2023-11-04T01:44:22.764310+0000","last_fullsized":"2023-11-04T01:44:22.764310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979257+0000","last_change":"2023-11-04T01:44:25.979257+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979257+0000","last_undegraded":"2023-11-04T01:44:25.979257+0000","last_fullsized":"2023-11-04T01:44:25.979257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.024696+0000","last_change":"2023-11-04T01:44:26.023958+0000","last_active":"2023-11-04T01:44:26.024696+0000","last_peered":"2023-11-04T01:44:26.024696+0000","last_clean":"2023-11-04T01:44:26.024696+0000","last_became_active":"2023-11-04T01:44:26.023597+0000","last_became_peered":"2023-11-04T01:44:26.023597+0000","last_unstale":"2023-11-04T01:44:26.024696+0000","last_undegraded":"2023-11-04T01:44:26.024696+0000","last_fullsized":"2023-11-04T01:44:26.024696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:38.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972667+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:44:24.972667+0000","last_peered":"2023-11-04T01:44:24.972667+0000","last_clean":"2023-11-04T01:44:24.972667+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:44:24.972667+0000","last_undegraded":"2023-11-04T01:44:24.972667+0000","last_fullsized":"2023-11-04T01:44:24.972667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.973273+0000","last_change":"2023-11-04T01:44:24.973273+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.973273+0000","last_undegraded":"2023-11-04T01:44:24.973273+0000","last_fullsized":"2023-11-04T01:44:24.973273+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971792+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:44:24.971792+0000","last_peered":"2023-11-04T01:44:24.971792+0000","last_clean":"2023-11-04T01:44:24.971792+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:44:24.971792+0000","last_undegraded":"2023-11-04T01:44:24.971792+0000","last_fullsized":"2023-11-04T01:44:24.971792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978475+0000","last_change":"2023-11-04T01:44:24.978475+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978475+0000","last_undegraded":"2023-11-04T01:44:24.978475+0000","last_fullsized":"2023-11-04T01:44:24.978475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305201+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:44:22.305201+0000","last_peered":"2023-11-04T01:44:22.305201+0000","last_clean":"2023-11-04T01:44:22.305201+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:44:22.305201+0000","last_undegraded":"2023-11-04T01:44:22.305201+0000","last_fullsized":"2023-11-04T01:44:22.305201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977940+0000","last_change":"2023-11-04T01:44:24.977940+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977940+0000","last_undegraded":"2023-11-04T01:44:24.977940+0000","last_fullsized":"2023-11-04T01:44:24.977940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.769898+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:44:22.769898+0000","last_peered":"2023-11-04T01:44:22.769898+0000","last_clean":"2023-11-04T01:44:22.769898+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:44:22.769898+0000","last_undegraded":"2023-11-04T01:44:22.769898+0000","last_fullsized":"2023-11-04T01:44:22.769898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978340+0000","last_change":"2023-11-04T01:44:24.978340+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978340+0000","last_undegraded":"2023-11-04T01:44:24.978340+0000","last_fullsized":"2023-11-04T01:44:24.978340+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305335+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:44:22.305335+0000","last_peered":"2023-11-04T01:44:22.305335+0000","last_clean":"2023-11-04T01:44:22.305335+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:44:22.305335+0000","last_undegraded":"2023-11-04T01:44:22.305335+0000","last_fullsized":"2023-11-04T01:44:22.305335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978224+0000","last_change":"2023-11-04T01:44:24.978224+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978224+0000","last_undegraded":"2023-11-04T01:44:24.978224+0000","last_fullsized":"2023-11-04T01:44:24.978224+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984868+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:44:24.984868+0000","last_peered":"2023-11-04T01:44:24.984868+0000","last_clean":"2023-11-04T01:44:24.984868+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:44:24.984868+0000","last_undegraded":"2023-11-04T01:44:24.984868+0000","last_fullsized":"2023-11-04T01:44:24.984868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.974235+0000","last_change":"2023-11-04T01:44:24.974235+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.974235+0000","last_undegraded":"2023-11-04T01:44:24.974235+0000","last_fullsized":"2023-11-04T01:44:24.974235+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770577+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:44:22.770577+0000","last_peered":"2023-11-04T01:44:22.770577+0000","last_clean":"2023-11-04T01:44:22.770577+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:44:22.770577+0000","last_undegraded":"2023-11-04T01:44:22.770577+0000","last_fullsized":"2023-11-04T01:44:22.770577+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.016448+0000","last_change":"2023-11-04T01:44:26.015593+0000","last_active":"2023-11-04T01:44:26.016448+0000","last_peered":"2023-11-04T01:44:26.016448+0000","last_clean":"2023-11-04T01:44:26.016448+0000","last_became_active":"2023-11-04T01:44:26.015226+0000","last_became_peered":"2023-11-04T01:44:26.015226+0000","last_unstale":"2023-11-04T01:44:26.016448+0000","last_undegraded":"2023-11-04T01:44:26.016448+0000","last_fullsized":"2023-11-04T01:44:26.016448+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:39.263964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594711+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:44:22.594711+0000","last_peered":"2023-11-04T01:44:22.594711+0000","last_clean":"2023-11-04T01:44:22.594711+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:44:22.594711+0000","last_undegraded":"2023-11-04T01:44:22.594711+0000","last_fullsized":"2023-11-04T01:44:22.594711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976038+0000","last_change":"2023-11-04T01:44:25.976038+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976038+0000","last_undegraded":"2023-11-04T01:44:25.976038+0000","last_fullsized":"2023-11-04T01:44:25.976038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981339+0000","last_change":"2023-11-04T01:44:24.981339+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981339+0000","last_undegraded":"2023-11-04T01:44:24.981339+0000","last_fullsized":"2023-11-04T01:44:24.981339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984398+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:44:24.984398+0000","last_peered":"2023-11-04T01:44:24.984398+0000","last_clean":"2023-11-04T01:44:24.984398+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:44:24.984398+0000","last_undegraded":"2023-11-04T01:44:24.984398+0000","last_fullsized":"2023-11-04T01:44:24.984398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982198+0000","last_change":"2023-11-04T01:44:24.982198+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982198+0000","last_undegraded":"2023-11-04T01:44:24.982198+0000","last_fullsized":"2023-11-04T01:44:24.982198+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971917+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:44:24.971917+0000","last_peered":"2023-11-04T01:44:24.971917+0000","last_clean":"2023-11-04T01:44:24.971917+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:44:24.971917+0000","last_undegraded":"2023-11-04T01:44:24.971917+0000","last_fullsized":"2023-11-04T01:44:24.971917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977410+0000","last_change":"2023-11-04T01:44:24.977410+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977410+0000","last_undegraded":"2023-11-04T01:44:24.977410+0000","last_fullsized":"2023-11-04T01:44:24.977410+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.764190+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:44:22.764190+0000","last_peered":"2023-11-04T01:44:22.764190+0000","last_clean":"2023-11-04T01:44:22.764190+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:44:22.764190+0000","last_undegraded":"2023-11-04T01:44:22.764190+0000","last_fullsized":"2023-11-04T01:44:22.764190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981356+0000","last_change":"2023-11-04T01:44:24.981356+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981356+0000","last_undegraded":"2023-11-04T01:44:24.981356+0000","last_fullsized":"2023-11-04T01:44:24.981356+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305020+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:44:22.305020+0000","last_peered":"2023-11-04T01:44:22.305020+0000","last_clean":"2023-11-04T01:44:22.305020+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:44:22.305020+0000","last_undegraded":"2023-11-04T01:44:22.305020+0000","last_fullsized":"2023-11-04T01:44:22.305020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982581+0000","last_change":"2023-11-04T01:44:24.982581+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982581+0000","last_undegraded":"2023-11-04T01:44:24.982581+0000","last_fullsized":"2023-11-04T01:44:24.982581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594658+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:44:22.594658+0000","last_peered":"2023-11-04T01:44:22.594658+0000","last_clean":"2023-11-04T01:44:22.594658+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:44:22.594658+0000","last_undegraded":"2023-11-04T01:44:22.594658+0000","last_fullsized":"2023-11-04T01:44:22.594658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.985508+0000","last_change":"2023-11-04T01:44:25.985508+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.985508+0000","last_undegraded":"2023-11-04T01:44:25.985508+0000","last_fullsized":"2023-11-04T01:44:25.985508+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981240+0000","last_change":"2023-11-04T01:44:24.981240+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981240+0000","last_undegraded":"2023-11-04T01:44:24.981240+0000","last_fullsized":"2023-11-04T01:44:24.981240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305451+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:44:22.305451+0000","last_peered":"2023-11-04T01:44:22.305451+0000","last_clean":"2023-11-04T01:44:22.305451+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:44:22.305451+0000","last_undegraded":"2023-11-04T01:44:22.305451+0000","last_fullsized":"2023-11-04T01:44:22.305451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.978236+0000","last_change":"2023-11-04T01:44:24.978236+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.978236+0000","last_undegraded":"2023-11-04T01:44:24.978236+0000","last_fullsized":"2023-11-04T01:44:24.978236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.985254+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:44:24.985254+0000","last_peered":"2023-11-04T01:44:24.985254+0000","last_clean":"2023-11-04T01:44:24.985254+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:44:24.985254+0000","last_undegraded":"2023-11-04T01:44:24.985254+0000","last_fullsized":"2023-11-04T01:44:24.985254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.972096+0000","last_change":"2023-11-04T01:44:24.972096+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.972096+0000","last_undegraded":"2023-11-04T01:44:24.972096+0000","last_fullsized":"2023-11-04T01:44:24.972096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305279+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:44:22.305279+0000","last_peered":"2023-11-04T01:44:22.305279+0000","last_clean":"2023-11-04T01:44:22.305279+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:44:22.305279+0000","last_undegraded":"2023-11-04T01:44:22.305279+0000","last_fullsized":"2023-11-04T01:44:22.305279+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976253+0000","last_change":"2023-11-04T01:44:24.976253+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976253+0000","last_undegraded":"2023-11-04T01:44:24.976253+0000","last_fullsized":"2023-11-04T01:44:24.976253+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":35,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.303006+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:44:22.303006+0000","last_peered":"2023-11-04T01:44:22.303006+0000","last_clean":"2023-11-04T01:44:22.303006+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:44:22.303006+0000","last_undegraded":"2023-11-04T01:44:22.303006+0000","last_fullsized":"2023-11-04T01:44:22.303006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979976+0000","last_change":"2023-11-04T01:44:25.979976+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979976+0000","last_undegraded":"2023-11-04T01:44:25.979976+0000","last_fullsized":"2023-11-04T01:44:25.979976+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.981141+0000","last_change":"2023-11-04T01:44:24.981141+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.981141+0000","last_undegraded":"2023-11-04T01:44:24.981141+0000","last_fullsized":"2023-11-04T01:44:24.981141+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.769949+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:44:22.769949+0000","last_peered":"2023-11-04T01:44:22.769949+0000","last_clean":"2023-11-04T01:44:22.769949+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:44:22.769949+0000","last_undegraded":"2023-11-04T01:44:22.769949+0000","last_fullsized":"2023-11-04T01:44:22.769949+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.976179+0000","last_change":"2023-11-04T01:44:24.976179+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.976179+0000","last_undegraded":"2023-11-04T01:44:24.976179+0000","last_fullsized":"2023-11-04T01:44:24.976179+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594657+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:44:22.594657+0000","last_peered":"2023-11-04T01:44:22.594657+0000","last_clean":"2023-11-04T01:44:22.594657+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:44:22.594657+0000","last_undegraded":"2023-11-04T01:44:22.594657+0000","last_fullsized":"2023-11-04T01:44:22.594657+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.982018+0000","last_change":"2023-11-04T01:44:24.982018+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.982018+0000","last_undegraded":"2023-11-04T01:44:24.982018+0000","last_fullsized":"2023-11-04T01:44:24.982018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":37,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.305242+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:44:22.305242+0000","last_peered":"2023-11-04T01:44:22.305242+0000","last_clean":"2023-11-04T01:44:22.305242+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:44:22.305242+0000","last_undegraded":"2023-11-04T01:44:22.305242+0000","last_fullsized":"2023-11-04T01:44:22.305242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.002160+0000","last_change":"2023-11-04T01:44:25.996467+0000","last_active":"2023-11-04T01:44:26.002160+0000","last_peered":"2023-11-04T01:44:26.002160+0000","last_clean":"2023-11-04T01:44:26.002160+0000","last_became_active":"2023-11-04T01:44:25.995184+0000","last_became_peered":"2023-11-04T01:44:25.995184+0000","last_unstale":"2023-11-04T01:44:26.002160+0000","last_undegraded":"2023-11-04T01:44:26.002160+0000","last_fullsized":"2023-11-04T01:44:26.002160+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:02.603408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971694+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:44:24.971694+0000","last_peered":"2023-11-04T01:44:24.971694+0000","last_clean":"2023-11-04T01:44:24.971694+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:44:24.971694+0000","last_undegraded":"2023-11-04T01:44:24.971694+0000","last_fullsized":"2023-11-04T01:44:24.971694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.984663+0000","last_change":"2023-11-04T01:44:25.984663+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.984663+0000","last_undegraded":"2023-11-04T01:44:25.984663+0000","last_fullsized":"2023-11-04T01:44:25.984663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.980271+0000","last_change":"2023-11-04T01:44:24.980271+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.980271+0000","last_undegraded":"2023-11-04T01:44:24.980271+0000","last_fullsized":"2023-11-04T01:44:24.980271+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770216+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:44:22.770216+0000","last_peered":"2023-11-04T01:44:22.770216+0000","last_clean":"2023-11-04T01:44:22.770216+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:44:22.770216+0000","last_undegraded":"2023-11-04T01:44:22.770216+0000","last_fullsized":"2023-11-04T01:44:22.770216+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-04T01:44:25.963816+0000","last_change":"2023-11-04T01:44:25.963816+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.963816+0000","last_undegraded":"2023-11-04T01:44:25.963816+0000","last_fullsized":"2023-11-04T01:44:25.963816+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:25.997388+0000","last_change":"2023-11-04T01:44:25.991176+0000","last_active":"2023-11-04T01:44:25.997388+0000","last_peered":"2023-11-04T01:44:25.997388+0000","last_clean":"2023-11-04T01:44:25.997388+0000","last_became_active":"2023-11-04T01:44:25.990747+0000","last_became_peered":"2023-11-04T01:44:25.990747+0000","last_unstale":"2023-11-04T01:44:25.997388+0000","last_undegraded":"2023-11-04T01:44:25.997388+0000","last_fullsized":"2023-11-04T01:44:25.997388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:16.695292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594650+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:44:22.594650+0000","last_peered":"2023-11-04T01:44:22.594650+0000","last_clean":"2023-11-04T01:44:22.594650+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:44:22.594650+0000","last_undegraded":"2023-11-04T01:44:22.594650+0000","last_fullsized":"2023-11-04T01:44:22.594650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982646+0000","last_change":"2023-11-04T01:44:25.982646+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982646+0000","last_undegraded":"2023-11-04T01:44:25.982646+0000","last_fullsized":"2023-11-04T01:44:25.982646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-11-04T01:44:24.977938+0000","last_change":"2023-11-04T01:44:24.977938+0000","last_active":"2023-11-04T01:44:24.950834+0000","last_peered":"2023-11-04T01:44:24.950834+0000","last_clean":"2023-11-04T01:44:24.950834+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:24.977938+0000","last_undegraded":"2023-11-04T01:44:24.977938+0000","last_fullsized":"2023-11-04T01:44:24.977938+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":36,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.770274+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:44:22.770274+0000","last_peered":"2023-11-04T01:44:22.770274+0000","last_clean":"2023-11-04T01:44:22.770274+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:44:22.770274+0000","last_undegraded":"2023-11-04T01:44:22.770274+0000","last_fullsized":"2023-11-04T01:44:22.770274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981465+0000","last_change":"2023-11-04T01:44:25.981465+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981465+0000","last_undegraded":"2023-11-04T01:44:25.981465+0000","last_fullsized":"2023-11-04T01:44:25.981465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.006150+0000","last_change":"2023-11-04T01:44:26.005066+0000","last_active":"2023-11-04T01:44:26.006150+0000","last_peered":"2023-11-04T01:44:26.006150+0000","last_clean":"2023-11-04T01:44:26.006150+0000","last_became_active":"2023-11-04T01:44:26.004633+0000","last_became_peered":"2023-11-04T01:44:26.004633+0000","last_unstale":"2023-11-04T01:44:26.006150+0000","last_undegraded":"2023-11-04T01:44:26.006150+0000","last_fullsized":"2023-11-04T01:44:26.006150+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:07.715775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":34,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-04T01:44:22.594794+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:44:22.594794+0000","last_peered":"2023-11-04T01:44:22.594794+0000","last_clean":"2023-11-04T01:44:22.594794+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:44:22.594794+0000","last_undegraded":"2023-11-04T01:44:22.594794+0000","last_fullsized":"2023-11-04T01:44:22.594794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":910185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.628}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.35299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.371,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.499}]},{"osd":4,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.877},"min":{"1min":0.57299999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.65300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3640000000000001,"5min":1.365,"15min":1.365},"last":0.99299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3540000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.079}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0620000000000001,"15min":1.0720000000000001},"min":{"1min":0.70199999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.373,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4159999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.079,"15min":1.077},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.92200000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":319817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.607}]},{"osd":3,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.143,"5min":1.885,"15min":1.885},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.526,"15min":1.526},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.3380000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2410000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.0960000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0089999999999999,"15min":1.006},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.256}]},{"osd":7,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.095,"15min":1.0960000000000001},"min":{"1min":0.628,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.518},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.369,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.3779999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542174,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.89600000000000002},"min":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.276,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.84799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.333,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.55700000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.875},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.137,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.86799999999999999,"15min":0.85699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1040000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90200000000000002},"min":{"1min":0.66700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2989999999999999,"5min":1.514,"15min":1.514},"last":1.032}]},{"osd":4,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.073,"15min":1.077},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2729999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.232,"5min":2.609,"15min":2.609},"last":0.997}]},{"osd":5,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.1539999999999999,"15min":1.1759999999999999},"min":{"1min":0.77800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.387,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.125,"5min":2.4529999999999998,"15min":2.6749999999999998},"min":{"1min":0.82899999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3660000000000001,"5min":40.195,"15min":40.195},"last":1.1200000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2909999999999999,"15min":1.319},"min":{"1min":0.94699999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2849999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1399999999999999,"15min":1.1499999999999999},"min":{"1min":0.77000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5529999999999999,"5min":1.637,"15min":1.637},"last":0.95099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.413,"5min":1.623,"15min":1.623},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.94699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4039999999999999,"5min":1.724,"15min":1.724},"last":0.83199999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.95399999999999996,"15min":0.96299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.444,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.244,"15min":1.244},"last":0.60799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0089999999999999,"15min":1.0169999999999999},"min":{"1min":0.61899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4330000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.03},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.298,"5min":1.976,"15min":1.976},"last":0.96399999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0049999999999999},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.335,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.002},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.546,"5min":2.161,"15min":2.161},"last":0.745}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.63,"5min":0.495,"15min":0.495},"max":{"1min":1.333,"5min":1.538,"15min":1.538},"last":0.879},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.1220000000000001},"min":{"1min":0.70199999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.516,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.079}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0600000000000001},"min":{"1min":0.69799999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.204,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.038},{"interface":"front","average":{"1min":1.095,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.484,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.381}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8919999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1060000000000001,"15min":1.111},"min":{"1min":0.83299999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.387,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.1439999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542173,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":903557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":0.876},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.23,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0600000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.321,"15min":1.321},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.28},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3320000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.4119999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.874,"15min":0.875},"min":{"1min":0.55600000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.1559999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":1.371},{"interface":"front","average":{"1min":1.024,"5min":0.93600000000000005,"15min":0.92200000000000004},"min":{"1min":0.72599999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.98499999999999999,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.343,"5min":1.401,"15min":1.401},"last":1.325},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0269999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1040000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3879999999999999,"5min":1.627,"15min":1.627},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.198,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":1.026,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.399,"5min":1.526,"15min":1.526},"last":1.4630000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.137,"15min":1.1459999999999999},"min":{"1min":0.81799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.409,"5min":1.49,"15min":1.49},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.22,"15min":1.23},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.496,"5min":1.536,"15min":1.536},"last":0.68799999999999994}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.758,"15min":1.758},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.46,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.755},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.173,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96499999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.65900000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1839999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.80300000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2889999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":1.833,"15min":1.833},"last":0.84299999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3420000000000001,"5min":1.369,"15min":1.369},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.125},"min":{"1min":0.77200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7410000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.014},"min":{"1min":0.84599999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.4399999999999999,"5min":1.554,"15min":1.554},"last":1.1060000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.292,"5min":1.417,"15min":1.417},"last":0.877},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.202},"min":{"1min":0.96799999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0569999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":712704,"data_stored":307019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85999999999999999,"5min":1.167,"15min":1.167},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.252,"5min":1.429,"15min":1.429},"last":0.501}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1890000000000001,"5min":1.252,"15min":1.252},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4159999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.81899999999999995}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.357,"5min":1.369,"15min":1.369},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.91800000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.0429999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.103,"5min":1.0469999999999999,"15min":1.0369999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.72499999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":724992,"data_stored":313189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.1319999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.81799999999999995,"5min":1.022,"15min":1.022},"last":0.90800000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.38100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.054,"5min":1.181,"15min":1.181},"last":0.875}]},{"osd":4,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.173},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.411,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.3080000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.879,"15min":0.877},"min":{"1min":0.61299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.329},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.282}]},{"osd":6,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2290000000000001,"5min":1.603,"15min":1.603},"last":1.034},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.367}]},{"osd":7,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.002,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.377,"5min":1.411,"15min":1.411},"last":1.2050000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.272,"5min":1.613,"15min":1.613},"last":1.2350000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:44:30.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-11-04T01:44:30.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-11-04T01:44:30.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-11-04T01:44:30.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-11-04T01:44:30.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.982884+0000', 'last_change': '2023-11-04T01:44:25.982884+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.982884+0000', 'last_undegraded': '2023-11-04T01:44:25.982884+0000', 'last_fullsized': '2023-11-04T01:44:25.982884+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-11-04T01:44:30.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.976187+0000', 'last_change': '2023-11-04T01:44:25.976187+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.976187+0000', 'last_undegraded': '2023-11-04T01:44:25.976187+0000', 'last_fullsized': '2023-11-04T01:44:25.976187+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.979913+0000', 'last_change': '2023-11-04T01:44:25.979913+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.979913+0000', 'last_undegraded': '2023-11-04T01:44:25.979913+0000', 'last_fullsized': '2023-11-04T01:44:25.979913+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.982170+0000', 'last_change': '2023-11-04T01:44:25.982170+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.982170+0000', 'last_undegraded': '2023-11-04T01:44:25.982170+0000', 'last_fullsized': '2023-11-04T01:44:25.982170+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.981364+0000', 'last_change': '2023-11-04T01:44:25.981364+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.981364+0000', 'last_undegraded': '2023-11-04T01:44:25.981364+0000', 'last_fullsized': '2023-11-04T01:44:25.981364+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.976612+0000', 'last_change': '2023-11-04T01:44:25.976612+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.976612+0000', 'last_undegraded': '2023-11-04T01:44:25.976612+0000', 'last_fullsized': '2023-11-04T01:44:25.976612+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.977361+0000', 'last_change': '2023-11-04T01:44:25.977361+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.977361+0000', 'last_undegraded': '2023-11-04T01:44:25.977361+0000', 'last_fullsized': '2023-11-04T01:44:25.977361+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-11-04T01:44:30.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.981221+0000', 'last_change': '2023-11-04T01:44:25.981221+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.981221+0000', 'last_undegraded': '2023-11-04T01:44:25.981221+0000', 'last_fullsized': '2023-11-04T01:44:25.981221+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-11-04T01:44:30.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.975915+0000', 'last_change': '2023-11-04T01:44:24.975915+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.975915+0000', 'last_undegraded': '2023-11-04T01:44:24.975915+0000', 'last_fullsized': '2023-11-04T01:44:24.975915+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.979235+0000', 'last_change': '2023-11-04T01:44:25.979235+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.979235+0000', 'last_undegraded': '2023-11-04T01:44:25.979235+0000', 'last_fullsized': '2023-11-04T01:44:25.979235+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.980411+0000', 'last_change': '2023-11-04T01:44:24.980411+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.980411+0000', 'last_undegraded': '2023-11-04T01:44:24.980411+0000', 'last_fullsized': '2023-11-04T01:44:24.980411+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.980153+0000', 'last_change': '2023-11-04T01:44:24.980153+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.980153+0000', 'last_undegraded': '2023-11-04T01:44:24.980153+0000', 'last_fullsized': '2023-11-04T01:44:24.980153+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-11-04T01:44:30.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.980786+0000', 'last_change': '2023-11-04T01:44:24.980786+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.980786+0000', 'last_undegraded': '2023-11-04T01:44:24.980786+0000', 'last_fullsized': '2023-11-04T01:44:24.980786+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.976618+0000', 'last_change': '2023-11-04T01:44:25.976618+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.976618+0000', 'last_undegraded': '2023-11-04T01:44:25.976618+0000', 'last_fullsized': '2023-11-04T01:44:25.976618+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.978975+0000', 'last_change': '2023-11-04T01:44:24.978975+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.978975+0000', 'last_undegraded': '2023-11-04T01:44:24.978975+0000', 'last_fullsized': '2023-11-04T01:44:24.978975+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-11-04T01:44:30.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.975970+0000', 'last_change': '2023-11-04T01:44:24.975970+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.975970+0000', 'last_undegraded': '2023-11-04T01:44:24.975970+0000', 'last_fullsized': '2023-11-04T01:44:24.975970+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.976169+0000', 'last_change': '2023-11-04T01:44:24.976169+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.976169+0000', 'last_undegraded': '2023-11-04T01:44:24.976169+0000', 'last_fullsized': '2023-11-04T01:44:24.976169+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.979257+0000', 'last_change': '2023-11-04T01:44:25.979257+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.979257+0000', 'last_undegraded': '2023-11-04T01:44:25.979257+0000', 'last_fullsized': '2023-11-04T01:44:25.979257+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-11-04T01:44:30.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.973273+0000', 'last_change': '2023-11-04T01:44:24.973273+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.973273+0000', 'last_undegraded': '2023-11-04T01:44:24.973273+0000', 'last_fullsized': '2023-11-04T01:44:24.973273+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.978475+0000', 'last_change': '2023-11-04T01:44:24.978475+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.978475+0000', 'last_undegraded': '2023-11-04T01:44:24.978475+0000', 'last_fullsized': '2023-11-04T01:44:24.978475+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.977940+0000', 'last_change': '2023-11-04T01:44:24.977940+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.977940+0000', 'last_undegraded': '2023-11-04T01:44:24.977940+0000', 'last_fullsized': '2023-11-04T01:44:24.977940+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:44:30.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.978340+0000', 'last_change': '2023-11-04T01:44:24.978340+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.978340+0000', 'last_undegraded': '2023-11-04T01:44:24.978340+0000', 'last_fullsized': '2023-11-04T01:44:24.978340+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.978224+0000', 'last_change': '2023-11-04T01:44:24.978224+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.978224+0000', 'last_undegraded': '2023-11-04T01:44:24.978224+0000', 'last_fullsized': '2023-11-04T01:44:24.978224+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-11-04T01:44:30.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.974235+0000', 'last_change': '2023-11-04T01:44:24.974235+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.974235+0000', 'last_undegraded': '2023-11-04T01:44:24.974235+0000', 'last_fullsized': '2023-11-04T01:44:24.974235+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.976038+0000', 'last_change': '2023-11-04T01:44:25.976038+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.976038+0000', 'last_undegraded': '2023-11-04T01:44:25.976038+0000', 'last_fullsized': '2023-11-04T01:44:25.976038+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.981339+0000', 'last_change': '2023-11-04T01:44:24.981339+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.981339+0000', 'last_undegraded': '2023-11-04T01:44:24.981339+0000', 'last_fullsized': '2023-11-04T01:44:24.981339+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-11-04T01:44:30.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.982198+0000', 'last_change': '2023-11-04T01:44:24.982198+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.982198+0000', 'last_undegraded': '2023-11-04T01:44:24.982198+0000', 'last_fullsized': '2023-11-04T01:44:24.982198+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.977410+0000', 'last_change': '2023-11-04T01:44:24.977410+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.977410+0000', 'last_undegraded': '2023-11-04T01:44:24.977410+0000', 'last_fullsized': '2023-11-04T01:44:24.977410+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.981356+0000', 'last_change': '2023-11-04T01:44:24.981356+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.981356+0000', 'last_undegraded': '2023-11-04T01:44:24.981356+0000', 'last_fullsized': '2023-11-04T01:44:24.981356+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-11-04T01:44:30.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.982581+0000', 'last_change': '2023-11-04T01:44:24.982581+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.982581+0000', 'last_undegraded': '2023-11-04T01:44:24.982581+0000', 'last_fullsized': '2023-11-04T01:44:24.982581+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.985508+0000', 'last_change': '2023-11-04T01:44:25.985508+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.985508+0000', 'last_undegraded': '2023-11-04T01:44:25.985508+0000', 'last_fullsized': '2023-11-04T01:44:25.985508+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.981240+0000', 'last_change': '2023-11-04T01:44:24.981240+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.981240+0000', 'last_undegraded': '2023-11-04T01:44:24.981240+0000', 'last_fullsized': '2023-11-04T01:44:24.981240+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.978236+0000', 'last_change': '2023-11-04T01:44:24.978236+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.978236+0000', 'last_undegraded': '2023-11-04T01:44:24.978236+0000', 'last_fullsized': '2023-11-04T01:44:24.978236+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-11-04T01:44:30.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.972096+0000', 'last_change': '2023-11-04T01:44:24.972096+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.972096+0000', 'last_undegraded': '2023-11-04T01:44:24.972096+0000', 'last_fullsized': '2023-11-04T01:44:24.972096+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.976253+0000', 'last_change': '2023-11-04T01:44:24.976253+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.976253+0000', 'last_undegraded': '2023-11-04T01:44:24.976253+0000', 'last_fullsized': '2023-11-04T01:44:24.976253+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.979976+0000', 'last_change': '2023-11-04T01:44:25.979976+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.979976+0000', 'last_undegraded': '2023-11-04T01:44:25.979976+0000', 'last_fullsized': '2023-11-04T01:44:25.979976+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-11-04T01:44:30.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.981141+0000', 'last_change': '2023-11-04T01:44:24.981141+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.981141+0000', 'last_undegraded': '2023-11-04T01:44:24.981141+0000', 'last_fullsized': '2023-11-04T01:44:24.981141+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.976179+0000', 'last_change': '2023-11-04T01:44:24.976179+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.976179+0000', 'last_undegraded': '2023-11-04T01:44:24.976179+0000', 'last_fullsized': '2023-11-04T01:44:24.976179+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.982018+0000', 'last_change': '2023-11-04T01:44:24.982018+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.982018+0000', 'last_undegraded': '2023-11-04T01:44:24.982018+0000', 'last_fullsized': '2023-11-04T01:44:24.982018+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.984663+0000', 'last_change': '2023-11-04T01:44:25.984663+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.984663+0000', 'last_undegraded': '2023-11-04T01:44:25.984663+0000', 'last_fullsized': '2023-11-04T01:44:25.984663+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.980271+0000', 'last_change': '2023-11-04T01:44:24.980271+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.980271+0000', 'last_undegraded': '2023-11-04T01:44:24.980271+0000', 'last_fullsized': '2023-11-04T01:44:24.980271+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-04T01:44:25.963816+0000', 'last_change': '2023-11-04T01:44:25.963816+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.963816+0000', 'last_undegraded': '2023-11-04T01:44:25.963816+0000', 'last_fullsized': '2023-11-04T01:44:25.963816+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.982646+0000', 'last_change': '2023-11-04T01:44:25.982646+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.982646+0000', 'last_undegraded': '2023-11-04T01:44:25.982646+0000', 'last_fullsized': '2023-11-04T01:44:25.982646+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:24.977938+0000', 'last_change': '2023-11-04T01:44:24.977938+0000', 'last_active': '2023-11-04T01:44:24.950834+0000', 'last_peered': '2023-11-04T01:44:24.950834+0000', 'last_clean': '2023-11-04T01:44:24.950834+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:24.977938+0000', 'last_undegraded': '2023-11-04T01:44:24.977938+0000', 'last_fullsized': '2023-11-04T01:44:24.977938+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:24.950834+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-11-04T01:44:30.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 62, 'state': 'creating+peering', 'last_fresh': '2023-11-04T01:44:25.981465+0000', 'last_change': '2023-11-04T01:44:25.981465+0000', 'last_active': '2023-11-04T01:44:25.963816+0000', 'last_peered': '2023-11-04T01:44:25.963816+0000', 'last_clean': '2023-11-04T01:44:25.963816+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-04T01:44:25.981465+0000', 'last_undegraded': '2023-11-04T01:44:25.981465+0000', 'last_fullsized': '2023-11-04T01:44:25.981465+0000', 'mapping_epoch': 62, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 62, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'last_clean_scrub_stamp': '2023-11-04T01:44:25.963816+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-04T01:44:30.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb53fdf640 1 Processor -- start 2023-11-04T01:44:30.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb53fdf640 1 -- start start 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb53fdf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c15d0b0 0x7ffb4c160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb53fdf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb4c0cff20 0x7ffb4c0d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb53fdf640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4c0b5e00 con 0x7ffb4c1610f0 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb53fdf640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c0d1520 con 0x7ffb4c0cff20 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb53fdf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c15d490 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.947+0000 7ffb5257c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb4c0cff20 0x7ffb4c0d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb5257c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb4c0cff20 0x7ffb4c0d1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36592/0 (socket says 172.21.15.2:36592) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb5257c640 1 -- 172.21.15.2:0/2297233388 learned_addr learned my addr 172.21.15.2:0/2297233388 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb51d7b640 1 --2- 172.21.15.2:0/2297233388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c15d0b0 0x7ffb4c160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb5257c640 1 -- 172.21.15.2:0/2297233388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c15d0b0 msgr2=0x7ffb4c160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb5257c640 1 --2- 172.21.15.2:0/2297233388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c15d0b0 0x7ffb4c160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb5257c640 1 -- 172.21.15.2:0/2297233388 >> v1:172.21.15.90:6789/0 conn(0x7ffb4c1610f0 legacy=0x7ffb4c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb5257c640 1 -- 172.21.15.2:0/2297233388 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0b8930 con 0x7ffb4c0cff20 2023-11-04T01:44:30.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb51d7b640 1 --2- 172.21.15.2:0/2297233388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c15d0b0 0x7ffb4c160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb5257c640 1 --2- 172.21.15.2:0/2297233388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c0cff20 0x7ffb4c0d1940 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009e50 tx=0x7ffb4401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfa0a015d666bce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb50d79640 1 -- 172.21.15.2:0/2297233388 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440a57f0 con 0x7ffb4c0cff20 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb50d79640 1 -- 172.21.15.2:0/2297233388 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb440a5950 con 0x7ffb4c0cff20 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb50d79640 1 -- 172.21.15.2:0/2297233388 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440a5ce0 con 0x7ffb4c0cff20 2023-11-04T01:44:30.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2297233388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c0cff20 msgr2=0x7ffb4c0d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2297233388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c0cff20 0x7ffb4c0d1940 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009e50 tx=0x7ffb4401ca10 comp rx=0 tx=0).stop 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2297233388 shutdown_connections 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2297233388 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c0cff20 0x7ffb4c0d1940 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2297233388 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c15d0b0 0x7ffb4c160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2297233388 >> 172.21.15.2:0/2297233388 conn(0x7ffb4c06a890 msgr2=0x7ffb4c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2297233388 shutdown_connections 2023-11-04T01:44:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.951+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2297233388 wait complete. 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 Processor -- start 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 -- start start 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c0cff20 0x7ffb4c158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c15d0b0 0x7ffb4c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c1610f0 0x7ffb4c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0ca480 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0ca760 con 0x7ffb4c1610f0 2023-11-04T01:44:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0caa40 con 0x7ffb4c0cff20 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c15d0b0 0x7ffb4c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c15d0b0 0x7ffb4c157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36606/0 (socket says 172.21.15.2:36606) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 -- 172.21.15.2:0/2163998928 learned_addr learned my addr 172.21.15.2:0/2163998928 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb51d7b640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c0cff20 0x7ffb4c158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5257c640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c1610f0 0x7ffb4c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 -- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c0cff20 msgr2=0x7ffb4c158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c0cff20 0x7ffb4c158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 -- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c1610f0 msgr2=0x7ffb4c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c1610f0 0x7ffb4c0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 -- 172.21.15.2:0/2163998928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009b30 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb51d7b640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c0cff20 0x7ffb4c158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb5157a640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c15d0b0 0x7ffb4c157860 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c007fd0 tx=0x7ffb3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb427fc640 1 -- 172.21.15.2:0/2163998928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0052d0 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb427fc640 1 -- 172.21.15.2:0/2163998928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c005430 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c0cad20 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb427fc640 1 -- 172.21.15.2:0/2163998928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c003820 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c158760 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c074510 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.955+0000 7ffb427fc640 1 -- 172.21.15.2:0/2163998928 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb3c003980 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.959+0000 7ffb427fc640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb300664a0 0x7ffb30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.959+0000 7ffb427fc640 1 -- 172.21.15.2:0/2163998928 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb3c0835d0 con 0x7ffb4c15d0b0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.959+0000 7ffb51d7b640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb300664a0 0x7ffb30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.959+0000 7ffb51d7b640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb300664a0 0x7ffb30068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009970 tx=0x7ffb48008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:30.963+0000 7ffb427fc640 1 -- 172.21.15.2:0/2163998928 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb3c0508f0 con 0x7ffb4c15d0b0 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.167+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ffb4c0cb1d0 con 0x7ffb4c15d0b0 2023-11-04T01:44:31.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb427fc640 1 -- 172.21.15.2:0/2163998928 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1663 (secure 0 0 0) 0x7ffb3c053f10 con 0x7ffb4c15d0b0 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:31.176 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","health":{"status":"HEALTH_WARN","checks":{"POOL_APP_NOT_ENABLED":{"severity":"HEALTH_WARN","summary":{"message":"1 pool(s) do not have an application enabled","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":151,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1699062131,"num_in_osds":8,"osd_in_since":1699062122,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":112},{"state_name":"creating+peering","count":17}],"num_pgs":129,"num_pools":4,"num_objects":19,"data_bytes":592778,"bytes_used":249954304,"bytes_avail":772844158976,"bytes_total":773094113280,"inactive_pgs_ratio":0.13178294897079468,"write_bytes_sec":2451,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":26,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6171}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-11-04T01:44:14.810389+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb300664a0 msgr2=0x7ffb30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb300664a0 0x7ffb30068960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009970 tx=0x7ffb48008040 comp rx=0 tx=0).stop 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c15d0b0 msgr2=0x7ffb4c157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c15d0b0 0x7ffb4c157860 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c007fd0 tx=0x7ffb3c00c890 comp rx=0 tx=0).stop 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 shutdown_connections 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb300664a0 0x7ffb30068960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb4c1610f0 0x7ffb4c0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb4c15d0b0 0x7ffb4c157860 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 --2- 172.21.15.2:0/2163998928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb4c0cff20 0x7ffb4c158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 >> 172.21.15.2:0/2163998928 conn(0x7ffb4c06a890 msgr2=0x7ffb4c0b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 shutdown_connections 2023-11-04T01:44:31.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.171+0000 7ffb53fdf640 1 -- 172.21.15.2:0/2163998928 wait complete. 2023-11-04T01:44:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-04T01:44:31.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:44:31.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 Processor -- start 2023-11-04T01:44:31.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 -- start start 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b27d0 0x7f14940d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f149415b150 0x7f14940cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14940b2bb0 0x7f14940ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149415f980 con 0x7f14940b2bb0 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149415f4f0 con 0x7f149415b150 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1498ce1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14940d0af0 con 0x7f14940b27d0 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14940b2bb0 0x7f14940ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14940b2bb0 0x7f14940ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40526/0 (socket says 172.21.15.2:40526) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 -- 172.21.15.2:0/3659590630 learned_addr learned my addr 172.21.15.2:0/3659590630 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f148bfff640 1 --2- 172.21.15.2:0/3659590630 >> v2:172.21.15.90:3300/0 conn(0x7f149415b150 0x7f14940cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f149259c640 1 --2- 172.21.15.2:0/3659590630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b27d0 0x7f14940d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 -- 172.21.15.2:0/3659590630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b27d0 msgr2=0x7f14940d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 --2- 172.21.15.2:0/3659590630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b27d0 0x7f14940d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 -- 172.21.15.2:0/3659590630 >> v2:172.21.15.90:3300/0 conn(0x7f149415b150 msgr2=0x7f14940cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:31.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 --2- 172.21.15.2:0/3659590630 >> v2:172.21.15.90:3300/0 conn(0x7f149415b150 0x7f14940cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f1492d9d640 1 -- 172.21.15.2:0/3659590630 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14940cb6d0 con 0x7f14940b2bb0 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f149259c640 1 --2- 172.21.15.2:0/3659590630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b27d0 0x7f14940d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.311+0000 7f148bfff640 1 --2- 172.21.15.2:0/3659590630 >> v2:172.21.15.90:3300/0 conn(0x7f149415b150 0x7f14940cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:31.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1492d9d640 1 --2- 172.21.15.2:0/3659590630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b2bb0 0x7f14940ce920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1494067650 tx=0x7f148c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e5b8f46a0ff3c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1491d9b640 1 -- 172.21.15.2:0/3659590630 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0a8460 con 0x7f14940b2bb0 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1491d9b640 1 -- 172.21.15.2:0/3659590630 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0a85c0 con 0x7f14940b2bb0 2023-11-04T01:44:31.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1491d9b640 1 -- 172.21.15.2:0/3659590630 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0a8950 con 0x7f14940b2bb0 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- 172.21.15.2:0/3659590630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b2bb0 msgr2=0x7f14940ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 --2- 172.21.15.2:0/3659590630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b2bb0 0x7f14940ce920 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1494067650 tx=0x7f148c01c680 comp rx=0 tx=0).stop 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- 172.21.15.2:0/3659590630 shutdown_connections 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 --2- 172.21.15.2:0/3659590630 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b2bb0 0x7f14940ce920 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 --2- 172.21.15.2:0/3659590630 >> v2:172.21.15.90:3300/0 conn(0x7f149415b150 0x7f14940cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 --2- 172.21.15.2:0/3659590630 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b27d0 0x7f14940d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- 172.21.15.2:0/3659590630 >> 172.21.15.2:0/3659590630 conn(0x7f14940cd7d0 msgr2=0x7f14940cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- 172.21.15.2:0/3659590630 shutdown_connections 2023-11-04T01:44:31.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- 172.21.15.2:0/3659590630 wait complete. 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 Processor -- start 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- start start 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b27d0 0x7f149414a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b2bb0 0x7f1494159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149415b150 0x7f14941559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14940caac0 con 0x7f14940b27d0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149415de00 con 0x7f149415b150 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1498ce1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149415e0e0 con 0x7f14940b2bb0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b27d0 0x7f149414a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b27d0 0x7f149414a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40528/0 (socket says 172.21.15.2:40528) 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 -- 172.21.15.2:0/1608454086 learned_addr learned my addr 172.21.15.2:0/1608454086 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1492d9d640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149415b150 0x7f14941559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f148bfff640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b2bb0 0x7f1494159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 -- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b2bb0 msgr2=0x7f1494159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b2bb0 0x7f1494159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 -- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149415b150 msgr2=0x7f14941559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149415b150 0x7f14941559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 -- 172.21.15.2:0/1608454086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009b30 con 0x7f14940b27d0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f1492d9d640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149415b150 0x7f14941559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.315+0000 7f149259c640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b27d0 0x7f149414a0e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f148400c7f0 tx=0x7f148400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148affd640 1 -- 172.21.15.2:0/1608454086 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484007820 con 0x7f14940b27d0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148affd640 1 -- 172.21.15.2:0/1608454086 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1484007980 con 0x7f14940b27d0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14940ca2c0 con 0x7f14940b27d0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148affd640 1 -- 172.21.15.2:0/1608454086 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1484007d30 con 0x7f14940b27d0 2023-11-04T01:44:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149415e3c0 con 0x7f14940b27d0 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14940744a0 con 0x7f14940b27d0 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148affd640 1 -- 172.21.15.2:0/1608454086 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f14840113f0 con 0x7f14940b27d0 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148affd640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14740664d0 0x7f1474068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148affd640 1 -- 172.21.15.2:0/1608454086 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1484084230 con 0x7f14940b27d0 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148bfff640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14740664d0 0x7f1474068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:31.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.319+0000 7f148bfff640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14740664d0 0x7f1474068990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f14941567b0 tx=0x7f147c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.323+0000 7f148affd640 1 -- 172.21.15.2:0/1608454086 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1484051550 con 0x7f14940b27d0 2023-11-04T01:44:31.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.467+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f149415f180 con 0x7f14740664d0 2023-11-04T01:44:31.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.499+0000 7f148affd640 1 -- 172.21.15.2:0/1608454086 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367014 (secure 0 0 0) 0x7f147c00a670 con 0x7f14740664d0 2023-11-04T01:44:31.505 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:31.508 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14740664d0 msgr2=0x7f1474068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14740664d0 0x7f1474068990 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f14941567b0 tx=0x7f147c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b27d0 msgr2=0x7f149414a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b27d0 0x7f149414a0e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f148400c7f0 tx=0x7f148400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 shutdown_connections 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14740664d0 0x7f1474068990 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149415b150 0x7f14941559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14940b2bb0 0x7f1494159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 --2- 172.21.15.2:0/1608454086 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14940b27d0 0x7f149414a0e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 >> 172.21.15.2:0/1608454086 conn(0x7f14940cd7d0 msgr2=0x7f14940b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 shutdown_connections 2023-11-04T01:44:31.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:31.503+0000 7f1498ce1640 1 -- 172.21.15.2:0/1608454086 wait complete. 2023-11-04T01:44:31.523 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2023-11-04T01:44:30.815631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":198,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244096,"kb_used_data":7124,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730624,"statfs":{"total":773094113280,"available":772844158976,"internally_reserved":0,"allocated":7294976,"data_stored":3826744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":61,"apply_latency_ms":61,"commit_latency_ns":61000000,"apply_latency_ns":61000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.847513"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.039953+0000","last_change":"2023-11-04T01:44:27.023961+0000","last_active":"2023-11-04T01:44:28.039953+0000","last_peered":"2023-11-04T01:44:28.039953+0000","last_clean":"2023-11-04T01:44:28.039953+0000","last_became_active":"2023-11-04T01:44:27.023233+0000","last_became_peered":"2023-11-04T01:44:27.023233+0000","last_unstale":"2023-11-04T01:44:28.039953+0000","last_undegraded":"2023-11-04T01:44:28.039953+0000","last_fullsized":"2023-11-04T01:44:28.039953+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:08.319009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.037134+0000","last_change":"2023-11-04T01:44:27.063338+0000","last_active":"2023-11-04T01:44:28.037134+0000","last_peered":"2023-11-04T01:44:28.037134+0000","last_clean":"2023-11-04T01:44:28.037134+0000","last_became_active":"2023-11-04T01:44:27.061901+0000","last_became_peered":"2023-11-04T01:44:27.061901+0000","last_unstale":"2023-11-04T01:44:28.037134+0000","last_undegraded":"2023-11-04T01:44:28.037134+0000","last_fullsized":"2023-11-04T01:44:28.037134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:54.299734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.674827+0000","last_change":"2023-11-04T01:44:27.043124+0000","last_active":"2023-11-04T01:44:28.674827+0000","last_peered":"2023-11-04T01:44:28.674827+0000","last_clean":"2023-11-04T01:44:28.674827+0000","last_became_active":"2023-11-04T01:44:27.042764+0000","last_became_peered":"2023-11-04T01:44:27.042764+0000","last_unstale":"2023-11-04T01:44:28.674827+0000","last_undegraded":"2023-11-04T01:44:28.674827+0000","last_fullsized":"2023-11-04T01:44:28.674827+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:02.499513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573911+0000","last_change":"2023-11-04T01:44:27.057506+0000","last_active":"2023-11-04T01:44:28.573911+0000","last_peered":"2023-11-04T01:44:28.573911+0000","last_clean":"2023-11-04T01:44:28.573911+0000","last_became_active":"2023-11-04T01:44:27.057128+0000","last_became_peered":"2023-11-04T01:44:27.057128+0000","last_unstale":"2023-11-04T01:44:28.573911+0000","last_undegraded":"2023-11-04T01:44:28.573911+0000","last_fullsized":"2023-11-04T01:44:28.573911+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:25:52.415381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.671928+0000","last_change":"2023-11-04T01:44:27.060522+0000","last_active":"2023-11-04T01:44:28.671928+0000","last_peered":"2023-11-04T01:44:28.671928+0000","last_clean":"2023-11-04T01:44:28.671928+0000","last_became_active":"2023-11-04T01:44:27.060199+0000","last_became_peered":"2023-11-04T01:44:27.060199+0000","last_unstale":"2023-11-04T01:44:28.671928+0000","last_undegraded":"2023-11-04T01:44:28.671928+0000","last_fullsized":"2023-11-04T01:44:28.671928+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:48:20.654188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036303+0000","last_change":"2023-11-04T01:44:27.029759+0000","last_active":"2023-11-04T01:44:28.036303+0000","last_peered":"2023-11-04T01:44:28.036303+0000","last_clean":"2023-11-04T01:44:28.036303+0000","last_became_active":"2023-11-04T01:44:27.028395+0000","last_became_peered":"2023-11-04T01:44:27.028395+0000","last_unstale":"2023-11-04T01:44:28.036303+0000","last_undegraded":"2023-11-04T01:44:28.036303+0000","last_fullsized":"2023-11-04T01:44:28.036303+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:27.386935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.037925+0000","last_change":"2023-11-04T01:44:27.040601+0000","last_active":"2023-11-04T01:44:28.037925+0000","last_peered":"2023-11-04T01:44:28.037925+0000","last_clean":"2023-11-04T01:44:28.037925+0000","last_became_active":"2023-11-04T01:44:27.039689+0000","last_became_peered":"2023-11-04T01:44:27.039689+0000","last_unstale":"2023-11-04T01:44:28.037925+0000","last_undegraded":"2023-11-04T01:44:28.037925+0000","last_fullsized":"2023-11-04T01:44:28.037925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:41.237582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672376+0000","last_change":"2023-11-04T01:44:27.060447+0000","last_active":"2023-11-04T01:44:28.672376+0000","last_peered":"2023-11-04T01:44:28.672376+0000","last_clean":"2023-11-04T01:44:28.672376+0000","last_became_active":"2023-11-04T01:44:27.060099+0000","last_became_peered":"2023-11-04T01:44:27.060099+0000","last_unstale":"2023-11-04T01:44:28.672376+0000","last_undegraded":"2023-11-04T01:44:28.672376+0000","last_fullsized":"2023-11-04T01:44:28.672376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:07.823921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574487+0000","last_change":"2023-11-04T01:44:27.043953+0000","last_active":"2023-11-04T01:44:28.574487+0000","last_peered":"2023-11-04T01:44:28.574487+0000","last_clean":"2023-11-04T01:44:28.574487+0000","last_became_active":"2023-11-04T01:44:27.042392+0000","last_became_peered":"2023-11-04T01:44:27.042392+0000","last_unstale":"2023-11-04T01:44:28.574487+0000","last_undegraded":"2023-11-04T01:44:28.574487+0000","last_fullsized":"2023-11-04T01:44:28.574487+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:45.837309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982884+0000","last_change":"2023-11-04T01:44:25.982884+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982884+0000","last_undegraded":"2023-11-04T01:44:25.982884+0000","last_fullsized":"2023-11-04T01:44:25.982884+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574027+0000","last_change":"2023-11-04T01:44:27.045225+0000","last_active":"2023-11-04T01:44:28.574027+0000","last_peered":"2023-11-04T01:44:28.574027+0000","last_clean":"2023-11-04T01:44:28.574027+0000","last_became_active":"2023-11-04T01:44:27.044810+0000","last_became_peered":"2023-11-04T01:44:27.044810+0000","last_unstale":"2023-11-04T01:44:28.574027+0000","last_undegraded":"2023-11-04T01:44:28.574027+0000","last_fullsized":"2023-11-04T01:44:28.574027+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:33.388356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574284+0000","last_change":"2023-11-04T01:44:27.051335+0000","last_active":"2023-11-04T01:44:28.574284+0000","last_peered":"2023-11-04T01:44:28.574284+0000","last_clean":"2023-11-04T01:44:28.574284+0000","last_became_active":"2023-11-04T01:44:27.049430+0000","last_became_peered":"2023-11-04T01:44:27.049430+0000","last_unstale":"2023-11-04T01:44:28.574284+0000","last_undegraded":"2023-11-04T01:44:28.574284+0000","last_fullsized":"2023-11-04T01:44:28.574284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:54.299734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976187+0000","last_change":"2023-11-04T01:44:25.976187+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976187+0000","last_undegraded":"2023-11-04T01:44:25.976187+0000","last_fullsized":"2023-11-04T01:44:25.976187+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979913+0000","last_change":"2023-11-04T01:44:25.979913+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979913+0000","last_undegraded":"2023-11-04T01:44:25.979913+0000","last_fullsized":"2023-11-04T01:44:25.979913+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982170+0000","last_change":"2023-11-04T01:44:25.982170+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982170+0000","last_undegraded":"2023-11-04T01:44:25.982170+0000","last_fullsized":"2023-11-04T01:44:25.982170+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672563+0000","last_change":"2023-11-04T01:44:27.066111+0000","last_active":"2023-11-04T01:44:28.672563+0000","last_peered":"2023-11-04T01:44:28.672563+0000","last_clean":"2023-11-04T01:44:28.672563+0000","last_became_active":"2023-11-04T01:44:27.065473+0000","last_became_peered":"2023-11-04T01:44:27.065473+0000","last_unstale":"2023-11-04T01:44:28.672563+0000","last_undegraded":"2023-11-04T01:44:28.672563+0000","last_fullsized":"2023-11-04T01:44:28.672563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:42:34.720030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.674600+0000","last_change":"2023-11-04T01:44:27.036703+0000","last_active":"2023-11-04T01:44:28.674600+0000","last_peered":"2023-11-04T01:44:28.674600+0000","last_clean":"2023-11-04T01:44:28.674600+0000","last_became_active":"2023-11-04T01:44:27.035025+0000","last_became_peered":"2023-11-04T01:44:27.035025+0000","last_unstale":"2023-11-04T01:44:28.674600+0000","last_undegraded":"2023-11-04T01:44:28.674600+0000","last_fullsized":"2023-11-04T01:44:28.674600+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:54.433635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574018+0000","last_change":"2023-11-04T01:44:27.044097+0000","last_active":"2023-11-04T01:44:28.574018+0000","last_peered":"2023-11-04T01:44:28.574018+0000","last_clean":"2023-11-04T01:44:28.574018+0000","last_became_active":"2023-11-04T01:44:27.043708+0000","last_became_peered":"2023-11-04T01:44:27.043708+0000","last_unstale":"2023-11-04T01:44:28.574018+0000","last_undegraded":"2023-11-04T01:44:28.574018+0000","last_fullsized":"2023-11-04T01:44:28.574018+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:27.386935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574265+0000","last_change":"2023-11-04T01:44:27.041766+0000","last_active":"2023-11-04T01:44:28.574265+0000","last_peered":"2023-11-04T01:44:28.574265+0000","last_clean":"2023-11-04T01:44:28.574265+0000","last_became_active":"2023-11-04T01:44:27.041345+0000","last_became_peered":"2023-11-04T01:44:27.041345+0000","last_unstale":"2023-11-04T01:44:28.574265+0000","last_undegraded":"2023-11-04T01:44:28.574265+0000","last_fullsized":"2023-11-04T01:44:28.574265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:30.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673546+0000","last_change":"2023-11-04T01:44:27.057408+0000","last_active":"2023-11-04T01:44:28.673546+0000","last_peered":"2023-11-04T01:44:28.673546+0000","last_clean":"2023-11-04T01:44:28.673546+0000","last_became_active":"2023-11-04T01:44:27.056798+0000","last_became_peered":"2023-11-04T01:44:27.056798+0000","last_unstale":"2023-11-04T01:44:28.673546+0000","last_undegraded":"2023-11-04T01:44:28.673546+0000","last_fullsized":"2023-11-04T01:44:28.673546+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:44.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981364+0000","last_change":"2023-11-04T01:44:25.981364+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981364+0000","last_undegraded":"2023-11-04T01:44:25.981364+0000","last_fullsized":"2023-11-04T01:44:25.981364+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036693+0000","last_change":"2023-11-04T01:44:27.029113+0000","last_active":"2023-11-04T01:44:28.036693+0000","last_peered":"2023-11-04T01:44:28.036693+0000","last_clean":"2023-11-04T01:44:28.036693+0000","last_became_active":"2023-11-04T01:44:27.027344+0000","last_became_peered":"2023-11-04T01:44:27.027344+0000","last_unstale":"2023-11-04T01:44:28.036693+0000","last_undegraded":"2023-11-04T01:44:28.036693+0000","last_fullsized":"2023-11-04T01:44:28.036693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:44.281749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672615+0000","last_change":"2023-11-04T01:44:27.064240+0000","last_active":"2023-11-04T01:44:28.672615+0000","last_peered":"2023-11-04T01:44:28.672615+0000","last_clean":"2023-11-04T01:44:28.672615+0000","last_became_active":"2023-11-04T01:44:27.063726+0000","last_became_peered":"2023-11-04T01:44:27.063726+0000","last_unstale":"2023-11-04T01:44:28.672615+0000","last_undegraded":"2023-11-04T01:44:28.672615+0000","last_fullsized":"2023-11-04T01:44:28.672615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:58.046159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672630+0000","last_change":"2023-11-04T01:44:27.070189+0000","last_active":"2023-11-04T01:44:28.672630+0000","last_peered":"2023-11-04T01:44:28.672630+0000","last_clean":"2023-11-04T01:44:28.672630+0000","last_became_active":"2023-11-04T01:44:27.069942+0000","last_became_peered":"2023-11-04T01:44:27.069942+0000","last_unstale":"2023-11-04T01:44:28.672630+0000","last_undegraded":"2023-11-04T01:44:28.672630+0000","last_fullsized":"2023-11-04T01:44:28.672630+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:01.423315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976612+0000","last_change":"2023-11-04T01:44:25.976612+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976612+0000","last_undegraded":"2023-11-04T01:44:25.976612+0000","last_fullsized":"2023-11-04T01:44:25.976612+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673266+0000","last_change":"2023-11-04T01:44:27.054211+0000","last_active":"2023-11-04T01:44:28.673266+0000","last_peered":"2023-11-04T01:44:28.673266+0000","last_clean":"2023-11-04T01:44:28.673266+0000","last_became_active":"2023-11-04T01:44:27.053482+0000","last_became_peered":"2023-11-04T01:44:27.053482+0000","last_unstale":"2023-11-04T01:44:28.673266+0000","last_undegraded":"2023-11-04T01:44:28.673266+0000","last_fullsized":"2023-11-04T01:44:28.673266+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:12.035593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.977361+0000","last_change":"2023-11-04T01:44:25.977361+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.977361+0000","last_undegraded":"2023-11-04T01:44:25.977361+0000","last_fullsized":"2023-11-04T01:44:25.977361+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.039162+0000","last_change":"2023-11-04T01:44:27.053908+0000","last_active":"2023-11-04T01:44:28.039162+0000","last_peered":"2023-11-04T01:44:28.039162+0000","last_clean":"2023-11-04T01:44:28.039162+0000","last_became_active":"2023-11-04T01:44:27.053169+0000","last_became_peered":"2023-11-04T01:44:27.053169+0000","last_unstale":"2023-11-04T01:44:28.039162+0000","last_undegraded":"2023-11-04T01:44:28.039162+0000","last_fullsized":"2023-11-04T01:44:28.039162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:12.998143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574075+0000","last_change":"2023-11-04T01:44:27.050966+0000","last_active":"2023-11-04T01:44:28.574075+0000","last_peered":"2023-11-04T01:44:28.574075+0000","last_clean":"2023-11-04T01:44:28.574075+0000","last_became_active":"2023-11-04T01:44:27.040373+0000","last_became_peered":"2023-11-04T01:44:27.040373+0000","last_unstale":"2023-11-04T01:44:28.574075+0000","last_undegraded":"2023-11-04T01:44:28.574075+0000","last_fullsized":"2023-11-04T01:44:28.574075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:44.281749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573689+0000","last_change":"2023-11-04T01:44:27.048015+0000","last_active":"2023-11-04T01:44:28.573689+0000","last_peered":"2023-11-04T01:44:28.573689+0000","last_clean":"2023-11-04T01:44:28.573689+0000","last_became_active":"2023-11-04T01:44:27.044893+0000","last_became_peered":"2023-11-04T01:44:27.044893+0000","last_unstale":"2023-11-04T01:44:28.573689+0000","last_undegraded":"2023-11-04T01:44:28.573689+0000","last_fullsized":"2023-11-04T01:44:28.573689+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:44.657798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.671628+0000","last_change":"2023-11-04T01:44:27.065887+0000","last_active":"2023-11-04T01:44:28.671628+0000","last_peered":"2023-11-04T01:44:28.671628+0000","last_clean":"2023-11-04T01:44:28.671628+0000","last_became_active":"2023-11-04T01:44:27.065560+0000","last_became_peered":"2023-11-04T01:44:27.065560+0000","last_unstale":"2023-11-04T01:44:28.671628+0000","last_undegraded":"2023-11-04T01:44:28.671628+0000","last_fullsized":"2023-11-04T01:44:28.671628+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:19.068122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.037901+0000","last_change":"2023-11-04T01:44:27.031564+0000","last_active":"2023-11-04T01:44:28.037901+0000","last_peered":"2023-11-04T01:44:28.037901+0000","last_clean":"2023-11-04T01:44:28.037901+0000","last_became_active":"2023-11-04T01:44:27.030802+0000","last_became_peered":"2023-11-04T01:44:27.030802+0000","last_unstale":"2023-11-04T01:44:28.037901+0000","last_undegraded":"2023-11-04T01:44:28.037901+0000","last_fullsized":"2023-11-04T01:44:28.037901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:02.261442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981221+0000","last_change":"2023-11-04T01:44:25.981221+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981221+0000","last_undegraded":"2023-11-04T01:44:25.981221+0000","last_fullsized":"2023-11-04T01:44:25.981221+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.007021+0000","last_change":"2023-11-04T01:44:26.018471+0000","last_active":"2023-11-04T01:44:27.007021+0000","last_peered":"2023-11-04T01:44:27.007021+0000","last_clean":"2023-11-04T01:44:27.007021+0000","last_became_active":"2023-11-04T01:44:26.017029+0000","last_became_peered":"2023-11-04T01:44:26.017029+0000","last_unstale":"2023-11-04T01:44:27.007021+0000","last_undegraded":"2023-11-04T01:44:27.007021+0000","last_fullsized":"2023-11-04T01:44:27.007021+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:56.757875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.983520+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:44:24.983520+0000","last_peered":"2023-11-04T01:44:24.983520+0000","last_clean":"2023-11-04T01:44:24.983520+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:44:24.983520+0000","last_undegraded":"2023-11-04T01:44:24.983520+0000","last_fullsized":"2023-11-04T01:44:24.983520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.032416+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:44:27.032416+0000","last_peered":"2023-11-04T01:44:27.032416+0000","last_clean":"2023-11-04T01:44:27.032416+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:44:27.032416+0000","last_undegraded":"2023-11-04T01:44:27.032416+0000","last_fullsized":"2023-11-04T01:44:27.032416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979235+0000","last_change":"2023-11-04T01:44:25.979235+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979235+0000","last_undegraded":"2023-11-04T01:44:25.979235+0000","last_fullsized":"2023-11-04T01:44:25.979235+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.066414+0000","last_change":"2023-11-04T01:44:26.011842+0000","last_active":"2023-11-04T01:44:27.066414+0000","last_peered":"2023-11-04T01:44:27.066414+0000","last_clean":"2023-11-04T01:44:27.066414+0000","last_became_active":"2023-11-04T01:44:26.011474+0000","last_became_peered":"2023-11-04T01:44:26.011474+0000","last_unstale":"2023-11-04T01:44:27.066414+0000","last_undegraded":"2023-11-04T01:44:27.066414+0000","last_fullsized":"2023-11-04T01:44:27.066414+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:32.606899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025022+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:44:27.025022+0000","last_peered":"2023-11-04T01:44:27.025022+0000","last_clean":"2023-11-04T01:44:27.025022+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:44:27.025022+0000","last_undegraded":"2023-11-04T01:44:27.025022+0000","last_fullsized":"2023-11-04T01:44:27.025022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673944+0000","last_change":"2023-11-04T01:44:27.055046+0000","last_active":"2023-11-04T01:44:28.673944+0000","last_peered":"2023-11-04T01:44:28.673944+0000","last_clean":"2023-11-04T01:44:28.673944+0000","last_became_active":"2023-11-04T01:44:27.054761+0000","last_became_peered":"2023-11-04T01:44:27.054761+0000","last_unstale":"2023-11-04T01:44:28.673944+0000","last_undegraded":"2023-11-04T01:44:28.673944+0000","last_fullsized":"2023-11-04T01:44:28.673944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:27.680782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025614+0000","last_change":"2023-11-04T01:44:26.013177+0000","last_active":"2023-11-04T01:44:27.025614+0000","last_peered":"2023-11-04T01:44:27.025614+0000","last_clean":"2023-11-04T01:44:27.025614+0000","last_became_active":"2023-11-04T01:44:26.012329+0000","last_became_peered":"2023-11-04T01:44:26.012329+0000","last_unstale":"2023-11-04T01:44:27.025614+0000","last_undegraded":"2023-11-04T01:44:27.025614+0000","last_fullsized":"2023-11-04T01:44:27.025614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:31.333688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972522+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:44:24.972522+0000","last_peered":"2023-11-04T01:44:24.972522+0000","last_clean":"2023-11-04T01:44:24.972522+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:44:24.972522+0000","last_undegraded":"2023-11-04T01:44:24.972522+0000","last_fullsized":"2023-11-04T01:44:24.972522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574760+0000","last_change":"2023-11-04T01:44:27.051035+0000","last_active":"2023-11-04T01:44:28.574760+0000","last_peered":"2023-11-04T01:44:28.574760+0000","last_clean":"2023-11-04T01:44:28.574760+0000","last_became_active":"2023-11-04T01:44:27.048940+0000","last_became_peered":"2023-11-04T01:44:27.048940+0000","last_unstale":"2023-11-04T01:44:28.574760+0000","last_undegraded":"2023-11-04T01:44:28.574760+0000","last_fullsized":"2023-11-04T01:44:28.574760+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:18.346134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.061458+0000","last_change":"2023-11-04T01:44:26.022462+0000","last_active":"2023-11-04T01:44:27.061458+0000","last_peered":"2023-11-04T01:44:27.061458+0000","last_clean":"2023-11-04T01:44:27.061458+0000","last_became_active":"2023-11-04T01:44:26.022072+0000","last_became_peered":"2023-11-04T01:44:26.022072+0000","last_unstale":"2023-11-04T01:44:27.061458+0000","last_undegraded":"2023-11-04T01:44:27.061458+0000","last_fullsized":"2023-11-04T01:44:27.061458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:40.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.033794+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:44:27.033794+0000","last_peered":"2023-11-04T01:44:27.033794+0000","last_clean":"2023-11-04T01:44:27.033794+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:44:27.033794+0000","last_undegraded":"2023-11-04T01:44:27.033794+0000","last_fullsized":"2023-11-04T01:44:27.033794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976618+0000","last_change":"2023-11-04T01:44:25.976618+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976618+0000","last_undegraded":"2023-11-04T01:44:25.976618+0000","last_fullsized":"2023-11-04T01:44:25.976618+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.066385+0000","last_change":"2023-11-04T01:44:25.995503+0000","last_active":"2023-11-04T01:44:27.066385+0000","last_peered":"2023-11-04T01:44:27.066385+0000","last_clean":"2023-11-04T01:44:27.066385+0000","last_became_active":"2023-11-04T01:44:25.994813+0000","last_became_peered":"2023-11-04T01:44:25.994813+0000","last_unstale":"2023-11-04T01:44:27.066385+0000","last_undegraded":"2023-11-04T01:44:27.066385+0000","last_fullsized":"2023-11-04T01:44:27.066385+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:55.446895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010770+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:44:27.010770+0000","last_peered":"2023-11-04T01:44:27.010770+0000","last_clean":"2023-11-04T01:44:27.010770+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:44:27.010770+0000","last_undegraded":"2023-11-04T01:44:27.010770+0000","last_fullsized":"2023-11-04T01:44:27.010770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573721+0000","last_change":"2023-11-04T01:44:27.057608+0000","last_active":"2023-11-04T01:44:28.573721+0000","last_peered":"2023-11-04T01:44:28.573721+0000","last_clean":"2023-11-04T01:44:28.573721+0000","last_became_active":"2023-11-04T01:44:27.057099+0000","last_became_peered":"2023-11-04T01:44:27.057099+0000","last_unstale":"2023-11-04T01:44:28.573721+0000","last_undegraded":"2023-11-04T01:44:28.573721+0000","last_fullsized":"2023-11-04T01:44:28.573721+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:23.782701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.006506+0000","last_change":"2023-11-04T01:44:26.014777+0000","last_active":"2023-11-04T01:44:27.006506+0000","last_peered":"2023-11-04T01:44:27.006506+0000","last_clean":"2023-11-04T01:44:27.006506+0000","last_became_active":"2023-11-04T01:44:26.004670+0000","last_became_peered":"2023-11-04T01:44:26.004670+0000","last_unstale":"2023-11-04T01:44:27.006506+0000","last_undegraded":"2023-11-04T01:44:27.006506+0000","last_fullsized":"2023-11-04T01:44:27.006506+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:07.306028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.014614+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:44:27.014614+0000","last_peered":"2023-11-04T01:44:27.014614+0000","last_clean":"2023-11-04T01:44:27.014614+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:44:27.014614+0000","last_undegraded":"2023-11-04T01:44:27.014614+0000","last_fullsized":"2023-11-04T01:44:27.014614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.035852+0000","last_change":"2023-11-04T01:44:27.029410+0000","last_active":"2023-11-04T01:44:28.035852+0000","last_peered":"2023-11-04T01:44:28.035852+0000","last_clean":"2023-11-04T01:44:28.035852+0000","last_became_active":"2023-11-04T01:44:27.028521+0000","last_became_peered":"2023-11-04T01:44:27.028521+0000","last_unstale":"2023-11-04T01:44:28.035852+0000","last_undegraded":"2023-11-04T01:44:28.035852+0000","last_fullsized":"2023-11-04T01:44:28.035852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:25:52.415381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.055635+0000","last_change":"2023-11-04T01:44:26.020940+0000","last_active":"2023-11-04T01:44:27.055635+0000","last_peered":"2023-11-04T01:44:27.055635+0000","last_clean":"2023-11-04T01:44:27.055635+0000","last_became_active":"2023-11-04T01:44:26.017653+0000","last_became_peered":"2023-11-04T01:44:26.017653+0000","last_unstale":"2023-11-04T01:44:27.055635+0000","last_undegraded":"2023-11-04T01:44:27.055635+0000","last_fullsized":"2023-11-04T01:44:27.055635+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:06.640627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.029055+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:44:27.029055+0000","last_peered":"2023-11-04T01:44:27.029055+0000","last_clean":"2023-11-04T01:44:27.029055+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:44:27.029055+0000","last_undegraded":"2023-11-04T01:44:27.029055+0000","last_fullsized":"2023-11-04T01:44:27.029055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979257+0000","last_change":"2023-11-04T01:44:25.979257+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979257+0000","last_undegraded":"2023-11-04T01:44:25.979257+0000","last_fullsized":"2023-11-04T01:44:25.979257+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.024696+0000","last_change":"2023-11-04T01:44:26.023958+0000","last_active":"2023-11-04T01:44:26.024696+0000","last_peered":"2023-11-04T01:44:26.024696+0000","last_clean":"2023-11-04T01:44:26.024696+0000","last_became_active":"2023-11-04T01:44:26.023597+0000","last_became_peered":"2023-11-04T01:44:26.023597+0000","last_unstale":"2023-11-04T01:44:26.024696+0000","last_undegraded":"2023-11-04T01:44:26.024696+0000","last_fullsized":"2023-11-04T01:44:26.024696+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:38.124099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.972667+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:44:24.972667+0000","last_peered":"2023-11-04T01:44:24.972667+0000","last_clean":"2023-11-04T01:44:24.972667+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:44:24.972667+0000","last_undegraded":"2023-11-04T01:44:24.972667+0000","last_fullsized":"2023-11-04T01:44:24.972667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673628+0000","last_change":"2023-11-04T01:44:27.041913+0000","last_active":"2023-11-04T01:44:28.673628+0000","last_peered":"2023-11-04T01:44:28.673628+0000","last_clean":"2023-11-04T01:44:28.673628+0000","last_became_active":"2023-11-04T01:44:27.041605+0000","last_became_peered":"2023-11-04T01:44:27.041605+0000","last_unstale":"2023-11-04T01:44:28.673628+0000","last_undegraded":"2023-11-04T01:44:28.673628+0000","last_fullsized":"2023-11-04T01:44:28.673628+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.224935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.013840+0000","last_change":"2023-11-04T01:44:26.016783+0000","last_active":"2023-11-04T01:44:27.013840+0000","last_peered":"2023-11-04T01:44:27.013840+0000","last_clean":"2023-11-04T01:44:27.013840+0000","last_became_active":"2023-11-04T01:44:26.015926+0000","last_became_peered":"2023-11-04T01:44:26.015926+0000","last_unstale":"2023-11-04T01:44:27.013840+0000","last_undegraded":"2023-11-04T01:44:27.013840+0000","last_fullsized":"2023-11-04T01:44:27.013840+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:49:01.586496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971792+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:44:24.971792+0000","last_peered":"2023-11-04T01:44:24.971792+0000","last_clean":"2023-11-04T01:44:24.971792+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:44:24.971792+0000","last_undegraded":"2023-11-04T01:44:24.971792+0000","last_fullsized":"2023-11-04T01:44:24.971792+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.674184+0000","last_change":"2023-11-04T01:44:27.055066+0000","last_active":"2023-11-04T01:44:28.674184+0000","last_peered":"2023-11-04T01:44:28.674184+0000","last_clean":"2023-11-04T01:44:28.674184+0000","last_became_active":"2023-11-04T01:44:27.054789+0000","last_became_peered":"2023-11-04T01:44:27.054789+0000","last_unstale":"2023-11-04T01:44:28.674184+0000","last_undegraded":"2023-11-04T01:44:28.674184+0000","last_fullsized":"2023-11-04T01:44:28.674184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:45.720996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.028847+0000","last_change":"2023-11-04T01:44:26.013417+0000","last_active":"2023-11-04T01:44:27.028847+0000","last_peered":"2023-11-04T01:44:27.028847+0000","last_clean":"2023-11-04T01:44:27.028847+0000","last_became_active":"2023-11-04T01:44:26.012615+0000","last_became_peered":"2023-11-04T01:44:26.012615+0000","last_unstale":"2023-11-04T01:44:27.028847+0000","last_undegraded":"2023-11-04T01:44:27.028847+0000","last_fullsized":"2023-11-04T01:44:27.028847+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:10:55.082546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.026358+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:44:27.026358+0000","last_peered":"2023-11-04T01:44:27.026358+0000","last_clean":"2023-11-04T01:44:27.026358+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:44:27.026358+0000","last_undegraded":"2023-11-04T01:44:27.026358+0000","last_fullsized":"2023-11-04T01:44:27.026358+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673562+0000","last_change":"2023-11-04T01:44:27.037096+0000","last_active":"2023-11-04T01:44:28.673562+0000","last_peered":"2023-11-04T01:44:28.673562+0000","last_clean":"2023-11-04T01:44:28.673562+0000","last_became_active":"2023-11-04T01:44:27.036350+0000","last_became_peered":"2023-11-04T01:44:27.036350+0000","last_unstale":"2023-11-04T01:44:28.673562+0000","last_undegraded":"2023-11-04T01:44:28.673562+0000","last_fullsized":"2023-11-04T01:44:28.673562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:35.786647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.059639+0000","last_change":"2023-11-04T01:44:25.998359+0000","last_active":"2023-11-04T01:44:27.059639+0000","last_peered":"2023-11-04T01:44:27.059639+0000","last_clean":"2023-11-04T01:44:27.059639+0000","last_became_active":"2023-11-04T01:44:25.998013+0000","last_became_peered":"2023-11-04T01:44:25.998013+0000","last_unstale":"2023-11-04T01:44:27.059639+0000","last_undegraded":"2023-11-04T01:44:27.059639+0000","last_fullsized":"2023-11-04T01:44:27.059639+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:16.045226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.033851+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:44:27.033851+0000","last_peered":"2023-11-04T01:44:27.033851+0000","last_clean":"2023-11-04T01:44:27.033851+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:44:27.033851+0000","last_undegraded":"2023-11-04T01:44:27.033851+0000","last_fullsized":"2023-11-04T01:44:27.033851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673779+0000","last_change":"2023-11-04T01:44:27.035791+0000","last_active":"2023-11-04T01:44:28.673779+0000","last_peered":"2023-11-04T01:44:28.673779+0000","last_clean":"2023-11-04T01:44:28.673779+0000","last_became_active":"2023-11-04T01:44:27.034980+0000","last_became_peered":"2023-11-04T01:44:27.034980+0000","last_unstale":"2023-11-04T01:44:28.673779+0000","last_undegraded":"2023-11-04T01:44:28.673779+0000","last_fullsized":"2023-11-04T01:44:28.673779+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:21.849993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.042513+0000","last_change":"2023-11-04T01:44:25.999138+0000","last_active":"2023-11-04T01:44:27.042513+0000","last_peered":"2023-11-04T01:44:27.042513+0000","last_clean":"2023-11-04T01:44:27.042513+0000","last_became_active":"2023-11-04T01:44:25.998861+0000","last_became_peered":"2023-11-04T01:44:25.998861+0000","last_unstale":"2023-11-04T01:44:27.042513+0000","last_undegraded":"2023-11-04T01:44:27.042513+0000","last_fullsized":"2023-11-04T01:44:27.042513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:54.219992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.021453+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:44:27.021453+0000","last_peered":"2023-11-04T01:44:27.021453+0000","last_clean":"2023-11-04T01:44:27.021453+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:44:27.021453+0000","last_undegraded":"2023-11-04T01:44:27.021453+0000","last_fullsized":"2023-11-04T01:44:27.021453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036430+0000","last_change":"2023-11-04T01:44:27.049197+0000","last_active":"2023-11-04T01:44:28.036430+0000","last_peered":"2023-11-04T01:44:28.036430+0000","last_clean":"2023-11-04T01:44:28.036430+0000","last_became_active":"2023-11-04T01:44:27.048457+0000","last_became_peered":"2023-11-04T01:44:27.048457+0000","last_unstale":"2023-11-04T01:44:28.036430+0000","last_undegraded":"2023-11-04T01:44:28.036430+0000","last_fullsized":"2023-11-04T01:44:28.036430+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:33.388356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.030278+0000","last_change":"2023-11-04T01:44:26.015137+0000","last_active":"2023-11-04T01:44:27.030278+0000","last_peered":"2023-11-04T01:44:27.030278+0000","last_clean":"2023-11-04T01:44:27.030278+0000","last_became_active":"2023-11-04T01:44:26.014332+0000","last_became_peered":"2023-11-04T01:44:26.014332+0000","last_unstale":"2023-11-04T01:44:27.030278+0000","last_undegraded":"2023-11-04T01:44:27.030278+0000","last_fullsized":"2023-11-04T01:44:27.030278+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:50.202133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984868+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:44:24.984868+0000","last_peered":"2023-11-04T01:44:24.984868+0000","last_clean":"2023-11-04T01:44:24.984868+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:44:24.984868+0000","last_undegraded":"2023-11-04T01:44:24.984868+0000","last_fullsized":"2023-11-04T01:44:24.984868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673978+0000","last_change":"2023-11-04T01:44:27.055992+0000","last_active":"2023-11-04T01:44:28.673978+0000","last_peered":"2023-11-04T01:44:28.673978+0000","last_clean":"2023-11-04T01:44:28.673978+0000","last_became_active":"2023-11-04T01:44:27.055289+0000","last_became_peered":"2023-11-04T01:44:27.055289+0000","last_unstale":"2023-11-04T01:44:28.673978+0000","last_undegraded":"2023-11-04T01:44:28.673978+0000","last_fullsized":"2023-11-04T01:44:28.673978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:24.425794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.006456+0000","last_change":"2023-11-04T01:44:26.017617+0000","last_active":"2023-11-04T01:44:27.006456+0000","last_peered":"2023-11-04T01:44:27.006456+0000","last_clean":"2023-11-04T01:44:27.006456+0000","last_became_active":"2023-11-04T01:44:26.016431+0000","last_became_peered":"2023-11-04T01:44:26.016431+0000","last_unstale":"2023-11-04T01:44:27.006456+0000","last_undegraded":"2023-11-04T01:44:27.006456+0000","last_fullsized":"2023-11-04T01:44:27.006456+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:20.535512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.015089+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:44:27.015089+0000","last_peered":"2023-11-04T01:44:27.015089+0000","last_clean":"2023-11-04T01:44:27.015089+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:44:27.015089+0000","last_undegraded":"2023-11-04T01:44:27.015089+0000","last_fullsized":"2023-11-04T01:44:27.015089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573437+0000","last_change":"2023-11-04T01:44:27.044206+0000","last_active":"2023-11-04T01:44:28.573437+0000","last_peered":"2023-11-04T01:44:28.573437+0000","last_clean":"2023-11-04T01:44:28.573437+0000","last_became_active":"2023-11-04T01:44:27.043855+0000","last_became_peered":"2023-11-04T01:44:27.043855+0000","last_unstale":"2023-11-04T01:44:28.573437+0000","last_undegraded":"2023-11-04T01:44:28.573437+0000","last_fullsized":"2023-11-04T01:44:28.573437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:40.660851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.016448+0000","last_change":"2023-11-04T01:44:26.015593+0000","last_active":"2023-11-04T01:44:26.016448+0000","last_peered":"2023-11-04T01:44:26.016448+0000","last_clean":"2023-11-04T01:44:26.016448+0000","last_became_active":"2023-11-04T01:44:26.015226+0000","last_became_peered":"2023-11-04T01:44:26.015226+0000","last_unstale":"2023-11-04T01:44:26.016448+0000","last_undegraded":"2023-11-04T01:44:26.016448+0000","last_fullsized":"2023-11-04T01:44:26.016448+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:34:39.263964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.012040+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:44:27.012040+0000","last_peered":"2023-11-04T01:44:27.012040+0000","last_clean":"2023-11-04T01:44:27.012040+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:44:27.012040+0000","last_undegraded":"2023-11-04T01:44:27.012040+0000","last_fullsized":"2023-11-04T01:44:27.012040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.976038+0000","last_change":"2023-11-04T01:44:25.976038+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.976038+0000","last_undegraded":"2023-11-04T01:44:25.976038+0000","last_fullsized":"2023-11-04T01:44:25.976038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010950+0000","last_change":"2023-11-04T01:44:26.010758+0000","last_active":"2023-11-04T01:44:27.010950+0000","last_peered":"2023-11-04T01:44:27.010950+0000","last_clean":"2023-11-04T01:44:27.010950+0000","last_became_active":"2023-11-04T01:44:26.010004+0000","last_became_peered":"2023-11-04T01:44:26.010004+0000","last_unstale":"2023-11-04T01:44:27.010950+0000","last_undegraded":"2023-11-04T01:44:27.010950+0000","last_fullsized":"2023-11-04T01:44:27.010950+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:26.506394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.984398+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:44:24.984398+0000","last_peered":"2023-11-04T01:44:24.984398+0000","last_clean":"2023-11-04T01:44:24.984398+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:44:24.984398+0000","last_undegraded":"2023-11-04T01:44:24.984398+0000","last_fullsized":"2023-11-04T01:44:24.984398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036829+0000","last_change":"2023-11-04T01:44:27.063722+0000","last_active":"2023-11-04T01:44:28.036829+0000","last_peered":"2023-11-04T01:44:28.036829+0000","last_clean":"2023-11-04T01:44:28.036829+0000","last_became_active":"2023-11-04T01:44:27.062722+0000","last_became_peered":"2023-11-04T01:44:27.062722+0000","last_unstale":"2023-11-04T01:44:28.036829+0000","last_undegraded":"2023-11-04T01:44:28.036829+0000","last_fullsized":"2023-11-04T01:44:28.036829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:30.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.071371+0000","last_change":"2023-11-04T01:44:26.002793+0000","last_active":"2023-11-04T01:44:27.071371+0000","last_peered":"2023-11-04T01:44:27.071371+0000","last_clean":"2023-11-04T01:44:27.071371+0000","last_became_active":"2023-11-04T01:44:26.001964+0000","last_became_peered":"2023-11-04T01:44:26.001964+0000","last_unstale":"2023-11-04T01:44:27.071371+0000","last_undegraded":"2023-11-04T01:44:27.071371+0000","last_fullsized":"2023-11-04T01:44:27.071371+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:57.459660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971917+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:44:24.971917+0000","last_peered":"2023-11-04T01:44:24.971917+0000","last_clean":"2023-11-04T01:44:24.971917+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:44:24.971917+0000","last_undegraded":"2023-11-04T01:44:24.971917+0000","last_fullsized":"2023-11-04T01:44:24.971917+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574625+0000","last_change":"2023-11-04T01:44:27.057689+0000","last_active":"2023-11-04T01:44:28.574625+0000","last_peered":"2023-11-04T01:44:28.574625+0000","last_clean":"2023-11-04T01:44:28.574625+0000","last_became_active":"2023-11-04T01:44:27.057328+0000","last_became_peered":"2023-11-04T01:44:27.057328+0000","last_unstale":"2023-11-04T01:44:28.574625+0000","last_undegraded":"2023-11-04T01:44:28.574625+0000","last_fullsized":"2023-11-04T01:44:28.574625+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:14.728412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.067173+0000","last_change":"2023-11-04T01:44:26.026547+0000","last_active":"2023-11-04T01:44:27.067173+0000","last_peered":"2023-11-04T01:44:27.067173+0000","last_clean":"2023-11-04T01:44:27.067173+0000","last_became_active":"2023-11-04T01:44:26.025889+0000","last_became_peered":"2023-11-04T01:44:26.025889+0000","last_unstale":"2023-11-04T01:44:27.067173+0000","last_undegraded":"2023-11-04T01:44:27.067173+0000","last_fullsized":"2023-11-04T01:44:27.067173+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:16.332260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025488+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:44:27.025488+0000","last_peered":"2023-11-04T01:44:27.025488+0000","last_clean":"2023-11-04T01:44:27.025488+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:44:27.025488+0000","last_undegraded":"2023-11-04T01:44:27.025488+0000","last_fullsized":"2023-11-04T01:44:27.025488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574528+0000","last_change":"2023-11-04T01:44:27.048601+0000","last_active":"2023-11-04T01:44:28.574528+0000","last_peered":"2023-11-04T01:44:28.574528+0000","last_clean":"2023-11-04T01:44:28.574528+0000","last_became_active":"2023-11-04T01:44:27.048139+0000","last_became_peered":"2023-11-04T01:44:27.048139+0000","last_unstale":"2023-11-04T01:44:28.574528+0000","last_undegraded":"2023-11-04T01:44:28.574528+0000","last_fullsized":"2023-11-04T01:44:28.574528+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:49.548339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.066894+0000","last_change":"2023-11-04T01:44:26.010837+0000","last_active":"2023-11-04T01:44:27.066894+0000","last_peered":"2023-11-04T01:44:27.066894+0000","last_clean":"2023-11-04T01:44:27.066894+0000","last_became_active":"2023-11-04T01:44:26.010100+0000","last_became_peered":"2023-11-04T01:44:26.010100+0000","last_unstale":"2023-11-04T01:44:27.066894+0000","last_undegraded":"2023-11-04T01:44:27.066894+0000","last_fullsized":"2023-11-04T01:44:27.066894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:29.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.020795+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:44:27.020795+0000","last_peered":"2023-11-04T01:44:27.020795+0000","last_clean":"2023-11-04T01:44:27.020795+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:44:27.020795+0000","last_undegraded":"2023-11-04T01:44:27.020795+0000","last_fullsized":"2023-11-04T01:44:27.020795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.675222+0000","last_change":"2023-11-04T01:44:27.059837+0000","last_active":"2023-11-04T01:44:28.675222+0000","last_peered":"2023-11-04T01:44:28.675222+0000","last_clean":"2023-11-04T01:44:28.675222+0000","last_became_active":"2023-11-04T01:44:27.059515+0000","last_became_peered":"2023-11-04T01:44:27.059515+0000","last_unstale":"2023-11-04T01:44:28.675222+0000","last_undegraded":"2023-11-04T01:44:28.675222+0000","last_fullsized":"2023-11-04T01:44:28.675222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:09.370575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.065604+0000","last_change":"2023-11-04T01:44:26.021964+0000","last_active":"2023-11-04T01:44:27.065604+0000","last_peered":"2023-11-04T01:44:27.065604+0000","last_clean":"2023-11-04T01:44:27.065604+0000","last_became_active":"2023-11-04T01:44:26.021274+0000","last_became_peered":"2023-11-04T01:44:26.021274+0000","last_unstale":"2023-11-04T01:44:27.065604+0000","last_undegraded":"2023-11-04T01:44:27.065604+0000","last_fullsized":"2023-11-04T01:44:27.065604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:45.379512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010542+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:44:27.010542+0000","last_peered":"2023-11-04T01:44:27.010542+0000","last_clean":"2023-11-04T01:44:27.010542+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:44:27.010542+0000","last_undegraded":"2023-11-04T01:44:27.010542+0000","last_fullsized":"2023-11-04T01:44:27.010542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.985508+0000","last_change":"2023-11-04T01:44:25.985508+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.985508+0000","last_undegraded":"2023-11-04T01:44:25.985508+0000","last_fullsized":"2023-11-04T01:44:25.985508+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010096+0000","last_change":"2023-11-04T01:44:26.010580+0000","last_active":"2023-11-04T01:44:27.010096+0000","last_peered":"2023-11-04T01:44:27.010096+0000","last_clean":"2023-11-04T01:44:27.010096+0000","last_became_active":"2023-11-04T01:44:26.009725+0000","last_became_peered":"2023-11-04T01:44:26.009725+0000","last_unstale":"2023-11-04T01:44:27.010096+0000","last_undegraded":"2023-11-04T01:44:27.010096+0000","last_fullsized":"2023-11-04T01:44:27.010096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:45.862193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025094+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:44:27.025094+0000","last_peered":"2023-11-04T01:44:27.025094+0000","last_clean":"2023-11-04T01:44:27.025094+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:44:27.025094+0000","last_undegraded":"2023-11-04T01:44:27.025094+0000","last_fullsized":"2023-11-04T01:44:27.025094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673707+0000","last_change":"2023-11-04T01:44:27.057858+0000","last_active":"2023-11-04T01:44:28.673707+0000","last_peered":"2023-11-04T01:44:28.673707+0000","last_clean":"2023-11-04T01:44:28.673707+0000","last_became_active":"2023-11-04T01:44:27.056968+0000","last_became_peered":"2023-11-04T01:44:27.056968+0000","last_unstale":"2023-11-04T01:44:28.673707+0000","last_undegraded":"2023-11-04T01:44:28.673707+0000","last_fullsized":"2023-11-04T01:44:28.673707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:52.619584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.033303+0000","last_change":"2023-11-04T01:44:26.002476+0000","last_active":"2023-11-04T01:44:27.033303+0000","last_peered":"2023-11-04T01:44:27.033303+0000","last_clean":"2023-11-04T01:44:27.033303+0000","last_became_active":"2023-11-04T01:44:26.002079+0000","last_became_peered":"2023-11-04T01:44:26.002079+0000","last_unstale":"2023-11-04T01:44:27.033303+0000","last_undegraded":"2023-11-04T01:44:27.033303+0000","last_fullsized":"2023-11-04T01:44:27.033303+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:56.757875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":38,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.985254+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:44:24.985254+0000","last_peered":"2023-11-04T01:44:24.985254+0000","last_clean":"2023-11-04T01:44:24.985254+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:44:24.985254+0000","last_undegraded":"2023-11-04T01:44:24.985254+0000","last_fullsized":"2023-11-04T01:44:24.985254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673032+0000","last_change":"2023-11-04T01:44:27.063685+0000","last_active":"2023-11-04T01:44:28.673032+0000","last_peered":"2023-11-04T01:44:28.673032+0000","last_clean":"2023-11-04T01:44:28.673032+0000","last_became_active":"2023-11-04T01:44:27.063053+0000","last_became_peered":"2023-11-04T01:44:27.063053+0000","last_unstale":"2023-11-04T01:44:28.673032+0000","last_undegraded":"2023-11-04T01:44:28.673032+0000","last_fullsized":"2023-11-04T01:44:28.673032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:02.822023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.071109+0000","last_change":"2023-11-04T01:44:25.997723+0000","last_active":"2023-11-04T01:44:27.071109+0000","last_peered":"2023-11-04T01:44:27.071109+0000","last_clean":"2023-11-04T01:44:27.071109+0000","last_became_active":"2023-11-04T01:44:25.995153+0000","last_became_peered":"2023-11-04T01:44:25.995153+0000","last_unstale":"2023-11-04T01:44:27.071109+0000","last_undegraded":"2023-11-04T01:44:27.071109+0000","last_fullsized":"2023-11-04T01:44:27.071109+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:54.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.023362+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:44:27.023362+0000","last_peered":"2023-11-04T01:44:27.023362+0000","last_clean":"2023-11-04T01:44:27.023362+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:44:27.023362+0000","last_undegraded":"2023-11-04T01:44:27.023362+0000","last_fullsized":"2023-11-04T01:44:27.023362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.038183+0000","last_change":"2023-11-04T01:44:27.039108+0000","last_active":"2023-11-04T01:44:28.038183+0000","last_peered":"2023-11-04T01:44:28.038183+0000","last_clean":"2023-11-04T01:44:28.038183+0000","last_became_active":"2023-11-04T01:44:27.037465+0000","last_became_peered":"2023-11-04T01:44:27.037465+0000","last_unstale":"2023-11-04T01:44:28.038183+0000","last_undegraded":"2023-11-04T01:44:28.038183+0000","last_fullsized":"2023-11-04T01:44:28.038183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:43.895920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.058790+0000","last_change":"2023-11-04T01:44:26.022595+0000","last_active":"2023-11-04T01:44:27.058790+0000","last_peered":"2023-11-04T01:44:27.058790+0000","last_clean":"2023-11-04T01:44:27.058790+0000","last_became_active":"2023-11-04T01:44:26.021907+0000","last_became_peered":"2023-11-04T01:44:26.021907+0000","last_unstale":"2023-11-04T01:44:27.058790+0000","last_undegraded":"2023-11-04T01:44:27.058790+0000","last_fullsized":"2023-11-04T01:44:27.058790+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:54.219992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.042107+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:44:27.042107+0000","last_peered":"2023-11-04T01:44:27.042107+0000","last_clean":"2023-11-04T01:44:27.042107+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:44:27.042107+0000","last_undegraded":"2023-11-04T01:44:27.042107+0000","last_fullsized":"2023-11-04T01:44:27.042107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.979976+0000","last_change":"2023-11-04T01:44:25.979976+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.979976+0000","last_undegraded":"2023-11-04T01:44:25.979976+0000","last_fullsized":"2023-11-04T01:44:25.979976+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.056186+0000","last_change":"2023-11-04T01:44:26.022628+0000","last_active":"2023-11-04T01:44:27.056186+0000","last_peered":"2023-11-04T01:44:27.056186+0000","last_clean":"2023-11-04T01:44:27.056186+0000","last_became_active":"2023-11-04T01:44:26.022154+0000","last_became_peered":"2023-11-04T01:44:26.022154+0000","last_unstale":"2023-11-04T01:44:27.056186+0000","last_undegraded":"2023-11-04T01:44:27.056186+0000","last_fullsized":"2023-11-04T01:44:27.056186+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:50.013057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.022278+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:44:27.022278+0000","last_peered":"2023-11-04T01:44:27.022278+0000","last_clean":"2023-11-04T01:44:27.022278+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:44:27.022278+0000","last_undegraded":"2023-11-04T01:44:27.022278+0000","last_fullsized":"2023-11-04T01:44:27.022278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673768+0000","last_change":"2023-11-04T01:44:27.065790+0000","last_active":"2023-11-04T01:44:28.673768+0000","last_peered":"2023-11-04T01:44:28.673768+0000","last_clean":"2023-11-04T01:44:28.673768+0000","last_became_active":"2023-11-04T01:44:27.065384+0000","last_became_peered":"2023-11-04T01:44:27.065384+0000","last_unstale":"2023-11-04T01:44:28.673768+0000","last_undegraded":"2023-11-04T01:44:28.673768+0000","last_fullsized":"2023-11-04T01:44:28.673768+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:33.230335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.073857+0000","last_change":"2023-11-04T01:44:26.026137+0000","last_active":"2023-11-04T01:44:27.073857+0000","last_peered":"2023-11-04T01:44:27.073857+0000","last_clean":"2023-11-04T01:44:27.073857+0000","last_became_active":"2023-11-04T01:44:26.025618+0000","last_became_peered":"2023-11-04T01:44:26.025618+0000","last_unstale":"2023-11-04T01:44:27.073857+0000","last_undegraded":"2023-11-04T01:44:27.073857+0000","last_fullsized":"2023-11-04T01:44:27.073857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:16.045226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.011625+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:44:27.011625+0000","last_peered":"2023-11-04T01:44:27.011625+0000","last_clean":"2023-11-04T01:44:27.011625+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:44:27.011625+0000","last_undegraded":"2023-11-04T01:44:27.011625+0000","last_fullsized":"2023-11-04T01:44:27.011625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.039200+0000","last_change":"2023-11-04T01:44:27.065081+0000","last_active":"2023-11-04T01:44:28.039200+0000","last_peered":"2023-11-04T01:44:28.039200+0000","last_clean":"2023-11-04T01:44:28.039200+0000","last_became_active":"2023-11-04T01:44:27.064420+0000","last_became_peered":"2023-11-04T01:44:27.064420+0000","last_unstale":"2023-11-04T01:44:28.039200+0000","last_undegraded":"2023-11-04T01:44:28.039200+0000","last_fullsized":"2023-11-04T01:44:28.039200+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:21.548494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.043506+0000","last_change":"2023-11-04T01:44:26.022463+0000","last_active":"2023-11-04T01:44:27.043506+0000","last_peered":"2023-11-04T01:44:27.043506+0000","last_clean":"2023-11-04T01:44:27.043506+0000","last_became_active":"2023-11-04T01:44:26.022048+0000","last_became_peered":"2023-11-04T01:44:26.022048+0000","last_unstale":"2023-11-04T01:44:27.043506+0000","last_undegraded":"2023-11-04T01:44:27.043506+0000","last_fullsized":"2023-11-04T01:44:27.043506+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:06.640627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.021175+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:44:27.021175+0000","last_peered":"2023-11-04T01:44:27.021175+0000","last_clean":"2023-11-04T01:44:27.021175+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:44:27.021175+0000","last_undegraded":"2023-11-04T01:44:27.021175+0000","last_fullsized":"2023-11-04T01:44:27.021175+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673709+0000","last_change":"2023-11-04T01:44:27.039279+0000","last_active":"2023-11-04T01:44:28.673709+0000","last_peered":"2023-11-04T01:44:28.673709+0000","last_clean":"2023-11-04T01:44:28.673709+0000","last_became_active":"2023-11-04T01:44:27.038477+0000","last_became_peered":"2023-11-04T01:44:27.038477+0000","last_unstale":"2023-11-04T01:44:28.673709+0000","last_undegraded":"2023-11-04T01:44:28.673709+0000","last_fullsized":"2023-11-04T01:44:28.673709+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:30.160196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.002160+0000","last_change":"2023-11-04T01:44:25.996467+0000","last_active":"2023-11-04T01:44:26.002160+0000","last_peered":"2023-11-04T01:44:26.002160+0000","last_clean":"2023-11-04T01:44:26.002160+0000","last_became_active":"2023-11-04T01:44:25.995184+0000","last_became_peered":"2023-11-04T01:44:25.995184+0000","last_unstale":"2023-11-04T01:44:26.002160+0000","last_undegraded":"2023-11-04T01:44:26.002160+0000","last_fullsized":"2023-11-04T01:44:26.002160+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:44:02.603408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-11-04T01:44:24.971694+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:44:24.971694+0000","last_peered":"2023-11-04T01:44:24.971694+0000","last_clean":"2023-11-04T01:44:24.971694+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:44:24.971694+0000","last_undegraded":"2023-11-04T01:44:24.971694+0000","last_fullsized":"2023-11-04T01:44:24.971694+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.984663+0000","last_change":"2023-11-04T01:44:25.984663+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.984663+0000","last_undegraded":"2023-11-04T01:44:25.984663+0000","last_fullsized":"2023-11-04T01:44:25.984663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.032001+0000","last_change":"2023-11-04T01:44:25.998853+0000","last_active":"2023-11-04T01:44:27.032001+0000","last_peered":"2023-11-04T01:44:27.032001+0000","last_clean":"2023-11-04T01:44:27.032001+0000","last_became_active":"2023-11-04T01:44:25.998391+0000","last_became_peered":"2023-11-04T01:44:25.998391+0000","last_unstale":"2023-11-04T01:44:27.032001+0000","last_undegraded":"2023-11-04T01:44:27.032001+0000","last_fullsized":"2023-11-04T01:44:27.032001+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:53.294178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.031785+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:44:27.031785+0000","last_peered":"2023-11-04T01:44:27.031785+0000","last_clean":"2023-11-04T01:44:27.031785+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:44:27.031785+0000","last_undegraded":"2023-11-04T01:44:27.031785+0000","last_fullsized":"2023-11-04T01:44:27.031785+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.038401+0000","last_change":"2023-11-04T01:44:27.041115+0000","last_active":"2023-11-04T01:44:28.038401+0000","last_peered":"2023-11-04T01:44:28.038401+0000","last_clean":"2023-11-04T01:44:28.038401+0000","last_became_active":"2023-11-04T01:44:27.040339+0000","last_became_peered":"2023-11-04T01:44:27.040339+0000","last_unstale":"2023-11-04T01:44:28.038401+0000","last_undegraded":"2023-11-04T01:44:28.038401+0000","last_fullsized":"2023-11-04T01:44:28.038401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:54.005900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:25.997388+0000","last_change":"2023-11-04T01:44:25.991176+0000","last_active":"2023-11-04T01:44:25.997388+0000","last_peered":"2023-11-04T01:44:25.997388+0000","last_clean":"2023-11-04T01:44:25.997388+0000","last_became_active":"2023-11-04T01:44:25.990747+0000","last_became_peered":"2023-11-04T01:44:25.990747+0000","last_unstale":"2023-11-04T01:44:25.997388+0000","last_undegraded":"2023-11-04T01:44:25.997388+0000","last_fullsized":"2023-11-04T01:44:25.997388+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:15:16.695292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.012805+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:44:27.012805+0000","last_peered":"2023-11-04T01:44:27.012805+0000","last_clean":"2023-11-04T01:44:27.012805+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:44:27.012805+0000","last_undegraded":"2023-11-04T01:44:27.012805+0000","last_fullsized":"2023-11-04T01:44:27.012805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.982646+0000","last_change":"2023-11-04T01:44:25.982646+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.982646+0000","last_undegraded":"2023-11-04T01:44:25.982646+0000","last_fullsized":"2023-11-04T01:44:25.982646+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.061436+0000","last_change":"2023-11-04T01:44:25.989387+0000","last_active":"2023-11-04T01:44:27.061436+0000","last_peered":"2023-11-04T01:44:27.061436+0000","last_clean":"2023-11-04T01:44:27.061436+0000","last_became_active":"2023-11-04T01:44:25.988969+0000","last_became_peered":"2023-11-04T01:44:25.988969+0000","last_unstale":"2023-11-04T01:44:27.061436+0000","last_undegraded":"2023-11-04T01:44:27.061436+0000","last_fullsized":"2023-11-04T01:44:27.061436+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:40.596004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.031606+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:44:27.031606+0000","last_peered":"2023-11-04T01:44:27.031606+0000","last_clean":"2023-11-04T01:44:27.031606+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:44:27.031606+0000","last_undegraded":"2023-11-04T01:44:27.031606+0000","last_fullsized":"2023-11-04T01:44:27.031606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":62,"state":"creating+peering","last_fresh":"2023-11-04T01:44:25.981465+0000","last_change":"2023-11-04T01:44:25.981465+0000","last_active":"2023-11-04T01:44:25.963816+0000","last_peered":"2023-11-04T01:44:25.963816+0000","last_clean":"2023-11-04T01:44:25.963816+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-04T01:44:25.981465+0000","last_undegraded":"2023-11-04T01:44:25.981465+0000","last_fullsized":"2023-11-04T01:44:25.981465+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-04T01:44:26.006150+0000","last_change":"2023-11-04T01:44:26.005066+0000","last_active":"2023-11-04T01:44:26.006150+0000","last_peered":"2023-11-04T01:44:26.006150+0000","last_clean":"2023-11-04T01:44:26.006150+0000","last_became_active":"2023-11-04T01:44:26.004633+0000","last_became_peered":"2023-11-04T01:44:26.004633+0000","last_unstale":"2023-11-04T01:44:26.006150+0000","last_undegraded":"2023-11-04T01:44:26.006150+0000","last_fullsized":"2023-11-04T01:44:26.006150+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:21:07.715775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.012563+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:44:27.012563+0000","last_peered":"2023-11-04T01:44:27.012563+0000","last_clean":"2023-11-04T01:44:27.012563+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:44:27.012563+0000","last_undegraded":"2023-11-04T01:44:27.012563+0000","last_fullsized":"2023-11-04T01:44:27.012563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":910185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.628}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.35299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.371,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.499}]},{"osd":4,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.877},"min":{"1min":0.57299999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.65300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3640000000000001,"5min":1.365,"15min":1.365},"last":0.99299999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3540000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.079}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0620000000000001,"15min":1.0720000000000001},"min":{"1min":0.70199999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.373,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4159999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.093,"5min":1.079,"15min":1.077},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.92200000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":319817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.607}]},{"osd":3,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.143,"5min":1.885,"15min":1.885},"last":1.4419999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.526,"15min":1.526},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.3380000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2410000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.0960000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0089999999999999,"15min":1.006},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.256}]},{"osd":7,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.095,"15min":1.0960000000000001},"min":{"1min":0.628,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.518},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.369,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.3779999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542175,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":333598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.89600000000000002},"min":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.276,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.84799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.333,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.78400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.875},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.137,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.86799999999999999,"15min":0.85699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.147},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1040000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90200000000000002},"min":{"1min":0.66700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2989999999999999,"5min":1.514,"15min":1.514},"last":0.94199999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.073,"15min":1.077},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2729999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.232,"5min":2.609,"15min":2.609},"last":1.1140000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.1539999999999999,"15min":1.1759999999999999},"min":{"1min":0.77800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.387,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.125,"5min":2.4529999999999998,"15min":2.6749999999999998},"min":{"1min":0.82899999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3660000000000001,"5min":40.195,"15min":40.195},"last":1.28}]},{"osd":6,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2909999999999999,"15min":1.319},"min":{"1min":0.94699999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2849999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.244},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1399999999999999,"15min":1.1499999999999999},"min":{"1min":0.77000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5529999999999999,"5min":1.637,"15min":1.637},"last":1.177}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":335862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.413,"5min":1.623,"15min":1.623},"last":0.5},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.94699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4039999999999999,"5min":1.724,"15min":1.724},"last":0.70699999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.95399999999999996,"15min":0.96299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.444,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.244,"15min":1.244},"last":0.92900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0089999999999999,"15min":1.0169999999999999},"min":{"1min":0.61899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4330000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.871},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.03},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.298,"5min":1.976,"15min":1.976},"last":1.1899999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0049999999999999},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.335,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.099},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.546,"5min":2.161,"15min":2.161},"last":1.2390000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.63,"5min":0.495,"15min":0.495},"max":{"1min":1.333,"5min":1.538,"15min":1.538},"last":1.161},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.1220000000000001},"min":{"1min":0.70199999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.516,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.034}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0600000000000001},"min":{"1min":0.69799999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.204,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.073},{"interface":"front","average":{"1min":1.095,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.484,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.214}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8919999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.999},{"interface":"front","average":{"1min":1.075,"5min":1.1060000000000001,"15min":1.111},"min":{"1min":0.83299999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.387,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2609999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1376256,"data_stored":925690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":0.876},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.23,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.86399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.321,"15min":1.321},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.075}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.28},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3320000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1899999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.874,"15min":0.875},"min":{"1min":0.55600000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.1559999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.024,"5min":0.93600000000000005,"15min":0.92200000000000004},"min":{"1min":0.72599999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.94499999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.98499999999999999,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.343,"5min":1.401,"15min":1.401},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0269999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.90700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3879999999999999,"5min":1.627,"15min":1.627},"last":1.268},{"interface":"front","average":{"1min":1.198,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":1.026,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.399,"5min":1.526,"15min":1.526},"last":1.1319999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.137,"15min":1.1459999999999999},"min":{"1min":0.81799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.409,"5min":1.49,"15min":1.49},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.22,"15min":1.23},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.496,"5min":1.536,"15min":1.536},"last":1.347}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":765952,"data_stored":334180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":2.8450000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.758,"15min":1.758},"last":4.8150000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.46,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":4.0919999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.173,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.772}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96499999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":3.4620000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.65900000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1839999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":4.556}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2889999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.927},{"interface":"front","average":{"1min":1,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":1.833,"15min":1.833},"last":4.3319999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3420000000000001,"5min":1.369,"15min":1.369},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.502}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.125},"min":{"1min":0.77200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7410000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.014},"min":{"1min":0.84599999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.4399999999999999,"5min":1.554,"15min":1.554},"last":0.91500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.292,"5min":1.417,"15min":1.417},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.202},"min":{"1min":0.96799999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1379999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":333758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85999999999999999,"5min":1.167,"15min":1.167},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.85099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.252,"5min":1.429,"15min":1.429},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1890000000000001,"5min":1.252,"15min":1.252},"last":1.254}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4159999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.198},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.335}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.357,"5min":1.369,"15min":1.369},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.069}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.0429999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.115},{"interface":"front","average":{"1min":1.103,"5min":1.0469999999999999,"15min":1.0369999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1579999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542175,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":333654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.0509999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.81799999999999995,"5min":1.022,"15min":1.022},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.38100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.054,"5min":1.181,"15min":1.181},"last":0.83199999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.411,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.1459999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.879,"15min":0.877},"min":{"1min":0.61299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0980000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2290000000000001,"5min":1.603,"15min":1.603},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.24}]},{"osd":7,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.002,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.377,"5min":1.411,"15min":1.411},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.272,"5min":1.613,"15min":1.613},"last":1.1890000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:44:31.958 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:44:31.951+0000 7f11f2d4e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:34.530 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:44:34.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.659+0000 7fd1c021e640 1 Processor -- start 2023-11-04T01:44:34.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.659+0000 7fd1c021e640 1 -- start start 2023-11-04T01:44:34.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1c021e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1b815d690 0x7fd1b806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1c021e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80cd400 con 0x7fd1b815d2b0 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1c021e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80cd6e0 con 0x7fd1b806f8f0 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1c021e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80ad450 con 0x7fd1b815d690 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bdfba640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd1b815d2b0 0x7fd1b80ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54616/0 (socket says 172.21.15.2:54616) 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bdfba640 1 -- 172.21.15.2:0/3340547265 learned_addr learned my addr 172.21.15.2:0/3340547265 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bd7b9640 1 --2- 172.21.15.2:0/3340547265 >> v2:172.21.15.90:3300/0 conn(0x7fd1b815d690 0x7fd1b806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bcfb8640 1 -- 172.21.15.2:0/3340547265 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752539161 0 0) 0x7fd1b80cd400 con 0x7fd1b815d2b0 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bcfb8640 1 -- 172.21.15.2:0/3340547265 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a4003530 con 0x7fd1b815d2b0 2023-11-04T01:44:34.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bd7b9640 1 -- 172.21.15.2:0/3340547265 >> v1:172.21.15.90:6789/0 conn(0x7fd1b806f8f0 legacy=0x7fd1b80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bd7b9640 1 -- 172.21.15.2:0/3340547265 >> v1:172.21.15.2:6789/0 conn(0x7fd1b815d2b0 legacy=0x7fd1b80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bcfb8640 1 -- 172.21.15.2:0/3340547265 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2625825355 0 0) 0x7fd1a4003530 con 0x7fd1b815d2b0 2023-11-04T01:44:34.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.663+0000 7fd1bd7b9640 1 -- 172.21.15.2:0/3340547265 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80ad070 con 0x7fd1b815d690 2023-11-04T01:44:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bd7b9640 1 --2- 172.21.15.2:0/3340547265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b806c630 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80097c0 tx=0x7fd1a801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1b9b112054cbc68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bcfb8640 1 -- 172.21.15.2:0/3340547265 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4001680 con 0x7fd1b815d690 2023-11-04T01:44:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bcfb8640 1 -- 172.21.15.2:0/3340547265 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a80a7050 con 0x7fd1b815d690 2023-11-04T01:44:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bcfb8640 1 -- 172.21.15.2:0/3340547265 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a80ab620 con 0x7fd1b815d690 2023-11-04T01:44:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- 172.21.15.2:0/3340547265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 msgr2=0x7fd1b806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 --2- 172.21.15.2:0/3340547265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b806c630 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80097c0 tx=0x7fd1a801c310 comp rx=0 tx=0).stop 2023-11-04T01:44:34.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- 172.21.15.2:0/3340547265 shutdown_connections 2023-11-04T01:44:34.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 --2- 172.21.15.2:0/3340547265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b806c630 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:34.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- 172.21.15.2:0/3340547265 >> 172.21.15.2:0/3340547265 conn(0x7fd1b80cebb0 msgr2=0x7fd1b80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:34.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- 172.21.15.2:0/3340547265 shutdown_connections 2023-11-04T01:44:34.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- 172.21.15.2:0/3340547265 wait complete. 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 Processor -- start 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- start start 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b806f8f0 0x7fd1b8154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b815d2b0 0x7fd1b814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b80c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81551d0 con 0x7fd1b806f8f0 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81503d0 con 0x7fd1b815d690 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1c021e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8151950 con 0x7fd1b815d2b0 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b806f8f0 0x7fd1b8154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:34.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b806f8f0 0x7fd1b8154c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40530/0 (socket says 172.21.15.2:40530) 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 -- 172.21.15.2:0/1931849519 learned_addr learned my addr 172.21.15.2:0/1931849519 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bd7b9640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b815d2b0 0x7fd1b814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 -- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b815d2b0 msgr2=0x7fd1b814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1be7bb640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b80c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b815d2b0 0x7fd1b814fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 -- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 msgr2=0x7fd1b80c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b80c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1bdfba640 1 -- 172.21.15.2:0/1931849519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8009420 con 0x7fd1b806f8f0 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.667+0000 7fd1be7bb640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b80c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1bdfba640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b806f8f0 0x7fd1b8154c90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c760 tx=0x7fd1b400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1ae7fc640 1 -- 172.21.15.2:0/1931849519 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4005ae0 con 0x7fd1b806f8f0 2023-11-04T01:44:34.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1ae7fc640 1 -- 172.21.15.2:0/1931849519 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4005c40 con 0x7fd1b806f8f0 2023-11-04T01:44:34.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b8151c30 con 0x7fd1b806f8f0 2023-11-04T01:44:34.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1ae7fc640 1 -- 172.21.15.2:0/1931849519 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4007070 con 0x7fd1b806f8f0 2023-11-04T01:44:34.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b81521f0 con 0x7fd1b806f8f0 2023-11-04T01:44:34.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b80744a0 con 0x7fd1b806f8f0 2023-11-04T01:44:34.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1ae7fc640 1 -- 172.21.15.2:0/1931849519 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1b40071f0 con 0x7fd1b806f8f0 2023-11-04T01:44:34.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1ae7fc640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd19c0664a0 0x7fd19c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:34.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1ae7fc640 1 -- 172.21.15.2:0/1931849519 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1b4083890 con 0x7fd1b806f8f0 2023-11-04T01:44:34.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1bd7b9640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd19c0664a0 0x7fd19c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:34.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.671+0000 7fd1bd7b9640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd19c0664a0 0x7fd19c068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80ad000 tx=0x7fd1a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:34.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.675+0000 7fd1ae7fc640 1 -- 172.21.15.2:0/1931849519 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1b40545c0 con 0x7fd1b806f8f0 2023-11-04T01:44:34.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.827+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1b8161c90 con 0x7fd19c0664a0 2023-11-04T01:44:34.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.859+0000 7fd1ae7fc640 1 -- 172.21.15.2:0/1931849519 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368453 (secure 0 0 0) 0x7fd1b8161c90 con 0x7fd19c0664a0 2023-11-04T01:44:34.865 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:34.870 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd19c0664a0 msgr2=0x7fd19c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd19c0664a0 0x7fd19c068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80ad000 tx=0x7fd1a8008040 comp rx=0 tx=0).stop 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b806f8f0 msgr2=0x7fd1b8154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b806f8f0 0x7fd1b8154c90 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c760 tx=0x7fd1b400cc20 comp rx=0 tx=0).stop 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 shutdown_connections 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd19c0664a0 0x7fd19c068960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1b815d690 0x7fd1b80c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1b815d2b0 0x7fd1b814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 --2- 172.21.15.2:0/1931849519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1b806f8f0 0x7fd1b8154c90 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 >> 172.21.15.2:0/1931849519 conn(0x7fd1b80cebb0 msgr2=0x7fd1b80cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 shutdown_connections 2023-11-04T01:44:34.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:34.863+0000 7fd1c021e640 1 -- 172.21.15.2:0/1931849519 wait complete. 2023-11-04T01:44:34.890 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2023-11-04T01:44:34.817523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":233,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244152,"kb_used_data":7176,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730568,"statfs":{"total":773094113280,"available":772844101632,"internally_reserved":0,"allocated":7348224,"data_stored":3854340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":64,"apply_latency_ms":64,"commit_latency_ns":64000000,"apply_latency_ns":64000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003250"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.039953+0000","last_change":"2023-11-04T01:44:27.023961+0000","last_active":"2023-11-04T01:44:28.039953+0000","last_peered":"2023-11-04T01:44:28.039953+0000","last_clean":"2023-11-04T01:44:28.039953+0000","last_became_active":"2023-11-04T01:44:27.023233+0000","last_became_peered":"2023-11-04T01:44:27.023233+0000","last_unstale":"2023-11-04T01:44:28.039953+0000","last_undegraded":"2023-11-04T01:44:28.039953+0000","last_fullsized":"2023-11-04T01:44:28.039953+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:08.319009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.037134+0000","last_change":"2023-11-04T01:44:27.063338+0000","last_active":"2023-11-04T01:44:28.037134+0000","last_peered":"2023-11-04T01:44:28.037134+0000","last_clean":"2023-11-04T01:44:28.037134+0000","last_became_active":"2023-11-04T01:44:27.061901+0000","last_became_peered":"2023-11-04T01:44:27.061901+0000","last_unstale":"2023-11-04T01:44:28.037134+0000","last_undegraded":"2023-11-04T01:44:28.037134+0000","last_fullsized":"2023-11-04T01:44:28.037134+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:54.299734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.674827+0000","last_change":"2023-11-04T01:44:27.043124+0000","last_active":"2023-11-04T01:44:28.674827+0000","last_peered":"2023-11-04T01:44:28.674827+0000","last_clean":"2023-11-04T01:44:28.674827+0000","last_became_active":"2023-11-04T01:44:27.042764+0000","last_became_peered":"2023-11-04T01:44:27.042764+0000","last_unstale":"2023-11-04T01:44:28.674827+0000","last_undegraded":"2023-11-04T01:44:28.674827+0000","last_fullsized":"2023-11-04T01:44:28.674827+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:02.499513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573911+0000","last_change":"2023-11-04T01:44:27.057506+0000","last_active":"2023-11-04T01:44:28.573911+0000","last_peered":"2023-11-04T01:44:28.573911+0000","last_clean":"2023-11-04T01:44:28.573911+0000","last_became_active":"2023-11-04T01:44:27.057128+0000","last_became_peered":"2023-11-04T01:44:27.057128+0000","last_unstale":"2023-11-04T01:44:28.573911+0000","last_undegraded":"2023-11-04T01:44:28.573911+0000","last_fullsized":"2023-11-04T01:44:28.573911+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:25:52.415381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.671928+0000","last_change":"2023-11-04T01:44:27.060522+0000","last_active":"2023-11-04T01:44:28.671928+0000","last_peered":"2023-11-04T01:44:28.671928+0000","last_clean":"2023-11-04T01:44:28.671928+0000","last_became_active":"2023-11-04T01:44:27.060199+0000","last_became_peered":"2023-11-04T01:44:27.060199+0000","last_unstale":"2023-11-04T01:44:28.671928+0000","last_undegraded":"2023-11-04T01:44:28.671928+0000","last_fullsized":"2023-11-04T01:44:28.671928+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:48:20.654188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036303+0000","last_change":"2023-11-04T01:44:27.029759+0000","last_active":"2023-11-04T01:44:28.036303+0000","last_peered":"2023-11-04T01:44:28.036303+0000","last_clean":"2023-11-04T01:44:28.036303+0000","last_became_active":"2023-11-04T01:44:27.028395+0000","last_became_peered":"2023-11-04T01:44:27.028395+0000","last_unstale":"2023-11-04T01:44:28.036303+0000","last_undegraded":"2023-11-04T01:44:28.036303+0000","last_fullsized":"2023-11-04T01:44:28.036303+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:27.386935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.037925+0000","last_change":"2023-11-04T01:44:27.040601+0000","last_active":"2023-11-04T01:44:28.037925+0000","last_peered":"2023-11-04T01:44:28.037925+0000","last_clean":"2023-11-04T01:44:28.037925+0000","last_became_active":"2023-11-04T01:44:27.039689+0000","last_became_peered":"2023-11-04T01:44:27.039689+0000","last_unstale":"2023-11-04T01:44:28.037925+0000","last_undegraded":"2023-11-04T01:44:28.037925+0000","last_fullsized":"2023-11-04T01:44:28.037925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:41.237582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672376+0000","last_change":"2023-11-04T01:44:27.060447+0000","last_active":"2023-11-04T01:44:28.672376+0000","last_peered":"2023-11-04T01:44:28.672376+0000","last_clean":"2023-11-04T01:44:28.672376+0000","last_became_active":"2023-11-04T01:44:27.060099+0000","last_became_peered":"2023-11-04T01:44:27.060099+0000","last_unstale":"2023-11-04T01:44:28.672376+0000","last_undegraded":"2023-11-04T01:44:28.672376+0000","last_fullsized":"2023-11-04T01:44:28.672376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:07.823921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574487+0000","last_change":"2023-11-04T01:44:27.043953+0000","last_active":"2023-11-04T01:44:28.574487+0000","last_peered":"2023-11-04T01:44:28.574487+0000","last_clean":"2023-11-04T01:44:28.574487+0000","last_became_active":"2023-11-04T01:44:27.042392+0000","last_became_peered":"2023-11-04T01:44:27.042392+0000","last_unstale":"2023-11-04T01:44:28.574487+0000","last_undegraded":"2023-11-04T01:44:28.574487+0000","last_fullsized":"2023-11-04T01:44:28.574487+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:45.837309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673369+0000","last_change":"2023-11-04T01:44:27.052828+0000","last_active":"2023-11-04T01:44:28.673369+0000","last_peered":"2023-11-04T01:44:28.673369+0000","last_clean":"2023-11-04T01:44:28.673369+0000","last_became_active":"2023-11-04T01:44:27.052507+0000","last_became_peered":"2023-11-04T01:44:27.052507+0000","last_unstale":"2023-11-04T01:44:28.673369+0000","last_undegraded":"2023-11-04T01:44:28.673369+0000","last_fullsized":"2023-11-04T01:44:28.673369+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:08.692973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574027+0000","last_change":"2023-11-04T01:44:27.045225+0000","last_active":"2023-11-04T01:44:28.574027+0000","last_peered":"2023-11-04T01:44:28.574027+0000","last_clean":"2023-11-04T01:44:28.574027+0000","last_became_active":"2023-11-04T01:44:27.044810+0000","last_became_peered":"2023-11-04T01:44:27.044810+0000","last_unstale":"2023-11-04T01:44:28.574027+0000","last_undegraded":"2023-11-04T01:44:28.574027+0000","last_fullsized":"2023-11-04T01:44:28.574027+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:33.388356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574284+0000","last_change":"2023-11-04T01:44:27.051335+0000","last_active":"2023-11-04T01:44:28.574284+0000","last_peered":"2023-11-04T01:44:28.574284+0000","last_clean":"2023-11-04T01:44:28.574284+0000","last_became_active":"2023-11-04T01:44:27.049430+0000","last_became_peered":"2023-11-04T01:44:27.049430+0000","last_unstale":"2023-11-04T01:44:28.574284+0000","last_undegraded":"2023-11-04T01:44:28.574284+0000","last_fullsized":"2023-11-04T01:44:28.574284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:28:54.299734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036277+0000","last_change":"2023-11-04T01:44:27.049255+0000","last_active":"2023-11-04T01:44:28.036277+0000","last_peered":"2023-11-04T01:44:28.036277+0000","last_clean":"2023-11-04T01:44:28.036277+0000","last_became_active":"2023-11-04T01:44:27.048907+0000","last_became_peered":"2023-11-04T01:44:27.048907+0000","last_unstale":"2023-11-04T01:44:28.036277+0000","last_undegraded":"2023-11-04T01:44:28.036277+0000","last_fullsized":"2023-11-04T01:44:28.036277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:08.692973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036267+0000","last_change":"2023-11-04T01:44:27.064002+0000","last_active":"2023-11-04T01:44:28.036267+0000","last_peered":"2023-11-04T01:44:28.036267+0000","last_clean":"2023-11-04T01:44:28.036267+0000","last_became_active":"2023-11-04T01:44:27.063753+0000","last_became_peered":"2023-11-04T01:44:27.063753+0000","last_unstale":"2023-11-04T01:44:28.036267+0000","last_undegraded":"2023-11-04T01:44:28.036267+0000","last_fullsized":"2023-11-04T01:44:28.036267+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:58:35.569491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.670750+0000","last_change":"2023-11-04T01:44:27.052866+0000","last_active":"2023-11-04T01:44:28.670750+0000","last_peered":"2023-11-04T01:44:28.670750+0000","last_clean":"2023-11-04T01:44:28.670750+0000","last_became_active":"2023-11-04T01:44:27.052577+0000","last_became_peered":"2023-11-04T01:44:27.052577+0000","last_unstale":"2023-11-04T01:44:28.670750+0000","last_undegraded":"2023-11-04T01:44:28.670750+0000","last_fullsized":"2023-11-04T01:44:28.670750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:20.909685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672563+0000","last_change":"2023-11-04T01:44:27.066111+0000","last_active":"2023-11-04T01:44:28.672563+0000","last_peered":"2023-11-04T01:44:28.672563+0000","last_clean":"2023-11-04T01:44:28.672563+0000","last_became_active":"2023-11-04T01:44:27.065473+0000","last_became_peered":"2023-11-04T01:44:27.065473+0000","last_unstale":"2023-11-04T01:44:28.672563+0000","last_undegraded":"2023-11-04T01:44:28.672563+0000","last_fullsized":"2023-11-04T01:44:28.672563+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:42:34.720030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.674600+0000","last_change":"2023-11-04T01:44:27.036703+0000","last_active":"2023-11-04T01:44:28.674600+0000","last_peered":"2023-11-04T01:44:28.674600+0000","last_clean":"2023-11-04T01:44:28.674600+0000","last_became_active":"2023-11-04T01:44:27.035025+0000","last_became_peered":"2023-11-04T01:44:27.035025+0000","last_unstale":"2023-11-04T01:44:28.674600+0000","last_undegraded":"2023-11-04T01:44:28.674600+0000","last_fullsized":"2023-11-04T01:44:28.674600+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:54:54.433635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574018+0000","last_change":"2023-11-04T01:44:27.044097+0000","last_active":"2023-11-04T01:44:28.574018+0000","last_peered":"2023-11-04T01:44:28.574018+0000","last_clean":"2023-11-04T01:44:28.574018+0000","last_became_active":"2023-11-04T01:44:27.043708+0000","last_became_peered":"2023-11-04T01:44:27.043708+0000","last_unstale":"2023-11-04T01:44:28.574018+0000","last_undegraded":"2023-11-04T01:44:28.574018+0000","last_fullsized":"2023-11-04T01:44:28.574018+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:27.386935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574265+0000","last_change":"2023-11-04T01:44:27.041766+0000","last_active":"2023-11-04T01:44:28.574265+0000","last_peered":"2023-11-04T01:44:28.574265+0000","last_clean":"2023-11-04T01:44:28.574265+0000","last_became_active":"2023-11-04T01:44:27.041345+0000","last_became_peered":"2023-11-04T01:44:27.041345+0000","last_unstale":"2023-11-04T01:44:28.574265+0000","last_undegraded":"2023-11-04T01:44:28.574265+0000","last_fullsized":"2023-11-04T01:44:28.574265+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:30.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673546+0000","last_change":"2023-11-04T01:44:27.057408+0000","last_active":"2023-11-04T01:44:28.673546+0000","last_peered":"2023-11-04T01:44:28.673546+0000","last_clean":"2023-11-04T01:44:28.673546+0000","last_became_active":"2023-11-04T01:44:27.056798+0000","last_became_peered":"2023-11-04T01:44:27.056798+0000","last_unstale":"2023-11-04T01:44:28.673546+0000","last_undegraded":"2023-11-04T01:44:28.673546+0000","last_fullsized":"2023-11-04T01:44:28.673546+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:13:44.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036005+0000","last_change":"2023-11-04T01:44:27.038469+0000","last_active":"2023-11-04T01:44:28.036005+0000","last_peered":"2023-11-04T01:44:28.036005+0000","last_clean":"2023-11-04T01:44:28.036005+0000","last_became_active":"2023-11-04T01:44:27.037759+0000","last_became_peered":"2023-11-04T01:44:27.037759+0000","last_unstale":"2023-11-04T01:44:28.036005+0000","last_undegraded":"2023-11-04T01:44:28.036005+0000","last_fullsized":"2023-11-04T01:44:28.036005+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:37.718345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036693+0000","last_change":"2023-11-04T01:44:27.029113+0000","last_active":"2023-11-04T01:44:28.036693+0000","last_peered":"2023-11-04T01:44:28.036693+0000","last_clean":"2023-11-04T01:44:28.036693+0000","last_became_active":"2023-11-04T01:44:27.027344+0000","last_became_peered":"2023-11-04T01:44:27.027344+0000","last_unstale":"2023-11-04T01:44:28.036693+0000","last_undegraded":"2023-11-04T01:44:28.036693+0000","last_fullsized":"2023-11-04T01:44:28.036693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:44.281749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672615+0000","last_change":"2023-11-04T01:44:27.064240+0000","last_active":"2023-11-04T01:44:28.672615+0000","last_peered":"2023-11-04T01:44:28.672615+0000","last_clean":"2023-11-04T01:44:28.672615+0000","last_became_active":"2023-11-04T01:44:27.063726+0000","last_became_peered":"2023-11-04T01:44:27.063726+0000","last_unstale":"2023-11-04T01:44:28.672615+0000","last_undegraded":"2023-11-04T01:44:28.672615+0000","last_fullsized":"2023-11-04T01:44:28.672615+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:58.046159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672630+0000","last_change":"2023-11-04T01:44:27.070189+0000","last_active":"2023-11-04T01:44:28.672630+0000","last_peered":"2023-11-04T01:44:28.672630+0000","last_clean":"2023-11-04T01:44:28.672630+0000","last_became_active":"2023-11-04T01:44:27.069942+0000","last_became_peered":"2023-11-04T01:44:27.069942+0000","last_unstale":"2023-11-04T01:44:28.672630+0000","last_undegraded":"2023-11-04T01:44:28.672630+0000","last_fullsized":"2023-11-04T01:44:28.672630+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:01.423315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.037153+0000","last_change":"2023-11-04T01:44:27.057609+0000","last_active":"2023-11-04T01:44:28.037153+0000","last_peered":"2023-11-04T01:44:28.037153+0000","last_clean":"2023-11-04T01:44:28.037153+0000","last_became_active":"2023-11-04T01:44:27.057311+0000","last_became_peered":"2023-11-04T01:44:27.057311+0000","last_unstale":"2023-11-04T01:44:28.037153+0000","last_undegraded":"2023-11-04T01:44:28.037153+0000","last_fullsized":"2023-11-04T01:44:28.037153+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:46.392493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673266+0000","last_change":"2023-11-04T01:44:27.054211+0000","last_active":"2023-11-04T01:44:28.673266+0000","last_peered":"2023-11-04T01:44:28.673266+0000","last_clean":"2023-11-04T01:44:28.673266+0000","last_became_active":"2023-11-04T01:44:27.053482+0000","last_became_peered":"2023-11-04T01:44:27.053482+0000","last_unstale":"2023-11-04T01:44:28.673266+0000","last_undegraded":"2023-11-04T01:44:28.673266+0000","last_fullsized":"2023-11-04T01:44:28.673266+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:12.035593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036663+0000","last_change":"2023-11-04T01:44:27.028106+0000","last_active":"2023-11-04T01:44:28.036663+0000","last_peered":"2023-11-04T01:44:28.036663+0000","last_clean":"2023-11-04T01:44:28.036663+0000","last_became_active":"2023-11-04T01:44:27.027260+0000","last_became_peered":"2023-11-04T01:44:27.027260+0000","last_unstale":"2023-11-04T01:44:28.036663+0000","last_undegraded":"2023-11-04T01:44:28.036663+0000","last_fullsized":"2023-11-04T01:44:28.036663+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:46.875174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.039162+0000","last_change":"2023-11-04T01:44:27.053908+0000","last_active":"2023-11-04T01:44:28.039162+0000","last_peered":"2023-11-04T01:44:28.039162+0000","last_clean":"2023-11-04T01:44:28.039162+0000","last_became_active":"2023-11-04T01:44:27.053169+0000","last_became_peered":"2023-11-04T01:44:27.053169+0000","last_unstale":"2023-11-04T01:44:28.039162+0000","last_undegraded":"2023-11-04T01:44:28.039162+0000","last_fullsized":"2023-11-04T01:44:28.039162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:59:12.998143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574075+0000","last_change":"2023-11-04T01:44:27.050966+0000","last_active":"2023-11-04T01:44:28.574075+0000","last_peered":"2023-11-04T01:44:28.574075+0000","last_clean":"2023-11-04T01:44:28.574075+0000","last_became_active":"2023-11-04T01:44:27.040373+0000","last_became_peered":"2023-11-04T01:44:27.040373+0000","last_unstale":"2023-11-04T01:44:28.574075+0000","last_undegraded":"2023-11-04T01:44:28.574075+0000","last_fullsized":"2023-11-04T01:44:28.574075+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:44.281749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573689+0000","last_change":"2023-11-04T01:44:27.048015+0000","last_active":"2023-11-04T01:44:28.573689+0000","last_peered":"2023-11-04T01:44:28.573689+0000","last_clean":"2023-11-04T01:44:28.573689+0000","last_became_active":"2023-11-04T01:44:27.044893+0000","last_became_peered":"2023-11-04T01:44:27.044893+0000","last_unstale":"2023-11-04T01:44:28.573689+0000","last_undegraded":"2023-11-04T01:44:28.573689+0000","last_fullsized":"2023-11-04T01:44:28.573689+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:44.657798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.671628+0000","last_change":"2023-11-04T01:44:27.065887+0000","last_active":"2023-11-04T01:44:28.671628+0000","last_peered":"2023-11-04T01:44:28.671628+0000","last_clean":"2023-11-04T01:44:28.671628+0000","last_became_active":"2023-11-04T01:44:27.065560+0000","last_became_peered":"2023-11-04T01:44:27.065560+0000","last_unstale":"2023-11-04T01:44:28.671628+0000","last_undegraded":"2023-11-04T01:44:28.671628+0000","last_fullsized":"2023-11-04T01:44:28.671628+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:19.068122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.037901+0000","last_change":"2023-11-04T01:44:27.031564+0000","last_active":"2023-11-04T01:44:28.037901+0000","last_peered":"2023-11-04T01:44:28.037901+0000","last_clean":"2023-11-04T01:44:28.037901+0000","last_became_active":"2023-11-04T01:44:27.030802+0000","last_became_peered":"2023-11-04T01:44:27.030802+0000","last_unstale":"2023-11-04T01:44:28.037901+0000","last_undegraded":"2023-11-04T01:44:28.037901+0000","last_fullsized":"2023-11-04T01:44:28.037901+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:08:02.261442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.671338+0000","last_change":"2023-11-04T01:44:27.058856+0000","last_active":"2023-11-04T01:44:28.671338+0000","last_peered":"2023-11-04T01:44:28.671338+0000","last_clean":"2023-11-04T01:44:28.671338+0000","last_became_active":"2023-11-04T01:44:27.058540+0000","last_became_peered":"2023-11-04T01:44:27.058540+0000","last_unstale":"2023-11-04T01:44:28.671338+0000","last_undegraded":"2023-11-04T01:44:28.671338+0000","last_fullsized":"2023-11-04T01:44:28.671338+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:53.563426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.007021+0000","last_change":"2023-11-04T01:44:26.018471+0000","last_active":"2023-11-04T01:44:27.007021+0000","last_peered":"2023-11-04T01:44:27.007021+0000","last_clean":"2023-11-04T01:44:27.007021+0000","last_became_active":"2023-11-04T01:44:26.017029+0000","last_became_peered":"2023-11-04T01:44:26.017029+0000","last_unstale":"2023-11-04T01:44:27.007021+0000","last_undegraded":"2023-11-04T01:44:27.007021+0000","last_fullsized":"2023-11-04T01:44:27.007021+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:56.757875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.017575+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:44:27.017575+0000","last_peered":"2023-11-04T01:44:27.017575+0000","last_clean":"2023-11-04T01:44:27.017575+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:44:27.017575+0000","last_undegraded":"2023-11-04T01:44:27.017575+0000","last_fullsized":"2023-11-04T01:44:27.017575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.032416+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:44:27.032416+0000","last_peered":"2023-11-04T01:44:27.032416+0000","last_clean":"2023-11-04T01:44:27.032416+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:44:27.032416+0000","last_undegraded":"2023-11-04T01:44:27.032416+0000","last_fullsized":"2023-11-04T01:44:27.032416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036532+0000","last_change":"2023-11-04T01:44:27.037327+0000","last_active":"2023-11-04T01:44:28.036532+0000","last_peered":"2023-11-04T01:44:28.036532+0000","last_clean":"2023-11-04T01:44:28.036532+0000","last_became_active":"2023-11-04T01:44:27.037013+0000","last_became_peered":"2023-11-04T01:44:27.037013+0000","last_unstale":"2023-11-04T01:44:28.036532+0000","last_undegraded":"2023-11-04T01:44:28.036532+0000","last_fullsized":"2023-11-04T01:44:28.036532+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:35:28.940394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.066414+0000","last_change":"2023-11-04T01:44:26.011842+0000","last_active":"2023-11-04T01:44:27.066414+0000","last_peered":"2023-11-04T01:44:27.066414+0000","last_clean":"2023-11-04T01:44:27.066414+0000","last_became_active":"2023-11-04T01:44:26.011474+0000","last_became_peered":"2023-11-04T01:44:26.011474+0000","last_unstale":"2023-11-04T01:44:27.066414+0000","last_undegraded":"2023-11-04T01:44:27.066414+0000","last_fullsized":"2023-11-04T01:44:27.066414+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:33:32.606899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025022+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:44:27.025022+0000","last_peered":"2023-11-04T01:44:27.025022+0000","last_clean":"2023-11-04T01:44:27.025022+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:44:27.025022+0000","last_undegraded":"2023-11-04T01:44:27.025022+0000","last_fullsized":"2023-11-04T01:44:27.025022+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673944+0000","last_change":"2023-11-04T01:44:27.055046+0000","last_active":"2023-11-04T01:44:28.673944+0000","last_peered":"2023-11-04T01:44:28.673944+0000","last_clean":"2023-11-04T01:44:28.673944+0000","last_became_active":"2023-11-04T01:44:27.054761+0000","last_became_peered":"2023-11-04T01:44:27.054761+0000","last_unstale":"2023-11-04T01:44:28.673944+0000","last_undegraded":"2023-11-04T01:44:28.673944+0000","last_fullsized":"2023-11-04T01:44:28.673944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:48:27.680782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025614+0000","last_change":"2023-11-04T01:44:26.013177+0000","last_active":"2023-11-04T01:44:27.025614+0000","last_peered":"2023-11-04T01:44:27.025614+0000","last_clean":"2023-11-04T01:44:27.025614+0000","last_became_active":"2023-11-04T01:44:26.012329+0000","last_became_peered":"2023-11-04T01:44:26.012329+0000","last_unstale":"2023-11-04T01:44:27.025614+0000","last_undegraded":"2023-11-04T01:44:27.025614+0000","last_fullsized":"2023-11-04T01:44:27.025614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:47:31.333688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010322+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:44:27.010322+0000","last_peered":"2023-11-04T01:44:27.010322+0000","last_clean":"2023-11-04T01:44:27.010322+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:44:27.010322+0000","last_undegraded":"2023-11-04T01:44:27.010322+0000","last_fullsized":"2023-11-04T01:44:27.010322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574760+0000","last_change":"2023-11-04T01:44:27.051035+0000","last_active":"2023-11-04T01:44:28.574760+0000","last_peered":"2023-11-04T01:44:28.574760+0000","last_clean":"2023-11-04T01:44:28.574760+0000","last_became_active":"2023-11-04T01:44:27.048940+0000","last_became_peered":"2023-11-04T01:44:27.048940+0000","last_unstale":"2023-11-04T01:44:28.574760+0000","last_undegraded":"2023-11-04T01:44:28.574760+0000","last_fullsized":"2023-11-04T01:44:28.574760+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:18.346134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.061458+0000","last_change":"2023-11-04T01:44:26.022462+0000","last_active":"2023-11-04T01:44:27.061458+0000","last_peered":"2023-11-04T01:44:27.061458+0000","last_clean":"2023-11-04T01:44:27.061458+0000","last_became_active":"2023-11-04T01:44:26.022072+0000","last_became_peered":"2023-11-04T01:44:26.022072+0000","last_unstale":"2023-11-04T01:44:27.061458+0000","last_undegraded":"2023-11-04T01:44:27.061458+0000","last_fullsized":"2023-11-04T01:44:27.061458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:40.681695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.033794+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:44:27.033794+0000","last_peered":"2023-11-04T01:44:27.033794+0000","last_clean":"2023-11-04T01:44:27.033794+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:44:27.033794+0000","last_undegraded":"2023-11-04T01:44:27.033794+0000","last_fullsized":"2023-11-04T01:44:27.033794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036744+0000","last_change":"2023-11-04T01:44:27.038599+0000","last_active":"2023-11-04T01:44:28.036744+0000","last_peered":"2023-11-04T01:44:28.036744+0000","last_clean":"2023-11-04T01:44:28.036744+0000","last_became_active":"2023-11-04T01:44:27.038034+0000","last_became_peered":"2023-11-04T01:44:27.038034+0000","last_unstale":"2023-11-04T01:44:28.036744+0000","last_undegraded":"2023-11-04T01:44:28.036744+0000","last_fullsized":"2023-11-04T01:44:28.036744+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:27.519376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.066385+0000","last_change":"2023-11-04T01:44:25.995503+0000","last_active":"2023-11-04T01:44:27.066385+0000","last_peered":"2023-11-04T01:44:27.066385+0000","last_clean":"2023-11-04T01:44:27.066385+0000","last_became_active":"2023-11-04T01:44:25.994813+0000","last_became_peered":"2023-11-04T01:44:25.994813+0000","last_unstale":"2023-11-04T01:44:27.066385+0000","last_undegraded":"2023-11-04T01:44:27.066385+0000","last_fullsized":"2023-11-04T01:44:27.066385+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:11:55.446895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010770+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:44:27.010770+0000","last_peered":"2023-11-04T01:44:27.010770+0000","last_clean":"2023-11-04T01:44:27.010770+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:44:27.010770+0000","last_undegraded":"2023-11-04T01:44:27.010770+0000","last_fullsized":"2023-11-04T01:44:27.010770+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573721+0000","last_change":"2023-11-04T01:44:27.057608+0000","last_active":"2023-11-04T01:44:28.573721+0000","last_peered":"2023-11-04T01:44:28.573721+0000","last_clean":"2023-11-04T01:44:28.573721+0000","last_became_active":"2023-11-04T01:44:27.057099+0000","last_became_peered":"2023-11-04T01:44:27.057099+0000","last_unstale":"2023-11-04T01:44:28.573721+0000","last_undegraded":"2023-11-04T01:44:28.573721+0000","last_fullsized":"2023-11-04T01:44:28.573721+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:23.782701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.006506+0000","last_change":"2023-11-04T01:44:26.014777+0000","last_active":"2023-11-04T01:44:27.006506+0000","last_peered":"2023-11-04T01:44:27.006506+0000","last_clean":"2023-11-04T01:44:27.006506+0000","last_became_active":"2023-11-04T01:44:26.004670+0000","last_became_peered":"2023-11-04T01:44:26.004670+0000","last_unstale":"2023-11-04T01:44:27.006506+0000","last_undegraded":"2023-11-04T01:44:27.006506+0000","last_fullsized":"2023-11-04T01:44:27.006506+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:29:07.306028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.014614+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:44:27.014614+0000","last_peered":"2023-11-04T01:44:27.014614+0000","last_clean":"2023-11-04T01:44:27.014614+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:44:27.014614+0000","last_undegraded":"2023-11-04T01:44:27.014614+0000","last_fullsized":"2023-11-04T01:44:27.014614+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.035852+0000","last_change":"2023-11-04T01:44:27.029410+0000","last_active":"2023-11-04T01:44:28.035852+0000","last_peered":"2023-11-04T01:44:28.035852+0000","last_clean":"2023-11-04T01:44:28.035852+0000","last_became_active":"2023-11-04T01:44:27.028521+0000","last_became_peered":"2023-11-04T01:44:27.028521+0000","last_unstale":"2023-11-04T01:44:28.035852+0000","last_undegraded":"2023-11-04T01:44:28.035852+0000","last_fullsized":"2023-11-04T01:44:28.035852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:25:52.415381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.055635+0000","last_change":"2023-11-04T01:44:26.020940+0000","last_active":"2023-11-04T01:44:27.055635+0000","last_peered":"2023-11-04T01:44:27.055635+0000","last_clean":"2023-11-04T01:44:27.055635+0000","last_became_active":"2023-11-04T01:44:26.017653+0000","last_became_peered":"2023-11-04T01:44:26.017653+0000","last_unstale":"2023-11-04T01:44:27.055635+0000","last_undegraded":"2023-11-04T01:44:27.055635+0000","last_fullsized":"2023-11-04T01:44:27.055635+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:06.640627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.029055+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:44:27.029055+0000","last_peered":"2023-11-04T01:44:27.029055+0000","last_clean":"2023-11-04T01:44:27.029055+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:44:27.029055+0000","last_undegraded":"2023-11-04T01:44:27.029055+0000","last_fullsized":"2023-11-04T01:44:27.029055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.035944+0000","last_change":"2023-11-04T01:44:27.037075+0000","last_active":"2023-11-04T01:44:28.035944+0000","last_peered":"2023-11-04T01:44:28.035944+0000","last_clean":"2023-11-04T01:44:28.035944+0000","last_became_active":"2023-11-04T01:44:27.036579+0000","last_became_peered":"2023-11-04T01:44:27.036579+0000","last_unstale":"2023-11-04T01:44:28.035944+0000","last_undegraded":"2023-11-04T01:44:28.035944+0000","last_fullsized":"2023-11-04T01:44:28.035944+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:47.147039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.020647+0000","last_change":"2023-11-04T01:44:26.023958+0000","last_active":"2023-11-04T01:44:27.020647+0000","last_peered":"2023-11-04T01:44:27.020647+0000","last_clean":"2023-11-04T01:44:27.020647+0000","last_became_active":"2023-11-04T01:44:26.023597+0000","last_became_peered":"2023-11-04T01:44:26.023597+0000","last_unstale":"2023-11-04T01:44:27.020647+0000","last_undegraded":"2023-11-04T01:44:27.020647+0000","last_fullsized":"2023-11-04T01:44:27.020647+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:52:10.185654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010627+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:44:27.010627+0000","last_peered":"2023-11-04T01:44:27.010627+0000","last_clean":"2023-11-04T01:44:27.010627+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:44:27.010627+0000","last_undegraded":"2023-11-04T01:44:27.010627+0000","last_fullsized":"2023-11-04T01:44:27.010627+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673628+0000","last_change":"2023-11-04T01:44:27.041913+0000","last_active":"2023-11-04T01:44:28.673628+0000","last_peered":"2023-11-04T01:44:28.673628+0000","last_clean":"2023-11-04T01:44:28.673628+0000","last_became_active":"2023-11-04T01:44:27.041605+0000","last_became_peered":"2023-11-04T01:44:27.041605+0000","last_unstale":"2023-11-04T01:44:28.673628+0000","last_undegraded":"2023-11-04T01:44:28.673628+0000","last_fullsized":"2023-11-04T01:44:28.673628+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:15.224935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.013840+0000","last_change":"2023-11-04T01:44:26.016783+0000","last_active":"2023-11-04T01:44:27.013840+0000","last_peered":"2023-11-04T01:44:27.013840+0000","last_clean":"2023-11-04T01:44:27.013840+0000","last_became_active":"2023-11-04T01:44:26.015926+0000","last_became_peered":"2023-11-04T01:44:26.015926+0000","last_unstale":"2023-11-04T01:44:27.013840+0000","last_undegraded":"2023-11-04T01:44:27.013840+0000","last_fullsized":"2023-11-04T01:44:27.013840+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:49:01.586496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.009610+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:44:27.009610+0000","last_peered":"2023-11-04T01:44:27.009610+0000","last_clean":"2023-11-04T01:44:27.009610+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:44:27.009610+0000","last_undegraded":"2023-11-04T01:44:27.009610+0000","last_fullsized":"2023-11-04T01:44:27.009610+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.674184+0000","last_change":"2023-11-04T01:44:27.055066+0000","last_active":"2023-11-04T01:44:28.674184+0000","last_peered":"2023-11-04T01:44:28.674184+0000","last_clean":"2023-11-04T01:44:28.674184+0000","last_became_active":"2023-11-04T01:44:27.054789+0000","last_became_peered":"2023-11-04T01:44:27.054789+0000","last_unstale":"2023-11-04T01:44:28.674184+0000","last_undegraded":"2023-11-04T01:44:28.674184+0000","last_fullsized":"2023-11-04T01:44:28.674184+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:45.720996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.028847+0000","last_change":"2023-11-04T01:44:26.013417+0000","last_active":"2023-11-04T01:44:27.028847+0000","last_peered":"2023-11-04T01:44:27.028847+0000","last_clean":"2023-11-04T01:44:27.028847+0000","last_became_active":"2023-11-04T01:44:26.012615+0000","last_became_peered":"2023-11-04T01:44:26.012615+0000","last_unstale":"2023-11-04T01:44:27.028847+0000","last_undegraded":"2023-11-04T01:44:27.028847+0000","last_fullsized":"2023-11-04T01:44:27.028847+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:10:55.082546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.026358+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:44:27.026358+0000","last_peered":"2023-11-04T01:44:27.026358+0000","last_clean":"2023-11-04T01:44:27.026358+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:44:27.026358+0000","last_undegraded":"2023-11-04T01:44:27.026358+0000","last_fullsized":"2023-11-04T01:44:27.026358+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673562+0000","last_change":"2023-11-04T01:44:27.037096+0000","last_active":"2023-11-04T01:44:28.673562+0000","last_peered":"2023-11-04T01:44:28.673562+0000","last_clean":"2023-11-04T01:44:28.673562+0000","last_became_active":"2023-11-04T01:44:27.036350+0000","last_became_peered":"2023-11-04T01:44:27.036350+0000","last_unstale":"2023-11-04T01:44:28.673562+0000","last_undegraded":"2023-11-04T01:44:28.673562+0000","last_fullsized":"2023-11-04T01:44:28.673562+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:01:35.786647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.059639+0000","last_change":"2023-11-04T01:44:25.998359+0000","last_active":"2023-11-04T01:44:27.059639+0000","last_peered":"2023-11-04T01:44:27.059639+0000","last_clean":"2023-11-04T01:44:27.059639+0000","last_became_active":"2023-11-04T01:44:25.998013+0000","last_became_peered":"2023-11-04T01:44:25.998013+0000","last_unstale":"2023-11-04T01:44:27.059639+0000","last_undegraded":"2023-11-04T01:44:27.059639+0000","last_fullsized":"2023-11-04T01:44:27.059639+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:16.045226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.033851+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:44:27.033851+0000","last_peered":"2023-11-04T01:44:27.033851+0000","last_clean":"2023-11-04T01:44:27.033851+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:44:27.033851+0000","last_undegraded":"2023-11-04T01:44:27.033851+0000","last_fullsized":"2023-11-04T01:44:27.033851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673779+0000","last_change":"2023-11-04T01:44:27.035791+0000","last_active":"2023-11-04T01:44:28.673779+0000","last_peered":"2023-11-04T01:44:28.673779+0000","last_clean":"2023-11-04T01:44:28.673779+0000","last_became_active":"2023-11-04T01:44:27.034980+0000","last_became_peered":"2023-11-04T01:44:27.034980+0000","last_unstale":"2023-11-04T01:44:28.673779+0000","last_undegraded":"2023-11-04T01:44:28.673779+0000","last_fullsized":"2023-11-04T01:44:28.673779+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:59:21.849993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.042513+0000","last_change":"2023-11-04T01:44:25.999138+0000","last_active":"2023-11-04T01:44:27.042513+0000","last_peered":"2023-11-04T01:44:27.042513+0000","last_clean":"2023-11-04T01:44:27.042513+0000","last_became_active":"2023-11-04T01:44:25.998861+0000","last_became_peered":"2023-11-04T01:44:25.998861+0000","last_unstale":"2023-11-04T01:44:27.042513+0000","last_undegraded":"2023-11-04T01:44:27.042513+0000","last_fullsized":"2023-11-04T01:44:27.042513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:54.219992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.021453+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:44:27.021453+0000","last_peered":"2023-11-04T01:44:27.021453+0000","last_clean":"2023-11-04T01:44:27.021453+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:44:27.021453+0000","last_undegraded":"2023-11-04T01:44:27.021453+0000","last_fullsized":"2023-11-04T01:44:27.021453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036430+0000","last_change":"2023-11-04T01:44:27.049197+0000","last_active":"2023-11-04T01:44:28.036430+0000","last_peered":"2023-11-04T01:44:28.036430+0000","last_clean":"2023-11-04T01:44:28.036430+0000","last_became_active":"2023-11-04T01:44:27.048457+0000","last_became_peered":"2023-11-04T01:44:27.048457+0000","last_unstale":"2023-11-04T01:44:28.036430+0000","last_undegraded":"2023-11-04T01:44:28.036430+0000","last_fullsized":"2023-11-04T01:44:28.036430+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:33.388356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.030278+0000","last_change":"2023-11-04T01:44:26.015137+0000","last_active":"2023-11-04T01:44:27.030278+0000","last_peered":"2023-11-04T01:44:27.030278+0000","last_clean":"2023-11-04T01:44:27.030278+0000","last_became_active":"2023-11-04T01:44:26.014332+0000","last_became_peered":"2023-11-04T01:44:26.014332+0000","last_unstale":"2023-11-04T01:44:27.030278+0000","last_undegraded":"2023-11-04T01:44:27.030278+0000","last_fullsized":"2023-11-04T01:44:27.030278+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:40:50.202133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.020452+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:44:27.020452+0000","last_peered":"2023-11-04T01:44:27.020452+0000","last_clean":"2023-11-04T01:44:27.020452+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:44:27.020452+0000","last_undegraded":"2023-11-04T01:44:27.020452+0000","last_fullsized":"2023-11-04T01:44:27.020452+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673978+0000","last_change":"2023-11-04T01:44:27.055992+0000","last_active":"2023-11-04T01:44:28.673978+0000","last_peered":"2023-11-04T01:44:28.673978+0000","last_clean":"2023-11-04T01:44:28.673978+0000","last_became_active":"2023-11-04T01:44:27.055289+0000","last_became_peered":"2023-11-04T01:44:27.055289+0000","last_unstale":"2023-11-04T01:44:28.673978+0000","last_undegraded":"2023-11-04T01:44:28.673978+0000","last_fullsized":"2023-11-04T01:44:28.673978+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:33:24.425794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.006456+0000","last_change":"2023-11-04T01:44:26.017617+0000","last_active":"2023-11-04T01:44:27.006456+0000","last_peered":"2023-11-04T01:44:27.006456+0000","last_clean":"2023-11-04T01:44:27.006456+0000","last_became_active":"2023-11-04T01:44:26.016431+0000","last_became_peered":"2023-11-04T01:44:26.016431+0000","last_unstale":"2023-11-04T01:44:27.006456+0000","last_undegraded":"2023-11-04T01:44:27.006456+0000","last_fullsized":"2023-11-04T01:44:27.006456+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:20.535512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.015089+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:44:27.015089+0000","last_peered":"2023-11-04T01:44:27.015089+0000","last_clean":"2023-11-04T01:44:27.015089+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:44:27.015089+0000","last_undegraded":"2023-11-04T01:44:27.015089+0000","last_fullsized":"2023-11-04T01:44:27.015089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.573437+0000","last_change":"2023-11-04T01:44:27.044206+0000","last_active":"2023-11-04T01:44:28.573437+0000","last_peered":"2023-11-04T01:44:28.573437+0000","last_clean":"2023-11-04T01:44:28.573437+0000","last_became_active":"2023-11-04T01:44:27.043855+0000","last_became_peered":"2023-11-04T01:44:27.043855+0000","last_unstale":"2023-11-04T01:44:28.573437+0000","last_undegraded":"2023-11-04T01:44:28.573437+0000","last_fullsized":"2023-11-04T01:44:28.573437+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:40.660851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.009967+0000","last_change":"2023-11-04T01:44:26.015593+0000","last_active":"2023-11-04T01:44:27.009967+0000","last_peered":"2023-11-04T01:44:27.009967+0000","last_clean":"2023-11-04T01:44:27.009967+0000","last_became_active":"2023-11-04T01:44:26.015226+0000","last_became_peered":"2023-11-04T01:44:26.015226+0000","last_unstale":"2023-11-04T01:44:27.009967+0000","last_undegraded":"2023-11-04T01:44:27.009967+0000","last_fullsized":"2023-11-04T01:44:27.009967+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:00:52.550445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.012040+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:44:27.012040+0000","last_peered":"2023-11-04T01:44:27.012040+0000","last_clean":"2023-11-04T01:44:27.012040+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:44:27.012040+0000","last_undegraded":"2023-11-04T01:44:27.012040+0000","last_fullsized":"2023-11-04T01:44:27.012040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036008+0000","last_change":"2023-11-04T01:44:27.033742+0000","last_active":"2023-11-04T01:44:28.036008+0000","last_peered":"2023-11-04T01:44:28.036008+0000","last_clean":"2023-11-04T01:44:28.036008+0000","last_became_active":"2023-11-04T01:44:27.032940+0000","last_became_peered":"2023-11-04T01:44:27.032940+0000","last_unstale":"2023-11-04T01:44:28.036008+0000","last_undegraded":"2023-11-04T01:44:28.036008+0000","last_fullsized":"2023-11-04T01:44:28.036008+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:05:45.148642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010950+0000","last_change":"2023-11-04T01:44:26.010758+0000","last_active":"2023-11-04T01:44:27.010950+0000","last_peered":"2023-11-04T01:44:27.010950+0000","last_clean":"2023-11-04T01:44:27.010950+0000","last_became_active":"2023-11-04T01:44:26.010004+0000","last_became_peered":"2023-11-04T01:44:26.010004+0000","last_unstale":"2023-11-04T01:44:27.010950+0000","last_undegraded":"2023-11-04T01:44:27.010950+0000","last_fullsized":"2023-11-04T01:44:27.010950+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:12:26.506394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.016378+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:44:27.016378+0000","last_peered":"2023-11-04T01:44:27.016378+0000","last_clean":"2023-11-04T01:44:27.016378+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:44:27.016378+0000","last_undegraded":"2023-11-04T01:44:27.016378+0000","last_fullsized":"2023-11-04T01:44:27.016378+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036829+0000","last_change":"2023-11-04T01:44:27.063722+0000","last_active":"2023-11-04T01:44:28.036829+0000","last_peered":"2023-11-04T01:44:28.036829+0000","last_clean":"2023-11-04T01:44:28.036829+0000","last_became_active":"2023-11-04T01:44:27.062722+0000","last_became_peered":"2023-11-04T01:44:27.062722+0000","last_unstale":"2023-11-04T01:44:28.036829+0000","last_undegraded":"2023-11-04T01:44:28.036829+0000","last_fullsized":"2023-11-04T01:44:28.036829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:30.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.071371+0000","last_change":"2023-11-04T01:44:26.002793+0000","last_active":"2023-11-04T01:44:27.071371+0000","last_peered":"2023-11-04T01:44:27.071371+0000","last_clean":"2023-11-04T01:44:27.071371+0000","last_became_active":"2023-11-04T01:44:26.001964+0000","last_became_peered":"2023-11-04T01:44:26.001964+0000","last_unstale":"2023-11-04T01:44:27.071371+0000","last_undegraded":"2023-11-04T01:44:27.071371+0000","last_fullsized":"2023-11-04T01:44:27.071371+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:47:57.459660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.009961+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:44:27.009961+0000","last_peered":"2023-11-04T01:44:27.009961+0000","last_clean":"2023-11-04T01:44:27.009961+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:44:27.009961+0000","last_undegraded":"2023-11-04T01:44:27.009961+0000","last_fullsized":"2023-11-04T01:44:27.009961+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574625+0000","last_change":"2023-11-04T01:44:27.057689+0000","last_active":"2023-11-04T01:44:28.574625+0000","last_peered":"2023-11-04T01:44:28.574625+0000","last_clean":"2023-11-04T01:44:28.574625+0000","last_became_active":"2023-11-04T01:44:27.057328+0000","last_became_peered":"2023-11-04T01:44:27.057328+0000","last_unstale":"2023-11-04T01:44:28.574625+0000","last_undegraded":"2023-11-04T01:44:28.574625+0000","last_fullsized":"2023-11-04T01:44:28.574625+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:14.728412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.067173+0000","last_change":"2023-11-04T01:44:26.026547+0000","last_active":"2023-11-04T01:44:27.067173+0000","last_peered":"2023-11-04T01:44:27.067173+0000","last_clean":"2023-11-04T01:44:27.067173+0000","last_became_active":"2023-11-04T01:44:26.025889+0000","last_became_peered":"2023-11-04T01:44:26.025889+0000","last_unstale":"2023-11-04T01:44:27.067173+0000","last_undegraded":"2023-11-04T01:44:27.067173+0000","last_fullsized":"2023-11-04T01:44:27.067173+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:18:16.332260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025488+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:44:27.025488+0000","last_peered":"2023-11-04T01:44:27.025488+0000","last_clean":"2023-11-04T01:44:27.025488+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:44:27.025488+0000","last_undegraded":"2023-11-04T01:44:27.025488+0000","last_fullsized":"2023-11-04T01:44:27.025488+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.574528+0000","last_change":"2023-11-04T01:44:27.048601+0000","last_active":"2023-11-04T01:44:28.574528+0000","last_peered":"2023-11-04T01:44:28.574528+0000","last_clean":"2023-11-04T01:44:28.574528+0000","last_became_active":"2023-11-04T01:44:27.048139+0000","last_became_peered":"2023-11-04T01:44:27.048139+0000","last_unstale":"2023-11-04T01:44:28.574528+0000","last_undegraded":"2023-11-04T01:44:28.574528+0000","last_fullsized":"2023-11-04T01:44:28.574528+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:06:49.548339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.066894+0000","last_change":"2023-11-04T01:44:26.010837+0000","last_active":"2023-11-04T01:44:27.066894+0000","last_peered":"2023-11-04T01:44:27.066894+0000","last_clean":"2023-11-04T01:44:27.066894+0000","last_became_active":"2023-11-04T01:44:26.010100+0000","last_became_peered":"2023-11-04T01:44:26.010100+0000","last_unstale":"2023-11-04T01:44:27.066894+0000","last_undegraded":"2023-11-04T01:44:27.066894+0000","last_fullsized":"2023-11-04T01:44:27.066894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:04:29.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.020795+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:44:27.020795+0000","last_peered":"2023-11-04T01:44:27.020795+0000","last_clean":"2023-11-04T01:44:27.020795+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:44:27.020795+0000","last_undegraded":"2023-11-04T01:44:27.020795+0000","last_fullsized":"2023-11-04T01:44:27.020795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.675222+0000","last_change":"2023-11-04T01:44:27.059837+0000","last_active":"2023-11-04T01:44:28.675222+0000","last_peered":"2023-11-04T01:44:28.675222+0000","last_clean":"2023-11-04T01:44:28.675222+0000","last_became_active":"2023-11-04T01:44:27.059515+0000","last_became_peered":"2023-11-04T01:44:27.059515+0000","last_unstale":"2023-11-04T01:44:28.675222+0000","last_undegraded":"2023-11-04T01:44:28.675222+0000","last_fullsized":"2023-11-04T01:44:28.675222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:09.370575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.065604+0000","last_change":"2023-11-04T01:44:26.021964+0000","last_active":"2023-11-04T01:44:27.065604+0000","last_peered":"2023-11-04T01:44:27.065604+0000","last_clean":"2023-11-04T01:44:27.065604+0000","last_became_active":"2023-11-04T01:44:26.021274+0000","last_became_peered":"2023-11-04T01:44:26.021274+0000","last_unstale":"2023-11-04T01:44:27.065604+0000","last_undegraded":"2023-11-04T01:44:27.065604+0000","last_fullsized":"2023-11-04T01:44:27.065604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:03:45.379512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010542+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:44:27.010542+0000","last_peered":"2023-11-04T01:44:27.010542+0000","last_clean":"2023-11-04T01:44:27.010542+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:44:27.010542+0000","last_undegraded":"2023-11-04T01:44:27.010542+0000","last_fullsized":"2023-11-04T01:44:27.010542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.672237+0000","last_change":"2023-11-04T01:44:27.046701+0000","last_active":"2023-11-04T01:44:28.672237+0000","last_peered":"2023-11-04T01:44:28.672237+0000","last_clean":"2023-11-04T01:44:28.672237+0000","last_became_active":"2023-11-04T01:44:27.046332+0000","last_became_peered":"2023-11-04T01:44:27.046332+0000","last_unstale":"2023-11-04T01:44:28.672237+0000","last_undegraded":"2023-11-04T01:44:28.672237+0000","last_fullsized":"2023-11-04T01:44:28.672237+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:00:37.718345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.010096+0000","last_change":"2023-11-04T01:44:26.010580+0000","last_active":"2023-11-04T01:44:27.010096+0000","last_peered":"2023-11-04T01:44:27.010096+0000","last_clean":"2023-11-04T01:44:27.010096+0000","last_became_active":"2023-11-04T01:44:26.009725+0000","last_became_peered":"2023-11-04T01:44:26.009725+0000","last_unstale":"2023-11-04T01:44:27.010096+0000","last_undegraded":"2023-11-04T01:44:27.010096+0000","last_fullsized":"2023-11-04T01:44:27.010096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:08:45.862193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.025094+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:44:27.025094+0000","last_peered":"2023-11-04T01:44:27.025094+0000","last_clean":"2023-11-04T01:44:27.025094+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:44:27.025094+0000","last_undegraded":"2023-11-04T01:44:27.025094+0000","last_fullsized":"2023-11-04T01:44:27.025094+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673707+0000","last_change":"2023-11-04T01:44:27.057858+0000","last_active":"2023-11-04T01:44:28.673707+0000","last_peered":"2023-11-04T01:44:28.673707+0000","last_clean":"2023-11-04T01:44:28.673707+0000","last_became_active":"2023-11-04T01:44:27.056968+0000","last_became_peered":"2023-11-04T01:44:27.056968+0000","last_unstale":"2023-11-04T01:44:28.673707+0000","last_undegraded":"2023-11-04T01:44:28.673707+0000","last_fullsized":"2023-11-04T01:44:28.673707+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:35:52.619584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.033303+0000","last_change":"2023-11-04T01:44:26.002476+0000","last_active":"2023-11-04T01:44:27.033303+0000","last_peered":"2023-11-04T01:44:27.033303+0000","last_clean":"2023-11-04T01:44:27.033303+0000","last_became_active":"2023-11-04T01:44:26.002079+0000","last_became_peered":"2023-11-04T01:44:26.002079+0000","last_unstale":"2023-11-04T01:44:27.033303+0000","last_undegraded":"2023-11-04T01:44:27.033303+0000","last_fullsized":"2023-11-04T01:44:27.033303+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:12:56.757875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.024881+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:44:27.024881+0000","last_peered":"2023-11-04T01:44:27.024881+0000","last_clean":"2023-11-04T01:44:27.024881+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:44:27.024881+0000","last_undegraded":"2023-11-04T01:44:27.024881+0000","last_fullsized":"2023-11-04T01:44:27.024881+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673032+0000","last_change":"2023-11-04T01:44:27.063685+0000","last_active":"2023-11-04T01:44:28.673032+0000","last_peered":"2023-11-04T01:44:28.673032+0000","last_clean":"2023-11-04T01:44:28.673032+0000","last_became_active":"2023-11-04T01:44:27.063053+0000","last_became_peered":"2023-11-04T01:44:27.063053+0000","last_unstale":"2023-11-04T01:44:28.673032+0000","last_undegraded":"2023-11-04T01:44:28.673032+0000","last_fullsized":"2023-11-04T01:44:28.673032+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:02:02.822023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.071109+0000","last_change":"2023-11-04T01:44:25.997723+0000","last_active":"2023-11-04T01:44:27.071109+0000","last_peered":"2023-11-04T01:44:27.071109+0000","last_clean":"2023-11-04T01:44:27.071109+0000","last_became_active":"2023-11-04T01:44:25.995153+0000","last_became_peered":"2023-11-04T01:44:25.995153+0000","last_unstale":"2023-11-04T01:44:27.071109+0000","last_undegraded":"2023-11-04T01:44:27.071109+0000","last_fullsized":"2023-11-04T01:44:27.071109+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:29:54.536776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.023362+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:44:27.023362+0000","last_peered":"2023-11-04T01:44:27.023362+0000","last_clean":"2023-11-04T01:44:27.023362+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:44:27.023362+0000","last_undegraded":"2023-11-04T01:44:27.023362+0000","last_fullsized":"2023-11-04T01:44:27.023362+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.038183+0000","last_change":"2023-11-04T01:44:27.039108+0000","last_active":"2023-11-04T01:44:28.038183+0000","last_peered":"2023-11-04T01:44:28.038183+0000","last_clean":"2023-11-04T01:44:28.038183+0000","last_became_active":"2023-11-04T01:44:27.037465+0000","last_became_peered":"2023-11-04T01:44:27.037465+0000","last_unstale":"2023-11-04T01:44:28.038183+0000","last_undegraded":"2023-11-04T01:44:28.038183+0000","last_fullsized":"2023-11-04T01:44:28.038183+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:54:43.895920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.058790+0000","last_change":"2023-11-04T01:44:26.022595+0000","last_active":"2023-11-04T01:44:27.058790+0000","last_peered":"2023-11-04T01:44:27.058790+0000","last_clean":"2023-11-04T01:44:27.058790+0000","last_became_active":"2023-11-04T01:44:26.021907+0000","last_became_peered":"2023-11-04T01:44:26.021907+0000","last_unstale":"2023-11-04T01:44:27.058790+0000","last_undegraded":"2023-11-04T01:44:27.058790+0000","last_fullsized":"2023-11-04T01:44:27.058790+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:21:54.219992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":38,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.042107+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:44:27.042107+0000","last_peered":"2023-11-04T01:44:27.042107+0000","last_clean":"2023-11-04T01:44:27.042107+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:44:27.042107+0000","last_undegraded":"2023-11-04T01:44:27.042107+0000","last_fullsized":"2023-11-04T01:44:27.042107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.036442+0000","last_change":"2023-11-04T01:44:27.034729+0000","last_active":"2023-11-04T01:44:28.036442+0000","last_peered":"2023-11-04T01:44:28.036442+0000","last_clean":"2023-11-04T01:44:28.036442+0000","last_became_active":"2023-11-04T01:44:27.034425+0000","last_became_peered":"2023-11-04T01:44:27.034425+0000","last_unstale":"2023-11-04T01:44:28.036442+0000","last_undegraded":"2023-11-04T01:44:28.036442+0000","last_fullsized":"2023-11-04T01:44:28.036442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:17.830183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.056186+0000","last_change":"2023-11-04T01:44:26.022628+0000","last_active":"2023-11-04T01:44:27.056186+0000","last_peered":"2023-11-04T01:44:27.056186+0000","last_clean":"2023-11-04T01:44:27.056186+0000","last_became_active":"2023-11-04T01:44:26.022154+0000","last_became_peered":"2023-11-04T01:44:26.022154+0000","last_unstale":"2023-11-04T01:44:27.056186+0000","last_undegraded":"2023-11-04T01:44:27.056186+0000","last_fullsized":"2023-11-04T01:44:27.056186+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:11:50.013057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.022278+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:44:27.022278+0000","last_peered":"2023-11-04T01:44:27.022278+0000","last_clean":"2023-11-04T01:44:27.022278+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:44:27.022278+0000","last_undegraded":"2023-11-04T01:44:27.022278+0000","last_fullsized":"2023-11-04T01:44:27.022278+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673768+0000","last_change":"2023-11-04T01:44:27.065790+0000","last_active":"2023-11-04T01:44:28.673768+0000","last_peered":"2023-11-04T01:44:28.673768+0000","last_clean":"2023-11-04T01:44:28.673768+0000","last_became_active":"2023-11-04T01:44:27.065384+0000","last_became_peered":"2023-11-04T01:44:27.065384+0000","last_unstale":"2023-11-04T01:44:28.673768+0000","last_undegraded":"2023-11-04T01:44:28.673768+0000","last_fullsized":"2023-11-04T01:44:28.673768+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:19:33.230335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.073857+0000","last_change":"2023-11-04T01:44:26.026137+0000","last_active":"2023-11-04T01:44:27.073857+0000","last_peered":"2023-11-04T01:44:27.073857+0000","last_clean":"2023-11-04T01:44:27.073857+0000","last_became_active":"2023-11-04T01:44:26.025618+0000","last_became_peered":"2023-11-04T01:44:26.025618+0000","last_unstale":"2023-11-04T01:44:27.073857+0000","last_undegraded":"2023-11-04T01:44:27.073857+0000","last_fullsized":"2023-11-04T01:44:27.073857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:16.045226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.011625+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:44:27.011625+0000","last_peered":"2023-11-04T01:44:27.011625+0000","last_clean":"2023-11-04T01:44:27.011625+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:44:27.011625+0000","last_undegraded":"2023-11-04T01:44:27.011625+0000","last_fullsized":"2023-11-04T01:44:27.011625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.039200+0000","last_change":"2023-11-04T01:44:27.065081+0000","last_active":"2023-11-04T01:44:28.039200+0000","last_peered":"2023-11-04T01:44:28.039200+0000","last_clean":"2023-11-04T01:44:28.039200+0000","last_became_active":"2023-11-04T01:44:27.064420+0000","last_became_peered":"2023-11-04T01:44:27.064420+0000","last_unstale":"2023-11-04T01:44:28.039200+0000","last_undegraded":"2023-11-04T01:44:28.039200+0000","last_fullsized":"2023-11-04T01:44:28.039200+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:21.548494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.043506+0000","last_change":"2023-11-04T01:44:26.022463+0000","last_active":"2023-11-04T01:44:27.043506+0000","last_peered":"2023-11-04T01:44:27.043506+0000","last_clean":"2023-11-04T01:44:27.043506+0000","last_became_active":"2023-11-04T01:44:26.022048+0000","last_became_peered":"2023-11-04T01:44:26.022048+0000","last_unstale":"2023-11-04T01:44:27.043506+0000","last_undegraded":"2023-11-04T01:44:27.043506+0000","last_fullsized":"2023-11-04T01:44:27.043506+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:06.640627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":40,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.021175+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:44:27.021175+0000","last_peered":"2023-11-04T01:44:27.021175+0000","last_clean":"2023-11-04T01:44:27.021175+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:44:27.021175+0000","last_undegraded":"2023-11-04T01:44:27.021175+0000","last_fullsized":"2023-11-04T01:44:27.021175+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.673709+0000","last_change":"2023-11-04T01:44:27.039279+0000","last_active":"2023-11-04T01:44:28.673709+0000","last_peered":"2023-11-04T01:44:28.673709+0000","last_clean":"2023-11-04T01:44:28.673709+0000","last_became_active":"2023-11-04T01:44:27.038477+0000","last_became_peered":"2023-11-04T01:44:27.038477+0000","last_unstale":"2023-11-04T01:44:28.673709+0000","last_undegraded":"2023-11-04T01:44:28.673709+0000","last_fullsized":"2023-11-04T01:44:28.673709+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:38:30.160196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.008946+0000","last_change":"2023-11-04T01:44:25.996467+0000","last_active":"2023-11-04T01:44:27.008946+0000","last_peered":"2023-11-04T01:44:27.008946+0000","last_clean":"2023-11-04T01:44:27.008946+0000","last_became_active":"2023-11-04T01:44:25.995184+0000","last_became_peered":"2023-11-04T01:44:25.995184+0000","last_unstale":"2023-11-04T01:44:27.008946+0000","last_undegraded":"2023-11-04T01:44:27.008946+0000","last_fullsized":"2023-11-04T01:44:27.008946+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:34:23.917009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":43,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.012016+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:44:27.012016+0000","last_peered":"2023-11-04T01:44:27.012016+0000","last_clean":"2023-11-04T01:44:27.012016+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:44:27.012016+0000","last_undegraded":"2023-11-04T01:44:27.012016+0000","last_fullsized":"2023-11-04T01:44:27.012016+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.671448+0000","last_change":"2023-11-04T01:44:27.037307+0000","last_active":"2023-11-04T01:44:28.671448+0000","last_peered":"2023-11-04T01:44:28.671448+0000","last_clean":"2023-11-04T01:44:28.671448+0000","last_became_active":"2023-11-04T01:44:27.036780+0000","last_became_peered":"2023-11-04T01:44:27.036780+0000","last_unstale":"2023-11-04T01:44:28.671448+0000","last_undegraded":"2023-11-04T01:44:28.671448+0000","last_fullsized":"2023-11-04T01:44:28.671448+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:45:47.147039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.032001+0000","last_change":"2023-11-04T01:44:25.998853+0000","last_active":"2023-11-04T01:44:27.032001+0000","last_peered":"2023-11-04T01:44:27.032001+0000","last_clean":"2023-11-04T01:44:27.032001+0000","last_became_active":"2023-11-04T01:44:25.998391+0000","last_became_peered":"2023-11-04T01:44:25.998391+0000","last_unstale":"2023-11-04T01:44:27.032001+0000","last_undegraded":"2023-11-04T01:44:27.032001+0000","last_fullsized":"2023-11-04T01:44:27.032001+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:53.294178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.031785+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:44:27.031785+0000","last_peered":"2023-11-04T01:44:27.031785+0000","last_clean":"2023-11-04T01:44:27.031785+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:44:27.031785+0000","last_undegraded":"2023-11-04T01:44:27.031785+0000","last_fullsized":"2023-11-04T01:44:27.031785+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.038401+0000","last_change":"2023-11-04T01:44:27.041115+0000","last_active":"2023-11-04T01:44:28.038401+0000","last_peered":"2023-11-04T01:44:28.038401+0000","last_clean":"2023-11-04T01:44:28.038401+0000","last_became_active":"2023-11-04T01:44:27.040339+0000","last_became_peered":"2023-11-04T01:44:27.040339+0000","last_unstale":"2023-11-04T01:44:28.038401+0000","last_undegraded":"2023-11-04T01:44:28.038401+0000","last_fullsized":"2023-11-04T01:44:28.038401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:38:54.005900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"63'8","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.057071+0000","last_change":"2023-11-04T01:44:25.991176+0000","last_active":"2023-11-04T01:44:27.057071+0000","last_peered":"2023-11-04T01:44:27.057071+0000","last_clean":"2023-11-04T01:44:27.057071+0000","last_became_active":"2023-11-04T01:44:25.990747+0000","last_became_peered":"2023-11-04T01:44:25.990747+0000","last_unstale":"2023-11-04T01:44:27.057071+0000","last_undegraded":"2023-11-04T01:44:27.057071+0000","last_fullsized":"2023-11-04T01:44:27.057071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:03:36.767190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.012805+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:44:27.012805+0000","last_peered":"2023-11-04T01:44:27.012805+0000","last_clean":"2023-11-04T01:44:27.012805+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:44:27.012805+0000","last_undegraded":"2023-11-04T01:44:27.012805+0000","last_fullsized":"2023-11-04T01:44:27.012805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.670570+0000","last_change":"2023-11-04T01:44:27.036585+0000","last_active":"2023-11-04T01:44:28.670570+0000","last_peered":"2023-11-04T01:44:28.670570+0000","last_clean":"2023-11-04T01:44:28.670570+0000","last_became_active":"2023-11-04T01:44:27.036232+0000","last_became_peered":"2023-11-04T01:44:27.036232+0000","last_unstale":"2023-11-04T01:44:28.670570+0000","last_undegraded":"2023-11-04T01:44:28.670570+0000","last_fullsized":"2023-11-04T01:44:28.670570+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:47.789029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.061436+0000","last_change":"2023-11-04T01:44:25.989387+0000","last_active":"2023-11-04T01:44:27.061436+0000","last_peered":"2023-11-04T01:44:27.061436+0000","last_clean":"2023-11-04T01:44:27.061436+0000","last_became_active":"2023-11-04T01:44:25.988969+0000","last_became_peered":"2023-11-04T01:44:25.988969+0000","last_unstale":"2023-11-04T01:44:27.061436+0000","last_undegraded":"2023-11-04T01:44:27.061436+0000","last_fullsized":"2023-11-04T01:44:27.061436+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:40.596004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":39,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.031606+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:44:27.031606+0000","last_peered":"2023-11-04T01:44:27.031606+0000","last_clean":"2023-11-04T01:44:27.031606+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:44:27.031606+0000","last_undegraded":"2023-11-04T01:44:27.031606+0000","last_fullsized":"2023-11-04T01:44:27.031606+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-04T01:44:28.671053+0000","last_change":"2023-11-04T01:44:27.052266+0000","last_active":"2023-11-04T01:44:28.671053+0000","last_peered":"2023-11-04T01:44:28.671053+0000","last_clean":"2023-11-04T01:44:28.671053+0000","last_became_active":"2023-11-04T01:44:27.051959+0000","last_became_peered":"2023-11-04T01:44:27.051959+0000","last_unstale":"2023-11-04T01:44:28.671053+0000","last_undegraded":"2023-11-04T01:44:28.671053+0000","last_fullsized":"2023-11-04T01:44:28.671053+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:25.963816+0000","last_clean_scrub_stamp":"2023-11-04T01:44:25.963816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:34:24.929990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.020263+0000","last_change":"2023-11-04T01:44:26.005066+0000","last_active":"2023-11-04T01:44:27.020263+0000","last_peered":"2023-11-04T01:44:27.020263+0000","last_clean":"2023-11-04T01:44:27.020263+0000","last_became_active":"2023-11-04T01:44:26.004633+0000","last_became_peered":"2023-11-04T01:44:26.004633+0000","last_unstale":"2023-11-04T01:44:27.020263+0000","last_undegraded":"2023-11-04T01:44:27.020263+0000","last_fullsized":"2023-11-04T01:44:27.020263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:24.950834+0000","last_clean_scrub_stamp":"2023-11-04T01:44:24.950834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:22.412972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":37,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-04T01:44:27.012563+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:44:27.012563+0000","last_peered":"2023-11-04T01:44:27.012563+0000","last_clean":"2023-11-04T01:44:27.012563+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:44:27.012563+0000","last_undegraded":"2023-11-04T01:44:27.012563+0000","last_fullsized":"2023-11-04T01:44:27.012563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1359872,"data_stored":924000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70499999999999996}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.35299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.82299999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.371,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.61199999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.877},"min":{"1min":0.57299999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.65300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3640000000000001,"5min":1.365,"15min":1.365},"last":1.085}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3540000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.238},{"interface":"front","average":{"1min":1.018,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.1819999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.002,"5min":1.0620000000000001,"15min":1.0720000000000001},"min":{"1min":0.70199999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.373,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.3380000000000001}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4159999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.28},{"interface":"front","average":{"1min":1.093,"5min":1.079,"15min":1.077},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.99199999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":333598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.44800000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.143,"5min":1.885,"15min":1.885},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.526,"15min":1.526},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.90700000000000003}]},{"osd":5,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2410000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.84899999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0089999999999999,"15min":1.006},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.73999999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.095,"15min":1.0960000000000001},"min":{"1min":0.628,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.369,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.79500000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542175,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":333598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.89600000000000002},"min":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.276,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.84799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.333,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.78400000000000003}]},{"osd":1,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.875},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.137,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.98599999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.86799999999999999,"15min":0.85699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.147},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1040000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.66500000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90200000000000002},"min":{"1min":0.66700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2989999999999999,"5min":1.514,"15min":1.514},"last":0.94199999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.073,"15min":1.077},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2729999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.232,"5min":2.609,"15min":2.609},"last":1.1140000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.1539999999999999,"15min":1.1759999999999999},"min":{"1min":0.77800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.387,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.125,"5min":2.4529999999999998,"15min":2.6749999999999998},"min":{"1min":0.82899999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3660000000000001,"5min":40.195,"15min":40.195},"last":1.28}]},{"osd":6,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2909999999999999,"15min":1.319},"min":{"1min":0.94699999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2849999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.244},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1399999999999999,"15min":1.1499999999999999},"min":{"1min":0.77000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5529999999999999,"5min":1.637,"15min":1.637},"last":1.177}]}]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":335862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.413,"5min":1.623,"15min":1.623},"last":0.5},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.94699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4039999999999999,"5min":1.724,"15min":1.724},"last":0.70699999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.95399999999999996,"15min":0.96299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.444,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.244,"15min":1.244},"last":0.92900000000000005}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0089999999999999,"15min":1.0169999999999999},"min":{"1min":0.61899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4330000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.871},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.03},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.298,"5min":1.976,"15min":1.976},"last":1.1899999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0049999999999999},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.335,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.099},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.546,"5min":2.161,"15min":2.161},"last":1.2390000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.63,"5min":0.495,"15min":0.495},"max":{"1min":1.333,"5min":1.538,"15min":1.538},"last":1.161},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.1220000000000001},"min":{"1min":0.70199999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.516,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.034}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0600000000000001},"min":{"1min":0.69799999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.204,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.073},{"interface":"front","average":{"1min":1.095,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.484,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":1.214}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8919999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.999},{"interface":"front","average":{"1min":1.075,"5min":1.1060000000000001,"15min":1.111},"min":{"1min":0.83299999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.387,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2609999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1376256,"data_stored":925690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":0.876},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.23,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.86399999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.321,"15min":1.321},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.075}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.28},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3320000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1899999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.874,"15min":0.875},"min":{"1min":0.55600000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.1559999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.024,"5min":0.93600000000000005,"15min":0.92200000000000004},"min":{"1min":0.72599999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.94499999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.98499999999999999,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.343,"5min":1.401,"15min":1.401},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0269999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.90700000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3879999999999999,"5min":1.627,"15min":1.627},"last":1.268},{"interface":"front","average":{"1min":1.198,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":1.026,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.399,"5min":1.526,"15min":1.526},"last":1.1319999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.137,"15min":1.1459999999999999},"min":{"1min":0.81799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.409,"5min":1.49,"15min":1.49},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.22,"15min":1.23},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.496,"5min":1.536,"15min":1.536},"last":1.347}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":765952,"data_stored":334180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":2.8450000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.758,"15min":1.758},"last":4.8150000000000004}]},{"osd":1,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.46,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":4.0919999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.173,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.772}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96499999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":3.4620000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.65900000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1839999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":4.556}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2889999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.927},{"interface":"front","average":{"1min":1,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":1.833,"15min":1.833},"last":4.3319999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3420000000000001,"5min":1.369,"15min":1.369},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.502}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.125},"min":{"1min":0.77200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7410000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.014},"min":{"1min":0.84599999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.4399999999999999,"5min":1.554,"15min":1.554},"last":0.91500000000000004}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.292,"5min":1.417,"15min":1.417},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.202},"min":{"1min":0.96799999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1379999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":333758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85999999999999999,"5min":1.167,"15min":1.167},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.85099999999999998}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.252,"5min":1.429,"15min":1.429},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1890000000000001,"5min":1.252,"15min":1.252},"last":1.254}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4159999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.97999999999999998}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.198},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.335}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.357,"5min":1.369,"15min":1.369},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.069}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.0429999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.115},{"interface":"front","average":{"1min":1.103,"5min":1.0469999999999999,"15min":1.0369999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1579999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542175,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":770048,"data_stored":333654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.0509999999999999}]},{"osd":1,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.81799999999999995,"5min":1.022,"15min":1.022},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.38100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.054,"5min":1.181,"15min":1.181},"last":0.83199999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.411,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":1.1459999999999999}]},{"osd":5,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.879,"15min":0.877},"min":{"1min":0.61299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0980000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2290000000000001,"5min":1.603,"15min":1.603},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.24}]},{"osd":7,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.002,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.377,"5min":1.411,"15min":1.411},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.272,"5min":1.613,"15min":1.613},"last":1.1890000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:44:34.895 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:44:34.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:44:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a684d6640 1 Processor -- start 2023-11-04T01:44:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a684d6640 1 -- start start 2023-11-04T01:44:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a684d6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a600c9cd0 0x7f3a600ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a684d6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6006fc10 con 0x7f3a600caad0 2023-11-04T01:44:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a684d6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a600c8fa0 con 0x7f3a6015af30 2023-11-04T01:44:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a684d6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a600c9840 con 0x7f3a600c9cd0 2023-11-04T01:44:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a65a71640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3a600caad0 0x7f3a600711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54622/0 (socket says 172.21.15.2:54622) 2023-11-04T01:44:35.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a65a71640 1 -- 172.21.15.2:0/1876597336 learned_addr learned my addr 172.21.15.2:0/1876597336 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a66a73640 1 --2- 172.21.15.2:0/1876597336 >> v2:172.21.15.90:3300/0 conn(0x7f3a600c9cd0 0x7f3a600ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253980925 0 0) 0x7f3a6006fc10 con 0x7f3a600caad0 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.067+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a4c003530 con 0x7f3a600caad0 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1237841877 0 0) 0x7f3a4c003530 con 0x7f3a600caad0 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 >> v2:172.21.15.90:3300/0 conn(0x7f3a600c9cd0 msgr2=0x7f3a600ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 --2- 172.21.15.2:0/1876597336 >> v2:172.21.15.90:3300/0 conn(0x7f3a600c9cd0 0x7f3a600ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 >> v1:172.21.15.90:6789/0 conn(0x7f3a6015af30 legacy=0x7f3a600ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6015b310 con 0x7f3a600caad0 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3a5c001680 con 0x7f3a600caad0 2023-11-04T01:44:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 >> v1:172.21.15.2:6789/0 conn(0x7f3a600caad0 legacy=0x7f3a600711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a4c003980 0x7f3a4c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c0047d0 0x7f3a4c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c005190 0x7f3a4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600c9840 con 0x7f3a4c0047d0 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c00c130 con 0x7f3a4c005190 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c00c2f0 con 0x7f3a4c003980 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65a71640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c0047d0 0x7f3a4c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a66272640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a4c003980 0x7f3a4c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a66a73640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c005190 0x7f3a4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65a71640 1 -- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a4c003980 msgr2=0x7f3a4c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65a71640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a4c003980 0x7f3a4c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65a71640 1 -- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c005190 msgr2=0x7f3a4c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65a71640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c005190 0x7f3a4c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65a71640 1 -- 172.21.15.2:0/1876597336 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c003530 con 0x7f3a4c0047d0 2023-11-04T01:44:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a66a73640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c005190 0x7f3a4c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a66a73640 1 -- 172.21.15.2:0/1876597336 reap_dead start 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65a71640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c0047d0 0x7f3a4c004c50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c190 tx=0x7f3a5c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95aaa91e97e1e361 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c005ae0 con 0x7f3a4c0047d0 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c005c40 con 0x7f3a4c0047d0 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a65270640 1 -- 172.21.15.2:0/1876597336 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a5b20 con 0x7f3a4c0047d0 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a684d6640 1 -- 172.21.15.2:0/1876597336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c0047d0 msgr2=0x7f3a4c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.071+0000 7f3a684d6640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c0047d0 0x7f3a4c004c50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c190 tx=0x7f3a5c01cb90 comp rx=0 tx=0).stop 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- 172.21.15.2:0/1876597336 shutdown_connections 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 --2- 172.21.15.2:0/1876597336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a4c0047d0 0x7f3a4c004c50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- 172.21.15.2:0/1876597336 >> 172.21.15.2:0/1876597336 conn(0x7f3a600ce9e0 msgr2=0x7f3a600cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- 172.21.15.2:0/1876597336 shutdown_connections 2023-11-04T01:44:35.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- 172.21.15.2:0/1876597336 wait complete. 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 Processor -- start 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- start start 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c0047d0 0x7f3a600c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a60158680 0x7f3a60157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a601f58c0 0x7f3a600c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600ac930 con 0x7f3a60158680 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600c52b0 con 0x7f3a4c0047d0 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a600c3f50 con 0x7f3a601f58c0 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a60158680 0x7f3a60157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a60158680 0x7f3a60157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40544/0 (socket says 172.21.15.2:40544) 2023-11-04T01:44:35.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 -- 172.21.15.2:0/830995605 learned_addr learned my addr 172.21.15.2:0/830995605 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a66a73640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a601f58c0 0x7f3a600c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a66272640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c0047d0 0x7f3a600c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 -- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a601f58c0 msgr2=0x7f3a600c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a601f58c0 0x7f3a600c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 -- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c0047d0 msgr2=0x7f3a600c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c0047d0 0x7f3a600c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 -- 172.21.15.2:0/830995605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600c4230 con 0x7f3a60158680 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a65a71640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a60158680 0x7f3a60157dd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c001940 tx=0x7f3a4c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a52ffd640 1 -- 172.21.15.2:0/830995605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b4070 con 0x7f3a60158680 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a52ffd640 1 -- 172.21.15.2:0/830995605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c001650 con 0x7f3a60158680 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a600c4510 con 0x7f3a60158680 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a52ffd640 1 -- 172.21.15.2:0/830995605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a5ae0 con 0x7f3a60158680 2023-11-04T01:44:35.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.075+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6015c2c0 con 0x7f3a60158680 2023-11-04T01:44:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.079+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a600744a0 con 0x7f3a60158680 2023-11-04T01:44:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.079+0000 7f3a52ffd640 1 -- 172.21.15.2:0/830995605 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a5c0a5c40 con 0x7f3a60158680 2023-11-04T01:44:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.079+0000 7f3a52ffd640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a440664a0 0x7f3a44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.079+0000 7f3a52ffd640 1 -- 172.21.15.2:0/830995605 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a5c11dad0 con 0x7f3a60158680 2023-11-04T01:44:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.079+0000 7f3a66272640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a440664a0 0x7f3a44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.079+0000 7f3a66272640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a440664a0 0x7f3a44068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a54000f90 tx=0x7f3a54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.083+0000 7f3a52ffd640 1 -- 172.21.15.2:0/830995605 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a5c0ead70 con 0x7f3a60158680 2023-11-04T01:44:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.295+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3a600c94d0 con 0x7f3a60158680 2023-11-04T01:44:35.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.299+0000 7f3a52ffd640 1 -- 172.21.15.2:0/830995605 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3a5c0bf020 con 0x7f3a60158680 2023-11-04T01:44:35.305 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-04T01:44:35.305 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ== 2023-11-04T01:44:35.305 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-04T01:44:35.306 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-04T01:44:35.306 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:44:35.306 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a440664a0 msgr2=0x7f3a44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a440664a0 0x7f3a44068960 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a54000f90 tx=0x7f3a54009040 comp rx=0 tx=0).stop 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a60158680 msgr2=0x7f3a60157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a60158680 0x7f3a60157dd0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c001940 tx=0x7f3a4c005800 comp rx=0 tx=0).stop 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 shutdown_connections 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a440664a0 0x7f3a44068960 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a601f58c0 0x7f3a600c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a60158680 0x7f3a60157dd0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 --2- 172.21.15.2:0/830995605 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a4c0047d0 0x7f3a600c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 >> 172.21.15.2:0/830995605 conn(0x7f3a600ce9e0 msgr2=0x7f3a600cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 shutdown_connections 2023-11-04T01:44:35.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.303+0000 7f3a684d6640 1 -- 172.21.15.2:0/830995605 wait complete. 2023-11-04T01:44:35.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.439+0000 7f0a4bb29640 1 Processor -- start 2023-11-04T01:44:35.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.439+0000 7f0a4bb29640 1 -- start start 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a4bb29640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 0x7f0a4415f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a4bb29640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a440cbe40 con 0x7f0a4415b470 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a4bb29640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a440cc120 con 0x7f0a4415b090 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a4bb29640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4415fca0 con 0x7f0a4406a870 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a490c4640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0a4415b470 0x7f0a440b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54628/0 (socket says 172.21.15.2:54628) 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a490c4640 1 -- 172.21.15.2:0/2970078090 learned_addr learned my addr 172.21.15.2:0/2970078090 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a4a0c6640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 0x7f0a4415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067824785 0 0) 0x7f0a440cbe40 con 0x7f0a4415b470 2023-11-04T01:44:35.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a30003530 con 0x7f0a4415b470 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3746896846 0 0) 0x7f0a30003530 con 0x7f0a4415b470 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 msgr2=0x7f0a4415f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 0x7f0a4415f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 >> v1:172.21.15.90:6789/0 conn(0x7f0a4415b090 legacy=0x7f0a4406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a440cc400 con 0x7f0a4415b470 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f0a340016a0 con 0x7f0a4415b470 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 >> v1:172.21.15.2:6789/0 conn(0x7f0a4415b470 legacy=0x7f0a440b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a300039b0 0x7f0a30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a300047d0 0x7f0a30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 0x7f0a30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4415fca0 con 0x7f0a300039b0 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000bac0 con 0x7f0a300047d0 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000bc80 con 0x7f0a4406a870 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a498c5640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a300039b0 0x7f0a30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a490c4640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a300047d0 0x7f0a30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a4a0c6640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 0x7f0a30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a498c5640 1 -- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 msgr2=0x7f0a30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a498c5640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a4406a870 0x7f0a30005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a498c5640 1 -- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a300047d0 msgr2=0x7f0a30004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a498c5640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a300047d0 0x7f0a30004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a498c5640 1 -- 172.21.15.2:0/2970078090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30003530 con 0x7f0a300039b0 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a498c5640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a300039b0 0x7f0a30003dd0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0a40001e70 tx=0x7f0a4001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7784dcb309592795 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.443+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40003b80 con 0x7f0a300039b0 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40003ce0 con 0x7f0a300039b0 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a488c3640 1 -- 172.21.15.2:0/2970078090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400052c0 con 0x7f0a300039b0 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- 172.21.15.2:0/2970078090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a300039b0 msgr2=0x7f0a30003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 --2- 172.21.15.2:0/2970078090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a300039b0 0x7f0a30003dd0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0a40001e70 tx=0x7f0a4001c730 comp rx=0 tx=0).stop 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 -- 172.21.15.2:0/2970078090 reap_dead start 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- 172.21.15.2:0/2970078090 shutdown_connections 2023-11-04T01:44:35.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- 172.21.15.2:0/2970078090 >> 172.21.15.2:0/2970078090 conn(0x7f0a440716a0 msgr2=0x7f0a44071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- 172.21.15.2:0/2970078090 shutdown_connections 2023-11-04T01:44:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- 172.21.15.2:0/2970078090 wait complete. 2023-11-04T01:44:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 Processor -- start 2023-11-04T01:44:35.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- start start 2023-11-04T01:44:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a44152720 0x7f0a4409a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a4415de10 0x7f0a4406d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a4409a940 0x7f0a4406d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4415c760 con 0x7f0a4409a940 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4415d050 con 0x7f0a4415de10 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4415d330 con 0x7f0a44152720 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a4409a940 0x7f0a4406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a4409a940 0x7f0a4406d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40558/0 (socket says 172.21.15.2:40558) 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 -- 172.21.15.2:0/3875733538 learned_addr learned my addr 172.21.15.2:0/3875733538 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a498c5640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a44152720 0x7f0a4409a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a490c4640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a4415de10 0x7f0a4406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 -- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a44152720 msgr2=0x7f0a4409a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a44152720 0x7f0a4409a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 -- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a4415de10 msgr2=0x7f0a4406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a4415de10 0x7f0a4406d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 -- 172.21.15.2:0/3875733538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4415d610 con 0x7f0a4409a940 2023-11-04T01:44:35.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a498c5640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a44152720 0x7f0a4409a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4a0c6640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a4409a940 0x7f0a4406d550 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0a440aec30 tx=0x7f0a3c011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a3a7fc640 1 -- 172.21.15.2:0/3875733538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c004440 con 0x7f0a4409a940 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a3a7fc640 1 -- 172.21.15.2:0/3875733538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c003620 con 0x7f0a4409a940 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4415d8f0 con 0x7f0a4409a940 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a3a7fc640 1 -- 172.21.15.2:0/3875733538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0039d0 con 0x7f0a4409a940 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.447+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a44153050 con 0x7f0a4409a940 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.451+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4415dae0 con 0x7f0a4409a940 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.451+0000 7f0a3a7fc640 1 -- 172.21.15.2:0/3875733538 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0a3c003b30 con 0x7f0a4409a940 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.451+0000 7f0a3a7fc640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a280664a0 0x7f0a28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:35.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.451+0000 7f0a3a7fc640 1 -- 172.21.15.2:0/3875733538 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a3c084040 con 0x7f0a4409a940 2023-11-04T01:44:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.451+0000 7f0a498c5640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a280664a0 0x7f0a28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:35.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.451+0000 7f0a498c5640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a280664a0 0x7f0a28068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0a40005000 tx=0x7f0a400a9040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:35.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.455+0000 7f0a3a7fc640 1 -- 172.21.15.2:0/3875733538 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0a3c0513f0 con 0x7f0a4409a940 2023-11-04T01:44:35.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.643+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a440675f0 con 0x7f0a4409a940 2023-11-04T01:44:35.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.643+0000 7f0a3a7fc640 1 -- 172.21.15.2:0/3875733538 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f0a3c054a10 con 0x7f0a4409a940 2023-11-04T01:44:35.650 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:35.650 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5518,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3645027182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3645027182},{"type":"v1","addr":"172.21.15.90:6835","nonce":3645027182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1098346949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1098346949},{"type":"v1","addr":"172.21.15.90:6837","nonce":1098346949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/4012044748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4012044748},{"type":"v1","addr":"172.21.15.2:6834","nonce":4012044748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:44:26.337328+0000","modified":"2023-11-04T01:44:28.379532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6171":{"gid":6171,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3559920390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3559920390},{"type":"v1","addr":"172.21.15.2:6835","nonce":3559920390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:44:35.650 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-04T01:44:35.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a280664a0 msgr2=0x7f0a28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a280664a0 0x7f0a28068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0a40005000 tx=0x7f0a400a9040 comp rx=0 tx=0).stop 2023-11-04T01:44:35.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a4409a940 msgr2=0x7f0a4406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:35.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a4409a940 0x7f0a4406d550 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0a440aec30 tx=0x7f0a3c011860 comp rx=0 tx=0).stop 2023-11-04T01:44:35.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 shutdown_connections 2023-11-04T01:44:35.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0a280664a0 0x7f0a28068960 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a4409a940 0x7f0a4406d550 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a4415de10 0x7f0a4406d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 --2- 172.21.15.2:0/3875733538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0a44152720 0x7f0a4409a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 >> 172.21.15.2:0/3875733538 conn(0x7f0a440716a0 msgr2=0x7f0a4406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 shutdown_connections 2023-11-04T01:44:35.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:35.647+0000 7f0a4bb29640 1 -- 172.21.15.2:0/3875733538 wait complete. 2023-11-04T01:44:36.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:44:26.337328+0000', 'modified': '2023-11-04T01:44:28.379532+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6171}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6171': {'gid': 6171, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6835/3559920390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6833', 'nonce': 3559920390}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3559920390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:44:36.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:44:36.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:44:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4c0a8640 1 Processor -- start 2023-11-04T01:44:36.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4c0a8640 1 -- start start 2023-11-04T01:44:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4c0a8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 0x7f5b440b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4c0a8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b440ccee0 con 0x7f5b440ca400 2023-11-04T01:44:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4c0a8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4415a5d0 con 0x7f5b4415a1f0 2023-11-04T01:44:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4c0a8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440ca900 con 0x7f5b440cdea0 2023-11-04T01:44:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4a645640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5b440ca400 0x7f5b440704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54634/0 (socket says 172.21.15.2:54634) 2023-11-04T01:44:36.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b4a645640 1 -- 172.21.15.2:0/542532773 learned_addr learned my addr 172.21.15.2:0/542532773 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:36.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b49643640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 0x7f5b440b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718177857 0 0) 0x7f5b440ccee0 con 0x7f5b440ca400 2023-11-04T01:44:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b30003530 con 0x7f5b440ca400 2023-11-04T01:44:36.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937878929 0 0) 0x7f5b4415a5d0 con 0x7f5b4415a1f0 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b440ccee0 con 0x7f5b4415a1f0 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1602737825 0 0) 0x7f5b30003530 con 0x7f5b440ca400 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 msgr2=0x7f5b440b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 0x7f5b440b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 >> v1:172.21.15.90:6789/0 conn(0x7f5b4415a1f0 legacy=0x7f5b440cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b440cabe0 con 0x7f5b440ca400 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f5b3c001a00 con 0x7f5b440ca400 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 >> v1:172.21.15.2:6789/0 conn(0x7f5b440ca400 legacy=0x7f5b440704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 0x7f5b30003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b300040f0 0x7f5b300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30004d10 0x7f5b30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440ca900 con 0x7f5b300040f0 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3000bad0 con 0x7f5b30004d10 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.199+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3000bc90 con 0x7f5b440cdea0 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49643640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b300040f0 0x7f5b300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49e44640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 0x7f5b30003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4a645640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30004d10 0x7f5b30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49643640 1 -- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 msgr2=0x7f5b30003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49643640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 0x7f5b30003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49643640 1 -- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30004d10 msgr2=0x7f5b30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49643640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30004d10 0x7f5b30005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49643640 1 -- 172.21.15.2:0/542532773 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b30003530 con 0x7f5b300040f0 2023-11-04T01:44:36.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49e44640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b440cdea0 0x7f5b30003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b49643640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b300040f0 0x7f5b300047d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009ae0 tx=0x7f5b3401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3802a03b88c18073 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340a5580 con 0x7f5b300040f0 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b340a56e0 con 0x7f5b300040f0 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b48e42640 1 -- 172.21.15.2:0/542532773 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340a5a90 con 0x7f5b300040f0 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/542532773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b300040f0 msgr2=0x7f5b300047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4c0a8640 1 --2- 172.21.15.2:0/542532773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b300040f0 0x7f5b300047d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009ae0 tx=0x7f5b3401c990 comp rx=0 tx=0).stop 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4a645640 1 -- 172.21.15.2:0/542532773 reap_dead start 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/542532773 shutdown_connections 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/542532773 >> 172.21.15.2:0/542532773 conn(0x7f5b440cebb0 msgr2=0x7f5b440cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/542532773 shutdown_connections 2023-11-04T01:44:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.203+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/542532773 wait complete. 2023-11-04T01:44:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 Processor -- start 2023-11-04T01:44:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 -- start start 2023-11-04T01:44:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b441534a0 0x7f5b440ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b44153880 0x7f5b440ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4406ba90 0x7f5b4406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4406c460 con 0x7f5b441534a0 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440abff0 con 0x7f5b4406ba90 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440ac2d0 con 0x7f5b44153880 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b441534a0 0x7f5b440ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b441534a0 0x7f5b440ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40586/0 (socket says 172.21.15.2:40586) 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 -- 172.21.15.2:0/499975386 learned_addr learned my addr 172.21.15.2:0/499975386 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49643640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b44153880 0x7f5b440ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4a645640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4406ba90 0x7f5b4406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 -- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b44153880 msgr2=0x7f5b440ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b44153880 0x7f5b440ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 -- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4406ba90 msgr2=0x7f5b4406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4406ba90 0x7f5b4406bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 -- 172.21.15.2:0/499975386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b440ac5b0 con 0x7f5b441534a0 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b49e44640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b441534a0 0x7f5b440ade70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5b400079b0 tx=0x7f5b40011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b3a7fc640 1 -- 172.21.15.2:0/499975386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40015610 con 0x7f5b441534a0 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b3a7fc640 1 -- 172.21.15.2:0/499975386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40015770 con 0x7f5b441534a0 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b440ac890 con 0x7f5b441534a0 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b3a7fc640 1 -- 172.21.15.2:0/499975386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40015ae0 con 0x7f5b441534a0 2023-11-04T01:44:36.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b440af730 con 0x7f5b441534a0 2023-11-04T01:44:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.207+0000 7f5b3a7fc640 1 -- 172.21.15.2:0/499975386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b40015c40 con 0x7f5b441534a0 2023-11-04T01:44:36.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b3a7fc640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b280664a0 0x7f5b28068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b3a7fc640 1 -- 172.21.15.2:0/499975386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b40087980 con 0x7f5b441534a0 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49643640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b280664a0 0x7f5b28068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 Processor -- start 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- start start 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49643640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b280664a0 0x7f5b28068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5b340af000 tx=0x7f5b34008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b679f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679fb10 0x5654b6752a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6753330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b6619460 con 0x5654b679f1f0 2023-11-04T01:44:36.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b65aa690 con 0x5654b679fb10 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654b65a7bc0 con 0x5654b6752f50 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b679f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b679f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40596/0 (socket says 172.21.15.2:40596) 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 -- 172.21.15.2:0/4216118308 learned_addr learned my addr 172.21.15.2:0/4216118308 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4a645640 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6753330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49643640 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679fb10 0x5654b6752a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 -- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 msgr2=0x5654b6753330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6753330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 -- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679fb10 msgr2=0x5654b6752a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679fb10 0x5654b6752a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 -- 172.21.15.2:0/4216118308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654b629b890 con 0x5654b679f1f0 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4a645640 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6753330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49643640 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679fb10 0x5654b6752a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b49e44640 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b679f5d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5b40054e00 tx=0x7f5b40011050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc119e16a124d0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b277fe640 1 -- 172.21.15.2:0/4216118308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40058950 con 0x5654b679f1f0 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b277fe640 1 -- 172.21.15.2:0/4216118308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4005caa0 con 0x5654b679f1f0 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b277fe640 1 -- 172.21.15.2:0/4216118308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40060c50 con 0x5654b679f1f0 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4216118308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 msgr2=0x5654b679f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b679f5d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5b40054e00 tx=0x7f5b40011050 comp rx=0 tx=0).stop 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4216118308 shutdown_connections 2023-11-04T01:44:36.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6753330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679fb10 0x5654b6752a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4216118308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b679f5d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4216118308 >> 172.21.15.2:0/4216118308 conn(0x5654b677bd40 msgr2=0x5654b677e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4216118308 shutdown_connections 2023-11-04T01:44:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.211+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4216118308 wait complete. 2023-11-04T01:44:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- start start 2023-11-04T01:44:36.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 Processor -- start 2023-11-04T01:44:36.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6780cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b6781210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b6781750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b65a34b0 con 0x5654b679f1f0 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b655baa0 con 0x5654b6752f50 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654b6561940 con 0x5654b679fb10 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 10 client.0 _ll_register_callbacks cb 0x5654b673c460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b6781210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b6781210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40612/0 (socket says 172.21.15.2:40612) 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 -- 172.21.15.2:0/466132355 learned_addr learned my addr 172.21.15.2:0/466132355 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4a645640 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b6781750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49e44640 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6780cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 -- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 msgr2=0x5654b6781750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b6781750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 -- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 msgr2=0x5654b6780cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6780cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 -- 172.21.15.2:0/466132355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b440af730 con 0x5654b679f1f0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49643640 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b6781210 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5b340b0040 tx=0x7f5b34019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2f4725631683b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 1 -- 172.21.15.2:0/466132355 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340be070 con 0x5654b679f1f0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 1 -- 172.21.15.2:0/466132355 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b340a59d0 con 0x5654b679f1f0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654b6560e10 con 0x5654b679f1f0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 1 -- 172.21.15.2:0/466132355 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b340a5b90 con 0x5654b679f1f0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 10 client.6348 fetch_fsmap learned FSMap version 26 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5654b65641a0 con 0x5654b679f1f0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 1 -- 172.21.15.2:0/466132355 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654b6560e10 con 0x5654b679f1f0 2023-11-04T01:44:36.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 1 -- 172.21.15.2:0/466132355 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b340a5cf0 con 0x5654b679f1f0 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 10 client.6348 fetch_fsmap finished waiting for FSMap version 26 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 10 client.6348 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 20 client.6348 populate_metadata read hostname 'smithi002' 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67af4a0 0x5654b67b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 4 client.6348 mds_command: new command op to 6171 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 --> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654b65a1e00 con 0x5654b67af4a0 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49e44640 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67af4a0 0x5654b67b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b49e44640 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67af4a0 0x5654b67b1890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ffb01a11065342d server_cookie=98fdb80a0e86b95d in_seq=0 out_seq=0 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 10 client.6348 ms_handle_connect on v2:172.21.15.2:6833/3559920390 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 1 -- 172.21.15.2:0/466132355 <== mds.0 v2:172.21.15.2:6833/3559920390 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654b65a1e00 con 0x5654b67af4a0 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 10 client.6348 handle_command_reply: tid=0 2023-11-04T01:44:36.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 client.6348 shutdown 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 msgr2=0x5654b6781210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b6781210 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5b340b0040 tx=0x7f5b34019730 comp rx=0 tx=0).stop 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 shutdown_connections 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67af4a0 0x5654b67b1890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b6781750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b6781210 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b24ff9640 0 client.6348 ms_handle_reset on v2:172.21.15.2:6833/3559920390 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/466132355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6780cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 >> 172.21.15.2:0/466132355 conn(0x5654b677bd40 msgr2=0x5654b674dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.215+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 shutdown_connections 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.219+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/466132355 wait complete. 2023-11-04T01:44:36.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.219+0000 7f5b4f1d5000 20 client.6348 trim_cache size 0 max 16384 2023-11-04T01:44:36.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.231+0000 7f5b4f1d5000 1 Processor -- start 2023-11-04T01:44:36.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.231+0000 7f5b4f1d5000 1 -- start start 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6779a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679f1f0 0x5654b6779f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679fb10 0x5654b677a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b625c940 con 0x5654b679fb10 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b659d990 con 0x5654b679f1f0 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654b6568d20 con 0x5654b6752f50 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679fb10 0x5654b677a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679fb10 0x5654b677a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40620/0 (socket says 172.21.15.2:40620) 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 -- 172.21.15.2:0/1662354137 learned_addr learned my addr 172.21.15.2:0/1662354137 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679f1f0 0x5654b6779f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49e44640 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6779a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 -- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 msgr2=0x5654b6779a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6779a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 -- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679f1f0 msgr2=0x5654b6779f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679f1f0 0x5654b6779f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 -- 172.21.15.2:0/1662354137 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b440aa530 con 0x5654b679fb10 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679f1f0 0x5654b6779f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679fb10 0x5654b677a4a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5b440b16f0 tx=0x7f5b3c0073e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6973e498cd1fb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b27fff640 1 -- 172.21.15.2:0/1662354137 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0163f0 con 0x5654b679fb10 2023-11-04T01:44:36.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b27fff640 1 -- 172.21.15.2:0/1662354137 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c016550 con 0x5654b679fb10 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b27fff640 1 -- 172.21.15.2:0/1662354137 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c016900 con 0x5654b679fb10 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/1662354137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679fb10 msgr2=0x5654b677a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679fb10 0x5654b677a4a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5b440b16f0 tx=0x7f5b3c0073e0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/1662354137 shutdown_connections 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679fb10 0x5654b677a4a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b679f1f0 0x5654b6779f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/1662354137 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b6752f50 0x5654b6779a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/1662354137 >> 172.21.15.2:0/1662354137 conn(0x5654b677bd40 msgr2=0x5654b674dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/1662354137 shutdown_connections 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/1662354137 wait complete. 2023-11-04T01:44:36.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- start start 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 Processor -- start 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6800490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b68009d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b67fca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b659d7b0 con 0x5654b679f1f0 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654b65e3830 con 0x5654b6752f50 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654b65a2340 con 0x5654b679fb10 2023-11-04T01:44:36.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 10 client.0 _ll_register_callbacks cb 0x7f5b40054c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b68009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b68009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40626/0 (socket says 172.21.15.2:40626) 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 -- 172.21.15.2:0/4117332021 learned_addr learned my addr 172.21.15.2:0/4117332021 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b67fca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49e44640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6800490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 -- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 msgr2=0x5654b67fca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b67fca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 -- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 msgr2=0x5654b6800490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6800490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 -- 172.21.15.2:0/4117332021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b440cabe0 con 0x5654b679f1f0 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49e44640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6800490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4a645640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b67fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b49643640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b68009d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5b34019770 tx=0x7f5b340a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edaee57b340b136 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b24ff9640 1 -- 172.21.15.2:0/4117332021 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340a5bd0 con 0x5654b679f1f0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b24ff9640 1 -- 172.21.15.2:0/4117332021 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b340a5d30 con 0x5654b679f1f0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654b656dd10 con 0x5654b679f1f0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.235+0000 7f5b24ff9640 1 -- 172.21.15.2:0/4117332021 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b340ad440 con 0x5654b679f1f0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 10 client.6354 fetch_fsmap learned FSMap version 26 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5654b654a4a0 con 0x5654b679f1f0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b24ff9640 1 -- 172.21.15.2:0/4117332021 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654b656dd10 con 0x5654b679f1f0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b24ff9640 1 -- 172.21.15.2:0/4117332021 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5b340d8020 con 0x5654b679f1f0 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 10 client.6354 fetch_fsmap finished waiting for FSMap version 26 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 10 client.6354 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:44:36.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 20 client.6354 populate_metadata read hostname 'smithi002' 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67fd3f0 0x5654b67fd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 4 client.6354 mds_command: new command op to 6171 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 --> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5654b659c490 con 0x5654b67fd3f0 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b49e44640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67fd3f0 0x5654b67fd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b49e44640 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67fd3f0 0x5654b67fd7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38d1ed415917d704 server_cookie=3bfa68d07a05be97 in_seq=0 out_seq=0 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b24ff9640 10 client.6354 ms_handle_connect on v2:172.21.15.2:6833/3559920390 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b24ff9640 1 -- 172.21.15.2:0/4117332021 <== mds.0 v2:172.21.15.2:6833/3559920390 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5654b659c490 con 0x5654b67fd3f0 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b24ff9640 10 client.6354 handle_command_reply: tid=0 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 client.6354 shutdown 2023-11-04T01:44:36.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 msgr2=0x5654b68009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b68009d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5b34019770 tx=0x7f5b340a7070 comp rx=0 tx=0).stop 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 shutdown_connections 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:6833/3559920390,v1:172.21.15.2:6835/3559920390] conn(0x5654b67fd3f0 0x5654b67fd7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5654b679fb10 0x5654b67fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654b679f1f0 0x5654b68009d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b24ff9640 0 client.6354 ms_handle_reset on v2:172.21.15.2:6833/3559920390 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 --2- 172.21.15.2:0/4117332021 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5654b6752f50 0x5654b6800490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 >> 172.21.15.2:0/4117332021 conn(0x5654b677bd40 msgr2=0x5654b67abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 shutdown_connections 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 1 -- 172.21.15.2:0/4117332021 wait complete. 2023-11-04T01:44:36.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4f1d5000 20 client.6354 trim_cache size 0 max 16384 2023-11-04T01:44:36.252 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:44:36.252 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:44:36.252 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:44:36.252 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 6171, 2023-11-04T01:44:36.252 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:44:36.252 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:44:36.252 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:44:36.253 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 9.2107021440000008, 2023-11-04T01:44:36.253 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2023-11-04T01:44:36.253 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 64, 2023-11-04T01:44:36.253 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 64, 2023-11-04T01:44:36.253 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 15.318751595 2023-11-04T01:44:36.253 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b280664a0 msgr2=0x7f5b28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b280664a0 0x7f5b28068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5b340af000 tx=0x7f5b34008040 comp rx=0 tx=0).stop 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b441534a0 msgr2=0x7f5b440ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b441534a0 0x7f5b440ade70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5b400079b0 tx=0x7f5b40011f90 comp rx=0 tx=0).stop 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 shutdown_connections 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b280664a0 0x7f5b28068960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4406ba90 0x7f5b4406bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b44153880 0x7f5b440ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 --2- 172.21.15.2:0/499975386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b441534a0 0x7f5b440ade70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 >> 172.21.15.2:0/499975386 conn(0x7f5b440cebb0 msgr2=0x7f5b44159430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 shutdown_connections 2023-11-04T01:44:36.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.239+0000 7f5b4c0a8640 1 -- 172.21.15.2:0/499975386 wait complete. 2023-11-04T01:44:36.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:44:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f8115df0640 1 Processor -- start 2023-11-04T01:44:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f8115df0640 1 -- start start 2023-11-04T01:44:36.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f8115df0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f811015d540 0x7f81100b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f8115df0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 0x7f811006a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f8115df0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100b4270 con 0x7f81100722e0 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f8115df0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811006ad60 con 0x7f811015d540 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f8115df0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811006cb40 con 0x7f811006a370 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f81100722e0 0x7f811006d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54648/0 (socket says 172.21.15.2:54648) 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810effd640 1 -- 172.21.15.2:0/1813961505 learned_addr learned my addr 172.21.15.2:0/1813961505 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499919564 0 0) 0x7f81100b4270 con 0x7f81100722e0 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc003530 con 0x7f81100722e0 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810f7fe640 1 --2- 172.21.15.2:0/1813961505 >> v2:172.21.15.90:3300/0 conn(0x7f811015d540 0x7f81100b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810ffff640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 0x7f811006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3500436668 0 0) 0x7f80fc003530 con 0x7f81100722e0 2023-11-04T01:44:36.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 msgr2=0x7f811006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 0x7f811006a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 >> v2:172.21.15.90:3300/0 conn(0x7f811015d540 msgr2=0x7f81100b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 --2- 172.21.15.2:0/1813961505 >> v2:172.21.15.90:3300/0 conn(0x7f811015d540 0x7f81100b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811006ce20 con 0x7f81100722e0 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f80f8001680 con 0x7f81100722e0 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 >> v1:172.21.15.2:6789/0 conn(0x7f81100722e0 legacy=0x7f811006d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 0x7f80fc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80fc003fb0 0x7f80fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80fc004d10 0x7f80fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811006ad60 con 0x7f80fc004d10 2023-11-04T01:44:36.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811006cb40 con 0x7f80fc003fb0 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc00bc00 con 0x7f811006a370 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810ffff640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80fc004d10 0x7f80fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810f7fe640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 0x7f80fc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810effd640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80fc003fb0 0x7f80fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810ffff640 1 -- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 msgr2=0x7f80fc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810ffff640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f811006a370 0x7f80fc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810ffff640 1 -- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80fc003fb0 msgr2=0x7f80fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810ffff640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80fc003fb0 0x7f80fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.363+0000 7f810ffff640 1 -- 172.21.15.2:0/1813961505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc003530 con 0x7f80fc004d10 2023-11-04T01:44:36.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80fc004d10 0x7f80fc005190 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f810800ba30 tx=0x7f810801c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716bd2c676083d77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080ac5f0 con 0x7f80fc004d10 2023-11-04T01:44:36.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080ac750 con 0x7f80fc004d10 2023-11-04T01:44:36.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810e7fc640 1 -- 172.21.15.2:0/1813961505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080acb00 con 0x7f80fc004d10 2023-11-04T01:44:36.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- 172.21.15.2:0/1813961505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80fc004d10 msgr2=0x7f80fc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 --2- 172.21.15.2:0/1813961505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80fc004d10 0x7f80fc005190 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f810800ba30 tx=0x7f810801c650 comp rx=0 tx=0).stop 2023-11-04T01:44:36.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 -- 172.21.15.2:0/1813961505 reap_dead start 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- 172.21.15.2:0/1813961505 shutdown_connections 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- 172.21.15.2:0/1813961505 >> 172.21.15.2:0/1813961505 conn(0x7f81100716a0 msgr2=0x7f8110071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- 172.21.15.2:0/1813961505 shutdown_connections 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- 172.21.15.2:0/1813961505 wait complete. 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 Processor -- start 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- start start 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8110151bf0 0x7f81100acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8110151fd0 0x7f811009a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81100ae420 0x7f811009ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100ad150 con 0x7f81100ae420 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81100ad380 con 0x7f8110151fd0 2023-11-04T01:44:36.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f8115df0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100ad660 con 0x7f8110151bf0 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81100ae420 0x7f811009ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81100ae420 0x7f811009ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40638/0 (socket says 172.21.15.2:40638) 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 -- 172.21.15.2:0/3628050808 learned_addr learned my addr 172.21.15.2:0/3628050808 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810f7fe640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8110151bf0 0x7f81100acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810effd640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8110151fd0 0x7f811009a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 -- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8110151bf0 msgr2=0x7f81100acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8110151bf0 0x7f81100acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 -- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8110151fd0 msgr2=0x7f811009a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8110151fd0 0x7f811009a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 -- 172.21.15.2:0/3628050808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100ad940 con 0x7f81100ae420 2023-11-04T01:44:36.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810f7fe640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8110151bf0 0x7f81100acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810effd640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8110151fd0 0x7f811009a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.367+0000 7f810ffff640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81100ae420 0x7f811009ac30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f81080ae040 tx=0x7f80fc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8107fff640 1 -- 172.21.15.2:0/3628050808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080ac3f0 con 0x7f81100ae420 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8107fff640 1 -- 172.21.15.2:0/3628050808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080ac550 con 0x7f81100ae420 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81100adc20 con 0x7f81100ae420 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8107fff640 1 -- 172.21.15.2:0/3628050808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108004220 con 0x7f81100ae420 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100c5a80 con 0x7f81100ae420 2023-11-04T01:44:36.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81100b40d0 con 0x7f81100ae420 2023-11-04T01:44:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8107fff640 1 -- 172.21.15.2:0/3628050808 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81080a9070 con 0x7f81100ae420 2023-11-04T01:44:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8107fff640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80f00664a0 0x7f80f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f8107fff640 1 -- 172.21.15.2:0/3628050808 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f810811e590 con 0x7f81100ae420 2023-11-04T01:44:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f810f7fe640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80f00664a0 0x7f80f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:36.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.371+0000 7f810f7fe640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80f00664a0 0x7f80f0068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8100003fd0 tx=0x7f810000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:36.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.375+0000 7f8107fff640 1 -- 172.21.15.2:0/3628050808 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f81080eb830 con 0x7f81100ae420 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.567+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81100aeb50 con 0x7f81100ae420 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.567+0000 7f8107fff640 1 -- 172.21.15.2:0/3628050808 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f81080eee50 con 0x7f81100ae420 2023-11-04T01:44:36.573 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:44:36.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80f00664a0 msgr2=0x7f80f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80f00664a0 0x7f80f0068960 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8100003fd0 tx=0x7f810000b040 comp rx=0 tx=0).stop 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81100ae420 msgr2=0x7f811009ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81100ae420 0x7f811009ac30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f81080ae040 tx=0x7f80fc005800 comp rx=0 tx=0).stop 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 shutdown_connections 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f80f00664a0 0x7f80f0068960 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81100ae420 0x7f811009ac30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8110151fd0 0x7f811009a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 --2- 172.21.15.2:0/3628050808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8110151bf0 0x7f81100acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 >> 172.21.15.2:0/3628050808 conn(0x7f81100716a0 msgr2=0x7f811015c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 shutdown_connections 2023-11-04T01:44:36.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:36.571+0000 7f8115df0640 1 -- 172.21.15.2:0/3628050808 wait complete. 2023-11-04T01:44:36.592 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:44:36.592 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:44:36.592 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:44:36.592 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:44:36.592 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:36.592 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:44:36.593 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:44:36.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:44:36.593 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:36.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:36.593 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:44:36.599 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:44:36.600 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42068sec preferred_lft 42068sec 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.601 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:44:36.602 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:44:36.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:36.603 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:44:36.656 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:44:36.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:36.657 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:44:36.705 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:44:36.705 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:44:36.705 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:44:36.705 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:44:36.705 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:44:36.705 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:44:36.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:36.706 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:44:36.706 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:44:36.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:44:36.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:44:36.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:44:36.706 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:44:36.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:36.780 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:44:36.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:44:36.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:44:36.828 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:36.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:36.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:44:36.884 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:44:36.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:44:36.885 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:36.932 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:44:36.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:44:36.932 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:36.979 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:37.028 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:44:37.029 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:44:37.030 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:37.031 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:37.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:37.032 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:44:37.079 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:44:37.079 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:44:37.124 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:37.130 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:44:37.131 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:37.132 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:37.133 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:37.133 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:37.133 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:44:37.133 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:37.133 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:37.133 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:37.133 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:37.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:37.134 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:44:37.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:44:37.203+0000 7fa51edc0580 -1 init, newargv = 0x55b536b3e9f0 newargc=15 2023-11-04T01:44:37.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[51324]: starting ceph client 2023-11-04T01:44:37.218 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[51324]: starting fuse 2023-11-04T01:44:38.282 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:44:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:44:38.290 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:44:38.291 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:44:38.292 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:44:38.293 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:44:38.293 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:44:38.293 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:38.293 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:44:38.293 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:38.293 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:44:38.293 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:38.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:38.294 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:44:38.346 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:44:38.346 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:44:38.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:44:38.346 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:38.347 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:44:38.348 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:44:38.472 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.51324.asok 2023-11-04T01:44:38.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:38.484 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51324.asok 2023-11-04T01:44:38.484 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:38.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.51324.asok status 2023-11-04T01:44:38.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:38.688 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:44:38.688 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:44:38.688 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:44:38.688 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:44:38.688 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:44:38.688 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:44:38.688 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "51324", 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 6366, 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 6366 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:38.689 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1419759254 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1419759254 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.6366 192.168.0.1:0/1419759254", 2023-11-04T01:44:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/1419759254", 2023-11-04T01:44:38.691 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:44:38.691 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 26, 2023-11-04T01:44:38.691 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 64, 2023-11-04T01:44:38.691 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:44:38.691 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:44:38.691 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:44:38.691 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:44:38.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:38.709 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:38.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:44:38.710 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:38.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:38.758 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:44:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:38.765 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:38.765 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:38.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:38.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:38.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:38.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_data_pool 2023-11-04T01:44:38.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf15c76640 1 Processor -- start 2023-11-04T01:44:38.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf15c76640 1 -- start start 2023-11-04T01:44:38.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf15c76640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faf1015af70 0x7faf100cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf15c76640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf1006d160 0x7faf100cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf15c76640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1015e890 con 0x7faf1015dd80 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf15c76640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf10071200 con 0x7faf1006d160 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf15c76640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1006c0c0 con 0x7faf1015af70 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf1006d160 0x7faf100cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf1006d160 0x7faf100cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40654/0 (socket says 172.21.15.2:40654) 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faf1015dd80 0x7faf1015e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54660/0 (socket says 172.21.15.2:54660) 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0effd640 1 -- 172.21.15.2:0/4055437637 learned_addr learned my addr 172.21.15.2:0/4055437637 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0f7fe640 1 --2- 172.21.15.2:0/4055437637 >> v2:172.21.15.90:3300/0 conn(0x7faf1015af70 0x7faf100cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0effd640 1 -- 172.21.15.2:0/4055437637 >> v2:172.21.15.90:3300/0 conn(0x7faf1015af70 msgr2=0x7faf100cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0effd640 1 --2- 172.21.15.2:0/4055437637 >> v2:172.21.15.90:3300/0 conn(0x7faf1015af70 0x7faf100cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0effd640 1 -- 172.21.15.2:0/4055437637 >> v1:172.21.15.2:6789/0 conn(0x7faf1015dd80 legacy=0x7faf1015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0e7fc640 1 -- 172.21.15.2:0/4055437637 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256171677 0 0) 0x7faf080014a0 con 0x7faf1015dd80 2023-11-04T01:44:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0effd640 1 -- 172.21.15.2:0/4055437637 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1006c3a0 con 0x7faf1006d160 2023-11-04T01:44:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.947+0000 7faf0f7fe640 1 --2- 172.21.15.2:0/4055437637 >> v2:172.21.15.90:3300/0 conn(0x7faf1015af70 0x7faf100cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:38.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0effd640 1 --2- 172.21.15.2:0/4055437637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1006d160 0x7faf100cdfe0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faf1006b490 tx=0x7faf0401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563523ea1cbe7eaa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0e7fc640 1 -- 172.21.15.2:0/4055437637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040ab5f0 con 0x7faf1006d160 2023-11-04T01:44:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0e7fc640 1 -- 172.21.15.2:0/4055437637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf040ab750 con 0x7faf1006d160 2023-11-04T01:44:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0e7fc640 1 -- 172.21.15.2:0/4055437637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040abae0 con 0x7faf1006d160 2023-11-04T01:44:38.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- 172.21.15.2:0/4055437637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1006d160 msgr2=0x7faf100cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 --2- 172.21.15.2:0/4055437637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1006d160 0x7faf100cdfe0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7faf1006b490 tx=0x7faf0401c500 comp rx=0 tx=0).stop 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- 172.21.15.2:0/4055437637 shutdown_connections 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 --2- 172.21.15.2:0/4055437637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1006d160 0x7faf100cdfe0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 --2- 172.21.15.2:0/4055437637 >> v2:172.21.15.90:3300/0 conn(0x7faf1015af70 0x7faf100cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- 172.21.15.2:0/4055437637 >> 172.21.15.2:0/4055437637 conn(0x7faf100cb510 msgr2=0x7faf100cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- 172.21.15.2:0/4055437637 shutdown_connections 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- 172.21.15.2:0/4055437637 wait complete. 2023-11-04T01:44:38.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 Processor -- start 2023-11-04T01:44:38.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- start start 2023-11-04T01:44:38.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf1006d160 0x7faf10154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf1015af70 0x7faf100cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1015dd80 0x7faf100ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100cd620 con 0x7faf1015dd80 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100b2060 con 0x7faf1006d160 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf15c76640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf100cd340 con 0x7faf1015af70 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1015dd80 0x7faf100ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1015dd80 0x7faf100ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40668/0 (socket says 172.21.15.2:40668) 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 -- 172.21.15.2:0/2700598236 learned_addr learned my addr 172.21.15.2:0/2700598236 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0f7fe640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf1006d160 0x7faf10154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0effd640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf1015af70 0x7faf100cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 -- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf1015af70 msgr2=0x7faf100cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf1015af70 0x7faf100cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 -- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf1006d160 msgr2=0x7faf10154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:38.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf1006d160 0x7faf10154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 -- 172.21.15.2:0/2700598236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040094d0 con 0x7faf1015dd80 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0effd640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf1015af70 0x7faf100cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.951+0000 7faf0ffff640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1015dd80 0x7faf100ac8c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c700 tx=0x7faf0800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faef7fff640 1 -- 172.21.15.2:0/2700598236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800ce10 con 0x7faf1015dd80 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faef7fff640 1 -- 172.21.15.2:0/2700598236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0800a640 con 0x7faf1015dd80 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf100b1a10 con 0x7faf1015dd80 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faef7fff640 1 -- 172.21.15.2:0/2700598236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800aa70 con 0x7faf1015dd80 2023-11-04T01:44:38.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf100ccf80 con 0x7faf1015dd80 2023-11-04T01:44:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf100b21d0 con 0x7faf1015dd80 2023-11-04T01:44:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faef7fff640 1 -- 172.21.15.2:0/2700598236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf0800abd0 con 0x7faf1015dd80 2023-11-04T01:44:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faef7fff640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faefc0664a0 0x7faefc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faef7fff640 1 -- 172.21.15.2:0/2700598236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf080834b0 con 0x7faf1015dd80 2023-11-04T01:44:38.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faf0f7fe640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faefc0664a0 0x7faefc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:38.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.955+0000 7faf0f7fe640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faefc0664a0 0x7faefc068960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faf0000a9a0 tx=0x7faf00008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:38.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:38.959+0000 7faef7fff640 1 -- 172.21.15.2:0/2700598236 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faf08050860 con 0x7faf1015dd80 2023-11-04T01:44:39.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.119+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_data_pool"} v 0) v1 -- 0x7faf1015e890 con 0x7faf1015dd80 2023-11-04T01:44:39.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.879+0000 7faef7fff640 1 -- 172.21.15.2:0/2700598236 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_data_pool"}]=0 pool 'test_data_pool' created v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7faf1015e890 con 0x7faf1015dd80 2023-11-04T01:44:39.884 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'test_data_pool' created 2023-11-04T01:44:39.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faefc0664a0 msgr2=0x7faefc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faefc0664a0 0x7faefc068960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faf0000a9a0 tx=0x7faf00008040 comp rx=0 tx=0).stop 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1015dd80 msgr2=0x7faf100ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1015dd80 0x7faf100ac8c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7faf0800c700 tx=0x7faf0800cbc0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 shutdown_connections 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faefc0664a0 0x7faefc068960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf1015dd80 0x7faf100ac8c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf1015af70 0x7faf100cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 --2- 172.21.15.2:0/2700598236 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf1006d160 0x7faf10154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:39.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 >> 172.21.15.2:0/2700598236 conn(0x7faf100cb510 msgr2=0x7faf100cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:39.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 shutdown_connections 2023-11-04T01:44:39.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:39.883+0000 7faf15c76640 1 -- 172.21.15.2:0/2700598236 wait complete. 2023-11-04T01:44:39.918 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create test_metadata_pool 2023-11-04T01:44:40.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a15722640 1 Processor -- start 2023-11-04T01:44:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a15722640 1 -- start start 2023-11-04T01:44:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a15722640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a1015ae60 0x7f4a100c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a15722640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a100ca550 0x7f4a100c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a15722640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a100cba30 con 0x7f4a1015b240 2023-11-04T01:44:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a15722640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a10071e90 con 0x7f4a100ca550 2023-11-04T01:44:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a15722640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a10072170 con 0x7f4a1015ae60 2023-11-04T01:44:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a07fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a100ca550 0x7f4a100c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a07fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a100ca550 0x7f4a100c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40676/0 (socket says 172.21.15.2:40676) 2023-11-04T01:44:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a07fff640 1 -- 172.21.15.2:0/2245542724 learned_addr learned my addr 172.21.15.2:0/2245542724 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:40.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a0effd640 1 --2- 172.21.15.2:0/2245542724 >> v2:172.21.15.90:3300/0 conn(0x7f4a1015ae60 0x7f4a100c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a07fff640 1 -- 172.21.15.2:0/2245542724 >> v2:172.21.15.90:3300/0 conn(0x7f4a1015ae60 msgr2=0x7f4a100c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a07fff640 1 --2- 172.21.15.2:0/2245542724 >> v2:172.21.15.90:3300/0 conn(0x7f4a1015ae60 0x7f4a100c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a07fff640 1 -- 172.21.15.2:0/2245542724 >> v1:172.21.15.90:6789/0 conn(0x7f4a1015b240 legacy=0x7f4a1015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.043+0000 7f4a07fff640 1 -- 172.21.15.2:0/2245542724 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10072450 con 0x7f4a100ca550 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 --2- 172.21.15.2:0/2245542724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a100ca550 0x7f4a100c9ed0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4a10072720 tx=0x7f49f801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff0c6c23152d47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a0e7fc640 1 -- 172.21.15.2:0/2245542724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80aa650 con 0x7f4a100ca550 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a0e7fc640 1 -- 172.21.15.2:0/2245542724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f80aa7b0 con 0x7f4a100ca550 2023-11-04T01:44:40.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a0e7fc640 1 -- 172.21.15.2:0/2245542724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80aab40 con 0x7f4a100ca550 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- 172.21.15.2:0/2245542724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a100ca550 msgr2=0x7f4a100c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 --2- 172.21.15.2:0/2245542724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a100ca550 0x7f4a100c9ed0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f4a10072720 tx=0x7f49f801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- 172.21.15.2:0/2245542724 shutdown_connections 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 --2- 172.21.15.2:0/2245542724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a100ca550 0x7f4a100c9ed0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 --2- 172.21.15.2:0/2245542724 >> v2:172.21.15.90:3300/0 conn(0x7f4a1015ae60 0x7f4a100c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- 172.21.15.2:0/2245542724 >> 172.21.15.2:0/2245542724 conn(0x7f4a100b0e30 msgr2=0x7f4a100b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- 172.21.15.2:0/2245542724 shutdown_connections 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- 172.21.15.2:0/2245542724 wait complete. 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 Processor -- start 2023-11-04T01:44:40.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- start start 2023-11-04T01:44:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a100ca550 0x7f4a100c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a1015ae60 0x7f4a100cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015b240 0x7f4a10156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c8240 con 0x7f4a1015ae60 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c8520 con 0x7f4a1015b240 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a15722640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a100c8800 con 0x7f4a100ca550 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a1015ae60 0x7f4a100cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a1015ae60 0x7f4a100cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40678/0 (socket says 172.21.15.2:40678) 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 -- 172.21.15.2:0/209886160 learned_addr learned my addr 172.21.15.2:0/209886160 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a0f7fe640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015b240 0x7f4a10156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a0effd640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a100ca550 0x7f4a100c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 -- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a100ca550 msgr2=0x7f4a100c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a100ca550 0x7f4a100c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 -- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015b240 msgr2=0x7f4a10156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015b240 0x7f4a10156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 -- 172.21.15.2:0/209886160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f80094d0 con 0x7f4a1015ae60 2023-11-04T01:44:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a07fff640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a1015ae60 0x7f4a100cd920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f49f80190e0 tx=0x7f49f801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.047+0000 7f4a077fe640 1 -- 172.21.15.2:0/209886160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80b3800 con 0x7f4a1015ae60 2023-11-04T01:44:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a077fe640 1 -- 172.21.15.2:0/209886160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f80b3960 con 0x7f4a1015ae60 2023-11-04T01:44:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a100c8ae0 con 0x7f4a1015ae60 2023-11-04T01:44:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a077fe640 1 -- 172.21.15.2:0/209886160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f80b3d10 con 0x7f4a1015ae60 2023-11-04T01:44:40.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a100c92e0 con 0x7f4a1015ae60 2023-11-04T01:44:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a100675f0 con 0x7f4a1015ae60 2023-11-04T01:44:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a077fe640 1 -- 172.21.15.2:0/209886160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49f80b2380 con 0x7f4a1015ae60 2023-11-04T01:44:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a077fe640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49f00664a0 0x7f49f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a077fe640 1 -- 172.21.15.2:0/209886160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6415+0+0 (secure 0 0 0) 0x7f4a100cb7d0 con 0x7f4a1015ae60 2023-11-04T01:44:40.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a0effd640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49f00664a0 0x7f49f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.051+0000 7f4a0effd640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49f00664a0 0x7f49f0068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009a10 tx=0x7f4a00008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.055+0000 7f4a077fe640 1 -- 172.21.15.2:0/209886160 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f49f80ebad0 con 0x7f4a1015ae60 2023-11-04T01:44:40.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.211+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f4a100c8f90 con 0x7f4a1015ae60 2023-11-04T01:44:40.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.883+0000 7f4a077fe640 1 -- 172.21.15.2:0/209886160 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "test_metadata_pool"}]=0 pool 'test_metadata_pool' created v66) v1 ==== 126+0+0 (secure 0 0 0) 0x7f49f80ef0f0 con 0x7f4a1015ae60 2023-11-04T01:44:40.889 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'test_metadata_pool' created 2023-11-04T01:44:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.883+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49f00664a0 msgr2=0x7f49f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.883+0000 7f4a15722640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49f00664a0 0x7f49f0068960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009a10 tx=0x7f4a00008040 comp rx=0 tx=0).stop 2023-11-04T01:44:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.883+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a1015ae60 msgr2=0x7f4a100cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.883+0000 7f4a15722640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a1015ae60 0x7f4a100cd920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f49f80190e0 tx=0x7f49f801ad10 comp rx=0 tx=0).stop 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 shutdown_connections 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f49f00664a0 0x7f49f0068960 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a1015b240 0x7f4a10156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a1015ae60 0x7f4a100cd920 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 --2- 172.21.15.2:0/209886160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a100ca550 0x7f4a100c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 >> 172.21.15.2:0/209886160 conn(0x7f4a100b0e30 msgr2=0x7f4a10159980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 shutdown_connections 2023-11-04T01:44:40.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.887+0000 7f4a15722640 1 -- 172.21.15.2:0/209886160 wait complete. 2023-11-04T01:44:40.937 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool mksnap snap4 2023-11-04T01:44:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 Processor -- start 2023-11-04T01:44:40.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- start start 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9803d9070 0x55c9803d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9804976d0 0x55c980408980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c980420be0 0x55c980408ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c980388190 con 0x55c9803d9070 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98033ffc0 con 0x55c9804976d0 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c98033fcc0 con 0x55c980420be0 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9803d9070 0x55c9803d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9803d9070 0x55c9803d9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40696/0 (socket says 172.21.15.2:40696) 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 -- 172.21.15.2:0/111093910 learned_addr learned my addr 172.21.15.2:0/111093910 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730404e640 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9804976d0 0x55c980408980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7305050640 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c980420be0 0x55c980408ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 -- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c980420be0 msgr2=0x55c980408ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c980420be0 0x55c980408ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 -- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9804976d0 msgr2=0x55c980408980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9804976d0 0x55c980408980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 -- 172.21.15.2:0/111093910 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c98032e420 con 0x55c9803d9070 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730484f640 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9803d9070 0x55c9803d9450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0046c0 tx=0x7f72fc004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2138f995c274c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730304c640 1 -- 172.21.15.2:0/111093910 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00d950 con 0x55c9803d9070 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730304c640 1 -- 172.21.15.2:0/111093910 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc00dab0 con 0x55c9803d9070 2023-11-04T01:44:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730304c640 1 -- 172.21.15.2:0/111093910 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc00de20 con 0x55c9803d9070 2023-11-04T01:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- 172.21.15.2:0/111093910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9803d9070 msgr2=0x55c9803d9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9803d9070 0x55c9803d9450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0046c0 tx=0x7f72fc004b80 comp rx=0 tx=0).stop 2023-11-04T01:44:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- 172.21.15.2:0/111093910 shutdown_connections 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c980420be0 0x55c980408ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9804976d0 0x55c980408980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- 172.21.15.2:0/111093910 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c9803d9070 0x55c9803d9450 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- 172.21.15.2:0/111093910 >> 172.21.15.2:0/111093910 conn(0x55c9804066b0 msgr2=0x55c980496bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- 172.21.15.2:0/111093910 shutdown_connections 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- 172.21.15.2:0/111093910 wait complete. 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 Processor -- start 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- start start 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9803d9070 0x55c98040b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c980420be0 0x55c980539c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9804976d0 0x55c98040a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9803162c0 con 0x55c980420be0 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98053a170 con 0x55c9803d9070 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f7306d30080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c98053b2d0 con 0x55c9804976d0 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.967+0000 7f730404e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c980420be0 0x55c980539c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c980420be0 0x55c980539c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40698/0 (socket says 172.21.15.2:40698) 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 -- 172.21.15.2:0/270205179 learned_addr learned my addr 172.21.15.2:0/270205179 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730484f640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9803d9070 0x55c98040b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f7305050640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9804976d0 0x55c98040a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 -- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9804976d0 msgr2=0x55c98040a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9804976d0 0x55c98040a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 -- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9803d9070 msgr2=0x55c98040b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9803d9070 0x55c98040b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 -- 172.21.15.2:0/270205179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc00e040 con 0x55c980420be0 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730484f640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9803d9070 0x55c98040b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730404e640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c980420be0 0x55c980539c30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f72f8007760 tx=0x7f72f8007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800f030 con 0x55c980420be0 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8010040 con 0x55c980420be0 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c9803215d0 con 0x55c980420be0 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8016440 con 0x55c980420be0 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c980321030 con 0x55c980420be0 2023-11-04T01:44:40.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72f80165a0 con 0x55c980420be0 2023-11-04T01:44:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730204a640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72f0064e80 0x7f72f0067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f72f8083a50 con 0x55c980420be0 2023-11-04T01:44:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(create snap pool 11 tid 1 name snap4 v0) v4 -- 0x55c980392110 con 0x55c980420be0 2023-11-04T01:44:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.971+0000 7f730484f640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72f0064e80 0x7f72f0067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:40.975+0000 7f730484f640 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72f0064e80 0x7f72f0067340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0046c0 tx=0x7f72fc008000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:41.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.899+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 <== mon.0 v2:172.21.15.2:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v67) v1 ==== 43+0+0 (secure 0 0 0) 0x7f72f8050aa0 con 0x55c980420be0 2023-11-04T01:44:41.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.899+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=67}) v3 -- 0x7f72f006f050 con 0x55c980420be0 2023-11-04T01:44:41.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.903+0000 7f730204a640 1 -- 172.21.15.2:0/270205179 <== mon.0 v2:172.21.15.2:3300/0 7 ==== osd_map(67..67 src has 1..67) v4 ==== 718+0+0 (secure 0 0 0) 0x7f72f8054e60 con 0x55c980420be0 2023-11-04T01:44:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:created pool test_data_pool snap snap4 2023-11-04T01:44:41.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.903+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72f0064e80 msgr2=0x7f72f0067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.903+0000 7f7306d30080 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72f0064e80 0x7f72f0067340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0046c0 tx=0x7f72fc008000 comp rx=0 tx=0).stop 2023-11-04T01:44:41.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.903+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c980420be0 msgr2=0x55c980539c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:41.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.903+0000 7f7306d30080 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c980420be0 0x55c980539c30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f72f8007760 tx=0x7f72f8007c20 comp rx=0 tx=0).stop 2023-11-04T01:44:41.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 shutdown_connections 2023-11-04T01:44:41.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f72f0064e80 0x7f72f0067340 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55c9804976d0 0x55c98040a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c980420be0 0x55c980539c30 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 --2- 172.21.15.2:0/270205179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55c9803d9070 0x55c98040b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:41.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 >> 172.21.15.2:0/270205179 conn(0x55c9804066b0 msgr2=0x55c9803ddf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:41.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 shutdown_connections 2023-11-04T01:44:41.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:41.907+0000 7f7306d30080 1 -- 172.21.15.2:0/270205179 wait complete. 2023-11-04T01:44:41.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testfs test_metadata_pool test_data_pool 2023-11-04T01:44:42.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ebd50640 1 Processor -- start 2023-11-04T01:44:42.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ebd50640 1 -- start start 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ebd50640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 0x7f22e40719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ebd50640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40cdb70 con 0x7f22e4071250 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ebd50640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40cde50 con 0x7f22e406de30 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ebd50640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e415a2e0 con 0x7f22e4159f00 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f22e4071250 0x7f22e40ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41756/0 (socket says 172.21.15.2:41756) 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 -- 172.21.15.2:0/3035387296 learned_addr learned my addr 172.21.15.2:0/3035387296 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e9aec640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 0x7f22e40719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612735273 0 0) 0x7f22e40cdb70 con 0x7f22e4071250 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d0003530 con 0x7f22e4071250 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3305379879 0 0) 0x7f22d0003530 con 0x7f22e4071250 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 msgr2=0x7f22e40719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:42.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 0x7f22e40719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 >> v1:172.21.15.90:6789/0 conn(0x7f22e406de30 legacy=0x7f22e4070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e415e4f0 con 0x7f22e4071250 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f22dc001a00 con 0x7f22e4071250 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 >> v1:172.21.15.2:6789/0 conn(0x7f22e4071250 legacy=0x7f22e40ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22d00039b0 0x7f22d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 0x7f22d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22d0004d10 0x7f22d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e415a2e0 con 0x7f22d0004d10 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d000bac0 con 0x7f22d00039b0 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d000bc80 con 0x7f22e4159f00 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22d0004d10 0x7f22d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e9aec640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22d00039b0 0x7f22d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e92eb640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 0x7f22d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 -- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 msgr2=0x7f22d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 0x7f22d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 -- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22d00039b0 msgr2=0x7f22d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22d00039b0 0x7f22d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22ea2ed640 1 -- 172.21.15.2:0/3035387296 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0003530 con 0x7f22d0004d10 2023-11-04T01:44:42.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.091+0000 7f22e92eb640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4159f00 0x7f22d00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ea2ed640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22d0004d10 0x7f22d0005190 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f22e4066e40 tx=0x7f22dc01fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d86b913f9a71bb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc0072d0 con 0x7f22d0004d10 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc007450 con 0x7f22d0004d10 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22e8aea640 1 -- 172.21.15.2:0/3035387296 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc007800 con 0x7f22d0004d10 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 -- 172.21.15.2:0/3035387296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22d0004d10 msgr2=0x7f22d0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 --2- 172.21.15.2:0/3035387296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22d0004d10 0x7f22d0005190 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f22e4066e40 tx=0x7f22dc01fa20 comp rx=0 tx=0).stop 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ea2ed640 1 -- 172.21.15.2:0/3035387296 reap_dead start 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 -- 172.21.15.2:0/3035387296 shutdown_connections 2023-11-04T01:44:42.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 -- 172.21.15.2:0/3035387296 >> 172.21.15.2:0/3035387296 conn(0x7f22e40cfc70 msgr2=0x7f22e40d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 -- 172.21.15.2:0/3035387296 shutdown_connections 2023-11-04T01:44:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 -- 172.21.15.2:0/3035387296 wait complete. 2023-11-04T01:44:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 Processor -- start 2023-11-04T01:44:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.095+0000 7f22ebd50640 1 -- start start 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4151230 0x7f22e40ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22e40acdf0 0x7f22e4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e41531c0 0x7f22e40b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4153640 con 0x7f22e40acdf0 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40adf80 con 0x7f22e41531c0 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40ad370 con 0x7f22e4151230 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22e40acdf0 0x7f22e4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22e40acdf0 0x7f22e4152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36126/0 (socket says 172.21.15.2:36126) 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 -- 172.21.15.2:0/3203086617 learned_addr learned my addr 172.21.15.2:0/3203086617 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e9aec640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4151230 0x7f22e40ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ea2ed640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e41531c0 0x7f22e40b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 -- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4151230 msgr2=0x7f22e40ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22e4151230 0x7f22e40ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 -- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e41531c0 msgr2=0x7f22e40b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22e41531c0 0x7f22e40b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 -- 172.21.15.2:0/3203086617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40ad650 con 0x7f22e40acdf0 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22e92eb640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22e40acdf0 0x7f22e4152c80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f22d400d770 tx=0x7f22d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22da7fc640 1 -- 172.21.15.2:0/3203086617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4017070 con 0x7f22e40acdf0 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22da7fc640 1 -- 172.21.15.2:0/3203086617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4005070 con 0x7f22e40acdf0 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22da7fc640 1 -- 172.21.15.2:0/3203086617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4005460 con 0x7f22e40acdf0 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 -- 172.21.15.2:0/3203086617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e40ad930 con 0x7f22e40acdf0 2023-11-04T01:44:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 -- 172.21.15.2:0/3203086617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e40ae410 con 0x7f22e40acdf0 2023-11-04T01:44:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22ebd50640 1 -- 172.21.15.2:0/3203086617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e40ae130 con 0x7f22e40acdf0 2023-11-04T01:44:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22da7fc640 1 -- 172.21.15.2:0/3203086617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f22d4007030 con 0x7f22e40acdf0 2023-11-04T01:44:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22da7fc640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22c80664a0 0x7f22c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.099+0000 7f22da7fc640 1 -- 172.21.15.2:0/3203086617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6811+0+0 (secure 0 0 0) 0x7f22d4083bd0 con 0x7f22e40acdf0 2023-11-04T01:44:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.103+0000 7f22e9aec640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22c80664a0 0x7f22c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.103+0000 7f22e9aec640 1 --2- 172.21.15.2:0/3203086617 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22c80664a0 0x7f22c8068960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f22e4151f20 tx=0x7f22e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.107+0000 7f22da7fc640 1 -- 172.21.15.2:0/3203086617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22e40ae130 con 0x7f22e40acdf0 2023-11-04T01:44:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.295+0000 7f22ebd50640 1 -- 172.21.15.2:0/3203086617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"} v 0) v1 -- 0x7f22e40ae0f0 con 0x7f22e40acdf0 2023-11-04T01:44:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.295+0000 7f22da7fc640 1 -- 172.21.15.2:0/3203086617 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testfs", "metadata": "test_metadata_pool", "data": "test_data_pool"}]=-95 pool(11) already has mon-managed snaps; can't attach pool to fs v26) v1 ==== 198+0+0 (secure 0 0 0) 0x7f22d4050b70 con 0x7f22e40acdf0 2023-11-04T01:44:42.302 INFO:teuthology.orchestra.run.smithi002.stderr:Error ENOTSUP: pool(11) already has mon-managed snaps; can't attach pool to fs 2023-11-04T01:44:42.308 DEBUG:teuthology.orchestra.run:got remote process result: 95 2023-11-04T01:44:42.309 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool test_data_pool rmsnap snap4 2023-11-04T01:44:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 Processor -- start 2023-11-04T01:44:42.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 -- start start 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef93e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd150 0x55cef9340970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd530 0x55cef933b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef92be190 con 0x55cef93cd150 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef9275fc0 con 0x55cef9341ac0 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.339+0000 7fcba011b080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef9275cc0 con 0x55cef93cd530 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd150 0x55cef9340970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd150 0x55cef9340970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36148/0 (socket says 172.21.15.2:36148) 2023-11-04T01:44:42.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 -- 172.21.15.2:0/2044016575 learned_addr learned my addr 172.21.15.2:0/2044016575 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9dc3a640 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef93e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 -- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd530 msgr2=0x55cef933b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd530 0x55cef933b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd530 0x55cef933b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 -- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 msgr2=0x55cef93e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef93e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 -- 172.21.15.2:0/2044016575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9000a1c0 con 0x55cef93cd150 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd530 0x55cef933b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9dc3a640 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef93e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd150 0x55cef9340970 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400b280 tx=0x7fcb9400b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab84427a426a639 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb8ffff640 1 -- 172.21.15.2:0/2044016575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94014070 con 0x55cef93cd150 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb8ffff640 1 -- 172.21.15.2:0/2044016575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9400d510 con 0x55cef93cd150 2023-11-04T01:44:42.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb8ffff640 1 -- 172.21.15.2:0/2044016575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400d8a0 con 0x55cef93cd150 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- 172.21.15.2:0/2044016575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd150 msgr2=0x55cef9340970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd150 0x55cef9340970 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400b280 tx=0x7fcb9400b740 comp rx=0 tx=0).stop 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- 172.21.15.2:0/2044016575 shutdown_connections 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd530 0x55cef933b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd150 0x55cef9340970 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 --2- 172.21.15.2:0/2044016575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef93e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- 172.21.15.2:0/2044016575 >> 172.21.15.2:0/2044016575 conn(0x55cef933d9e0 msgr2=0x55cef9357360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- 172.21.15.2:0/2044016575 shutdown_connections 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- 172.21.15.2:0/2044016575 wait complete. 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 Processor -- start 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- start start 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef933e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd150 0x55cef93e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd530 0x55cef9479680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef924c2c0 con 0x55cef93cd530 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef9478d10 con 0x55cef9341ac0 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcba011b080 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef93e6820 con 0x55cef93cd150 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd530 0x55cef9479680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd530 0x55cef9479680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36162/0 (socket says 172.21.15.2:36162) 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 -- 172.21.15.2:0/1765015787 learned_addr learned my addr 172.21.15.2:0/1765015787 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9dc3a640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef933e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9d439640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd150 0x55cef93e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 -- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd150 msgr2=0x55cef93e93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd150 0x55cef93e93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 -- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 msgr2=0x55cef933e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef933e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 -- 172.21.15.2:0/1765015787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb94001b10 con 0x55cef93cd530 2023-11-04T01:44:42.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb9e43b640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd530 0x55cef9479680 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcb90018dd0 tx=0x7fcb90017f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.343+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900aae20 con 0x55cef93cd530 2023-11-04T01:44:42.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb90005b50 con 0x55cef93cd530 2023-11-04T01:44:42.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cef9264420 con 0x55cef93cd530 2023-11-04T01:44:42.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900be6a0 con 0x55cef93cd530 2023-11-04T01:44:42.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cef92575d0 con 0x55cef93cd530 2023-11-04T01:44:42.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb900a8070 con 0x55cef93cd530 2023-11-04T01:44:42.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcb8effd640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb80064e50 0x7fcb80067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:42.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6811+0+0 (secure 0 0 0) 0x7fcb9011e2b0 con 0x55cef93cd530 2023-11-04T01:44:42.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- pool_op(delete snap pool 11 tid 1 name snap4 v0) v4 -- 0x55cef92c8110 con 0x55cef93cd530 2023-11-04T01:44:42.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcb9dc3a640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb80064e50 0x7fcb80067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:42.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.347+0000 7fcb9dc3a640 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb80064e50 0x7fcb80067310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcb98005780 tx=0x7fcb980056d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:42.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.899+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 <== mon.0 v2:172.21.15.2:3300/0 6 ==== pool_op_reply(tid 1 (0) Success v68) v1 ==== 43+0+0 (secure 0 0 0) 0x7fcb900eb3f0 con 0x55cef93cd530 2023-11-04T01:44:42.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.899+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fcb8006f0e0 con 0x55cef93cd530 2023-11-04T01:44:42.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.899+0000 7fcb8effd640 1 -- 172.21.15.2:0/1765015787 <== mon.0 v2:172.21.15.2:3300/0 7 ==== osd_map(68..68 src has 1..68) v4 ==== 970+0+0 (secure 0 0 0) 0x7fcb900ef7b0 con 0x55cef93cd530 2023-11-04T01:44:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:removed pool test_data_pool snap snap4 2023-11-04T01:44:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb80064e50 msgr2=0x7fcb80067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb80064e50 0x7fcb80067310 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcb98005780 tx=0x7fcb980056d0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd530 msgr2=0x55cef9479680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd530 0x55cef9479680 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcb90018dd0 tx=0x7fcb90017f40 comp rx=0 tx=0).stop 2023-11-04T01:44:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 shutdown_connections 2023-11-04T01:44:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb80064e50 0x7fcb80067310 secure :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcb98005780 tx=0x7fcb980056d0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cef93cd530 0x55cef9479680 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cef93cd150 0x55cef93e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 --2- 172.21.15.2:0/1765015787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cef9341ac0 0x55cef933e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 >> 172.21.15.2:0/1765015787 conn(0x55cef933d9e0 msgr2=0x55cef9356ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 shutdown_connections 2023-11-04T01:44:42.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:42.903+0000 7fcba011b080 1 -- 172.21.15.2:0/1765015787 wait complete. 2023-11-04T01:44:42.913 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_data_pool 2023-11-04T01:44:43.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fe21a4640 1 Processor -- start 2023-11-04T01:44:43.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fe21a4640 1 -- start start 2023-11-04T01:44:43.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fe21a4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fdc15af70 0x7f2fdc0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fe21a4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc15e890 con 0x7f2fdc06d160 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fe21a4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc06c0c0 con 0x7f2fdc15e490 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fe21a4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fdc06c3a0 con 0x7f2fdc15af70 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fdb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fdc15af70 0x7f2fdc0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fdaffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2fdc06d160 0x7f2fdc15dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41764/0 (socket says 172.21.15.2:41764) 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fdaffd640 1 -- 172.21.15.2:0/2446348622 learned_addr learned my addr 172.21.15.2:0/2446348622 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fdb7fe640 1 -- 172.21.15.2:0/2446348622 >> v1:172.21.15.90:6789/0 conn(0x7f2fdc15e490 legacy=0x7f2fdc0701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fdb7fe640 1 -- 172.21.15.2:0/2446348622 >> v1:172.21.15.2:6789/0 conn(0x7f2fdc06d160 legacy=0x7f2fdc15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.083+0000 7f2fdb7fe640 1 -- 172.21.15.2:0/2446348622 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc06c680 con 0x7f2fdc15af70 2023-11-04T01:44:43.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fdb7fe640 1 --2- 172.21.15.2:0/2446348622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 0x7f2fdc0cdaa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0097c0 tx=0x7f2fcc01e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9f968ebc2eca6d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fda7fc640 1 -- 172.21.15.2:0/2446348622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0ad660 con 0x7f2fdc15af70 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fda7fc640 1 -- 172.21.15.2:0/2446348622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc0ad7c0 con 0x7f2fdc15af70 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fda7fc640 1 -- 172.21.15.2:0/2446348622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0adb50 con 0x7f2fdc15af70 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2446348622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 msgr2=0x7f2fdc0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 --2- 172.21.15.2:0/2446348622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 0x7f2fdc0cdaa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0097c0 tx=0x7f2fcc01e650 comp rx=0 tx=0).stop 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2446348622 shutdown_connections 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 --2- 172.21.15.2:0/2446348622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 0x7f2fdc0cdaa0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2446348622 >> 172.21.15.2:0/2446348622 conn(0x7f2fdc0cb510 msgr2=0x7f2fdc0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2446348622 shutdown_connections 2023-11-04T01:44:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2446348622 wait complete. 2023-11-04T01:44:43.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 Processor -- start 2023-11-04T01:44:43.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.087+0000 7f2fe21a4640 1 -- start start 2023-11-04T01:44:43.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fdc06d160 0x7f2fdc0af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 0x7f2fdc1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fdc15e490 0x7f2fdc0c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc156330 con 0x7f2fdc15af70 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0ae490 con 0x7f2fdc15e490 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0ae770 con 0x7f2fdc06d160 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 0x7f2fdc1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 0x7f2fdc1570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36192/0 (socket says 172.21.15.2:36192) 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 -- 172.21.15.2:0/2564210632 learned_addr learned my addr 172.21.15.2:0/2564210632 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 -- 172.21.15.2:0/2564210632 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fdc06d160 msgr2=0x7f2fdc0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 --2- 172.21.15.2:0/2564210632 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fdc06d160 0x7f2fdc0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 -- 172.21.15.2:0/2564210632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fdc15e490 msgr2=0x7f2fdc0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 --2- 172.21.15.2:0/2564210632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fdc15e490 0x7f2fdc0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 -- 172.21.15.2:0/2564210632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc009420 con 0x7f2fdc15af70 2023-11-04T01:44:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdaffd640 1 --2- 172.21.15.2:0/2564210632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fdc15af70 0x7f2fdc1570a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000c500 tx=0x7f2fd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fc3fff640 1 -- 172.21.15.2:0/2564210632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0005cf0 con 0x7f2fdc15af70 2023-11-04T01:44:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fc3fff640 1 -- 172.21.15.2:0/2564210632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0005e50 con 0x7f2fdc15af70 2023-11-04T01:44:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2564210632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc0aea50 con 0x7f2fdc15af70 2023-11-04T01:44:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fc3fff640 1 -- 172.21.15.2:0/2564210632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00072f0 con 0x7f2fdc15af70 2023-11-04T01:44:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2564210632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc0af010 con 0x7f2fdc15af70 2023-11-04T01:44:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2564210632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc0af200 con 0x7f2fdc15af70 2023-11-04T01:44:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fc3fff640 1 -- 172.21.15.2:0/2564210632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fd0007450 con 0x7f2fdc15af70 2023-11-04T01:44:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fc3fff640 1 --2- 172.21.15.2:0/2564210632 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fc80664a0 0x7f2fc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fc3fff640 1 -- 172.21.15.2:0/2564210632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f2fd0083710 con 0x7f2fdc15af70 2023-11-04T01:44:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.091+0000 7f2fdb7fe640 1 --2- 172.21.15.2:0/2564210632 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fc80664a0 0x7f2fc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.095+0000 7f2fdb7fe640 1 --2- 172.21.15.2:0/2564210632 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fc80664a0 0x7f2fc8068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0b1000 tx=0x7f2fcc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.095+0000 7f2fc3fff640 1 -- 172.21.15.2:0/2564210632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2fd0050740 con 0x7f2fdc15af70 2023-11-04T01:44:43.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.259+0000 7f2fe21a4640 1 -- 172.21.15.2:0/2564210632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_data_pool"} v 0) v1 -- 0x7f2fdc15e890 con 0x7f2fdc15af70 2023-11-04T01:44:43.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.263+0000 7f2fc3fff640 1 -- 172.21.15.2:0/2564210632 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_data_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v68) v1 ==== 296+0+0 (secure 0 0 0) 0x7f2fdc15e890 con 0x7f2fdc15af70 2023-11-04T01:44:43.268 INFO:teuthology.orchestra.run.smithi002.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_data_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:44:43.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:43.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete test_metadata_pool 2023-11-04T01:44:43.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 Processor -- start 2023-11-04T01:44:43.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 -- start start 2023-11-04T01:44:43.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f079c15acb0 0x7f079c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f079c15c160 0x7f079c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c0b0a50 0x7f079c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c15bd40 con 0x7f079c15acb0 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c06fd80 con 0x7f079c15c160 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.395+0000 7f07a0e5a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0b0ee0 con 0x7f079c0b0a50 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f079c15acb0 0x7f079c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f079c15acb0 0x7f079c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36206/0 (socket says 172.21.15.2:36206) 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 -- 172.21.15.2:0/610173414 learned_addr learned my addr 172.21.15.2:0/610173414 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079ad9d640 1 --2- 172.21.15.2:0/610173414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c0b0a50 0x7f079c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f0799d9b640 1 --2- 172.21.15.2:0/610173414 >> v2:172.21.15.90:3300/0 conn(0x7f079c15c160 0x7f079c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 -- 172.21.15.2:0/610173414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c0b0a50 msgr2=0x7f079c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 --2- 172.21.15.2:0/610173414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c0b0a50 0x7f079c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 -- 172.21.15.2:0/610173414 >> v2:172.21.15.90:3300/0 conn(0x7f079c15c160 msgr2=0x7f079c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 --2- 172.21.15.2:0/610173414 >> v2:172.21.15.90:3300/0 conn(0x7f079c15c160 0x7f079c0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 -- 172.21.15.2:0/610173414 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0cb130 con 0x7f079c15acb0 2023-11-04T01:44:43.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f0799d9b640 1 --2- 172.21.15.2:0/610173414 >> v2:172.21.15.90:3300/0 conn(0x7f079c15c160 0x7f079c0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079a59c640 1 --2- 172.21.15.2:0/610173414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c15acb0 0x7f079c15b090 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f079c0ce4b0 tx=0x7f078c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988611b8b1d53279 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079959a640 1 -- 172.21.15.2:0/610173414 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0aa5f0 con 0x7f079c15acb0 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079959a640 1 -- 172.21.15.2:0/610173414 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c0aa750 con 0x7f079c15acb0 2023-11-04T01:44:43.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f079959a640 1 -- 172.21.15.2:0/610173414 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0aaae0 con 0x7f079c15acb0 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 -- 172.21.15.2:0/610173414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c15acb0 msgr2=0x7f079c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 --2- 172.21.15.2:0/610173414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c15acb0 0x7f079c15b090 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f079c0ce4b0 tx=0x7f078c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 -- 172.21.15.2:0/610173414 shutdown_connections 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 --2- 172.21.15.2:0/610173414 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c0b0a50 0x7f079c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 --2- 172.21.15.2:0/610173414 >> v2:172.21.15.90:3300/0 conn(0x7f079c15c160 0x7f079c0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 --2- 172.21.15.2:0/610173414 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c15acb0 0x7f079c15b090 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 -- 172.21.15.2:0/610173414 >> 172.21.15.2:0/610173414 conn(0x7f079c0cb510 msgr2=0x7f079c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 -- 172.21.15.2:0/610173414 shutdown_connections 2023-11-04T01:44:43.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.399+0000 7f07a0e5a640 1 -- 172.21.15.2:0/610173414 wait complete. 2023-11-04T01:44:43.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 Processor -- start 2023-11-04T01:44:43.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 -- start start 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c0b0a50 0x7f079c0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c15c160 0x7f079c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f079c0c52a0 0x7f079c150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0c6de0 con 0x7f079c0b0a50 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c152e10 con 0x7f079c0c52a0 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0c6160 con 0x7f079c15c160 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c0b0a50 0x7f079c0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c0b0a50 0x7f079c0c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36214/0 (socket says 172.21.15.2:36214) 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 -- 172.21.15.2:0/3225174467 learned_addr learned my addr 172.21.15.2:0/3225174467 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f0799d9b640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c15c160 0x7f079c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079ad9d640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f079c0c52a0 0x7f079c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 -- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c15c160 msgr2=0x7f079c15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f079c15c160 0x7f079c15ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 -- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f079c0c52a0 msgr2=0x7f079c150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f079c0c52a0 0x7f079c150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 -- 172.21.15.2:0/3225174467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0094d0 con 0x7f079c0b0a50 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f079a59c640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f079c0b0a50 0x7f079c0c5b60 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f078c01cd70 tx=0x7f078c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f078affd640 1 -- 172.21.15.2:0/3225174467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0b3800 con 0x7f079c0b0a50 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f078affd640 1 -- 172.21.15.2:0/3225174467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c0b3960 con 0x7f079c0b0a50 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f078affd640 1 -- 172.21.15.2:0/3225174467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0b3d10 con 0x7f079c0b0a50 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 -- 172.21.15.2:0/3225174467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c0c6440 con 0x7f079c0b0a50 2023-11-04T01:44:43.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.403+0000 7f07a0e5a640 1 -- 172.21.15.2:0/3225174467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c0c6a00 con 0x7f079c0b0a50 2023-11-04T01:44:43.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.407+0000 7f07a0e5a640 1 -- 172.21.15.2:0/3225174467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c0c6f20 con 0x7f079c0b0a50 2023-11-04T01:44:43.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.407+0000 7f078affd640 1 -- 172.21.15.2:0/3225174467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f078c0b2380 con 0x7f079c0b0a50 2023-11-04T01:44:43.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.407+0000 7f078affd640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f077c0664a0 0x7f077c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.407+0000 7f078affd640 1 -- 172.21.15.2:0/3225174467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f078c0a7070 con 0x7f079c0b0a50 2023-11-04T01:44:43.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.407+0000 7f0799d9b640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f077c0664a0 0x7f077c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.407+0000 7f0799d9b640 1 --2- 172.21.15.2:0/3225174467 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f077c0664a0 0x7f077c068960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0790006fd0 tx=0x7f0790008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.411+0000 7f078affd640 1 -- 172.21.15.2:0/3225174467 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f079c0c6f20 con 0x7f079c0b0a50 2023-11-04T01:44:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.567+0000 7f07a0e5a640 1 -- 172.21.15.2:0/3225174467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "test_metadata_pool"} v 0) v1 -- 0x7f079c0c6f20 con 0x7f079c0b0a50 2023-11-04T01:44:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.567+0000 7f078affd640 1 -- 172.21.15.2:0/3225174467 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "test_metadata_pool"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v68) v1 ==== 304+0+0 (secure 0 0 0) 0x7f079c0c6f20 con 0x7f079c0b0a50 2023-11-04T01:44:43.572 INFO:teuthology.orchestra.run.smithi002.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool test_metadata_pool. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2023-11-04T01:44:43.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:43.578 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:44:43.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:43.629 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:43.680 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:44:43.680 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:43.681 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:43.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:43.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0666948640 1 Processor -- start 2023-11-04T01:44:43.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0666948640 1 -- start start 2023-11-04T01:44:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0666948640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f066015afd0 0x7f06600715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0666948640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066006f8f0 0x7f06600b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0666948640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06600c2670 con 0x7f06600b0b70 2023-11-04T01:44:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0666948640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0660070140 con 0x7f066015afd0 2023-11-04T01:44:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0666948640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066015fc90 con 0x7f066006f8f0 2023-11-04T01:44:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f065ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f066015afd0 0x7f06600715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0664ee5640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f06600b0b70 0x7f06600c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:58058/0 (socket says 172.21.15.2:58058) 2023-11-04T01:44:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f0664ee5640 1 -- 172.21.15.2:0/1303456275 learned_addr learned my addr 172.21.15.2:0/1303456275 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.851+0000 7f065f7fe640 1 --2- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066006f8f0 0x7f06600b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065ffff640 1 -- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066006f8f0 msgr2=0x7f06600b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065ffff640 1 --2- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066006f8f0 0x7f06600b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065ffff640 1 -- 172.21.15.2:0/1303456275 >> v1:172.21.15.90:6789/0 conn(0x7f06600b0b70 legacy=0x7f06600c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065ffff640 1 -- 172.21.15.2:0/1303456275 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066006bc30 con 0x7f066015afd0 2023-11-04T01:44:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065f7fe640 1 --2- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066006f8f0 0x7f06600b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065ffff640 1 --2- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015afd0 0x7f06600715d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0658009d90 tx=0x7f065801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e988beea7b48398 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065effd640 1 -- 172.21.15.2:0/1303456275 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580a5730 con 0x7f066015afd0 2023-11-04T01:44:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065effd640 1 -- 172.21.15.2:0/1303456275 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06580a5890 con 0x7f066015afd0 2023-11-04T01:44:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f065effd640 1 -- 172.21.15.2:0/1303456275 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580a5c20 con 0x7f066015afd0 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 -- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015afd0 msgr2=0x7f06600715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 --2- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015afd0 0x7f06600715d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0658009d90 tx=0x7f065801c950 comp rx=0 tx=0).stop 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 -- 172.21.15.2:0/1303456275 shutdown_connections 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 --2- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066006f8f0 0x7f06600b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 --2- 172.21.15.2:0/1303456275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f066015afd0 0x7f06600715d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 -- 172.21.15.2:0/1303456275 >> 172.21.15.2:0/1303456275 conn(0x7f06600cebb0 msgr2=0x7f06600cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 -- 172.21.15.2:0/1303456275 shutdown_connections 2023-11-04T01:44:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.855+0000 7f0666948640 1 -- 172.21.15.2:0/1303456275 wait complete. 2023-11-04T01:44:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 Processor -- start 2023-11-04T01:44:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 -- start start 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f066006f8f0 0x7f06600cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06600b0b70 0x7f06600c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066015afd0 0x7f06600c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600adee0 con 0x7f066006f8f0 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600cd9a0 con 0x7f06600b0b70 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600ad5b0 con 0x7f066015afd0 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f066006f8f0 0x7f06600cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f066006f8f0 0x7f06600cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36216/0 (socket says 172.21.15.2:36216) 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 -- 172.21.15.2:0/2324564322 learned_addr learned my addr 172.21.15.2:0/2324564322 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0664ee5640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066015afd0 0x7f06600c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065f7fe640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06600b0b70 0x7f06600c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 -- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066015afd0 msgr2=0x7f06600c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066015afd0 0x7f06600c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 -- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06600b0b70 msgr2=0x7f06600c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06600b0b70 0x7f06600c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 -- 172.21.15.2:0/2324564322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654009420 con 0x7f066006f8f0 2023-11-04T01:44:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0664ee5640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066015afd0 0x7f06600c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065ffff640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f066006f8f0 0x7f06600cdef0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f065801b000 tx=0x7f06580196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065cff9640 1 -- 172.21.15.2:0/2324564322 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580ad440 con 0x7f066006f8f0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065cff9640 1 -- 172.21.15.2:0/2324564322 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06580ad5a0 con 0x7f066006f8f0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0658009a70 con 0x7f066006f8f0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f065cff9640 1 -- 172.21.15.2:0/2324564322 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580ad950 con 0x7f066006f8f0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06600adb70 con 0x7f066006f8f0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.859+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06600744a0 con 0x7f066006f8f0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.863+0000 7f065cff9640 1 -- 172.21.15.2:0/2324564322 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06580adab0 con 0x7f066006f8f0 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.863+0000 7f065cff9640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f064c0664d0 0x7f064c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.863+0000 7f065cff9640 1 -- 172.21.15.2:0/2324564322 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f065811f1c0 con 0x7f066006f8f0 2023-11-04T01:44:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.863+0000 7f065f7fe640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f064c0664d0 0x7f064c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.863+0000 7f065f7fe640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f064c0664d0 0x7f064c068990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0660165fe0 tx=0x7f0654008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:43.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:43.867+0000 7f065cff9640 1 -- 172.21.15.2:0/2324564322 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06580ec270 con 0x7f066006f8f0 2023-11-04T01:44:44.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.023+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f066015fa70 con 0x7f066006f8f0 2023-11-04T01:44:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.027+0000 7f065cff9640 1 -- 172.21.15.2:0/2324564322 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+21791 (secure 0 0 0) 0x7f06580ef890 con 0x7f066006f8f0 2023-11-04T01:44:44.034 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":68,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:42.890805+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:44:24.247898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:44:25.345255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f064c0664d0 msgr2=0x7f064c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f064c0664d0 0x7f064c068990 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0660165fe0 tx=0x7f0654008040 comp rx=0 tx=0).stop 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f066006f8f0 msgr2=0x7f06600cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f066006f8f0 0x7f06600cdef0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f065801b000 tx=0x7f06580196f0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 shutdown_connections 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f064c0664d0 0x7f064c068990 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f066015afd0 0x7f06600c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06600b0b70 0x7f06600c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 --2- 172.21.15.2:0/2324564322 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f066006f8f0 0x7f06600cdef0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 >> 172.21.15.2:0/2324564322 conn(0x7f06600cebb0 msgr2=0x7f06600c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 shutdown_connections 2023-11-04T01:44:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.031+0000 7f0666948640 1 -- 172.21.15.2:0/2324564322 wait complete. 2023-11-04T01:44:44.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:44:24.247898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:44:25.345255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:44.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:44.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.163+0000 7f814dfdf640 1 Processor -- start 2023-11-04T01:44:44.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.163+0000 7f814dfdf640 1 -- start start 2023-11-04T01:44:44.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81480b0c20 0x7f814815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81480cb130 con 0x7f814815c160 2023-11-04T01:44:44.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814815b680 con 0x7f814815acb0 2023-11-04T01:44:44.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814815bd40 con 0x7f81480b0c20 2023-11-04T01:44:44.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f8146ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81480b0c20 0x7f814815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f8147fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f814815c160 0x7f81480ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41778/0 (socket says 172.21.15.2:41778) 2023-11-04T01:44:44.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f8147fff640 1 -- 172.21.15.2:0/714757661 learned_addr learned my addr 172.21.15.2:0/714757661 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:44.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f8146ffd640 1 -- 172.21.15.2:0/714757661 >> v1:172.21.15.90:6789/0 conn(0x7f814815acb0 legacy=0x7f81480b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f8146ffd640 1 -- 172.21.15.2:0/714757661 >> v1:172.21.15.2:6789/0 conn(0x7f814815c160 legacy=0x7f81480ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f81467fc640 1 -- 172.21.15.2:0/714757661 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070250552 0 0) 0x7f81480cb130 con 0x7f814815c160 2023-11-04T01:44:44.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f8146ffd640 1 -- 172.21.15.2:0/714757661 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814815b960 con 0x7f81480b0c20 2023-11-04T01:44:44.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f8146ffd640 1 --2- 172.21.15.2:0/714757661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f814815b090 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f813c0097c0 tx=0x7f813c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa1d4a2a2995ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f81467fc640 1 -- 172.21.15.2:0/714757661 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c004230 con 0x7f81480b0c20 2023-11-04T01:44:44.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f81467fc640 1 -- 172.21.15.2:0/714757661 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c0a7050 con 0x7f81480b0c20 2023-11-04T01:44:44.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f81467fc640 1 -- 172.21.15.2:0/714757661 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c003620 con 0x7f81480b0c20 2023-11-04T01:44:44.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- 172.21.15.2:0/714757661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 msgr2=0x7f814815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 --2- 172.21.15.2:0/714757661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f814815b090 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f813c0097c0 tx=0x7f813c01c440 comp rx=0 tx=0).stop 2023-11-04T01:44:44.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- 172.21.15.2:0/714757661 shutdown_connections 2023-11-04T01:44:44.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 --2- 172.21.15.2:0/714757661 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f814815b090 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- 172.21.15.2:0/714757661 >> 172.21.15.2:0/714757661 conn(0x7f81480cb510 msgr2=0x7f81480cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- 172.21.15.2:0/714757661 shutdown_connections 2023-11-04T01:44:44.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.167+0000 7f814dfdf640 1 -- 172.21.15.2:0/714757661 wait complete. 2023-11-04T01:44:44.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 Processor -- start 2023-11-04T01:44:44.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 -- start start 2023-11-04T01:44:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f81480c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f814815acb0 0x7f814806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f814815c160 0x7f814806cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814806b300 con 0x7f81480b0c20 2023-11-04T01:44:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814814b5a0 con 0x7f814815c160 2023-11-04T01:44:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814806d1c0 con 0x7f814815acb0 2023-11-04T01:44:44.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f81480c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f81480c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36222/0 (socket says 172.21.15.2:36222) 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 -- 172.21.15.2:0/1619244650 learned_addr learned my addr 172.21.15.2:0/1619244650 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f8147fff640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f814815c160 0x7f814806cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f8146ffd640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f814815acb0 0x7f814806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 -- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f814815acb0 msgr2=0x7f814806c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f814815acb0 0x7f814806c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 -- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f814815c160 msgr2=0x7f814806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f814815c160 0x7f814806cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 -- 172.21.15.2:0/1619244650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c009420 con 0x7f81480b0c20 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f8147fff640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f814815c160 0x7f814806cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f81477fe640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f81480c5230 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f813800c450 tx=0x7f813800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f812ffff640 1 -- 172.21.15.2:0/1619244650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138012830 con 0x7f81480b0c20 2023-11-04T01:44:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f812ffff640 1 -- 172.21.15.2:0/1619244650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81380129b0 con 0x7f81480b0c20 2023-11-04T01:44:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f812ffff640 1 -- 172.21.15.2:0/1619244650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8138012d60 con 0x7f81480b0c20 2023-11-04T01:44:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814806b550 con 0x7f81480b0c20 2023-11-04T01:44:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814806bb10 con 0x7f81480b0c20 2023-11-04T01:44:44.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.171+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81480744a0 con 0x7f81480b0c20 2023-11-04T01:44:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.175+0000 7f812ffff640 1 -- 172.21.15.2:0/1619244650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f813801c460 con 0x7f81480b0c20 2023-11-04T01:44:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.175+0000 7f812ffff640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81340664d0 0x7f8134068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.175+0000 7f812ffff640 1 -- 172.21.15.2:0/1619244650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f8138084130 con 0x7f81480b0c20 2023-11-04T01:44:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.175+0000 7f8146ffd640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81340664d0 0x7f8134068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.175+0000 7f8146ffd640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81340664d0 0x7f8134068990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f813c0ad000 tx=0x7f813c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.179+0000 7f812ffff640 1 -- 172.21.15.2:0/1619244650 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8138051150 con 0x7f81480b0c20 2023-11-04T01:44:44.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.327+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81480cde30 con 0x7f81480b0c20 2023-11-04T01:44:44.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.327+0000 7f812ffff640 1 -- 172.21.15.2:0/1619244650 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8138054770 con 0x7f81480b0c20 2023-11-04T01:44:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:44:44.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81340664d0 msgr2=0x7f8134068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81340664d0 0x7f8134068990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f813c0ad000 tx=0x7f813c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 msgr2=0x7f81480c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f81480c5230 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f813800c450 tx=0x7f813800c910 comp rx=0 tx=0).stop 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 shutdown_connections 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81340664d0 0x7f8134068990 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f814815c160 0x7f814806cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f814815acb0 0x7f814806c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 --2- 172.21.15.2:0/1619244650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81480b0c20 0x7f81480c5230 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 >> 172.21.15.2:0/1619244650 conn(0x7f81480cb510 msgr2=0x7f81480c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 shutdown_connections 2023-11-04T01:44:44.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.331+0000 7f814dfdf640 1 -- 172.21.15.2:0/1619244650 wait complete. 2023-11-04T01:44:44.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5d1c6e640 1 Processor -- start 2023-11-04T01:44:44.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5d1c6e640 1 -- start start 2023-11-04T01:44:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5d1c6e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5cc0cf810 0x7fd5cc0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5d1c6e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5cc0d1940 0x7fd5cc0d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5d1c6e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc0b5e00 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5d1c6e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0d1520 con 0x7fd5cc0cf810 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5d1c6e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc0d01c0 con 0x7fd5cc0d1940 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5caffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5cc0cf810 0x7fd5cc0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5caffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd5cc0cf810 0x7fd5cc0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36238/0 (socket says 172.21.15.2:36238) 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5caffd640 1 -- 172.21.15.2:0/863214291 learned_addr learned my addr 172.21.15.2:0/863214291 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5cbfff640 1 --2- 172.21.15.2:0/863214291 >> v2:172.21.15.90:3300/0 conn(0x7fd5cc0d1940 0x7fd5cc0d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5caffd640 1 -- 172.21.15.2:0/863214291 >> v2:172.21.15.90:3300/0 conn(0x7fd5cc0d1940 msgr2=0x7fd5cc0d1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5caffd640 1 --2- 172.21.15.2:0/863214291 >> v2:172.21.15.90:3300/0 conn(0x7fd5cc0d1940 0x7fd5cc0d1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5caffd640 1 -- 172.21.15.2:0/863214291 >> v1:172.21.15.90:6789/0 conn(0x7fd5cc15d0b0 legacy=0x7fd5cc160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5caffd640 1 -- 172.21.15.2:0/863214291 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc15d490 con 0x7fd5cc0cf810 2023-11-04T01:44:44.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.475+0000 7fd5cbfff640 1 --2- 172.21.15.2:0/863214291 >> v2:172.21.15.90:3300/0 conn(0x7fd5cc0d1940 0x7fd5cc0d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:44.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5caffd640 1 --2- 172.21.15.2:0/863214291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc0cf810 0x7fd5cc0cfc80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0b2850 tx=0x7fd5c001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c0bea25547bfa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5ca7fc640 1 -- 172.21.15.2:0/863214291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00aa620 con 0x7fd5cc0cf810 2023-11-04T01:44:44.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5ca7fc640 1 -- 172.21.15.2:0/863214291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c00aa780 con 0x7fd5cc0cf810 2023-11-04T01:44:44.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5ca7fc640 1 -- 172.21.15.2:0/863214291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00aab10 con 0x7fd5cc0cf810 2023-11-04T01:44:44.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/863214291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc0cf810 msgr2=0x7fd5cc0cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/863214291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc0cf810 0x7fd5cc0cfc80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0b2850 tx=0x7fd5c001c4c0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/863214291 shutdown_connections 2023-11-04T01:44:44.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/863214291 >> v2:172.21.15.90:3300/0 conn(0x7fd5cc0d1940 0x7fd5cc0d1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/863214291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc0cf810 0x7fd5cc0cfc80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/863214291 >> 172.21.15.2:0/863214291 conn(0x7fd5cc06a890 msgr2=0x7fd5cc06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/863214291 shutdown_connections 2023-11-04T01:44:44.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.479+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/863214291 wait complete. 2023-11-04T01:44:44.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 Processor -- start 2023-11-04T01:44:44.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 -- start start 2023-11-04T01:44:44.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5cc0cf810 0x7fd5cc157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5cc0d1940 0x7fd5cc15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc15d0b0 0x7fd5cc0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0c6950 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc158030 con 0x7fd5cc0d1940 2023-11-04T01:44:44.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc158300 con 0x7fd5cc0cf810 2023-11-04T01:44:44.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc15d0b0 0x7fd5cc0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc15d0b0 0x7fd5cc0b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36240/0 (socket says 172.21.15.2:36240) 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 -- 172.21.15.2:0/1924011480 learned_addr learned my addr 172.21.15.2:0/1924011480 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5caffd640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5cc0d1940 0x7fd5cc15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cb7fe640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5cc0cf810 0x7fd5cc157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 -- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5cc0cf810 msgr2=0x7fd5cc157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5cc0cf810 0x7fd5cc157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 -- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5cc0d1940 msgr2=0x7fd5cc15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5cc0d1940 0x7fd5cc15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 -- 172.21.15.2:0/1924011480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00094d0 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5cbfff640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc15d0b0 0x7fd5cc0b3100 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400cef0 tx=0x7fd5c400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5b3fff640 1 -- 172.21.15.2:0/1924011480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400d840 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5b3fff640 1 -- 172.21.15.2:0/1924011480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c400d9c0 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc1585e0 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5b3fff640 1 -- 172.21.15.2:0/1924011480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400dd70 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc0c6c10 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc0c6e30 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5b3fff640 1 -- 172.21.15.2:0/1924011480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5c401e3b0 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5b3fff640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd5b80664a0 0x7fd5b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.483+0000 7fd5b3fff640 1 -- 172.21.15.2:0/1924011480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fd5c4084d00 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.487+0000 7fd5cb7fe640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd5b80664a0 0x7fd5b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.487+0000 7fd5cb7fe640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd5b80664a0 0x7fd5b8068960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00b810 tx=0x7fd5bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.487+0000 7fd5b3fff640 1 -- 172.21.15.2:0/1924011480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd5c4051e70 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.643+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fd5cc0744a0 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.643+0000 7fd5b3fff640 1 -- 172.21.15.2:0/1924011480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v68) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd5c401a020 con 0x7fd5cc15d0b0 2023-11-04T01:44:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd5b80664a0 msgr2=0x7fd5b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd5b80664a0 0x7fd5b8068960 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00b810 tx=0x7fd5bc008040 comp rx=0 tx=0).stop 2023-11-04T01:44:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc15d0b0 msgr2=0x7fd5cc0b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc15d0b0 0x7fd5cc0b3100 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400cef0 tx=0x7fd5c400a710 comp rx=0 tx=0).stop 2023-11-04T01:44:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 shutdown_connections 2023-11-04T01:44:44.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd5b80664a0 0x7fd5b8068960 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd5cc15d0b0 0x7fd5cc0b3100 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5cc0d1940 0x7fd5cc15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 --2- 172.21.15.2:0/1924011480 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd5cc0cf810 0x7fd5cc157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 >> 172.21.15.2:0/1924011480 conn(0x7fd5cc06a890 msgr2=0x7fd5cc159110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 shutdown_connections 2023-11-04T01:44:44.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.647+0000 7fd5d1c6e640 1 -- 172.21.15.2:0/1924011480 wait complete. 2023-11-04T01:44:44.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.791+0000 7f4f9929b640 1 Processor -- start 2023-11-04T01:44:44.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.791+0000 7f4f9929b640 1 -- start start 2023-11-04T01:44:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f9929b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f9415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f9929b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4f9415c160 0x7f4f940b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f9929b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940cb130 con 0x7f4f940b0a50 2023-11-04T01:44:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f9929b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9415bd40 con 0x7f4f9415c160 2023-11-04T01:44:44.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f9929b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9406fd80 con 0x7f4f9415acb0 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4f9415c160 0x7f4f940b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f9415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4f9415c160 0x7f4f940b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:50554/0 (socket says 172.21.15.2:50554) 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 -- 172.21.15.2:0/2421727025 learned_addr learned my addr 172.21.15.2:0/2421727025 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 -- 172.21.15.2:0/2421727025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 msgr2=0x7f4f9415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 --2- 172.21.15.2:0/2421727025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f9415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 -- 172.21.15.2:0/2421727025 >> v1:172.21.15.90:6789/0 conn(0x7f4f940b0a50 legacy=0x7f4f940ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 -- 172.21.15.2:0/2421727025 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9415b680 con 0x7f4f9415c160 2023-11-04T01:44:44.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.795+0000 7f4f927fc640 1 --2- 172.21.15.2:0/2421727025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 0x7f4f940b0510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009870 tx=0x7f4f8801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15abce4f2e7306e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f91ffb640 1 -- 172.21.15.2:0/2421727025 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880ab650 con 0x7f4f9415c160 2023-11-04T01:44:44.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f91ffb640 1 -- 172.21.15.2:0/2421727025 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f880ab7b0 con 0x7f4f9415c160 2023-11-04T01:44:44.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f91ffb640 1 -- 172.21.15.2:0/2421727025 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880abb40 con 0x7f4f9415c160 2023-11-04T01:44:44.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- 172.21.15.2:0/2421727025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 msgr2=0x7f4f940b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 --2- 172.21.15.2:0/2421727025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 0x7f4f940b0510 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009870 tx=0x7f4f8801c540 comp rx=0 tx=0).stop 2023-11-04T01:44:44.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- 172.21.15.2:0/2421727025 shutdown_connections 2023-11-04T01:44:44.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 --2- 172.21.15.2:0/2421727025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 0x7f4f940b0510 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 --2- 172.21.15.2:0/2421727025 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f9415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- 172.21.15.2:0/2421727025 >> 172.21.15.2:0/2421727025 conn(0x7f4f940cb510 msgr2=0x7f4f940cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- 172.21.15.2:0/2421727025 shutdown_connections 2023-11-04T01:44:44.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- 172.21.15.2:0/2421727025 wait complete. 2023-11-04T01:44:44.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 Processor -- start 2023-11-04T01:44:44.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- start start 2023-11-04T01:44:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940b0a50 0x7f4f941514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f94151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 0x7f4f940c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940b18e0 con 0x7f4f940b0a50 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940b1bc0 con 0x7f4f9415c160 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f9929b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940b1ea0 con 0x7f4f9415acb0 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940b0a50 0x7f4f941514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940b0a50 0x7f4f941514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36256/0 (socket says 172.21.15.2:36256) 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 -- 172.21.15.2:0/1464338496 learned_addr learned my addr 172.21.15.2:0/1464338496 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f927fc640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f94151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f937fe640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 0x7f4f940c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 -- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 msgr2=0x7f4f94151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f94151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 -- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 msgr2=0x7f4f940c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 0x7f4f940c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.799+0000 7f4f92ffd640 1 -- 172.21.15.2:0/1464338496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880094d0 con 0x7f4f940b0a50 2023-11-04T01:44:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f92ffd640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940b0a50 0x7f4f941514e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400e930 tx=0x7f4f8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f7b7fe640 1 -- 172.21.15.2:0/1464338496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84009690 con 0x7f4f940b0a50 2023-11-04T01:44:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f7b7fe640 1 -- 172.21.15.2:0/1464338496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400ca00 con 0x7f4f940b0a50 2023-11-04T01:44:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f940b2180 con 0x7f4f940b0a50 2023-11-04T01:44:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f7b7fe640 1 -- 172.21.15.2:0/1464338496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400cd70 con 0x7f4f940b0a50 2023-11-04T01:44:44.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f94151a20 con 0x7f4f940b0a50 2023-11-04T01:44:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f940744a0 con 0x7f4f940b0a50 2023-11-04T01:44:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f7b7fe640 1 -- 172.21.15.2:0/1464338496 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f84013470 con 0x7f4f940b0a50 2023-11-04T01:44:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f7b7fe640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f800664a0 0x7f4f80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f7b7fe640 1 -- 172.21.15.2:0/1464338496 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f4f84084530 con 0x7f4f940b0a50 2023-11-04T01:44:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f927fc640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f800664a0 0x7f4f80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:44.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.803+0000 7f4f927fc640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f800664a0 0x7f4f80068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f880af000 tx=0x7f4f880a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:44.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.807+0000 7f4f7b7fe640 1 -- 172.21.15.2:0/1464338496 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4f84051610 con 0x7f4f940b0a50 2023-11-04T01:44:44.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.963+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f940ca570 con 0x7f4f940b0a50 2023-11-04T01:44:44.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.963+0000 7f4f7b7fe640 1 -- 172.21.15.2:0/1464338496 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f84054c30 con 0x7f4f940b0a50 2023-11-04T01:44:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f800664a0 msgr2=0x7f4f80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f800664a0 0x7f4f80068960 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f880af000 tx=0x7f4f880a7000 comp rx=0 tx=0).stop 2023-11-04T01:44:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940b0a50 msgr2=0x7f4f941514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940b0a50 0x7f4f941514e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400e930 tx=0x7f4f8400edf0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 shutdown_connections 2023-11-04T01:44:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4f800664a0 0x7f4f80068960 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f9415c160 0x7f4f940c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4f9415acb0 0x7f4f94151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 --2- 172.21.15.2:0/1464338496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940b0a50 0x7f4f941514e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 >> 172.21.15.2:0/1464338496 conn(0x7f4f940cb510 msgr2=0x7f4f940ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 shutdown_connections 2023-11-04T01:44:44.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:44.967+0000 7f4f9929b640 1 -- 172.21.15.2:0/1464338496 wait complete. 2023-11-04T01:44:44.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:45.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff8a0dde640 1 Processor -- start 2023-11-04T01:44:45.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff8a0dde640 1 -- start start 2023-11-04T01:44:45.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff8a0dde640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff89c0cd670 0x7ff89c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff8a0dde640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c160c50 con 0x7ff89c15d290 2023-11-04T01:44:45.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff8a0dde640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c0cedf0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff8a0dde640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c160ef0 con 0x7ff89c0cd670 2023-11-04T01:44:45.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff89a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff89c0cd670 0x7ff89c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff89ad9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff89c15d290 0x7ff89c0af8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41782/0 (socket says 172.21.15.2:41782) 2023-11-04T01:44:45.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff89ad9d640 1 -- 172.21.15.2:0/2206379112 learned_addr learned my addr 172.21.15.2:0/2206379112 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:45.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff89a59c640 1 -- 172.21.15.2:0/2206379112 >> v1:172.21.15.90:6789/0 conn(0x7ff89c06cfc0 legacy=0x7ff89c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:45.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff89959a640 1 -- 172.21.15.2:0/2206379112 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233011502 0 0) 0x7ff89c160c50 con 0x7ff89c15d290 2023-11-04T01:44:45.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff89a59c640 1 -- 172.21.15.2:0/2206379112 >> v1:172.21.15.2:6789/0 conn(0x7ff89c15d290 legacy=0x7ff89c0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.115+0000 7ff89a59c640 1 -- 172.21.15.2:0/2206379112 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c1611d0 con 0x7ff89c0cd670 2023-11-04T01:44:45.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 --2- 172.21.15.2:0/2206379112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c0cd670 0x7ff89c0ce8b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0097a0 tx=0x7ff88c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6185187c4c02341e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89959a640 1 -- 172.21.15.2:0/2206379112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0a7070 con 0x7ff89c0cd670 2023-11-04T01:44:45.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89959a640 1 -- 172.21.15.2:0/2206379112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c0ab430 con 0x7ff89c0cd670 2023-11-04T01:44:45.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89959a640 1 -- 172.21.15.2:0/2206379112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0ab7c0 con 0x7ff89c0cd670 2023-11-04T01:44:45.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2206379112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c0cd670 msgr2=0x7ff89c0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2206379112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c0cd670 0x7ff89c0ce8b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0097a0 tx=0x7ff88c01c430 comp rx=0 tx=0).stop 2023-11-04T01:44:45.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2206379112 shutdown_connections 2023-11-04T01:44:45.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2206379112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c0cd670 0x7ff89c0ce8b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2206379112 >> 172.21.15.2:0/2206379112 conn(0x7ff89c065dc0 msgr2=0x7ff89c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2206379112 shutdown_connections 2023-11-04T01:44:45.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2206379112 wait complete. 2023-11-04T01:44:45.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 Processor -- start 2023-11-04T01:44:45.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- start start 2023-11-04T01:44:45.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c06cfc0 0x7ff89c153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff89c0cd670 0x7ff89c156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff89c15d290 0x7ff89c0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0c7db0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c154040 con 0x7ff89c15d290 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff8a0dde640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c156d50 con 0x7ff89c0cd670 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c06cfc0 0x7ff89c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c06cfc0 0x7ff89c153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36272/0 (socket says 172.21.15.2:36272) 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 -- 172.21.15.2:0/2734862036 learned_addr learned my addr 172.21.15.2:0/2734862036 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff899d9b640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff89c0cd670 0x7ff89c156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89ad9d640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff89c15d290 0x7ff89c0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 -- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff89c0cd670 msgr2=0x7ff89c156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff89c0cd670 0x7ff89c156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 -- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff89c15d290 msgr2=0x7ff89c0ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff89c15d290 0x7ff89c0ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.119+0000 7ff89a59c640 1 -- 172.21.15.2:0/2734862036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c0093b0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff89a59c640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c06cfc0 0x7ff89c153b00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0ad040 tx=0x7ff88c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff892ffd640 1 -- 172.21.15.2:0/2734862036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c005ba0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff892ffd640 1 -- 172.21.15.2:0/2734862036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c005d20 con 0x7ff89c06cfc0 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c157030 con 0x7ff89c06cfc0 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff892ffd640 1 -- 172.21.15.2:0/2734862036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c006260 con 0x7ff89c06cfc0 2023-11-04T01:44:45.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c0c8000 con 0x7ff89c06cfc0 2023-11-04T01:44:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c0c81f0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff892ffd640 1 -- 172.21.15.2:0/2734862036 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff88c0063c0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff892ffd640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff87c0664d0 0x7ff87c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff892ffd640 1 -- 172.21.15.2:0/2734862036 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7ff88c11e890 con 0x7ff89c06cfc0 2023-11-04T01:44:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff899d9b640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff87c0664d0 0x7ff87c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.123+0000 7ff899d9b640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff87c0664d0 0x7ff87c068990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0c7bb0 tx=0x7ff884009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.127+0000 7ff892ffd640 1 -- 172.21.15.2:0/2734862036 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff88c0eb8b0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.283+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff89c0b6930 con 0x7ff89c06cfc0 2023-11-04T01:44:45.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.283+0000 7ff892ffd640 1 -- 172.21.15.2:0/2734862036 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff88c0eeed0 con 0x7ff89c06cfc0 2023-11-04T01:44:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:44:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff87c0664d0 msgr2=0x7ff87c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff87c0664d0 0x7ff87c068990 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0c7bb0 tx=0x7ff884009040 comp rx=0 tx=0).stop 2023-11-04T01:44:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c06cfc0 msgr2=0x7ff89c153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c06cfc0 0x7ff89c153b00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0ad040 tx=0x7ff88c01ac70 comp rx=0 tx=0).stop 2023-11-04T01:44:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 shutdown_connections 2023-11-04T01:44:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff87c0664d0 0x7ff87c068990 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff89c15d290 0x7ff89c0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff89c0cd670 0x7ff89c156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 --2- 172.21.15.2:0/2734862036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff89c06cfc0 0x7ff89c153b00 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 >> 172.21.15.2:0/2734862036 conn(0x7ff89c065dc0 msgr2=0x7ff89c15cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 shutdown_connections 2023-11-04T01:44:45.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.287+0000 7ff8a0dde640 1 -- 172.21.15.2:0/2734862036 wait complete. 2023-11-04T01:44:45.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe21a4c640 1 Processor -- start 2023-11-04T01:44:45.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe21a4c640 1 -- start start 2023-11-04T01:44:45.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe21a4c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 0x7fbe1c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe21a4c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe1c06ba10 0x7fbe1c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe21a4c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c0b0eb0 con 0x7fbe1c0b0a50 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe21a4c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c0c90e0 con 0x7fbe1c06ba10 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe21a4c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c06c010 con 0x7fbe1c15d290 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1a7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbe1c0b0a50 0x7fbe1c06b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41790/0 (socket says 172.21.15.2:41790) 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1a7fc640 1 -- 172.21.15.2:0/3304027284 learned_addr learned my addr 172.21.15.2:0/3304027284 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1b7fe640 1 --2- 172.21.15.2:0/3304027284 >> v2:172.21.15.90:3300/0 conn(0x7fbe1c06ba10 0x7fbe1c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1affd640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 0x7fbe1c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688675943 0 0) 0x7fbe1c0b0eb0 con 0x7fbe1c0b0a50 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe04003530 con 0x7fbe1c0b0a50 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3556939860 0 0) 0x7fbe04003530 con 0x7fbe1c0b0a50 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 msgr2=0x7fbe1c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 0x7fbe1c0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 >> v2:172.21.15.90:3300/0 conn(0x7fbe1c06ba10 msgr2=0x7fbe1c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:45.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 --2- 172.21.15.2:0/3304027284 >> v2:172.21.15.90:3300/0 conn(0x7fbe1c06ba10 0x7fbe1c160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c0ac960 con 0x7fbe1c0b0a50 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fbe10001680 con 0x7fbe1c0b0a50 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 >> v1:172.21.15.2:6789/0 conn(0x7fbe1c0b0a50 legacy=0x7fbe1c06b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe04003980 0x7fbe04003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe040047d0 0x7fbe04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 0x7fbe04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c0c90e0 con 0x7fbe04003980 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c06c010 con 0x7fbe040047d0 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0400b990 con 0x7fbe1c15d290 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1affd640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe04003980 0x7fbe04003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1b7fe640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 0x7fbe04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1a7fc640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe040047d0 0x7fbe04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1affd640 1 -- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 msgr2=0x7fbe04005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:45.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1affd640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe1c15d290 0x7fbe04005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1affd640 1 -- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe040047d0 msgr2=0x7fbe04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:45.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1affd640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe040047d0 0x7fbe04004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.415+0000 7fbe1affd640 1 -- 172.21.15.2:0/3304027284 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe04003530 con 0x7fbe04003980 2023-11-04T01:44:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe1affd640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe04003980 0x7fbe04003da0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009ae0 tx=0x7fbe0c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51240644e3a0fc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0a6430 con 0x7fbe04003980 2023-11-04T01:44:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c0a6590 con 0x7fbe04003980 2023-11-04T01:44:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe19ffb640 1 -- 172.21.15.2:0/3304027284 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0a6940 con 0x7fbe04003980 2023-11-04T01:44:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 -- 172.21.15.2:0/3304027284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe04003980 msgr2=0x7fbe04003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 --2- 172.21.15.2:0/3304027284 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe04003980 0x7fbe04003da0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009ae0 tx=0x7fbe0c01ca20 comp rx=0 tx=0).stop 2023-11-04T01:44:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe1b7fe640 1 -- 172.21.15.2:0/3304027284 reap_dead start 2023-11-04T01:44:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 -- 172.21.15.2:0/3304027284 shutdown_connections 2023-11-04T01:44:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 -- 172.21.15.2:0/3304027284 >> 172.21.15.2:0/3304027284 conn(0x7fbe1c0cb510 msgr2=0x7fbe1c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 -- 172.21.15.2:0/3304027284 shutdown_connections 2023-11-04T01:44:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 -- 172.21.15.2:0/3304027284 wait complete. 2023-11-04T01:44:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 Processor -- start 2023-11-04T01:44:45.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.419+0000 7fbe21a4c640 1 -- start start 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04003980 0x7fbe1c1f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe1c1f3020 0x7fbe1c0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe1c1f2650 0x7fbe1c0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c154a30 con 0x7fbe1c1f3020 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c154410 con 0x7fbe1c1f2650 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c070a20 con 0x7fbe04003980 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe1c1f3020 0x7fbe1c0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe1c1f3020 0x7fbe1c0af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36286/0 (socket says 172.21.15.2:36286) 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 -- 172.21.15.2:0/2006541344 learned_addr learned my addr 172.21.15.2:0/2006541344 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1affd640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04003980 0x7fbe1c1f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1b7fe640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe1c1f2650 0x7fbe1c0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 -- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04003980 msgr2=0x7fbe1c1f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04003980 0x7fbe1c1f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 -- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe1c1f2650 msgr2=0x7fbe1c0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe1c1f2650 0x7fbe1c0af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 -- 172.21.15.2:0/2006541344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c070d00 con 0x7fbe1c1f3020 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1a7fc640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe1c1f3020 0x7fbe1c0af3b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000d720 tx=0x7fbe1000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe03fff640 1 -- 172.21.15.2:0/2006541344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100074e0 con 0x7fbe1c1f3020 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe03fff640 1 -- 172.21.15.2:0/2006541344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe10007640 con 0x7fbe1c1f3020 2023-11-04T01:44:45.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c1546c0 con 0x7fbe1c1f3020 2023-11-04T01:44:45.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe03fff640 1 -- 172.21.15.2:0/2006541344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10004a30 con 0x7fbe1c1f3020 2023-11-04T01:44:45.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c155090 con 0x7fbe1c1f3020 2023-11-04T01:44:45.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe1c154ba0 con 0x7fbe1c1f3020 2023-11-04T01:44:45.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe03fff640 1 -- 172.21.15.2:0/2006541344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe10004b90 con 0x7fbe1c1f3020 2023-11-04T01:44:45.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe03fff640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe080664d0 0x7fbe08068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe03fff640 1 -- 172.21.15.2:0/2006541344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fbe10083fa0 con 0x7fbe1c1f3020 2023-11-04T01:44:45.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1affd640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe080664d0 0x7fbe08068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.423+0000 7fbe1affd640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe080664d0 0x7fbe08068990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0ad000 tx=0x7fbe0c0b2040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.427+0000 7fbe03fff640 1 -- 172.21.15.2:0/2006541344 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe10050f60 con 0x7fbe1c1f3020 2023-11-04T01:44:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.583+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fbe1c0744a0 con 0x7fbe1c1f3020 2023-11-04T01:44:45.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.583+0000 7fbe03fff640 1 -- 172.21.15.2:0/2006541344 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v68) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbe10019020 con 0x7fbe1c1f3020 2023-11-04T01:44:45.590 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe080664d0 msgr2=0x7fbe08068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe080664d0 0x7fbe08068990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0ad000 tx=0x7fbe0c0b2040 comp rx=0 tx=0).stop 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe1c1f3020 msgr2=0x7fbe1c0af3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe1c1f3020 0x7fbe1c0af3b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000d720 tx=0x7fbe1000dbe0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 shutdown_connections 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe080664d0 0x7fbe08068990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe1c1f2650 0x7fbe1c0af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe1c1f3020 0x7fbe1c0af3b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 --2- 172.21.15.2:0/2006541344 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04003980 0x7fbe1c1f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 >> 172.21.15.2:0/2006541344 conn(0x7fbe1c0cb510 msgr2=0x7fbe1c0ac050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 shutdown_connections 2023-11-04T01:44:45.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.587+0000 7fbe21a4c640 1 -- 172.21.15.2:0/2006541344 wait complete. 2023-11-04T01:44:45.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.715+0000 7f2b0ce31640 1 Processor -- start 2023-11-04T01:44:45.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.715+0000 7f2b0ce31640 1 -- start start 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0ce31640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2b08065dc0 0x7f2b080ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0ce31640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b080caed0 0x7f2b080ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0ce31640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b08066250 con 0x7f2b08159f50 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0ce31640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0806b3f0 con 0x7f2b080caed0 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0ce31640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0806b6d0 con 0x7f2b08065dc0 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b06d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b080caed0 0x7f2b080ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2b08159f50 0x7f2b080ccf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41800/0 (socket says 172.21.15.2:41800) 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0659c640 1 -- 172.21.15.2:0/918726754 learned_addr learned my addr 172.21.15.2:0/918726754 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b06d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b080caed0 0x7f2b080ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36302/0 (socket says 172.21.15.2:36302) 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b06d9d640 1 -- 172.21.15.2:0/918726754 >> v2:172.21.15.90:3300/0 conn(0x7f2b08065dc0 msgr2=0x7f2b080ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:45.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b05d9b640 1 --2- 172.21.15.2:0/918726754 >> v2:172.21.15.90:3300/0 conn(0x7f2b08065dc0 0x7f2b080ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0559a640 1 -- 172.21.15.2:0/918726754 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533671159 0 0) 0x7f2b08066250 con 0x7f2b08159f50 2023-11-04T01:44:45.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b06d9d640 1 --2- 172.21.15.2:0/918726754 >> v2:172.21.15.90:3300/0 conn(0x7f2b08065dc0 0x7f2b080ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b06d9d640 1 -- 172.21.15.2:0/918726754 >> v1:172.21.15.2:6789/0 conn(0x7f2b08159f50 legacy=0x7f2b080ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b06d9d640 1 -- 172.21.15.2:0/918726754 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0815a330 con 0x7f2b080caed0 2023-11-04T01:44:45.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b05d9b640 1 --2- 172.21.15.2:0/918726754 >> v2:172.21.15.90:3300/0 conn(0x7f2b08065dc0 0x7f2b080ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:45.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b06d9d640 1 --2- 172.21.15.2:0/918726754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b080caed0 0x7f2b080ca870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2b0806dd20 tx=0x7f2af801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b32aa52c9e0caf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0559a640 1 -- 172.21.15.2:0/918726754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80a7b10 con 0x7f2b080caed0 2023-11-04T01:44:45.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0559a640 1 -- 172.21.15.2:0/918726754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af80a7c70 con 0x7f2b080caed0 2023-11-04T01:44:45.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.719+0000 7f2b0559a640 1 -- 172.21.15.2:0/918726754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80af440 con 0x7f2b080caed0 2023-11-04T01:44:45.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- 172.21.15.2:0/918726754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b080caed0 msgr2=0x7f2b080ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/918726754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b080caed0 0x7f2b080ca870 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2b0806dd20 tx=0x7f2af801eb30 comp rx=0 tx=0).stop 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- 172.21.15.2:0/918726754 shutdown_connections 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/918726754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b080caed0 0x7f2b080ca870 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/918726754 >> v2:172.21.15.90:3300/0 conn(0x7f2b08065dc0 0x7f2b080ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- 172.21.15.2:0/918726754 >> 172.21.15.2:0/918726754 conn(0x7f2b080b0e30 msgr2=0x7f2b080b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- 172.21.15.2:0/918726754 shutdown_connections 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- 172.21.15.2:0/918726754 wait complete. 2023-11-04T01:44:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 Processor -- start 2023-11-04T01:44:45.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- start start 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b080caed0 0x7f2b081460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b08159f50 0x7f2b0814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b08150170 0x7f2b080c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0814f810 con 0x7f2b08150170 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0814eb90 con 0x7f2b080caed0 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0814ee70 con 0x7f2b08159f50 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b08150170 0x7f2b080c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b08150170 0x7f2b080c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36310/0 (socket says 172.21.15.2:36310) 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 -- 172.21.15.2:0/3074627726 learned_addr learned my addr 172.21.15.2:0/3074627726 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b05d9b640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b08159f50 0x7f2b0814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0659c640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b080caed0 0x7f2b081460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 -- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b08159f50 msgr2=0x7f2b0814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b08159f50 0x7f2b0814fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 -- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b080caed0 msgr2=0x7f2b081460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b080caed0 0x7f2b081460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 -- 172.21.15.2:0/3074627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af800b6c0 con 0x7f2b08150170 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0659c640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b080caed0 0x7f2b081460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b06d9d640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b08150170 0x7f2b080c1fb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2af80b2040 tx=0x7f2af801b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2af6ffd640 1 -- 172.21.15.2:0/3074627726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80b9610 con 0x7f2b08150170 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2af6ffd640 1 -- 172.21.15.2:0/3074627726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af80b9770 con 0x7f2b08150170 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0814f150 con 0x7f2b08150170 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2af6ffd640 1 -- 172.21.15.2:0/3074627726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80b9b00 con 0x7f2b08150170 2023-11-04T01:44:45.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.723+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b08146600 con 0x7f2b08150170 2023-11-04T01:44:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.727+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b080675f0 con 0x7f2b08150170 2023-11-04T01:44:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.727+0000 7f2af6ffd640 1 -- 172.21.15.2:0/3074627726 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2af80b6050 con 0x7f2b08150170 2023-11-04T01:44:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.727+0000 7f2af6ffd640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ae80664a0 0x7f2ae8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.727+0000 7f2af6ffd640 1 -- 172.21.15.2:0/3074627726 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f2af8121870 con 0x7f2b08150170 2023-11-04T01:44:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.727+0000 7f2b0659c640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ae80664a0 0x7f2ae8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:45.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.727+0000 7f2b0659c640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ae80664a0 0x7f2ae8068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b000012f0 tx=0x7f2b00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:45.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.731+0000 7f2af6ffd640 1 -- 172.21.15.2:0/3074627726 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2af80eea40 con 0x7f2b08150170 2023-11-04T01:44:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.883+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f2b080b52c0 con 0x7f2b08150170 2023-11-04T01:44:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.883+0000 7f2af6ffd640 1 -- 172.21.15.2:0/3074627726 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v68) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2af80b40b0 con 0x7f2b08150170 2023-11-04T01:44:45.891 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ae80664a0 msgr2=0x7f2ae8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ae80664a0 0x7f2ae8068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2b000012f0 tx=0x7f2b00009040 comp rx=0 tx=0).stop 2023-11-04T01:44:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b08150170 msgr2=0x7f2b080c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b08150170 0x7f2b080c1fb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2af80b2040 tx=0x7f2af801b8d0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 shutdown_connections 2023-11-04T01:44:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ae80664a0 0x7f2ae8068960 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b08150170 0x7f2b080c1fb0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b08159f50 0x7f2b0814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 --2- 172.21.15.2:0/3074627726 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b080caed0 0x7f2b081460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 >> 172.21.15.2:0/3074627726 conn(0x7f2b080b0e30 msgr2=0x7f2b08151240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 shutdown_connections 2023-11-04T01:44:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:45.887+0000 7f2b0ce31640 1 -- 172.21.15.2:0/3074627726 wait complete. 2023-11-04T01:44:45.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:44:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 Processor -- start 2023-11-04T01:44:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 -- start start 2023-11-04T01:44:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fab280b0890 0x7fab280cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280c9960 0x7fab280704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab280b0c70 0x7fab280ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2806d2f0 con 0x7fab280b0c70 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280ce110 con 0x7fab280b0890 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2ccfd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab280ce320 con 0x7fab280c9960 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab280b0c70 0x7fab280ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fab280b0c70 0x7fab280ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36312/0 (socket says 172.21.15.2:36312) 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 -- 172.21.15.2:0/870910752 learned_addr learned my addr 172.21.15.2:0/870910752 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2659c640 1 --2- 172.21.15.2:0/870910752 >> v2:172.21.15.90:3300/0 conn(0x7fab280b0890 0x7fab280cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab25d9b640 1 --2- 172.21.15.2:0/870910752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280c9960 0x7fab280704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 -- 172.21.15.2:0/870910752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280c9960 msgr2=0x7fab280704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 --2- 172.21.15.2:0/870910752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280c9960 0x7fab280704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 -- 172.21.15.2:0/870910752 >> v2:172.21.15.90:3300/0 conn(0x7fab280b0890 msgr2=0x7fab280cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 --2- 172.21.15.2:0/870910752 >> v2:172.21.15.90:3300/0 conn(0x7fab280b0890 0x7fab280cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab26d9d640 1 -- 172.21.15.2:0/870910752 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280ce600 con 0x7fab280b0c70 2023-11-04T01:44:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.027+0000 7fab2659c640 1 --2- 172.21.15.2:0/870910752 >> v2:172.21.15.90:3300/0 conn(0x7fab280b0890 0x7fab280cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab26d9d640 1 --2- 172.21.15.2:0/870910752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280b0c70 0x7fab280ccf90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fab2806df00 tx=0x7fab2001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215e7c927f0f9f60 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2559a640 1 -- 172.21.15.2:0/870910752 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200a5840 con 0x7fab280b0c70 2023-11-04T01:44:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2559a640 1 -- 172.21.15.2:0/870910752 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab200a59a0 con 0x7fab280b0c70 2023-11-04T01:44:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2559a640 1 -- 172.21.15.2:0/870910752 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200a5d30 con 0x7fab280b0c70 2023-11-04T01:44:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 -- 172.21.15.2:0/870910752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280b0c70 msgr2=0x7fab280ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/870910752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280b0c70 0x7fab280ccf90 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fab2806df00 tx=0x7fab2001c9a0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 -- 172.21.15.2:0/870910752 shutdown_connections 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/870910752 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280b0c70 0x7fab280ccf90 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/870910752 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280c9960 0x7fab280704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/870910752 >> v2:172.21.15.90:3300/0 conn(0x7fab280b0890 0x7fab280cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 -- 172.21.15.2:0/870910752 >> 172.21.15.2:0/870910752 conn(0x7fab280cebb0 msgr2=0x7fab280cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 -- 172.21.15.2:0/870910752 shutdown_connections 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 -- 172.21.15.2:0/870910752 wait complete. 2023-11-04T01:44:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 Processor -- start 2023-11-04T01:44:46.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 -- start start 2023-11-04T01:44:46.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab280b0890 0x7fab280c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280b0c70 0x7fab2814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.031+0000 7fab2ccfd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280c9960 0x7fab281504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2ccfd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab280c8830 con 0x7fab280c9960 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2ccfd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab28154ca0 con 0x7fab280b0890 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2ccfd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab28154f80 con 0x7fab280b0c70 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280c9960 0x7fab281504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280c9960 0x7fab281504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36326/0 (socket says 172.21.15.2:36326) 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 -- 172.21.15.2:0/1791960754 learned_addr learned my addr 172.21.15.2:0/1791960754 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2659c640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab280b0890 0x7fab280c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 -- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280b0c70 msgr2=0x7fab2814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280b0c70 0x7fab2814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 -- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab280b0890 msgr2=0x7fab280c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab280b0890 0x7fab280c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 -- 172.21.15.2:0/1791960754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20009b30 con 0x7fab280c9960 2023-11-04T01:44:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2659c640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab280b0890 0x7fab280c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab26d9d640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280c9960 0x7fab281504c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fab200af040 tx=0x7fab20019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab1effd640 1 -- 172.21.15.2:0/1791960754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200b8670 con 0x7fab280c9960 2023-11-04T01:44:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab1effd640 1 -- 172.21.15.2:0/1791960754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab200b87f0 con 0x7fab280c9960 2023-11-04T01:44:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab28155260 con 0x7fab280c9960 2023-11-04T01:44:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab1effd640 1 -- 172.21.15.2:0/1791960754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab200b8ba0 con 0x7fab280c9960 2023-11-04T01:44:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab28155820 con 0x7fab280c9960 2023-11-04T01:44:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab28155a10 con 0x7fab280c9960 2023-11-04T01:44:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab1effd640 1 -- 172.21.15.2:0/1791960754 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab200b8d00 con 0x7fab280c9960 2023-11-04T01:44:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab1effd640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab080664a0 0x7fab08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab1effd640 1 -- 172.21.15.2:0/1791960754 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fab20120290 con 0x7fab280c9960 2023-11-04T01:44:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2659c640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab080664a0 0x7fab08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.035+0000 7fab2659c640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab080664a0 0x7fab08068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab1800d940 tx=0x7fab18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.039+0000 7fab1effd640 1 -- 172.21.15.2:0/1791960754 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab200ed450 con 0x7fab280c9960 2023-11-04T01:44:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab280744a0 con 0x7fab280c9960 2023-11-04T01:44:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab1effd640 1 -- 172.21.15.2:0/1791960754 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab200f0a70 con 0x7fab280c9960 2023-11-04T01:44:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab080664a0 msgr2=0x7fab08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab080664a0 0x7fab08068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab1800d940 tx=0x7fab18008040 comp rx=0 tx=0).stop 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280c9960 msgr2=0x7fab281504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280c9960 0x7fab281504c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fab200af040 tx=0x7fab20019740 comp rx=0 tx=0).stop 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 shutdown_connections 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab080664a0 0x7fab08068960 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab280c9960 0x7fab281504c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fab280b0c70 0x7fab2814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 --2- 172.21.15.2:0/1791960754 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fab280b0890 0x7fab280c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 >> 172.21.15.2:0/1791960754 conn(0x7fab280cebb0 msgr2=0x7fab2815a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 shutdown_connections 2023-11-04T01:44:46.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.203+0000 7fab2ccfd640 1 -- 172.21.15.2:0/1791960754 wait complete. 2023-11-04T01:44:46.227 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:44:46.227 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:44:46.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:44:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:44:46.276 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[51324]: fuse finished with error 0 and tester_r 0 2023-11-04T01:44:46.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:46.284 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:44:46.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:46.284 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:44:46.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:44:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:44:46.292 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:46.292 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:46.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:46.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:44:46.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:46.299 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:44:46.347 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:44:46.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:46.348 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:46.348 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:46.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:44:46.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:44:46.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:46.354 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:44:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:44:46.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:46.400 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:46.400 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:46.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:46.405 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:44:46.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:44:46.405 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:44:46.451 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:44:46.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:44:46.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.571+0000 7f2dadb93640 1 Processor -- start 2023-11-04T01:44:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.571+0000 7f2dadb93640 1 -- start start 2023-11-04T01:44:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2dadb93640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da81435e0 0x7f2da80cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2dadb93640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2da80cead0 0x7f2da80c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2dadb93640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2da8070bf0 0x7f2da8071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2dadb93640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da80c59a0 con 0x7f2da80cead0 2023-11-04T01:44:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2dadb93640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da80715c0 con 0x7f2da8070bf0 2023-11-04T01:44:46.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2dadb93640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80cb9a0 con 0x7f2da81435e0 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2da80cead0 0x7f2da80c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2da80cead0 0x7f2da80c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36334/0 (socket says 172.21.15.2:36334) 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2236179692 learned_addr learned my addr 172.21.15.2:0/2236179692 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da7fff640 1 --2- 172.21.15.2:0/2236179692 >> v2:172.21.15.90:3300/0 conn(0x7f2da8070bf0 0x7f2da8071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da77fe640 1 --2- 172.21.15.2:0/2236179692 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da81435e0 0x7f2da80cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2236179692 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da81435e0 msgr2=0x7f2da80cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 --2- 172.21.15.2:0/2236179692 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da81435e0 0x7f2da80cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2236179692 >> v2:172.21.15.90:3300/0 conn(0x7f2da8070bf0 msgr2=0x7f2da8071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 --2- 172.21.15.2:0/2236179692 >> v2:172.21.15.90:3300/0 conn(0x7f2da8070bf0 0x7f2da8071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2236179692 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da80cb390 con 0x7f2da80cead0 2023-11-04T01:44:46.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da7fff640 1 --2- 172.21.15.2:0/2236179692 >> v2:172.21.15.90:3300/0 conn(0x7f2da8070bf0 0x7f2da8071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da6ffd640 1 --2- 172.21.15.2:0/2236179692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c4ae0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2da80ca630 tx=0x7f2d9401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23dde108e8755e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da67fc640 1 -- 172.21.15.2:0/2236179692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940aa5f0 con 0x7f2da80cead0 2023-11-04T01:44:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da67fc640 1 -- 172.21.15.2:0/2236179692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940aa750 con 0x7f2da80cead0 2023-11-04T01:44:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.575+0000 7f2da67fc640 1 -- 172.21.15.2:0/2236179692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940aaae0 con 0x7f2da80cead0 2023-11-04T01:44:46.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- 172.21.15.2:0/2236179692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 msgr2=0x7f2da80c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2236179692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c4ae0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2da80ca630 tx=0x7f2d9401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- 172.21.15.2:0/2236179692 shutdown_connections 2023-11-04T01:44:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2236179692 >> v2:172.21.15.90:3300/0 conn(0x7f2da8070bf0 0x7f2da8071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2236179692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c4ae0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2236179692 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da81435e0 0x7f2da80cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- 172.21.15.2:0/2236179692 >> 172.21.15.2:0/2236179692 conn(0x7f2da80cfc00 msgr2=0x7f2da80d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- 172.21.15.2:0/2236179692 shutdown_connections 2023-11-04T01:44:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- 172.21.15.2:0/2236179692 wait complete. 2023-11-04T01:44:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 Processor -- start 2023-11-04T01:44:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- start start 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da8070bf0 0x7f2da80b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2da81435e0 0x7f2da8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80c86e0 con 0x7f2da80cead0 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80b09a0 con 0x7f2da81435e0 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2dadb93640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80b0c80 con 0x7f2da8070bf0 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36346/0 (socket says 172.21.15.2:36346) 2023-11-04T01:44:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2155205642 learned_addr learned my addr 172.21.15.2:0/2155205642 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da7fff640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2da81435e0 0x7f2da8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da77fe640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da8070bf0 0x7f2da80b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da8070bf0 msgr2=0x7f2da80b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da8070bf0 0x7f2da80b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2da81435e0 msgr2=0x7f2da8158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2da81435e0 0x7f2da8158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 -- 172.21.15.2:0/2155205642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940094d0 con 0x7f2da80cead0 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da7fff640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2da81435e0 0x7f2da8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2da6ffd640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c81a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ac040 tx=0x7f2d9401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2d9ffff640 1 -- 172.21.15.2:0/2155205642 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940b3800 con 0x7f2da80cead0 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2d9ffff640 1 -- 172.21.15.2:0/2155205642 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940b3980 con 0x7f2da80cead0 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.579+0000 7f2d9ffff640 1 -- 172.21.15.2:0/2155205642 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d940b3d30 con 0x7f2da80cead0 2023-11-04T01:44:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da80b0f60 con 0x7f2da80cead0 2023-11-04T01:44:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da80af920 con 0x7f2da80cead0 2023-11-04T01:44:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da80c6790 con 0x7f2da80cead0 2023-11-04T01:44:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2d9ffff640 1 -- 172.21.15.2:0/2155205642 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2d940b2380 con 0x7f2da80cead0 2023-11-04T01:44:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2d9ffff640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2d900664a0 0x7f2d90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2d9ffff640 1 -- 172.21.15.2:0/2155205642 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f2d940a7070 con 0x7f2da80cead0 2023-11-04T01:44:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2da77fe640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2d900664a0 0x7f2d90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.583+0000 7f2da77fe640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2d900664a0 0x7f2d90068960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2da813a350 tx=0x7f2d98008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.587+0000 7f2d9ffff640 1 -- 172.21.15.2:0/2155205642 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2d940eba10 con 0x7f2da80cead0 2023-11-04T01:44:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.771+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2da80675f0 con 0x7f2da80cead0 2023-11-04T01:44:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.771+0000 7f2d9ffff640 1 -- 172.21.15.2:0/2155205642 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f2d940ef030 con 0x7f2da80cead0 2023-11-04T01:44:46.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:46.779 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5518,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3645027182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3645027182},{"type":"v1","addr":"172.21.15.90:6835","nonce":3645027182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1098346949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1098346949},{"type":"v1","addr":"172.21.15.90:6837","nonce":1098346949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/4012044748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4012044748},{"type":"v1","addr":"172.21.15.2:6834","nonce":4012044748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:44:26.337328+0000","modified":"2023-11-04T01:44:28.379532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6171":{"gid":6171,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3559920390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3559920390},{"type":"v1","addr":"172.21.15.2:6835","nonce":3559920390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:44:46.779 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-04T01:44:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2d900664a0 msgr2=0x7f2d90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2d900664a0 0x7f2d90068960 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2da813a350 tx=0x7f2d98008040 comp rx=0 tx=0).stop 2023-11-04T01:44:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 msgr2=0x7f2da80c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c81a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2d940ac040 tx=0x7f2d9401ad10 comp rx=0 tx=0).stop 2023-11-04T01:44:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 shutdown_connections 2023-11-04T01:44:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2d900664a0 0x7f2d90068960 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2da81435e0 0x7f2da8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2da80cead0 0x7f2da80c81a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 --2- 172.21.15.2:0/2155205642 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2da8070bf0 0x7f2da80b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 >> 172.21.15.2:0/2155205642 conn(0x7f2da80cfc00 msgr2=0x7f2da813b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 shutdown_connections 2023-11-04T01:44:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.775+0000 7f2dadb93640 1 -- 172.21.15.2:0/2155205642 wait complete. 2023-11-04T01:44:46.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977bdc6640 1 Processor -- start 2023-11-04T01:44:46.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977bdc6640 1 -- start start 2023-11-04T01:44:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977bdc6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f977415a1f0 0x7f97740cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977bdc6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f97740b0d40 0x7f97740704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977bdc6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740ccee0 con 0x7f97740cdea0 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977bdc6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977415a5d0 con 0x7f97740b0d40 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977bdc6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740ca900 con 0x7f977415a1f0 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f9779361640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f97740cdea0 0x7f97740b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:58088/0 (socket says 172.21.15.2:58088) 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f9779361640 1 -- 172.21.15.2:0/60120151 learned_addr learned my addr 172.21.15.2:0/60120151 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f9779b62640 1 --2- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f977415a1f0 0x7f97740cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.911+0000 7f977a363640 1 --2- 172.21.15.2:0/60120151 >> v2:172.21.15.90:3300/0 conn(0x7f97740b0d40 0x7f97740704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f9778b60640 1 -- 172.21.15.2:0/60120151 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398391051 0 0) 0x7f97740ccee0 con 0x7f97740cdea0 2023-11-04T01:44:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f9778b60640 1 -- 172.21.15.2:0/60120151 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9760003530 con 0x7f97740cdea0 2023-11-04T01:44:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f977a363640 1 -- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f977415a1f0 msgr2=0x7f97740cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f977a363640 1 --2- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f977415a1f0 0x7f97740cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f977a363640 1 -- 172.21.15.2:0/60120151 >> v1:172.21.15.90:6789/0 conn(0x7f97740cdea0 legacy=0x7f97740b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f977a363640 1 -- 172.21.15.2:0/60120151 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740cabe0 con 0x7f97740b0d40 2023-11-04T01:44:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f9779b62640 1 --2- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f977415a1f0 0x7f97740cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f977a363640 1 --2- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740b0d40 0x7f97740704e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f976c009d90 tx=0x7f976c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f9d3fd5fb26341 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f9778b60640 1 -- 172.21.15.2:0/60120151 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0a59e0 con 0x7f97740b0d40 2023-11-04T01:44:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f9778b60640 1 -- 172.21.15.2:0/60120151 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c0a5b40 con 0x7f97740b0d40 2023-11-04T01:44:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.915+0000 7f9778b60640 1 -- 172.21.15.2:0/60120151 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0ad440 con 0x7f97740b0d40 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740b0d40 msgr2=0x7f97740704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 --2- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740b0d40 0x7f97740704e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f976c009d90 tx=0x7f976c01c920 comp rx=0 tx=0).stop 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- 172.21.15.2:0/60120151 shutdown_connections 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 --2- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740b0d40 0x7f97740704e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 --2- 172.21.15.2:0/60120151 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f977415a1f0 0x7f97740cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- 172.21.15.2:0/60120151 >> 172.21.15.2:0/60120151 conn(0x7f97740cebb0 msgr2=0x7f97740cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- 172.21.15.2:0/60120151 shutdown_connections 2023-11-04T01:44:46.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- 172.21.15.2:0/60120151 wait complete. 2023-11-04T01:44:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 Processor -- start 2023-11-04T01:44:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- start start 2023-11-04T01:44:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97740b0d40 0x7f9774151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740cdea0 0x7f977414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f977415a1f0 0x7f977414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977414f060 con 0x7f977415a1f0 2023-11-04T01:44:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9774166e00 con 0x7f97740cdea0 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97741670e0 con 0x7f97740b0d40 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f977415a1f0 0x7f977414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f977415a1f0 0x7f977414e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36358/0 (socket says 172.21.15.2:36358) 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 -- 172.21.15.2:0/1144903244 learned_addr learned my addr 172.21.15.2:0/1144903244 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f9779361640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740cdea0 0x7f977414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f9779b62640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97740b0d40 0x7f9774151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 -- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97740b0d40 msgr2=0x7f9774151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97740b0d40 0x7f9774151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 -- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740cdea0 msgr2=0x7f977414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740cdea0 0x7f977414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 -- 172.21.15.2:0/1144903244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768009420 con 0x7f977415a1f0 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f9779b62640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97740b0d40 0x7f9774151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977a363640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f977415a1f0 0x7f977414e0e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f976c01afd0 tx=0x7f976c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f97667fc640 1 -- 172.21.15.2:0/1144903244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0adce0 con 0x7f977415a1f0 2023-11-04T01:44:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f97667fc640 1 -- 172.21.15.2:0/1144903244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c0ade40 con 0x7f977415a1f0 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c009a70 con 0x7f977415a1f0 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f97667fc640 1 -- 172.21.15.2:0/1144903244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0b9670 con 0x7f977415a1f0 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.919+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97741676a0 con 0x7f977415a1f0 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.923+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97740744a0 con 0x7f977415a1f0 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.923+0000 7f97667fc640 1 -- 172.21.15.2:0/1144903244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f976c0b97d0 con 0x7f977415a1f0 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.923+0000 7f97667fc640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f97580664d0 0x7f9758068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.923+0000 7f97667fc640 1 -- 172.21.15.2:0/1144903244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f976c11fa80 con 0x7f977415a1f0 2023-11-04T01:44:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.923+0000 7f9779b62640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f97580664d0 0x7f9758068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.923+0000 7f9779b62640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f97580664d0 0x7f9758068990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9768009ca0 tx=0x7f9768008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:46.927+0000 7f97667fc640 1 -- 172.21.15.2:0/1144903244 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f976c0eca20 con 0x7f977415a1f0 2023-11-04T01:44:47.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.083+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f977406cfb0 con 0x7f977415a1f0 2023-11-04T01:44:47.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.087+0000 7f97667fc640 1 -- 172.21.15.2:0/1144903244 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+21791 (secure 0 0 0) 0x7f976c009450 con 0x7f977415a1f0 2023-11-04T01:44:47.095 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:47.095 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":68,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:42.890805+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:44:24.247898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:44:25.345255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:47.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f97580664d0 msgr2=0x7f9758068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f97580664d0 0x7f9758068990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9768009ca0 tx=0x7f9768008040 comp rx=0 tx=0).stop 2023-11-04T01:44:47.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f977415a1f0 msgr2=0x7f977414e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f977415a1f0 0x7f977414e0e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f976c01afd0 tx=0x7f976c0196c0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 shutdown_connections 2023-11-04T01:44:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f97580664d0 0x7f9758068990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f977415a1f0 0x7f977414e0e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97740cdea0 0x7f977414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 --2- 172.21.15.2:0/1144903244 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f97740b0d40 0x7f9774151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 >> 172.21.15.2:0/1144903244 conn(0x7f97740cebb0 msgr2=0x7f97740c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 shutdown_connections 2023-11-04T01:44:47.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.091+0000 7f977bdc6640 1 -- 172.21.15.2:0/1144903244 wait complete. 2023-11-04T01:44:47.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:44:24.247898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:44:25.345255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:47.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:47.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe37b38b640 1 Processor -- start 2023-11-04T01:44:47.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe37b38b640 1 -- start start 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe37b38b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3740b0c20 0x7fe37415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe37b38b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740cb130 con 0x7fe37415acb0 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe37b38b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37415b680 con 0x7fe37415c160 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe37b38b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37415bd40 con 0x7fe3740b0c20 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe378926640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3740b0c20 0x7fe37415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe379127640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe37415acb0 0x7fe3740b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41808/0 (socket says 172.21.15.2:41808) 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe379127640 1 -- 172.21.15.2:0/93892415 learned_addr learned my addr 172.21.15.2:0/93892415 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:47.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe378926640 1 -- 172.21.15.2:0/93892415 >> v1:172.21.15.90:6789/0 conn(0x7fe37415c160 legacy=0x7fe3740ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe378926640 1 -- 172.21.15.2:0/93892415 >> v1:172.21.15.2:6789/0 conn(0x7fe37415acb0 legacy=0x7fe3740b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe36bfff640 1 -- 172.21.15.2:0/93892415 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018124894 0 0) 0x7fe3740cb130 con 0x7fe37415acb0 2023-11-04T01:44:47.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.239+0000 7fe378926640 1 -- 172.21.15.2:0/93892415 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37415b960 con 0x7fe3740b0c20 2023-11-04T01:44:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe378926640 1 --2- 172.21.15.2:0/93892415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe37415b090 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe3640097c0 tx=0x7fe36401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3921e062599e01e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe36bfff640 1 -- 172.21.15.2:0/93892415 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364004230 con 0x7fe3740b0c20 2023-11-04T01:44:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe36bfff640 1 -- 172.21.15.2:0/93892415 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3640a7050 con 0x7fe3740b0c20 2023-11-04T01:44:47.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe36bfff640 1 -- 172.21.15.2:0/93892415 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364003620 con 0x7fe3740b0c20 2023-11-04T01:44:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 -- 172.21.15.2:0/93892415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 msgr2=0x7fe37415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 --2- 172.21.15.2:0/93892415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe37415b090 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe3640097c0 tx=0x7fe36401c440 comp rx=0 tx=0).stop 2023-11-04T01:44:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 -- 172.21.15.2:0/93892415 shutdown_connections 2023-11-04T01:44:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 --2- 172.21.15.2:0/93892415 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe37415b090 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 -- 172.21.15.2:0/93892415 >> 172.21.15.2:0/93892415 conn(0x7fe3740cb510 msgr2=0x7fe3740cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 -- 172.21.15.2:0/93892415 shutdown_connections 2023-11-04T01:44:47.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 -- 172.21.15.2:0/93892415 wait complete. 2023-11-04T01:44:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 Processor -- start 2023-11-04T01:44:47.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.243+0000 7fe37b38b640 1 -- start start 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe374147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe37415acb0 0x7fe3740ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe37415c160 0x7fe3740ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37414f310 con 0x7fe3740b0c20 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37406b9a0 con 0x7fe37415acb0 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37406bc80 con 0x7fe37415c160 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe374147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe374147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36376/0 (socket says 172.21.15.2:36376) 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 -- 172.21.15.2:0/1427809441 learned_addr learned my addr 172.21.15.2:0/1427809441 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 -- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe37415c160 msgr2=0x7fe3740ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe37415c160 0x7fe3740ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 -- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe37415acb0 msgr2=0x7fe3740ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe37415acb0 0x7fe3740ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 -- 172.21.15.2:0/1427809441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe364009420 con 0x7fe3740b0c20 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe379127640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe374147f40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe3700011f0 tx=0x7fe37000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe369ffb640 1 -- 172.21.15.2:0/1427809441 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3700074e0 con 0x7fe3740b0c20 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe369ffb640 1 -- 172.21.15.2:0/1427809441 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370007640 con 0x7fe3740b0c20 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37406bf60 con 0x7fe3740b0c20 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe369ffb640 1 -- 172.21.15.2:0/1427809441 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370004a10 con 0x7fe3740b0c20 2023-11-04T01:44:47.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37415f680 con 0x7fe3740b0c20 2023-11-04T01:44:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37414f4e0 con 0x7fe3740b0c20 2023-11-04T01:44:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe369ffb640 1 -- 172.21.15.2:0/1427809441 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe370004b70 con 0x7fe3740b0c20 2023-11-04T01:44:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe369ffb640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3580664d0 0x7fe358068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe369ffb640 1 -- 172.21.15.2:0/1427809441 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fe3700837b0 con 0x7fe3740b0c20 2023-11-04T01:44:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.247+0000 7fe378926640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3580664d0 0x7fe358068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.251+0000 7fe378926640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3580664d0 0x7fe358068990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ad000 tx=0x7fe364004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.255+0000 7fe369ffb640 1 -- 172.21.15.2:0/1427809441 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe370050860 con 0x7fe3740b0c20 2023-11-04T01:44:47.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3740744a0 con 0x7fe3740b0c20 2023-11-04T01:44:47.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe369ffb640 1 -- 172.21.15.2:0/1427809441 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe370018020 con 0x7fe3740b0c20 2023-11-04T01:44:47.421 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:44:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3580664d0 msgr2=0x7fe358068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3580664d0 0x7fe358068990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ad000 tx=0x7fe364004740 comp rx=0 tx=0).stop 2023-11-04T01:44:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 msgr2=0x7fe374147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe374147f40 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe3700011f0 tx=0x7fe37000c9b0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 shutdown_connections 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3580664d0 0x7fe358068990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe37415c160 0x7fe3740ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe37415acb0 0x7fe3740ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 --2- 172.21.15.2:0/1427809441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3740b0c20 0x7fe374147f40 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.415+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 >> 172.21.15.2:0/1427809441 conn(0x7fe3740cb510 msgr2=0x7fe3740c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.419+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 shutdown_connections 2023-11-04T01:44:47.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.419+0000 7fe37b38b640 1 -- 172.21.15.2:0/1427809441 wait complete. 2023-11-04T01:44:47.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:47.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.563+0000 7f35685e1640 1 Processor -- start 2023-11-04T01:44:47.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.563+0000 7f35685e1640 1 -- start start 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f35685e1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015adb0 0x7f35600cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f35685e1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f356015b190 0x7f356015f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f35685e1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35600cb220 con 0x7f35600cced0 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f35685e1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356006fcd0 con 0x7f356015b190 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f35685e1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35600cac60 con 0x7f356015adb0 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f356015b190 0x7f356015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f356015b190 0x7f356015f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36382/0 (socket says 172.21.15.2:36382) 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 -- 172.21.15.2:0/196981753 learned_addr learned my addr 172.21.15.2:0/196981753 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:47.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f356637d640 1 --2- 172.21.15.2:0/196981753 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015adb0 0x7f35600cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 -- 172.21.15.2:0/196981753 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015adb0 msgr2=0x7f35600cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 --2- 172.21.15.2:0/196981753 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015adb0 0x7f35600cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 -- 172.21.15.2:0/196981753 >> v1:172.21.15.90:6789/0 conn(0x7f35600cced0 legacy=0x7f35600b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 -- 172.21.15.2:0/196981753 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600caf40 con 0x7f356015b190 2023-11-04T01:44:47.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f356637d640 1 --2- 172.21.15.2:0/196981753 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015adb0 0x7f35600cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.567+0000 7f3565b7c640 1 --2- 172.21.15.2:0/196981753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015b190 0x7f356015f030 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f355c009e50 tx=0x7f355c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665ac94a8b410045 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f356537b640 1 -- 172.21.15.2:0/196981753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0a5870 con 0x7f356015b190 2023-11-04T01:44:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f356537b640 1 -- 172.21.15.2:0/196981753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c0a59d0 con 0x7f356015b190 2023-11-04T01:44:47.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f356537b640 1 -- 172.21.15.2:0/196981753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0a5d60 con 0x7f356015b190 2023-11-04T01:44:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- 172.21.15.2:0/196981753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015b190 msgr2=0x7f356015f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 --2- 172.21.15.2:0/196981753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015b190 0x7f356015f030 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f355c009e50 tx=0x7f355c01c9e0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- 172.21.15.2:0/196981753 shutdown_connections 2023-11-04T01:44:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 --2- 172.21.15.2:0/196981753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015b190 0x7f356015f030 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 --2- 172.21.15.2:0/196981753 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015adb0 0x7f35600cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- 172.21.15.2:0/196981753 >> 172.21.15.2:0/196981753 conn(0x7f35600cb510 msgr2=0x7f35600cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:47.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- 172.21.15.2:0/196981753 shutdown_connections 2023-11-04T01:44:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- 172.21.15.2:0/196981753 wait complete. 2023-11-04T01:44:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 Processor -- start 2023-11-04T01:44:47.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- start start 2023-11-04T01:44:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35600cced0 0x7f3560158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015adb0 0x7f35600c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015b190 0x7f3560158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35600c2130 con 0x7f356015adb0 2023-11-04T01:44:47.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560158fc0 con 0x7f35600cced0 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3560158540 con 0x7f356015b190 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015adb0 0x7f35600c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015adb0 0x7f35600c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36388/0 (socket says 172.21.15.2:36388) 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 -- 172.21.15.2:0/877194514 learned_addr learned my addr 172.21.15.2:0/877194514 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f356637d640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35600cced0 0x7f3560158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3566b7e640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015b190 0x7f3560158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 -- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015b190 msgr2=0x7f3560158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015b190 0x7f3560158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 -- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35600cced0 msgr2=0x7f3560158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35600cced0 0x7f3560158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 -- 172.21.15.2:0/877194514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009b30 con 0x7f356015adb0 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f356637d640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35600cced0 0x7f3560158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3565b7c640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015adb0 0x7f35600c1bf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f355c0af040 tx=0x7f355c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3552ffd640 1 -- 172.21.15.2:0/877194514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0b8670 con 0x7f356015adb0 2023-11-04T01:44:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3552ffd640 1 -- 172.21.15.2:0/877194514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c0b8830 con 0x7f356015adb0 2023-11-04T01:44:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35600c5c00 con 0x7f356015adb0 2023-11-04T01:44:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f3552ffd640 1 -- 172.21.15.2:0/877194514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0b8be0 con 0x7f356015adb0 2023-11-04T01:44:47.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.571+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35600c6180 con 0x7f356015adb0 2023-11-04T01:44:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.575+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35600744a0 con 0x7f356015adb0 2023-11-04T01:44:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.575+0000 7f3552ffd640 1 -- 172.21.15.2:0/877194514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f355c0b8d40 con 0x7f356015adb0 2023-11-04T01:44:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.575+0000 7f3552ffd640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f35440664a0 0x7f3544068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.575+0000 7f3552ffd640 1 -- 172.21.15.2:0/877194514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f355c11f920 con 0x7f356015adb0 2023-11-04T01:44:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.575+0000 7f356637d640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f35440664a0 0x7f3544068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.575+0000 7f356637d640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f35440664a0 0x7f3544068960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f35601f8fd0 tx=0x7f3554008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.579+0000 7f3552ffd640 1 -- 172.21.15.2:0/877194514 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f355c0eca60 con 0x7f356015adb0 2023-11-04T01:44:47.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f35600cde40 con 0x7f356015adb0 2023-11-04T01:44:47.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f3552ffd640 1 -- 172.21.15.2:0/877194514 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v68) v1 ==== 103+0+11 (secure 0 0 0) 0x7f355c0f0080 con 0x7f356015adb0 2023-11-04T01:44:47.737 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f35440664a0 msgr2=0x7f3544068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f35440664a0 0x7f3544068960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f35601f8fd0 tx=0x7f3554008040 comp rx=0 tx=0).stop 2023-11-04T01:44:47.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015adb0 msgr2=0x7f35600c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015adb0 0x7f35600c1bf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f355c0af040 tx=0x7f355c019780 comp rx=0 tx=0).stop 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 shutdown_connections 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f35440664a0 0x7f3544068960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f356015b190 0x7f3560158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f356015adb0 0x7f35600c1bf0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 --2- 172.21.15.2:0/877194514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35600cced0 0x7f3560158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.731+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 >> 172.21.15.2:0/877194514 conn(0x7f35600cb510 msgr2=0x7f356006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.735+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 shutdown_connections 2023-11-04T01:44:47.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.735+0000 7f35685e1640 1 -- 172.21.15.2:0/877194514 wait complete. 2023-11-04T01:44:47.755 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:44:47.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.867+0000 7f5dd4a6f640 1 Processor -- start 2023-11-04T01:44:47.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.867+0000 7f5dd4a6f640 1 -- start start 2023-11-04T01:44:47.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dd4a6f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5dd015d0b0 0x7f5dd0160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dd4a6f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd01610f0 0x7f5dd00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dd4a6f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5dd00cfd50 0x7f5dd00b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dd4a6f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00d1520 con 0x7f5dd00cfd50 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dd4a6f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00d01e0 con 0x7f5dd015d0b0 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dd4a6f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00b5e00 con 0x7f5dd01610f0 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5dd00cfd50 0x7f5dd00b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5dd00cfd50 0x7f5dd00b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36396/0 (socket says 172.21.15.2:36396) 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 -- 172.21.15.2:0/2636621254 learned_addr learned my addr 172.21.15.2:0/2636621254 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dcdd9b640 1 --2- 172.21.15.2:0/2636621254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd01610f0 0x7f5dd00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dce59c640 1 --2- 172.21.15.2:0/2636621254 >> v2:172.21.15.90:3300/0 conn(0x7f5dd015d0b0 0x7f5dd0160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 -- 172.21.15.2:0/2636621254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd01610f0 msgr2=0x7f5dd00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 --2- 172.21.15.2:0/2636621254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd01610f0 0x7f5dd00cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 -- 172.21.15.2:0/2636621254 >> v2:172.21.15.90:3300/0 conn(0x7f5dd015d0b0 msgr2=0x7f5dd0160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:47.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 --2- 172.21.15.2:0/2636621254 >> v2:172.21.15.90:3300/0 conn(0x7f5dd015d0b0 0x7f5dd0160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 -- 172.21.15.2:0/2636621254 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd015d490 con 0x7f5dd00cfd50 2023-11-04T01:44:47.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dced9d640 1 --2- 172.21.15.2:0/2636621254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00b48c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5dd006b900 tx=0x7f5dc001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda4299752bf5c02 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dcd59a640 1 -- 172.21.15.2:0/2636621254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00ab600 con 0x7f5dd00cfd50 2023-11-04T01:44:47.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dcd59a640 1 -- 172.21.15.2:0/2636621254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc00a7050 con 0x7f5dd00cfd50 2023-11-04T01:44:47.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.871+0000 7f5dcd59a640 1 -- 172.21.15.2:0/2636621254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00ab980 con 0x7f5dd00cfd50 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/2636621254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 msgr2=0x7f5dd00b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/2636621254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00b48c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5dd006b900 tx=0x7f5dc001c240 comp rx=0 tx=0).stop 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/2636621254 shutdown_connections 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/2636621254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00b48c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/2636621254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd01610f0 0x7f5dd00cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/2636621254 >> v2:172.21.15.90:3300/0 conn(0x7f5dd015d0b0 0x7f5dd0160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/2636621254 >> 172.21.15.2:0/2636621254 conn(0x7f5dd006a890 msgr2=0x7f5dd006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/2636621254 shutdown_connections 2023-11-04T01:44:47.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/2636621254 wait complete. 2023-11-04T01:44:47.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 Processor -- start 2023-11-04T01:44:47.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- start start 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd015d0b0 0x7f5dd00b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd01610f0 0x7f5dd015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015e6a0 con 0x7f5dd00cfd50 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015da20 con 0x7f5dd01610f0 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015dd00 con 0x7f5dd015d0b0 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36412/0 (socket says 172.21.15.2:36412) 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 -- 172.21.15.2:0/1195005995 learned_addr learned my addr 172.21.15.2:0/1195005995 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dced9d640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd01610f0 0x7f5dd015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dcdd9b640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd015d0b0 0x7f5dd00b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 -- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd015d0b0 msgr2=0x7f5dd00b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd015d0b0 0x7f5dd00b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 -- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd01610f0 msgr2=0x7f5dd015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd01610f0 0x7f5dd015b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 -- 172.21.15.2:0/1195005995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00094d0 con 0x7f5dd00cfd50 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dce59c640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00c8a90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8007e60 tx=0x7f5dc800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dc6ffd640 1 -- 172.21.15.2:0/1195005995 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8014620 con 0x7f5dd00cfd50 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dc6ffd640 1 -- 172.21.15.2:0/1195005995 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc800ee90 con 0x7f5dd00cfd50 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd015dfe0 con 0x7f5dd00cfd50 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dc6ffd640 1 -- 172.21.15.2:0/1195005995 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc80149c0 con 0x7f5dd00cfd50 2023-11-04T01:44:47.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.875+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd015d6b0 con 0x7f5dd00cfd50 2023-11-04T01:44:47.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.879+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd00744a0 con 0x7f5dd00cfd50 2023-11-04T01:44:47.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.879+0000 7f5dc6ffd640 1 -- 172.21.15.2:0/1195005995 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5dc8014b20 con 0x7f5dd00cfd50 2023-11-04T01:44:47.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.879+0000 7f5dc6ffd640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5db00664a0 0x7f5db0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:47.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.879+0000 7f5dc6ffd640 1 -- 172.21.15.2:0/1195005995 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f5dc8084bf0 con 0x7f5dd00cfd50 2023-11-04T01:44:47.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.879+0000 7f5dcdd9b640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5db00664a0 0x7f5db0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:47.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.879+0000 7f5dcdd9b640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5db00664a0 0x7f5db0068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00b4180 tx=0x7f5db8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:47.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:47.883+0000 7f5dc6ffd640 1 -- 172.21.15.2:0/1195005995 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5dc8051c10 con 0x7f5dd00cfd50 2023-11-04T01:44:48.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.035+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5dd00d0e30 con 0x7f5dd00cfd50 2023-11-04T01:44:48.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dc6ffd640 1 -- 172.21.15.2:0/1195005995 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5dc8055230 con 0x7f5dd00cfd50 2023-11-04T01:44:48.044 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5db00664a0 msgr2=0x7f5db0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5db00664a0 0x7f5db0068960 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00b4180 tx=0x7f5db8008040 comp rx=0 tx=0).stop 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 msgr2=0x7f5dd00c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00c8a90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8007e60 tx=0x7f5dc800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 shutdown_connections 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5db00664a0 0x7f5db0068960 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dd01610f0 0x7f5dd015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5dd015d0b0 0x7f5dd00b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 --2- 172.21.15.2:0/1195005995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5dd00cfd50 0x7f5dd00c8a90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 >> 172.21.15.2:0/1195005995 conn(0x7f5dd006a890 msgr2=0x7f5dd00b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 shutdown_connections 2023-11-04T01:44:48.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.039+0000 7f5dd4a6f640 1 -- 172.21.15.2:0/1195005995 wait complete. 2023-11-04T01:44:48.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:44:48.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8cb9f640 1 Processor -- start 2023-11-04T01:44:48.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8cb9f640 1 -- start start 2023-11-04T01:44:48.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8cb9f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8815d0b0 0x7f6c88160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8cb9f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c880cff20 0x7f6c880d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8cb9f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880b5e00 con 0x7f6c881610f0 2023-11-04T01:44:48.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8cb9f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880d1520 con 0x7f6c880cff20 2023-11-04T01:44:48.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8cb9f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8815d490 con 0x7f6c8815d0b0 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c7ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c881610f0 0x7f6c880cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41812/0 (socket says 172.21.15.2:41812) 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c7ffff640 1 -- 172.21.15.2:0/2825105713 learned_addr learned my addr 172.21.15.2:0/2825105713 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c86d9d640 1 --2- 172.21.15.2:0/2825105713 >> v2:172.21.15.2:3300/0 conn(0x7f6c880cff20 0x7f6c880d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c85d9b640 1 -- 172.21.15.2:0/2825105713 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035519259 0 0) 0x7f6c880b5e00 con 0x7f6c881610f0 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c8659c640 1 --2- 172.21.15.2:0/2825105713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8815d0b0 0x7f6c88160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.171+0000 7f6c85d9b640 1 -- 172.21.15.2:0/2825105713 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c74003530 con 0x7f6c881610f0 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c86d9d640 1 -- 172.21.15.2:0/2825105713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8815d0b0 msgr2=0x7f6c88160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c86d9d640 1 --2- 172.21.15.2:0/2825105713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8815d0b0 0x7f6c88160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c85d9b640 1 -- 172.21.15.2:0/2825105713 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4010249495 0 0) 0x7f6c74003530 con 0x7f6c881610f0 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c86d9d640 1 -- 172.21.15.2:0/2825105713 >> v1:172.21.15.2:6789/0 conn(0x7f6c881610f0 legacy=0x7f6c880cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c86d9d640 1 -- 172.21.15.2:0/2825105713 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880b8930 con 0x7f6c880cff20 2023-11-04T01:44:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8659c640 1 --2- 172.21.15.2:0/2825105713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8815d0b0 0x7f6c88160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c86d9d640 1 --2- 172.21.15.2:0/2825105713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cff20 0x7f6c880d1940 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009d90 tx=0x7f6c8001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfbf4bde5155aa6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c85d9b640 1 -- 172.21.15.2:0/2825105713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70001680 con 0x7f6c880cff20 2023-11-04T01:44:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c85d9b640 1 -- 172.21.15.2:0/2825105713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c800a5580 con 0x7f6c880cff20 2023-11-04T01:44:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c85d9b640 1 -- 172.21.15.2:0/2825105713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c800a5910 con 0x7f6c880cff20 2023-11-04T01:44:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/2825105713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cff20 msgr2=0x7f6c880d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/2825105713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cff20 0x7f6c880d1940 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6c80009d90 tx=0x7f6c8001c870 comp rx=0 tx=0).stop 2023-11-04T01:44:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/2825105713 shutdown_connections 2023-11-04T01:44:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/2825105713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c880cff20 0x7f6c880d1940 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/2825105713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c8815d0b0 0x7f6c88160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/2825105713 >> 172.21.15.2:0/2825105713 conn(0x7f6c8806a890 msgr2=0x7f6c8806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/2825105713 shutdown_connections 2023-11-04T01:44:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.175+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/2825105713 wait complete. 2023-11-04T01:44:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 Processor -- start 2023-11-04T01:44:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 -- start start 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c880cff20 0x7f6c88155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c8815d0b0 0x7f6c8815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c881610f0 0x7f6c88152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88155800 con 0x7f6c8815d0b0 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88156160 con 0x7f6c880cff20 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88154bc0 con 0x7f6c881610f0 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c8815d0b0 0x7f6c8815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c8815d0b0 0x7f6c8815bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36428/0 (socket says 172.21.15.2:36428) 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 -- 172.21.15.2:0/418191368 learned_addr learned my addr 172.21.15.2:0/418191368 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8659c640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c880cff20 0x7f6c88155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 -- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c881610f0 msgr2=0x7f6c88152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c881610f0 0x7f6c88152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 -- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c880cff20 msgr2=0x7f6c88155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c880cff20 0x7f6c88155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 -- 172.21.15.2:0/418191368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80009a70 con 0x7f6c8815d0b0 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7ffff640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c8815d0b0 0x7f6c8815bff0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c750 tx=0x7f6c7000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7effd640 1 -- 172.21.15.2:0/418191368 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70005ae0 con 0x7f6c8815d0b0 2023-11-04T01:44:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7effd640 1 -- 172.21.15.2:0/418191368 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c70005c40 con 0x7f6c8815d0b0 2023-11-04T01:44:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c88154e60 con 0x7f6c8815d0b0 2023-11-04T01:44:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7effd640 1 -- 172.21.15.2:0/418191368 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70007070 con 0x7f6c8815d0b0 2023-11-04T01:44:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88155420 con 0x7f6c8815d0b0 2023-11-04T01:44:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88155940 con 0x7f6c8815d0b0 2023-11-04T01:44:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7effd640 1 -- 172.21.15.2:0/418191368 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c700071f0 con 0x7f6c8815d0b0 2023-11-04T01:44:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7effd640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c680664a0 0x7f6c68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c7effd640 1 -- 172.21.15.2:0/418191368 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f6c70084190 con 0x7f6c8815d0b0 2023-11-04T01:44:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.179+0000 7f6c8659c640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c680664a0 0x7f6c68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.183+0000 7f6c8659c640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c680664a0 0x7f6c68068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800d8b0 tx=0x7f6c78008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.183+0000 7f6c7effd640 1 -- 172.21.15.2:0/418191368 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c88155940 con 0x7f6c8815d0b0 2023-11-04T01:44:48.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c88155940 con 0x7f6c8815d0b0 2023-11-04T01:44:48.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c7effd640 1 -- 172.21.15.2:0/418191368 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c88155940 con 0x7f6c8815d0b0 2023-11-04T01:44:48.340 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:44:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c680664a0 msgr2=0x7f6c68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c680664a0 0x7f6c68068960 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800d8b0 tx=0x7f6c78008040 comp rx=0 tx=0).stop 2023-11-04T01:44:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c8815d0b0 msgr2=0x7f6c8815bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c8815d0b0 0x7f6c8815bff0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c750 tx=0x7f6c7000cc10 comp rx=0 tx=0).stop 2023-11-04T01:44:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 shutdown_connections 2023-11-04T01:44:48.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c680664a0 0x7f6c68068960 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c881610f0 0x7f6c88152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c8815d0b0 0x7f6c8815bff0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 --2- 172.21.15.2:0/418191368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c880cff20 0x7f6c88155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 >> 172.21.15.2:0/418191368 conn(0x7f6c8806a890 msgr2=0x7f6c880b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 shutdown_connections 2023-11-04T01:44:48.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.335+0000 7f6c8cb9f640 1 -- 172.21.15.2:0/418191368 wait complete. 2023-11-04T01:44:48.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.467+0000 7fc5ae0ec640 1 Processor -- start 2023-11-04T01:44:48.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.467+0000 7fc5ae0ec640 1 -- start start 2023-11-04T01:44:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5ae0ec640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 0x7fc5a80d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5ae0ec640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80b5e00 con 0x7fc5a80cf810 2023-11-04T01:44:48.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5ae0ec640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a815d490 con 0x7fc5a815d0b0 2023-11-04T01:44:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5ae0ec640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80d1520 con 0x7fc5a80cfc80 2023-11-04T01:44:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc5a80cf810 0x7fc5a80d1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41822/0 (socket says 172.21.15.2:41822) 2023-11-04T01:44:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 -- 172.21.15.2:0/3974347676 learned_addr learned my addr 172.21.15.2:0/3974347676 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:48.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a7fff640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 0x7fc5a80d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66746565 0 0) 0x7fc5a80b5e00 con 0x7fc5a80cf810 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc594003530 con 0x7fc5a80cf810 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260411161 0 0) 0x7fc5a815d490 con 0x7fc5a815d0b0 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a80b5e00 con 0x7fc5a815d0b0 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268168270 0 0) 0x7fc594003530 con 0x7fc5a80cf810 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 msgr2=0x7fc5a80d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 0x7fc5a80d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 >> v1:172.21.15.90:6789/0 conn(0x7fc5a815d0b0 legacy=0x7fc5a8160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80b8930 con 0x7fc5a80cf810 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc590001680 con 0x7fc5a80cf810 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 >> v1:172.21.15.2:6789/0 conn(0x7fc5a80cf810 legacy=0x7fc5a80d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 0x7fc594003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc594004d10 0x7fc594005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80d1520 con 0x7fc5940040a0 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59400ba70 con 0x7fc594004d10 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59400bc30 con 0x7fc5a80cfc80 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a77fe640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 0x7fc594003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a7fff640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc594004d10 0x7fc594005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 -- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 msgr2=0x7fc594003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:48.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a80cfc80 0x7fc594003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 -- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc594004d10 msgr2=0x7fc594005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:48.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc594004d10 0x7fc594005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc59effd640 1 -- 172.21.15.2:0/3974347676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594003530 con 0x7fc5940040a0 2023-11-04T01:44:48.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.471+0000 7fc5a7fff640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc594004d10 0x7fc594005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc59effd640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5940047d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c160 tx=0x7fc59001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc12a6b4896bd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900058e0 con 0x7fc5940040a0 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590005a60 con 0x7fc5940040a0 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a6ffd640 1 -- 172.21.15.2:0/3974347676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590005e50 con 0x7fc5940040a0 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/3974347676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 msgr2=0x7fc5940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 --2- 172.21.15.2:0/3974347676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5940047d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc59000c160 tx=0x7fc59001cba0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a7fff640 1 -- 172.21.15.2:0/3974347676 reap_dead start 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/3974347676 shutdown_connections 2023-11-04T01:44:48.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/3974347676 >> 172.21.15.2:0/3974347676 conn(0x7fc5a806a890 msgr2=0x7fc5a806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/3974347676 shutdown_connections 2023-11-04T01:44:48.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/3974347676 wait complete. 2023-11-04T01:44:48.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 Processor -- start 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- start start 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5a8151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a81f71f0 0x7fc5a8147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5a80d2890 0x7fc5a80d2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8153310 con 0x7fc5940040a0 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80d3250 con 0x7fc5a80d2890 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8152270 con 0x7fc5a81f71f0 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5a8151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5a8151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36448/0 (socket says 172.21.15.2:36448) 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 -- 172.21.15.2:0/2087881452 learned_addr learned my addr 172.21.15.2:0/2087881452 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc59effd640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a81f71f0 0x7fc5a8147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a7fff640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5a80d2890 0x7fc5a80d2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 -- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a81f71f0 msgr2=0x7fc5a8147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a81f71f0 0x7fc5a8147080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 -- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5a80d2890 msgr2=0x7fc5a80d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5a80d2890 0x7fc5a80d2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 -- 172.21.15.2:0/2087881452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a8152550 con 0x7fc5940040a0 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a77fe640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5a8151c90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc598011ee0 tx=0x7fc59800f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a4ff9640 1 -- 172.21.15.2:0/2087881452 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598015610 con 0x7fc5940040a0 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a4ff9640 1 -- 172.21.15.2:0/2087881452 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc598015770 con 0x7fc5940040a0 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a8152830 con 0x7fc5940040a0 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.475+0000 7fc5a4ff9640 1 -- 172.21.15.2:0/2087881452 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598015b20 con 0x7fc5940040a0 2023-11-04T01:44:48.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.479+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a8152df0 con 0x7fc5940040a0 2023-11-04T01:44:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.479+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a80744a0 con 0x7fc5940040a0 2023-11-04T01:44:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.479+0000 7fc5a4ff9640 1 -- 172.21.15.2:0/2087881452 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc598015c80 con 0x7fc5940040a0 2023-11-04T01:44:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.479+0000 7fc5a4ff9640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5880664a0 0x7fc588068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.479+0000 7fc5a4ff9640 1 -- 172.21.15.2:0/2087881452 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fc598087cb0 con 0x7fc5940040a0 2023-11-04T01:44:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.479+0000 7fc59effd640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5880664a0 0x7fc588068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.479+0000 7fc59effd640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5880664a0 0x7fc588068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc5900aa000 tx=0x7fc590001a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.483+0000 7fc5a4ff9640 1 -- 172.21.15.2:0/2087881452 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc598054cd0 con 0x7fc5940040a0 2023-11-04T01:44:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.635+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fc5a80b8550 con 0x7fc5940040a0 2023-11-04T01:44:48.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5a4ff9640 1 -- 172.21.15.2:0/2087881452 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v68) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5980582f0 con 0x7fc5940040a0 2023-11-04T01:44:48.644 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5880664a0 msgr2=0x7fc588068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5880664a0 0x7fc588068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc5900aa000 tx=0x7fc590001a00 comp rx=0 tx=0).stop 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 msgr2=0x7fc5a8151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5a8151c90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc598011ee0 tx=0x7fc59800f540 comp rx=0 tx=0).stop 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 shutdown_connections 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5880664a0 0x7fc588068960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5a80d2890 0x7fc5a80d2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5a81f71f0 0x7fc5a8147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 --2- 172.21.15.2:0/2087881452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5940040a0 0x7fc5a8151c90 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 >> 172.21.15.2:0/2087881452 conn(0x7fc5a806a890 msgr2=0x7fc5a80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 shutdown_connections 2023-11-04T01:44:48.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.639+0000 7fc5ae0ec640 1 -- 172.21.15.2:0/2087881452 wait complete. 2023-11-04T01:44:48.663 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:48.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f6675c6b640 1 Processor -- start 2023-11-04T01:44:48.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f6675c6b640 1 -- start start 2023-11-04T01:44:48.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f6675c6b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f66700ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f6675c6b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f66700b0c20 0x7f66700caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f6675c6b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667015f990 con 0x7f667015ad90 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f6675c6b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667015f570 con 0x7f66700b0c20 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f6675c6b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700cb2c0 con 0x7f667015b170 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f667015ad90 0x7f66700b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41832/0 (socket says 172.21.15.2:41832) 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666f7fe640 1 -- 172.21.15.2:0/2113560689 learned_addr learned my addr 172.21.15.2:0/2113560689 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666ffff640 1 --2- 172.21.15.2:0/2113560689 >> v2:172.21.15.2:3300/0 conn(0x7f66700b0c20 0x7f66700caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666e7fc640 1 -- 172.21.15.2:0/2113560689 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268888210 0 0) 0x7f6660001120 con 0x7f667015ad90 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666e7fc640 1 -- 172.21.15.2:0/2113560689 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6658003530 con 0x7f667015ad90 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666effd640 1 --2- 172.21.15.2:0/2113560689 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f66700ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666ffff640 1 -- 172.21.15.2:0/2113560689 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 msgr2=0x7f66700ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666ffff640 1 --2- 172.21.15.2:0/2113560689 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f66700ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666ffff640 1 -- 172.21.15.2:0/2113560689 >> v1:172.21.15.2:6789/0 conn(0x7f667015ad90 legacy=0x7f66700b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666ffff640 1 -- 172.21.15.2:0/2113560689 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667015ec10 con 0x7f66700b0c20 2023-11-04T01:44:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.779+0000 7f666effd640 1 --2- 172.21.15.2:0/2113560689 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f66700ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:48.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666ffff640 1 --2- 172.21.15.2:0/2113560689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f66700caad0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6668009dc0 tx=0x7f666801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab512c568f29d16c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666e7fc640 1 -- 172.21.15.2:0/2113560689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680a5960 con 0x7f66700b0c20 2023-11-04T01:44:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666e7fc640 1 -- 172.21.15.2:0/2113560689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680a5ac0 con 0x7f66700b0c20 2023-11-04T01:44:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666e7fc640 1 -- 172.21.15.2:0/2113560689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680a5e50 con 0x7f66700b0c20 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- 172.21.15.2:0/2113560689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 msgr2=0x7f66700caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 --2- 172.21.15.2:0/2113560689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f66700caad0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6668009dc0 tx=0x7f666801c8a0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- 172.21.15.2:0/2113560689 shutdown_connections 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 --2- 172.21.15.2:0/2113560689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f66700caad0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 --2- 172.21.15.2:0/2113560689 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f66700ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- 172.21.15.2:0/2113560689 >> 172.21.15.2:0/2113560689 conn(0x7f66700cb510 msgr2=0x7f66700cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- 172.21.15.2:0/2113560689 shutdown_connections 2023-11-04T01:44:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- 172.21.15.2:0/2113560689 wait complete. 2023-11-04T01:44:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 Processor -- start 2023-11-04T01:44:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- start start 2023-11-04T01:44:48.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f667015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f667015ad90 0x7f66700c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f6670155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c8130 con 0x7f66700b0c20 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c7690 con 0x7f667015ad90 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f6675c6b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c73b0 con 0x7f667015b170 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f667015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f667015caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36456/0 (socket says 172.21.15.2:36456) 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 -- 172.21.15.2:0/169528537 learned_addr learned my addr 172.21.15.2:0/169528537 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666ffff640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f6670155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666effd640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f667015ad90 0x7f66700c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 -- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 msgr2=0x7f6670155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f6670155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 -- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f667015ad90 msgr2=0x7f66700c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f667015ad90 0x7f66700c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.783+0000 7f666f7fe640 1 -- 172.21.15.2:0/169528537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668009a70 con 0x7f66700b0c20 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f666f7fe640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f667015caa0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f666000c700 tx=0x7f666000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6657fff640 1 -- 172.21.15.2:0/169528537 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660005ac0 con 0x7f66700b0c20 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6657fff640 1 -- 172.21.15.2:0/169528537 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6660005c60 con 0x7f66700b0c20 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700c7a70 con 0x7f66700b0c20 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6657fff640 1 -- 172.21.15.2:0/169528537 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660001d60 con 0x7f66700b0c20 2023-11-04T01:44:48.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700c7040 con 0x7f66700b0c20 2023-11-04T01:44:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66700c8a90 con 0x7f66700b0c20 2023-11-04T01:44:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6657fff640 1 -- 172.21.15.2:0/169528537 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6660007070 con 0x7f66700b0c20 2023-11-04T01:44:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6657fff640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f665c0664a0 0x7f665c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f6657fff640 1 -- 172.21.15.2:0/169528537 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f6660083650 con 0x7f66700b0c20 2023-11-04T01:44:48.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f666effd640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f665c0664a0 0x7f665c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.787+0000 7f666effd640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f665c0664a0 0x7f665c068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6664006fd0 tx=0x7f6664008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:48.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.791+0000 7f6657fff640 1 -- 172.21.15.2:0/169528537 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6660050680 con 0x7f66700b0c20 2023-11-04T01:44:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.943+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f667015f990 con 0x7f66700b0c20 2023-11-04T01:44:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.943+0000 7f6657fff640 1 -- 172.21.15.2:0/169528537 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v68) v1 ==== 107+0+11 (secure 0 0 0) 0x7f667015f990 con 0x7f66700b0c20 2023-11-04T01:44:48.950 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f665c0664a0 msgr2=0x7f665c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f665c0664a0 0x7f665c068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6664006fd0 tx=0x7f6664008040 comp rx=0 tx=0).stop 2023-11-04T01:44:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 msgr2=0x7f667015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f667015caa0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f666000c700 tx=0x7f666000cbc0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 shutdown_connections 2023-11-04T01:44:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f665c0664a0 0x7f665c068960 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667015b170 0x7f6670155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f667015ad90 0x7f66700c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 --2- 172.21.15.2:0/169528537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66700b0c20 0x7f667015caa0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 >> 172.21.15.2:0/169528537 conn(0x7f66700cb510 msgr2=0x7f66700cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 shutdown_connections 2023-11-04T01:44:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:48.947+0000 7f6675c6b640 1 -- 172.21.15.2:0/169528537 wait complete. 2023-11-04T01:44:48.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.083+0000 7f0949575640 1 Processor -- start 2023-11-04T01:44:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.083+0000 7f0949575640 1 -- start start 2023-11-04T01:44:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0949575640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 0x7f09440b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0949575640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440cd400 con 0x7f094415d690 2023-11-04T01:44:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0949575640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440cd6e0 con 0x7f094415d2b0 2023-11-04T01:44:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0949575640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440ad450 con 0x7f094406c630 2023-11-04T01:44:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09427fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f094415d690 0x7f094406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41844/0 (socket says 172.21.15.2:41844) 2023-11-04T01:44:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09427fc640 1 -- 172.21.15.2:0/2942084703 learned_addr learned my addr 172.21.15.2:0/2942084703 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09437fe640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 0x7f09440b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822540126 0 0) 0x7f09440cd400 con 0x7f094415d690 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0930003530 con 0x7f094415d690 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3238814306 0 0) 0x7f0930003530 con 0x7f094415d690 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 msgr2=0x7f09440b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 0x7f09440b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 >> v1:172.21.15.90:6789/0 conn(0x7f094415d2b0 legacy=0x7f09440ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440ad070 con 0x7f094415d690 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f092c0016a0 con 0x7f094415d690 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 >> v1:172.21.15.2:6789/0 conn(0x7f094415d690 legacy=0x7f094406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09300039b0 0x7f0930003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 0x7f09300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0930004d10 0x7f0930005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440ad450 con 0x7f0930004d10 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093000baf0 con 0x7f09300039b0 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093000bcb0 con 0x7f094406c630 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09437fe640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0930004d10 0x7f0930005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f0942ffd640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09300039b0 0x7f0930003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09427fc640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 0x7f09300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09437fe640 1 -- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 msgr2=0x7f09300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09437fe640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f094406c630 0x7f09300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09437fe640 1 -- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09300039b0 msgr2=0x7f0930003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09437fe640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f09300039b0 0x7f0930003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.087+0000 7f09437fe640 1 -- 172.21.15.2:0/2942084703 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930003530 con 0x7f0930004d10 2023-11-04T01:44:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0930004d10 0x7f0930005190 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0934009ae0 tx=0x7f093401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fdea16c23015e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340a5530 con 0x7f0930004d10 2023-11-04T01:44:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09340a5690 con 0x7f0930004d10 2023-11-04T01:44:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0941ffb640 1 -- 172.21.15.2:0/2942084703 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340a5a40 con 0x7f0930004d10 2023-11-04T01:44:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- 172.21.15.2:0/2942084703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0930004d10 msgr2=0x7f0930005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 --2- 172.21.15.2:0/2942084703 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0930004d10 0x7f0930005190 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0934009ae0 tx=0x7f093401ca50 comp rx=0 tx=0).stop 2023-11-04T01:44:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 -- 172.21.15.2:0/2942084703 reap_dead start 2023-11-04T01:44:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- 172.21.15.2:0/2942084703 shutdown_connections 2023-11-04T01:44:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- 172.21.15.2:0/2942084703 >> 172.21.15.2:0/2942084703 conn(0x7f09440cebb0 msgr2=0x7f09440cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- 172.21.15.2:0/2942084703 shutdown_connections 2023-11-04T01:44:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- 172.21.15.2:0/2942084703 wait complete. 2023-11-04T01:44:49.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 Processor -- start 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- start start 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0930004d10 0x7f09440c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09440c8840 0x7f09440c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0944151060 0x7f094415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440c3500 con 0x7f0944151060 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440c4000 con 0x7f0930004d10 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0949575640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440c42e0 con 0x7f09440c8840 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0944151060 0x7f094415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0944151060 0x7f094415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36476/0 (socket says 172.21.15.2:36476) 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 -- 172.21.15.2:0/3438795223 learned_addr learned my addr 172.21.15.2:0/3438795223 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:49.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0942ffd640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0930004d10 0x7f09440c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 -- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09440c8840 msgr2=0x7f09440c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09440c8840 0x7f09440c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 -- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0930004d10 msgr2=0x7f09440c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0930004d10 0x7f09440c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f09437fe640 1 -- 172.21.15.2:0/3438795223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440c24e0 con 0x7f0944151060 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.091+0000 7f0942ffd640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0930004d10 0x7f09440c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f09437fe640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0944151060 0x7f094415b980 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0934009ae0 tx=0x7f0930005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f093b7fe640 1 -- 172.21.15.2:0/3438795223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340a5530 con 0x7f0944151060 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f093b7fe640 1 -- 172.21.15.2:0/3438795223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934004230 con 0x7f0944151060 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f093b7fe640 1 -- 172.21.15.2:0/3438795223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934003620 con 0x7f0944151060 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09440c27c0 con 0x7f0944151060 2023-11-04T01:44:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09440c3cf0 con 0x7f0944151060 2023-11-04T01:44:49.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09440c2340 con 0x7f0944151060 2023-11-04T01:44:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f093b7fe640 1 -- 172.21.15.2:0/3438795223 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f09340b4070 con 0x7f0944151060 2023-11-04T01:44:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f093b7fe640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f09240664d0 0x7f0924068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f093b7fe640 1 -- 172.21.15.2:0/3438795223 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f093411da50 con 0x7f0944151060 2023-11-04T01:44:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f0942ffd640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f09240664d0 0x7f0924068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.095+0000 7f0942ffd640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f09240664d0 0x7f0924068990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f093c001dd0 tx=0x7f093c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.099+0000 7f093b7fe640 1 -- 172.21.15.2:0/3438795223 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f09440c2340 con 0x7f0944151060 2023-11-04T01:44:49.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.291+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09440c2340 con 0x7f0944151060 2023-11-04T01:44:49.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.291+0000 7f093b7fe640 1 -- 172.21.15.2:0/3438795223 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f09440c2340 con 0x7f0944151060 2023-11-04T01:44:49.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:49.297 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5518,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3645027182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3645027182},{"type":"v1","addr":"172.21.15.90:6835","nonce":3645027182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1098346949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1098346949},{"type":"v1","addr":"172.21.15.90:6837","nonce":1098346949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/4012044748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4012044748},{"type":"v1","addr":"172.21.15.2:6834","nonce":4012044748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:44:26.337328+0000","modified":"2023-11-04T01:44:28.379532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6171":{"gid":6171,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3559920390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3559920390},{"type":"v1","addr":"172.21.15.2:6835","nonce":3559920390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:44:49.297 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-04T01:44:49.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.291+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f09240664d0 msgr2=0x7f0924068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.291+0000 7f0949575640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f09240664d0 0x7f0924068990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f093c001dd0 tx=0x7f093c009040 comp rx=0 tx=0).stop 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.291+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0944151060 msgr2=0x7f094415b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.291+0000 7f0949575640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0944151060 0x7f094415b980 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0934009ae0 tx=0x7f0930005800 comp rx=0 tx=0).stop 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 shutdown_connections 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f09240664d0 0x7f0924068990 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0944151060 0x7f094415b980 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f09440c8840 0x7f09440c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 --2- 172.21.15.2:0/3438795223 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0930004d10 0x7f09440c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 >> 172.21.15.2:0/3438795223 conn(0x7f09440cebb0 msgr2=0x7f094415abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 shutdown_connections 2023-11-04T01:44:49.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.295+0000 7f0949575640 1 -- 172.21.15.2:0/3438795223 wait complete. 2023-11-04T01:44:49.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:49.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.435+0000 7fcfb7c0e640 1 Processor -- start 2023-11-04T01:44:49.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.435+0000 7fcfb7c0e640 1 -- start start 2023-11-04T01:44:49.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb7c0e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfb015afd0 0x7fcfb00715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb7c0e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcfb006f8f0 0x7fcfb00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb7c0e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00c2670 con 0x7fcfb00b0b70 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb7c0e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb0070140 con 0x7fcfb015afd0 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb7c0e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb015fc90 con 0x7fcfb006f8f0 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfb015afd0 0x7fcfb00715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcfb015afd0 0x7fcfb00715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36478/0 (socket says 172.21.15.2:36478) 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 -- 172.21.15.2:0/3444505619 learned_addr learned my addr 172.21.15.2:0/3444505619 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb51a9640 1 --2- 172.21.15.2:0/3444505619 >> v2:172.21.15.90:3300/0 conn(0x7fcfb006f8f0 0x7fcfb00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 -- 172.21.15.2:0/3444505619 >> v2:172.21.15.90:3300/0 conn(0x7fcfb006f8f0 msgr2=0x7fcfb00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 --2- 172.21.15.2:0/3444505619 >> v2:172.21.15.90:3300/0 conn(0x7fcfb006f8f0 0x7fcfb00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 -- 172.21.15.2:0/3444505619 >> v1:172.21.15.90:6789/0 conn(0x7fcfb00b0b70 legacy=0x7fcfb00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 -- 172.21.15.2:0/3444505619 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb006bc30 con 0x7fcfb015afd0 2023-11-04T01:44:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb59aa640 1 --2- 172.21.15.2:0/3444505619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb00715d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00ce900 tx=0x7fcfac01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33df04271d97e0c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb49a8640 1 -- 172.21.15.2:0/3444505619 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0ab600 con 0x7fcfb015afd0 2023-11-04T01:44:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb49a8640 1 -- 172.21.15.2:0/3444505619 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac0a7050 con 0x7fcfb015afd0 2023-11-04T01:44:49.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.439+0000 7fcfb49a8640 1 -- 172.21.15.2:0/3444505619 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0ab980 con 0x7fcfb015afd0 2023-11-04T01:44:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/3444505619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 msgr2=0x7fcfb00715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/3444505619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb00715d0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00ce900 tx=0x7fcfac01c4c0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/3444505619 shutdown_connections 2023-11-04T01:44:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/3444505619 >> v2:172.21.15.90:3300/0 conn(0x7fcfb006f8f0 0x7fcfb00b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/3444505619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb00715d0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/3444505619 >> 172.21.15.2:0/3444505619 conn(0x7fcfb00cebb0 msgr2=0x7fcfb00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/3444505619 shutdown_connections 2023-11-04T01:44:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/3444505619 wait complete. 2023-11-04T01:44:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 Processor -- start 2023-11-04T01:44:49.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- start start 2023-11-04T01:44:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfb006f8f0 0x7fcfb00c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfb00b0b70 0x7fcfb0154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb01f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb014c540 con 0x7fcfb015afd0 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00c37b0 con 0x7fcfb00b0b70 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00c4180 con 0x7fcfb006f8f0 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb01f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb01f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36490/0 (socket says 172.21.15.2:36490) 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 -- 172.21.15.2:0/4203510714 learned_addr learned my addr 172.21.15.2:0/4203510714 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb51a9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfb00b0b70 0x7fcfb0154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb59aa640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfb006f8f0 0x7fcfb00c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 -- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfb006f8f0 msgr2=0x7fcfb00c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfb006f8f0 0x7fcfb00c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 -- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfb00b0b70 msgr2=0x7fcfb0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfb00b0b70 0x7fcfb0154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 -- 172.21.15.2:0/4203510714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac0094d0 con 0x7fcfb015afd0 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb61ab640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb01f9720 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c7b0 tx=0x7fcfa800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfa67fc640 1 -- 172.21.15.2:0/4203510714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8004b70 con 0x7fcfb015afd0 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfa67fc640 1 -- 172.21.15.2:0/4203510714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8004cd0 con 0x7fcfb015afd0 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb0154ac0 con 0x7fcfb015afd0 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfa67fc640 1 -- 172.21.15.2:0/4203510714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800aa90 con 0x7fcfb015afd0 2023-11-04T01:44:49.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.443+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00c2e80 con 0x7fcfb015afd0 2023-11-04T01:44:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.447+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb00744a0 con 0x7fcfb015afd0 2023-11-04T01:44:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.447+0000 7fcfa67fc640 1 -- 172.21.15.2:0/4203510714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfa800abf0 con 0x7fcfb015afd0 2023-11-04T01:44:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.447+0000 7fcfa67fc640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf940664a0 0x7fcf94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.447+0000 7fcfa67fc640 1 -- 172.21.15.2:0/4203510714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fcfa80843a0 con 0x7fcfb015afd0 2023-11-04T01:44:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.447+0000 7fcfb59aa640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf940664a0 0x7fcf94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.447+0000 7fcfb59aa640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf940664a0 0x7fcf94068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0ad000 tx=0x7fcfac0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.451+0000 7fcfa67fc640 1 -- 172.21.15.2:0/4203510714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcfa8051450 con 0x7fcfb015afd0 2023-11-04T01:44:49.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.607+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb00c38f0 con 0x7fcfb015afd0 2023-11-04T01:44:49.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfa67fc640 1 -- 172.21.15.2:0/4203510714 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+21747 (secure 0 0 0) 0x7fcfa8054a70 con 0x7fcfb015afd0 2023-11-04T01:44:49.616 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:49.616 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":69,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:49.539745+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:44:24.247898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:44:25.345255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:49.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf940664a0 msgr2=0x7fcf94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf940664a0 0x7fcf94068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0ad000 tx=0x7fcfac0a6000 comp rx=0 tx=0).stop 2023-11-04T01:44:49.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 msgr2=0x7fcfb01f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb01f9720 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c7b0 tx=0x7fcfa800cc70 comp rx=0 tx=0).stop 2023-11-04T01:44:49.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 shutdown_connections 2023-11-04T01:44:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcf940664a0 0x7fcf94068960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcfb015afd0 0x7fcfb01f9720 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcfb00b0b70 0x7fcfb0154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 --2- 172.21.15.2:0/4203510714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcfb006f8f0 0x7fcfb00c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 >> 172.21.15.2:0/4203510714 conn(0x7fcfb00cebb0 msgr2=0x7fcfb00cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 shutdown_connections 2023-11-04T01:44:49.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.611+0000 7fcfb7c0e640 1 -- 172.21.15.2:0/4203510714 wait complete. 2023-11-04T01:44:49.634 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:44:49.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:49.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.739+0000 7f4bd4ee4640 1 Processor -- start 2023-11-04T01:44:49.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.739+0000 7f4bd4ee4640 1 -- start start 2023-11-04T01:44:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bd4ee4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bd00b4990 0x7f4bd00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bd4ee4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00b74f0 0x7f4bd00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bd4ee4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd00b6070 con 0x7f4bd00d0690 2023-11-04T01:44:49.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bd4ee4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd00b8ed0 con 0x7f4bd00b4990 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bd4ee4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00b52b0 con 0x7f4bd00b74f0 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bd00b4990 0x7f4bd00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bd00b4990 0x7f4bd00b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36494/0 (socket says 172.21.15.2:36494) 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 -- 172.21.15.2:0/3293933150 learned_addr learned my addr 172.21.15.2:0/3293933150 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bced9d640 1 --2- 172.21.15.2:0/3293933150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00b74f0 0x7f4bd00cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 -- 172.21.15.2:0/3293933150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00b74f0 msgr2=0x7f4bd00cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 --2- 172.21.15.2:0/3293933150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00b74f0 0x7f4bd00cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 -- 172.21.15.2:0/3293933150 >> v1:172.21.15.90:6789/0 conn(0x7f4bd00d0690 legacy=0x7f4bd00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 -- 172.21.15.2:0/3293933150 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00d1ce0 con 0x7f4bd00b4990 2023-11-04T01:44:49.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bced9d640 1 --2- 172.21.15.2:0/3293933150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00b74f0 0x7f4bd00cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bce59c640 1 --2- 172.21.15.2:0/3293933150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd00b4d70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009870 tx=0x7f4bc001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627a048f679c2b97 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bcdd9b640 1 -- 172.21.15.2:0/3293933150 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00a89b0 con 0x7f4bd00b4990 2023-11-04T01:44:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bcdd9b640 1 -- 172.21.15.2:0/3293933150 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc00a8b10 con 0x7f4bd00b4990 2023-11-04T01:44:49.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.743+0000 7f4bcdd9b640 1 -- 172.21.15.2:0/3293933150 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00a8ea0 con 0x7f4bd00b4990 2023-11-04T01:44:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/3293933150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 msgr2=0x7f4bd00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/3293933150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd00b4d70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009870 tx=0x7f4bc001ecf0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/3293933150 shutdown_connections 2023-11-04T01:44:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/3293933150 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00b74f0 0x7f4bd00cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/3293933150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd00b4d70 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/3293933150 >> 172.21.15.2:0/3293933150 conn(0x7f4bd00cf990 msgr2=0x7f4bd00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/3293933150 shutdown_connections 2023-11-04T01:44:49.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/3293933150 wait complete. 2023-11-04T01:44:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 Processor -- start 2023-11-04T01:44:49.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- start start 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd014b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd00b74f0 0x7f4bd015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00d0690 0x7f4bd015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd015f0d0 con 0x7f4bd00b4990 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01559b0 con 0x7f4bd00b74f0 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd015e550 con 0x7f4bd00d0690 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd014b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd014b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36506/0 (socket says 172.21.15.2:36506) 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 -- 172.21.15.2:0/1729612239 learned_addr learned my addr 172.21.15.2:0/1729612239 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bc7fff640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd00b74f0 0x7f4bd015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bced9d640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00d0690 0x7f4bd015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 -- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00d0690 msgr2=0x7f4bd015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00d0690 0x7f4bd015fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 -- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd00b74f0 msgr2=0x7f4bd015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd00b74f0 0x7f4bd015f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 -- 172.21.15.2:0/1729612239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00094d0 con 0x7f4bd00b4990 2023-11-04T01:44:49.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bce59c640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd014b1d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4bc001f590 tx=0x7f4bc001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bc6ffd640 1 -- 172.21.15.2:0/1729612239 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00c1070 con 0x7f4bd00b4990 2023-11-04T01:44:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bc6ffd640 1 -- 172.21.15.2:0/1729612239 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc00b0c90 con 0x7f4bd00b4990 2023-11-04T01:44:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd015e830 con 0x7f4bd00b4990 2023-11-04T01:44:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bc6ffd640 1 -- 172.21.15.2:0/1729612239 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc00bb420 con 0x7f4bd00b4990 2023-11-04T01:44:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd015edf0 con 0x7f4bd00b4990 2023-11-04T01:44:49.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.747+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd0155b70 con 0x7f4bd00b4990 2023-11-04T01:44:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.751+0000 7f4bc6ffd640 1 -- 172.21.15.2:0/1729612239 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4bc00b7040 con 0x7f4bd00b4990 2023-11-04T01:44:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.751+0000 7f4bc6ffd640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4bb00664a0 0x7f4bb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.751+0000 7f4bc6ffd640 1 -- 172.21.15.2:0/1729612239 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f4bc01225f0 con 0x7f4bd00b4990 2023-11-04T01:44:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.751+0000 7f4bc7fff640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4bb00664a0 0x7f4bb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:49.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.751+0000 7f4bc7fff640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4bb00664a0 0x7f4bb0068960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b4260 tx=0x7f4bb8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:49.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.755+0000 7f4bc6ffd640 1 -- 172.21.15.2:0/1729612239 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4bc00ef730 con 0x7f4bd00b4990 2023-11-04T01:44:49.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.947+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bd00744a0 con 0x7f4bd00b4990 2023-11-04T01:44:49.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.947+0000 7f4bc6ffd640 1 -- 172.21.15.2:0/1729612239 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4908 (secure 0 0 0) 0x7f4bc00f2d50 con 0x7f4bd00b4990 2023-11-04T01:44:49.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:49.954 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5518,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3645027182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3645027182},{"type":"v1","addr":"172.21.15.90:6835","nonce":3645027182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1098346949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1098346949},{"type":"v1","addr":"172.21.15.90:6837","nonce":1098346949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/4012044748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4012044748},{"type":"v1","addr":"172.21.15.2:6834","nonce":4012044748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:44:26.337328+0000","modified":"2023-11-04T01:44:28.379532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6171":{"gid":6171,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3559920390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3559920390},{"type":"v1","addr":"172.21.15.2:6835","nonce":3559920390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:44:49.955 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-04T01:44:49.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4bb00664a0 msgr2=0x7f4bb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4bb00664a0 0x7f4bb0068960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b4260 tx=0x7f4bb8009040 comp rx=0 tx=0).stop 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 msgr2=0x7f4bd014b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd014b1d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f4bc001f590 tx=0x7f4bc001ba90 comp rx=0 tx=0).stop 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 shutdown_connections 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4bb00664a0 0x7f4bb0068960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bd00d0690 0x7f4bd015fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bd00b74f0 0x7f4bd015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 --2- 172.21.15.2:0/1729612239 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd00b4990 0x7f4bd014b1d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 >> 172.21.15.2:0/1729612239 conn(0x7f4bd00cf990 msgr2=0x7f4bd00cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 shutdown_connections 2023-11-04T01:44:49.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:49.951+0000 7f4bd4ee4640 1 -- 172.21.15.2:0/1729612239 wait complete. 2023-11-04T01:44:49.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3b2921640 1 Processor -- start 2023-11-04T01:44:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3b2921640 1 -- start start 2023-11-04T01:44:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3b2921640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 0x7fc3ac0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3b2921640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac0b4270 con 0x7fc3ac15d540 2023-11-04T01:44:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3b2921640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac06cb40 con 0x7fc3ac06a370 2023-11-04T01:44:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3b2921640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac06ce20 con 0x7fc3ac0722e0 2023-11-04T01:44:50.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3abfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc3ac15d540 0x7fc3ac06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41858/0 (socket says 172.21.15.2:41858) 2023-11-04T01:44:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3abfff640 1 -- 172.21.15.2:0/2622456423 learned_addr learned my addr 172.21.15.2:0/2622456423 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174222307 0 0) 0x7fc3ac0b4270 con 0x7fc3ac15d540 2023-11-04T01:44:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc398003530 con 0x7fc3ac15d540 2023-11-04T01:44:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 0x7fc3ac0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3462433175 0 0) 0x7fc398003530 con 0x7fc3ac15d540 2023-11-04T01:44:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 msgr2=0x7fc3ac0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 0x7fc3ac0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 >> v1:172.21.15.90:6789/0 conn(0x7fc3ac06a370 legacy=0x7fc3ac0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac06d100 con 0x7fc3ac15d540 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc394001680 con 0x7fc3ac15d540 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 >> v1:172.21.15.2:6789/0 conn(0x7fc3ac15d540 legacy=0x7fc3ac06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 0x7fc3980039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc398004d60 0x7fc3980051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac06ce20 con 0x7fc398003fe0 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39800bc70 con 0x7fc398004d60 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39800be30 con 0x7fc3ac0722e0 2023-11-04T01:44:50.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3b0ebe640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc398004d60 0x7fc3980051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3abfff640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 0x7fc3980039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3ab7fe640 1 -- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 msgr2=0x7fc3980039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac0722e0 0x7fc3980039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3ab7fe640 1 -- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc398004d60 msgr2=0x7fc3980051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc398004d60 0x7fc3980051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.099+0000 7fc3ab7fe640 1 -- 172.21.15.2:0/2622456423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398003530 con 0x7fc398003fe0 2023-11-04T01:44:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3980047d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00ba00 tx=0x7fc39c01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966eef0740645485 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0a4970 con 0x7fc398003fe0 2023-11-04T01:44:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c0a8070 con 0x7fc398003fe0 2023-11-04T01:44:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3aaffd640 1 -- 172.21.15.2:0/2622456423 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0a4d10 con 0x7fc398003fe0 2023-11-04T01:44:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3b2921640 1 -- 172.21.15.2:0/2622456423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 msgr2=0x7fc3980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3b2921640 1 --2- 172.21.15.2:0/2622456423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3980047d0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00ba00 tx=0x7fc39c01c320 comp rx=0 tx=0).stop 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3b0ebe640 1 -- 172.21.15.2:0/2622456423 reap_dead start 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3b2921640 1 -- 172.21.15.2:0/2622456423 shutdown_connections 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3b2921640 1 -- 172.21.15.2:0/2622456423 >> 172.21.15.2:0/2622456423 conn(0x7fc3ac0716a0 msgr2=0x7fc3ac071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3b2921640 1 -- 172.21.15.2:0/2622456423 shutdown_connections 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.103+0000 7fc3b2921640 1 -- 172.21.15.2:0/2622456423 wait complete. 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 Processor -- start 2023-11-04T01:44:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 -- start start 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3ac0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3ac1fad80 0x7fc3ac0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac155e60 0x7fc3ac0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1fb200 con 0x7fc398003fe0 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0afd80 con 0x7fc3ac1fad80 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0c56f0 con 0x7fc3ac155e60 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3ac0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3ac0c64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36522/0 (socket says 172.21.15.2:36522) 2023-11-04T01:44:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 -- 172.21.15.2:0/2430287491 learned_addr learned my addr 172.21.15.2:0/2430287491 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3ac1fad80 0x7fc3ac0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b0ebe640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac155e60 0x7fc3ac0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 -- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac155e60 msgr2=0x7fc3ac0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac155e60 0x7fc3ac0b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 -- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3ac1fad80 msgr2=0x7fc3ac0c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3ac1fad80 0x7fc3ac0c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 -- 172.21.15.2:0/2430287491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac06ad10 con 0x7fc398003fe0 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3ac1fad80 0x7fc3ac0c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3abfff640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3ac0c64f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e7e0 tx=0x7fc39400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3a8ff9640 1 -- 172.21.15.2:0/2430287491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400c870 con 0x7fc398003fe0 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3a8ff9640 1 -- 172.21.15.2:0/2430287491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39400c9f0 con 0x7fc398003fe0 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac1562e0 con 0x7fc398003fe0 2023-11-04T01:44:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3a8ff9640 1 -- 172.21.15.2:0/2430287491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400cda0 con 0x7fc398003fe0 2023-11-04T01:44:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac1fb6c0 con 0x7fc398003fe0 2023-11-04T01:44:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ac0675f0 con 0x7fc398003fe0 2023-11-04T01:44:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.107+0000 7fc3a8ff9640 1 -- 172.21.15.2:0/2430287491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc394013420 con 0x7fc398003fe0 2023-11-04T01:44:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.111+0000 7fc3a8ff9640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc38c0664d0 0x7fc38c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.111+0000 7fc3a8ff9640 1 -- 172.21.15.2:0/2430287491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fc394083e80 con 0x7fc398003fe0 2023-11-04T01:44:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.111+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc38c0664d0 0x7fc38c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.111+0000 7fc3ab7fe640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc38c0664d0 0x7fc38c068990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0af000 tx=0x7fc39c0046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.115+0000 7fc3a8ff9640 1 -- 172.21.15.2:0/2430287491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc394050ed0 con 0x7fc398003fe0 2023-11-04T01:44:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.295+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3ac0afb50 con 0x7fc398003fe0 2023-11-04T01:44:50.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3a8ff9640 1 -- 172.21.15.2:0/2430287491 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4908 (secure 0 0 0) 0x7fc3940544f0 con 0x7fc398003fe0 2023-11-04T01:44:50.304 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:50.304 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5518,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3645027182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3645027182},{"type":"v1","addr":"172.21.15.90:6835","nonce":3645027182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1098346949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1098346949},{"type":"v1","addr":"172.21.15.90:6837","nonce":1098346949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/4012044748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4012044748},{"type":"v1","addr":"172.21.15.2:6834","nonce":4012044748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:44:26.337328+0000","modified":"2023-11-04T01:44:28.379532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6171},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6171":{"gid":6171,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/3559920390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":3559920390},{"type":"v1","addr":"172.21.15.2:6835","nonce":3559920390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-04T01:44:50.304 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2023-11-04T01:44:50.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc38c0664d0 msgr2=0x7fc38c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc38c0664d0 0x7fc38c068990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0af000 tx=0x7fc39c0046d0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 msgr2=0x7fc3ac0c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3ac0c64f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e7e0 tx=0x7fc39400eca0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 shutdown_connections 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc38c0664d0 0x7fc38c068990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3ac155e60 0x7fc3ac0b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3ac1fad80 0x7fc3ac0c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 --2- 172.21.15.2:0/2430287491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc398003fe0 0x7fc3ac0c64f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.299+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 >> 172.21.15.2:0/2430287491 conn(0x7fc3ac0716a0 msgr2=0x7fc3ac1660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.303+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 shutdown_connections 2023-11-04T01:44:50.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.303+0000 7fc3b2921640 1 -- 172.21.15.2:0/2430287491 wait complete. 2023-11-04T01:44:50.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:50.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.443+0000 7fc2dc18b640 1 Processor -- start 2023-11-04T01:44:50.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.443+0000 7fc2dc18b640 1 -- start start 2023-11-04T01:44:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2dc18b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2d4161510 0x7fc2d41618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2dc18b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2dc18b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40cc6f0 con 0x7fc2d406ba90 2023-11-04T01:44:50.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2dc18b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d406bf90 con 0x7fc2d4161510 2023-11-04T01:44:50.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2dc18b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d406c270 con 0x7fc2d406f8f0 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9f27640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2d4161510 0x7fc2d41618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9726640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9f27640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2d4161510 0x7fc2d41618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:50794/0 (socket says 172.21.15.2:50794) 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9726640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:51676/0 (socket says 172.21.15.2:51676) 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9f27640 1 -- 172.21.15.2:0/430140549 learned_addr learned my addr 172.21.15.2:0/430140549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2da728640 1 --1- 172.21.15.2:0/430140549 >> v1:172.21.15.90:6789/0 conn(0x7fc2d406ba90 0x7fc2d40c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:58140/0 (socket says 172.21.15.2:58140) 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9f27640 1 -- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 msgr2=0x7fc2d40b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9f27640 1 --2- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9f27640 1 -- 172.21.15.2:0/430140549 >> v1:172.21.15.90:6789/0 conn(0x7fc2d406ba90 legacy=0x7fc2d40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9f27640 1 -- 172.21.15.2:0/430140549 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d406c550 con 0x7fc2d4161510 2023-11-04T01:44:50.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.447+0000 7fc2d9726640 1 --2- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2d9f27640 1 --2- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d4161510 0x7fc2d41618f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009e80 tx=0x7fc2c401c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36734923bbc14b8f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2d8f25640 1 -- 172.21.15.2:0/430140549 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40a58a0 con 0x7fc2d4161510 2023-11-04T01:44:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2d8f25640 1 -- 172.21.15.2:0/430140549 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40a5a00 con 0x7fc2d4161510 2023-11-04T01:44:50.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2d8f25640 1 -- 172.21.15.2:0/430140549 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40a5d90 con 0x7fc2d4161510 2023-11-04T01:44:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d4161510 msgr2=0x7fc2d41618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d4161510 0x7fc2d41618f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009e80 tx=0x7fc2c401c9c0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- 172.21.15.2:0/430140549 shutdown_connections 2023-11-04T01:44:50.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/430140549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d4161510 0x7fc2d41618f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- 172.21.15.2:0/430140549 >> 172.21.15.2:0/430140549 conn(0x7fc2d40cebb0 msgr2=0x7fc2d40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- 172.21.15.2:0/430140549 shutdown_connections 2023-11-04T01:44:50.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- 172.21.15.2:0/430140549 wait complete. 2023-11-04T01:44:50.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 Processor -- start 2023-11-04T01:44:50.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- start start 2023-11-04T01:44:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d406ba90 0x7fc2d4154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2d4161510 0x7fc2d415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41549c0 con 0x7fc2d4161510 2023-11-04T01:44:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40c6730 con 0x7fc2d406ba90 2023-11-04T01:44:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.451+0000 7fc2dc18b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40c6a10 con 0x7fc2d406f8f0 2023-11-04T01:44:50.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2d4161510 0x7fc2d415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2d4161510 0x7fc2d415ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36536/0 (socket says 172.21.15.2:36536) 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 -- 172.21.15.2:0/1154957439 learned_addr learned my addr 172.21.15.2:0/1154957439 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d9726640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d9f27640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d406ba90 0x7fc2d4154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 -- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 msgr2=0x7fc2d40c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 -- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d406ba90 msgr2=0x7fc2d4154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d406ba90 0x7fc2d4154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 -- 172.21.15.2:0/1154957439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c8009420 con 0x7fc2d4161510 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2da728640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2d4161510 0x7fc2d415ef00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00c390 tx=0x7fc2cc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d27fc640 1 -- 172.21.15.2:0/1154957439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0074e0 con 0x7fc2d4161510 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d27fc640 1 -- 172.21.15.2:0/1154957439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2cc007640 con 0x7fc2d4161510 2023-11-04T01:44:50.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c4009b30 con 0x7fc2d4161510 2023-11-04T01:44:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d27fc640 1 -- 172.21.15.2:0/1154957439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0049f0 con 0x7fc2d4161510 2023-11-04T01:44:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d40c6fd0 con 0x7fc2d4161510 2023-11-04T01:44:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d4068310 con 0x7fc2d4161510 2023-11-04T01:44:50.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d27fc640 1 -- 172.21.15.2:0/1154957439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2cc004b50 con 0x7fc2d4161510 2023-11-04T01:44:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d27fc640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2c00664d0 0x7fc2c0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d27fc640 1 -- 172.21.15.2:0/1154957439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6800+0+0 (secure 0 0 0) 0x7fc2cc083b70 con 0x7fc2d4161510 2023-11-04T01:44:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.455+0000 7fc2d9f27640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2c00664d0 0x7fc2c0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.459+0000 7fc2d9f27640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2c00664d0 0x7fc2c0068990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40ae000 tx=0x7fc2c40a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.459+0000 7fc2d27fc640 1 -- 172.21.15.2:0/1154957439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2cc050be0 con 0x7fc2d4161510 2023-11-04T01:44:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.619+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2d40744a0 con 0x7fc2d4161510 2023-11-04T01:44:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2d27fc640 1 -- 172.21.15.2:0/1154957439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+21747 (secure 0 0 0) 0x7fc2cc054200 con 0x7fc2d4161510 2023-11-04T01:44:50.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:50.628 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":69,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:49.539745+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:44:24.247898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-04T01:44:25.345255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":1,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2c00664d0 msgr2=0x7fc2c0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2c00664d0 0x7fc2c0068990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40ae000 tx=0x7fc2c40a7070 comp rx=0 tx=0).stop 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2d4161510 msgr2=0x7fc2d415ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2d4161510 0x7fc2d415ef00 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00c390 tx=0x7fc2cc00c850 comp rx=0 tx=0).stop 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 shutdown_connections 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2c00664d0 0x7fc2c0068990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2d4161510 0x7fc2d415ef00 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2d406f8f0 0x7fc2d40c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 --2- 172.21.15.2:0/1154957439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2d406ba90 0x7fc2d4154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 >> 172.21.15.2:0/1154957439 conn(0x7fc2d40cebb0 msgr2=0x7fc2d415fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 shutdown_connections 2023-11-04T01:44:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.623+0000 7fc2dc18b640 1 -- 172.21.15.2:0/1154957439 wait complete. 2023-11-04T01:44:50.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:44:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90ddce6640 1 Processor -- start 2023-11-04T01:44:50.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90ddce6640 1 -- start start 2023-11-04T01:44:50.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90ddce6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f90d815af80 0x7f90d80ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90ddce6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f90d806ace0 0x7f90d80b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90ddce6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d815b360 con 0x7f90d806f280 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90ddce6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d8071880 con 0x7f90d815af80 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90ddce6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d8071b60 con 0x7f90d806ace0 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f90d815af80 0x7f90d80ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d7fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f90d806f280 0x7f90d815eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41864/0 (socket says 172.21.15.2:41864) 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d7fff640 1 -- 172.21.15.2:0/190558593 learned_addr learned my addr 172.21.15.2:0/190558593 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d6ffd640 1 --2- 172.21.15.2:0/190558593 >> v2:172.21.15.90:3300/0 conn(0x7f90d806ace0 0x7f90d80b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d77fe640 1 -- 172.21.15.2:0/190558593 >> v2:172.21.15.90:3300/0 conn(0x7f90d806ace0 msgr2=0x7f90d80b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d77fe640 1 --2- 172.21.15.2:0/190558593 >> v2:172.21.15.90:3300/0 conn(0x7f90d806ace0 0x7f90d80b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d77fe640 1 -- 172.21.15.2:0/190558593 >> v1:172.21.15.2:6789/0 conn(0x7f90d806f280 legacy=0x7f90d815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.767+0000 7f90d77fe640 1 -- 172.21.15.2:0/190558593 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d806a200 con 0x7f90d815af80 2023-11-04T01:44:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90d77fe640 1 --2- 172.21.15.2:0/190558593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d815af80 0x7f90d80ca1c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f90d8071680 tx=0x7f90c801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa1f14be34c02d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90d67fc640 1 -- 172.21.15.2:0/190558593 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80ab600 con 0x7f90d815af80 2023-11-04T01:44:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90d67fc640 1 -- 172.21.15.2:0/190558593 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c80a7050 con 0x7f90d815af80 2023-11-04T01:44:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90d67fc640 1 -- 172.21.15.2:0/190558593 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80ab980 con 0x7f90d815af80 2023-11-04T01:44:50.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 -- 172.21.15.2:0/190558593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d815af80 msgr2=0x7f90d80ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 --2- 172.21.15.2:0/190558593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d815af80 0x7f90d80ca1c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f90d8071680 tx=0x7f90c801c3d0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 -- 172.21.15.2:0/190558593 shutdown_connections 2023-11-04T01:44:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 --2- 172.21.15.2:0/190558593 >> v2:172.21.15.90:3300/0 conn(0x7f90d806ace0 0x7f90d80b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 --2- 172.21.15.2:0/190558593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d815af80 0x7f90d80ca1c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 -- 172.21.15.2:0/190558593 >> 172.21.15.2:0/190558593 conn(0x7f90d806e760 msgr2=0x7f90d806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 -- 172.21.15.2:0/190558593 shutdown_connections 2023-11-04T01:44:50.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 -- 172.21.15.2:0/190558593 wait complete. 2023-11-04T01:44:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 Processor -- start 2023-11-04T01:44:50.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.771+0000 7f90ddce6640 1 -- start start 2023-11-04T01:44:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90d806ace0 0x7f90d8155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d806f280 0x7f90d814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d815af80 0x7f90d814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8153620 con 0x7f90d806f280 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8153be0 con 0x7f90d815af80 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d815dfc0 con 0x7f90d806ace0 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d806f280 0x7f90d814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d806f280 0x7f90d814c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36550/0 (socket says 172.21.15.2:36550) 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 -- 172.21.15.2:0/2706579533 learned_addr learned my addr 172.21.15.2:0/2706579533 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d77fe640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90d806ace0 0x7f90d8155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d7fff640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d815af80 0x7f90d814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 -- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90d806ace0 msgr2=0x7f90d8155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90d806ace0 0x7f90d8155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 -- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d815af80 msgr2=0x7f90d814d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d815af80 0x7f90d814d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 -- 172.21.15.2:0/2706579533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8009420 con 0x7f90d806f280 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d6ffd640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d806f280 0x7f90d814c780 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00d830 tx=0x7f90cc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90bffff640 1 -- 172.21.15.2:0/2706579533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00b6c0 con 0x7f90d806f280 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90bffff640 1 -- 172.21.15.2:0/2706579533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc00b820 con 0x7f90d806f280 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90bffff640 1 -- 172.21.15.2:0/2706579533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc00bb90 con 0x7f90d806f280 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d815e2a0 con 0x7f90d806f280 2023-11-04T01:44:50.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8153870 con 0x7f90d806f280 2023-11-04T01:44:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d8153d70 con 0x7f90d806f280 2023-11-04T01:44:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90bffff640 1 -- 172.21.15.2:0/2706579533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f90cc01e460 con 0x7f90d806f280 2023-11-04T01:44:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90bffff640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90c40664a0 0x7f90c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90bffff640 1 -- 172.21.15.2:0/2706579533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f90cc085470 con 0x7f90d806f280 2023-11-04T01:44:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.775+0000 7f90d77fe640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90c40664a0 0x7f90c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:50.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.779+0000 7f90d77fe640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90c40664a0 0x7f90c4068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f90c80ad000 tx=0x7f90c80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:50.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.779+0000 7f90bffff640 1 -- 172.21.15.2:0/2706579533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f90cc0525b0 con 0x7f90d806f280 2023-11-04T01:44:50.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.967+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f90d80675f0 con 0x7f90d806f280 2023-11-04T01:44:50.973 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-04T01:44:50.967+0000 7f4b9aa78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:44:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.975+0000 7f90bffff640 1 -- 172.21.15.2:0/2706579533 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f90cc055bd0 con 0x7f90d806f280 2023-11-04T01:44:50.982 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90c40664a0 msgr2=0x7f90c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90c40664a0 0x7f90c4068960 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f90c80ad000 tx=0x7f90c80a6000 comp rx=0 tx=0).stop 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d806f280 msgr2=0x7f90d814c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d806f280 0x7f90d814c780 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00d830 tx=0x7f90cc00dcf0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 shutdown_connections 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90c40664a0 0x7f90c4068960 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d815af80 0x7f90d814d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90d806f280 0x7f90d814c780 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 --2- 172.21.15.2:0/2706579533 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f90d806ace0 0x7f90d8155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 >> 172.21.15.2:0/2706579533 conn(0x7f90d806e760 msgr2=0x7f90d80b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:50.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 shutdown_connections 2023-11-04T01:44:50.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:50.979+0000 7f90ddce6640 1 -- 172.21.15.2:0/2706579533 wait complete. 2023-11-04T01:44:50.988 INFO:tasks.ceph.mds.a.smithi002.stderr: -883> 2023-11-04T01:44:31.951+0000 7f11f2d4e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:44:51.004 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:44:51.022 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:44:51.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 Processor -- start 2023-11-04T01:44:51.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 -- start start 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f511c0adb50 0x7f511c0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f511c0cc990 0x7f511c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c06c3d0 0x7f511c0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c0cce40 con 0x7f511c0adb50 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c06c840 con 0x7f511c0cc990 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.119+0000 7f5122989640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0cd020 con 0x7f511c06c3d0 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f511c0adb50 0x7f511c0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f511c0adb50 0x7f511c0adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36570/0 (socket says 172.21.15.2:36570) 2023-11-04T01:44:51.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 -- 172.21.15.2:0/3629391833 learned_addr learned my addr 172.21.15.2:0/3629391833 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511b7fe640 1 --2- 172.21.15.2:0/3629391833 >> v2:172.21.15.90:3300/0 conn(0x7f511c0cc990 0x7f511c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5120f26640 1 --2- 172.21.15.2:0/3629391833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c06c3d0 0x7f511c0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 -- 172.21.15.2:0/3629391833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c06c3d0 msgr2=0x7f511c0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 --2- 172.21.15.2:0/3629391833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c06c3d0 0x7f511c0c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 -- 172.21.15.2:0/3629391833 >> v2:172.21.15.90:3300/0 conn(0x7f511c0cc990 msgr2=0x7f511c0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 --2- 172.21.15.2:0/3629391833 >> v2:172.21.15.90:3300/0 conn(0x7f511c0cc990 0x7f511c0ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 -- 172.21.15.2:0/3629391833 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0cd300 con 0x7f511c0adb50 2023-11-04T01:44:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511bfff640 1 --2- 172.21.15.2:0/3629391833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0adb50 0x7f511c0adf30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f511c0b4c00 tx=0x7f510c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f65eab8da9752d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511affd640 1 -- 172.21.15.2:0/3629391833 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0ab600 con 0x7f511c0adb50 2023-11-04T01:44:51.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511affd640 1 -- 172.21.15.2:0/3629391833 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510c0a7050 con 0x7f511c0adb50 2023-11-04T01:44:51.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f511affd640 1 -- 172.21.15.2:0/3629391833 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510c0ab980 con 0x7f511c0adb50 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 -- 172.21.15.2:0/3629391833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0adb50 msgr2=0x7f511c0adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 --2- 172.21.15.2:0/3629391833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0adb50 0x7f511c0adf30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f511c0b4c00 tx=0x7f510c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 -- 172.21.15.2:0/3629391833 shutdown_connections 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 --2- 172.21.15.2:0/3629391833 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c06c3d0 0x7f511c0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 --2- 172.21.15.2:0/3629391833 >> v2:172.21.15.90:3300/0 conn(0x7f511c0cc990 0x7f511c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 --2- 172.21.15.2:0/3629391833 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0adb50 0x7f511c0adf30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 -- 172.21.15.2:0/3629391833 >> 172.21.15.2:0/3629391833 conn(0x7f511c0cb510 msgr2=0x7f511c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 -- 172.21.15.2:0/3629391833 shutdown_connections 2023-11-04T01:44:51.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.123+0000 7f5122989640 1 -- 172.21.15.2:0/3629391833 wait complete. 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 Processor -- start 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 -- start start 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f511c06c3d0 0x7f511c148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c0adb50 0x7f511c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0cc990 0x7f511c1f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c14c790 con 0x7f511c0cc990 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c150650 con 0x7f511c06c3d0 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c150930 con 0x7f511c0adb50 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0cc990 0x7f511c1f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0cc990 0x7f511c1f6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36574/0 (socket says 172.21.15.2:36574) 2023-11-04T01:44:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 -- 172.21.15.2:0/1781172816 learned_addr learned my addr 172.21.15.2:0/1781172816 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f511bfff640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f511c06c3d0 0x7f511c148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f511b7fe640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c0adb50 0x7f511c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 -- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c0adb50 msgr2=0x7f511c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c0adb50 0x7f511c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 -- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f511c06c3d0 msgr2=0x7f511c148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f511c06c3d0 0x7f511c148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 -- 172.21.15.2:0/1781172816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0094d0 con 0x7f511c0cc990 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5120f26640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0cc990 0x7f511c1f6fa0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5114007e60 tx=0x7f511400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5118ff9640 1 -- 172.21.15.2:0/1781172816 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114014420 con 0x7f511c0cc990 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5118ff9640 1 -- 172.21.15.2:0/1781172816 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51140145a0 con 0x7f511c0cc990 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511c150c10 con 0x7f511c0cc990 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5118ff9640 1 -- 172.21.15.2:0/1781172816 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5114014950 con 0x7f511c0cc990 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.127+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c156f00 con 0x7f511c0cc990 2023-11-04T01:44:51.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.131+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c0744a0 con 0x7f511c0cc990 2023-11-04T01:44:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.131+0000 7f5118ff9640 1 -- 172.21.15.2:0/1781172816 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5114014ab0 con 0x7f511c0cc990 2023-11-04T01:44:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.131+0000 7f5118ff9640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f51080664a0 0x7f5108068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.131+0000 7f5118ff9640 1 -- 172.21.15.2:0/1781172816 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f5114084c30 con 0x7f511c0cc990 2023-11-04T01:44:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.131+0000 7f511bfff640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f51080664a0 0x7f5108068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.131+0000 7f511bfff640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f51080664a0 0x7f5108068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f510c0ad000 tx=0x7f510c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:51.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.135+0000 7f5118ff9640 1 -- 172.21.15.2:0/1781172816 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5114051c30 con 0x7f511c0cc990 2023-11-04T01:44:51.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.327+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f511c1510c0 con 0x7f511c0cc990 2023-11-04T01:44:51.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.979+0000 7f5118ff9640 1 -- 172.21.15.2:0/1781172816 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5114055250 con 0x7f511c0cc990 2023-11-04T01:44:51.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f51080664a0 msgr2=0x7f5108068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f51080664a0 0x7f5108068960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f510c0ad000 tx=0x7f510c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:44:51.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0cc990 msgr2=0x7f511c1f6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0cc990 0x7f511c1f6fa0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f5114007e60 tx=0x7f511400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 shutdown_connections 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f51080664a0 0x7f5108068960 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f511c0cc990 0x7f511c1f6fa0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f511c0adb50 0x7f511c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 --2- 172.21.15.2:0/1781172816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f511c06c3d0 0x7f511c148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 >> 172.21.15.2:0/1781172816 conn(0x7f511c0cb510 msgr2=0x7f511c073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 shutdown_connections 2023-11-04T01:44:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:51.983+0000 7f5122989640 1 -- 172.21.15.2:0/1781172816 wait complete. 2023-11-04T01:44:52.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:44:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f110bce7640 1 Processor -- start 2023-11-04T01:44:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f110bce7640 1 -- start start 2023-11-04T01:44:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f110bce7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f110415e430 0x7f11040b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f110bce7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11040d0220 con 0x7f110406cf70 2023-11-04T01:44:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f110bce7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110406d350 con 0x7f11040ce8c0 2023-11-04T01:44:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f110bce7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11040d0450 con 0x7f110415e430 2023-11-04T01:44:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f1109a83640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f110406cf70 0x7f1104160c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55372/0 (socket says 172.21.15.2:55372) 2023-11-04T01:44:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f1109a83640 1 -- 172.21.15.2:0/2328649233 learned_addr learned my addr 172.21.15.2:0/2328649233 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f110a284640 1 --2- 172.21.15.2:0/2328649233 >> v2:172.21.15.90:3300/0 conn(0x7f110415e430 0x7f11040b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569050660 0 0) 0x7f11040d0220 con 0x7f110406cf70 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.187+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f0003530 con 0x7f110406cf70 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049408411 0 0) 0x7f10f0003530 con 0x7f110406cf70 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 >> v2:172.21.15.90:3300/0 conn(0x7f110415e430 msgr2=0x7f11040b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 --2- 172.21.15.2:0/2328649233 >> v2:172.21.15.90:3300/0 conn(0x7f110415e430 0x7f11040b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 >> v1:172.21.15.90:6789/0 conn(0x7f11040ce8c0 legacy=0x7f110415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040d0730 con 0x7f110406cf70 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f10f8001680 con 0x7f110406cf70 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 >> v1:172.21.15.2:6789/0 conn(0x7f110406cf70 legacy=0x7f1104160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10f0003980 0x7f10f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f10f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10f0005190 0x7f10f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11040d0450 con 0x7f10f00047d0 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f000c130 con 0x7f10f0005190 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f000c2f0 con 0x7f10f0003980 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109282640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f10f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110a284640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10f0005190 0x7f10f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109a83640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10f0003980 0x7f10f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109282640 1 -- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10f0003980 msgr2=0x7f10f0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109282640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f10f0003980 0x7f10f0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109282640 1 -- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10f0005190 msgr2=0x7f10f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109282640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10f0005190 0x7f10f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110a284640 1 -- 172.21.15.2:0/2328649233 reap_dead start 2023-11-04T01:44:52.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109282640 1 -- 172.21.15.2:0/2328649233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f0003530 con 0x7f10f00047d0 2023-11-04T01:44:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1109282640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f10f0004c50 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f11040d1df0 tx=0x7f110001c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36737225d0c92c23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100003b80 con 0x7f10f00047d0 2023-11-04T01:44:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100003ce0 con 0x7f10f00047d0 2023-11-04T01:44:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f1108a81640 1 -- 172.21.15.2:0/2328649233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1100005310 con 0x7f10f00047d0 2023-11-04T01:44:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110bce7640 1 -- 172.21.15.2:0/2328649233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 msgr2=0x7f10f0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110bce7640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f10f0004c50 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f11040d1df0 tx=0x7f110001c6b0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110bce7640 1 -- 172.21.15.2:0/2328649233 shutdown_connections 2023-11-04T01:44:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110bce7640 1 --2- 172.21.15.2:0/2328649233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f10f0004c50 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110bce7640 1 -- 172.21.15.2:0/2328649233 >> 172.21.15.2:0/2328649233 conn(0x7f11040cd770 msgr2=0x7f11040cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110bce7640 1 -- 172.21.15.2:0/2328649233 shutdown_connections 2023-11-04T01:44:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.191+0000 7f110bce7640 1 -- 172.21.15.2:0/2328649233 wait complete. 2023-11-04T01:44:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 Processor -- start 2023-11-04T01:44:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 -- start start 2023-11-04T01:44:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f110415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110415b220 0x7f1104161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1104162310 0x7f11040b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11040b3bc0 con 0x7f10f00047d0 2023-11-04T01:44:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104162770 con 0x7f110415b220 2023-11-04T01:44:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110415f140 con 0x7f1104162310 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f110415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f110415a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40396/0 (socket says 172.21.15.2:40396) 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 -- 172.21.15.2:0/1531941903 learned_addr learned my addr 172.21.15.2:0/1531941903 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109282640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110415b220 0x7f1104161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110a284640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1104162310 0x7f11040b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 -- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1104162310 msgr2=0x7f11040b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1104162310 0x7f11040b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 -- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110415b220 msgr2=0x7f1104161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110415b220 0x7f1104161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 -- 172.21.15.2:0/1531941903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110415f670 con 0x7f10f00047d0 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109282640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110415b220 0x7f1104161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f1109a83640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f110415a430 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f10f800e780 tx=0x7f10f800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f10f67fc640 1 -- 172.21.15.2:0/1531941903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800ee90 con 0x7f10f00047d0 2023-11-04T01:44:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f10f67fc640 1 -- 172.21.15.2:0/1531941903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f800c8d0 con 0x7f10f00047d0 2023-11-04T01:44:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f10f67fc640 1 -- 172.21.15.2:0/1531941903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800cc60 con 0x7f10f00047d0 2023-11-04T01:44:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11041ea1b0 con 0x7f10f00047d0 2023-11-04T01:44:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.195+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11041e9e40 con 0x7f10f00047d0 2023-11-04T01:44:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.199+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11040744a0 con 0x7f10f00047d0 2023-11-04T01:44:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.199+0000 7f10f67fc640 1 -- 172.21.15.2:0/1531941903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10f801d460 con 0x7f10f00047d0 2023-11-04T01:44:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.199+0000 7f10f67fc640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10e80664a0 0x7f10e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.199+0000 7f10f67fc640 1 -- 172.21.15.2:0/1531941903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6858+0+0 (secure 0 0 0) 0x7f10f8084340 con 0x7f10f00047d0 2023-11-04T01:44:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.199+0000 7f1109282640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10e80664a0 0x7f10e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.199+0000 7f1109282640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10e80664a0 0x7f10e8068960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11000ac000 tx=0x7f1100001520 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.203+0000 7f10f67fc640 1 -- 172.21.15.2:0/1531941903 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f10f8054dc0 con 0x7f10f00047d0 2023-11-04T01:44:52.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.359+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f11040b3480 con 0x7f10f00047d0 2023-11-04T01:44:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.987+0000 7f10f67fc640 1 -- 172.21.15.2:0/1531941903 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7f10f8054950 con 0x7f10f00047d0 2023-11-04T01:44:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:44:52.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10e80664a0 msgr2=0x7f10e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10e80664a0 0x7f10e8068960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11000ac000 tx=0x7f1100001520 comp rx=0 tx=0).stop 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 msgr2=0x7f110415a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f110415a430 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f10f800e780 tx=0x7f10f800ec40 comp rx=0 tx=0).stop 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 shutdown_connections 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f10e80664a0 0x7f10e8068960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1104162310 0x7f11040b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f110415b220 0x7f1104161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 --2- 172.21.15.2:0/1531941903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f10f00047d0 0x7f110415a430 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 >> 172.21.15.2:0/1531941903 conn(0x7f11040cd770 msgr2=0x7f110406c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 shutdown_connections 2023-11-04T01:44:52.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:52.991+0000 7f110bce7640 1 -- 172.21.15.2:0/1531941903 wait complete. 2023-11-04T01:44:53.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:44:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.151+0000 7f3c078f8640 1 Processor -- start 2023-11-04T01:44:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.151+0000 7f3c078f8640 1 -- start start 2023-11-04T01:44:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000cab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c0006b320 0x7f3c0006b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0015f8a0 con 0x7f3c000ca440 2023-11-04T01:44:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0015ea00 con 0x7f3c0006b320 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015b240 con 0x7f3c0015ae60 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c0006b320 0x7f3c0006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c0006b320 0x7f3c0006b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40412/0 (socket says 172.21.15.2:40412) 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 -- 172.21.15.2:0/1455344317 learned_addr learned my addr 172.21.15.2:0/1455344317 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05694640 1 --2- 172.21.15.2:0/1455344317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 -- 172.21.15.2:0/1455344317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 msgr2=0x7f3c000cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 --2- 172.21.15.2:0/1455344317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 -- 172.21.15.2:0/1455344317 >> v1:172.21.15.90:6789/0 conn(0x7f3c000ca440 legacy=0x7f3c0015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 -- 172.21.15.2:0/1455344317 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0006cda0 con 0x7f3c0006b320 2023-11-04T01:44:53.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05694640 1 --2- 172.21.15.2:0/1455344317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:53.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c05e95640 1 --2- 172.21.15.2:0/1455344317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0006b750 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa5cee7ecd1e76b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3bf7fff640 1 -- 172.21.15.2:0/1455344317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80a5820 con 0x7f3c0006b320 2023-11-04T01:44:53.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3bf7fff640 1 -- 172.21.15.2:0/1455344317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf80a5980 con 0x7f3c0006b320 2023-11-04T01:44:53.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3bf7fff640 1 -- 172.21.15.2:0/1455344317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80a5d10 con 0x7f3c0006b320 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- 172.21.15.2:0/1455344317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 msgr2=0x7f3c0006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 --2- 172.21.15.2:0/1455344317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0006b750 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf801c9a0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- 172.21.15.2:0/1455344317 shutdown_connections 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 --2- 172.21.15.2:0/1455344317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0006b750 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 --2- 172.21.15.2:0/1455344317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- 172.21.15.2:0/1455344317 >> 172.21.15.2:0/1455344317 conn(0x7f3c000b0630 msgr2=0x7f3c000b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- 172.21.15.2:0/1455344317 shutdown_connections 2023-11-04T01:44:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.155+0000 7f3c078f8640 1 -- 172.21.15.2:0/1455344317 wait complete. 2023-11-04T01:44:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 Processor -- start 2023-11-04T01:44:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 -- start start 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000ca440 0x7f3c00150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000b3880 con 0x7f3c0006b320 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001501c0 con 0x7f3c000ca440 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001504a0 con 0x7f3c0015ae60 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0014ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40416/0 (socket says 172.21.15.2:40416) 2023-11-04T01:44:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 -- 172.21.15.2:0/2185845535 learned_addr learned my addr 172.21.15.2:0/2185845535 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c04e93640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000ca440 0x7f3c00150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05e95640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 -- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 msgr2=0x7f3c000b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 -- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000ca440 msgr2=0x7f3c00150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000ca440 0x7f3c00150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 -- 172.21.15.2:0/2185845535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8009b30 con 0x7f3c0006b320 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c05694640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0014ad80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c7f0 tx=0x7f3bfc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3bf5ffb640 1 -- 172.21.15.2:0/2185845535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc007820 con 0x7f3c0006b320 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3bf5ffb640 1 -- 172.21.15.2:0/2185845535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc007980 con 0x7f3c0006b320 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c00150780 con 0x7f3c0006b320 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3bf5ffb640 1 -- 172.21.15.2:0/2185845535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc007d30 con 0x7f3c0006b320 2023-11-04T01:44:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c000b2680 con 0x7f3c0006b320 2023-11-04T01:44:53.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.159+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000744a0 con 0x7f3c0006b320 2023-11-04T01:44:53.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.163+0000 7f3bf5ffb640 1 -- 172.21.15.2:0/2185845535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3bfc0113f0 con 0x7f3c0006b320 2023-11-04T01:44:53.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.163+0000 7f3bf5ffb640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3be40664a0 0x7f3be4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:53.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.163+0000 7f3bf5ffb640 1 -- 172.21.15.2:0/2185845535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3bfc084510 con 0x7f3c0006b320 2023-11-04T01:44:53.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.163+0000 7f3c04e93640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3be40664a0 0x7f3be4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:53.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.163+0000 7f3c04e93640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3be40664a0 0x7f3be4068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c000c2530 tx=0x7f3bf0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:53.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.167+0000 7f3bf5ffb640 1 -- 172.21.15.2:0/2185845535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3bfc051620 con 0x7f3c0006b320 2023-11-04T01:44:53.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:53.323+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c000b39c0 con 0x7f3c0006b320 2023-11-04T01:44:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3bf5ffb640 1 -- 172.21.15.2:0/2185845535 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3bfc05b030 con 0x7f3c0006b320 2023-11-04T01:44:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-04T01:44:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3be40664a0 msgr2=0x7f3be4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3be40664a0 0x7f3be4068960 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c000c2530 tx=0x7f3bf0009040 comp rx=0 tx=0).stop 2023-11-04T01:44:54.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 msgr2=0x7f3c0014ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0014ad80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c7f0 tx=0x7f3bfc00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 shutdown_connections 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3be40664a0 0x7f3be4068960 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c0015ae60 0x7f3c000b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c000ca440 0x7f3c00150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 --2- 172.21.15.2:0/2185845535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0006b320 0x7f3c0014ad80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 >> 172.21.15.2:0/2185845535 conn(0x7f3c000b0630 msgr2=0x7f3c000ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 shutdown_connections 2023-11-04T01:44:54.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.011+0000 7f3c078f8640 1 -- 172.21.15.2:0/2185845535 wait complete. 2023-11-04T01:44:54.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:44:54.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 Processor -- start 2023-11-04T01:44:54.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- start start 2023-11-04T01:44:54.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fca9015c160 0x7fca9015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca900cb130 con 0x7fca9015acb0 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9015b680 con 0x7fca900b0c20 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9015bd40 con 0x7fca9015c160 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca948f8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fca9015acb0 0x7fca900b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55380/0 (socket says 172.21.15.2:55380) 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca948f8640 1 -- 172.21.15.2:0/2799558676 learned_addr learned my addr 172.21.15.2:0/2799558676 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 --2- 172.21.15.2:0/2799558676 >> v2:172.21.15.90:3300/0 conn(0x7fca9015c160 0x7fca9015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189567162 0 0) 0x7fca900cb130 con 0x7fca9015acb0 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca78003530 con 0x7fca9015acb0 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873673924 0 0) 0x7fca78003530 con 0x7fca9015acb0 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 >> v2:172.21.15.90:3300/0 conn(0x7fca9015c160 msgr2=0x7fca9015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 --2- 172.21.15.2:0/2799558676 >> v2:172.21.15.90:3300/0 conn(0x7fca9015c160 0x7fca9015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 >> v1:172.21.15.90:6789/0 conn(0x7fca900b0c20 legacy=0x7fca900ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9015b960 con 0x7fca9015acb0 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fca80001680 con 0x7fca9015acb0 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 >> v1:172.21.15.2:6789/0 conn(0x7fca9015acb0 legacy=0x7fca900b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca78003980 0x7fca78003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca780047d0 0x7fca78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9015bd40 con 0x7fca78005190 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7800c0e0 con 0x7fca780047d0 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7800c2a0 con 0x7fca78003980 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 --2- 172.21.15.2:0/2799558676 >> v2:172.21.15.90:3300/0 conn(0x7fca9015c160 0x7fca9015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8ffff640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca780047d0 0x7fca78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca948f8640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca78003980 0x7fca78003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 -- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca78003980 msgr2=0x7fca78003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca78003980 0x7fca78003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 -- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca780047d0 msgr2=0x7fca78004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca780047d0 0x7fca78004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 -- 172.21.15.2:0/2799558676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78003530 con 0x7fca78005190 2023-11-04T01:44:54.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 -- 172.21.15.2:0/2799558676 reap_dead start 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca950f9640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca7800b990 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fca880073e0 tx=0x7fca8801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4b965505c9500c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880a5e20 con 0x7fca78005190 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880ad440 con 0x7fca78005190 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca8f7fe640 1 -- 172.21.15.2:0/2799558676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880ad7d0 con 0x7fca78005190 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- 172.21.15.2:0/2799558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 msgr2=0x7fca7800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca7800b990 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fca880073e0 tx=0x7fca8801cf20 comp rx=0 tx=0).stop 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- 172.21.15.2:0/2799558676 shutdown_connections 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 --2- 172.21.15.2:0/2799558676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca7800b990 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- 172.21.15.2:0/2799558676 >> 172.21.15.2:0/2799558676 conn(0x7fca900cb510 msgr2=0x7fca900cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- 172.21.15.2:0/2799558676 shutdown_connections 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- 172.21.15.2:0/2799558676 wait complete. 2023-11-04T01:44:54.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 Processor -- start 2023-11-04T01:44:54.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- start start 2023-11-04T01:44:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca901f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca900ca650 0x7fca900c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca9015d4b0 0x7fca9015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9015dea0 con 0x7fca78005190 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900b4a10 con 0x7fca9015d4b0 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.171+0000 7fca96b5c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900c6ee0 con 0x7fca900ca650 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca901f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca901f1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40440/0 (socket says 172.21.15.2:40440) 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 -- 172.21.15.2:0/152948286 learned_addr learned my addr 172.21.15.2:0/152948286 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca950f9640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca9015d4b0 0x7fca9015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8ffff640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca900ca650 0x7fca900c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 -- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca900ca650 msgr2=0x7fca900c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca900ca650 0x7fca900c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 -- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca9015d4b0 msgr2=0x7fca9015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca9015d4b0 0x7fca9015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 -- 172.21.15.2:0/152948286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900c71c0 con 0x7fca78005190 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca950f9640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca9015d4b0 0x7fca9015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca948f8640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca901f1f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fca8000e7f0 tx=0x7fca8000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8d7fa640 1 -- 172.21.15.2:0/152948286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8000c870 con 0x7fca78005190 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8d7fa640 1 -- 172.21.15.2:0/152948286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8000c9d0 con 0x7fca78005190 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8d7fa640 1 -- 172.21.15.2:0/152948286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8000cd60 con 0x7fca78005190 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca900c74a0 con 0x7fca78005190 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900c7a60 con 0x7fca78005190 2023-11-04T01:44:54.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca900744a0 con 0x7fca78005190 2023-11-04T01:44:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8d7fa640 1 -- 172.21.15.2:0/152948286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca8001d460 con 0x7fca78005190 2023-11-04T01:44:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8d7fa640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca7c0664a0 0x7fca7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8d7fa640 1 -- 172.21.15.2:0/152948286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fca80083f30 con 0x7fca78005190 2023-11-04T01:44:54.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.175+0000 7fca8ffff640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca7c0664a0 0x7fca7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.179+0000 7fca8ffff640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca7c0664a0 0x7fca7c068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca900ce6c0 tx=0x7fca84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:54.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.179+0000 7fca8d7fa640 1 -- 172.21.15.2:0/152948286 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca80051280 con 0x7fca78005190 2023-11-04T01:44:54.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.339+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fca900cde30 con 0x7fca78005190 2023-11-04T01:44:54.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca8d7fa640 1 -- 172.21.15.2:0/152948286 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fca800548a0 con 0x7fca78005190 2023-11-04T01:44:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca7c0664a0 msgr2=0x7fca7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca7c0664a0 0x7fca7c068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca900ce6c0 tx=0x7fca84009040 comp rx=0 tx=0).stop 2023-11-04T01:44:54.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 msgr2=0x7fca901f1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca901f1f70 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fca8000e7f0 tx=0x7fca8000ecb0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 shutdown_connections 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fca7c0664a0 0x7fca7c068960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca9015d4b0 0x7fca9015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca900ca650 0x7fca900c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 --2- 172.21.15.2:0/152948286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca78005190 0x7fca901f1f70 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 >> 172.21.15.2:0/152948286 conn(0x7fca900cb510 msgr2=0x7fca900cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 shutdown_connections 2023-11-04T01:44:54.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.351+0000 7fca96b5c640 1 -- 172.21.15.2:0/152948286 wait complete. 2023-11-04T01:44:54.373 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation' 2023-11-04T01:44:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f03955cc640 1 Processor -- start 2023-11-04T01:44:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f03955cc640 1 -- start start 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f03955cc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f039015d690 0x7f039006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f03955cc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f039006f8f0 0x7f03900b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f03955cc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03900cd400 con 0x7f039015d2b0 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f03955cc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03900ad450 con 0x7f039015d690 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f03955cc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03900cd6e0 con 0x7f039006f8f0 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038e7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f039015d690 0x7f039006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f039015d2b0 0x7f03900ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55384/0 (socket says 172.21.15.2:55384) 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038effd640 1 -- 172.21.15.2:0/2059670860 learned_addr learned my addr 172.21.15.2:0/2059670860 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038dffb640 1 -- 172.21.15.2:0/2059670860 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263376245 0 0) 0x7f03900cd400 con 0x7f039015d2b0 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038dffb640 1 -- 172.21.15.2:0/2059670860 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0378003530 con 0x7f039015d2b0 2023-11-04T01:44:54.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038f7fe640 1 --2- 172.21.15.2:0/2059670860 >> v2:172.21.15.90:3300/0 conn(0x7f039006f8f0 0x7f03900b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038e7fc640 1 -- 172.21.15.2:0/2059670860 >> v2:172.21.15.90:3300/0 conn(0x7f039006f8f0 msgr2=0x7f03900b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:54.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038e7fc640 1 --2- 172.21.15.2:0/2059670860 >> v2:172.21.15.90:3300/0 conn(0x7f039006f8f0 0x7f03900b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038e7fc640 1 -- 172.21.15.2:0/2059670860 >> v1:172.21.15.2:6789/0 conn(0x7f039015d2b0 legacy=0x7f03900ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.494+0000 7f038e7fc640 1 -- 172.21.15.2:0/2059670860 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03900ad070 con 0x7f039015d690 2023-11-04T01:44:54.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f038e7fc640 1 --2- 172.21.15.2:0/2059670860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039015d690 0x7f039006c630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f03900cfbf0 tx=0x7f038401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0db6535643cc0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:54.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f038dffb640 1 -- 172.21.15.2:0/2059670860 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840ab600 con 0x7f039015d690 2023-11-04T01:44:54.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f038dffb640 1 -- 172.21.15.2:0/2059670860 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03840a7050 con 0x7f039015d690 2023-11-04T01:44:54.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f038dffb640 1 -- 172.21.15.2:0/2059670860 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840ab980 con 0x7f039015d690 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- 172.21.15.2:0/2059670860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039015d690 msgr2=0x7f039006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 --2- 172.21.15.2:0/2059670860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039015d690 0x7f039006c630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f03900cfbf0 tx=0x7f038401c3d0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- 172.21.15.2:0/2059670860 shutdown_connections 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 --2- 172.21.15.2:0/2059670860 >> v2:172.21.15.90:3300/0 conn(0x7f039006f8f0 0x7f03900b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 --2- 172.21.15.2:0/2059670860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039015d690 0x7f039006c630 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- 172.21.15.2:0/2059670860 >> 172.21.15.2:0/2059670860 conn(0x7f03900cebb0 msgr2=0x7f03900cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- 172.21.15.2:0/2059670860 shutdown_connections 2023-11-04T01:44:54.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- 172.21.15.2:0/2059670860 wait complete. 2023-11-04T01:44:54.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 Processor -- start 2023-11-04T01:44:54.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- start start 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039006f8f0 0x7f0390151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039015d2b0 0x7f03900c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f039015d690 0x7f0390154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390152da0 con 0x7f039006f8f0 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390152120 con 0x7f039015d2b0 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.498+0000 7f03955cc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0390152400 con 0x7f039015d690 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039006f8f0 0x7f0390151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039006f8f0 0x7f0390151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40444/0 (socket says 172.21.15.2:40444) 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 -- 172.21.15.2:0/3166169650 learned_addr learned my addr 172.21.15.2:0/3166169650 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038f7fe640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f039015d690 0x7f0390154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038e7fc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039015d2b0 0x7f03900c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 -- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f039015d690 msgr2=0x7f0390154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f039015d690 0x7f0390154310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 -- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039015d2b0 msgr2=0x7f03900c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039015d2b0 0x7f03900c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 -- 172.21.15.2:0/3166169650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009420 con 0x7f039006f8f0 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038effd640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039006f8f0 0x7f0390151a20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f038000c420 tx=0x7f038000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03777fe640 1 -- 172.21.15.2:0/3166169650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380005cf0 con 0x7f039006f8f0 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03777fe640 1 -- 172.21.15.2:0/3166169650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380005e50 con 0x7f039006f8f0 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039006fee0 con 0x7f039006f8f0 2023-11-04T01:44:54.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03777fe640 1 -- 172.21.15.2:0/3166169650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800072d0 con 0x7f039006f8f0 2023-11-04T01:44:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03901529c0 con 0x7f039006f8f0 2023-11-04T01:44:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03900744a0 con 0x7f039006f8f0 2023-11-04T01:44:54.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03777fe640 1 -- 172.21.15.2:0/3166169650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0380007430 con 0x7f039006f8f0 2023-11-04T01:44:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03777fe640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f037c0664a0 0x7f037c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f03777fe640 1 -- 172.21.15.2:0/3166169650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f03800834c0 con 0x7f039006f8f0 2023-11-04T01:44:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038e7fc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f037c0664a0 0x7f037c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:54.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.502+0000 7f038e7fc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f037c0664a0 0x7f037c068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f03840ad000 tx=0x7f0384008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:54.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.506+0000 7f03777fe640 1 -- 172.21.15.2:0/3166169650 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f03800508c0 con 0x7f039006f8f0 2023-11-04T01:44:54.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:54.730+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]} v 0) v1 -- 0x7f0390071cb0 con 0x7f039006f8f0 2023-11-04T01:44:54.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:54.797 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:44:55.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.010+0000 7f03777fe640 1 -- 172.21.15.2:0/3166169650 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestMonSnapsAndFsPools.test_using_pool_with_snap_fails_fs_creation"]}]=0 v162) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0380053ee0 con 0x7f039006f8f0 2023-11-04T01:44:55.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f037c0664a0 msgr2=0x7f037c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f037c0664a0 0x7f037c068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f03840ad000 tx=0x7f0384008040 comp rx=0 tx=0).stop 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039006f8f0 msgr2=0x7f0390151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039006f8f0 0x7f0390151a20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f038000c420 tx=0x7f038000c8e0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 shutdown_connections 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f037c0664a0 0x7f037c068960 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f039015d690 0x7f0390154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f039015d2b0 0x7f03900c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 --2- 172.21.15.2:0/3166169650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f039006f8f0 0x7f0390151a20 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 >> 172.21.15.2:0/3166169650 conn(0x7f03900cebb0 msgr2=0x7f03900b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 shutdown_connections 2023-11-04T01:44:55.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.014+0000 7f03955cc640 1 -- 172.21.15.2:0/3166169650 wait complete. 2023-11-04T01:44:55.044 INFO:tasks.cephfs_test_runner:Test that using a pool with snaps for fs creation fails ... ok 2023-11-04T01:44:55.044 INFO:tasks.cephfs_test_runner:Starting test: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) Check whether 'allow_new_snaps' setting works 2023-11-04T01:44:55.044 INFO:tasks.cephfs_test_runner:test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:44:55.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.166+0000 7fa44fbdf640 1 Processor -- start 2023-11-04T01:44:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.166+0000 7fa44fbdf640 1 -- start start 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44fbdf640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa4480b4990 0x7fa4480b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44fbdf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 0x7fa4480cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44fbdf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480b6070 con 0x7fa4480d0690 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44fbdf640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4480b8ed0 con 0x7fa4480b4990 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44fbdf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b52b0 con 0x7fa4480b74f0 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d17a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa4480d0690 0x7fa4480cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55394/0 (socket says 172.21.15.2:55394) 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d17a640 1 -- 172.21.15.2:0/3566409235 learned_addr learned my addr 172.21.15.2:0/3566409235 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d97b640 1 --2- 172.21.15.2:0/3566409235 >> v2:172.21.15.90:3300/0 conn(0x7fa4480b4990 0x7fa4480b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44e17c640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 0x7fa4480cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355556766 0 0) 0x7fa4480b6070 con 0x7fa4480d0690 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa434003530 con 0x7fa4480d0690 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1129525869 0 0) 0x7fa434003530 con 0x7fa4480d0690 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 msgr2=0x7fa4480cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 0x7fa4480cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 >> v2:172.21.15.90:3300/0 conn(0x7fa4480b4990 msgr2=0x7fa4480b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 --2- 172.21.15.2:0/3566409235 >> v2:172.21.15.90:3300/0 conn(0x7fa4480b4990 0x7fa4480b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480d1ce0 con 0x7fa4480d0690 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa444001680 con 0x7fa4480d0690 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 >> v1:172.21.15.2:6789/0 conn(0x7fa4480d0690 legacy=0x7fa4480cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa434003980 0x7fa434003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 0x7fa4340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434004d10 0x7fa434005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b8ed0 con 0x7fa434003980 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480b52b0 con 0x7fa434004d10 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43400b990 con 0x7fa4480b74f0 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d97b640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa434003980 0x7fa434003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d17a640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 0x7fa4340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44e17c640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434004d10 0x7fa434005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d97b640 1 -- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 msgr2=0x7fa4340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d97b640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4480b74f0 0x7fa4340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d97b640 1 -- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434004d10 msgr2=0x7fa434005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d97b640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434004d10 0x7fa434005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44d97b640 1 -- 172.21.15.2:0/3566409235 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434003530 con 0x7fa434003980 2023-11-04T01:44:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.170+0000 7fa44e17c640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434004d10 0x7fa434005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d97b640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa434003980 0x7fa434003da0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa438009ae0 tx=0x7fa43801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c764e9344699694 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380a5570 con 0x7fa434003980 2023-11-04T01:44:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4380a56d0 con 0x7fa434003980 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44c979640 1 -- 172.21.15.2:0/3566409235 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4380a5a80 con 0x7fa434003980 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- 172.21.15.2:0/3566409235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa434003980 msgr2=0x7fa434003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 --2- 172.21.15.2:0/3566409235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa434003980 0x7fa434003da0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa438009ae0 tx=0x7fa43801ca90 comp rx=0 tx=0).stop 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44e17c640 1 -- 172.21.15.2:0/3566409235 reap_dead start 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- 172.21.15.2:0/3566409235 shutdown_connections 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- 172.21.15.2:0/3566409235 >> 172.21.15.2:0/3566409235 conn(0x7fa4480cf990 msgr2=0x7fa4480cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- 172.21.15.2:0/3566409235 shutdown_connections 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- 172.21.15.2:0/3566409235 wait complete. 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 Processor -- start 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- start start 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434003980 0x7fa4481f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa448071230 0x7fa4480cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa44806d480 0x7fa44806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4481f9d60 con 0x7fa448071230 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480cc580 con 0x7fa434003980 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44fbdf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480ccb30 con 0x7fa44806d480 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa448071230 0x7fa4480cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa448071230 0x7fa4480cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40468/0 (socket says 172.21.15.2:40468) 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 -- 172.21.15.2:0/1101750303 learned_addr learned my addr 172.21.15.2:0/1101750303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d97b640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434003980 0x7fa4481f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44e17c640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa44806d480 0x7fa44806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 -- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa44806d480 msgr2=0x7fa44806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa44806d480 0x7fa44806d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 -- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434003980 msgr2=0x7fa4481f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434003980 0x7fa4481f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 -- 172.21.15.2:0/1101750303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480716b0 con 0x7fa448071230 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.174+0000 7fa44d17a640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa448071230 0x7fa4480cc040 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa444011870 tx=0x7fa444011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa43e7fc640 1 -- 172.21.15.2:0/1101750303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44400fa80 con 0x7fa448071230 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa43e7fc640 1 -- 172.21.15.2:0/1101750303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44400fc20 con 0x7fa448071230 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4481f6bd0 con 0x7fa448071230 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa43e7fc640 1 -- 172.21.15.2:0/1101750303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444015410 con 0x7fa448071230 2023-11-04T01:44:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4481f7190 con 0x7fa448071230 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4481f9ea0 con 0x7fa448071230 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa43e7fc640 1 -- 172.21.15.2:0/1101750303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa444015570 con 0x7fa448071230 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa43e7fc640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa42c0664d0 0x7fa42c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa43e7fc640 1 -- 172.21.15.2:0/1101750303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fa444087270 con 0x7fa448071230 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa44d97b640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa42c0664d0 0x7fa42c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.178+0000 7fa44d97b640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa42c0664d0 0x7fa42c068990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa4380af000 tx=0x7fa4380046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.182+0000 7fa43e7fc640 1 -- 172.21.15.2:0/1101750303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4481f9ea0 con 0x7fa448071230 2023-11-04T01:44:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.338+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4481f9ea0 con 0x7fa448071230 2023-11-04T01:44:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.342+0000 7fa43e7fc640 1 -- 172.21.15.2:0/1101750303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18129 (secure 0 0 0) 0x7fa4481f9ea0 con 0x7fa448071230 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:55.345 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":72,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:54.011166+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6835/3559920390":"2023-11-05T01:44:50.972692+0000","172.21.15.2:6833/3559920390":"2023-11-05T01:44:50.972692+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa42c0664d0 msgr2=0x7fa42c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa42c0664d0 0x7fa42c068990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa4380af000 tx=0x7fa4380046d0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa448071230 msgr2=0x7fa4480cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa448071230 0x7fa4480cc040 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa444011870 tx=0x7fa444011d30 comp rx=0 tx=0).stop 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 shutdown_connections 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa42c0664d0 0x7fa42c068990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa44806d480 0x7fa44806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa448071230 0x7fa4480cc040 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 --2- 172.21.15.2:0/1101750303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa434003980 0x7fa4481f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 >> 172.21.15.2:0/1101750303 conn(0x7fa4480cf990 msgr2=0x7fa4480b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 shutdown_connections 2023-11-04T01:44:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.346+0000 7fa44fbdf640 1 -- 172.21.15.2:0/1101750303 wait complete. 2023-11-04T01:44:55.365 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:55.365 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05c108e640 1 Processor -- start 2023-11-04T01:44:55.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05c108e640 1 -- start start 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05c108e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f05bc06cfc0 0x7f05bc15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05c108e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05bc0cda50 0x7f05bc15d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05c108e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc160c50 con 0x7f05bc0cd670 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05c108e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc15d600 con 0x7f05bc0cda50 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05c108e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc160ef0 con 0x7f05bc06cfc0 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05bb59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05bc0cda50 0x7f05bc15d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05bb59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05bc0cda50 0x7f05bc15d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40482/0 (socket says 172.21.15.2:40482) 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05bb59e640 1 -- 172.21.15.2:0/495320984 learned_addr learned my addr 172.21.15.2:0/495320984 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05ba59c640 1 --2- 172.21.15.2:0/495320984 >> v2:172.21.15.90:3300/0 conn(0x7f05bc06cfc0 0x7f05bc15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05bb59e640 1 -- 172.21.15.2:0/495320984 >> v2:172.21.15.90:3300/0 conn(0x7f05bc06cfc0 msgr2=0x7f05bc15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05bb59e640 1 --2- 172.21.15.2:0/495320984 >> v2:172.21.15.90:3300/0 conn(0x7f05bc06cfc0 0x7f05bc15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05bb59e640 1 -- 172.21.15.2:0/495320984 >> v1:172.21.15.90:6789/0 conn(0x7f05bc0cd670 legacy=0x7f05bc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.482+0000 7f05bb59e640 1 -- 172.21.15.2:0/495320984 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc1611d0 con 0x7f05bc0cda50 2023-11-04T01:44:55.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05bb59e640 1 --2- 172.21.15.2:0/495320984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc15d0c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f05bc06f190 tx=0x7f05b401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b367adc1e9e64bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05b9d9b640 1 -- 172.21.15.2:0/495320984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40a5820 con 0x7f05bc0cda50 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05b9d9b640 1 -- 172.21.15.2:0/495320984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40a5980 con 0x7f05bc0cda50 2023-11-04T01:44:55.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05b9d9b640 1 -- 172.21.15.2:0/495320984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40a5d10 con 0x7f05bc0cda50 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- 172.21.15.2:0/495320984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 msgr2=0x7f05bc15d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 --2- 172.21.15.2:0/495320984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc15d0c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f05bc06f190 tx=0x7f05b401c960 comp rx=0 tx=0).stop 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- 172.21.15.2:0/495320984 shutdown_connections 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 --2- 172.21.15.2:0/495320984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc15d0c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 --2- 172.21.15.2:0/495320984 >> v2:172.21.15.90:3300/0 conn(0x7f05bc06cfc0 0x7f05bc15cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- 172.21.15.2:0/495320984 >> 172.21.15.2:0/495320984 conn(0x7f05bc065dc0 msgr2=0x7f05bc0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- 172.21.15.2:0/495320984 shutdown_connections 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- 172.21.15.2:0/495320984 wait complete. 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 Processor -- start 2023-11-04T01:44:55.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- start start 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05bc06cfc0 0x7f05bc0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05bc0cd670 0x7f05bc0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0c8060 con 0x7f05bc0cda50 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0b42d0 con 0x7f05bc06cfc0 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05c108e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0b6780 con 0x7f05bc0cd670 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05bb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05bb59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc0c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40488/0 (socket says 172.21.15.2:40488) 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05bb59e640 1 -- 172.21.15.2:0/2516096994 learned_addr learned my addr 172.21.15.2:0/2516096994 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05ba59c640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05bc0cd670 0x7f05bc0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.486+0000 7f05bad9d640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05bc06cfc0 0x7f05bc0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bb59e640 1 -- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05bc0cd670 msgr2=0x7f05bc0c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bb59e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05bc0cd670 0x7f05bc0c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bb59e640 1 -- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05bc06cfc0 msgr2=0x7f05bc0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bb59e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05bc06cfc0 0x7f05bc0b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bb59e640 1 -- 172.21.15.2:0/2516096994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4009b30 con 0x7f05bc0cda50 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bad9d640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05bc06cfc0 0x7f05bc0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bb59e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc0c9a60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f05b401a590 tx=0x7f05b4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05a37fe640 1 -- 172.21.15.2:0/2516096994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40bd070 con 0x7f05bc0cda50 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05a37fe640 1 -- 172.21.15.2:0/2516096994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b40b8470 con 0x7f05bc0cda50 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05a37fe640 1 -- 172.21.15.2:0/2516096994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40b8820 con 0x7f05bc0cda50 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc0b39a0 con 0x7f05bc0cda50 2023-11-04T01:44:55.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0b3f60 con 0x7f05bc0cda50 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc0b4460 con 0x7f05bc0cda50 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05a37fe640 1 -- 172.21.15.2:0/2516096994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f05b40b8980 con 0x7f05bc0cda50 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05a37fe640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05a80664a0 0x7f05a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05a37fe640 1 -- 172.21.15.2:0/2516096994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f05b411edc0 con 0x7f05bc0cda50 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bad9d640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05a80664a0 0x7f05a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.490+0000 7f05bad9d640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05a80664a0 0x7f05a8068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05ac007fd0 tx=0x7f05ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.494+0000 7f05a37fe640 1 -- 172.21.15.2:0/2516096994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05b40ec230 con 0x7f05bc0cda50 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.646+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05bc0675f0 con 0x7f05bc0cda50 2023-11-04T01:44:55.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.646+0000 7f05a37fe640 1 -- 172.21.15.2:0/2516096994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05b40ef850 con 0x7f05bc0cda50 2023-11-04T01:44:55.651 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05a80664a0 msgr2=0x7f05a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05a80664a0 0x7f05a8068960 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f05ac007fd0 tx=0x7f05ac009040 comp rx=0 tx=0).stop 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 msgr2=0x7f05bc0c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc0c9a60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f05b401a590 tx=0x7f05b4019700 comp rx=0 tx=0).stop 2023-11-04T01:44:55.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 shutdown_connections 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05a80664a0 0x7f05a8068960 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05bc0cda50 0x7f05bc0c9a60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05bc0cd670 0x7f05bc0c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 --2- 172.21.15.2:0/2516096994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05bc06cfc0 0x7f05bc0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 >> 172.21.15.2:0/2516096994 conn(0x7f05bc065dc0 msgr2=0x7f05bc0b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 shutdown_connections 2023-11-04T01:44:55.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.650+0000 7f05c108e640 1 -- 172.21.15.2:0/2516096994 wait complete. 2023-11-04T01:44:55.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f908a586640 1 Processor -- start 2023-11-04T01:44:55.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f908a586640 1 -- start start 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f908a586640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415acb0 0x7f908415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f908a586640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f908415c160 0x7f90840b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f908a586640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840cb130 con 0x7f90840b0a50 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f908a586640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908415bd40 con 0x7f908415c160 2023-11-04T01:44:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f908a586640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908406fd80 con 0x7f908415acb0 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f90837fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f908415c160 0x7f90840b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f9083fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415acb0 0x7f908415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f9088b23640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f90840b0a50 0x7f90840ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:32892/0 (socket says 172.21.15.2:32892) 2023-11-04T01:44:55.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f9088b23640 1 -- 172.21.15.2:0/491692085 learned_addr learned my addr 172.21.15.2:0/491692085 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f90837fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f908415c160 0x7f90840b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:53102/0 (socket says 172.21.15.2:53102) 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f9083fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415acb0 0x7f908415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:60490/0 (socket says 172.21.15.2:60490) 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f90837fe640 1 -- 172.21.15.2:0/491692085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415acb0 msgr2=0x7f908415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f90837fe640 1 --2- 172.21.15.2:0/491692085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415acb0 0x7f908415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f90837fe640 1 -- 172.21.15.2:0/491692085 >> v1:172.21.15.90:6789/0 conn(0x7f90840b0a50 legacy=0x7f90840ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.782+0000 7f90837fe640 1 -- 172.21.15.2:0/491692085 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908415b680 con 0x7f908415c160 2023-11-04T01:44:55.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f90837fe640 1 --2- 172.21.15.2:0/491692085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f908415c160 0x7f90840b0510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f906c009d90 tx=0x7f906c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21207616afd04b48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f9082ffd640 1 -- 172.21.15.2:0/491692085 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0a5920 con 0x7f908415c160 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f9082ffd640 1 -- 172.21.15.2:0/491692085 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0a5a80 con 0x7f908415c160 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f9082ffd640 1 -- 172.21.15.2:0/491692085 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0a5e10 con 0x7f908415c160 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 -- 172.21.15.2:0/491692085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f908415c160 msgr2=0x7f90840b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 --2- 172.21.15.2:0/491692085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f908415c160 0x7f90840b0510 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f906c009d90 tx=0x7f906c01c950 comp rx=0 tx=0).stop 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 -- 172.21.15.2:0/491692085 shutdown_connections 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 --2- 172.21.15.2:0/491692085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f908415c160 0x7f90840b0510 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 --2- 172.21.15.2:0/491692085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415acb0 0x7f908415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 -- 172.21.15.2:0/491692085 >> 172.21.15.2:0/491692085 conn(0x7f90840cb510 msgr2=0x7f90840cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 -- 172.21.15.2:0/491692085 shutdown_connections 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.786+0000 7f908a586640 1 -- 172.21.15.2:0/491692085 wait complete. 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 Processor -- start 2023-11-04T01:44:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 -- start start 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90840b0a50 0x7f908414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908415acb0 0x7f90840b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415c160 0x7f90840b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908406c1d0 con 0x7f908415acb0 2023-11-04T01:44:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908406b300 con 0x7f90840b0a50 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908406c5f0 con 0x7f908415c160 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908415acb0 0x7f90840b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908415acb0 0x7f90840b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40496/0 (socket says 172.21.15.2:40496) 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 -- 172.21.15.2:0/3406501918 learned_addr learned my addr 172.21.15.2:0/3406501918 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9083fff640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90840b0a50 0x7f908414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9088b23640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415c160 0x7f90840b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 -- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415c160 msgr2=0x7f90840b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415c160 0x7f90840b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 -- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90840b0a50 msgr2=0x7f908414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90840b0a50 0x7f908414b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 -- 172.21.15.2:0/3406501918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009a70 con 0x7f908415acb0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9088b23640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415c160 0x7f90840b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f90837fe640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908415acb0 0x7f90840b2c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f906c01a580 tx=0x7f906c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9080ff9640 1 -- 172.21.15.2:0/3406501918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0b7610 con 0x7f908415acb0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9080ff9640 1 -- 172.21.15.2:0/3406501918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0b7790 con 0x7f908415acb0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908406b550 con 0x7f908415acb0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9080ff9640 1 -- 172.21.15.2:0/3406501918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0b7b40 con 0x7f908415acb0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908406bb10 con 0x7f908415acb0 2023-11-04T01:44:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90840744a0 con 0x7f908415acb0 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9080ff9640 1 -- 172.21.15.2:0/3406501918 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f906c0b4050 con 0x7f908415acb0 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9080ff9640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90640664a0 0x7f9064068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9080ff9640 1 -- 172.21.15.2:0/3406501918 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f906c11f570 con 0x7f908415acb0 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.790+0000 7f9083fff640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90640664a0 0x7f9064068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:55.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.794+0000 7f9083fff640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90640664a0 0x7f9064068960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f90840cbf60 tx=0x7f9074008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.794+0000 7f9080ff9640 1 -- 172.21.15.2:0/3406501918 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f906c0ec8b0 con 0x7f908415acb0 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f90840cde30 con 0x7f908415acb0 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f9080ff9640 1 -- 172.21.15.2:0/3406501918 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v72) v1 ==== 103+0+11 (secure 0 0 0) 0x7f906c0b2020 con 0x7f908415acb0 2023-11-04T01:44:55.948 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90640664a0 msgr2=0x7f9064068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90640664a0 0x7f9064068960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f90840cbf60 tx=0x7f9074008040 comp rx=0 tx=0).stop 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908415acb0 msgr2=0x7f90840b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908415acb0 0x7f90840b2c90 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f906c01a580 tx=0x7f906c0196f0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 shutdown_connections 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f90640664a0 0x7f9064068960 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f908415c160 0x7f90840b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f908415acb0 0x7f90840b2c90 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 --2- 172.21.15.2:0/3406501918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90840b0a50 0x7f908414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 >> 172.21.15.2:0/3406501918 conn(0x7f90840cb510 msgr2=0x7f908414efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 shutdown_connections 2023-11-04T01:44:55.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:55.946+0000 7f908a586640 1 -- 172.21.15.2:0/3406501918 wait complete. 2023-11-04T01:44:55.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f43534cb640 1 Processor -- start 2023-11-04T01:44:56.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f43534cb640 1 -- start start 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f43534cb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 0x7f434c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f43534cb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434c0cb130 con 0x7f434c15c160 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f43534cb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434c15b680 con 0x7f434c15acb0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f43534cb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c15bd40 con 0x7f434c0b0c20 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351a68640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f434c15c160 0x7f434c0ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55398/0 (socket says 172.21.15.2:55398) 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351a68640 1 -- 172.21.15.2:0/3096521259 learned_addr learned my addr 172.21.15.2:0/3096521259 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4350a66640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 0x7f434c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676761799 0 0) 0x7f434c0cb130 con 0x7f434c15c160 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4338003530 con 0x7f434c15c160 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2933195562 0 0) 0x7f4338003530 con 0x7f434c15c160 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 msgr2=0x7f434c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:56.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 0x7f434c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 >> v1:172.21.15.90:6789/0 conn(0x7f434c15acb0 legacy=0x7f434c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c15b960 con 0x7f434c15c160 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f4344001a00 con 0x7f434c15c160 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 >> v1:172.21.15.2:6789/0 conn(0x7f434c15c160 legacy=0x7f434c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43380039b0 0x7f4338003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380047d0 0x7f4338004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 0x7f4338005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c15bd40 con 0x7f43380039b0 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433800ba40 con 0x7f43380047d0 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433800bc00 con 0x7f434c0b0c20 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351267640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43380039b0 0x7f4338003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4350a66640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380047d0 0x7f4338004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351a68640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 0x7f4338005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351267640 1 -- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 msgr2=0x7f4338005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351267640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0b0c20 0x7f4338005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351267640 1 -- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380047d0 msgr2=0x7f4338004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351267640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380047d0 0x7f4338004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.090+0000 7f4351267640 1 -- 172.21.15.2:0/3096521259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4338003530 con 0x7f43380039b0 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f4351267640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43380039b0 0x7f4338003dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4348001750 tx=0x7f434801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a8788c2c632872 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480052d0 con 0x7f43380039b0 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480a7050 con 0x7f43380039b0 2023-11-04T01:44:56.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f4343fff640 1 -- 172.21.15.2:0/3096521259 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348003600 con 0x7f43380039b0 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f43534cb640 1 -- 172.21.15.2:0/3096521259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43380039b0 msgr2=0x7f4338003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f43534cb640 1 --2- 172.21.15.2:0/3096521259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43380039b0 0x7f4338003dd0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4348001750 tx=0x7f434801c3a0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f4351a68640 1 -- 172.21.15.2:0/3096521259 reap_dead start 2023-11-04T01:44:56.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f43534cb640 1 -- 172.21.15.2:0/3096521259 shutdown_connections 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f43534cb640 1 -- 172.21.15.2:0/3096521259 >> 172.21.15.2:0/3096521259 conn(0x7f434c0cb510 msgr2=0x7f434c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f43534cb640 1 -- 172.21.15.2:0/3096521259 shutdown_connections 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.094+0000 7f43534cb640 1 -- 172.21.15.2:0/3096521259 wait complete. 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 Processor -- start 2023-11-04T01:44:56.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 -- start start 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380039b0 0x7f434c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0c5b60 0x7f434c158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0c5fe0 0x7f434c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0ae4c0 con 0x7f434c0c5fe0 2023-11-04T01:44:56.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0c6540 con 0x7f43380039b0 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0ae710 con 0x7f434c0c5b60 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0c5fe0 0x7f434c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0c5fe0 0x7f434c158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40516/0 (socket says 172.21.15.2:40516) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 -- 172.21.15.2:0/2746215808 learned_addr learned my addr 172.21.15.2:0/2746215808 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351267640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380039b0 0x7f434c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4350a66640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0c5b60 0x7f434c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 -- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0c5b60 msgr2=0x7f434c158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0c5b60 0x7f434c158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 -- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380039b0 msgr2=0x7f434c14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380039b0 0x7f434c14ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 -- 172.21.15.2:0/2746215808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c0ae9f0 con 0x7f434c0c5fe0 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351267640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380039b0 0x7f434c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4351a68640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0c5fe0 0x7f434c158c70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f434c0b47e0 tx=0x7f434400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4341ffb640 1 -- 172.21.15.2:0/2746215808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400ad40 con 0x7f434c0c5fe0 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4341ffb640 1 -- 172.21.15.2:0/2746215808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43440133f0 con 0x7f434c0c5fe0 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c0aecd0 con 0x7f434c0c5fe0 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f4341ffb640 1 -- 172.21.15.2:0/2746215808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43440137a0 con 0x7f434c0c5fe0 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c0c8930 con 0x7f434c0c5fe0 2023-11-04T01:44:56.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.098+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c0744a0 con 0x7f434c0c5fe0 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.102+0000 7f4341ffb640 1 -- 172.21.15.2:0/2746215808 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4344013900 con 0x7f434c0c5fe0 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.102+0000 7f4341ffb640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43300664a0 0x7f4330068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.102+0000 7f4341ffb640 1 -- 172.21.15.2:0/2746215808 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f4344084990 con 0x7f434c0c5fe0 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.102+0000 7f4351267640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43300664a0 0x7f4330068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.102+0000 7f4351267640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43300664a0 0x7f4330068960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f43380057b0 tx=0x7f43480011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.106+0000 7f4341ffb640 1 -- 172.21.15.2:0/2746215808 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4344051d70 con 0x7f434c0c5fe0 2023-11-04T01:44:56.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.262+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f434c0cde30 con 0x7f434c0c5fe0 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.262+0000 7f4341ffb640 1 -- 172.21.15.2:0/2746215808 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v72) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4344017020 con 0x7f434c0c5fe0 2023-11-04T01:44:56.266 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43300664a0 msgr2=0x7f4330068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43300664a0 0x7f4330068960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f43380057b0 tx=0x7f43480011a0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0c5fe0 msgr2=0x7f434c158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0c5fe0 0x7f434c158c70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f434c0b47e0 tx=0x7f434400a6e0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 shutdown_connections 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43300664a0 0x7f4330068960 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f434c0c5fe0 0x7f434c158c70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f434c0c5b60 0x7f434c158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 --2- 172.21.15.2:0/2746215808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43380039b0 0x7f434c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 >> 172.21.15.2:0/2746215808 conn(0x7f434c0cb510 msgr2=0x7f434c15a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:56.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 shutdown_connections 2023-11-04T01:44:56.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.266+0000 7f43534cb640 1 -- 172.21.15.2:0/2746215808 wait complete. 2023-11-04T01:44:56.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff221af640 1 Processor -- start 2023-11-04T01:44:56.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff221af640 1 -- start start 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff221af640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff1c15af70 0x7eff1c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff221af640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7eff1c06d160 0x7eff1c0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff221af640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c15e890 con 0x7eff1c15dd80 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff221af640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c071200 con 0x7eff1c15af70 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff221af640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c06c0c0 con 0x7eff1c06d160 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff1c15af70 0x7eff1c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7eff1c15af70 0x7eff1c0cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40524/0 (socket says 172.21.15.2:40524) 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1b7fe640 1 -- 172.21.15.2:0/3962513224 learned_addr learned my addr 172.21.15.2:0/3962513224 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1affd640 1 --2- 172.21.15.2:0/3962513224 >> v2:172.21.15.90:3300/0 conn(0x7eff1c06d160 0x7eff1c0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1b7fe640 1 -- 172.21.15.2:0/3962513224 >> v2:172.21.15.90:3300/0 conn(0x7eff1c06d160 msgr2=0x7eff1c0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1b7fe640 1 --2- 172.21.15.2:0/3962513224 >> v2:172.21.15.90:3300/0 conn(0x7eff1c06d160 0x7eff1c0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1b7fe640 1 -- 172.21.15.2:0/3962513224 >> v1:172.21.15.90:6789/0 conn(0x7eff1c15dd80 legacy=0x7eff1c15e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.410+0000 7eff1b7fe640 1 -- 172.21.15.2:0/3962513224 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c06c3a0 con 0x7eff1c15af70 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1b7fe640 1 --2- 172.21.15.2:0/3962513224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c0cdaa0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0cfb90 tx=0x7eff0401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aab3307b09ae9db server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1a7fc640 1 -- 172.21.15.2:0/3962513224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040ac410 con 0x7eff1c15af70 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1a7fc640 1 -- 172.21.15.2:0/3962513224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff040ac570 con 0x7eff1c15af70 2023-11-04T01:44:56.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1a7fc640 1 -- 172.21.15.2:0/3962513224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff040ac900 con 0x7eff1c15af70 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- 172.21.15.2:0/3962513224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 msgr2=0x7eff1c0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 --2- 172.21.15.2:0/3962513224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c0cdaa0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0cfb90 tx=0x7eff0401c4c0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- 172.21.15.2:0/3962513224 shutdown_connections 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 --2- 172.21.15.2:0/3962513224 >> v2:172.21.15.90:3300/0 conn(0x7eff1c06d160 0x7eff1c0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 --2- 172.21.15.2:0/3962513224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c0cdaa0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- 172.21.15.2:0/3962513224 >> 172.21.15.2:0/3962513224 conn(0x7eff1c0cb510 msgr2=0x7eff1c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- 172.21.15.2:0/3962513224 shutdown_connections 2023-11-04T01:44:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- 172.21.15.2:0/3962513224 wait complete. 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 Processor -- start 2023-11-04T01:44:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- start start 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff1c06d160 0x7eff1c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff1c15dd80 0x7eff1c149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c15a810 con 0x7eff1c15af70 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1572c0 con 0x7eff1c06d160 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff221af640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c149590 con 0x7eff1c15dd80 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40534/0 (socket says 172.21.15.2:40534) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 -- 172.21.15.2:0/1501581694 learned_addr learned my addr 172.21.15.2:0/1501581694 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1bfff640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff1c15dd80 0x7eff1c149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 -- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff1c15dd80 msgr2=0x7eff1c149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1b7fe640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff1c06d160 0x7eff1c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff1c15dd80 0x7eff1c149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 -- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff1c06d160 msgr2=0x7eff1c0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff1c06d160 0x7eff1c0c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1affd640 1 -- 172.21.15.2:0/1501581694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040094d0 con 0x7eff1c15af70 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.414+0000 7eff1bfff640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff1c15dd80 0x7eff1c149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff1affd640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c156d80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d830 tx=0x7eff0c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff13fff640 1 -- 172.21.15.2:0/1501581694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00b6c0 con 0x7eff1c15af70 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff13fff640 1 -- 172.21.15.2:0/1501581694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00b820 con 0x7eff1c15af70 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c15a530 con 0x7eff1c15af70 2023-11-04T01:44:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff13fff640 1 -- 172.21.15.2:0/1501581694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00bb90 con 0x7eff1c15af70 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c165970 con 0x7eff1c15af70 2023-11-04T01:44:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c1654f0 con 0x7eff1c15af70 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff13fff640 1 -- 172.21.15.2:0/1501581694 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff0c01e460 con 0x7eff1c15af70 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff13fff640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff13fff640 1 -- 172.21.15.2:0/1501581694 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7eff0c084790 con 0x7eff1c15af70 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff1b7fe640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.418+0000 7eff1b7fe640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff040ae000 tx=0x7eff04008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.426+0000 7eff13fff640 1 -- 172.21.15.2:0/1501581694 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff1c1654f0 con 0x7eff1c15af70 2023-11-04T01:44:56.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.574+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7eff1c1654f0 con 0x7eff1c15af70 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.574+0000 7eff13fff640 1 -- 172.21.15.2:0/1501581694 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v72) v1 ==== 107+0+11 (secure 0 0 0) 0x7eff1c1654f0 con 0x7eff1c15af70 2023-11-04T01:44:56.579 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 msgr2=0x7efefc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7eff040ae000 tx=0x7eff04008040 comp rx=0 tx=0).stop 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 msgr2=0x7eff1c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c156d80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00d830 tx=0x7eff0c00dcf0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 shutdown_connections 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efefc0664a0 0x7efefc068960 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff1c15dd80 0x7eff1c149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff1c15af70 0x7eff1c156d80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 --2- 172.21.15.2:0/1501581694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff1c06d160 0x7eff1c0c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 >> 172.21.15.2:0/1501581694 conn(0x7eff1c0cb510 msgr2=0x7eff1c0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 shutdown_connections 2023-11-04T01:44:56.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.578+0000 7eff221af640 1 -- 172.21.15.2:0/1501581694 wait complete. 2023-11-04T01:44:56.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e99f3640 1 Processor -- start 2023-11-04T01:44:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e99f3640 1 -- start start 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e99f3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f15e415ccb0 0x7f15e40ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e99f3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f15e40cdf00 0x7f15e40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e99f3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40ccc30 con 0x7f15e406ba90 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e99f3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e40cda70 con 0x7f15e415ccb0 2023-11-04T01:44:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e99f3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e4070af0 con 0x7f15e40cdf00 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e2ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f15e415ccb0 0x7f15e40ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e2ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f15e415ccb0 0x7f15e40ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40538/0 (socket says 172.21.15.2:40538) 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e2ffd640 1 -- 172.21.15.2:0/203367296 learned_addr learned my addr 172.21.15.2:0/203367296 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e27fc640 1 --2- 172.21.15.2:0/203367296 >> v2:172.21.15.90:3300/0 conn(0x7f15e40cdf00 0x7f15e40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e2ffd640 1 -- 172.21.15.2:0/203367296 >> v2:172.21.15.90:3300/0 conn(0x7f15e40cdf00 msgr2=0x7f15e40cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e2ffd640 1 --2- 172.21.15.2:0/203367296 >> v2:172.21.15.90:3300/0 conn(0x7f15e40cdf00 0x7f15e40cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e2ffd640 1 -- 172.21.15.2:0/203367296 >> v1:172.21.15.90:6789/0 conn(0x7f15e406ba90 legacy=0x7f15e415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.702+0000 7f15e2ffd640 1 -- 172.21.15.2:0/203367296 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40cce60 con 0x7f15e415ccb0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e2ffd640 1 --2- 172.21.15.2:0/203367296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e415ccb0 0x7f15e40ce580 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f15e40cf990 tx=0x7f15d401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfc3d5f34546b26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e1ffb640 1 -- 172.21.15.2:0/203367296 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40a89b0 con 0x7f15e415ccb0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e1ffb640 1 -- 172.21.15.2:0/203367296 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d40a8b10 con 0x7f15e415ccb0 2023-11-04T01:44:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e1ffb640 1 -- 172.21.15.2:0/203367296 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40a8ea0 con 0x7f15e415ccb0 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 -- 172.21.15.2:0/203367296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e415ccb0 msgr2=0x7f15e40ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 --2- 172.21.15.2:0/203367296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e415ccb0 0x7f15e40ce580 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f15e40cf990 tx=0x7f15d401ecb0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 -- 172.21.15.2:0/203367296 shutdown_connections 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 --2- 172.21.15.2:0/203367296 >> v2:172.21.15.90:3300/0 conn(0x7f15e40cdf00 0x7f15e40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 --2- 172.21.15.2:0/203367296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e415ccb0 0x7f15e40ce580 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 -- 172.21.15.2:0/203367296 >> 172.21.15.2:0/203367296 conn(0x7f15e40cebb0 msgr2=0x7f15e40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 -- 172.21.15.2:0/203367296 shutdown_connections 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 -- 172.21.15.2:0/203367296 wait complete. 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 Processor -- start 2023-11-04T01:44:56.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.706+0000 7f15e99f3640 1 -- start start 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e406ba90 0x7f15e4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15e40cdf00 0x7f15e41456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15e415ccb0 0x7f15e414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e414a810 con 0x7f15e406ba90 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4152b80 con 0x7f15e40cdf00 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4149790 con 0x7f15e415ccb0 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e406ba90 0x7f15e4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e406ba90 0x7f15e4152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40554/0 (socket says 172.21.15.2:40554) 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 -- 172.21.15.2:0/2012483504 learned_addr learned my addr 172.21.15.2:0/2012483504 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e37fe640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15e415ccb0 0x7f15e414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e27fc640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15e40cdf00 0x7f15e41456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 -- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15e415ccb0 msgr2=0x7f15e414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15e415ccb0 0x7f15e414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 -- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15e40cdf00 msgr2=0x7f15e41456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15e40cdf00 0x7f15e41456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 -- 172.21.15.2:0/2012483504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40094d0 con 0x7f15e406ba90 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e37fe640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15e415ccb0 0x7f15e414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e27fc640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15e40cdf00 0x7f15e41456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:56.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e2ffd640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e406ba90 0x7f15e4152640 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f15d40b3040 tx=0x7f15d401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15cbfff640 1 -- 172.21.15.2:0/2012483504 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40b0e80 con 0x7f15e406ba90 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15cbfff640 1 -- 172.21.15.2:0/2012483504 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d40bb480 con 0x7f15e406ba90 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e4149a70 con 0x7f15e406ba90 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15cbfff640 1 -- 172.21.15.2:0/2012483504 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40bb810 con 0x7f15e406ba90 2023-11-04T01:44:56.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e414a030 con 0x7f15e406ba90 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e40744a0 con 0x7f15e406ba90 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15cbfff640 1 -- 172.21.15.2:0/2012483504 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f15d40bb970 con 0x7f15e406ba90 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15cbfff640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15d00664a0 0x7f15d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15cbfff640 1 -- 172.21.15.2:0/2012483504 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f15d4122630 con 0x7f15e406ba90 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.710+0000 7f15e27fc640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15d00664a0 0x7f15d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.714+0000 7f15e27fc640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15d00664a0 0x7f15d0068960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f15e40c30d0 tx=0x7f15d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.718+0000 7f15cbfff640 1 -- 172.21.15.2:0/2012483504 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f15d40ef900 con 0x7f15e406ba90 2023-11-04T01:44:56.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:56.922+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f15e40744a0 con 0x7f15e406ba90 2023-11-04T01:44:57.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.026+0000 7f15cbfff640 1 -- 172.21.15.2:0/2012483504 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v164) v1 ==== 151+0+0 (secure 0 0 0) 0x7f15d40f2f20 con 0x7f15e406ba90 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15d00664a0 msgr2=0x7f15d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15d00664a0 0x7f15d0068960 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f15e40c30d0 tx=0x7f15d8008040 comp rx=0 tx=0).stop 2023-11-04T01:44:57.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e406ba90 msgr2=0x7f15e4152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e406ba90 0x7f15e4152640 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f15d40b3040 tx=0x7f15d401ba50 comp rx=0 tx=0).stop 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 shutdown_connections 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f15d00664a0 0x7f15d0068960 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f15e415ccb0 0x7f15e414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15e40cdf00 0x7f15e41456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 --2- 172.21.15.2:0/2012483504 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15e406ba90 0x7f15e4152640 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 >> 172.21.15.2:0/2012483504 conn(0x7f15e40cebb0 msgr2=0x7f15e40c99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 shutdown_connections 2023-11-04T01:44:57.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.030+0000 7f15e99f3640 1 -- 172.21.15.2:0/2012483504 wait complete. 2023-11-04T01:44:57.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:44:57.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.174+0000 7f13f700c640 1 Processor -- start 2023-11-04T01:44:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.174+0000 7f13f700c640 1 -- start start 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f700c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13f015aff0 0x7f13f00cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f700c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f13f00ca0a0 0x7f13f006a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f700c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f006a290 con 0x7f13f0070270 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f700c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f00cbba0 con 0x7f13f015aff0 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f700c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f0071e90 con 0x7f13f00ca0a0 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13f015aff0 0x7f13f00cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13f015aff0 0x7f13f00cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40568/0 (socket says 172.21.15.2:40568) 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 -- 172.21.15.2:0/1901813788 learned_addr learned my addr 172.21.15.2:0/1901813788 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 -- 172.21.15.2:0/1901813788 >> v2:172.21.15.90:3300/0 conn(0x7f13f00ca0a0 msgr2=0x7f13f006a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f55a9640 1 --2- 172.21.15.2:0/1901813788 >> v2:172.21.15.90:3300/0 conn(0x7f13f00ca0a0 0x7f13f006a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 --2- 172.21.15.2:0/1901813788 >> v2:172.21.15.90:3300/0 conn(0x7f13f00ca0a0 0x7f13f006a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13ef7fe640 1 -- 172.21.15.2:0/1901813788 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311836287 0 0) 0x7f13f006a290 con 0x7f13f0070270 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 -- 172.21.15.2:0/1901813788 >> v1:172.21.15.2:6789/0 conn(0x7f13f0070270 legacy=0x7f13f00c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 -- 172.21.15.2:0/1901813788 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0072170 con 0x7f13f015aff0 2023-11-04T01:44:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13f4da8640 1 --2- 172.21.15.2:0/1901813788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f015aff0 0x7f13f00cb5c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f13f006fc60 tx=0x7f13e401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d696f6b147fae67 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13ef7fe640 1 -- 172.21.15.2:0/1901813788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e40a89f0 con 0x7f13f015aff0 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13ef7fe640 1 -- 172.21.15.2:0/1901813788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e40a8b50 con 0x7f13f015aff0 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.178+0000 7f13ef7fe640 1 -- 172.21.15.2:0/1901813788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e40b0440 con 0x7f13f015aff0 2023-11-04T01:44:57.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- 172.21.15.2:0/1901813788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f015aff0 msgr2=0x7f13f00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 --2- 172.21.15.2:0/1901813788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f015aff0 0x7f13f00cb5c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f13f006fc60 tx=0x7f13e401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- 172.21.15.2:0/1901813788 shutdown_connections 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 --2- 172.21.15.2:0/1901813788 >> v2:172.21.15.90:3300/0 conn(0x7f13f00ca0a0 0x7f13f006a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 --2- 172.21.15.2:0/1901813788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f015aff0 0x7f13f00cb5c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- 172.21.15.2:0/1901813788 >> 172.21.15.2:0/1901813788 conn(0x7f13f00b0e30 msgr2=0x7f13f00b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- 172.21.15.2:0/1901813788 shutdown_connections 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- 172.21.15.2:0/1901813788 wait complete. 2023-11-04T01:44:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 Processor -- start 2023-11-04T01:44:57.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- start start 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13f0070270 0x7f13f00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f00ca0a0 0x7f13f01e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f015aff0 0x7f13f01e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0144370 con 0x7f13f00ca0a0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f01f6a40 con 0x7f13f015aff0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f01e78f0 con 0x7f13f0070270 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f00ca0a0 0x7f13f01e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f00ca0a0 0x7f13f01e6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40580/0 (socket says 172.21.15.2:40580) 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 -- 172.21.15.2:0/3275956193 learned_addr learned my addr 172.21.15.2:0/3275956193 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f55a9640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f015aff0 0x7f13f01e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f4da8640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13f0070270 0x7f13f00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 -- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13f0070270 msgr2=0x7f13f00af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13f0070270 0x7f13f00af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 -- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f015aff0 msgr2=0x7f13f01e73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f015aff0 0x7f13f01e73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 -- 172.21.15.2:0/3275956193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40094d0 con 0x7f13f00ca0a0 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13effff640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f00ca0a0 0x7f13f01e6e70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c500 tx=0x7f13dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13ed7fa640 1 -- 172.21.15.2:0/3275956193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc003600 con 0x7f13f00ca0a0 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13ed7fa640 1 -- 172.21.15.2:0/3275956193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc003760 con 0x7f13f00ca0a0 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13ed7fa640 1 -- 172.21.15.2:0/3275956193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc003b10 con 0x7f13f00ca0a0 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f00c3890 con 0x7f13f00ca0a0 2023-11-04T01:44:57.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.182+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f01f63f0 con 0x7f13f00ca0a0 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.186+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f01f6bf0 con 0x7f13f00ca0a0 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.186+0000 7f13ed7fa640 1 -- 172.21.15.2:0/3275956193 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13dc003c70 con 0x7f13f00ca0a0 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.186+0000 7f13ed7fa640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13d40664a0 0x7f13d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.186+0000 7f13ed7fa640 1 -- 172.21.15.2:0/3275956193 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f13dc083530 con 0x7f13f00ca0a0 2023-11-04T01:44:57.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.186+0000 7f13f4da8640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13d40664a0 0x7f13d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.186+0000 7f13f4da8640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13d40664a0 0x7f13d4068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f13e40b2000 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.190+0000 7f13ed7fa640 1 -- 172.21.15.2:0/3275956193 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f13dc0509d0 con 0x7f13f00ca0a0 2023-11-04T01:44:57.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.346+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f13f00675f0 con 0x7f13f00ca0a0 2023-11-04T01:44:57.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13ed7fa640 1 -- 172.21.15.2:0/3275956193 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v17)=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13dc0170c0 con 0x7f13f00ca0a0 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13d40664a0 msgr2=0x7f13d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13d40664a0 0x7f13d4068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f13e40b2000 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f00ca0a0 msgr2=0x7f13f01e6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f00ca0a0 0x7f13f01e6e70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c500 tx=0x7f13dc00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 shutdown_connections 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13d40664a0 0x7f13d4068960 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13f015aff0 0x7f13f01e73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13f00ca0a0 0x7f13f01e6e70 secure :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c500 tx=0x7f13dc00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 --2- 172.21.15.2:0/3275956193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13f0070270 0x7f13f00af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 >> 172.21.15.2:0/3275956193 conn(0x7f13f00b0e30 msgr2=0x7f13f006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 shutdown_connections 2023-11-04T01:44:57.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.354+0000 7f13f700c640 1 -- 172.21.15.2:0/3275956193 wait complete. 2023-11-04T01:44:57.375 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:44:57.376 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:57.413 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:44:57.473 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:44:57.473 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:57.473 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:57.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:44:57.478 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:57.478 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:57.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:57.484 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:44:57.484 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:57.524 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:44:57.524 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:44:57.524 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:44:57.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:44:57.535 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:44:57.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b47198640 1 Processor -- start 2023-11-04T01:44:57.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b47198640 1 -- start start 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b47198640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b4015afd0 0x7f8b400715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b47198640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b4006f8f0 0x7f8b400b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b47198640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b400c2670 con 0x7f8b400b0b70 2023-11-04T01:44:57.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b47198640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b40070140 con 0x7f8b4006f8f0 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b47198640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4015fc90 con 0x7f8b4015afd0 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b3ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b4006f8f0 0x7f8b400b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b45735640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8b400b0b70 0x7f8b400c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55414/0 (socket says 172.21.15.2:55414) 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b3ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8b4006f8f0 0x7f8b400b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40588/0 (socket says 172.21.15.2:40588) 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b45735640 1 -- 172.21.15.2:0/903904631 learned_addr learned my addr 172.21.15.2:0/903904631 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b44f34640 1 --2- 172.21.15.2:0/903904631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b4015afd0 0x7f8b400715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b3ffff640 1 -- 172.21.15.2:0/903904631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b4015afd0 msgr2=0x7f8b400715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b3ffff640 1 --2- 172.21.15.2:0/903904631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b4015afd0 0x7f8b400715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b3ffff640 1 -- 172.21.15.2:0/903904631 >> v1:172.21.15.2:6789/0 conn(0x7f8b400b0b70 legacy=0x7f8b400c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b3f7fe640 1 -- 172.21.15.2:0/903904631 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704197676 0 0) 0x7f8b400c2670 con 0x7f8b400b0b70 2023-11-04T01:44:57.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.694+0000 7f8b3ffff640 1 -- 172.21.15.2:0/903904631 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4006bc30 con 0x7f8b4006f8f0 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b3ffff640 1 --2- 172.21.15.2:0/903904631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b400b0630 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0097c0 tx=0x7f8b2c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0714b1ffa34e005 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b3f7fe640 1 -- 172.21.15.2:0/903904631 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0ab600 con 0x7f8b4006f8f0 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b3f7fe640 1 -- 172.21.15.2:0/903904631 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c0a7050 con 0x7f8b4006f8f0 2023-11-04T01:44:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b3f7fe640 1 -- 172.21.15.2:0/903904631 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0ab980 con 0x7f8b4006f8f0 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- 172.21.15.2:0/903904631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 msgr2=0x7f8b400b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 --2- 172.21.15.2:0/903904631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b400b0630 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0097c0 tx=0x7f8b2c01c480 comp rx=0 tx=0).stop 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- 172.21.15.2:0/903904631 shutdown_connections 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 --2- 172.21.15.2:0/903904631 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b400b0630 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 --2- 172.21.15.2:0/903904631 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b4015afd0 0x7f8b400715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- 172.21.15.2:0/903904631 >> 172.21.15.2:0/903904631 conn(0x7f8b400cebb0 msgr2=0x7f8b400cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- 172.21.15.2:0/903904631 shutdown_connections 2023-11-04T01:44:57.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- 172.21.15.2:0/903904631 wait complete. 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 Processor -- start 2023-11-04T01:44:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- start start 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b40159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b400b0b70 0x7f8b400cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b4015afd0 0x7f8b4014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4015a490 con 0x7f8b4006f8f0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b400cd100 con 0x7f8b4015afd0 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b47198640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b400c7400 con 0x7f8b400b0b70 2023-11-04T01:44:57.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b44f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b40159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b44f34640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b40159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40602/0 (socket says 172.21.15.2:40602) 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.698+0000 7f8b44f34640 1 -- 172.21.15.2:0/2972728109 learned_addr learned my addr 172.21.15.2:0/2972728109 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3ffff640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b400b0b70 0x7f8b400cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b45735640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b4015afd0 0x7f8b4014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b44f34640 1 -- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b400b0b70 msgr2=0x7f8b400cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b44f34640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b400b0b70 0x7f8b400cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b44f34640 1 -- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b4015afd0 msgr2=0x7f8b4014a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b44f34640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b4015afd0 0x7f8b4014a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b44f34640 1 -- 172.21.15.2:0/2972728109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c009420 con 0x7f8b4006f8f0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b45735640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b4015afd0 0x7f8b4014a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b44f34640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b40159f50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d800 tx=0x7f8b3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3d7fa640 1 -- 172.21.15.2:0/2972728109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400b6c0 con 0x7f8b4006f8f0 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3d7fa640 1 -- 172.21.15.2:0/2972728109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3400b820 con 0x7f8b4006f8f0 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b400cd350 con 0x7f8b4006f8f0 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3d7fa640 1 -- 172.21.15.2:0/2972728109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400bb90 con 0x7f8b4006f8f0 2023-11-04T01:44:57.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b400cd910 con 0x7f8b4006f8f0 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b400744a0 con 0x7f8b4006f8f0 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3d7fa640 1 -- 172.21.15.2:0/2972728109 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b3400bcf0 con 0x7f8b4006f8f0 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3d7fa640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b240664a0 0x7f8b24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3d7fa640 1 -- 172.21.15.2:0/2972728109 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f8b34084490 con 0x7f8b4006f8f0 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3ffff640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b240664a0 0x7f8b24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:57.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.702+0000 7f8b3ffff640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b240664a0 0x7f8b24068960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0ad000 tx=0x7f8b2c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:57.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.706+0000 7f8b3d7fa640 1 -- 172.21.15.2:0/2972728109 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b34051870 con 0x7f8b4006f8f0 2023-11-04T01:44:57.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.898+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b4006cba0 con 0x7f8b4006f8f0 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.898+0000 7f8b3d7fa640 1 -- 172.21.15.2:0/2972728109 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f8b34054e90 con 0x7f8b4006f8f0 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5518,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3645027182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3645027182},{"type":"v1","addr":"172.21.15.90:6835","nonce":3645027182}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1098346949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1098346949},{"type":"v1","addr":"172.21.15.90:6837","nonce":1098346949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/4012044748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":4012044748},{"type":"v1","addr":"172.21.15.2:6834","nonce":4012044748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1698917192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":1698917192},{"type":"v1","addr":"172.21.15.2:6835","nonce":1698917192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2023-11-04T01:44:57.902 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 28 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b240664a0 msgr2=0x7f8b24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b240664a0 0x7f8b24068960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0ad000 tx=0x7f8b2c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 msgr2=0x7f8b40159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b40159f50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d800 tx=0x7f8b3400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 shutdown_connections 2023-11-04T01:44:57.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b240664a0 0x7f8b24068960 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b4015afd0 0x7f8b4014a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b400b0b70 0x7f8b400cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 --2- 172.21.15.2:0/2972728109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b4006f8f0 0x7f8b40159f50 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 >> 172.21.15.2:0/2972728109 conn(0x7f8b400cebb0 msgr2=0x7f8b400c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 shutdown_connections 2023-11-04T01:44:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:57.902+0000 7f8b47198640 1 -- 172.21.15.2:0/2972728109 wait complete. 2023-11-04T01:44:57.921 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:44:57.921 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:44:57.922 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:57.922 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:44:57.922 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:44:57.922 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:44:57.922 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:57.923 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:44:57.923 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:44:57.923 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:44:57.923 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:57.923 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:44:57.923 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:44:57.924 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:44:57.924 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:44:57.934 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:44:57.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:44:57.935 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:44:57.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:44:57.938 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:44:57.938 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:44:57.943 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:44:57.943 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:44:57.976 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:44:57.977 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:57.977 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:44:57.977 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:57.991 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:44:57.992 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:57.993 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:44:57.993 DEBUG:teuthology.parallel:result is None 2023-11-04T01:44:57.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:44:58.038 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:44:58.047 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:44:58.059 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:44:58.064 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.110+0000 7f5390894640 1 Processor -- start 2023-11-04T01:44:58.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.110+0000 7f5390894640 1 -- start start 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5390894640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f538c0b4990 0x7f538c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5390894640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538c0b6070 con 0x7f538c0d0690 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5390894640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538c0b8ed0 con 0x7f538c0b74f0 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5390894640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c0ce590 con 0x7f538c0b4990 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5389d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f538c0d0690 0x7f538c0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55434/0 (socket says 172.21.15.2:55434) 2023-11-04T01:44:58.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f538c0b4990 0x7f538c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5389d9b640 1 -- 172.21.15.2:0/928865273 learned_addr learned my addr 172.21.15.2:0/928865273 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538a59c640 1 -- 172.21.15.2:0/928865273 >> v1:172.21.15.90:6789/0 conn(0x7f538c0b74f0 legacy=0x7f538c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538a59c640 1 -- 172.21.15.2:0/928865273 >> v1:172.21.15.2:6789/0 conn(0x7f538c0d0690 legacy=0x7f538c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538959a640 1 -- 172.21.15.2:0/928865273 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186381509 0 0) 0x7f538c0b6070 con 0x7f538c0d0690 2023-11-04T01:44:58.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538a59c640 1 -- 172.21.15.2:0/928865273 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c0b52b0 con 0x7f538c0b4990 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538a59c640 1 --2- 172.21.15.2:0/928865273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0b4990 0x7f538c0b4d70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f537c0097c0 tx=0x7f537c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ce3a1fd75e43ea server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:58.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538959a640 1 -- 172.21.15.2:0/928865273 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c0a8970 con 0x7f538c0b4990 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538959a640 1 -- 172.21.15.2:0/928865273 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c0a8ad0 con 0x7f538c0b4990 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f538959a640 1 -- 172.21.15.2:0/928865273 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c0a8e60 con 0x7f538c0b4990 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5390894640 1 -- 172.21.15.2:0/928865273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0b4990 msgr2=0x7f538c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.114+0000 7f5390894640 1 --2- 172.21.15.2:0/928865273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0b4990 0x7f538c0b4d70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f537c0097c0 tx=0x7f537c01ec70 comp rx=0 tx=0).stop 2023-11-04T01:44:58.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- 172.21.15.2:0/928865273 shutdown_connections 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 --2- 172.21.15.2:0/928865273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0b4990 0x7f538c0b4d70 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- 172.21.15.2:0/928865273 >> 172.21.15.2:0/928865273 conn(0x7f538c0cf990 msgr2=0x7f538c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- 172.21.15.2:0/928865273 shutdown_connections 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- 172.21.15.2:0/928865273 wait complete. 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 Processor -- start 2023-11-04T01:44:58.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- start start 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f538c0b4990 0x7f538c1f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f538c0b74f0 0x7f538c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0d0690 0x7f538c152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0cd1d0 con 0x7f538c0d0690 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c158140 con 0x7f538c0b74f0 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c158420 con 0x7f538c0b4990 2023-11-04T01:44:58.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0d0690 0x7f538c152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0d0690 0x7f538c152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40646/0 (socket says 172.21.15.2:40646) 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 -- 172.21.15.2:0/2893327421 learned_addr learned my addr 172.21.15.2:0/2893327421 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5389d9b640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f538c0b74f0 0x7f538c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538a59c640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f538c0b4990 0x7f538c1f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 -- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f538c0b4990 msgr2=0x7f538c1f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f538c0b4990 0x7f538c1f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 -- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f538c0b74f0 msgr2=0x7f538c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f538c0b74f0 0x7f538c0ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 -- 172.21.15.2:0/2893327421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c009420 con 0x7f538c0d0690 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f538ad9d640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0d0690 0x7f538c152490 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f538400c7a0 tx=0x7f538400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f537affd640 1 -- 172.21.15.2:0/2893327421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384003b80 con 0x7f538c0d0690 2023-11-04T01:44:58.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f537affd640 1 -- 172.21.15.2:0/2893327421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384003ce0 con 0x7f538c0d0690 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c158700 con 0x7f538c0d0690 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f537affd640 1 -- 172.21.15.2:0/2893327421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538400aa30 con 0x7f538c0d0690 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c158cc0 con 0x7f538c0d0690 2023-11-04T01:44:58.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.118+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c158ee0 con 0x7f538c0d0690 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.122+0000 7f537affd640 1 -- 172.21.15.2:0/2893327421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f538400ab90 con 0x7f538c0d0690 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.122+0000 7f537affd640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f536c0664a0 0x7f536c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.122+0000 7f537affd640 1 -- 172.21.15.2:0/2893327421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f5384083c80 con 0x7f538c0d0690 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.122+0000 7f538a59c640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f536c0664a0 0x7f536c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:58.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.122+0000 7f538a59c640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f536c0664a0 0x7f536c068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f537c0b2000 tx=0x7f537c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:58.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.126+0000 7f537affd640 1 -- 172.21.15.2:0/2893327421 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5384051080 con 0x7f538c0d0690 2023-11-04T01:44:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:58.286+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f538c0744a0 con 0x7f538c0d0690 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.058+0000 7f537affd640 1 -- 172.21.15.2:0/2893327421 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7f53840546a0 con 0x7f538c0d0690 2023-11-04T01:44:59.063 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.062+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f536c0664a0 msgr2=0x7f536c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.062+0000 7f5390894640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f536c0664a0 0x7f536c068960 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f537c0b2000 tx=0x7f537c008040 comp rx=0 tx=0).stop 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.062+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0d0690 msgr2=0x7f538c152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.062+0000 7f5390894640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0d0690 0x7f538c152490 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f538400c7a0 tx=0x7f538400cc60 comp rx=0 tx=0).stop 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 shutdown_connections 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f536c0664a0 0x7f536c068960 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f538c0d0690 0x7f538c152490 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f538c0b74f0 0x7f538c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 --2- 172.21.15.2:0/2893327421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f538c0b4990 0x7f538c1f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 >> 172.21.15.2:0/2893327421 conn(0x7f538c0cf990 msgr2=0x7f538c0d14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 shutdown_connections 2023-11-04T01:44:59.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.066+0000 7f5390894640 1 -- 172.21.15.2:0/2893327421 wait complete. 2023-11-04T01:44:59.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f237042d640 1 Processor -- start 2023-11-04T01:44:59.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f237042d640 1 -- start start 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f237042d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f23680b4990 0x7f23680b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f237042d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23680b6070 con 0x7f23680d0690 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f237042d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23680b8ed0 con 0x7f23680b74f0 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f237042d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23680ce590 con 0x7f23680b4990 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d9c8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f23680d0690 0x7f23680cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55440/0 (socket says 172.21.15.2:55440) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d9c8640 1 -- 172.21.15.2:0/966171870 learned_addr learned my addr 172.21.15.2:0/966171870 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236e1c9640 1 --2- 172.21.15.2:0/966171870 >> v2:172.21.15.90:3300/0 conn(0x7f23680b4990 0x7f23680b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643354368 0 0) 0x7f23680b6070 con 0x7f23680d0690 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2354003530 con 0x7f23680d0690 2023-11-04T01:44:59.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880559797 0 0) 0x7f2354003530 con 0x7f23680d0690 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 >> v2:172.21.15.90:3300/0 conn(0x7f23680b4990 msgr2=0x7f23680b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 --2- 172.21.15.2:0/966171870 >> v2:172.21.15.90:3300/0 conn(0x7f23680b4990 0x7f23680b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 >> v1:172.21.15.90:6789/0 conn(0x7f23680b74f0 legacy=0x7f23680cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680b52b0 con 0x7f23680d0690 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2358001680 con 0x7f23680d0690 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 >> v1:172.21.15.2:6789/0 conn(0x7f23680d0690 legacy=0x7f23680cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23540039d0 0x7f2354003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23540047d0 0x7f2354004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f235400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680ce590 con 0x7f2354005190 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235400c070 con 0x7f23540039d0 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235400c230 con 0x7f23540047d0 2023-11-04T01:44:59.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236e9ca640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f235400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236e9ca640 1 -- 172.21.15.2:0/966171870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23540047d0 msgr2=0x7f2354004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236e9ca640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23540047d0 0x7f2354004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236e9ca640 1 -- 172.21.15.2:0/966171870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23540039d0 msgr2=0x7f2354003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236e9ca640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23540039d0 0x7f2354003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.250+0000 7f236e9ca640 1 -- 172.21.15.2:0/966171870 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354003530 con 0x7f2354005190 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f236e9ca640 1 -- 172.21.15.2:0/966171870 reap_dead start 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f236e9ca640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f235400b990 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2360001e40 tx=0x7f236001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df007859b3bc4d40 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360003b80 con 0x7f2354005190 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2360003ce0 con 0x7f2354005190 2023-11-04T01:44:59.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f236d1c7640 1 -- 172.21.15.2:0/966171870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360005260 con 0x7f2354005190 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 -- 172.21.15.2:0/966171870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 msgr2=0x7f235400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f235400b990 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2360001e40 tx=0x7f236001c740 comp rx=0 tx=0).stop 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 -- 172.21.15.2:0/966171870 shutdown_connections 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 --2- 172.21.15.2:0/966171870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f235400b990 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 -- 172.21.15.2:0/966171870 >> 172.21.15.2:0/966171870 conn(0x7f23680cf990 msgr2=0x7f23680cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 -- 172.21.15.2:0/966171870 shutdown_connections 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 -- 172.21.15.2:0/966171870 wait complete. 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 Processor -- start 2023-11-04T01:44:59.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.254+0000 7f237042d640 1 -- start start 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f236815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23680b12e0 0x7f23680d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23680b3d90 0x7f23680b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b4760 con 0x7f2354005190 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680d38b0 con 0x7f23680b12e0 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b1a50 con 0x7f23680b3d90 2023-11-04T01:44:59.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f236815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f236815b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40672/0 (socket says 172.21.15.2:40672) 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 -- 172.21.15.2:0/1799356166 learned_addr learned my addr 172.21.15.2:0/1799356166 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236d9c8640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23680b12e0 0x7f23680d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e9ca640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23680b3d90 0x7f23680b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 -- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23680b3d90 msgr2=0x7f23680b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23680b3d90 0x7f23680b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 -- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23680b12e0 msgr2=0x7f23680d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23680b12e0 0x7f23680d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 -- 172.21.15.2:0/1799356166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680abe90 con 0x7f2354005190 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236e1c9640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f236815b540 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f236400e820 tx=0x7f236400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f235effd640 1 -- 172.21.15.2:0/1799356166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236400eed0 con 0x7f2354005190 2023-11-04T01:44:59.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f235effd640 1 -- 172.21.15.2:0/1799356166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236400c8e0 con 0x7f2354005190 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236815ba80 con 0x7f2354005190 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f235effd640 1 -- 172.21.15.2:0/1799356166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236400cc70 con 0x7f2354005190 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23680ab840 con 0x7f2354005190 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23680ab6a0 con 0x7f2354005190 2023-11-04T01:44:59.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f235effd640 1 -- 172.21.15.2:0/1799356166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2364013470 con 0x7f2354005190 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f235effd640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f234c0664d0 0x7f234c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f235effd640 1 -- 172.21.15.2:0/1799356166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f2364083fe0 con 0x7f2354005190 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.258+0000 7f236d9c8640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f234c0664d0 0x7f234c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.262+0000 7f236d9c8640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f234c0664d0 0x7f234c068990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f23681f5910 tx=0x7f2358009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.262+0000 7f235effd640 1 -- 172.21.15.2:0/1799356166 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f23680ab6a0 con 0x7f2354005190 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f23680ab6a0 con 0x7f2354005190 2023-11-04T01:44:59.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f235effd640 1 -- 172.21.15.2:0/1799356166 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f23680ab6a0 con 0x7f2354005190 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlnFZCMBAAsgGcwY3jbh9F9NEVwbamwg==", 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDZRuAxAA6zx8mu5wQEvvcICXPTXZZQ==", 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlFSvMOBAA0k4I7A+4TRIrxBOwUdIZLw==", 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl/PDbCxAA+6y8He/9gQZa1vvdJH+iCg==", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBIoUVlnpFvJBAAAyqa0u7D+cz+Gy4XpppWYQ==", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.476 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBLoUVlObtjKhAAbf3wgZ9mpp8+pI1IGyIwdg==", 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBOoUVlOF4QMxAANdCz1HMyMGzyFpUv9xawYA==", 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-04T01:44:59.478 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBRoUVlMnFiOxAA2d7ZoQEhtXkAMhu0yPh4iw==", 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBYoUVlfe9FCBAA3oVMNubThpWJoxlqFzaAfg==", 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.479 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBboUVlTfGNEBAA2FNXiCKGJ2s4XeH+paqrNw==", 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-04T01:44:59.480 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBeoUVluX7oGBAAh+/toMBPGjq99EonfWEPtQ==", 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBhoUVlGhEAIhAAO8mqoIPekhVmAxnR1VKXeQ==", 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:44:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ==", 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:44:59.482 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDtmNGRAAFXXp/X0fnL9uuEIfj1Eadw==", 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlPzfyFhAAbCRYmyHHFu2GDtyZOL2ISw==", 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-04T01:44:59.484 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl1jK2HhAAH1E38zcrKticBLLRR/8IuA==", 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlCj8pFxAApTKY8a6VcYBWkCLKrKHorQ==", 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:44:59.485 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlcZ/jKhAAWDrmzYgapIV+SBRNrXWAjg==", 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.486 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlhYtpKBAAn1snUSz1+SKC8frnVuvFdA==", 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-04T01:44:59.487 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f234c0664d0 msgr2=0x7f234c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f234c0664d0 0x7f234c068990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f23681f5910 tx=0x7f2358009040 comp rx=0 tx=0).stop 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 msgr2=0x7f236815b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f236815b540 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f236400e820 tx=0x7f236400ece0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 shutdown_connections 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f234c0664d0 0x7f234c068990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f23680b3d90 0x7f23680b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23680b12e0 0x7f23680d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 --2- 172.21.15.2:0/1799356166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2354005190 0x7f236815b540 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 >> 172.21.15.2:0/1799356166 conn(0x7f23680cf990 msgr2=0x7f236815f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 shutdown_connections 2023-11-04T01:44:59.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.470+0000 7f237042d640 1 -- 172.21.15.2:0/1799356166 wait complete. 2023-11-04T01:44:59.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:44:59.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc690bc640 1 Processor -- start 2023-11-04T01:44:59.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc690bc640 1 -- start start 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc690bc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc640b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc690bc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcc640cb400 0x7fcc640cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc690bc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc640d0a60 con 0x7fcc640cd6d0 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc690bc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6415b390 con 0x7fcc640cb400 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc690bc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640d04a0 con 0x7fcc6415afb0 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc62d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc640b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc6259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcc640cb400 0x7fcc640cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc6259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcc640cb400 0x7fcc640cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:53290/0 (socket says 172.21.15.2:53290) 2023-11-04T01:44:59.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc6259c640 1 -- 172.21.15.2:0/2857206606 learned_addr learned my addr 172.21.15.2:0/2857206606 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc6259c640 1 -- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 msgr2=0x7fcc640b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc6259c640 1 --2- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc640b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc6259c640 1 -- 172.21.15.2:0/2857206606 >> v1:172.21.15.90:6789/0 conn(0x7fcc640cd6d0 legacy=0x7fcc640cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc6259c640 1 -- 172.21.15.2:0/2857206606 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc640d0780 con 0x7fcc640cb400 2023-11-04T01:44:59.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.614+0000 7fcc62d9d640 1 --2- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc640b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc6259c640 1 --2- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cb400 0x7fcc640cf190 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009e50 tx=0x7fcc4c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e4f7086698bbb1f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc61d9b640 1 -- 172.21.15.2:0/2857206606 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c0a5810 con 0x7fcc640cb400 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc61d9b640 1 -- 172.21.15.2:0/2857206606 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c0a5970 con 0x7fcc640cb400 2023-11-04T01:44:59.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc61d9b640 1 -- 172.21.15.2:0/2857206606 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c0a5d00 con 0x7fcc640cb400 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cb400 msgr2=0x7fcc640cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 --2- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cb400 0x7fcc640cf190 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009e50 tx=0x7fcc4c01c950 comp rx=0 tx=0).stop 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- 172.21.15.2:0/2857206606 shutdown_connections 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 --2- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cb400 0x7fcc640cf190 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 --2- 172.21.15.2:0/2857206606 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc640b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- 172.21.15.2:0/2857206606 >> 172.21.15.2:0/2857206606 conn(0x7fcc64065dc0 msgr2=0x7fcc640661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- 172.21.15.2:0/2857206606 shutdown_connections 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- 172.21.15.2:0/2857206606 wait complete. 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 Processor -- start 2023-11-04T01:44:59.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- start start 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640cb400 0x7fcc64164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cd6d0 0x7fcc64155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc6415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640b2170 con 0x7fcc640cb400 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc640b1e90 con 0x7fcc640cd6d0 2023-11-04T01:44:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.618+0000 7fcc690bc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc641637b0 con 0x7fcc6415afb0 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640cb400 0x7fcc64164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640cb400 0x7fcc64164290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40680/0 (socket says 172.21.15.2:40680) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 -- 172.21.15.2:0/1280154804 learned_addr learned my addr 172.21.15.2:0/1280154804 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc6259c640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cd6d0 0x7fcc64155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc6359e640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc6415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 -- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 msgr2=0x7fcc6415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc6415d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 -- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cd6d0 msgr2=0x7fcc64155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cd6d0 0x7fcc64155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 -- 172.21.15.2:0/1280154804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54009420 con 0x7fcc640cb400 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc62d9d640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640cb400 0x7fcc64164290 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400ebe0 tx=0x7fcc5400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc5b7fe640 1 -- 172.21.15.2:0/1280154804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400eee0 con 0x7fcc640cb400 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc5b7fe640 1 -- 172.21.15.2:0/1280154804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5400cc30 con 0x7fcc640cb400 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc5b7fe640 1 -- 172.21.15.2:0/1280154804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54013470 con 0x7fcc640cb400 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c009b30 con 0x7fcc640cb400 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc64163d70 con 0x7fcc640cb400 2023-11-04T01:44:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc64163610 con 0x7fcc640cb400 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc5b7fe640 1 -- 172.21.15.2:0/1280154804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc540135d0 con 0x7fcc640cb400 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc5b7fe640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc440664a0 0x7fcc44068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc5b7fe640 1 -- 172.21.15.2:0/1280154804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fcc54084310 con 0x7fcc640cb400 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.622+0000 7fcc6259c640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc440664a0 0x7fcc44068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.626+0000 7fcc6259c640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc440664a0 0x7fcc44068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0ae000 tx=0x7fcc4c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.626+0000 7fcc5b7fe640 1 -- 172.21.15.2:0/1280154804 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcc64163610 con 0x7fcc640cb400 2023-11-04T01:44:59.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.786+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc64163610 con 0x7fcc640cb400 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.786+0000 7fcc5b7fe640 1 -- 172.21.15.2:0/1280154804 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18002 (secure 0 0 0) 0x7fcc64163610 con 0x7fcc640cb400 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:44:59.790 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":76,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:44:59.080464+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc440664a0 msgr2=0x7fcc44068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc440664a0 0x7fcc44068960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0ae000 tx=0x7fcc4c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640cb400 msgr2=0x7fcc64164290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640cb400 0x7fcc64164290 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400ebe0 tx=0x7fcc5400c520 comp rx=0 tx=0).stop 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 shutdown_connections 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc440664a0 0x7fcc44068960 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcc6415afb0 0x7fcc6415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc640cd6d0 0x7fcc64155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 --2- 172.21.15.2:0/1280154804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcc640cb400 0x7fcc64164290 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 >> 172.21.15.2:0/1280154804 conn(0x7fcc64065dc0 msgr2=0x7fcc640b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 shutdown_connections 2023-11-04T01:44:59.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.790+0000 7fcc690bc640 1 -- 172.21.15.2:0/1280154804 wait complete. 2023-11-04T01:44:59.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:44:59.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.934+0000 7fe4938f8640 1 Processor -- start 2023-11-04T01:44:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe4938f8640 1 -- start start 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe4938f8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe48c15acb0 0x7fe48c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe4938f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c0b0c20 0x7fe48c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe4938f8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0cb130 con 0x7fe48c15c160 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe4938f8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c15bd40 con 0x7fe48c15acb0 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe4938f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c06fd80 con 0x7fe48c0b0c20 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491694640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe48c15acb0 0x7fe48c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491694640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe48c15acb0 0x7fe48c15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40688/0 (socket says 172.21.15.2:40688) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491694640 1 -- 172.21.15.2:0/3182460424 learned_addr learned my addr 172.21.15.2:0/3182460424 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491694640 1 -- 172.21.15.2:0/3182460424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c0b0c20 msgr2=0x7fe48c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491e95640 1 --2- 172.21.15.2:0/3182460424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c0b0c20 0x7fe48c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491694640 1 --2- 172.21.15.2:0/3182460424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c0b0c20 0x7fe48c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491694640 1 -- 172.21.15.2:0/3182460424 >> v1:172.21.15.90:6789/0 conn(0x7fe48c15c160 legacy=0x7fe48c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491694640 1 -- 172.21.15.2:0/3182460424 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c15b680 con 0x7fe48c15acb0 2023-11-04T01:44:59.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.938+0000 7fe491e95640 1 --2- 172.21.15.2:0/3182460424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c0b0c20 0x7fe48c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:59.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe491694640 1 --2- 172.21.15.2:0/3182460424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c15b090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe488009870 tx=0x7fe48801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878ab99b2b164e61 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe483fff640 1 -- 172.21.15.2:0/3182460424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4880a95f0 con 0x7fe48c15acb0 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe483fff640 1 -- 172.21.15.2:0/3182460424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4880a9750 con 0x7fe48c15acb0 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe483fff640 1 -- 172.21.15.2:0/3182460424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4880a9ae0 con 0x7fe48c15acb0 2023-11-04T01:44:59.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- 172.21.15.2:0/3182460424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 msgr2=0x7fe48c15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3182460424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c15b090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fe488009870 tx=0x7fe48801c510 comp rx=0 tx=0).stop 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- 172.21.15.2:0/3182460424 shutdown_connections 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3182460424 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c0b0c20 0x7fe48c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3182460424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c15b090 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- 172.21.15.2:0/3182460424 >> 172.21.15.2:0/3182460424 conn(0x7fe48c0cb510 msgr2=0x7fe48c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- 172.21.15.2:0/3182460424 shutdown_connections 2023-11-04T01:44:59.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- 172.21.15.2:0/3182460424 wait complete. 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 Processor -- start 2023-11-04T01:44:59.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- start start 2023-11-04T01:44:59.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe48c0b0c20 0x7fe48c151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c15c160 0x7fe48c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c15a670 con 0x7fe48c15acb0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c152870 con 0x7fe48c0b0c20 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe4938f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c152b50 con 0x7fe48c15c160 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40700/0 (socket says 172.21.15.2:40700) 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 -- 172.21.15.2:0/3731904628 learned_addr learned my addr 172.21.15.2:0/3731904628 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe491694640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe48c0b0c20 0x7fe48c151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe491e95640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c15c160 0x7fe48c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 -- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c15c160 msgr2=0x7fe48c0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c15c160 0x7fe48c0ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 -- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe48c0b0c20 msgr2=0x7fe48c151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe48c0b0c20 0x7fe48c151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe490e93640 1 -- 172.21.15.2:0/3731904628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880094d0 con 0x7fe48c15acb0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.942+0000 7fe491694640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe48c0b0c20 0x7fe48c151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe490e93640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c0ac8c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c3c0 tx=0x7fe47c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe481ffb640 1 -- 172.21.15.2:0/3731904628 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0052d0 con 0x7fe48c15acb0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe481ffb640 1 -- 172.21.15.2:0/3731904628 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c005430 con 0x7fe48c15acb0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c152e30 con 0x7fe48c15acb0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe481ffb640 1 -- 172.21.15.2:0/3731904628 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c003840 con 0x7fe48c15acb0 2023-11-04T01:44:59.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c152340 con 0x7fe48c15acb0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c0744a0 con 0x7fe48c15acb0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe481ffb640 1 -- 172.21.15.2:0/3731904628 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe47c0039a0 con 0x7fe48c15acb0 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe481ffb640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4700664a0 0x7fe470068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:44:59.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe481ffb640 1 -- 172.21.15.2:0/3731904628 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fe47c083490 con 0x7fe48c15acb0 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe491694640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4700664a0 0x7fe470068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:44:59.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.946+0000 7fe491694640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4700664a0 0x7fe470068960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe4880ae000 tx=0x7fe4880b3040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:44:59.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:44:59.950+0000 7fe481ffb640 1 -- 172.21.15.2:0/3731904628 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe47c050840 con 0x7fe48c15acb0 2023-11-04T01:45:00.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe48c1532e0 con 0x7fe48c15acb0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe481ffb640 1 -- 172.21.15.2:0/3731904628 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe47c053e60 con 0x7fe48c15acb0 2023-11-04T01:45:00.113 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4700664a0 msgr2=0x7fe470068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4700664a0 0x7fe470068960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe4880ae000 tx=0x7fe4880b3040 comp rx=0 tx=0).stop 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 msgr2=0x7fe48c0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c0ac8c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c3c0 tx=0x7fe47c00c880 comp rx=0 tx=0).stop 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 shutdown_connections 2023-11-04T01:45:00.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe4700664a0 0x7fe470068960 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe48c15c160 0x7fe48c0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe48c15acb0 0x7fe48c0ac8c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 --2- 172.21.15.2:0/3731904628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe48c0b0c20 0x7fe48c151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.110+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 >> 172.21.15.2:0/3731904628 conn(0x7fe48c0cb510 msgr2=0x7fe48c156520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.114+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 shutdown_connections 2023-11-04T01:45:00.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.114+0000 7fe4938f8640 1 -- 172.21.15.2:0/3731904628 wait complete. 2023-11-04T01:45:00.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f7b0a640 1 Processor -- start 2023-11-04T01:45:00.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f7b0a640 1 -- start start 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f7b0a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f00c9a00 0x7ff5f00adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f7b0a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff5f00cc990 0x7ff5f00ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f7b0a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f00cd020 con 0x7ff5f00adb50 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f7b0a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f00cce20 con 0x7ff5f00cc990 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f7b0a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f00cd300 con 0x7ff5f00c9a00 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff5f00adb50 0x7ff5f00c92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55446/0 (socket says 172.21.15.2:55446) 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3011444105 learned_addr learned my addr 172.21.15.2:0/3011444105 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f60a7640 1 --2- 172.21.15.2:0/3011444105 >> v2:172.21.15.90:3300/0 conn(0x7ff5f00cc990 0x7ff5f00ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f50a5640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f00c9a00 0x7ff5f00adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506972824 0 0) 0x7ff5f00cd020 con 0x7ff5f00adb50 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5dc003530 con 0x7ff5f00adb50 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3573692009 0 0) 0x7ff5dc003530 con 0x7ff5f00adb50 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f00c9a00 msgr2=0x7ff5f00adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f00c9a00 0x7ff5f00adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 >> v2:172.21.15.90:3300/0 conn(0x7ff5f00cc990 msgr2=0x7ff5f00ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 --2- 172.21.15.2:0/3011444105 >> v2:172.21.15.90:3300/0 conn(0x7ff5f00cc990 0x7ff5f00ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f00cd5e0 con 0x7ff5f00adb50 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff5ec001680 con 0x7ff5f00adb50 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 >> v1:172.21.15.2:6789/0 conn(0x7ff5f00adb50 legacy=0x7ff5f00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5dc0047d0 0x7ff5dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f00c9a00 0x7ff5dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f00cce20 con 0x7ff5dc003980 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f00cd300 con 0x7ff5dc0047d0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc00b990 con 0x7ff5f00c9a00 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f60a7640 1 --2- 172.21.15.2:0/3011444105 >> v2:172.21.15.90:3300/0 conn(0x7ff5f00cc990 0x7ff5f00ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f50a5640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5dc0047d0 0x7ff5dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f00c9a00 msgr2=0x7ff5dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f00c9a00 0x7ff5dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5dc0047d0 msgr2=0x7ff5dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5dc0047d0 0x7ff5dc004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.246+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3011444105 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc003530 con 0x7ff5dc003980 2023-11-04T01:45:00.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f58a6640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5dc003da0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c110 tx=0x7ff5ec01cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e192119073397d23 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0058e0 con 0x7ff5dc003980 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec005a60 con 0x7ff5dc003980 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f48a4640 1 -- 172.21.15.2:0/3011444105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec005e10 con 0x7ff5dc003980 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3011444105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 msgr2=0x7ff5dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 --2- 172.21.15.2:0/3011444105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5dc003da0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00c110 tx=0x7ff5ec01cb70 comp rx=0 tx=0).stop 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f60a7640 1 -- 172.21.15.2:0/3011444105 reap_dead start 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3011444105 shutdown_connections 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3011444105 >> 172.21.15.2:0/3011444105 conn(0x7ff5f00cb510 msgr2=0x7ff5f00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3011444105 shutdown_connections 2023-11-04T01:45:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3011444105 wait complete. 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 Processor -- start 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.250+0000 7ff5f7b0a640 1 -- start start 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5f015f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f014dc60 0x7ff5f0159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5f015a1c0 0x7ff5f00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f014d7d0 con 0x7ff5dc003980 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f014abe0 con 0x7ff5f015a1c0 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f014ceb0 con 0x7ff5f014dc60 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5f015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5f015f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40708/0 (socket says 172.21.15.2:40708) 2023-11-04T01:45:00.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3692915595 learned_addr learned my addr 172.21.15.2:0/3692915595 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f50a5640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f014dc60 0x7ff5f0159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f60a7640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5f015a1c0 0x7ff5f00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f014dc60 msgr2=0x7ff5f0159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f014dc60 0x7ff5f0159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5f015a1c0 msgr2=0x7ff5f00ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5f015a1c0 0x7ff5f00ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 -- 172.21.15.2:0/3692915595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f015a740 con 0x7ff5dc003980 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f60a7640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5f015a1c0 0x7ff5f00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f58a6640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5f015f880 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec007040 tx=0x7ff5dc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5e67fc640 1 -- 172.21.15.2:0/3692915595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0047f0 con 0x7ff5dc003980 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5e67fc640 1 -- 172.21.15.2:0/3692915595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec004970 con 0x7ff5dc003980 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f014d180 con 0x7ff5dc003980 2023-11-04T01:45:00.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5e67fc640 1 -- 172.21.15.2:0/3692915595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec004d20 con 0x7ff5dc003980 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f0158cd0 con 0x7ff5dc003980 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f00744a0 con 0x7ff5dc003980 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5e67fc640 1 -- 172.21.15.2:0/3692915595 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5ec007070 con 0x7ff5dc003980 2023-11-04T01:45:00.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5e67fc640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5d40664d0 0x7ff5d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5e67fc640 1 -- 172.21.15.2:0/3692915595 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7ff5ec11d9b0 con 0x7ff5dc003980 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.254+0000 7ff5f50a5640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5d40664d0 0x7ff5d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.258+0000 7ff5f50a5640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5d40664d0 0x7ff5d4068990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00ad480 tx=0x7ff5e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.258+0000 7ff5e67fc640 1 -- 172.21.15.2:0/3692915595 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5ec0eace0 con 0x7ff5dc003980 2023-11-04T01:45:00.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.414+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7ff5f00b1420 con 0x7ff5dc003980 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.414+0000 7ff5e67fc640 1 -- 172.21.15.2:0/3692915595 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v76) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff5ec0ee300 con 0x7ff5dc003980 2023-11-04T01:45:00.418 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5d40664d0 msgr2=0x7ff5d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5d40664d0 0x7ff5d4068990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00ad480 tx=0x7ff5e0008040 comp rx=0 tx=0).stop 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 msgr2=0x7ff5f015f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5f015f880 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec007040 tx=0x7ff5dc005800 comp rx=0 tx=0).stop 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 shutdown_connections 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5d40664d0 0x7ff5d4068990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5f015a1c0 0x7ff5f00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5f014dc60 0x7ff5f0159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 --2- 172.21.15.2:0/3692915595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5dc003980 0x7ff5f015f880 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 >> 172.21.15.2:0/3692915595 conn(0x7ff5f00cb510 msgr2=0x7ff5f00aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:00.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 shutdown_connections 2023-11-04T01:45:00.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.418+0000 7ff5f7b0a640 1 -- 172.21.15.2:0/3692915595 wait complete. 2023-11-04T01:45:00.437 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.562+0000 7ff1d5e0a640 1 Processor -- start 2023-11-04T01:45:00.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.562+0000 7ff1d5e0a640 1 -- start start 2023-11-04T01:45:00.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1d5e0a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff1d00b0c20 0x7ff1d015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1d5e0a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d00cb130 con 0x7ff1d015c160 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1d5e0a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d015b680 con 0x7ff1d015acb0 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1d5e0a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1d015bd40 con 0x7ff1d00b0c20 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff1d015c160 0x7ff1d00ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55452/0 (socket says 172.21.15.2:55452) 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cffff640 1 -- 172.21.15.2:0/3160043602 learned_addr learned my addr 172.21.15.2:0/3160043602 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ceffd640 1 --2- 172.21.15.2:0/3160043602 >> v2:172.21.15.90:3300/0 conn(0x7ff1d00b0c20 0x7ff1d015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220150690 0 0) 0x7ff1d00cb130 con 0x7ff1d015c160 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b8003530 con 0x7ff1d015c160 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821226463 0 0) 0x7ff1b8003530 con 0x7ff1d015c160 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 >> v2:172.21.15.90:3300/0 conn(0x7ff1d00b0c20 msgr2=0x7ff1d015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 --2- 172.21.15.2:0/3160043602 >> v2:172.21.15.90:3300/0 conn(0x7ff1d00b0c20 0x7ff1d015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 >> v1:172.21.15.90:6789/0 conn(0x7ff1d015acb0 legacy=0x7ff1d00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d015b960 con 0x7ff1d015c160 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff1c8001a00 con 0x7ff1d015c160 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 >> v1:172.21.15.2:6789/0 conn(0x7ff1d015c160 legacy=0x7ff1d00ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1b8003980 0x7ff1b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b80047d0 0x7ff1b8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1b8005190 0x7ff1b800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d015bd40 con 0x7ff1b8003980 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b800c030 con 0x7ff1b8005190 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b800c1f0 con 0x7ff1b80047d0 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1b8003980 0x7ff1b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1ceffd640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b80047d0 0x7ff1b8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cffff640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1b8005190 0x7ff1b800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cf7fe640 1 -- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b80047d0 msgr2=0x7ff1b8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b80047d0 0x7ff1b8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cf7fe640 1 -- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1b8005190 msgr2=0x7ff1b800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1b8005190 0x7ff1b800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cffff640 1 -- 172.21.15.2:0/3160043602 reap_dead start 2023-11-04T01:45:00.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.566+0000 7ff1cf7fe640 1 -- 172.21.15.2:0/3160043602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b8003530 con 0x7ff1b8003980 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1b8003980 0x7ff1b8003da0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001780 tx=0x7ff1c401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5dfeacb67e9532 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40a4ea0 con 0x7ff1b8003980 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c40a7050 con 0x7ff1b8003980 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1ce7fc640 1 -- 172.21.15.2:0/3160043602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4003600 con 0x7ff1b8003980 2023-11-04T01:45:00.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3160043602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1b8003980 msgr2=0x7ff1b8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1b8003980 0x7ff1b8003da0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001780 tx=0x7ff1c401c3e0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3160043602 shutdown_connections 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3160043602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1b8003980 0x7ff1b8003da0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3160043602 >> 172.21.15.2:0/3160043602 conn(0x7ff1d00cb510 msgr2=0x7ff1d00cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3160043602 shutdown_connections 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3160043602 wait complete. 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 Processor -- start 2023-11-04T01:45:00.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.570+0000 7ff1d5e0a640 1 -- start start 2023-11-04T01:45:00.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b8003980 0x7ff1d00b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d0151ee0 0x7ff1d00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d00b1e20 0x7ff1d00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d0151690 con 0x7ff1d0151ee0 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00b34f0 con 0x7ff1d00b1e20 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d01523e0 con 0x7ff1b8003980 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d0151ee0 0x7ff1d00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d0151ee0 0x7ff1d00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40736/0 (socket says 172.21.15.2:40736) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 -- 172.21.15.2:0/3806946018 learned_addr learned my addr 172.21.15.2:0/3806946018 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1cffff640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d00b1e20 0x7ff1d00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b8003980 0x7ff1d00b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 -- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b8003980 msgr2=0x7ff1d00b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b8003980 0x7ff1d00b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 -- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d00b1e20 msgr2=0x7ff1d00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d00b1e20 0x7ff1d00b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 -- 172.21.15.2:0/3806946018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d015c6d0 con 0x7ff1d0151ee0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b8003980 0x7ff1d00b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1cffff640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d00b1e20 0x7ff1d00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1ceffd640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d0151ee0 0x7ff1d00b18e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0011660 tx=0x7ff1c0011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1b7fff640 1 -- 172.21.15.2:0/3806946018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000f9c0 con 0x7ff1d0151ee0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1b7fff640 1 -- 172.21.15.2:0/3806946018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000fb20 con 0x7ff1d0151ee0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d015c9b0 con 0x7ff1d0151ee0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1b7fff640 1 -- 172.21.15.2:0/3806946018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000fe90 con 0x7ff1d0151ee0 2023-11-04T01:45:00.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d01526c0 con 0x7ff1d0151ee0 2023-11-04T01:45:00.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d00744a0 con 0x7ff1d0151ee0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1b7fff640 1 -- 172.21.15.2:0/3806946018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff1c0015460 con 0x7ff1d0151ee0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1b7fff640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1bc0664a0 0x7ff1bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1b7fff640 1 -- 172.21.15.2:0/3806946018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7ff1c0084770 con 0x7ff1d0151ee0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.574+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1bc0664a0 0x7ff1bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.578+0000 7ff1cf7fe640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1bc0664a0 0x7ff1bc068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001750 tx=0x7ff1c40011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.582+0000 7ff1b7fff640 1 -- 172.21.15.2:0/3806946018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff1c0051bd0 con 0x7ff1d0151ee0 2023-11-04T01:45:00.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7ff1d00cde30 con 0x7ff1d0151ee0 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1b7fff640 1 -- 172.21.15.2:0/3806946018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v76) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff1c00551f0 con 0x7ff1d0151ee0 2023-11-04T01:45:00.733 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1bc0664a0 msgr2=0x7ff1bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1bc0664a0 0x7ff1bc068960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001750 tx=0x7ff1c40011a0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d0151ee0 msgr2=0x7ff1d00b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d0151ee0 0x7ff1d00b18e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0011660 tx=0x7ff1c0011b20 comp rx=0 tx=0).stop 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 shutdown_connections 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1bc0664a0 0x7ff1bc068960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff1d00b1e20 0x7ff1d00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1d0151ee0 0x7ff1d00b18e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 --2- 172.21.15.2:0/3806946018 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff1b8003980 0x7ff1d00b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 >> 172.21.15.2:0/3806946018 conn(0x7ff1d00cb510 msgr2=0x7ff1d00c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 shutdown_connections 2023-11-04T01:45:00.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.730+0000 7ff1d5e0a640 1 -- 172.21.15.2:0/3806946018 wait complete. 2023-11-04T01:45:00.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe0a403640 1 Processor -- start 2023-11-04T01:45:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe0a403640 1 -- start start 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe0a403640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe0415af50 0x7fbe040cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe0a403640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe040b32f0 0x7fbe040ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe0a403640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe040cd830 con 0x7fbe040cf4c0 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe0a403640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe040b3780 con 0x7fbe040b32f0 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe0a403640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe040cdad0 con 0x7fbe0415af50 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe037fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe040b32f0 0x7fbe040ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe037fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe040b32f0 0x7fbe040ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40752/0 (socket says 172.21.15.2:40752) 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe037fe640 1 -- 172.21.15.2:0/1649392649 learned_addr learned my addr 172.21.15.2:0/1649392649 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe03fff640 1 --2- 172.21.15.2:0/1649392649 >> v2:172.21.15.90:3300/0 conn(0x7fbe0415af50 0x7fbe040cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe037fe640 1 -- 172.21.15.2:0/1649392649 >> v2:172.21.15.90:3300/0 conn(0x7fbe0415af50 msgr2=0x7fbe040cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe037fe640 1 --2- 172.21.15.2:0/1649392649 >> v2:172.21.15.90:3300/0 conn(0x7fbe0415af50 0x7fbe040cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe037fe640 1 -- 172.21.15.2:0/1649392649 >> v1:172.21.15.90:6789/0 conn(0x7fbe040cf4c0 legacy=0x7fbe0415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe037fe640 1 -- 172.21.15.2:0/1649392649 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe040cddb0 con 0x7fbe040b32f0 2023-11-04T01:45:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.866+0000 7fbe03fff640 1 --2- 172.21.15.2:0/1649392649 >> v2:172.21.15.90:3300/0 conn(0x7fbe0415af50 0x7fbe040cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe037fe640 1 --2- 172.21.15.2:0/1649392649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040b32f0 0x7fbe040ce8b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbe040681a0 tx=0x7fbdf401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d86f73a79bac4a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe02ffd640 1 -- 172.21.15.2:0/1649392649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40a57e0 con 0x7fbe040b32f0 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe02ffd640 1 -- 172.21.15.2:0/1649392649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf40a5940 con 0x7fbe040b32f0 2023-11-04T01:45:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe02ffd640 1 -- 172.21.15.2:0/1649392649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40a5cd0 con 0x7fbe040b32f0 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- 172.21.15.2:0/1649392649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040b32f0 msgr2=0x7fbe040ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1649392649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040b32f0 0x7fbe040ce8b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbe040681a0 tx=0x7fbdf401c900 comp rx=0 tx=0).stop 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- 172.21.15.2:0/1649392649 shutdown_connections 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1649392649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040b32f0 0x7fbe040ce8b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1649392649 >> v2:172.21.15.90:3300/0 conn(0x7fbe0415af50 0x7fbe040cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- 172.21.15.2:0/1649392649 >> 172.21.15.2:0/1649392649 conn(0x7fbe04065dc0 msgr2=0x7fbe040661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- 172.21.15.2:0/1649392649 shutdown_connections 2023-11-04T01:45:00.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- 172.21.15.2:0/1649392649 wait complete. 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 Processor -- start 2023-11-04T01:45:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- start start 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040cf4c0 0x7fbe04159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe0415af50 0x7fbe04161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04161dd0 0x7fbe040ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040ca230 con 0x7fbe040cf4c0 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040c95b0 con 0x7fbe0415af50 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe0a403640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040c9890 con 0x7fbe04161dd0 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040cf4c0 0x7fbe04159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe03fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040cf4c0 0x7fbe04159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40768/0 (socket says 172.21.15.2:40768) 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe03fff640 1 -- 172.21.15.2:0/1421861399 learned_addr learned my addr 172.21.15.2:0/1421861399 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe037fe640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe0415af50 0x7fbe04161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.870+0000 7fbe089a0640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04161dd0 0x7fbe040ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe03fff640 1 -- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04161dd0 msgr2=0x7fbe040ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe03fff640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04161dd0 0x7fbe040ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe03fff640 1 -- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe0415af50 msgr2=0x7fbe04161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe03fff640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe0415af50 0x7fbe04161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe03fff640 1 -- 172.21.15.2:0/1421861399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4009b30 con 0x7fbe040cf4c0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe089a0640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04161dd0 0x7fbe040ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe03fff640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040cf4c0 0x7fbe04159c80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c7f0 tx=0x7fbdf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe00ff9640 1 -- 172.21.15.2:0/1421861399 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8005ba0 con 0x7fbe040cf4c0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe00ff9640 1 -- 172.21.15.2:0/1421861399 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8005d00 con 0x7fbe040cf4c0 2023-11-04T01:45:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe040c9b70 con 0x7fbe040cf4c0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe00ff9640 1 -- 172.21.15.2:0/1421861399 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8006250 con 0x7fbe040cf4c0 2023-11-04T01:45:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0415a1c0 con 0x7fbe040cf4c0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0415a410 con 0x7fbe040cf4c0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe00ff9640 1 -- 172.21.15.2:0/1421861399 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbdf80065c0 con 0x7fbe040cf4c0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe00ff9640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbdf00664a0 0x7fbdf0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe00ff9640 1 -- 172.21.15.2:0/1421861399 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fbdf8084000 con 0x7fbe040cf4c0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe037fe640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbdf00664a0 0x7fbdf0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:00.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.874+0000 7fbe037fe640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbdf00664a0 0x7fbdf0068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40ae000 tx=0x7fbdf40a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:00.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:00.878+0000 7fbe00ff9640 1 -- 172.21.15.2:0/1421861399 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe0415a410 con 0x7fbe040cf4c0 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.030+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7fbe040ca370 con 0x7fbe040cf4c0 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe00ff9640 1 -- 172.21.15.2:0/1421861399 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v76) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbdf801e020 con 0x7fbe040cf4c0 2023-11-04T01:45:01.035 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbdf00664a0 msgr2=0x7fbdf0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbdf00664a0 0x7fbdf0068960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40ae000 tx=0x7fbdf40a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040cf4c0 msgr2=0x7fbe04159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040cf4c0 0x7fbe04159c80 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c7f0 tx=0x7fbdf800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 shutdown_connections 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbdf00664a0 0x7fbdf0068960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe04161dd0 0x7fbe040ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe0415af50 0x7fbe04161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 --2- 172.21.15.2:0/1421861399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe040cf4c0 0x7fbe04159c80 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 >> 172.21.15.2:0/1421861399 conn(0x7fbe04065dc0 msgr2=0x7fbe04073150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 shutdown_connections 2023-11-04T01:45:01.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.034+0000 7fbe0a403640 1 -- 172.21.15.2:0/1421861399 wait complete. 2023-11-04T01:45:01.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.174+0000 7fea92350640 1 Processor -- start 2023-11-04T01:45:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.174+0000 7fea92350640 1 -- start start 2023-11-04T01:45:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea92350640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea8c15a1f0 0x7fea8c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea92350640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fea8c0cdea0 0x7fea8c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea92350640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c0ccee0 con 0x7fea8c0ca400 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea92350640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8c15a5d0 con 0x7fea8c15a1f0 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea92350640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8c0ca900 con 0x7fea8c0cdea0 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea8c15a1f0 0x7fea8c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea908ed640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fea8c0ca400 0x7fea8c0704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55464/0 (socket says 172.21.15.2:55464) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea908ed640 1 -- 172.21.15.2:0/2461476862 learned_addr learned my addr 172.21.15.2:0/2461476862 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea8c15a1f0 0x7fea8c0cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40784/0 (socket says 172.21.15.2:40784) 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8b7fe640 1 --2- 172.21.15.2:0/2461476862 >> v2:172.21.15.90:3300/0 conn(0x7fea8c0cdea0 0x7fea8c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8bfff640 1 -- 172.21.15.2:0/2461476862 >> v2:172.21.15.90:3300/0 conn(0x7fea8c0cdea0 msgr2=0x7fea8c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8bfff640 1 --2- 172.21.15.2:0/2461476862 >> v2:172.21.15.90:3300/0 conn(0x7fea8c0cdea0 0x7fea8c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8affd640 1 -- 172.21.15.2:0/2461476862 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889167347 0 0) 0x7fea8c0ccee0 con 0x7fea8c0ca400 2023-11-04T01:45:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8bfff640 1 -- 172.21.15.2:0/2461476862 >> v1:172.21.15.2:6789/0 conn(0x7fea8c0ca400 legacy=0x7fea8c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8bfff640 1 -- 172.21.15.2:0/2461476862 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c0cabe0 con 0x7fea8c15a1f0 2023-11-04T01:45:01.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8b7fe640 1 --2- 172.21.15.2:0/2461476862 >> v2:172.21.15.90:3300/0 conn(0x7fea8c0cdea0 0x7fea8c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.178+0000 7fea8bfff640 1 --2- 172.21.15.2:0/2461476862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0cd370 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fea8c15dc30 tx=0x7fea7c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dc65f0a1e1e1f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea8affd640 1 -- 172.21.15.2:0/2461476862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0a7070 con 0x7fea8c15a1f0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea8affd640 1 -- 172.21.15.2:0/2461476862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c0ab430 con 0x7fea8c15a1f0 2023-11-04T01:45:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea8affd640 1 -- 172.21.15.2:0/2461476862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7c0ab7c0 con 0x7fea8c15a1f0 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- 172.21.15.2:0/2461476862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 msgr2=0x7fea8c0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 --2- 172.21.15.2:0/2461476862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0cd370 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fea8c15dc30 tx=0x7fea7c01c430 comp rx=0 tx=0).stop 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- 172.21.15.2:0/2461476862 shutdown_connections 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 --2- 172.21.15.2:0/2461476862 >> v2:172.21.15.90:3300/0 conn(0x7fea8c0cdea0 0x7fea8c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 --2- 172.21.15.2:0/2461476862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0cd370 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- 172.21.15.2:0/2461476862 >> 172.21.15.2:0/2461476862 conn(0x7fea8c0cebb0 msgr2=0x7fea8c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- 172.21.15.2:0/2461476862 shutdown_connections 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- 172.21.15.2:0/2461476862 wait complete. 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 Processor -- start 2023-11-04T01:45:01.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- start start 2023-11-04T01:45:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8c0ca400 0x7fea8c0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8c0cdea0 0x7fea8c0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c0c7780 con 0x7fea8c15a1f0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c0c8150 con 0x7fea8c0cdea0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c0c6b70 con 0x7fea8c0ca400 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40792/0 (socket says 172.21.15.2:40792) 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 -- 172.21.15.2:0/1881021077 learned_addr learned my addr 172.21.15.2:0/1881021077 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 -- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8c0ca400 msgr2=0x7fea8c0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea8bfff640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8c0ca400 0x7fea8c0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea8b7fe640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8c0cdea0 0x7fea8c0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8c0ca400 0x7fea8c0c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 -- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8c0cdea0 msgr2=0x7fea8c0c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8c0cdea0 0x7fea8c0c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 -- 172.21.15.2:0/1881021077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c009420 con 0x7fea8c15a1f0 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea908ed640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0c6270 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fea84001570 tx=0x7fea8400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea88ff9640 1 -- 172.21.15.2:0/1881021077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8400a640 con 0x7fea8c15a1f0 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea88ff9640 1 -- 172.21.15.2:0/1881021077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8400a7c0 con 0x7fea8c15a1f0 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c0c6e50 con 0x7fea8c15a1f0 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea88ff9640 1 -- 172.21.15.2:0/1881021077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8400ab70 con 0x7fea8c15a1f0 2023-11-04T01:45:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.182+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c0c7410 con 0x7fea8c15a1f0 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.186+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8c0c78f0 con 0x7fea8c15a1f0 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.186+0000 7fea88ff9640 1 -- 172.21.15.2:0/1881021077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea8400acd0 con 0x7fea8c15a1f0 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.186+0000 7fea88ff9640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea780664a0 0x7fea78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.186+0000 7fea88ff9640 1 -- 172.21.15.2:0/1881021077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fea84083540 con 0x7fea8c15a1f0 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.186+0000 7fea8bfff640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea780664a0 0x7fea78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.186+0000 7fea8bfff640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea780664a0 0x7fea78068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0af000 tx=0x7fea7c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.190+0000 7fea88ff9640 1 -- 172.21.15.2:0/1881021077 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea840508f0 con 0x7fea8c15a1f0 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.338+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea8c0cd880 con 0x7fea8c15a1f0 2023-11-04T01:45:01.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.338+0000 7fea88ff9640 1 -- 172.21.15.2:0/1881021077 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+287 (secure 0 0 0) 0x7fea84018090 con 0x7fea8c15a1f0 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 6, 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "snap-test-pool" 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 11, 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "test_data_pool" 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 12, 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:01.344 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea780664a0 msgr2=0x7fea78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea780664a0 0x7fea78068960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0af000 tx=0x7fea7c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 msgr2=0x7fea8c0c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0c6270 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fea84001570 tx=0x7fea8400cca0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 shutdown_connections 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fea780664a0 0x7fea78068960 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea8c15a1f0 0x7fea8c0c6270 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea8c0cdea0 0x7fea8c0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 --2- 172.21.15.2:0/1881021077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea8c0ca400 0x7fea8c0c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 >> 172.21.15.2:0/1881021077 conn(0x7fea8c0cebb0 msgr2=0x7fea8c0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 shutdown_connections 2023-11-04T01:45:01.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.342+0000 7fea92350640 1 -- 172.21.15.2:0/1881021077 wait complete. 2023-11-04T01:45:01.360 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:45:01.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a58f08640 1 Processor -- start 2023-11-04T01:45:01.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a58f08640 1 -- start start 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a58f08640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a54071470 0x7f1a540b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a58f08640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a5406a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a58f08640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a54144b50 con 0x7f1a54144770 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a58f08640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5406ab30 con 0x7f1a54071470 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a58f08640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540b5060 con 0x7f1a5406a160 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a51d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a54071470 0x7f1a540b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a51d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a54071470 0x7f1a540b54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37528/0 (socket says 172.21.15.2:37528) 2023-11-04T01:45:01.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a51d9b640 1 -- 172.21.15.2:0/2582283513 learned_addr learned my addr 172.21.15.2:0/2582283513 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a52d9d640 1 --2- 172.21.15.2:0/2582283513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a5406a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a51d9b640 1 -- 172.21.15.2:0/2582283513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 msgr2=0x7f1a5406a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a51d9b640 1 --2- 172.21.15.2:0/2582283513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a5406a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a51d9b640 1 -- 172.21.15.2:0/2582283513 >> v1:172.21.15.90:6789/0 conn(0x7f1a54144770 legacy=0x7f1a540b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.486+0000 7f1a51d9b640 1 -- 172.21.15.2:0/2582283513 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5406afb0 con 0x7f1a54071470 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a51d9b640 1 --2- 172.21.15.2:0/2582283513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a540b54f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb84521d6d9c8e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a5159a640 1 -- 172.21.15.2:0/2582283513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0aa670 con 0x7f1a54071470 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a5159a640 1 -- 172.21.15.2:0/2582283513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0aa7d0 con 0x7f1a54071470 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a5159a640 1 -- 172.21.15.2:0/2582283513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0aab60 con 0x7f1a54071470 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 -- 172.21.15.2:0/2582283513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 msgr2=0x7f1a540b54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 --2- 172.21.15.2:0/2582283513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a540b54f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c01c510 comp rx=0 tx=0).stop 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 -- 172.21.15.2:0/2582283513 shutdown_connections 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 --2- 172.21.15.2:0/2582283513 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a5406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 --2- 172.21.15.2:0/2582283513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a540b54f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 -- 172.21.15.2:0/2582283513 >> 172.21.15.2:0/2582283513 conn(0x7f1a5406b270 msgr2=0x7f1a5406b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 -- 172.21.15.2:0/2582283513 shutdown_connections 2023-11-04T01:45:01.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 -- 172.21.15.2:0/2582283513 wait complete. 2023-11-04T01:45:01.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 Processor -- start 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.490+0000 7f1a58f08640 1 -- start start 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a541432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a5415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a54144770 0x7f1a5415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5415a6c0 con 0x7f1a54071470 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54142260 con 0x7f1a54144770 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54142500 con 0x7f1a5406a160 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a5415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a5415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37544/0 (socket says 172.21.15.2:37544) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 -- 172.21.15.2:0/1229372783 learned_addr learned my addr 172.21.15.2:0/1229372783 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a5259c640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a541432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a52d9d640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a54144770 0x7f1a5415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 -- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 msgr2=0x7f1a541432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a541432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 -- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a54144770 msgr2=0x7f1a5415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a54144770 0x7f1a5415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 -- 172.21.15.2:0/1229372783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0094d0 con 0x7f1a54071470 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a52d9d640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a54144770 0x7f1a5415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a51d9b640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a5415a180 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c01a140 tx=0x7f1a3c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a4affd640 1 -- 172.21.15.2:0/1229372783 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0b3800 con 0x7f1a54071470 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a4affd640 1 -- 172.21.15.2:0/1229372783 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0b3960 con 0x7f1a54071470 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a541427e0 con 0x7f1a54071470 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a4affd640 1 -- 172.21.15.2:0/1229372783 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0b3d10 con 0x7f1a54071470 2023-11-04T01:45:01.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a54142da0 con 0x7f1a54071470 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a54142f90 con 0x7f1a54071470 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a4affd640 1 -- 172.21.15.2:0/1229372783 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a3c0b2380 con 0x7f1a54071470 2023-11-04T01:45:01.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a4affd640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a4affd640 1 -- 172.21.15.2:0/1229372783 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f1a3c11e710 con 0x7f1a54071470 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.494+0000 7f1a5259c640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:01.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.498+0000 7f1a5259c640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0012f0 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:01.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.498+0000 7f1a4affd640 1 -- 172.21.15.2:0/1229372783 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a3c0ebb70 con 0x7f1a54071470 2023-11-04T01:45:01.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:01.658+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1a540675f0 con 0x7f1a54071470 2023-11-04T01:45:02.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.078+0000 7f1a4affd640 1 -- 172.21.15.2:0/1229372783 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1a3c0ef190 con 0x7f1a54071470 2023-11-04T01:45:02.080 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 msgr2=0x7f1a34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0012f0 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 msgr2=0x7f1a5415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a5415a180 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c01a140 tx=0x7f1a3c01ad50 comp rx=0 tx=0).stop 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 shutdown_connections 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a54144770 0x7f1a5415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a54071470 0x7f1a5415a180 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 --2- 172.21.15.2:0/1229372783 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a5406a160 0x7f1a541432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 >> 172.21.15.2:0/1229372783 conn(0x7f1a5406b270 msgr2=0x7f1a5415c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:02.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 shutdown_connections 2023-11-04T01:45:02.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.082+0000 7f1a58f08640 1 -- 172.21.15.2:0/1229372783 wait complete. 2023-11-04T01:45:02.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:45:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7ee19a8640 1 Processor -- start 2023-11-04T01:45:02.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7ee19a8640 1 -- start start 2023-11-04T01:45:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7ee19a8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7edc06a160 0x7f7edc0af810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7ee19a8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7edc0c2c40 0x7f7edc0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7ee19a8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc06b8b0 con 0x7f7edc1618b0 2023-11-04T01:45:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7ee19a8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0aec20 con 0x7f7edc0c2c40 2023-11-04T01:45:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7ee19a8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc06bb50 con 0x7f7edc06a160 2023-11-04T01:45:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7edc0c2c40 0x7f7edc0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7edc0c2c40 0x7f7edc0afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37550/0 (socket says 172.21.15.2:37550) 2023-11-04T01:45:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edb7fe640 1 -- 172.21.15.2:0/771669003 learned_addr learned my addr 172.21.15.2:0/771669003 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edaffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7edc1618b0 0x7f7edc0c2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40510/0 (socket says 172.21.15.2:40510) 2023-11-04T01:45:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7eda7fc640 1 --2- 172.21.15.2:0/771669003 >> v2:172.21.15.90:3300/0 conn(0x7f7edc06a160 0x7f7edc0af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edb7fe640 1 -- 172.21.15.2:0/771669003 >> v2:172.21.15.90:3300/0 conn(0x7f7edc06a160 msgr2=0x7f7edc0af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edb7fe640 1 --2- 172.21.15.2:0/771669003 >> v2:172.21.15.90:3300/0 conn(0x7f7edc06a160 0x7f7edc0af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edb7fe640 1 -- 172.21.15.2:0/771669003 >> v1:172.21.15.2:6789/0 conn(0x7f7edc1618b0 legacy=0x7f7edc0c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.242+0000 7f7edb7fe640 1 -- 172.21.15.2:0/771669003 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0d0220 con 0x7f7edc0c2c40 2023-11-04T01:45:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7edb7fe640 1 --2- 172.21.15.2:0/771669003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc0afd50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f7edc071480 tx=0x7f7ecc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470290f2d6ed18a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ed9ffb640 1 -- 172.21.15.2:0/771669003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0ab600 con 0x7f7edc0c2c40 2023-11-04T01:45:02.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ed9ffb640 1 -- 172.21.15.2:0/771669003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc0a7050 con 0x7f7edc0c2c40 2023-11-04T01:45:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ed9ffb640 1 -- 172.21.15.2:0/771669003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0ab980 con 0x7f7edc0c2c40 2023-11-04T01:45:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 -- 172.21.15.2:0/771669003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 msgr2=0x7f7edc0afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/771669003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc0afd50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f7edc071480 tx=0x7f7ecc01c390 comp rx=0 tx=0).stop 2023-11-04T01:45:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 -- 172.21.15.2:0/771669003 shutdown_connections 2023-11-04T01:45:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/771669003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc0afd50 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/771669003 >> v2:172.21.15.90:3300/0 conn(0x7f7edc06a160 0x7f7edc0af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 -- 172.21.15.2:0/771669003 >> 172.21.15.2:0/771669003 conn(0x7f7edc0cf560 msgr2=0x7f7edc0cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 -- 172.21.15.2:0/771669003 shutdown_connections 2023-11-04T01:45:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 -- 172.21.15.2:0/771669003 wait complete. 2023-11-04T01:45:02.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 Processor -- start 2023-11-04T01:45:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.246+0000 7f7ee19a8640 1 -- start start 2023-11-04T01:45:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7edc06a160 0x7f7edc15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc098700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7edc1618b0 0x7f7edc156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc098270 con 0x7f7edc0c2c40 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0ad640 con 0x7f7edc06a160 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc097660 con 0x7f7edc1618b0 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc098700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc098700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37556/0 (socket says 172.21.15.2:37556) 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 -- 172.21.15.2:0/4046137817 learned_addr learned my addr 172.21.15.2:0/4046137817 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7edaffd640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7edc06a160 0x7f7edc15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7edb7fe640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7edc1618b0 0x7f7edc156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 -- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7edc1618b0 msgr2=0x7f7edc156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7edc1618b0 0x7f7edc156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 -- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7edc06a160 msgr2=0x7f7edc15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7edc06a160 0x7f7edc15db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 -- 172.21.15.2:0/4046137817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0094d0 con 0x7f7edc0c2c40 2023-11-04T01:45:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7eda7fc640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc098700 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000efc0 tx=0x7f7ed000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ec3fff640 1 -- 172.21.15.2:0/4046137817 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0014480 con 0x7f7edc0c2c40 2023-11-04T01:45:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ec3fff640 1 -- 172.21.15.2:0/4046137817 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed000f040 con 0x7f7edc0c2c40 2023-11-04T01:45:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ec3fff640 1 -- 172.21.15.2:0/4046137817 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0014800 con 0x7f7edc0c2c40 2023-11-04T01:45:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc0b06a0 con 0x7f7edc0c2c40 2023-11-04T01:45:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc097c20 con 0x7f7edc0c2c40 2023-11-04T01:45:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc06c1d0 con 0x7f7edc0c2c40 2023-11-04T01:45:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.250+0000 7f7ec3fff640 1 -- 172.21.15.2:0/4046137817 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7ed0014960 con 0x7f7edc0c2c40 2023-11-04T01:45:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.254+0000 7f7ec3fff640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ec80664d0 0x7f7ec8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.254+0000 7f7ec3fff640 1 -- 172.21.15.2:0/4046137817 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6290+0+0 (secure 0 0 0) 0x7f7ed0084c30 con 0x7f7edc0c2c40 2023-11-04T01:45:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.254+0000 7f7edaffd640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ec80664d0 0x7f7ec8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:02.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.254+0000 7f7edaffd640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ec80664d0 0x7f7ec8068990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4000f70 tx=0x7f7ed4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:02.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.258+0000 7f7ec3fff640 1 -- 172.21.15.2:0/4046137817 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ed0051ef0 con 0x7f7edc0c2c40 2023-11-04T01:45:02.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:02.418+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7edc0675f0 con 0x7f7edc0c2c40 2023-11-04T01:45:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.090+0000 7f7ec3fff640 1 -- 172.21.15.2:0/4046137817 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ed0055510 con 0x7f7edc0c2c40 2023-11-04T01:45:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-04T01:45:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ec80664d0 msgr2=0x7f7ec8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ec80664d0 0x7f7ec8068990 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4000f70 tx=0x7f7ed4009040 comp rx=0 tx=0).stop 2023-11-04T01:45:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 msgr2=0x7f7edc098700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc098700 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000efc0 tx=0x7f7ed000c490 comp rx=0 tx=0).stop 2023-11-04T01:45:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 shutdown_connections 2023-11-04T01:45:03.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ec80664d0 0x7f7ec8068990 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7edc1618b0 0x7f7edc156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7edc0c2c40 0x7f7edc098700 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 --2- 172.21.15.2:0/4046137817 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7edc06a160 0x7f7edc15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 >> 172.21.15.2:0/4046137817 conn(0x7f7edc0cf560 msgr2=0x7f7edc0aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 shutdown_connections 2023-11-04T01:45:03.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.094+0000 7f7ee19a8640 1 -- 172.21.15.2:0/4046137817 wait complete. 2023-11-04T01:45:03.135 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:45:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.258+0000 7fd0197f2640 1 Processor -- start 2023-11-04T01:45:03.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.258+0000 7fd0197f2640 1 -- start start 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0140ca500 0x7fd01406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140b4170 0x7fd0140b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0140ca9a0 con 0x7fd0140b3d90 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0140c97f0 con 0x7fd0140ca500 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140cac80 con 0x7fd0140b4170 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0127fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0140ca500 0x7fd01406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd012ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd0140b3d90 0x7fd0140c90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40512/0 (socket says 172.21.15.2:40512) 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd012ffd640 1 -- 172.21.15.2:0/807940319 learned_addr learned my addr 172.21.15.2:0/807940319 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0127fc640 1 -- 172.21.15.2:0/807940319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140b4170 msgr2=0x7fd0140b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0137fe640 1 --2- 172.21.15.2:0/807940319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140b4170 0x7fd0140b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0127fc640 1 --2- 172.21.15.2:0/807940319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140b4170 0x7fd0140b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0127fc640 1 -- 172.21.15.2:0/807940319 >> v1:172.21.15.2:6789/0 conn(0x7fd0140b3d90 legacy=0x7fd0140c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0127fc640 1 -- 172.21.15.2:0/807940319 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0140caf60 con 0x7fd0140ca500 2023-11-04T01:45:03.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0137fe640 1 --2- 172.21.15.2:0/807940319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140b4170 0x7fd0140b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0127fc640 1 --2- 172.21.15.2:0/807940319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140ca500 0x7fd01406f9c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd0080097c0 tx=0x7fd00801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ea1d12a4903745 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd011ffb640 1 -- 172.21.15.2:0/807940319 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0080ab600 con 0x7fd0140ca500 2023-11-04T01:45:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd011ffb640 1 -- 172.21.15.2:0/807940319 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0080a7050 con 0x7fd0140ca500 2023-11-04T01:45:03.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd011ffb640 1 -- 172.21.15.2:0/807940319 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0080ab980 con 0x7fd0140ca500 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- 172.21.15.2:0/807940319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140ca500 msgr2=0x7fd01406f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 --2- 172.21.15.2:0/807940319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140ca500 0x7fd01406f9c0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd0080097c0 tx=0x7fd00801c480 comp rx=0 tx=0).stop 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- 172.21.15.2:0/807940319 shutdown_connections 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 --2- 172.21.15.2:0/807940319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140ca500 0x7fd01406f9c0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 --2- 172.21.15.2:0/807940319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140b4170 0x7fd0140b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- 172.21.15.2:0/807940319 >> 172.21.15.2:0/807940319 conn(0x7fd0140cb510 msgr2=0x7fd0140cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- 172.21.15.2:0/807940319 shutdown_connections 2023-11-04T01:45:03.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.262+0000 7fd0197f2640 1 -- 172.21.15.2:0/807940319 wait complete. 2023-11-04T01:45:03.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 Processor -- start 2023-11-04T01:45:03.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 -- start start 2023-11-04T01:45:03.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140b3d90 0x7fd0141542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0140b4170 0x7fd0141511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140ca500 0x7fd0140ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140b3220 con 0x7fd0140b3d90 2023-11-04T01:45:03.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd014151710 con 0x7fd0140b4170 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0140b0170 con 0x7fd0140ca500 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140b3d90 0x7fd0141542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140b3d90 0x7fd0141542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37574/0 (socket says 172.21.15.2:37574) 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 -- 172.21.15.2:0/3261428500 learned_addr learned my addr 172.21.15.2:0/3261428500 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0127fc640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0140b4170 0x7fd0141511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0137fe640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140ca500 0x7fd0140ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 -- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140ca500 msgr2=0x7fd0140ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140ca500 0x7fd0140ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 -- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0140b4170 msgr2=0x7fd0141511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0140b4170 0x7fd0141511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 -- 172.21.15.2:0/3261428500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008009420 con 0x7fd0140b3d90 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd012ffd640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140b3d90 0x7fd0141542b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd004002240 tx=0x7fd00400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fcffb7fe640 1 -- 172.21.15.2:0/3261428500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400ad40 con 0x7fd0140b3d90 2023-11-04T01:45:03.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fcffb7fe640 1 -- 172.21.15.2:0/3261428500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004012400 con 0x7fd0140b3d90 2023-11-04T01:45:03.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0140b0380 con 0x7fd0140b3d90 2023-11-04T01:45:03.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fcffb7fe640 1 -- 172.21.15.2:0/3261428500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400aea0 con 0x7fd0140b3d90 2023-11-04T01:45:03.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.266+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01406ca50 con 0x7fd0140b3d90 2023-11-04T01:45:03.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.270+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0140744a0 con 0x7fd0140b3d90 2023-11-04T01:45:03.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.270+0000 7fcffb7fe640 1 -- 172.21.15.2:0/3261428500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd004007070 con 0x7fd0140b3d90 2023-11-04T01:45:03.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.270+0000 7fcffb7fe640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0000664a0 0x7fd000068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:03.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.270+0000 7fcffb7fe640 1 -- 172.21.15.2:0/3261428500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6672+0+0 (secure 0 0 0) 0x7fd004084540 con 0x7fd0140b3d90 2023-11-04T01:45:03.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.270+0000 7fd0127fc640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0000664a0 0x7fd000068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:03.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.270+0000 7fd0127fc640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0000664a0 0x7fd000068960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd0080ad000 tx=0x7fd008008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:03.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.274+0000 7fcffb7fe640 1 -- 172.21.15.2:0/3261428500 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd004051790 con 0x7fd0140b3d90 2023-11-04T01:45:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:03.462+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd0140cde20 con 0x7fd0140b3d90 2023-11-04T01:45:04.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.122+0000 7fcffb7fe640 1 -- 172.21.15.2:0/3261428500 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v31) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd004054db0 con 0x7fd0140b3d90 2023-11-04T01:45:04.130 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 13 and data pool 14 2023-11-04T01:45:04.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0000664a0 msgr2=0x7fd000068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0000664a0 0x7fd000068960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd0080ad000 tx=0x7fd008008040 comp rx=0 tx=0).stop 2023-11-04T01:45:04.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140b3d90 msgr2=0x7fd0141542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140b3d90 0x7fd0141542b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd004002240 tx=0x7fd00400a430 comp rx=0 tx=0).stop 2023-11-04T01:45:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 shutdown_connections 2023-11-04T01:45:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd0000664a0 0x7fd000068960 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd0140ca500 0x7fd0140ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd0140b4170 0x7fd0141511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 --2- 172.21.15.2:0/3261428500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0140b3d90 0x7fd0141542b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 >> 172.21.15.2:0/3261428500 conn(0x7fd0140cb510 msgr2=0x7fd0140ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:04.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 shutdown_connections 2023-11-04T01:45:04.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.134+0000 7fd0197f2640 1 -- 172.21.15.2:0/3261428500 wait complete. 2023-11-04T01:45:04.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.286+0000 7fca1732a640 1 Processor -- start 2023-11-04T01:45:04.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.286+0000 7fca1732a640 1 -- start start 2023-11-04T01:45:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca1732a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca100b0890 0x7fca100cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca1732a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca100ce320 con 0x7fca100b0c70 2023-11-04T01:45:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca1732a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca100ce600 con 0x7fca100c9960 2023-11-04T01:45:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca1732a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1006d2f0 con 0x7fca100b0890 2023-11-04T01:45:04.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca158c7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fca100b0c70 0x7fca100ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40520/0 (socket says 172.21.15.2:40520) 2023-11-04T01:45:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca150c6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fca100b0890 0x7fca100cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca158c7640 1 -- 172.21.15.2:0/2303369268 learned_addr learned my addr 172.21.15.2:0/2303369268 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca07fff640 1 -- 172.21.15.2:0/2303369268 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598252702 0 0) 0x7fca100ce320 con 0x7fca100b0c70 2023-11-04T01:45:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca07fff640 1 -- 172.21.15.2:0/2303369268 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9fc005740 con 0x7fca100b0c70 2023-11-04T01:45:04.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca150c6640 1 -- 172.21.15.2:0/2303369268 >> v1:172.21.15.90:6789/0 conn(0x7fca100c9960 legacy=0x7fca100704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca150c6640 1 -- 172.21.15.2:0/2303369268 >> v1:172.21.15.2:6789/0 conn(0x7fca100b0c70 legacy=0x7fca100ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.290+0000 7fca150c6640 1 -- 172.21.15.2:0/2303369268 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca100ce8e0 con 0x7fca100b0890 2023-11-04T01:45:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca150c6640 1 --2- 172.21.15.2:0/2303369268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100b0890 0x7fca100cdbd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2675c687e2a3646a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca07fff640 1 -- 172.21.15.2:0/2303369268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0a5900 con 0x7fca100b0890 2023-11-04T01:45:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca07fff640 1 -- 172.21.15.2:0/2303369268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c0a5a60 con 0x7fca100b0890 2023-11-04T01:45:04.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca07fff640 1 -- 172.21.15.2:0/2303369268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0a5df0 con 0x7fca100b0890 2023-11-04T01:45:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 -- 172.21.15.2:0/2303369268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100b0890 msgr2=0x7fca100cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 --2- 172.21.15.2:0/2303369268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100b0890 0x7fca100cdbd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c01c950 comp rx=0 tx=0).stop 2023-11-04T01:45:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 -- 172.21.15.2:0/2303369268 shutdown_connections 2023-11-04T01:45:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 --2- 172.21.15.2:0/2303369268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100b0890 0x7fca100cdbd0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 -- 172.21.15.2:0/2303369268 >> 172.21.15.2:0/2303369268 conn(0x7fca100cebb0 msgr2=0x7fca100cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 -- 172.21.15.2:0/2303369268 shutdown_connections 2023-11-04T01:45:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 -- 172.21.15.2:0/2303369268 wait complete. 2023-11-04T01:45:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 Processor -- start 2023-11-04T01:45:04.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.294+0000 7fca1732a640 1 -- start start 2023-11-04T01:45:04.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca100b0890 0x7fca1014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca100b0c70 0x7fca1015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100c9960 0x7fca100c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca100c3cf0 con 0x7fca100c9960 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca100c2e20 con 0x7fca100b0890 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca100c30e0 con 0x7fca100b0c70 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100c9960 0x7fca100c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100c9960 0x7fca100c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37584/0 (socket says 172.21.15.2:37584) 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 -- 172.21.15.2:0/3467030483 learned_addr learned my addr 172.21.15.2:0/3467030483 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca150c6640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca100b0890 0x7fca1014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca148c5640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca100b0c70 0x7fca1015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 -- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca100b0c70 msgr2=0x7fca1015acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca100b0c70 0x7fca1015acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 -- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca100b0890 msgr2=0x7fca1014ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca100b0890 0x7fca1014ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 -- 172.21.15.2:0/3467030483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c009a70 con 0x7fca100c9960 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca158c7640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100c9960 0x7fca100c1a10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c450 tx=0x7fca0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca05ffb640 1 -- 172.21.15.2:0/3467030483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08005cf0 con 0x7fca100c9960 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca05ffb640 1 -- 172.21.15.2:0/3467030483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08005e50 con 0x7fca100c9960 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca100c33c0 con 0x7fca100c9960 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca05ffb640 1 -- 172.21.15.2:0/3467030483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080072b0 con 0x7fca100c9960 2023-11-04T01:45:04.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca100c3980 con 0x7fca100c9960 2023-11-04T01:45:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca100c3e60 con 0x7fca100c9960 2023-11-04T01:45:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca05ffb640 1 -- 172.21.15.2:0/3467030483 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca08007410 con 0x7fca100c9960 2023-11-04T01:45:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca05ffb640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9f40664a0 0x7fc9f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca05ffb640 1 -- 172.21.15.2:0/3467030483 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fca08083370 con 0x7fca100c9960 2023-11-04T01:45:04.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.298+0000 7fca150c6640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9f40664a0 0x7fc9f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.302+0000 7fca150c6640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9f40664a0 0x7fc9f4068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0af000 tx=0x7fca0c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.302+0000 7fca05ffb640 1 -- 172.21.15.2:0/3467030483 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca08050500 con 0x7fca100c9960 2023-11-04T01:45:04.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.462+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca100737f0 con 0x7fca100c9960 2023-11-04T01:45:04.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca05ffb640 1 -- 172.21.15.2:0/3467030483 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+21717 (secure 0 0 0) 0x7fca08053b20 con 0x7fca100c9960 2023-11-04T01:45:04.468 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:04.468 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":79,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:03.465719+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:01.698844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:02.463984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:04.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9f40664a0 msgr2=0x7fc9f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9f40664a0 0x7fc9f4068960 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0af000 tx=0x7fca0c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:04.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100c9960 msgr2=0x7fca100c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100c9960 0x7fca100c1a10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c450 tx=0x7fca0800c910 comp rx=0 tx=0).stop 2023-11-04T01:45:04.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 shutdown_connections 2023-11-04T01:45:04.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9f40664a0 0x7fc9f4068960 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca100c9960 0x7fca100c1a10 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fca100b0c70 0x7fca1015acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 --2- 172.21.15.2:0/3467030483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fca100b0890 0x7fca1014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 >> 172.21.15.2:0/3467030483 conn(0x7fca100cebb0 msgr2=0x7fca1015bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:04.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 shutdown_connections 2023-11-04T01:45:04.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.466+0000 7fca1732a640 1 -- 172.21.15.2:0/3467030483 wait complete. 2023-11-04T01:45:04.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c3bf9640 1 Processor -- start 2023-11-04T01:45:04.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c3bf9640 1 -- start start 2023-11-04T01:45:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c3bf9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff7bc15d240 0x7ff7bc15d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c3bf9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0d2280 con 0x7ff7bc0d0b10 2023-11-04T01:45:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c3bf9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0d2560 con 0x7ff7bc0b49c0 2023-11-04T01:45:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c3bf9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0d2840 con 0x7ff7bc15d240 2023-11-04T01:45:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c1194640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff7bc0d0b10 0x7ff7bc0d1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40524/0 (socket says 172.21.15.2:40524) 2023-11-04T01:45:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c1194640 1 -- 172.21.15.2:0/2814158997 learned_addr learned my addr 172.21.15.2:0/2814158997 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:04.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461958621 0 0) 0x7ff7bc0d2280 con 0x7ff7bc0d0b10 2023-11-04T01:45:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a8003530 con 0x7ff7bc0d0b10 2023-11-04T01:45:04.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c1995640 1 --2- 172.21.15.2:0/2814158997 >> v2:172.21.15.90:3300/0 conn(0x7ff7bc15d240 0x7ff7bc15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3263367611 0 0) 0x7ff7a8003530 con 0x7ff7bc0d0b10 2023-11-04T01:45:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 >> v2:172.21.15.90:3300/0 conn(0x7ff7bc15d240 msgr2=0x7ff7bc15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:04.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 --2- 172.21.15.2:0/2814158997 >> v2:172.21.15.90:3300/0 conn(0x7ff7bc15d240 0x7ff7bc15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 >> v1:172.21.15.90:6789/0 conn(0x7ff7bc0b49c0 legacy=0x7ff7bc0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0b66c0 con 0x7ff7bc0d0b10 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff7b8001680 con 0x7ff7bc0d0b10 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c1995640 1 --2- 172.21.15.2:0/2814158997 >> v2:172.21.15.90:3300/0 conn(0x7ff7bc15d240 0x7ff7bc15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 >> v1:172.21.15.2:6789/0 conn(0x7ff7bc0d0b10 legacy=0x7ff7bc0d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8003980 0x7ff7a8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a8004380 0x7ff7a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a8005050 0x7ff7a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0d2840 con 0x7ff7a8005050 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800bfb0 con 0x7ff7a8003980 2023-11-04T01:45:04.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800c170 con 0x7ff7a8004380 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c2196640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a8005050 0x7ff7a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c1995640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8003980 0x7ff7a8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c1194640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a8004380 0x7ff7a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c2196640 1 -- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a8004380 msgr2=0x7ff7a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c2196640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7a8004380 0x7ff7a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c2196640 1 -- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8003980 msgr2=0x7ff7a8003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c2196640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8003980 0x7ff7a8003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.610+0000 7ff7c2196640 1 -- 172.21.15.2:0/2814158997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8003530 con 0x7ff7a8005050 2023-11-04T01:45:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c2196640 1 -- 172.21.15.2:0/2814158997 reap_dead start 2023-11-04T01:45:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c2196640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a8005050 0x7ff7a800b990 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001e70 tx=0x7ff7b401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567e27758ea9e7c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4003b80 con 0x7ff7a8005050 2023-11-04T01:45:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b4003d20 con 0x7ff7a8005050 2023-11-04T01:45:04.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c0993640 1 -- 172.21.15.2:0/2814158997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4005260 con 0x7ff7a8005050 2023-11-04T01:45:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/2814158997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a8005050 msgr2=0x7ff7a800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a8005050 0x7ff7a800b990 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4001e70 tx=0x7ff7b401c760 comp rx=0 tx=0).stop 2023-11-04T01:45:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/2814158997 shutdown_connections 2023-11-04T01:45:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/2814158997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a8005050 0x7ff7a800b990 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/2814158997 >> 172.21.15.2:0/2814158997 conn(0x7ff7bc0cf9c0 msgr2=0x7ff7bc0cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/2814158997 shutdown_connections 2023-11-04T01:45:04.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/2814158997 wait complete. 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 Processor -- start 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.614+0000 7ff7c3bf9640 1 -- start start 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8005050 0x7ff7bc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7bc0c8f40 0x7ff7bc0c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7bc0ce010 0x7ff7bc0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0cd320 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c9990 con 0x7ff7a8005050 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c5fc0 con 0x7ff7bc0ce010 2023-11-04T01:45:04.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7bc0c8f40 0x7ff7bc0c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c2196640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7bc0ce010 0x7ff7bc0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7bc0c8f40 0x7ff7bc0c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37600/0 (socket says 172.21.15.2:37600) 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 -- 172.21.15.2:0/648876607 learned_addr learned my addr 172.21.15.2:0/648876607 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1995640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8005050 0x7ff7bc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 -- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7bc0ce010 msgr2=0x7ff7bc0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7bc0ce010 0x7ff7bc0ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 -- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8005050 msgr2=0x7ff7bc0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8005050 0x7ff7bc0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 -- 172.21.15.2:0/648876607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0c96b0 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1995640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8005050 0x7ff7bc0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:04.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c1194640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7bc0c8f40 0x7ff7bc0c5a80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80017b0 tx=0x7ff7b8008430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7b27fc640 1 -- 172.21.15.2:0/648876607 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b800e930 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7b27fc640 1 -- 172.21.15.2:0/648876607 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b800ea90 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc0cd530 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7b27fc640 1 -- 172.21.15.2:0/648876607 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b800ee20 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc0cdaf0 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc0cdce0 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7b27fc640 1 -- 172.21.15.2:0/648876607 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7b801d460 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7b27fc640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7a00664a0 0x7ff7a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.618+0000 7ff7b27fc640 1 -- 172.21.15.2:0/648876607 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7ff7b80843f0 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.622+0000 7ff7c1995640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7a00664a0 0x7ff7a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.622+0000 7ff7c1995640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7a00664a0 0x7ff7a0068960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009cf0 tx=0x7ff7ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.626+0000 7ff7b27fc640 1 -- 172.21.15.2:0/648876607 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff7b8051440 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.786+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7bc0675f0 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7b27fc640 1 -- 172.21.15.2:0/648876607 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+21717 (secure 0 0 0) 0x7ff7b8054a60 con 0x7ff7bc0c8f40 2023-11-04T01:45:04.792 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:04.792 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":79,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:03.465719+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:01.698844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:02.463984+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7a00664a0 msgr2=0x7ff7a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7a00664a0 0x7ff7a0068960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009cf0 tx=0x7ff7ac008040 comp rx=0 tx=0).stop 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7bc0c8f40 msgr2=0x7ff7bc0c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7bc0c8f40 0x7ff7bc0c5a80 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80017b0 tx=0x7ff7b8008430 comp rx=0 tx=0).stop 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 shutdown_connections 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff7a00664a0 0x7ff7a0068960 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff7bc0ce010 0x7ff7bc0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7bc0c8f40 0x7ff7bc0c5a80 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 --2- 172.21.15.2:0/648876607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7a8005050 0x7ff7bc0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 >> 172.21.15.2:0/648876607 conn(0x7ff7bc0cf9c0 msgr2=0x7ff7bc15dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:04.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 shutdown_connections 2023-11-04T01:45:04.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.790+0000 7ff7c3bf9640 1 -- 172.21.15.2:0/648876607 wait complete. 2023-11-04T01:45:04.811 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:45:04.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.942+0000 7fd73ed2b640 1 Processor -- start 2023-11-04T01:45:04.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.942+0000 7fd73ed2b640 1 -- start start 2023-11-04T01:45:04.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd73ed2b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd73815af70 0x7fd7380cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd73ed2b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73806c0c0 con 0x7fd73806d160 2023-11-04T01:45:04.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd73ed2b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73806c3a0 con 0x7fd73815e490 2023-11-04T01:45:04.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd73ed2b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73806c680 con 0x7fd73815af70 2023-11-04T01:45:04.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd73806d160 0x7fd73815dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40530/0 (socket says 172.21.15.2:40530) 2023-11-04T01:45:04.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 -- 172.21.15.2:0/3816036690 learned_addr learned my addr 172.21.15.2:0/3816036690 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:04.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd73cac7640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd73815af70 0x7fd7380cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167397259 0 0) 0x7fd73806c0c0 con 0x7fd73806d160 2023-11-04T01:45:04.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd724003530 con 0x7fd73806d160 2023-11-04T01:45:04.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901391095 0 0) 0x7fd724003530 con 0x7fd73806d160 2023-11-04T01:45:04.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd73815af70 msgr2=0x7fd7380cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:04.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd73815af70 0x7fd7380cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 >> v1:172.21.15.90:6789/0 conn(0x7fd73815e490 legacy=0x7fd7380701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73806c960 con 0x7fd73806d160 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fd720001680 con 0x7fd73806d160 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 >> v1:172.21.15.2:6789/0 conn(0x7fd73806d160 legacy=0x7fd73815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7240039b0 0x7fd724003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd724004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd73815af70 0x7fd724005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73806c680 con 0x7fd7240047d0 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72400ba40 con 0x7fd7240039b0 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72400de10 con 0x7fd73815af70 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd724004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd73cac7640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7240039b0 0x7fd724003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 -- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd73815af70 msgr2=0x7fd724005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:04.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd73815af70 0x7fd724005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 -- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7240039b0 msgr2=0x7fd724003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7240039b0 0x7fd724003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 -- 172.21.15.2:0/3816036690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724003530 con 0x7fd7240047d0 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd737fff640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd724004c50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c210 tx=0x7fd72001f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ddbecdecbffa55 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720005ae0 con 0x7fd7240047d0 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7200ab070 con 0x7fd7240047d0 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.946+0000 7fd7377fe640 1 -- 172.21.15.2:0/3816036690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720005ea0 con 0x7fd7240047d0 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- 172.21.15.2:0/3816036690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 msgr2=0x7fd724004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 --2- 172.21.15.2:0/3816036690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd724004c50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c210 tx=0x7fd72001f350 comp rx=0 tx=0).stop 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73d2c8640 1 -- 172.21.15.2:0/3816036690 reap_dead start 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- 172.21.15.2:0/3816036690 shutdown_connections 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- 172.21.15.2:0/3816036690 >> 172.21.15.2:0/3816036690 conn(0x7fd7380cb510 msgr2=0x7fd7380cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- 172.21.15.2:0/3816036690 shutdown_connections 2023-11-04T01:45:04.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- 172.21.15.2:0/3816036690 wait complete. 2023-11-04T01:45:04.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 Processor -- start 2023-11-04T01:45:04.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- start start 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd7380c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7380c6f10 0x7fd738157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7380cdd60 0x7fd7380ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380c7370 con 0x7fd7240047d0 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738157570 con 0x7fd7380cdd60 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380c7590 con 0x7fd7380c6f10 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd7380c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd7380c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37610/0 (socket says 172.21.15.2:37610) 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 -- 172.21.15.2:0/1311415769 learned_addr learned my addr 172.21.15.2:0/1311415769 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd737fff640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7380c6f10 0x7fd738157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73d2c8640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7380cdd60 0x7fd7380ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 -- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7380c6f10 msgr2=0x7fd738157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7380c6f10 0x7fd738157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 -- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7380cdd60 msgr2=0x7fd7380ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7380cdd60 0x7fd7380ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 -- 172.21.15.2:0/1311415769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380c7870 con 0x7fd7240047d0 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73cac7640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd7380c8630 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd73000f380 tx=0x7fd73000f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd7357fa640 1 -- 172.21.15.2:0/1311415769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730017600 con 0x7fd7240047d0 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd7357fa640 1 -- 172.21.15.2:0/1311415769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730011040 con 0x7fd7240047d0 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7380c7b50 con 0x7fd7240047d0 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd7357fa640 1 -- 172.21.15.2:0/1311415769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300179c0 con 0x7fd7240047d0 2023-11-04T01:45:04.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.950+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7380c8110 con 0x7fd7240047d0 2023-11-04T01:45:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.954+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7380744a0 con 0x7fd7240047d0 2023-11-04T01:45:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.954+0000 7fd7357fa640 1 -- 172.21.15.2:0/1311415769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd730017b20 con 0x7fd7240047d0 2023-11-04T01:45:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.954+0000 7fd7357fa640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd7180664d0 0x7fd718068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.954+0000 7fd7357fa640 1 -- 172.21.15.2:0/1311415769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fd7300848c0 con 0x7fd7240047d0 2023-11-04T01:45:04.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.954+0000 7fd737fff640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd7180664d0 0x7fd718068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:04.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.954+0000 7fd737fff640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd7180664d0 0x7fd718068990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd7200af000 tx=0x7fd7200aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:04.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:04.958+0000 7fd7357fa640 1 -- 172.21.15.2:0/1311415769 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd730051a60 con 0x7fd7240047d0 2023-11-04T01:45:05.068 INFO:tasks.ceph.mds.b.smithi090.stderr:2023-11-04T01:45:05.064+0000 7fa72ae85640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:05.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:05.150+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd73806b910 con 0x7fd7240047d0 2023-11-04T01:45:06.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.110+0000 7fd7357fa640 1 -- 172.21.15.2:0/1311415769 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd73001c0b0 con 0x7fd7240047d0 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd7180664d0 msgr2=0x7fd718068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd7180664d0 0x7fd718068990 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd7200af000 tx=0x7fd7200aa000 comp rx=0 tx=0).stop 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 msgr2=0x7fd7380c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd7380c8630 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd73000f380 tx=0x7fd73000f840 comp rx=0 tx=0).stop 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 shutdown_connections 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd7180664d0 0x7fd718068990 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd7380cdd60 0x7fd7380ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd7380c6f10 0x7fd738157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 --2- 172.21.15.2:0/1311415769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7240047d0 0x7fd7380c8630 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 >> 172.21.15.2:0/1311415769 conn(0x7fd7380cb510 msgr2=0x7fd7380b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:06.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 shutdown_connections 2023-11-04T01:45:06.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.114+0000 7fd73ed2b640 1 -- 172.21.15.2:0/1311415769 wait complete. 2023-11-04T01:45:06.138 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:45:06.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:45:06.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff4421fd640 1 Processor -- start 2023-11-04T01:45:06.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff4421fd640 1 -- start start 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff4421fd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff43c159ec0 0x7ff43c0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff4421fd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c15da30 0x7ff43c0cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff4421fd640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43c15e260 con 0x7ff43c06c5c0 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff4421fd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43c15e540 con 0x7ff43c159ec0 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff4421fd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c15e820 con 0x7ff43c15da30 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff43c159ec0 0x7ff43c0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff43c06c5c0 0x7ff43c070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40538/0 (socket says 172.21.15.2:40538) 2023-11-04T01:45:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43bfff640 1 -- 172.21.15.2:0/2901313715 learned_addr learned my addr 172.21.15.2:0/2901313715 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43affd640 1 --2- 172.21.15.2:0/2901313715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c15da30 0x7ff43c0cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43b7fe640 1 -- 172.21.15.2:0/2901313715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c15da30 msgr2=0x7ff43c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43b7fe640 1 --2- 172.21.15.2:0/2901313715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c15da30 0x7ff43c0cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43b7fe640 1 -- 172.21.15.2:0/2901313715 >> v1:172.21.15.2:6789/0 conn(0x7ff43c06c5c0 legacy=0x7ff43c070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43a7fc640 1 -- 172.21.15.2:0/2901313715 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879587884 0 0) 0x7ff43c15e260 con 0x7ff43c06c5c0 2023-11-04T01:45:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43b7fe640 1 -- 172.21.15.2:0/2901313715 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c070220 con 0x7ff43c159ec0 2023-11-04T01:45:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.266+0000 7ff43affd640 1 --2- 172.21.15.2:0/2901313715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c15da30 0x7ff43c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43b7fe640 1 --2- 172.21.15.2:0/2901313715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c159ec0 0x7ff43c0c93b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0097c0 tx=0x7ff42c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fd7185a05dd0c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43a7fc640 1 -- 172.21.15.2:0/2901313715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0ad640 con 0x7ff43c159ec0 2023-11-04T01:45:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43a7fc640 1 -- 172.21.15.2:0/2901313715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c0ad7a0 con 0x7ff43c159ec0 2023-11-04T01:45:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43a7fc640 1 -- 172.21.15.2:0/2901313715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0adb30 con 0x7ff43c159ec0 2023-11-04T01:45:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- 172.21.15.2:0/2901313715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c159ec0 msgr2=0x7ff43c0c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2901313715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c159ec0 0x7ff43c0c93b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0097c0 tx=0x7ff42c01c3f0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- 172.21.15.2:0/2901313715 shutdown_connections 2023-11-04T01:45:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2901313715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c15da30 0x7ff43c0cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2901313715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c159ec0 0x7ff43c0c93b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- 172.21.15.2:0/2901313715 >> 172.21.15.2:0/2901313715 conn(0x7ff43c0cb420 msgr2=0x7ff43c0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:06.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- 172.21.15.2:0/2901313715 shutdown_connections 2023-11-04T01:45:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- 172.21.15.2:0/2901313715 wait complete. 2023-11-04T01:45:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 Processor -- start 2023-11-04T01:45:06.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- start start 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff43c06c5c0 0x7ff43c156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c159ec0 0x7ff43c0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c15da30 0x7ff43c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c156260 con 0x7ff43c15da30 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0b3290 con 0x7ff43c06c5c0 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0b2400 con 0x7ff43c159ec0 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c15da30 0x7ff43c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c15da30 0x7ff43c0c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37626/0 (socket says 172.21.15.2:37626) 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 -- 172.21.15.2:0/2409920224 learned_addr learned my addr 172.21.15.2:0/2409920224 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43b7fe640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff43c06c5c0 0x7ff43c156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:06.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43affd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c159ec0 0x7ff43c0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 -- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c159ec0 msgr2=0x7ff43c0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c159ec0 0x7ff43c0c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 -- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff43c06c5c0 msgr2=0x7ff43c156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff43c06c5c0 0x7ff43c156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 -- 172.21.15.2:0/2409920224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c009420 con 0x7ff43c15da30 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43affd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c159ec0 0x7ff43c0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff43bfff640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c15da30 0x7ff43c0c3b90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c3f0 tx=0x7ff43400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff423fff640 1 -- 172.21.15.2:0/2409920224 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340074e0 con 0x7ff43c15da30 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff423fff640 1 -- 172.21.15.2:0/2409920224 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434007640 con 0x7ff43c15da30 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff423fff640 1 -- 172.21.15.2:0/2409920224 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434004a30 con 0x7ff43c15da30 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c0b2680 con 0x7ff43c15da30 2023-11-04T01:45:06.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.270+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c0b2c40 con 0x7ff43c15da30 2023-11-04T01:45:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.274+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c0b3420 con 0x7ff43c15da30 2023-11-04T01:45:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.274+0000 7ff423fff640 1 -- 172.21.15.2:0/2409920224 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff434004b90 con 0x7ff43c15da30 2023-11-04T01:45:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.274+0000 7ff423fff640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4280664a0 0x7ff428068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.274+0000 7ff423fff640 1 -- 172.21.15.2:0/2409920224 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7ff434084080 con 0x7ff43c15da30 2023-11-04T01:45:06.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.274+0000 7ff43b7fe640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4280664a0 0x7ff428068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:06.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.274+0000 7ff43b7fe640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4280664a0 0x7ff428068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0af000 tx=0x7ff42c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:06.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.278+0000 7ff423fff640 1 -- 172.21.15.2:0/2409920224 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff434054b60 con 0x7ff43c15da30 2023-11-04T01:45:06.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:06.470+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff43c0744a0 con 0x7ff43c15da30 2023-11-04T01:45:07.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.114+0000 7ff423fff640 1 -- 172.21.15.2:0/2409920224 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff4340546f0 con 0x7ff43c15da30 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4280664a0 msgr2=0x7ff428068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4280664a0 0x7ff428068960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0af000 tx=0x7ff42c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c15da30 msgr2=0x7ff43c0c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c15da30 0x7ff43c0c3b90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c3f0 tx=0x7ff43400c8b0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 shutdown_connections 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4280664a0 0x7ff428068960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff43c15da30 0x7ff43c0c3b90 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff43c159ec0 0x7ff43c0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 --2- 172.21.15.2:0/2409920224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff43c06c5c0 0x7ff43c156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 >> 172.21.15.2:0/2409920224 conn(0x7ff43c0cb420 msgr2=0x7ff43c0cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 shutdown_connections 2023-11-04T01:45:07.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.118+0000 7ff4421fd640 1 -- 172.21.15.2:0/2409920224 wait complete. 2023-11-04T01:45:07.145 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:45:07.145 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:07.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f71935da640 1 Processor -- start 2023-11-04T01:45:07.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f71935da640 1 -- start start 2023-11-04T01:45:07.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f71935da640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c159a50 0x7f718c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f71935da640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f718c06c1a0 0x7f718c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f71935da640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c159e30 con 0x7f718c0ce720 2023-11-04T01:45:07.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f71935da640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0ccfd0 con 0x7f718c06c1a0 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f71935da640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0cd2b0 con 0x7f718c159a50 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7190b75640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f718c0ce720 0x7f718c06ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40552/0 (socket says 172.21.15.2:40552) 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7190b75640 1 -- 172.21.15.2:0/1355928056 learned_addr learned my addr 172.21.15.2:0/1355928056 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7191b77640 1 --2- 172.21.15.2:0/1355928056 >> v2:172.21.15.2:3300/0 conn(0x7f718c06c1a0 0x7f718c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7191376640 1 --2- 172.21.15.2:0/1355928056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c159a50 0x7f718c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f717ffff640 1 -- 172.21.15.2:0/1355928056 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384667947 0 0) 0x7f7188001120 con 0x7f718c0ce720 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f717ffff640 1 -- 172.21.15.2:0/1355928056 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7178003530 con 0x7f718c0ce720 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7191b77640 1 -- 172.21.15.2:0/1355928056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c159a50 msgr2=0x7f718c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7191b77640 1 --2- 172.21.15.2:0/1355928056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c159a50 0x7f718c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7191b77640 1 -- 172.21.15.2:0/1355928056 >> v1:172.21.15.2:6789/0 conn(0x7f718c0ce720 legacy=0x7f718c06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.270+0000 7f7191b77640 1 -- 172.21.15.2:0/1355928056 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c0cd590 con 0x7f718c06c1a0 2023-11-04T01:45:07.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7191b77640 1 --2- 172.21.15.2:0/1355928056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c06c1a0 0x7f718c06fb70 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f718400aea0 tx=0x7f718401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f6a22b4e48e452 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f717ffff640 1 -- 172.21.15.2:0/1355928056 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400a2d0 con 0x7f718c06c1a0 2023-11-04T01:45:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f717ffff640 1 -- 172.21.15.2:0/1355928056 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71840ab050 con 0x7f718c06c1a0 2023-11-04T01:45:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f717ffff640 1 -- 172.21.15.2:0/1355928056 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184008640 con 0x7f718c06c1a0 2023-11-04T01:45:07.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- 172.21.15.2:0/1355928056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c06c1a0 msgr2=0x7f718c06fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 --2- 172.21.15.2:0/1355928056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c06c1a0 0x7f718c06fb70 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f718400aea0 tx=0x7f718401f130 comp rx=0 tx=0).stop 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- 172.21.15.2:0/1355928056 shutdown_connections 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 --2- 172.21.15.2:0/1355928056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c06c1a0 0x7f718c06fb70 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 --2- 172.21.15.2:0/1355928056 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c159a50 0x7f718c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- 172.21.15.2:0/1355928056 >> 172.21.15.2:0/1355928056 conn(0x7f718c0cebb0 msgr2=0x7f718c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- 172.21.15.2:0/1355928056 shutdown_connections 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- 172.21.15.2:0/1355928056 wait complete. 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 Processor -- start 2023-11-04T01:45:07.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- start start 2023-11-04T01:45:07.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c06c1a0 0x7f718c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c0ce720 0x7f718c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c159a50 0x7f718c15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0b18c0 con 0x7f718c0ce720 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c153630 con 0x7f718c159a50 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f71935da640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0c8110 con 0x7f718c06c1a0 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c0ce720 0x7f718c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c0ce720 0x7f718c1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37632/0 (socket says 172.21.15.2:37632) 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 -- 172.21.15.2:0/2252045808 learned_addr learned my addr 172.21.15.2:0/2252045808 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7191376640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c06c1a0 0x7f718c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7191b77640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c159a50 0x7f718c15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 -- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c06c1a0 msgr2=0x7f718c0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c06c1a0 0x7f718c0c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 -- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c159a50 msgr2=0x7f718c15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c159a50 0x7f718c15b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 -- 172.21.15.2:0/2252045808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718400ab80 con 0x7f718c0ce720 2023-11-04T01:45:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.274+0000 7f7190b75640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c0ce720 0x7f718c1530f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f718800c730 tx=0x7f718800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f717dffb640 1 -- 172.21.15.2:0/2252045808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188005ac0 con 0x7f718c0ce720 2023-11-04T01:45:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f717dffb640 1 -- 172.21.15.2:0/2252045808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188005c20 con 0x7f718c0ce720 2023-11-04T01:45:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f717dffb640 1 -- 172.21.15.2:0/2252045808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188001d40 con 0x7f718c0ce720 2023-11-04T01:45:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c0c83f0 con 0x7f718c0ce720 2023-11-04T01:45:07.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c0c89b0 con 0x7f718c0ce720 2023-11-04T01:45:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c0744a0 con 0x7f718c0ce720 2023-11-04T01:45:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f717dffb640 1 -- 172.21.15.2:0/2252045808 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7188007070 con 0x7f718c0ce720 2023-11-04T01:45:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f717dffb640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71700664d0 0x7f7170068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f717dffb640 1 -- 172.21.15.2:0/2252045808 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f71880836f0 con 0x7f718c0ce720 2023-11-04T01:45:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f7191376640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71700664d0 0x7f7170068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.278+0000 7f7191376640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71700664d0 0x7f7170068990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7180006aa0 tx=0x7f7180006a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.282+0000 7f717dffb640 1 -- 172.21.15.2:0/2252045808 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f71880506a0 con 0x7f718c0ce720 2023-11-04T01:45:07.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.470+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f718c159e30 con 0x7f718c0ce720 2023-11-04T01:45:07.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f717dffb640 1 -- 172.21.15.2:0/2252045808 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f718c159e30 con 0x7f718c0ce720 2023-11-04T01:45:07.476 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:07.476 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1649859495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1649859495},{"type":"v1","addr":"172.21.15.90:6837","nonce":1649859495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/821298795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":821298795},{"type":"v1","addr":"172.21.15.2:6833","nonce":821298795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1371690425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1371690425},{"type":"v1","addr":"172.21.15.2:6835","nonce":1371690425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:45:03.466495+0000","modified":"2023-11-04T01:45:06.473015+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1445624388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1445624388},{"type":"v1","addr":"172.21.15.90:6835","nonce":1445624388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:45:07.477 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 34 2023-11-04T01:45:07.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71700664d0 msgr2=0x7f7170068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71700664d0 0x7f7170068990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7180006aa0 tx=0x7f7180006a30 comp rx=0 tx=0).stop 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c0ce720 msgr2=0x7f718c1530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c0ce720 0x7f718c1530f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f718800c730 tx=0x7f718800cbf0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 shutdown_connections 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f71700664d0 0x7f7170068990 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f718c159a50 0x7f718c15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f718c0ce720 0x7f718c1530f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 --2- 172.21.15.2:0/2252045808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f718c06c1a0 0x7f718c0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 >> 172.21.15.2:0/2252045808 conn(0x7f718c0cebb0 msgr2=0x7f718c0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 shutdown_connections 2023-11-04T01:45:07.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.474+0000 7f71935da640 1 -- 172.21.15.2:0/2252045808 wait complete. 2023-11-04T01:45:07.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:07.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d863c640 1 Processor -- start 2023-11-04T01:45:07.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d863c640 1 -- start start 2023-11-04T01:45:07.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d863c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1d0159a50 0x7fb1d00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d863c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d006c1a0 0x7fb1d006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d863c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d0159e30 con 0x7fb1d00ce720 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d863c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00ccfd0 con 0x7fb1d0159a50 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d863c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00cd2b0 con 0x7fb1d006c1a0 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d63d8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1d0159a50 0x7fb1d00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d63d8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb1d0159a50 0x7fb1d00cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37636/0 (socket says 172.21.15.2:37636) 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d63d8640 1 -- 172.21.15.2:0/82479853 learned_addr learned my addr 172.21.15.2:0/82479853 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d6bd9640 1 --2- 172.21.15.2:0/82479853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d006c1a0 0x7fb1d006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d63d8640 1 -- 172.21.15.2:0/82479853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d006c1a0 msgr2=0x7fb1d006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d63d8640 1 --2- 172.21.15.2:0/82479853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d006c1a0 0x7fb1d006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d63d8640 1 -- 172.21.15.2:0/82479853 >> v1:172.21.15.90:6789/0 conn(0x7fb1d00ce720 legacy=0x7fb1d006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.614+0000 7fb1d63d8640 1 -- 172.21.15.2:0/82479853 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00cd590 con 0x7fb1d0159a50 2023-11-04T01:45:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d63d8640 1 --2- 172.21.15.2:0/82479853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d0159a50 0x7fb1d00cc6f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009e50 tx=0x7fb1cc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52298e9003f84080 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d53d6640 1 -- 172.21.15.2:0/82479853 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0af400 con 0x7fb1d0159a50 2023-11-04T01:45:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d53d6640 1 -- 172.21.15.2:0/82479853 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0ab050 con 0x7fb1d0159a50 2023-11-04T01:45:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d53d6640 1 -- 172.21.15.2:0/82479853 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0af780 con 0x7fb1d0159a50 2023-11-04T01:45:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- 172.21.15.2:0/82479853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d0159a50 msgr2=0x7fb1d00cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 --2- 172.21.15.2:0/82479853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d0159a50 0x7fb1d00cc6f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009e50 tx=0x7fb1cc01f1c0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- 172.21.15.2:0/82479853 shutdown_connections 2023-11-04T01:45:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 --2- 172.21.15.2:0/82479853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d006c1a0 0x7fb1d006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 --2- 172.21.15.2:0/82479853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d0159a50 0x7fb1d00cc6f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- 172.21.15.2:0/82479853 >> 172.21.15.2:0/82479853 conn(0x7fb1d00cebb0 msgr2=0x7fb1d00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- 172.21.15.2:0/82479853 shutdown_connections 2023-11-04T01:45:07.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- 172.21.15.2:0/82479853 wait complete. 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 Processor -- start 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- start start 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d006c1a0 0x7fb1d0155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d00ce720 0x7fb1d00c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d0159a50 0x7fb1d0158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d01562f0 con 0x7fb1d00ce720 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0157a20 con 0x7fb1d006c1a0 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0157d00 con 0x7fb1d0159a50 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d00ce720 0x7fb1d00c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d00ce720 0x7fb1d00c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37648/0 (socket says 172.21.15.2:37648) 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 -- 172.21.15.2:0/2362696038 learned_addr learned my addr 172.21.15.2:0/2362696038 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d6bd9640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d0159a50 0x7fb1d0158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d63d8640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d006c1a0 0x7fb1d0155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 -- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d0159a50 msgr2=0x7fb1d0158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d0159a50 0x7fb1d0158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 -- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d006c1a0 msgr2=0x7fb1d0155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d006c1a0 0x7fb1d0155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 -- 172.21.15.2:0/2362696038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc009b30 con 0x7fb1d00ce720 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d5bd7640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d00ce720 0x7fb1d00c4a40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c410 tx=0x7fb1c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1c6ffd640 1 -- 172.21.15.2:0/2362696038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0011790 con 0x7fb1d00ce720 2023-11-04T01:45:07.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1c6ffd640 1 -- 172.21.15.2:0/2362696038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c00118f0 con 0x7fb1d00ce720 2023-11-04T01:45:07.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d0157fe0 con 0x7fb1d00ce720 2023-11-04T01:45:07.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1c6ffd640 1 -- 172.21.15.2:0/2362696038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0011ce0 con 0x7fb1d00ce720 2023-11-04T01:45:07.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.618+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d01585a0 con 0x7fb1d00ce720 2023-11-04T01:45:07.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.622+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d0158790 con 0x7fb1d00ce720 2023-11-04T01:45:07.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.622+0000 7fb1c6ffd640 1 -- 172.21.15.2:0/2362696038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1c001c460 con 0x7fb1d00ce720 2023-11-04T01:45:07.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.622+0000 7fb1c6ffd640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1b40664a0 0x7fb1b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.622+0000 7fb1c6ffd640 1 -- 172.21.15.2:0/2362696038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fb1c0084200 con 0x7fb1d00ce720 2023-11-04T01:45:07.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.622+0000 7fb1d63d8640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1b40664a0 0x7fb1b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.622+0000 7fb1d63d8640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1b40664a0 0x7fb1b4068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0b1000 tx=0x7fb1cc0aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.626+0000 7fb1c6ffd640 1 -- 172.21.15.2:0/2362696038 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb1c0051250 con 0x7fb1d00ce720 2023-11-04T01:45:07.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.778+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1d00744a0 con 0x7fb1d00ce720 2023-11-04T01:45:07.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1c6ffd640 1 -- 172.21.15.2:0/2362696038 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+21704 (secure 0 0 0) 0x7fb1c0054870 con 0x7fb1d00ce720 2023-11-04T01:45:07.783 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:07.784 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:05.086327+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:01.698844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:02.463984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1b40664a0 msgr2=0x7fb1b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1b40664a0 0x7fb1b4068960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0b1000 tx=0x7fb1cc0aa000 comp rx=0 tx=0).stop 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d00ce720 msgr2=0x7fb1d00c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d00ce720 0x7fb1d00c4a40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c410 tx=0x7fb1c000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 shutdown_connections 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb1b40664a0 0x7fb1b4068960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb1d0159a50 0x7fb1d0158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb1d00ce720 0x7fb1d00c4a40 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 --2- 172.21.15.2:0/2362696038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d006c1a0 0x7fb1d0155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 >> 172.21.15.2:0/2362696038 conn(0x7fb1d00cebb0 msgr2=0x7fb1d00cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 shutdown_connections 2023-11-04T01:45:07.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.782+0000 7fb1d863c640 1 -- 172.21.15.2:0/2362696038 wait complete. 2023-11-04T01:45:07.801 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:45:07.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:45:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f069b07a640 1 Processor -- start 2023-11-04T01:45:07.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f069b07a640 1 -- start start 2023-11-04T01:45:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f069b07a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 0x7f06940b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f069b07a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940b6070 con 0x7f06940d0ae0 2023-11-04T01:45:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f069b07a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940b8ed0 con 0x7f06940b4990 2023-11-04T01:45:07.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f069b07a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940d1ce0 con 0x7f06940d0690 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0699617640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f06940d0ae0 0x7f06940b6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40556/0 (socket says 172.21.15.2:40556) 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0699617640 1 -- 172.21.15.2:0/1632260423 learned_addr learned my addr 172.21.15.2:0/1632260423 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0693fff640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 0x7f06940b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700713601 0 0) 0x7f06940b6070 con 0x7f06940d0ae0 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f067c003530 con 0x7f06940d0ae0 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576402705 0 0) 0x7f06940b8ed0 con 0x7f06940b4990 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06940b6070 con 0x7f06940b4990 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2593813297 0 0) 0x7f067c003530 con 0x7f06940d0ae0 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 msgr2=0x7f06940b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 0x7f06940b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 >> v1:172.21.15.90:6789/0 conn(0x7f06940b4990 legacy=0x7f06940b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940d1fc0 con 0x7f06940d0ae0 2023-11-04T01:45:07.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f068c001980 con 0x7f06940d0ae0 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 >> v1:172.21.15.2:6789/0 conn(0x7f06940d0ae0 legacy=0x7f06940b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c003b40 0x7f067c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c0047d0 0x7f067c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 0x7f067c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940d1ce0 con 0x7f067c003b40 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c00ba40 con 0x7f067c0047d0 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c00bc00 con 0x7f06940d0690 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0698e16640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c003b40 0x7f067c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0693fff640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c0047d0 0x7f067c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0699617640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 0x7f067c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0698e16640 1 -- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 msgr2=0x7f067c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0698e16640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 0x7f067c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0698e16640 1 -- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c0047d0 msgr2=0x7f067c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:07.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0698e16640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c0047d0 0x7f067c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0698e16640 1 -- 172.21.15.2:0/1632260423 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c003530 con 0x7f067c003b40 2023-11-04T01:45:07.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.922+0000 7f0699617640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940d0690 0x7f067c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f0698e16640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c003b40 0x7f067c003f40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f06840018d0 tx=0x7f068401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc9df141f835f34 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840052d0 con 0x7f067c003b40 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684005450 con 0x7f067c003b40 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f06937fe640 1 -- 172.21.15.2:0/1632260423 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840a8930 con 0x7f067c003b40 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- 172.21.15.2:0/1632260423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c003b40 msgr2=0x7f067c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 --2- 172.21.15.2:0/1632260423 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f067c003b40 0x7f067c003f40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f06840018d0 tx=0x7f068401ecd0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f0699617640 1 -- 172.21.15.2:0/1632260423 reap_dead start 2023-11-04T01:45:07.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- 172.21.15.2:0/1632260423 shutdown_connections 2023-11-04T01:45:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- 172.21.15.2:0/1632260423 >> 172.21.15.2:0/1632260423 conn(0x7f06940cf990 msgr2=0x7f06940cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- 172.21.15.2:0/1632260423 shutdown_connections 2023-11-04T01:45:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- 172.21.15.2:0/1632260423 wait complete. 2023-11-04T01:45:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 Processor -- start 2023-11-04T01:45:07.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- start start 2023-11-04T01:45:07.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c003b40 0x7f06941582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f069415d4d0 0x7f069414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940b78c0 0x7f06940b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940b8260 con 0x7f069415d4d0 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069415eb40 con 0x7f067c003b40 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.926+0000 7f069b07a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069415ee20 con 0x7f06940b78c0 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f069415d4d0 0x7f069414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f069415d4d0 0x7f069414d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37652/0 (socket says 172.21.15.2:37652) 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 -- 172.21.15.2:0/1106936947 learned_addr learned my addr 172.21.15.2:0/1106936947 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0698e16640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c003b40 0x7f06941582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0699617640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940b78c0 0x7f06940b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 -- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940b78c0 msgr2=0x7f06940b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940b78c0 0x7f06940b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 -- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c003b40 msgr2=0x7f06941582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c003b40 0x7f06941582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 -- 172.21.15.2:0/1106936947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069415dce0 con 0x7f069415d4d0 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0693fff640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f069415d4d0 0x7f069414d2d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f06880115c0 tx=0x7f0688011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f06917fa640 1 -- 172.21.15.2:0/1106936947 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688004220 con 0x7f069415d4d0 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f06917fa640 1 -- 172.21.15.2:0/1106936947 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688004380 con 0x7f069415d4d0 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f06917fa640 1 -- 172.21.15.2:0/1106936947 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800f8f0 con 0x7f069415d4d0 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069415dfc0 con 0x7f069415d4d0 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069414d810 con 0x7f069415d4d0 2023-11-04T01:45:07.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06940744a0 con 0x7f069415d4d0 2023-11-04T01:45:07.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f06917fa640 1 -- 172.21.15.2:0/1106936947 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f068800fa50 con 0x7f069415d4d0 2023-11-04T01:45:07.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f06917fa640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06800664a0 0x7f0680068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:07.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f06917fa640 1 -- 172.21.15.2:0/1106936947 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f0688084450 con 0x7f069415d4d0 2023-11-04T01:45:07.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0698e16640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06800664a0 0x7f0680068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:07.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.930+0000 7f0698e16640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06800664a0 0x7f0680068960 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f06840b0000 tx=0x7f06840aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:07.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:07.934+0000 7f06917fa640 1 -- 172.21.15.2:0/1106936947 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0688051530 con 0x7f069415d4d0 2023-11-04T01:45:08.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.090+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06940d2580 con 0x7f06800664a0 2023-11-04T01:45:08.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.130+0000 7f06917fa640 1 -- 172.21.15.2:0/1106936947 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+530102 (secure 0 0 0) 0x7f06840a86f0 con 0x7f06800664a0 2023-11-04T01:45:08.138 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:08.142 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06800664a0 msgr2=0x7f0680068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06800664a0 0x7f0680068960 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f06840b0000 tx=0x7f06840aa070 comp rx=0 tx=0).stop 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f069415d4d0 msgr2=0x7f069414d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f069415d4d0 0x7f069414d2d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f06880115c0 tx=0x7f0688011a80 comp rx=0 tx=0).stop 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 shutdown_connections 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06800664a0 0x7f0680068960 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f06940b78c0 0x7f06940b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f069415d4d0 0x7f069414d2d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 --2- 172.21.15.2:0/1106936947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f067c003b40 0x7f06941582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 >> 172.21.15.2:0/1106936947 conn(0x7f06940cf990 msgr2=0x7f06940b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 shutdown_connections 2023-11-04T01:45:08.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.134+0000 7f069b07a640 1 -- 172.21.15.2:0/1106936947 wait complete. 2023-11-04T01:45:08.158 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-11-04T01:45:06.830716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":329,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249844,"kb_used_data":8716,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724876,"statfs":{"total":773094113280,"available":772838273024,"internally_reserved":0,"allocated":8925184,"data_stored":4709309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.746326"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.412339+0000","last_change":"2023-11-04T01:45:04.137313+0000","last_active":"2023-11-04T01:45:05.412339+0000","last_peered":"2023-11-04T01:45:05.412339+0000","last_clean":"2023-11-04T01:45:05.412339+0000","last_became_active":"2023-11-04T01:45:04.137022+0000","last_became_peered":"2023-11-04T01:45:04.137022+0000","last_unstale":"2023-11-04T01:45:05.412339+0000","last_undegraded":"2023-11-04T01:45:05.412339+0000","last_fullsized":"2023-11-04T01:45:05.412339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433853+0000","last_change":"2023-11-04T01:45:04.143130+0000","last_active":"2023-11-04T01:45:06.433853+0000","last_peered":"2023-11-04T01:45:06.433853+0000","last_clean":"2023-11-04T01:45:06.433853+0000","last_became_active":"2023-11-04T01:45:04.142401+0000","last_became_peered":"2023-11-04T01:45:04.142401+0000","last_unstale":"2023-11-04T01:45:06.433853+0000","last_undegraded":"2023-11-04T01:45:06.433853+0000","last_fullsized":"2023-11-04T01:45:06.433853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:37:10.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.156825+0000","last_change":"2023-11-04T01:45:04.138676+0000","last_active":"2023-11-04T01:45:04.156825+0000","last_peered":"2023-11-04T01:45:04.156825+0000","last_clean":"2023-11-04T01:45:04.156825+0000","last_became_active":"2023-11-04T01:45:04.138143+0000","last_became_peered":"2023-11-04T01:45:04.138143+0000","last_unstale":"2023-11-04T01:45:04.156825+0000","last_undegraded":"2023-11-04T01:45:04.156825+0000","last_fullsized":"2023-11-04T01:45:04.156825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:01.542179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162037+0000","last_change":"2023-11-04T01:45:04.140204+0000","last_active":"2023-11-04T01:45:04.162037+0000","last_peered":"2023-11-04T01:45:04.162037+0000","last_clean":"2023-11-04T01:45:04.162037+0000","last_became_active":"2023-11-04T01:45:04.138955+0000","last_became_peered":"2023-11-04T01:45:04.138955+0000","last_unstale":"2023-11-04T01:45:04.162037+0000","last_undegraded":"2023-11-04T01:45:04.162037+0000","last_fullsized":"2023-11-04T01:45:04.162037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:12.630595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433288+0000","last_change":"2023-11-04T01:45:04.126630+0000","last_active":"2023-11-04T01:45:06.433288+0000","last_peered":"2023-11-04T01:45:06.433288+0000","last_clean":"2023-11-04T01:45:06.433288+0000","last_became_active":"2023-11-04T01:45:04.125343+0000","last_became_peered":"2023-11-04T01:45:04.125343+0000","last_unstale":"2023-11-04T01:45:06.433288+0000","last_undegraded":"2023-11-04T01:45:06.433288+0000","last_fullsized":"2023-11-04T01:45:06.433288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:50.290527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097101+0000","last_change":"2023-11-04T01:45:04.146656+0000","last_active":"2023-11-04T01:45:05.097101+0000","last_peered":"2023-11-04T01:45:05.097101+0000","last_clean":"2023-11-04T01:45:05.097101+0000","last_became_active":"2023-11-04T01:45:04.146370+0000","last_became_peered":"2023-11-04T01:45:04.146370+0000","last_unstale":"2023-11-04T01:45:05.097101+0000","last_undegraded":"2023-11-04T01:45:05.097101+0000","last_fullsized":"2023-11-04T01:45:05.097101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:28.104295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.094518+0000","last_change":"2023-11-04T01:45:04.161706+0000","last_active":"2023-11-04T01:45:05.094518+0000","last_peered":"2023-11-04T01:45:05.094518+0000","last_clean":"2023-11-04T01:45:05.094518+0000","last_became_active":"2023-11-04T01:45:04.161287+0000","last_became_peered":"2023-11-04T01:45:04.161287+0000","last_unstale":"2023-11-04T01:45:05.094518+0000","last_undegraded":"2023-11-04T01:45:05.094518+0000","last_fullsized":"2023-11-04T01:45:05.094518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:03.029985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096692+0000","last_change":"2023-11-04T01:45:04.155552+0000","last_active":"2023-11-04T01:45:05.096692+0000","last_peered":"2023-11-04T01:45:05.096692+0000","last_clean":"2023-11-04T01:45:05.096692+0000","last_became_active":"2023-11-04T01:45:04.155059+0000","last_became_peered":"2023-11-04T01:45:04.155059+0000","last_unstale":"2023-11-04T01:45:05.096692+0000","last_undegraded":"2023-11-04T01:45:05.096692+0000","last_fullsized":"2023-11-04T01:45:05.096692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:01.463285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.095972+0000","last_change":"2023-11-04T01:45:04.132384+0000","last_active":"2023-11-04T01:45:05.095972+0000","last_peered":"2023-11-04T01:45:05.095972+0000","last_clean":"2023-11-04T01:45:05.095972+0000","last_became_active":"2023-11-04T01:45:04.132006+0000","last_became_peered":"2023-11-04T01:45:04.132006+0000","last_unstale":"2023-11-04T01:45:05.095972+0000","last_undegraded":"2023-11-04T01:45:05.095972+0000","last_fullsized":"2023-11-04T01:45:05.095972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:16.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.161999+0000","last_change":"2023-11-04T01:45:04.139809+0000","last_active":"2023-11-04T01:45:04.161999+0000","last_peered":"2023-11-04T01:45:04.161999+0000","last_clean":"2023-11-04T01:45:04.161999+0000","last_became_active":"2023-11-04T01:45:04.139363+0000","last_became_peered":"2023-11-04T01:45:04.139363+0000","last_unstale":"2023-11-04T01:45:04.161999+0000","last_undegraded":"2023-11-04T01:45:04.161999+0000","last_fullsized":"2023-11-04T01:45:04.161999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:55:31.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096292+0000","last_change":"2023-11-04T01:45:04.150346+0000","last_active":"2023-11-04T01:45:05.096292+0000","last_peered":"2023-11-04T01:45:05.096292+0000","last_clean":"2023-11-04T01:45:05.096292+0000","last_became_active":"2023-11-04T01:45:04.149682+0000","last_became_peered":"2023-11-04T01:45:04.149682+0000","last_unstale":"2023-11-04T01:45:05.096292+0000","last_undegraded":"2023-11-04T01:45:05.096292+0000","last_fullsized":"2023-11-04T01:45:05.096292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:18.477727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.161973+0000","last_change":"2023-11-04T01:45:04.139649+0000","last_active":"2023-11-04T01:45:04.161973+0000","last_peered":"2023-11-04T01:45:04.161973+0000","last_clean":"2023-11-04T01:45:04.161973+0000","last_became_active":"2023-11-04T01:45:04.138190+0000","last_became_peered":"2023-11-04T01:45:04.138190+0000","last_unstale":"2023-11-04T01:45:04.161973+0000","last_undegraded":"2023-11-04T01:45:04.161973+0000","last_fullsized":"2023-11-04T01:45:04.161973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:49:56.709488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.134990+0000","last_change":"2023-11-04T01:45:04.130272+0000","last_active":"2023-11-04T01:45:04.134990+0000","last_peered":"2023-11-04T01:45:04.134990+0000","last_clean":"2023-11-04T01:45:04.134990+0000","last_became_active":"2023-11-04T01:45:04.129492+0000","last_became_peered":"2023-11-04T01:45:04.129492+0000","last_unstale":"2023-11-04T01:45:04.134990+0000","last_undegraded":"2023-11-04T01:45:04.134990+0000","last_fullsized":"2023-11-04T01:45:04.134990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:15.290471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098960+0000","last_change":"2023-11-04T01:45:04.139319+0000","last_active":"2023-11-04T01:45:05.098960+0000","last_peered":"2023-11-04T01:45:05.098960+0000","last_clean":"2023-11-04T01:45:05.098960+0000","last_became_active":"2023-11-04T01:45:04.139029+0000","last_became_peered":"2023-11-04T01:45:04.139029+0000","last_unstale":"2023-11-04T01:45:05.098960+0000","last_undegraded":"2023-11-04T01:45:05.098960+0000","last_fullsized":"2023-11-04T01:45:05.098960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:38.568242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.163548+0000","last_change":"2023-11-04T01:45:04.161102+0000","last_active":"2023-11-04T01:45:04.163548+0000","last_peered":"2023-11-04T01:45:04.163548+0000","last_clean":"2023-11-04T01:45:04.163548+0000","last_became_active":"2023-11-04T01:45:04.160667+0000","last_became_peered":"2023-11-04T01:45:04.160667+0000","last_unstale":"2023-11-04T01:45:04.163548+0000","last_undegraded":"2023-11-04T01:45:04.163548+0000","last_fullsized":"2023-11-04T01:45:04.163548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:36.269080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096690+0000","last_change":"2023-11-04T01:45:04.151346+0000","last_active":"2023-11-04T01:45:05.096690+0000","last_peered":"2023-11-04T01:45:05.096690+0000","last_clean":"2023-11-04T01:45:05.096690+0000","last_became_active":"2023-11-04T01:45:04.150036+0000","last_became_peered":"2023-11-04T01:45:04.150036+0000","last_unstale":"2023-11-04T01:45:05.096690+0000","last_undegraded":"2023-11-04T01:45:05.096690+0000","last_fullsized":"2023-11-04T01:45:05.096690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:49.677641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098875+0000","last_change":"2023-11-04T01:45:04.129075+0000","last_active":"2023-11-04T01:45:05.098875+0000","last_peered":"2023-11-04T01:45:05.098875+0000","last_clean":"2023-11-04T01:45:05.098875+0000","last_became_active":"2023-11-04T01:45:04.128760+0000","last_became_peered":"2023-11-04T01:45:04.128760+0000","last_unstale":"2023-11-04T01:45:05.098875+0000","last_undegraded":"2023-11-04T01:45:05.098875+0000","last_fullsized":"2023-11-04T01:45:05.098875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:32.603734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162055+0000","last_change":"2023-11-04T01:45:04.140458+0000","last_active":"2023-11-04T01:45:04.162055+0000","last_peered":"2023-11-04T01:45:04.162055+0000","last_clean":"2023-11-04T01:45:04.162055+0000","last_became_active":"2023-11-04T01:45:04.140072+0000","last_became_peered":"2023-11-04T01:45:04.140072+0000","last_unstale":"2023-11-04T01:45:04.162055+0000","last_undegraded":"2023-11-04T01:45:04.162055+0000","last_fullsized":"2023-11-04T01:45:04.162055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:13.343118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.149550+0000","last_change":"2023-11-04T01:45:04.142562+0000","last_active":"2023-11-04T01:45:04.149550+0000","last_peered":"2023-11-04T01:45:04.149550+0000","last_clean":"2023-11-04T01:45:04.149550+0000","last_became_active":"2023-11-04T01:45:04.142153+0000","last_became_peered":"2023-11-04T01:45:04.142153+0000","last_unstale":"2023-11-04T01:45:04.149550+0000","last_undegraded":"2023-11-04T01:45:04.149550+0000","last_fullsized":"2023-11-04T01:45:04.149550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:04.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097653+0000","last_change":"2023-11-04T01:45:04.145778+0000","last_active":"2023-11-04T01:45:05.097653+0000","last_peered":"2023-11-04T01:45:05.097653+0000","last_clean":"2023-11-04T01:45:05.097653+0000","last_became_active":"2023-11-04T01:45:04.145494+0000","last_became_peered":"2023-11-04T01:45:04.145494+0000","last_unstale":"2023-11-04T01:45:05.097653+0000","last_undegraded":"2023-11-04T01:45:05.097653+0000","last_fullsized":"2023-11-04T01:45:05.097653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:16.178541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433781+0000","last_change":"2023-11-04T01:45:04.126121+0000","last_active":"2023-11-04T01:45:06.433781+0000","last_peered":"2023-11-04T01:45:06.433781+0000","last_clean":"2023-11-04T01:45:06.433781+0000","last_became_active":"2023-11-04T01:45:04.122581+0000","last_became_peered":"2023-11-04T01:45:04.122581+0000","last_unstale":"2023-11-04T01:45:06.433781+0000","last_undegraded":"2023-11-04T01:45:06.433781+0000","last_fullsized":"2023-11-04T01:45:06.433781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:47.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135667+0000","last_change":"2023-11-04T01:45:04.125169+0000","last_active":"2023-11-04T01:45:04.135667+0000","last_peered":"2023-11-04T01:45:04.135667+0000","last_clean":"2023-11-04T01:45:04.135667+0000","last_became_active":"2023-11-04T01:45:04.124313+0000","last_became_peered":"2023-11-04T01:45:04.124313+0000","last_unstale":"2023-11-04T01:45:04.135667+0000","last_undegraded":"2023-11-04T01:45:04.135667+0000","last_fullsized":"2023-11-04T01:45:04.135667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:38.708741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432471+0000","last_change":"2023-11-04T01:45:04.143758+0000","last_active":"2023-11-04T01:45:06.432471+0000","last_peered":"2023-11-04T01:45:06.432471+0000","last_clean":"2023-11-04T01:45:06.432471+0000","last_became_active":"2023-11-04T01:45:04.142681+0000","last_became_peered":"2023-11-04T01:45:04.142681+0000","last_unstale":"2023-11-04T01:45:06.432471+0000","last_undegraded":"2023-11-04T01:45:06.432471+0000","last_fullsized":"2023-11-04T01:45:06.432471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:30:55.227050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410384+0000","last_change":"2023-11-04T01:45:04.140165+0000","last_active":"2023-11-04T01:45:05.410384+0000","last_peered":"2023-11-04T01:45:05.410384+0000","last_clean":"2023-11-04T01:45:05.410384+0000","last_became_active":"2023-11-04T01:45:04.139627+0000","last_became_peered":"2023-11-04T01:45:04.139627+0000","last_unstale":"2023-11-04T01:45:05.410384+0000","last_undegraded":"2023-11-04T01:45:05.410384+0000","last_fullsized":"2023-11-04T01:45:05.410384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:45.466522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.435056+0000","last_change":"2023-11-04T01:45:04.126493+0000","last_active":"2023-11-04T01:45:06.435056+0000","last_peered":"2023-11-04T01:45:06.435056+0000","last_clean":"2023-11-04T01:45:06.435056+0000","last_became_active":"2023-11-04T01:45:04.124915+0000","last_became_peered":"2023-11-04T01:45:04.124915+0000","last_unstale":"2023-11-04T01:45:06.435056+0000","last_undegraded":"2023-11-04T01:45:06.435056+0000","last_fullsized":"2023-11-04T01:45:06.435056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:15.290471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434269+0000","last_change":"2023-11-04T01:45:04.142458+0000","last_active":"2023-11-04T01:45:06.434269+0000","last_peered":"2023-11-04T01:45:06.434269+0000","last_clean":"2023-11-04T01:45:06.434269+0000","last_became_active":"2023-11-04T01:45:04.142104+0000","last_became_peered":"2023-11-04T01:45:04.142104+0000","last_unstale":"2023-11-04T01:45:06.434269+0000","last_undegraded":"2023-11-04T01:45:06.434269+0000","last_fullsized":"2023-11-04T01:45:06.434269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162084+0000","last_change":"2023-11-04T01:45:04.140415+0000","last_active":"2023-11-04T01:45:04.162084+0000","last_peered":"2023-11-04T01:45:04.162084+0000","last_clean":"2023-11-04T01:45:04.162084+0000","last_became_active":"2023-11-04T01:45:04.139829+0000","last_became_peered":"2023-11-04T01:45:04.139829+0000","last_unstale":"2023-11-04T01:45:04.162084+0000","last_undegraded":"2023-11-04T01:45:04.162084+0000","last_fullsized":"2023-11-04T01:45:04.162084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:28.104329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.125414+0000","last_change":"2023-11-04T01:45:04.119304+0000","last_active":"2023-11-04T01:45:04.125414+0000","last_peered":"2023-11-04T01:45:04.125414+0000","last_clean":"2023-11-04T01:45:04.125414+0000","last_became_active":"2023-11-04T01:45:04.118360+0000","last_became_peered":"2023-11-04T01:45:04.118360+0000","last_unstale":"2023-11-04T01:45:04.125414+0000","last_undegraded":"2023-11-04T01:45:04.125414+0000","last_fullsized":"2023-11-04T01:45:04.125414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433221+0000","last_change":"2023-11-04T01:45:04.154361+0000","last_active":"2023-11-04T01:45:06.433221+0000","last_peered":"2023-11-04T01:45:06.433221+0000","last_clean":"2023-11-04T01:45:06.433221+0000","last_became_active":"2023-11-04T01:45:04.152329+0000","last_became_peered":"2023-11-04T01:45:04.152329+0000","last_unstale":"2023-11-04T01:45:06.433221+0000","last_undegraded":"2023-11-04T01:45:06.433221+0000","last_fullsized":"2023-11-04T01:45:06.433221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:53:18.811573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432757+0000","last_change":"2023-11-04T01:45:04.132358+0000","last_active":"2023-11-04T01:45:06.432757+0000","last_peered":"2023-11-04T01:45:06.432757+0000","last_clean":"2023-11-04T01:45:06.432757+0000","last_became_active":"2023-11-04T01:45:04.132014+0000","last_became_peered":"2023-11-04T01:45:04.132014+0000","last_unstale":"2023-11-04T01:45:06.432757+0000","last_undegraded":"2023-11-04T01:45:06.432757+0000","last_fullsized":"2023-11-04T01:45:06.432757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:57.908229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.149647+0000","last_change":"2023-11-04T01:45:04.143659+0000","last_active":"2023-11-04T01:45:04.149647+0000","last_peered":"2023-11-04T01:45:04.149647+0000","last_clean":"2023-11-04T01:45:04.149647+0000","last_became_active":"2023-11-04T01:45:04.143016+0000","last_became_peered":"2023-11-04T01:45:04.143016+0000","last_unstale":"2023-11-04T01:45:04.149647+0000","last_undegraded":"2023-11-04T01:45:04.149647+0000","last_fullsized":"2023-11-04T01:45:04.149647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097072+0000","last_change":"2023-11-04T01:45:04.151627+0000","last_active":"2023-11-04T01:45:05.097072+0000","last_peered":"2023-11-04T01:45:05.097072+0000","last_clean":"2023-11-04T01:45:05.097072+0000","last_became_active":"2023-11-04T01:45:04.150690+0000","last_became_peered":"2023-11-04T01:45:04.150690+0000","last_unstale":"2023-11-04T01:45:05.097072+0000","last_undegraded":"2023-11-04T01:45:05.097072+0000","last_fullsized":"2023-11-04T01:45:05.097072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:59.420998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434866+0000","last_change":"2023-11-04T01:45:04.127937+0000","last_active":"2023-11-04T01:45:06.434866+0000","last_peered":"2023-11-04T01:45:06.434866+0000","last_clean":"2023-11-04T01:45:06.434866+0000","last_became_active":"2023-11-04T01:45:04.127101+0000","last_became_peered":"2023-11-04T01:45:04.127101+0000","last_unstale":"2023-11-04T01:45:06.434866+0000","last_undegraded":"2023-11-04T01:45:06.434866+0000","last_fullsized":"2023-11-04T01:45:06.434866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411465+0000","last_change":"2023-11-04T01:45:03.136311+0000","last_active":"2023-11-04T01:45:05.411465+0000","last_peered":"2023-11-04T01:45:05.411465+0000","last_clean":"2023-11-04T01:45:05.411465+0000","last_became_active":"2023-11-04T01:45:03.133442+0000","last_became_peered":"2023-11-04T01:45:03.133442+0000","last_unstale":"2023-11-04T01:45:05.411465+0000","last_undegraded":"2023-11-04T01:45:05.411465+0000","last_fullsized":"2023-11-04T01:45:05.411465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:27.353924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126757+0000","last_change":"2023-11-04T01:44:41.931890+0000","last_active":"2023-11-04T01:45:04.126757+0000","last_peered":"2023-11-04T01:45:04.126757+0000","last_clean":"2023-11-04T01:45:04.126757+0000","last_became_active":"2023-11-04T01:44:41.931428+0000","last_became_peered":"2023-11-04T01:44:41.931428+0000","last_unstale":"2023-11-04T01:45:04.126757+0000","last_undegraded":"2023-11-04T01:45:04.126757+0000","last_fullsized":"2023-11-04T01:45:04.126757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:35.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109002+0000","last_change":"2023-11-04T01:44:43.171663+0000","last_active":"2023-11-04T01:45:03.109002+0000","last_peered":"2023-11-04T01:45:03.109002+0000","last_clean":"2023-11-04T01:45:03.109002+0000","last_became_active":"2023-11-04T01:44:40.925496+0000","last_became_peered":"2023-11-04T01:44:40.925496+0000","last_unstale":"2023-11-04T01:45:03.109002+0000","last_undegraded":"2023-11-04T01:45:03.109002+0000","last_fullsized":"2023-11-04T01:45:03.109002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:59.630466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987024,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.104264+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:45:04.104264+0000","last_peered":"2023-11-04T01:45:04.104264+0000","last_clean":"2023-11-04T01:45:04.104264+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:45:04.104264+0000","last_undegraded":"2023-11-04T01:45:04.104264+0000","last_fullsized":"2023-11-04T01:45:04.104264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.128223+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:45:04.128223+0000","last_peered":"2023-11-04T01:45:04.128223+0000","last_clean":"2023-11-04T01:45:04.128223+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:45:04.128223+0000","last_undegraded":"2023-11-04T01:45:04.128223+0000","last_fullsized":"2023-11-04T01:45:04.128223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.148087+0000","last_change":"2023-11-04T01:45:04.140486+0000","last_active":"2023-11-04T01:45:04.148087+0000","last_peered":"2023-11-04T01:45:04.148087+0000","last_clean":"2023-11-04T01:45:04.148087+0000","last_became_active":"2023-11-04T01:45:04.140053+0000","last_became_peered":"2023-11-04T01:45:04.140053+0000","last_unstale":"2023-11-04T01:45:04.148087+0000","last_undegraded":"2023-11-04T01:45:04.148087+0000","last_fullsized":"2023-11-04T01:45:04.148087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097849+0000","last_change":"2023-11-04T01:45:03.111019+0000","last_active":"2023-11-04T01:45:05.097849+0000","last_peered":"2023-11-04T01:45:05.097849+0000","last_clean":"2023-11-04T01:45:05.097849+0000","last_became_active":"2023-11-04T01:45:03.110118+0000","last_became_peered":"2023-11-04T01:45:03.110118+0000","last_unstale":"2023-11-04T01:45:05.097849+0000","last_undegraded":"2023-11-04T01:45:05.097849+0000","last_fullsized":"2023-11-04T01:45:05.097849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:09.334597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127152+0000","last_change":"2023-11-04T01:44:41.934578+0000","last_active":"2023-11-04T01:45:03.127152+0000","last_peered":"2023-11-04T01:45:03.127152+0000","last_clean":"2023-11-04T01:45:03.127152+0000","last_became_active":"2023-11-04T01:44:41.932591+0000","last_became_peered":"2023-11-04T01:44:41.932591+0000","last_unstale":"2023-11-04T01:45:03.127152+0000","last_undegraded":"2023-11-04T01:45:03.127152+0000","last_fullsized":"2023-11-04T01:45:03.127152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:29.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.096722+0000","last_change":"2023-11-04T01:44:42.906847+0000","last_active":"2023-11-04T01:45:04.096722+0000","last_peered":"2023-11-04T01:45:04.096722+0000","last_clean":"2023-11-04T01:45:04.096722+0000","last_became_active":"2023-11-04T01:44:40.908611+0000","last_became_peered":"2023-11-04T01:44:40.908611+0000","last_unstale":"2023-11-04T01:45:04.096722+0000","last_undegraded":"2023-11-04T01:45:04.096722+0000","last_fullsized":"2023-11-04T01:45:04.096722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:44.272984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044006599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.121623+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:45:04.121623+0000","last_peered":"2023-11-04T01:45:04.121623+0000","last_clean":"2023-11-04T01:45:04.121623+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:45:04.121623+0000","last_undegraded":"2023-11-04T01:45:04.121623+0000","last_fullsized":"2023-11-04T01:45:04.121623+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411706+0000","last_change":"2023-11-04T01:45:04.156985+0000","last_active":"2023-11-04T01:45:05.411706+0000","last_peered":"2023-11-04T01:45:05.411706+0000","last_clean":"2023-11-04T01:45:05.411706+0000","last_became_active":"2023-11-04T01:45:04.156495+0000","last_became_peered":"2023-11-04T01:45:04.156495+0000","last_unstale":"2023-11-04T01:45:05.411706+0000","last_undegraded":"2023-11-04T01:45:05.411706+0000","last_fullsized":"2023-11-04T01:45:05.411706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:57.946591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093859+0000","last_change":"2023-11-04T01:45:03.113950+0000","last_active":"2023-11-04T01:45:04.093859+0000","last_peered":"2023-11-04T01:45:04.093859+0000","last_clean":"2023-11-04T01:45:04.093859+0000","last_became_active":"2023-11-04T01:45:03.112073+0000","last_became_peered":"2023-11-04T01:45:03.112073+0000","last_unstale":"2023-11-04T01:45:04.093859+0000","last_undegraded":"2023-11-04T01:45:04.093859+0000","last_fullsized":"2023-11-04T01:45:04.093859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:46.142793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100214+0000","last_change":"2023-11-04T01:44:41.924659+0000","last_active":"2023-11-04T01:45:04.100214+0000","last_peered":"2023-11-04T01:45:04.100214+0000","last_clean":"2023-11-04T01:45:04.100214+0000","last_became_active":"2023-11-04T01:44:41.923887+0000","last_became_peered":"2023-11-04T01:44:41.923887+0000","last_unstale":"2023-11-04T01:45:04.100214+0000","last_undegraded":"2023-11-04T01:45:04.100214+0000","last_fullsized":"2023-11-04T01:45:04.100214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:59.201022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.096174+0000","last_change":"2023-11-04T01:44:42.906331+0000","last_active":"2023-11-04T01:45:04.096174+0000","last_peered":"2023-11-04T01:45:04.096174+0000","last_clean":"2023-11-04T01:45:04.096174+0000","last_became_active":"2023-11-04T01:44:40.923564+0000","last_became_peered":"2023-11-04T01:44:40.923564+0000","last_unstale":"2023-11-04T01:45:04.096174+0000","last_undegraded":"2023-11-04T01:45:04.096174+0000","last_fullsized":"2023-11-04T01:45:04.096174+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:58.191219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038764860000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093676+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:45:04.093676+0000","last_peered":"2023-11-04T01:45:04.093676+0000","last_clean":"2023-11-04T01:45:04.093676+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:45:04.093676+0000","last_undegraded":"2023-11-04T01:45:04.093676+0000","last_fullsized":"2023-11-04T01:45:04.093676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098131+0000","last_change":"2023-11-04T01:45:04.129183+0000","last_active":"2023-11-04T01:45:05.098131+0000","last_peered":"2023-11-04T01:45:05.098131+0000","last_clean":"2023-11-04T01:45:05.098131+0000","last_became_active":"2023-11-04T01:45:04.128483+0000","last_became_peered":"2023-11-04T01:45:04.128483+0000","last_unstale":"2023-11-04T01:45:05.098131+0000","last_undegraded":"2023-11-04T01:45:05.098131+0000","last_fullsized":"2023-11-04T01:45:05.098131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:38.902182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.094828+0000","last_change":"2023-11-04T01:45:03.147853+0000","last_active":"2023-11-04T01:45:05.094828+0000","last_peered":"2023-11-04T01:45:05.094828+0000","last_clean":"2023-11-04T01:45:05.094828+0000","last_became_active":"2023-11-04T01:45:03.147455+0000","last_became_peered":"2023-11-04T01:45:03.147455+0000","last_unstale":"2023-11-04T01:45:05.094828+0000","last_undegraded":"2023-11-04T01:45:05.094828+0000","last_fullsized":"2023-11-04T01:45:05.094828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:26.009816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.113795+0000","last_change":"2023-11-04T01:44:41.933323+0000","last_active":"2023-11-04T01:45:04.113795+0000","last_peered":"2023-11-04T01:45:04.113795+0000","last_clean":"2023-11-04T01:45:04.113795+0000","last_became_active":"2023-11-04T01:44:41.932545+0000","last_became_peered":"2023-11-04T01:44:41.932545+0000","last_unstale":"2023-11-04T01:45:04.113795+0000","last_undegraded":"2023-11-04T01:45:04.113795+0000","last_fullsized":"2023-11-04T01:45:04.113795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:28.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.129173+0000","last_change":"2023-11-04T01:44:43.112250+0000","last_active":"2023-11-04T01:45:03.129173+0000","last_peered":"2023-11-04T01:45:03.129173+0000","last_clean":"2023-11-04T01:45:03.129173+0000","last_became_active":"2023-11-04T01:44:40.940763+0000","last_became_peered":"2023-11-04T01:44:40.940763+0000","last_unstale":"2023-11-04T01:45:03.129173+0000","last_undegraded":"2023-11-04T01:45:03.129173+0000","last_fullsized":"2023-11-04T01:45:03.129173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:13.065066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127390+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:45:03.127390+0000","last_peered":"2023-11-04T01:45:03.127390+0000","last_clean":"2023-11-04T01:45:03.127390+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:45:03.127390+0000","last_undegraded":"2023-11-04T01:45:03.127390+0000","last_fullsized":"2023-11-04T01:45:03.127390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.099436+0000","last_change":"2023-11-04T01:45:04.149287+0000","last_active":"2023-11-04T01:45:05.099436+0000","last_peered":"2023-11-04T01:45:05.099436+0000","last_clean":"2023-11-04T01:45:05.099436+0000","last_became_active":"2023-11-04T01:45:04.148834+0000","last_became_peered":"2023-11-04T01:45:04.148834+0000","last_unstale":"2023-11-04T01:45:05.099436+0000","last_undegraded":"2023-11-04T01:45:05.099436+0000","last_fullsized":"2023-11-04T01:45:05.099436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:30.710270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097687+0000","last_change":"2023-11-04T01:45:03.136686+0000","last_active":"2023-11-04T01:45:05.097687+0000","last_peered":"2023-11-04T01:45:05.097687+0000","last_clean":"2023-11-04T01:45:05.097687+0000","last_became_active":"2023-11-04T01:45:03.134854+0000","last_became_peered":"2023-11-04T01:45:03.134854+0000","last_unstale":"2023-11-04T01:45:05.097687+0000","last_undegraded":"2023-11-04T01:45:05.097687+0000","last_fullsized":"2023-11-04T01:45:05.097687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:48.330977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.125933+0000","last_change":"2023-11-04T01:44:41.933572+0000","last_active":"2023-11-04T01:45:03.125933+0000","last_peered":"2023-11-04T01:45:03.125933+0000","last_clean":"2023-11-04T01:45:03.125933+0000","last_became_active":"2023-11-04T01:44:41.932825+0000","last_became_peered":"2023-11-04T01:44:41.932825+0000","last_unstale":"2023-11-04T01:45:03.125933+0000","last_undegraded":"2023-11-04T01:45:03.125933+0000","last_fullsized":"2023-11-04T01:45:03.125933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:17.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127308+0000","last_change":"2023-11-04T01:44:43.112178+0000","last_active":"2023-11-04T01:45:03.127308+0000","last_peered":"2023-11-04T01:45:03.127308+0000","last_clean":"2023-11-04T01:45:03.127308+0000","last_became_active":"2023-11-04T01:44:40.940919+0000","last_became_peered":"2023-11-04T01:44:40.940919+0000","last_unstale":"2023-11-04T01:45:03.127308+0000","last_undegraded":"2023-11-04T01:45:03.127308+0000","last_fullsized":"2023-11-04T01:45:03.127308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:26.706337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015529090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100800+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:45:04.100800+0000","last_peered":"2023-11-04T01:45:04.100800+0000","last_clean":"2023-11-04T01:45:04.100800+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:45:04.100800+0000","last_undegraded":"2023-11-04T01:45:04.100800+0000","last_fullsized":"2023-11-04T01:45:04.100800+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433943+0000","last_change":"2023-11-04T01:45:04.123063+0000","last_active":"2023-11-04T01:45:06.433943+0000","last_peered":"2023-11-04T01:45:06.433943+0000","last_clean":"2023-11-04T01:45:06.433943+0000","last_became_active":"2023-11-04T01:45:04.122186+0000","last_became_peered":"2023-11-04T01:45:04.122186+0000","last_unstale":"2023-11-04T01:45:06.433943+0000","last_undegraded":"2023-11-04T01:45:06.433943+0000","last_fullsized":"2023-11-04T01:45:06.433943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:57.946591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098532+0000","last_change":"2023-11-04T01:45:03.121095+0000","last_active":"2023-11-04T01:45:05.098532+0000","last_peered":"2023-11-04T01:45:05.098532+0000","last_clean":"2023-11-04T01:45:05.098532+0000","last_became_active":"2023-11-04T01:45:03.120657+0000","last_became_peered":"2023-11-04T01:45:03.120657+0000","last_unstale":"2023-11-04T01:45:05.098532+0000","last_undegraded":"2023-11-04T01:45:05.098532+0000","last_fullsized":"2023-11-04T01:45:05.098532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:03.785044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127508+0000","last_change":"2023-11-04T01:44:41.944543+0000","last_active":"2023-11-04T01:45:03.127508+0000","last_peered":"2023-11-04T01:45:03.127508+0000","last_clean":"2023-11-04T01:45:03.127508+0000","last_became_active":"2023-11-04T01:44:41.943902+0000","last_became_peered":"2023-11-04T01:44:41.943902+0000","last_unstale":"2023-11-04T01:45:03.127508+0000","last_undegraded":"2023-11-04T01:45:03.127508+0000","last_fullsized":"2023-11-04T01:45:03.127508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:57.847851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101860+0000","last_change":"2023-11-04T01:44:43.177318+0000","last_active":"2023-11-04T01:45:04.101860+0000","last_peered":"2023-11-04T01:45:04.101860+0000","last_clean":"2023-11-04T01:45:04.101860+0000","last_became_active":"2023-11-04T01:44:40.940689+0000","last_became_peered":"2023-11-04T01:44:40.940689+0000","last_unstale":"2023-11-04T01:45:04.101860+0000","last_undegraded":"2023-11-04T01:45:04.101860+0000","last_fullsized":"2023-11-04T01:45:04.101860+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:28.637882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033848720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106487+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:45:03.106487+0000","last_peered":"2023-11-04T01:45:03.106487+0000","last_clean":"2023-11-04T01:45:03.106487+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:45:03.106487+0000","last_undegraded":"2023-11-04T01:45:03.106487+0000","last_fullsized":"2023-11-04T01:45:03.106487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126984+0000","last_change":"2023-11-04T01:45:04.122667+0000","last_active":"2023-11-04T01:45:04.126984+0000","last_peered":"2023-11-04T01:45:04.126984+0000","last_clean":"2023-11-04T01:45:04.126984+0000","last_became_active":"2023-11-04T01:45:04.121928+0000","last_became_peered":"2023-11-04T01:45:04.121928+0000","last_unstale":"2023-11-04T01:45:04.126984+0000","last_undegraded":"2023-11-04T01:45:04.126984+0000","last_fullsized":"2023-11-04T01:45:04.126984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:50.290527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.150350+0000","last_change":"2023-11-04T01:45:03.113924+0000","last_active":"2023-11-04T01:45:04.150350+0000","last_peered":"2023-11-04T01:45:04.150350+0000","last_clean":"2023-11-04T01:45:04.150350+0000","last_became_active":"2023-11-04T01:45:03.113456+0000","last_became_peered":"2023-11-04T01:45:03.113456+0000","last_unstale":"2023-11-04T01:45:04.150350+0000","last_undegraded":"2023-11-04T01:45:04.150350+0000","last_fullsized":"2023-11-04T01:45:04.150350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:05:38.080406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.129143+0000","last_change":"2023-11-04T01:44:41.934066+0000","last_active":"2023-11-04T01:45:03.129143+0000","last_peered":"2023-11-04T01:45:03.129143+0000","last_clean":"2023-11-04T01:45:03.129143+0000","last_became_active":"2023-11-04T01:44:41.933308+0000","last_became_peered":"2023-11-04T01:44:41.933308+0000","last_unstale":"2023-11-04T01:45:03.129143+0000","last_undegraded":"2023-11-04T01:45:03.129143+0000","last_fullsized":"2023-11-04T01:45:03.129143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:36.172813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.117291+0000","last_change":"2023-11-04T01:44:42.903075+0000","last_active":"2023-11-04T01:45:04.117291+0000","last_peered":"2023-11-04T01:45:04.117291+0000","last_clean":"2023-11-04T01:45:04.117291+0000","last_became_active":"2023-11-04T01:44:40.942840+0000","last_became_peered":"2023-11-04T01:44:40.942840+0000","last_unstale":"2023-11-04T01:45:04.117291+0000","last_undegraded":"2023-11-04T01:45:04.117291+0000","last_fullsized":"2023-11-04T01:45:04.117291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:04.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015750029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127719+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:45:03.127719+0000","last_peered":"2023-11-04T01:45:03.127719+0000","last_clean":"2023-11-04T01:45:03.127719+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:45:03.127719+0000","last_undegraded":"2023-11-04T01:45:03.127719+0000","last_fullsized":"2023-11-04T01:45:03.127719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096282+0000","last_change":"2023-11-04T01:45:04.131711+0000","last_active":"2023-11-04T01:45:05.096282+0000","last_peered":"2023-11-04T01:45:05.096282+0000","last_clean":"2023-11-04T01:45:05.096282+0000","last_became_active":"2023-11-04T01:45:04.130929+0000","last_became_peered":"2023-11-04T01:45:04.130929+0000","last_unstale":"2023-11-04T01:45:05.096282+0000","last_undegraded":"2023-11-04T01:45:05.096282+0000","last_fullsized":"2023-11-04T01:45:05.096282+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:46.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.099241+0000","last_change":"2023-11-04T01:45:03.120950+0000","last_active":"2023-11-04T01:45:05.099241+0000","last_peered":"2023-11-04T01:45:05.099241+0000","last_clean":"2023-11-04T01:45:05.099241+0000","last_became_active":"2023-11-04T01:45:03.120667+0000","last_became_peered":"2023-11-04T01:45:03.120667+0000","last_unstale":"2023-11-04T01:45:05.099241+0000","last_undegraded":"2023-11-04T01:45:05.099241+0000","last_fullsized":"2023-11-04T01:45:05.099241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:38.603775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.128013+0000","last_change":"2023-11-04T01:44:41.918892+0000","last_active":"2023-11-04T01:45:04.128013+0000","last_peered":"2023-11-04T01:45:04.128013+0000","last_clean":"2023-11-04T01:45:04.128013+0000","last_became_active":"2023-11-04T01:44:41.917911+0000","last_became_peered":"2023-11-04T01:44:41.917911+0000","last_unstale":"2023-11-04T01:45:04.128013+0000","last_undegraded":"2023-11-04T01:45:04.128013+0000","last_fullsized":"2023-11-04T01:45:04.128013+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:53.093358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.104189+0000","last_change":"2023-11-04T01:44:43.177231+0000","last_active":"2023-11-04T01:45:04.104189+0000","last_peered":"2023-11-04T01:45:04.104189+0000","last_clean":"2023-11-04T01:45:04.104189+0000","last_became_active":"2023-11-04T01:44:40.929373+0000","last_became_peered":"2023-11-04T01:44:40.929373+0000","last_unstale":"2023-11-04T01:45:04.104189+0000","last_undegraded":"2023-11-04T01:45:04.104189+0000","last_fullsized":"2023-11-04T01:45:04.104189+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:03.457810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005564182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094642+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:45:04.094642+0000","last_peered":"2023-11-04T01:45:04.094642+0000","last_clean":"2023-11-04T01:45:04.094642+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:45:04.094642+0000","last_undegraded":"2023-11-04T01:45:04.094642+0000","last_fullsized":"2023-11-04T01:45:04.094642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135564+0000","last_change":"2023-11-04T01:45:04.124512+0000","last_active":"2023-11-04T01:45:04.135564+0000","last_peered":"2023-11-04T01:45:04.135564+0000","last_clean":"2023-11-04T01:45:04.135564+0000","last_became_active":"2023-11-04T01:45:04.123649+0000","last_became_peered":"2023-11-04T01:45:04.123649+0000","last_unstale":"2023-11-04T01:45:04.135564+0000","last_undegraded":"2023-11-04T01:45:04.135564+0000","last_fullsized":"2023-11-04T01:45:04.135564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432327+0000","last_change":"2023-11-04T01:45:03.131113+0000","last_active":"2023-11-04T01:45:06.432327+0000","last_peered":"2023-11-04T01:45:06.432327+0000","last_clean":"2023-11-04T01:45:06.432327+0000","last_became_active":"2023-11-04T01:45:03.130641+0000","last_became_peered":"2023-11-04T01:45:03.130641+0000","last_unstale":"2023-11-04T01:45:06.432327+0000","last_undegraded":"2023-11-04T01:45:06.432327+0000","last_fullsized":"2023-11-04T01:45:06.432327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:51.329197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093302+0000","last_change":"2023-11-04T01:44:41.918887+0000","last_active":"2023-11-04T01:45:04.093302+0000","last_peered":"2023-11-04T01:45:04.093302+0000","last_clean":"2023-11-04T01:45:04.093302+0000","last_became_active":"2023-11-04T01:44:41.918464+0000","last_became_peered":"2023-11-04T01:44:41.918464+0000","last_unstale":"2023-11-04T01:45:04.093302+0000","last_undegraded":"2023-11-04T01:45:04.093302+0000","last_fullsized":"2023-11-04T01:45:04.093302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:59.577071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.108093+0000","last_change":"2023-11-04T01:44:43.174324+0000","last_active":"2023-11-04T01:45:04.108093+0000","last_peered":"2023-11-04T01:45:04.108093+0000","last_clean":"2023-11-04T01:45:04.108093+0000","last_became_active":"2023-11-04T01:44:40.924963+0000","last_became_peered":"2023-11-04T01:44:40.924963+0000","last_unstale":"2023-11-04T01:45:04.108093+0000","last_undegraded":"2023-11-04T01:45:04.108093+0000","last_fullsized":"2023-11-04T01:45:04.108093+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:49:16.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016466950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094446+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:45:04.094446+0000","last_peered":"2023-11-04T01:45:04.094446+0000","last_clean":"2023-11-04T01:45:04.094446+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:45:04.094446+0000","last_undegraded":"2023-11-04T01:45:04.094446+0000","last_fullsized":"2023-11-04T01:45:04.094446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097774+0000","last_change":"2023-11-04T01:45:04.145720+0000","last_active":"2023-11-04T01:45:05.097774+0000","last_peered":"2023-11-04T01:45:05.097774+0000","last_clean":"2023-11-04T01:45:05.097774+0000","last_became_active":"2023-11-04T01:45:04.145429+0000","last_became_peered":"2023-11-04T01:45:04.145429+0000","last_unstale":"2023-11-04T01:45:05.097774+0000","last_undegraded":"2023-11-04T01:45:05.097774+0000","last_fullsized":"2023-11-04T01:45:05.097774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:51.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432538+0000","last_change":"2023-11-04T01:45:03.117374+0000","last_active":"2023-11-04T01:45:06.432538+0000","last_peered":"2023-11-04T01:45:06.432538+0000","last_clean":"2023-11-04T01:45:06.432538+0000","last_became_active":"2023-11-04T01:45:03.116962+0000","last_became_peered":"2023-11-04T01:45:03.116962+0000","last_unstale":"2023-11-04T01:45:06.432538+0000","last_undegraded":"2023-11-04T01:45:06.432538+0000","last_fullsized":"2023-11-04T01:45:06.432538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:21.825258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103488+0000","last_change":"2023-11-04T01:44:41.929589+0000","last_active":"2023-11-04T01:45:04.103488+0000","last_peered":"2023-11-04T01:45:04.103488+0000","last_clean":"2023-11-04T01:45:04.103488+0000","last_became_active":"2023-11-04T01:44:41.929209+0000","last_became_peered":"2023-11-04T01:44:41.929209+0000","last_unstale":"2023-11-04T01:45:04.103488+0000","last_undegraded":"2023-11-04T01:45:04.103488+0000","last_fullsized":"2023-11-04T01:45:04.103488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:56.528258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106333+0000","last_change":"2023-11-04T01:44:43.175322+0000","last_active":"2023-11-04T01:45:03.106333+0000","last_peered":"2023-11-04T01:45:03.106333+0000","last_clean":"2023-11-04T01:45:03.106333+0000","last_became_active":"2023-11-04T01:44:40.931389+0000","last_became_peered":"2023-11-04T01:44:40.931389+0000","last_unstale":"2023-11-04T01:45:03.106333+0000","last_undegraded":"2023-11-04T01:45:03.106333+0000","last_fullsized":"2023-11-04T01:45:03.106333+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022947649999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116090+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:45:04.116090+0000","last_peered":"2023-11-04T01:45:04.116090+0000","last_clean":"2023-11-04T01:45:04.116090+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:45:04.116090+0000","last_undegraded":"2023-11-04T01:45:04.116090+0000","last_fullsized":"2023-11-04T01:45:04.116090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097440+0000","last_change":"2023-11-04T01:45:04.144745+0000","last_active":"2023-11-04T01:45:05.097440+0000","last_peered":"2023-11-04T01:45:05.097440+0000","last_clean":"2023-11-04T01:45:05.097440+0000","last_became_active":"2023-11-04T01:45:04.129378+0000","last_became_peered":"2023-11-04T01:45:04.129378+0000","last_unstale":"2023-11-04T01:45:05.097440+0000","last_undegraded":"2023-11-04T01:45:05.097440+0000","last_fullsized":"2023-11-04T01:45:05.097440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.109383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411619+0000","last_change":"2023-11-04T01:45:03.144010+0000","last_active":"2023-11-04T01:45:05.411619+0000","last_peered":"2023-11-04T01:45:05.411619+0000","last_clean":"2023-11-04T01:45:05.411619+0000","last_became_active":"2023-11-04T01:45:03.143319+0000","last_became_peered":"2023-11-04T01:45:03.143319+0000","last_unstale":"2023-11-04T01:45:05.411619+0000","last_undegraded":"2023-11-04T01:45:05.411619+0000","last_fullsized":"2023-11-04T01:45:05.411619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:48.392129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109407+0000","last_change":"2023-11-04T01:44:41.935051+0000","last_active":"2023-11-04T01:45:03.109407+0000","last_peered":"2023-11-04T01:45:03.109407+0000","last_clean":"2023-11-04T01:45:03.109407+0000","last_became_active":"2023-11-04T01:44:41.934245+0000","last_became_peered":"2023-11-04T01:44:41.934245+0000","last_unstale":"2023-11-04T01:45:03.109407+0000","last_undegraded":"2023-11-04T01:45:03.109407+0000","last_fullsized":"2023-11-04T01:45:03.109407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:58.744375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101655+0000","last_change":"2023-11-04T01:44:43.174084+0000","last_active":"2023-11-04T01:45:04.101655+0000","last_peered":"2023-11-04T01:45:04.101655+0000","last_clean":"2023-11-04T01:45:04.101655+0000","last_became_active":"2023-11-04T01:44:40.923078+0000","last_became_peered":"2023-11-04T01:44:40.923078+0000","last_unstale":"2023-11-04T01:45:04.101655+0000","last_undegraded":"2023-11-04T01:45:04.101655+0000","last_fullsized":"2023-11-04T01:45:04.101655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:30.967677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015459650000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.120650+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:45:04.120650+0000","last_peered":"2023-11-04T01:45:04.120650+0000","last_clean":"2023-11-04T01:45:04.120650+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:45:04.120650+0000","last_undegraded":"2023-11-04T01:45:04.120650+0000","last_fullsized":"2023-11-04T01:45:04.120650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.163393+0000","last_change":"2023-11-04T01:45:04.155555+0000","last_active":"2023-11-04T01:45:04.163393+0000","last_peered":"2023-11-04T01:45:04.163393+0000","last_clean":"2023-11-04T01:45:04.163393+0000","last_became_active":"2023-11-04T01:45:04.154964+0000","last_became_peered":"2023-11-04T01:45:04.154964+0000","last_unstale":"2023-11-04T01:45:04.163393+0000","last_undegraded":"2023-11-04T01:45:04.163393+0000","last_fullsized":"2023-11-04T01:45:04.163393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:40.511964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432872+0000","last_change":"2023-11-04T01:45:03.119062+0000","last_active":"2023-11-04T01:45:06.432872+0000","last_peered":"2023-11-04T01:45:06.432872+0000","last_clean":"2023-11-04T01:45:06.432872+0000","last_became_active":"2023-11-04T01:45:03.118627+0000","last_became_peered":"2023-11-04T01:45:03.118627+0000","last_unstale":"2023-11-04T01:45:06.432872+0000","last_undegraded":"2023-11-04T01:45:06.432872+0000","last_fullsized":"2023-11-04T01:45:06.432872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:37.556118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.113397+0000","last_change":"2023-11-04T01:44:41.916693+0000","last_active":"2023-11-04T01:45:04.113397+0000","last_peered":"2023-11-04T01:45:04.113397+0000","last_clean":"2023-11-04T01:45:04.113397+0000","last_became_active":"2023-11-04T01:44:41.914418+0000","last_became_peered":"2023-11-04T01:44:41.914418+0000","last_unstale":"2023-11-04T01:45:04.113397+0000","last_undegraded":"2023-11-04T01:45:04.113397+0000","last_fullsized":"2023-11-04T01:45:04.113397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:02.978838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094176+0000","last_change":"2023-11-04T01:44:42.903798+0000","last_active":"2023-11-04T01:45:04.094176+0000","last_peered":"2023-11-04T01:45:04.094176+0000","last_clean":"2023-11-04T01:45:04.094176+0000","last_became_active":"2023-11-04T01:44:40.921927+0000","last_became_peered":"2023-11-04T01:44:40.921927+0000","last_unstale":"2023-11-04T01:45:04.094176+0000","last_undegraded":"2023-11-04T01:45:04.094176+0000","last_fullsized":"2023-11-04T01:45:04.094176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:41.296405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018315269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.115689+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:45:04.115689+0000","last_peered":"2023-11-04T01:45:04.115689+0000","last_clean":"2023-11-04T01:45:04.115689+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:45:04.115689+0000","last_undegraded":"2023-11-04T01:45:04.115689+0000","last_fullsized":"2023-11-04T01:45:04.115689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135145+0000","last_change":"2023-11-04T01:45:04.133109+0000","last_active":"2023-11-04T01:45:04.135145+0000","last_peered":"2023-11-04T01:45:04.135145+0000","last_clean":"2023-11-04T01:45:04.135145+0000","last_became_active":"2023-11-04T01:45:04.132752+0000","last_became_peered":"2023-11-04T01:45:04.132752+0000","last_unstale":"2023-11-04T01:45:04.135145+0000","last_undegraded":"2023-11-04T01:45:04.135145+0000","last_fullsized":"2023-11-04T01:45:04.135145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.105449+0000","last_change":"2023-11-04T01:45:03.126241+0000","last_active":"2023-11-04T01:45:04.105449+0000","last_peered":"2023-11-04T01:45:04.105449+0000","last_clean":"2023-11-04T01:45:04.105449+0000","last_became_active":"2023-11-04T01:45:03.125856+0000","last_became_peered":"2023-11-04T01:45:03.125856+0000","last_unstale":"2023-11-04T01:45:04.105449+0000","last_undegraded":"2023-11-04T01:45:04.105449+0000","last_fullsized":"2023-11-04T01:45:04.105449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:45.346926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109267+0000","last_change":"2023-11-04T01:44:41.944011+0000","last_active":"2023-11-04T01:45:03.109267+0000","last_peered":"2023-11-04T01:45:03.109267+0000","last_clean":"2023-11-04T01:45:03.109267+0000","last_became_active":"2023-11-04T01:44:41.943702+0000","last_became_peered":"2023-11-04T01:44:41.943702+0000","last_unstale":"2023-11-04T01:45:03.109267+0000","last_undegraded":"2023-11-04T01:45:03.109267+0000","last_fullsized":"2023-11-04T01:45:03.109267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:57.519730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.122110+0000","last_change":"2023-11-04T01:44:42.902919+0000","last_active":"2023-11-04T01:45:04.122110+0000","last_peered":"2023-11-04T01:45:04.122110+0000","last_clean":"2023-11-04T01:45:04.122110+0000","last_became_active":"2023-11-04T01:44:40.918933+0000","last_became_peered":"2023-11-04T01:44:40.918933+0000","last_unstale":"2023-11-04T01:45:04.122110+0000","last_undegraded":"2023-11-04T01:45:04.122110+0000","last_fullsized":"2023-11-04T01:45:04.122110+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:47.321809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002224087,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.110609+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:45:04.110609+0000","last_peered":"2023-11-04T01:45:04.110609+0000","last_clean":"2023-11-04T01:45:04.110609+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:45:04.110609+0000","last_undegraded":"2023-11-04T01:45:04.110609+0000","last_fullsized":"2023-11-04T01:45:04.110609+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434321+0000","last_change":"2023-11-04T01:45:04.133624+0000","last_active":"2023-11-04T01:45:06.434321+0000","last_peered":"2023-11-04T01:45:06.434321+0000","last_clean":"2023-11-04T01:45:06.434321+0000","last_became_active":"2023-11-04T01:45:04.132951+0000","last_became_peered":"2023-11-04T01:45:04.132951+0000","last_unstale":"2023-11-04T01:45:06.434321+0000","last_undegraded":"2023-11-04T01:45:06.434321+0000","last_fullsized":"2023-11-04T01:45:06.434321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.095456+0000","last_change":"2023-11-04T01:45:03.127489+0000","last_active":"2023-11-04T01:45:05.095456+0000","last_peered":"2023-11-04T01:45:05.095456+0000","last_clean":"2023-11-04T01:45:05.095456+0000","last_became_active":"2023-11-04T01:45:03.127137+0000","last_became_peered":"2023-11-04T01:45:03.127137+0000","last_unstale":"2023-11-04T01:45:05.095456+0000","last_undegraded":"2023-11-04T01:45:05.095456+0000","last_fullsized":"2023-11-04T01:45:05.095456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:40.560900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094420+0000","last_change":"2023-11-04T01:44:41.926845+0000","last_active":"2023-11-04T01:45:04.094420+0000","last_peered":"2023-11-04T01:45:04.094420+0000","last_clean":"2023-11-04T01:45:04.094420+0000","last_became_active":"2023-11-04T01:44:41.926160+0000","last_became_peered":"2023-11-04T01:44:41.926160+0000","last_unstale":"2023-11-04T01:45:04.094420+0000","last_undegraded":"2023-11-04T01:45:04.094420+0000","last_fullsized":"2023-11-04T01:45:04.094420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:09.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.104549+0000","last_change":"2023-11-04T01:44:43.172635+0000","last_active":"2023-11-04T01:45:03.104549+0000","last_peered":"2023-11-04T01:45:03.104549+0000","last_clean":"2023-11-04T01:45:03.104549+0000","last_became_active":"2023-11-04T01:44:40.944235+0000","last_became_peered":"2023-11-04T01:44:40.944235+0000","last_unstale":"2023-11-04T01:45:03.104549+0000","last_undegraded":"2023-11-04T01:45:03.104549+0000","last_fullsized":"2023-11-04T01:45:03.104549+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:23.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025398959999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106500+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:45:03.106500+0000","last_peered":"2023-11-04T01:45:03.106500+0000","last_clean":"2023-11-04T01:45:03.106500+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:45:03.106500+0000","last_undegraded":"2023-11-04T01:45:03.106500+0000","last_fullsized":"2023-11-04T01:45:03.106500+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.138380+0000","last_change":"2023-11-04T01:45:04.133627+0000","last_active":"2023-11-04T01:45:04.138380+0000","last_peered":"2023-11-04T01:45:04.138380+0000","last_clean":"2023-11-04T01:45:04.138380+0000","last_became_active":"2023-11-04T01:45:04.133260+0000","last_became_peered":"2023-11-04T01:45:04.133260+0000","last_unstale":"2023-11-04T01:45:04.138380+0000","last_undegraded":"2023-11-04T01:45:04.138380+0000","last_fullsized":"2023-11-04T01:45:04.138380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:40.425687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096078+0000","last_change":"2023-11-04T01:45:03.121289+0000","last_active":"2023-11-04T01:45:05.096078+0000","last_peered":"2023-11-04T01:45:05.096078+0000","last_clean":"2023-11-04T01:45:05.096078+0000","last_became_active":"2023-11-04T01:45:03.120805+0000","last_became_peered":"2023-11-04T01:45:03.120805+0000","last_unstale":"2023-11-04T01:45:05.096078+0000","last_undegraded":"2023-11-04T01:45:05.096078+0000","last_fullsized":"2023-11-04T01:45:05.096078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:35.388907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103720+0000","last_change":"2023-11-04T01:44:41.927015+0000","last_active":"2023-11-04T01:45:04.103720+0000","last_peered":"2023-11-04T01:45:04.103720+0000","last_clean":"2023-11-04T01:45:04.103720+0000","last_became_active":"2023-11-04T01:44:41.926208+0000","last_became_peered":"2023-11-04T01:44:41.926208+0000","last_unstale":"2023-11-04T01:45:04.103720+0000","last_undegraded":"2023-11-04T01:45:04.103720+0000","last_fullsized":"2023-11-04T01:45:04.103720+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:33.265407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094629+0000","last_change":"2023-11-04T01:44:42.903587+0000","last_active":"2023-11-04T01:45:04.094629+0000","last_peered":"2023-11-04T01:45:04.094629+0000","last_clean":"2023-11-04T01:45:04.094629+0000","last_became_active":"2023-11-04T01:44:40.914477+0000","last_became_peered":"2023-11-04T01:44:40.914477+0000","last_unstale":"2023-11-04T01:45:04.094629+0000","last_undegraded":"2023-11-04T01:45:04.094629+0000","last_fullsized":"2023-11-04T01:45:04.094629+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.324851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021038049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.102821+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:45:04.102821+0000","last_peered":"2023-11-04T01:45:04.102821+0000","last_clean":"2023-11-04T01:45:04.102821+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:45:04.102821+0000","last_undegraded":"2023-11-04T01:45:04.102821+0000","last_fullsized":"2023-11-04T01:45:04.102821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135104+0000","last_change":"2023-11-04T01:45:04.130675+0000","last_active":"2023-11-04T01:45:04.135104+0000","last_peered":"2023-11-04T01:45:04.135104+0000","last_clean":"2023-11-04T01:45:04.135104+0000","last_became_active":"2023-11-04T01:45:04.130191+0000","last_became_peered":"2023-11-04T01:45:04.130191+0000","last_unstale":"2023-11-04T01:45:04.135104+0000","last_undegraded":"2023-11-04T01:45:04.135104+0000","last_fullsized":"2023-11-04T01:45:04.135104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:57.946591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096525+0000","last_change":"2023-11-04T01:45:03.121322+0000","last_active":"2023-11-04T01:45:05.096525+0000","last_peered":"2023-11-04T01:45:05.096525+0000","last_clean":"2023-11-04T01:45:05.096525+0000","last_became_active":"2023-11-04T01:45:03.120985+0000","last_became_peered":"2023-11-04T01:45:03.120985+0000","last_unstale":"2023-11-04T01:45:05.096525+0000","last_undegraded":"2023-11-04T01:45:05.096525+0000","last_fullsized":"2023-11-04T01:45:05.096525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:19.631540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.128926+0000","last_change":"2023-11-04T01:44:41.932084+0000","last_active":"2023-11-04T01:45:03.128926+0000","last_peered":"2023-11-04T01:45:03.128926+0000","last_clean":"2023-11-04T01:45:03.128926+0000","last_became_active":"2023-11-04T01:44:41.931308+0000","last_became_peered":"2023-11-04T01:44:41.931308+0000","last_unstale":"2023-11-04T01:45:03.128926+0000","last_undegraded":"2023-11-04T01:45:03.128926+0000","last_fullsized":"2023-11-04T01:45:03.128926+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:02.241295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103980+0000","last_change":"2023-11-04T01:44:43.175475+0000","last_active":"2023-11-04T01:45:04.103980+0000","last_peered":"2023-11-04T01:45:04.103980+0000","last_clean":"2023-11-04T01:45:04.103980+0000","last_became_active":"2023-11-04T01:44:40.930314+0000","last_became_peered":"2023-11-04T01:44:40.930314+0000","last_unstale":"2023-11-04T01:45:04.103980+0000","last_undegraded":"2023-11-04T01:45:04.103980+0000","last_fullsized":"2023-11-04T01:45:04.103980+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:59.746779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042346939999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101860+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:45:04.101860+0000","last_peered":"2023-11-04T01:45:04.101860+0000","last_clean":"2023-11-04T01:45:04.101860+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:45:04.101860+0000","last_undegraded":"2023-11-04T01:45:04.101860+0000","last_fullsized":"2023-11-04T01:45:04.101860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097460+0000","last_change":"2023-11-04T01:45:04.150277+0000","last_active":"2023-11-04T01:45:05.097460+0000","last_peered":"2023-11-04T01:45:05.097460+0000","last_clean":"2023-11-04T01:45:05.097460+0000","last_became_active":"2023-11-04T01:45:04.149979+0000","last_became_peered":"2023-11-04T01:45:04.149979+0000","last_unstale":"2023-11-04T01:45:05.097460+0000","last_undegraded":"2023-11-04T01:45:05.097460+0000","last_fullsized":"2023-11-04T01:45:05.097460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:21.516748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.125253+0000","last_change":"2023-11-04T01:45:03.137987+0000","last_active":"2023-11-04T01:45:04.125253+0000","last_peered":"2023-11-04T01:45:04.125253+0000","last_clean":"2023-11-04T01:45:04.125253+0000","last_became_active":"2023-11-04T01:45:03.137175+0000","last_became_peered":"2023-11-04T01:45:03.137175+0000","last_unstale":"2023-11-04T01:45:04.125253+0000","last_undegraded":"2023-11-04T01:45:04.125253+0000","last_fullsized":"2023-11-04T01:45:04.125253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:28.709088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.128234+0000","last_change":"2023-11-04T01:44:41.921366+0000","last_active":"2023-11-04T01:45:03.128234+0000","last_peered":"2023-11-04T01:45:03.128234+0000","last_clean":"2023-11-04T01:45:03.128234+0000","last_became_active":"2023-11-04T01:44:41.920641+0000","last_became_peered":"2023-11-04T01:44:41.920641+0000","last_unstale":"2023-11-04T01:45:03.128234+0000","last_undegraded":"2023-11-04T01:45:03.128234+0000","last_fullsized":"2023-11-04T01:45:03.128234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.316345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.129049+0000","last_change":"2023-11-04T01:44:43.113042+0000","last_active":"2023-11-04T01:45:03.129049+0000","last_peered":"2023-11-04T01:45:03.129049+0000","last_clean":"2023-11-04T01:45:03.129049+0000","last_became_active":"2023-11-04T01:44:40.944546+0000","last_became_peered":"2023-11-04T01:44:40.944546+0000","last_unstale":"2023-11-04T01:45:03.129049+0000","last_undegraded":"2023-11-04T01:45:03.129049+0000","last_fullsized":"2023-11-04T01:45:03.129049+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:09.170503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00104459,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.095131+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:45:04.095131+0000","last_peered":"2023-11-04T01:45:04.095131+0000","last_clean":"2023-11-04T01:45:04.095131+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:45:04.095131+0000","last_undegraded":"2023-11-04T01:45:04.095131+0000","last_fullsized":"2023-11-04T01:45:04.095131+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.412158+0000","last_change":"2023-11-04T01:45:04.137617+0000","last_active":"2023-11-04T01:45:05.412158+0000","last_peered":"2023-11-04T01:45:05.412158+0000","last_clean":"2023-11-04T01:45:05.412158+0000","last_became_active":"2023-11-04T01:45:04.137018+0000","last_became_peered":"2023-11-04T01:45:04.137018+0000","last_unstale":"2023-11-04T01:45:05.412158+0000","last_undegraded":"2023-11-04T01:45:05.412158+0000","last_fullsized":"2023-11-04T01:45:05.412158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432328+0000","last_change":"2023-11-04T01:45:03.137935+0000","last_active":"2023-11-04T01:45:06.432328+0000","last_peered":"2023-11-04T01:45:06.432328+0000","last_clean":"2023-11-04T01:45:06.432328+0000","last_became_active":"2023-11-04T01:45:03.137485+0000","last_became_peered":"2023-11-04T01:45:03.137485+0000","last_unstale":"2023-11-04T01:45:06.432328+0000","last_undegraded":"2023-11-04T01:45:06.432328+0000","last_fullsized":"2023-11-04T01:45:06.432328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:09.334597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127370+0000","last_change":"2023-11-04T01:44:41.944522+0000","last_active":"2023-11-04T01:45:03.127370+0000","last_peered":"2023-11-04T01:45:03.127370+0000","last_clean":"2023-11-04T01:45:03.127370+0000","last_became_active":"2023-11-04T01:44:41.943801+0000","last_became_peered":"2023-11-04T01:44:41.943801+0000","last_unstale":"2023-11-04T01:45:03.127370+0000","last_undegraded":"2023-11-04T01:45:03.127370+0000","last_fullsized":"2023-11-04T01:45:03.127370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:01.424092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126664+0000","last_change":"2023-11-04T01:44:42.907186+0000","last_active":"2023-11-04T01:45:04.126664+0000","last_peered":"2023-11-04T01:45:04.126664+0000","last_clean":"2023-11-04T01:45:04.126664+0000","last_became_active":"2023-11-04T01:44:40.918060+0000","last_became_peered":"2023-11-04T01:44:40.918060+0000","last_unstale":"2023-11-04T01:45:04.126664+0000","last_undegraded":"2023-11-04T01:45:04.126664+0000","last_fullsized":"2023-11-04T01:45:04.126664+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:29.430028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016383540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.126794+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:45:03.126794+0000","last_peered":"2023-11-04T01:45:03.126794+0000","last_clean":"2023-11-04T01:45:03.126794+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:45:03.126794+0000","last_undegraded":"2023-11-04T01:45:03.126794+0000","last_fullsized":"2023-11-04T01:45:03.126794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.142256+0000","last_change":"2023-11-04T01:45:04.137444+0000","last_active":"2023-11-04T01:45:04.142256+0000","last_peered":"2023-11-04T01:45:04.142256+0000","last_clean":"2023-11-04T01:45:04.142256+0000","last_became_active":"2023-11-04T01:45:04.137117+0000","last_became_peered":"2023-11-04T01:45:04.137117+0000","last_unstale":"2023-11-04T01:45:04.142256+0000","last_undegraded":"2023-11-04T01:45:04.142256+0000","last_fullsized":"2023-11-04T01:45:04.142256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:45.466522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162039+0000","last_change":"2023-11-04T01:45:03.134341+0000","last_active":"2023-11-04T01:45:04.162039+0000","last_peered":"2023-11-04T01:45:04.162039+0000","last_clean":"2023-11-04T01:45:04.162039+0000","last_became_active":"2023-11-04T01:45:03.133098+0000","last_became_peered":"2023-11-04T01:45:03.133098+0000","last_unstale":"2023-11-04T01:45:04.162039+0000","last_undegraded":"2023-11-04T01:45:04.162039+0000","last_fullsized":"2023-11-04T01:45:04.162039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:14.278347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109130+0000","last_change":"2023-11-04T01:44:41.934242+0000","last_active":"2023-11-04T01:45:03.109130+0000","last_peered":"2023-11-04T01:45:03.109130+0000","last_clean":"2023-11-04T01:45:03.109130+0000","last_became_active":"2023-11-04T01:44:41.933915+0000","last_became_peered":"2023-11-04T01:44:41.933915+0000","last_unstale":"2023-11-04T01:45:03.109130+0000","last_undegraded":"2023-11-04T01:45:03.109130+0000","last_fullsized":"2023-11-04T01:45:03.109130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:00.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101437+0000","last_change":"2023-11-04T01:44:43.173395+0000","last_active":"2023-11-04T01:45:04.101437+0000","last_peered":"2023-11-04T01:45:04.101437+0000","last_clean":"2023-11-04T01:45:04.101437+0000","last_became_active":"2023-11-04T01:44:40.917492+0000","last_became_peered":"2023-11-04T01:44:40.917492+0000","last_unstale":"2023-11-04T01:45:04.101437+0000","last_undegraded":"2023-11-04T01:45:04.101437+0000","last_fullsized":"2023-11-04T01:45:04.101437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:09.142444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012455719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116927+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:45:04.116927+0000","last_peered":"2023-11-04T01:45:04.116927+0000","last_clean":"2023-11-04T01:45:04.116927+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:45:04.116927+0000","last_undegraded":"2023-11-04T01:45:04.116927+0000","last_fullsized":"2023-11-04T01:45:04.116927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.094643+0000","last_change":"2023-11-04T01:45:04.158816+0000","last_active":"2023-11-04T01:45:05.094643+0000","last_peered":"2023-11-04T01:45:05.094643+0000","last_clean":"2023-11-04T01:45:05.094643+0000","last_became_active":"2023-11-04T01:45:04.158474+0000","last_became_peered":"2023-11-04T01:45:04.158474+0000","last_unstale":"2023-11-04T01:45:05.094643+0000","last_undegraded":"2023-11-04T01:45:05.094643+0000","last_fullsized":"2023-11-04T01:45:05.094643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:23.611357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.144727+0000","last_change":"2023-11-04T01:45:03.139843+0000","last_active":"2023-11-04T01:45:04.144727+0000","last_peered":"2023-11-04T01:45:04.144727+0000","last_clean":"2023-11-04T01:45:04.144727+0000","last_became_active":"2023-11-04T01:45:03.139021+0000","last_became_peered":"2023-11-04T01:45:03.139021+0000","last_unstale":"2023-11-04T01:45:04.144727+0000","last_undegraded":"2023-11-04T01:45:04.144727+0000","last_fullsized":"2023-11-04T01:45:04.144727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:37:09.516600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093582+0000","last_change":"2023-11-04T01:44:41.914046+0000","last_active":"2023-11-04T01:45:04.093582+0000","last_peered":"2023-11-04T01:45:04.093582+0000","last_clean":"2023-11-04T01:45:04.093582+0000","last_became_active":"2023-11-04T01:44:41.913611+0000","last_became_peered":"2023-11-04T01:44:41.913611+0000","last_unstale":"2023-11-04T01:45:04.093582+0000","last_undegraded":"2023-11-04T01:45:04.093582+0000","last_fullsized":"2023-11-04T01:45:04.093582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:00.756582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109608+0000","last_change":"2023-11-04T01:44:43.177428+0000","last_active":"2023-11-04T01:45:03.109608+0000","last_peered":"2023-11-04T01:45:03.109608+0000","last_clean":"2023-11-04T01:45:03.109608+0000","last_became_active":"2023-11-04T01:44:40.909113+0000","last_became_peered":"2023-11-04T01:44:40.909113+0000","last_unstale":"2023-11-04T01:45:03.109608+0000","last_undegraded":"2023-11-04T01:45:03.109608+0000","last_fullsized":"2023-11-04T01:45:03.109608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:27.620457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001590373,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100450+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:45:04.100450+0000","last_peered":"2023-11-04T01:45:04.100450+0000","last_clean":"2023-11-04T01:45:04.100450+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:45:04.100450+0000","last_undegraded":"2023-11-04T01:45:04.100450+0000","last_fullsized":"2023-11-04T01:45:04.100450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096082+0000","last_change":"2023-11-04T01:45:04.124199+0000","last_active":"2023-11-04T01:45:05.096082+0000","last_peered":"2023-11-04T01:45:05.096082+0000","last_clean":"2023-11-04T01:45:05.096082+0000","last_became_active":"2023-11-04T01:45:04.122519+0000","last_became_peered":"2023-11-04T01:45:04.122519+0000","last_unstale":"2023-11-04T01:45:05.096082+0000","last_undegraded":"2023-11-04T01:45:05.096082+0000","last_fullsized":"2023-11-04T01:45:05.096082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:10.478508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433802+0000","last_change":"2023-11-04T01:45:03.147696+0000","last_active":"2023-11-04T01:45:06.433802+0000","last_peered":"2023-11-04T01:45:06.433802+0000","last_clean":"2023-11-04T01:45:06.433802+0000","last_became_active":"2023-11-04T01:45:03.147230+0000","last_became_peered":"2023-11-04T01:45:03.147230+0000","last_unstale":"2023-11-04T01:45:06.433802+0000","last_undegraded":"2023-11-04T01:45:06.433802+0000","last_fullsized":"2023-11-04T01:45:06.433802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:43.928183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106265+0000","last_change":"2023-11-04T01:44:41.932864+0000","last_active":"2023-11-04T01:45:03.106265+0000","last_peered":"2023-11-04T01:45:03.106265+0000","last_clean":"2023-11-04T01:45:03.106265+0000","last_became_active":"2023-11-04T01:44:41.932047+0000","last_became_peered":"2023-11-04T01:44:41.932047+0000","last_unstale":"2023-11-04T01:45:03.106265+0000","last_undegraded":"2023-11-04T01:45:03.106265+0000","last_fullsized":"2023-11-04T01:45:03.106265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109249+0000","last_change":"2023-11-04T01:44:43.176420+0000","last_active":"2023-11-04T01:45:03.109249+0000","last_peered":"2023-11-04T01:45:03.109249+0000","last_clean":"2023-11-04T01:45:03.109249+0000","last_became_active":"2023-11-04T01:44:40.912610+0000","last_became_peered":"2023-11-04T01:44:40.912610+0000","last_unstale":"2023-11-04T01:45:03.109249+0000","last_undegraded":"2023-11-04T01:45:03.109249+0000","last_fullsized":"2023-11-04T01:45:03.109249+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:26.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010551130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.118291+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:45:04.118291+0000","last_peered":"2023-11-04T01:45:04.118291+0000","last_clean":"2023-11-04T01:45:04.118291+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:45:04.118291+0000","last_undegraded":"2023-11-04T01:45:04.118291+0000","last_fullsized":"2023-11-04T01:45:04.118291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.163485+0000","last_change":"2023-11-04T01:45:04.157605+0000","last_active":"2023-11-04T01:45:04.163485+0000","last_peered":"2023-11-04T01:45:04.163485+0000","last_clean":"2023-11-04T01:45:04.163485+0000","last_became_active":"2023-11-04T01:45:04.157198+0000","last_became_peered":"2023-11-04T01:45:04.157198+0000","last_unstale":"2023-11-04T01:45:04.163485+0000","last_undegraded":"2023-11-04T01:45:04.163485+0000","last_fullsized":"2023-11-04T01:45:04.163485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:52:38.245774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098279+0000","last_change":"2023-11-04T01:45:03.120368+0000","last_active":"2023-11-04T01:45:05.098279+0000","last_peered":"2023-11-04T01:45:05.098279+0000","last_clean":"2023-11-04T01:45:05.098279+0000","last_became_active":"2023-11-04T01:45:03.119921+0000","last_became_peered":"2023-11-04T01:45:03.119921+0000","last_unstale":"2023-11-04T01:45:05.098279+0000","last_undegraded":"2023-11-04T01:45:05.098279+0000","last_fullsized":"2023-11-04T01:45:05.098279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:51.329197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100659+0000","last_change":"2023-11-04T01:44:41.924679+0000","last_active":"2023-11-04T01:45:04.100659+0000","last_peered":"2023-11-04T01:45:04.100659+0000","last_clean":"2023-11-04T01:45:04.100659+0000","last_became_active":"2023-11-04T01:44:41.923856+0000","last_became_peered":"2023-11-04T01:44:41.923856+0000","last_unstale":"2023-11-04T01:45:04.100659+0000","last_undegraded":"2023-11-04T01:45:04.100659+0000","last_fullsized":"2023-11-04T01:45:04.100659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:09.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.121386+0000","last_change":"2023-11-04T01:44:42.903545+0000","last_active":"2023-11-04T01:45:04.121386+0000","last_peered":"2023-11-04T01:45:04.121386+0000","last_clean":"2023-11-04T01:45:04.121386+0000","last_became_active":"2023-11-04T01:44:40.920627+0000","last_became_peered":"2023-11-04T01:44:40.920627+0000","last_unstale":"2023-11-04T01:45:04.121386+0000","last_undegraded":"2023-11-04T01:45:04.121386+0000","last_fullsized":"2023-11-04T01:45:04.121386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:23.948002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032735189999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.108463+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:45:04.108463+0000","last_peered":"2023-11-04T01:45:04.108463+0000","last_clean":"2023-11-04T01:45:04.108463+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:45:04.108463+0000","last_undegraded":"2023-11-04T01:45:04.108463+0000","last_fullsized":"2023-11-04T01:45:04.108463+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411188+0000","last_change":"2023-11-04T01:45:04.156790+0000","last_active":"2023-11-04T01:45:05.411188+0000","last_peered":"2023-11-04T01:45:05.411188+0000","last_clean":"2023-11-04T01:45:05.411188+0000","last_became_active":"2023-11-04T01:45:04.156521+0000","last_became_peered":"2023-11-04T01:45:04.156521+0000","last_unstale":"2023-11-04T01:45:05.411188+0000","last_undegraded":"2023-11-04T01:45:05.411188+0000","last_fullsized":"2023-11-04T01:45:05.411188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:37:10.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"79'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434685+0000","last_change":"2023-11-04T01:45:03.124669+0000","last_active":"2023-11-04T01:45:06.434685+0000","last_peered":"2023-11-04T01:45:06.434685+0000","last_clean":"2023-11-04T01:45:06.434685+0000","last_became_active":"2023-11-04T01:45:03.124253+0000","last_became_peered":"2023-11-04T01:45:03.124253+0000","last_unstale":"2023-11-04T01:45:06.434685+0000","last_undegraded":"2023-11-04T01:45:06.434685+0000","last_fullsized":"2023-11-04T01:45:06.434685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:26:18.704719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109681+0000","last_change":"2023-11-04T01:44:41.920012+0000","last_active":"2023-11-04T01:45:03.109681+0000","last_peered":"2023-11-04T01:45:03.109681+0000","last_clean":"2023-11-04T01:45:03.109681+0000","last_became_active":"2023-11-04T01:44:41.919196+0000","last_became_peered":"2023-11-04T01:44:41.919196+0000","last_unstale":"2023-11-04T01:45:03.109681+0000","last_undegraded":"2023-11-04T01:45:03.109681+0000","last_fullsized":"2023-11-04T01:45:03.109681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.168935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.113725+0000","last_change":"2023-11-04T01:44:42.902675+0000","last_active":"2023-11-04T01:45:04.113725+0000","last_peered":"2023-11-04T01:45:04.113725+0000","last_clean":"2023-11-04T01:45:04.113725+0000","last_became_active":"2023-11-04T01:44:40.923318+0000","last_became_peered":"2023-11-04T01:44:40.923318+0000","last_unstale":"2023-11-04T01:45:04.113725+0000","last_undegraded":"2023-11-04T01:45:04.113725+0000","last_fullsized":"2023-11-04T01:45:04.113725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:17.305049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022310820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116254+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:45:04.116254+0000","last_peered":"2023-11-04T01:45:04.116254+0000","last_clean":"2023-11-04T01:45:04.116254+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:45:04.116254+0000","last_undegraded":"2023-11-04T01:45:04.116254+0000","last_fullsized":"2023-11-04T01:45:04.116254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098415+0000","last_change":"2023-11-04T01:45:04.145562+0000","last_active":"2023-11-04T01:45:05.098415+0000","last_peered":"2023-11-04T01:45:05.098415+0000","last_clean":"2023-11-04T01:45:05.098415+0000","last_became_active":"2023-11-04T01:45:04.145280+0000","last_became_peered":"2023-11-04T01:45:04.145280+0000","last_unstale":"2023-11-04T01:45:05.098415+0000","last_undegraded":"2023-11-04T01:45:05.098415+0000","last_fullsized":"2023-11-04T01:45:05.098415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:31:37.444567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098722+0000","last_change":"2023-11-04T01:45:03.110619+0000","last_active":"2023-11-04T01:45:05.098722+0000","last_peered":"2023-11-04T01:45:05.098722+0000","last_clean":"2023-11-04T01:45:05.098722+0000","last_became_active":"2023-11-04T01:45:03.110285+0000","last_became_peered":"2023-11-04T01:45:03.110285+0000","last_unstale":"2023-11-04T01:45:05.098722+0000","last_undegraded":"2023-11-04T01:45:05.098722+0000","last_fullsized":"2023-11-04T01:45:05.098722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:21.825258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.127755+0000","last_change":"2023-11-04T01:44:41.925191+0000","last_active":"2023-11-04T01:45:04.127755+0000","last_peered":"2023-11-04T01:45:04.127755+0000","last_clean":"2023-11-04T01:45:04.127755+0000","last_became_active":"2023-11-04T01:44:41.924485+0000","last_became_peered":"2023-11-04T01:44:41.924485+0000","last_unstale":"2023-11-04T01:45:04.127755+0000","last_undegraded":"2023-11-04T01:45:04.127755+0000","last_fullsized":"2023-11-04T01:45:04.127755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:58:41.435918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103844+0000","last_change":"2023-11-04T01:44:43.174754+0000","last_active":"2023-11-04T01:45:04.103844+0000","last_peered":"2023-11-04T01:45:04.103844+0000","last_clean":"2023-11-04T01:45:04.103844+0000","last_became_active":"2023-11-04T01:44:40.921452+0000","last_became_peered":"2023-11-04T01:44:40.921452+0000","last_unstale":"2023-11-04T01:45:04.103844+0000","last_undegraded":"2023-11-04T01:45:04.103844+0000","last_fullsized":"2023-11-04T01:45:04.103844+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:08.209205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039894290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109993+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:45:03.109993+0000","last_peered":"2023-11-04T01:45:03.109993+0000","last_clean":"2023-11-04T01:45:03.109993+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:45:03.109993+0000","last_undegraded":"2023-11-04T01:45:03.109993+0000","last_fullsized":"2023-11-04T01:45:03.109993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410741+0000","last_change":"2023-11-04T01:45:04.141096+0000","last_active":"2023-11-04T01:45:05.410741+0000","last_peered":"2023-11-04T01:45:05.410741+0000","last_clean":"2023-11-04T01:45:05.410741+0000","last_became_active":"2023-11-04T01:45:04.140574+0000","last_became_peered":"2023-11-04T01:45:04.140574+0000","last_unstale":"2023-11-04T01:45:05.410741+0000","last_undegraded":"2023-11-04T01:45:05.410741+0000","last_fullsized":"2023-11-04T01:45:05.410741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:47.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410719+0000","last_change":"2023-11-04T01:45:03.144587+0000","last_active":"2023-11-04T01:45:05.410719+0000","last_peered":"2023-11-04T01:45:05.410719+0000","last_clean":"2023-11-04T01:45:05.410719+0000","last_became_active":"2023-11-04T01:45:03.143278+0000","last_became_peered":"2023-11-04T01:45:03.143278+0000","last_unstale":"2023-11-04T01:45:05.410719+0000","last_undegraded":"2023-11-04T01:45:05.410719+0000","last_fullsized":"2023-11-04T01:45:05.410719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:37.556118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103789+0000","last_change":"2023-11-04T01:44:41.925691+0000","last_active":"2023-11-04T01:45:04.103789+0000","last_peered":"2023-11-04T01:45:04.103789+0000","last_clean":"2023-11-04T01:45:04.103789+0000","last_became_active":"2023-11-04T01:44:41.924864+0000","last_became_peered":"2023-11-04T01:44:41.924864+0000","last_unstale":"2023-11-04T01:45:04.103789+0000","last_undegraded":"2023-11-04T01:45:04.103789+0000","last_fullsized":"2023-11-04T01:45:04.103789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:45.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.096531+0000","last_change":"2023-11-04T01:44:42.906340+0000","last_active":"2023-11-04T01:45:04.096531+0000","last_peered":"2023-11-04T01:45:04.096531+0000","last_clean":"2023-11-04T01:45:04.096531+0000","last_became_active":"2023-11-04T01:44:40.910288+0000","last_became_peered":"2023-11-04T01:44:40.910288+0000","last_unstale":"2023-11-04T01:45:04.096531+0000","last_undegraded":"2023-11-04T01:45:04.096531+0000","last_fullsized":"2023-11-04T01:45:04.096531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:47.297826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042925560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.121206+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:45:04.121206+0000","last_peered":"2023-11-04T01:45:04.121206+0000","last_clean":"2023-11-04T01:45:04.121206+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:45:04.121206+0000","last_undegraded":"2023-11-04T01:45:04.121206+0000","last_fullsized":"2023-11-04T01:45:04.121206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.125247+0000","last_change":"2023-11-04T01:45:04.118872+0000","last_active":"2023-11-04T01:45:04.125247+0000","last_peered":"2023-11-04T01:45:04.125247+0000","last_clean":"2023-11-04T01:45:04.125247+0000","last_became_active":"2023-11-04T01:45:04.118045+0000","last_became_peered":"2023-11-04T01:45:04.118045+0000","last_unstale":"2023-11-04T01:45:04.125247+0000","last_undegraded":"2023-11-04T01:45:04.125247+0000","last_fullsized":"2023-11-04T01:45:04.125247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"79'8","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.164054+0000","last_change":"2023-11-04T01:45:03.148766+0000","last_active":"2023-11-04T01:45:04.164054+0000","last_peered":"2023-11-04T01:45:04.164054+0000","last_clean":"2023-11-04T01:45:04.164054+0000","last_became_active":"2023-11-04T01:45:03.148025+0000","last_became_peered":"2023-11-04T01:45:03.148025+0000","last_unstale":"2023-11-04T01:45:04.164054+0000","last_undegraded":"2023-11-04T01:45:04.164054+0000","last_fullsized":"2023-11-04T01:45:04.164054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:01.334400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.108912+0000","last_change":"2023-11-04T01:44:41.918620+0000","last_active":"2023-11-04T01:45:03.108912+0000","last_peered":"2023-11-04T01:45:03.108912+0000","last_clean":"2023-11-04T01:45:03.108912+0000","last_became_active":"2023-11-04T01:44:41.918291+0000","last_became_peered":"2023-11-04T01:44:41.918291+0000","last_unstale":"2023-11-04T01:45:03.108912+0000","last_undegraded":"2023-11-04T01:45:03.108912+0000","last_fullsized":"2023-11-04T01:45:03.108912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.110059+0000","last_change":"2023-11-04T01:44:43.173305+0000","last_active":"2023-11-04T01:45:04.110059+0000","last_peered":"2023-11-04T01:45:04.110059+0000","last_clean":"2023-11-04T01:45:04.110059+0000","last_became_active":"2023-11-04T01:44:40.918163+0000","last_became_peered":"2023-11-04T01:44:40.918163+0000","last_unstale":"2023-11-04T01:45:04.110059+0000","last_undegraded":"2023-11-04T01:45:04.110059+0000","last_fullsized":"2023-11-04T01:45:04.110059+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:21.563078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011642689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.102427+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:45:04.102427+0000","last_peered":"2023-11-04T01:45:04.102427+0000","last_clean":"2023-11-04T01:45:04.102427+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:45:04.102427+0000","last_undegraded":"2023-11-04T01:45:04.102427+0000","last_fullsized":"2023-11-04T01:45:04.102427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410595+0000","last_change":"2023-11-04T01:45:04.136173+0000","last_active":"2023-11-04T01:45:05.410595+0000","last_peered":"2023-11-04T01:45:05.410595+0000","last_clean":"2023-11-04T01:45:05.410595+0000","last_became_active":"2023-11-04T01:45:04.135721+0000","last_became_peered":"2023-11-04T01:45:04.135721+0000","last_unstale":"2023-11-04T01:45:05.410595+0000","last_undegraded":"2023-11-04T01:45:05.410595+0000","last_fullsized":"2023-11-04T01:45:05.410595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:50.290527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433532+0000","last_change":"2023-11-04T01:45:03.148299+0000","last_active":"2023-11-04T01:45:06.433532+0000","last_peered":"2023-11-04T01:45:06.433532+0000","last_clean":"2023-11-04T01:45:06.433532+0000","last_became_active":"2023-11-04T01:45:03.147980+0000","last_became_peered":"2023-11-04T01:45:03.147980+0000","last_unstale":"2023-11-04T01:45:06.433532+0000","last_undegraded":"2023-11-04T01:45:06.433532+0000","last_fullsized":"2023-11-04T01:45:06.433532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:27.353924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116254+0000","last_change":"2023-11-04T01:44:41.918947+0000","last_active":"2023-11-04T01:45:04.116254+0000","last_peered":"2023-11-04T01:45:04.116254+0000","last_clean":"2023-11-04T01:45:04.116254+0000","last_became_active":"2023-11-04T01:44:41.918140+0000","last_became_peered":"2023-11-04T01:44:41.918140+0000","last_unstale":"2023-11-04T01:45:04.116254+0000","last_undegraded":"2023-11-04T01:45:04.116254+0000","last_fullsized":"2023-11-04T01:45:04.116254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:58.268543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106196+0000","last_change":"2023-11-04T01:44:43.173435+0000","last_active":"2023-11-04T01:45:03.106196+0000","last_peered":"2023-11-04T01:45:03.106196+0000","last_clean":"2023-11-04T01:45:03.106196+0000","last_became_active":"2023-11-04T01:44:40.934905+0000","last_became_peered":"2023-11-04T01:44:40.934905+0000","last_unstale":"2023-11-04T01:45:03.106196+0000","last_undegraded":"2023-11-04T01:45:03.106196+0000","last_fullsized":"2023-11-04T01:45:03.106196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:59.915687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324778,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.117306+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:45:04.117306+0000","last_peered":"2023-11-04T01:45:04.117306+0000","last_clean":"2023-11-04T01:45:04.117306+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:45:04.117306+0000","last_undegraded":"2023-11-04T01:45:04.117306+0000","last_fullsized":"2023-11-04T01:45:04.117306+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432630+0000","last_change":"2023-11-04T01:45:04.132591+0000","last_active":"2023-11-04T01:45:06.432630+0000","last_peered":"2023-11-04T01:45:06.432630+0000","last_clean":"2023-11-04T01:45:06.432630+0000","last_became_active":"2023-11-04T01:45:04.132219+0000","last_became_peered":"2023-11-04T01:45:04.132219+0000","last_unstale":"2023-11-04T01:45:06.432630+0000","last_undegraded":"2023-11-04T01:45:06.432630+0000","last_fullsized":"2023-11-04T01:45:06.432630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:56.701946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411707+0000","last_change":"2023-11-04T01:45:03.135777+0000","last_active":"2023-11-04T01:45:05.411707+0000","last_peered":"2023-11-04T01:45:05.411707+0000","last_clean":"2023-11-04T01:45:05.411707+0000","last_became_active":"2023-11-04T01:45:03.134717+0000","last_became_peered":"2023-11-04T01:45:03.134717+0000","last_unstale":"2023-11-04T01:45:05.411707+0000","last_undegraded":"2023-11-04T01:45:05.411707+0000","last_fullsized":"2023-11-04T01:45:05.411707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:19.929364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.105143+0000","last_change":"2023-11-04T01:44:41.935218+0000","last_active":"2023-11-04T01:45:03.105143+0000","last_peered":"2023-11-04T01:45:03.105143+0000","last_clean":"2023-11-04T01:45:03.105143+0000","last_became_active":"2023-11-04T01:44:41.934439+0000","last_became_peered":"2023-11-04T01:44:41.934439+0000","last_unstale":"2023-11-04T01:45:03.105143+0000","last_undegraded":"2023-11-04T01:45:03.105143+0000","last_fullsized":"2023-11-04T01:45:03.105143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:16.371130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126152+0000","last_change":"2023-11-04T01:44:42.905649+0000","last_active":"2023-11-04T01:45:04.126152+0000","last_peered":"2023-11-04T01:45:04.126152+0000","last_clean":"2023-11-04T01:45:04.126152+0000","last_became_active":"2023-11-04T01:44:40.923902+0000","last_became_peered":"2023-11-04T01:44:40.923902+0000","last_unstale":"2023-11-04T01:45:04.126152+0000","last_undegraded":"2023-11-04T01:45:04.126152+0000","last_fullsized":"2023-11-04T01:45:04.126152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:10.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015906259999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094846+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:45:04.094846+0000","last_peered":"2023-11-04T01:45:04.094846+0000","last_clean":"2023-11-04T01:45:04.094846+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:45:04.094846+0000","last_undegraded":"2023-11-04T01:45:04.094846+0000","last_fullsized":"2023-11-04T01:45:04.094846+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411836+0000","last_change":"2023-11-04T01:45:04.158187+0000","last_active":"2023-11-04T01:45:05.411836+0000","last_peered":"2023-11-04T01:45:05.411836+0000","last_clean":"2023-11-04T01:45:05.411836+0000","last_became_active":"2023-11-04T01:45:04.157717+0000","last_became_peered":"2023-11-04T01:45:04.157717+0000","last_unstale":"2023-11-04T01:45:05.411836+0000","last_undegraded":"2023-11-04T01:45:05.411836+0000","last_fullsized":"2023-11-04T01:45:05.411836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"79'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096380+0000","last_change":"2023-11-04T01:45:03.143798+0000","last_active":"2023-11-04T01:45:05.096380+0000","last_peered":"2023-11-04T01:45:05.096380+0000","last_clean":"2023-11-04T01:45:05.096380+0000","last_became_active":"2023-11-04T01:45:03.143464+0000","last_became_peered":"2023-11-04T01:45:03.143464+0000","last_unstale":"2023-11-04T01:45:05.096380+0000","last_undegraded":"2023-11-04T01:45:05.096380+0000","last_fullsized":"2023-11-04T01:45:05.096380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:15.730743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093947+0000","last_change":"2023-11-04T01:44:41.934607+0000","last_active":"2023-11-04T01:45:04.093947+0000","last_peered":"2023-11-04T01:45:04.093947+0000","last_clean":"2023-11-04T01:45:04.093947+0000","last_became_active":"2023-11-04T01:44:41.934198+0000","last_became_peered":"2023-11-04T01:44:41.934198+0000","last_unstale":"2023-11-04T01:45:04.093947+0000","last_undegraded":"2023-11-04T01:45:04.093947+0000","last_fullsized":"2023-11-04T01:45:04.093947+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:38.701974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.111389+0000","last_change":"2023-11-04T01:44:43.172018+0000","last_active":"2023-11-04T01:45:04.111389+0000","last_peered":"2023-11-04T01:45:04.111389+0000","last_clean":"2023-11-04T01:45:04.111389+0000","last_became_active":"2023-11-04T01:44:40.912370+0000","last_became_peered":"2023-11-04T01:44:40.912370+0000","last_unstale":"2023-11-04T01:45:04.111389+0000","last_undegraded":"2023-11-04T01:45:04.111389+0000","last_fullsized":"2023-11-04T01:45:04.111389+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:13:11.680326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061865800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.127608+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:45:04.127608+0000","last_peered":"2023-11-04T01:45:04.127608+0000","last_clean":"2023-11-04T01:45:04.127608+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:45:04.127608+0000","last_undegraded":"2023-11-04T01:45:04.127608+0000","last_fullsized":"2023-11-04T01:45:04.127608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.099428+0000","last_change":"2023-11-04T01:45:04.144100+0000","last_active":"2023-11-04T01:45:05.099428+0000","last_peered":"2023-11-04T01:45:05.099428+0000","last_clean":"2023-11-04T01:45:05.099428+0000","last_became_active":"2023-11-04T01:45:04.143710+0000","last_became_peered":"2023-11-04T01:45:04.143710+0000","last_unstale":"2023-11-04T01:45:05.099428+0000","last_undegraded":"2023-11-04T01:45:05.099428+0000","last_fullsized":"2023-11-04T01:45:05.099428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:16.828619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"79'6","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411209+0000","last_change":"2023-11-04T01:45:03.136641+0000","last_active":"2023-11-04T01:45:05.411209+0000","last_peered":"2023-11-04T01:45:05.411209+0000","last_clean":"2023-11-04T01:45:05.411209+0000","last_became_active":"2023-11-04T01:45:03.135904+0000","last_became_peered":"2023-11-04T01:45:03.135904+0000","last_unstale":"2023-11-04T01:45:05.411209+0000","last_undegraded":"2023-11-04T01:45:05.411209+0000","last_fullsized":"2023-11-04T01:45:05.411209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:49.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101228+0000","last_change":"2023-11-04T01:44:41.926616+0000","last_active":"2023-11-04T01:45:04.101228+0000","last_peered":"2023-11-04T01:45:04.101228+0000","last_clean":"2023-11-04T01:45:04.101228+0000","last_became_active":"2023-11-04T01:44:41.926311+0000","last_became_peered":"2023-11-04T01:44:41.926311+0000","last_unstale":"2023-11-04T01:45:04.101228+0000","last_undegraded":"2023-11-04T01:45:04.101228+0000","last_fullsized":"2023-11-04T01:45:04.101228+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:11.379149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109344+0000","last_change":"2023-11-04T01:44:43.178007+0000","last_active":"2023-11-04T01:45:03.109344+0000","last_peered":"2023-11-04T01:45:03.109344+0000","last_clean":"2023-11-04T01:45:03.109344+0000","last_became_active":"2023-11-04T01:44:40.918444+0000","last_became_peered":"2023-11-04T01:44:40.918444+0000","last_unstale":"2023-11-04T01:45:03.109344+0000","last_undegraded":"2023-11-04T01:45:03.109344+0000","last_fullsized":"2023-11-04T01:45:03.109344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029560530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.104699+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:45:04.104699+0000","last_peered":"2023-11-04T01:45:04.104699+0000","last_clean":"2023-11-04T01:45:04.104699+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:45:04.104699+0000","last_undegraded":"2023-11-04T01:45:04.104699+0000","last_fullsized":"2023-11-04T01:45:04.104699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433211+0000","last_change":"2023-11-04T01:45:04.119883+0000","last_active":"2023-11-04T01:45:06.433211+0000","last_peered":"2023-11-04T01:45:06.433211+0000","last_clean":"2023-11-04T01:45:06.433211+0000","last_became_active":"2023-11-04T01:45:04.119122+0000","last_became_peered":"2023-11-04T01:45:04.119122+0000","last_unstale":"2023-11-04T01:45:06.433211+0000","last_undegraded":"2023-11-04T01:45:06.433211+0000","last_fullsized":"2023-11-04T01:45:06.433211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:45.466522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434740+0000","last_change":"2023-11-04T01:45:03.148003+0000","last_active":"2023-11-04T01:45:06.434740+0000","last_peered":"2023-11-04T01:45:06.434740+0000","last_clean":"2023-11-04T01:45:06.434740+0000","last_became_active":"2023-11-04T01:45:03.147377+0000","last_became_peered":"2023-11-04T01:45:03.147377+0000","last_unstale":"2023-11-04T01:45:06.434740+0000","last_undegraded":"2023-11-04T01:45:06.434740+0000","last_fullsized":"2023-11-04T01:45:06.434740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:49.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109762+0000","last_change":"2023-11-04T01:44:41.910669+0000","last_active":"2023-11-04T01:45:03.109762+0000","last_peered":"2023-11-04T01:45:03.109762+0000","last_clean":"2023-11-04T01:45:03.109762+0000","last_became_active":"2023-11-04T01:44:41.910257+0000","last_became_peered":"2023-11-04T01:44:41.910257+0000","last_unstale":"2023-11-04T01:45:03.109762+0000","last_undegraded":"2023-11-04T01:45:03.109762+0000","last_fullsized":"2023-11-04T01:45:03.109762+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:15.837643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127177+0000","last_change":"2023-11-04T01:44:43.112877+0000","last_active":"2023-11-04T01:45:03.127177+0000","last_peered":"2023-11-04T01:45:03.127177+0000","last_clean":"2023-11-04T01:45:03.127177+0000","last_became_active":"2023-11-04T01:44:40.940708+0000","last_became_peered":"2023-11-04T01:44:40.940708+0000","last_unstale":"2023-11-04T01:45:03.127177+0000","last_undegraded":"2023-11-04T01:45:03.127177+0000","last_fullsized":"2023-11-04T01:45:03.127177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:09.389684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022320399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126670+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:45:04.126670+0000","last_peered":"2023-11-04T01:45:04.126670+0000","last_clean":"2023-11-04T01:45:04.126670+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:45:04.126670+0000","last_undegraded":"2023-11-04T01:45:04.126670+0000","last_fullsized":"2023-11-04T01:45:04.126670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096523+0000","last_change":"2023-11-04T01:45:04.133341+0000","last_active":"2023-11-04T01:45:05.096523+0000","last_peered":"2023-11-04T01:45:05.096523+0000","last_clean":"2023-11-04T01:45:05.096523+0000","last_became_active":"2023-11-04T01:45:04.132519+0000","last_became_peered":"2023-11-04T01:45:04.132519+0000","last_unstale":"2023-11-04T01:45:05.096523+0000","last_undegraded":"2023-11-04T01:45:05.096523+0000","last_fullsized":"2023-11-04T01:45:05.096523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:11.031337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.109882+0000","last_change":"2023-11-04T01:45:03.140200+0000","last_active":"2023-11-04T01:45:04.109882+0000","last_peered":"2023-11-04T01:45:04.109882+0000","last_clean":"2023-11-04T01:45:04.109882+0000","last_became_active":"2023-11-04T01:45:03.139232+0000","last_became_peered":"2023-11-04T01:45:03.139232+0000","last_unstale":"2023-11-04T01:45:04.109882+0000","last_undegraded":"2023-11-04T01:45:04.109882+0000","last_fullsized":"2023-11-04T01:45:04.109882+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:11:02.402618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.107886+0000","last_change":"2023-11-04T01:44:41.934098+0000","last_active":"2023-11-04T01:45:04.107886+0000","last_peered":"2023-11-04T01:45:04.107886+0000","last_clean":"2023-11-04T01:45:04.107886+0000","last_became_active":"2023-11-04T01:44:41.933709+0000","last_became_peered":"2023-11-04T01:44:41.933709+0000","last_unstale":"2023-11-04T01:45:04.107886+0000","last_undegraded":"2023-11-04T01:45:04.107886+0000","last_fullsized":"2023-11-04T01:45:04.107886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:56.613949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.103070+0000","last_change":"2023-11-04T01:44:43.172536+0000","last_active":"2023-11-04T01:45:03.103070+0000","last_peered":"2023-11-04T01:45:03.103070+0000","last_clean":"2023-11-04T01:45:03.103070+0000","last_became_active":"2023-11-04T01:44:40.923754+0000","last_became_peered":"2023-11-04T01:44:40.923754+0000","last_unstale":"2023-11-04T01:45:03.103070+0000","last_undegraded":"2023-11-04T01:45:03.103070+0000","last_fullsized":"2023-11-04T01:45:03.103070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:16.408984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026512620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100723+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:45:04.100723+0000","last_peered":"2023-11-04T01:45:04.100723+0000","last_clean":"2023-11-04T01:45:04.100723+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:45:04.100723+0000","last_undegraded":"2023-11-04T01:45:04.100723+0000","last_fullsized":"2023-11-04T01:45:04.100723+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":1028762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.35299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.433}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.496},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.371,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.58899999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.877},"min":{"1min":0.57299999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.65300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3640000000000001,"5min":1.365,"15min":1.365},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3540000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.018,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.879}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.0620000000000001,"15min":1.0720000000000001},"min":{"1min":0.70199999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.373,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4159999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.093,"5min":1.079,"15min":1.077},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.80000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":445141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.502}]},{"osd":2,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.143,"5min":1.885,"15min":1.885},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.526,"15min":1.526},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.80700000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2410000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.60299999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0089999999999999,"15min":1.006},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.82199999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.095,"15min":1.0960000000000001},"min":{"1min":0.628,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.369,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.63700000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":437708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.89600000000000002},"min":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.276,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.84799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.333,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.875},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.137,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.89300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.86799999999999999,"15min":0.85699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1040000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90200000000000002},"min":{"1min":0.66700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2989999999999999,"5min":1.514,"15min":1.514},"last":0.81399999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.073,"15min":1.077},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2729999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.232,"5min":2.609,"15min":2.609},"last":1.2170000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.1539999999999999,"15min":1.1759999999999999},"min":{"1min":0.77800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.387,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.048},{"interface":"front","average":{"1min":1.125,"5min":2.4529999999999998,"15min":2.6749999999999998},"min":{"1min":0.82899999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3660000000000001,"5min":40.195,"15min":40.195},"last":1.109}]},{"osd":6,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2909999999999999,"15min":1.319},"min":{"1min":0.94699999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2849999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1399999999999999,"15min":1.1499999999999999},"min":{"1min":0.77000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5529999999999999,"5min":1.637,"15min":1.637},"last":1.26}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":446807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.413,"5min":1.623,"15min":1.623},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.94699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4039999999999999,"5min":1.724,"15min":1.724},"last":1.25}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.95399999999999996,"15min":0.96299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.444,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.244,"15min":1.244},"last":1.0660000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0089999999999999,"15min":1.0169999999999999},"min":{"1min":0.61899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4330000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.03},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.298,"5min":1.976,"15min":1.976},"last":1.0309999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0049999999999999},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.335,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.546,"5min":2.161,"15min":2.161},"last":1.1399999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.63,"5min":0.495,"15min":0.495},"max":{"1min":1.333,"5min":1.538,"15min":1.538},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.1220000000000001},"min":{"1min":0.70199999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.516,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.998}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0600000000000001},"min":{"1min":0.69799999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.204,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.095,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.484,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8919999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.075,"5min":1.1060000000000001,"15min":1.111},"min":{"1min":0.83299999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.387,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.179}]}]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1548288,"data_stored":1028076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":0.876},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.23,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.901}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.321,"15min":1.321},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.3919999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.28},"last":1.6850000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3320000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.2050000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.874,"15min":0.875},"min":{"1min":0.55600000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.1559999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.024,"5min":0.93600000000000005,"15min":0.92200000000000004},"min":{"1min":0.72599999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.8120000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.98499999999999999,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.343,"5min":1.401,"15min":1.401},"last":1.986},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0269999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.125}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3879999999999999,"5min":1.627,"15min":1.627},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":1.026,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.399,"5min":1.526,"15min":1.526},"last":2.1429999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.137,"15min":1.1459999999999999},"min":{"1min":0.81799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.409,"5min":1.49,"15min":1.49},"last":1.54},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.22,"15min":1.23},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.496,"5min":1.536,"15min":1.536},"last":1.6240000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":437708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.758,"15min":1.758},"last":0.89400000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.46,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.173,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96499999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.278},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.65900000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1839999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0940000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2889999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":1.833,"15min":1.833},"last":1.052}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3420000000000001,"5min":1.369,"15min":1.369},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.85199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.125},"min":{"1min":0.77200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7410000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.014},"min":{"1min":0.84599999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.4399999999999999,"5min":1.554,"15min":1.554},"last":1.169}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.292,"5min":1.417,"15min":1.417},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.202},"min":{"1min":0.96799999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.206}]}]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":446795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85999999999999999,"5min":1.167,"15min":1.167},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.252,"5min":1.429,"15min":1.429},"last":0.34799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1890000000000001,"5min":1.252,"15min":1.252},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4159999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.435}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.357,"5min":1.369,"15min":1.369},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.0429999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.0469999999999999,"15min":1.0369999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":438312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.629},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.81799999999999995,"5min":1.022,"15min":1.022},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.38100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.054,"5min":1.181,"15min":1.181},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.411,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.879,"15min":0.877},"min":{"1min":0.61299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.876},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2290000000000001,"5min":1.603,"15min":1.603},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.85699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.002,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.377,"5min":1.411,"15min":1.411},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.272,"5min":1.613,"15min":1.613},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:45:08.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:45:08.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.322+0000 7f82c4588640 1 Processor -- start 2023-11-04T01:45:08.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c4588640 1 -- start start 2023-11-04T01:45:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c4588640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f82bc0c9960 0x7f82bc0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c4588640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0ce320 con 0x7f82bc0b0c70 2023-11-04T01:45:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c4588640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0ce600 con 0x7f82bc0b0890 2023-11-04T01:45:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c4588640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc06d2f0 con 0x7f82bc0c9960 2023-11-04T01:45:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f82bc0b0c70 0x7f82bc0ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40572/0 (socket says 172.21.15.2:40572) 2023-11-04T01:45:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 -- 172.21.15.2:0/2633889827 learned_addr learned my addr 172.21.15.2:0/2633889827 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1b23640 1 --2- 172.21.15.2:0/2633889827 >> v2:172.21.15.90:3300/0 conn(0x7f82bc0c9960 0x7f82bc0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455849552 0 0) 0x7f82bc0ce320 con 0x7f82bc0b0c70 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a8003530 con 0x7f82bc0b0c70 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895048024 0 0) 0x7f82a8003530 con 0x7f82bc0b0c70 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 >> v2:172.21.15.90:3300/0 conn(0x7f82bc0c9960 msgr2=0x7f82bc0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 --2- 172.21.15.2:0/2633889827 >> v2:172.21.15.90:3300/0 conn(0x7f82bc0c9960 0x7f82bc0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 >> v1:172.21.15.90:6789/0 conn(0x7f82bc0b0890 legacy=0x7f82bc0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0ce8e0 con 0x7f82bc0b0c70 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f82b4001a00 con 0x7f82bc0b0c70 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 >> v1:172.21.15.2:6789/0 conn(0x7f82bc0b0c70 legacy=0x7f82bc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8003980 0x7f82a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a80047d0 0x7f82a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82a8005190 0x7f82a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc06d2f0 con 0x7f82a8005190 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a800c030 con 0x7f82a80047d0 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a800c1f0 con 0x7f82a8003980 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82a8005190 0x7f82a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1b23640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a80047d0 0x7f82a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2324640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8003980 0x7f82a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 -- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8003980 msgr2=0x7f82a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8003980 0x7f82a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 -- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a80047d0 msgr2=0x7f82a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a80047d0 0x7f82a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2b25640 1 -- 172.21.15.2:0/2633889827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8003530 con 0x7f82a8005190 2023-11-04T01:45:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c2324640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8003980 0x7f82a8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.326+0000 7f82c1b23640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82a80047d0 0x7f82a8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c2b25640 1 -- 172.21.15.2:0/2633889827 reap_dead start 2023-11-04T01:45:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c2b25640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82a8005190 0x7f82a800b990 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f82b400a820 tx=0x7f82b401d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c84e34ebebc8756 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40072d0 con 0x7f82a8005190 2023-11-04T01:45:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b40a8070 con 0x7f82a8005190 2023-11-04T01:45:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c1322640 1 -- 172.21.15.2:0/2633889827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b40076b0 con 0x7f82a8005190 2023-11-04T01:45:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- 172.21.15.2:0/2633889827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82a8005190 msgr2=0x7f82a800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82a8005190 0x7f82a800b990 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f82b400a820 tx=0x7f82b401d320 comp rx=0 tx=0).stop 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- 172.21.15.2:0/2633889827 shutdown_connections 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 --2- 172.21.15.2:0/2633889827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82a8005190 0x7f82a800b990 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- 172.21.15.2:0/2633889827 >> 172.21.15.2:0/2633889827 conn(0x7f82bc0cebb0 msgr2=0x7f82bc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- 172.21.15.2:0/2633889827 shutdown_connections 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- 172.21.15.2:0/2633889827 wait complete. 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 Processor -- start 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- start start 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005190 0x7f82bc157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82bc0c2c10 0x7f82bc15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc15c920 0x7f82bc1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0c2450 con 0x7f82bc0c2c10 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc15ce50 con 0x7f82bc15c920 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c4588640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc15d130 con 0x7f82a8005190 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c1b23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82bc0c2c10 0x7f82bc15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c1b23640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82bc0c2c10 0x7f82bc15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37670/0 (socket says 172.21.15.2:37670) 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c1b23640 1 -- 172.21.15.2:0/2243898769 learned_addr learned my addr 172.21.15.2:0/2243898769 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c2b25640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc15c920 0x7f82bc1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.330+0000 7f82c2324640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005190 0x7f82bc157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c1b23640 1 -- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005190 msgr2=0x7f82bc157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c1b23640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005190 0x7f82bc157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c1b23640 1 -- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc15c920 msgr2=0x7f82bc1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c1b23640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc15c920 0x7f82bc1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c1b23640 1 -- 172.21.15.2:0/2243898769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0c26f0 con 0x7f82bc0c2c10 2023-11-04T01:45:08.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c2324640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005190 0x7f82bc157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:08.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c1b23640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82bc0c2c10 0x7f82bc15c3e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009160 tx=0x7f82ac011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82b2ffd640 1 -- 172.21.15.2:0/2243898769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac004220 con 0x7f82bc0c2c10 2023-11-04T01:45:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82b2ffd640 1 -- 172.21.15.2:0/2243898769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac004380 con 0x7f82bc0c2c10 2023-11-04T01:45:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc15d410 con 0x7f82bc0c2c10 2023-11-04T01:45:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82b2ffd640 1 -- 172.21.15.2:0/2243898769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac015890 con 0x7f82bc0c2c10 2023-11-04T01:45:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc157740 con 0x7f82bc0c2c10 2023-11-04T01:45:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc0744a0 con 0x7f82bc0c2c10 2023-11-04T01:45:08.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82b2ffd640 1 -- 172.21.15.2:0/2243898769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82ac0159f0 con 0x7f82bc0c2c10 2023-11-04T01:45:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82b2ffd640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a00664a0 0x7f82a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82b2ffd640 1 -- 172.21.15.2:0/2243898769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f82ac084a90 con 0x7f82bc0c2c10 2023-11-04T01:45:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c2324640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a00664a0 0x7f82a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.334+0000 7f82c2324640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a00664a0 0x7f82a0068960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f82b8007fd0 tx=0x7f82b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.338+0000 7f82b2ffd640 1 -- 172.21.15.2:0/2243898769 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82ac051d00 con 0x7f82bc0c2c10 2023-11-04T01:45:08.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.490+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82bc0cca70 con 0x7f82a00664a0 2023-11-04T01:45:08.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.530+0000 7f82b2ffd640 1 -- 172.21.15.2:0/2243898769 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+530102 (secure 0 0 0) 0x7f82b800d050 con 0x7f82a00664a0 2023-11-04T01:45:08.537 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:08.541 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a00664a0 msgr2=0x7f82a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a00664a0 0x7f82a0068960 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f82b8007fd0 tx=0x7f82b8009040 comp rx=0 tx=0).stop 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82bc0c2c10 msgr2=0x7f82bc15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82bc0c2c10 0x7f82bc15c3e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009160 tx=0x7f82ac011a60 comp rx=0 tx=0).stop 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 shutdown_connections 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a00664a0 0x7f82a0068960 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc15c920 0x7f82bc1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82bc0c2c10 0x7f82bc15c3e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 --2- 172.21.15.2:0/2243898769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82a8005190 0x7f82bc157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 >> 172.21.15.2:0/2243898769 conn(0x7f82bc0cebb0 msgr2=0x7f82bc06c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 shutdown_connections 2023-11-04T01:45:08.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.534+0000 7f82c4588640 1 -- 172.21.15.2:0/2243898769 wait complete. 2023-11-04T01:45:08.554 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-11-04T01:45:06.830716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":329,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249844,"kb_used_data":8716,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724876,"statfs":{"total":773094113280,"available":772838273024,"internally_reserved":0,"allocated":8925184,"data_stored":4709309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.746326"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.412339+0000","last_change":"2023-11-04T01:45:04.137313+0000","last_active":"2023-11-04T01:45:05.412339+0000","last_peered":"2023-11-04T01:45:05.412339+0000","last_clean":"2023-11-04T01:45:05.412339+0000","last_became_active":"2023-11-04T01:45:04.137022+0000","last_became_peered":"2023-11-04T01:45:04.137022+0000","last_unstale":"2023-11-04T01:45:05.412339+0000","last_undegraded":"2023-11-04T01:45:05.412339+0000","last_fullsized":"2023-11-04T01:45:05.412339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433853+0000","last_change":"2023-11-04T01:45:04.143130+0000","last_active":"2023-11-04T01:45:06.433853+0000","last_peered":"2023-11-04T01:45:06.433853+0000","last_clean":"2023-11-04T01:45:06.433853+0000","last_became_active":"2023-11-04T01:45:04.142401+0000","last_became_peered":"2023-11-04T01:45:04.142401+0000","last_unstale":"2023-11-04T01:45:06.433853+0000","last_undegraded":"2023-11-04T01:45:06.433853+0000","last_fullsized":"2023-11-04T01:45:06.433853+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:37:10.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.156825+0000","last_change":"2023-11-04T01:45:04.138676+0000","last_active":"2023-11-04T01:45:04.156825+0000","last_peered":"2023-11-04T01:45:04.156825+0000","last_clean":"2023-11-04T01:45:04.156825+0000","last_became_active":"2023-11-04T01:45:04.138143+0000","last_became_peered":"2023-11-04T01:45:04.138143+0000","last_unstale":"2023-11-04T01:45:04.156825+0000","last_undegraded":"2023-11-04T01:45:04.156825+0000","last_fullsized":"2023-11-04T01:45:04.156825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:34:01.542179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162037+0000","last_change":"2023-11-04T01:45:04.140204+0000","last_active":"2023-11-04T01:45:04.162037+0000","last_peered":"2023-11-04T01:45:04.162037+0000","last_clean":"2023-11-04T01:45:04.162037+0000","last_became_active":"2023-11-04T01:45:04.138955+0000","last_became_peered":"2023-11-04T01:45:04.138955+0000","last_unstale":"2023-11-04T01:45:04.162037+0000","last_undegraded":"2023-11-04T01:45:04.162037+0000","last_fullsized":"2023-11-04T01:45:04.162037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:38:12.630595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433288+0000","last_change":"2023-11-04T01:45:04.126630+0000","last_active":"2023-11-04T01:45:06.433288+0000","last_peered":"2023-11-04T01:45:06.433288+0000","last_clean":"2023-11-04T01:45:06.433288+0000","last_became_active":"2023-11-04T01:45:04.125343+0000","last_became_peered":"2023-11-04T01:45:04.125343+0000","last_unstale":"2023-11-04T01:45:06.433288+0000","last_undegraded":"2023-11-04T01:45:06.433288+0000","last_fullsized":"2023-11-04T01:45:06.433288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:50.290527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097101+0000","last_change":"2023-11-04T01:45:04.146656+0000","last_active":"2023-11-04T01:45:05.097101+0000","last_peered":"2023-11-04T01:45:05.097101+0000","last_clean":"2023-11-04T01:45:05.097101+0000","last_became_active":"2023-11-04T01:45:04.146370+0000","last_became_peered":"2023-11-04T01:45:04.146370+0000","last_unstale":"2023-11-04T01:45:05.097101+0000","last_undegraded":"2023-11-04T01:45:05.097101+0000","last_fullsized":"2023-11-04T01:45:05.097101+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:31:28.104295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.094518+0000","last_change":"2023-11-04T01:45:04.161706+0000","last_active":"2023-11-04T01:45:05.094518+0000","last_peered":"2023-11-04T01:45:05.094518+0000","last_clean":"2023-11-04T01:45:05.094518+0000","last_became_active":"2023-11-04T01:45:04.161287+0000","last_became_peered":"2023-11-04T01:45:04.161287+0000","last_unstale":"2023-11-04T01:45:05.094518+0000","last_undegraded":"2023-11-04T01:45:05.094518+0000","last_fullsized":"2023-11-04T01:45:05.094518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:03.029985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096692+0000","last_change":"2023-11-04T01:45:04.155552+0000","last_active":"2023-11-04T01:45:05.096692+0000","last_peered":"2023-11-04T01:45:05.096692+0000","last_clean":"2023-11-04T01:45:05.096692+0000","last_became_active":"2023-11-04T01:45:04.155059+0000","last_became_peered":"2023-11-04T01:45:04.155059+0000","last_unstale":"2023-11-04T01:45:05.096692+0000","last_undegraded":"2023-11-04T01:45:05.096692+0000","last_fullsized":"2023-11-04T01:45:05.096692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:01:01.463285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.095972+0000","last_change":"2023-11-04T01:45:04.132384+0000","last_active":"2023-11-04T01:45:05.095972+0000","last_peered":"2023-11-04T01:45:05.095972+0000","last_clean":"2023-11-04T01:45:05.095972+0000","last_became_active":"2023-11-04T01:45:04.132006+0000","last_became_peered":"2023-11-04T01:45:04.132006+0000","last_unstale":"2023-11-04T01:45:05.095972+0000","last_undegraded":"2023-11-04T01:45:05.095972+0000","last_fullsized":"2023-11-04T01:45:05.095972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:16.548935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.161999+0000","last_change":"2023-11-04T01:45:04.139809+0000","last_active":"2023-11-04T01:45:04.161999+0000","last_peered":"2023-11-04T01:45:04.161999+0000","last_clean":"2023-11-04T01:45:04.161999+0000","last_became_active":"2023-11-04T01:45:04.139363+0000","last_became_peered":"2023-11-04T01:45:04.139363+0000","last_unstale":"2023-11-04T01:45:04.161999+0000","last_undegraded":"2023-11-04T01:45:04.161999+0000","last_fullsized":"2023-11-04T01:45:04.161999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:55:31.550021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096292+0000","last_change":"2023-11-04T01:45:04.150346+0000","last_active":"2023-11-04T01:45:05.096292+0000","last_peered":"2023-11-04T01:45:05.096292+0000","last_clean":"2023-11-04T01:45:05.096292+0000","last_became_active":"2023-11-04T01:45:04.149682+0000","last_became_peered":"2023-11-04T01:45:04.149682+0000","last_unstale":"2023-11-04T01:45:05.096292+0000","last_undegraded":"2023-11-04T01:45:05.096292+0000","last_fullsized":"2023-11-04T01:45:05.096292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:18.477727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.161973+0000","last_change":"2023-11-04T01:45:04.139649+0000","last_active":"2023-11-04T01:45:04.161973+0000","last_peered":"2023-11-04T01:45:04.161973+0000","last_clean":"2023-11-04T01:45:04.161973+0000","last_became_active":"2023-11-04T01:45:04.138190+0000","last_became_peered":"2023-11-04T01:45:04.138190+0000","last_unstale":"2023-11-04T01:45:04.161973+0000","last_undegraded":"2023-11-04T01:45:04.161973+0000","last_fullsized":"2023-11-04T01:45:04.161973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:49:56.709488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.134990+0000","last_change":"2023-11-04T01:45:04.130272+0000","last_active":"2023-11-04T01:45:04.134990+0000","last_peered":"2023-11-04T01:45:04.134990+0000","last_clean":"2023-11-04T01:45:04.134990+0000","last_became_active":"2023-11-04T01:45:04.129492+0000","last_became_peered":"2023-11-04T01:45:04.129492+0000","last_unstale":"2023-11-04T01:45:04.134990+0000","last_undegraded":"2023-11-04T01:45:04.134990+0000","last_fullsized":"2023-11-04T01:45:04.134990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:15.290471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098960+0000","last_change":"2023-11-04T01:45:04.139319+0000","last_active":"2023-11-04T01:45:05.098960+0000","last_peered":"2023-11-04T01:45:05.098960+0000","last_clean":"2023-11-04T01:45:05.098960+0000","last_became_active":"2023-11-04T01:45:04.139029+0000","last_became_peered":"2023-11-04T01:45:04.139029+0000","last_unstale":"2023-11-04T01:45:05.098960+0000","last_undegraded":"2023-11-04T01:45:05.098960+0000","last_fullsized":"2023-11-04T01:45:05.098960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:38.568242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.163548+0000","last_change":"2023-11-04T01:45:04.161102+0000","last_active":"2023-11-04T01:45:04.163548+0000","last_peered":"2023-11-04T01:45:04.163548+0000","last_clean":"2023-11-04T01:45:04.163548+0000","last_became_active":"2023-11-04T01:45:04.160667+0000","last_became_peered":"2023-11-04T01:45:04.160667+0000","last_unstale":"2023-11-04T01:45:04.163548+0000","last_undegraded":"2023-11-04T01:45:04.163548+0000","last_fullsized":"2023-11-04T01:45:04.163548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:32:36.269080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096690+0000","last_change":"2023-11-04T01:45:04.151346+0000","last_active":"2023-11-04T01:45:05.096690+0000","last_peered":"2023-11-04T01:45:05.096690+0000","last_clean":"2023-11-04T01:45:05.096690+0000","last_became_active":"2023-11-04T01:45:04.150036+0000","last_became_peered":"2023-11-04T01:45:04.150036+0000","last_unstale":"2023-11-04T01:45:05.096690+0000","last_undegraded":"2023-11-04T01:45:05.096690+0000","last_fullsized":"2023-11-04T01:45:05.096690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:51:49.677641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098875+0000","last_change":"2023-11-04T01:45:04.129075+0000","last_active":"2023-11-04T01:45:05.098875+0000","last_peered":"2023-11-04T01:45:05.098875+0000","last_clean":"2023-11-04T01:45:05.098875+0000","last_became_active":"2023-11-04T01:45:04.128760+0000","last_became_peered":"2023-11-04T01:45:04.128760+0000","last_unstale":"2023-11-04T01:45:05.098875+0000","last_undegraded":"2023-11-04T01:45:05.098875+0000","last_fullsized":"2023-11-04T01:45:05.098875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:32.603734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162055+0000","last_change":"2023-11-04T01:45:04.140458+0000","last_active":"2023-11-04T01:45:04.162055+0000","last_peered":"2023-11-04T01:45:04.162055+0000","last_clean":"2023-11-04T01:45:04.162055+0000","last_became_active":"2023-11-04T01:45:04.140072+0000","last_became_peered":"2023-11-04T01:45:04.140072+0000","last_unstale":"2023-11-04T01:45:04.162055+0000","last_undegraded":"2023-11-04T01:45:04.162055+0000","last_fullsized":"2023-11-04T01:45:04.162055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:31:13.343118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.149550+0000","last_change":"2023-11-04T01:45:04.142562+0000","last_active":"2023-11-04T01:45:04.149550+0000","last_peered":"2023-11-04T01:45:04.149550+0000","last_clean":"2023-11-04T01:45:04.149550+0000","last_became_active":"2023-11-04T01:45:04.142153+0000","last_became_peered":"2023-11-04T01:45:04.142153+0000","last_unstale":"2023-11-04T01:45:04.149550+0000","last_undegraded":"2023-11-04T01:45:04.149550+0000","last_fullsized":"2023-11-04T01:45:04.149550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:04.551590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097653+0000","last_change":"2023-11-04T01:45:04.145778+0000","last_active":"2023-11-04T01:45:05.097653+0000","last_peered":"2023-11-04T01:45:05.097653+0000","last_clean":"2023-11-04T01:45:05.097653+0000","last_became_active":"2023-11-04T01:45:04.145494+0000","last_became_peered":"2023-11-04T01:45:04.145494+0000","last_unstale":"2023-11-04T01:45:05.097653+0000","last_undegraded":"2023-11-04T01:45:05.097653+0000","last_fullsized":"2023-11-04T01:45:05.097653+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:16.178541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433781+0000","last_change":"2023-11-04T01:45:04.126121+0000","last_active":"2023-11-04T01:45:06.433781+0000","last_peered":"2023-11-04T01:45:06.433781+0000","last_clean":"2023-11-04T01:45:06.433781+0000","last_became_active":"2023-11-04T01:45:04.122581+0000","last_became_peered":"2023-11-04T01:45:04.122581+0000","last_unstale":"2023-11-04T01:45:06.433781+0000","last_undegraded":"2023-11-04T01:45:06.433781+0000","last_fullsized":"2023-11-04T01:45:06.433781+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:47.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135667+0000","last_change":"2023-11-04T01:45:04.125169+0000","last_active":"2023-11-04T01:45:04.135667+0000","last_peered":"2023-11-04T01:45:04.135667+0000","last_clean":"2023-11-04T01:45:04.135667+0000","last_became_active":"2023-11-04T01:45:04.124313+0000","last_became_peered":"2023-11-04T01:45:04.124313+0000","last_unstale":"2023-11-04T01:45:04.135667+0000","last_undegraded":"2023-11-04T01:45:04.135667+0000","last_fullsized":"2023-11-04T01:45:04.135667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:48:38.708741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432471+0000","last_change":"2023-11-04T01:45:04.143758+0000","last_active":"2023-11-04T01:45:06.432471+0000","last_peered":"2023-11-04T01:45:06.432471+0000","last_clean":"2023-11-04T01:45:06.432471+0000","last_became_active":"2023-11-04T01:45:04.142681+0000","last_became_peered":"2023-11-04T01:45:04.142681+0000","last_unstale":"2023-11-04T01:45:06.432471+0000","last_undegraded":"2023-11-04T01:45:06.432471+0000","last_fullsized":"2023-11-04T01:45:06.432471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:30:55.227050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410384+0000","last_change":"2023-11-04T01:45:04.140165+0000","last_active":"2023-11-04T01:45:05.410384+0000","last_peered":"2023-11-04T01:45:05.410384+0000","last_clean":"2023-11-04T01:45:05.410384+0000","last_became_active":"2023-11-04T01:45:04.139627+0000","last_became_peered":"2023-11-04T01:45:04.139627+0000","last_unstale":"2023-11-04T01:45:05.410384+0000","last_undegraded":"2023-11-04T01:45:05.410384+0000","last_fullsized":"2023-11-04T01:45:05.410384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:45.466522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.435056+0000","last_change":"2023-11-04T01:45:04.126493+0000","last_active":"2023-11-04T01:45:06.435056+0000","last_peered":"2023-11-04T01:45:06.435056+0000","last_clean":"2023-11-04T01:45:06.435056+0000","last_became_active":"2023-11-04T01:45:04.124915+0000","last_became_peered":"2023-11-04T01:45:04.124915+0000","last_unstale":"2023-11-04T01:45:06.435056+0000","last_undegraded":"2023-11-04T01:45:06.435056+0000","last_fullsized":"2023-11-04T01:45:06.435056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:15.290471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434269+0000","last_change":"2023-11-04T01:45:04.142458+0000","last_active":"2023-11-04T01:45:06.434269+0000","last_peered":"2023-11-04T01:45:06.434269+0000","last_clean":"2023-11-04T01:45:06.434269+0000","last_became_active":"2023-11-04T01:45:04.142104+0000","last_became_peered":"2023-11-04T01:45:04.142104+0000","last_unstale":"2023-11-04T01:45:06.434269+0000","last_undegraded":"2023-11-04T01:45:06.434269+0000","last_fullsized":"2023-11-04T01:45:06.434269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162084+0000","last_change":"2023-11-04T01:45:04.140415+0000","last_active":"2023-11-04T01:45:04.162084+0000","last_peered":"2023-11-04T01:45:04.162084+0000","last_clean":"2023-11-04T01:45:04.162084+0000","last_became_active":"2023-11-04T01:45:04.139829+0000","last_became_peered":"2023-11-04T01:45:04.139829+0000","last_unstale":"2023-11-04T01:45:04.162084+0000","last_undegraded":"2023-11-04T01:45:04.162084+0000","last_fullsized":"2023-11-04T01:45:04.162084+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:28.104329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.125414+0000","last_change":"2023-11-04T01:45:04.119304+0000","last_active":"2023-11-04T01:45:04.125414+0000","last_peered":"2023-11-04T01:45:04.125414+0000","last_clean":"2023-11-04T01:45:04.125414+0000","last_became_active":"2023-11-04T01:45:04.118360+0000","last_became_peered":"2023-11-04T01:45:04.118360+0000","last_unstale":"2023-11-04T01:45:04.125414+0000","last_undegraded":"2023-11-04T01:45:04.125414+0000","last_fullsized":"2023-11-04T01:45:04.125414+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433221+0000","last_change":"2023-11-04T01:45:04.154361+0000","last_active":"2023-11-04T01:45:06.433221+0000","last_peered":"2023-11-04T01:45:06.433221+0000","last_clean":"2023-11-04T01:45:06.433221+0000","last_became_active":"2023-11-04T01:45:04.152329+0000","last_became_peered":"2023-11-04T01:45:04.152329+0000","last_unstale":"2023-11-04T01:45:06.433221+0000","last_undegraded":"2023-11-04T01:45:06.433221+0000","last_fullsized":"2023-11-04T01:45:06.433221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:53:18.811573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432757+0000","last_change":"2023-11-04T01:45:04.132358+0000","last_active":"2023-11-04T01:45:06.432757+0000","last_peered":"2023-11-04T01:45:06.432757+0000","last_clean":"2023-11-04T01:45:06.432757+0000","last_became_active":"2023-11-04T01:45:04.132014+0000","last_became_peered":"2023-11-04T01:45:04.132014+0000","last_unstale":"2023-11-04T01:45:06.432757+0000","last_undegraded":"2023-11-04T01:45:06.432757+0000","last_fullsized":"2023-11-04T01:45:06.432757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:08:57.908229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.149647+0000","last_change":"2023-11-04T01:45:04.143659+0000","last_active":"2023-11-04T01:45:04.149647+0000","last_peered":"2023-11-04T01:45:04.149647+0000","last_clean":"2023-11-04T01:45:04.149647+0000","last_became_active":"2023-11-04T01:45:04.143016+0000","last_became_peered":"2023-11-04T01:45:04.143016+0000","last_unstale":"2023-11-04T01:45:04.149647+0000","last_undegraded":"2023-11-04T01:45:04.149647+0000","last_fullsized":"2023-11-04T01:45:04.149647+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097072+0000","last_change":"2023-11-04T01:45:04.151627+0000","last_active":"2023-11-04T01:45:05.097072+0000","last_peered":"2023-11-04T01:45:05.097072+0000","last_clean":"2023-11-04T01:45:05.097072+0000","last_became_active":"2023-11-04T01:45:04.150690+0000","last_became_peered":"2023-11-04T01:45:04.150690+0000","last_unstale":"2023-11-04T01:45:05.097072+0000","last_undegraded":"2023-11-04T01:45:05.097072+0000","last_fullsized":"2023-11-04T01:45:05.097072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:24:59.420998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434866+0000","last_change":"2023-11-04T01:45:04.127937+0000","last_active":"2023-11-04T01:45:06.434866+0000","last_peered":"2023-11-04T01:45:06.434866+0000","last_clean":"2023-11-04T01:45:06.434866+0000","last_became_active":"2023-11-04T01:45:04.127101+0000","last_became_peered":"2023-11-04T01:45:04.127101+0000","last_unstale":"2023-11-04T01:45:06.434866+0000","last_undegraded":"2023-11-04T01:45:06.434866+0000","last_fullsized":"2023-11-04T01:45:06.434866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411465+0000","last_change":"2023-11-04T01:45:03.136311+0000","last_active":"2023-11-04T01:45:05.411465+0000","last_peered":"2023-11-04T01:45:05.411465+0000","last_clean":"2023-11-04T01:45:05.411465+0000","last_became_active":"2023-11-04T01:45:03.133442+0000","last_became_peered":"2023-11-04T01:45:03.133442+0000","last_unstale":"2023-11-04T01:45:05.411465+0000","last_undegraded":"2023-11-04T01:45:05.411465+0000","last_fullsized":"2023-11-04T01:45:05.411465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:27.353924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126757+0000","last_change":"2023-11-04T01:44:41.931890+0000","last_active":"2023-11-04T01:45:04.126757+0000","last_peered":"2023-11-04T01:45:04.126757+0000","last_clean":"2023-11-04T01:45:04.126757+0000","last_became_active":"2023-11-04T01:44:41.931428+0000","last_became_peered":"2023-11-04T01:44:41.931428+0000","last_unstale":"2023-11-04T01:45:04.126757+0000","last_undegraded":"2023-11-04T01:45:04.126757+0000","last_fullsized":"2023-11-04T01:45:04.126757+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:35.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109002+0000","last_change":"2023-11-04T01:44:43.171663+0000","last_active":"2023-11-04T01:45:03.109002+0000","last_peered":"2023-11-04T01:45:03.109002+0000","last_clean":"2023-11-04T01:45:03.109002+0000","last_became_active":"2023-11-04T01:44:40.925496+0000","last_became_peered":"2023-11-04T01:44:40.925496+0000","last_unstale":"2023-11-04T01:45:03.109002+0000","last_undegraded":"2023-11-04T01:45:03.109002+0000","last_fullsized":"2023-11-04T01:45:03.109002+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:59.630466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987024,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":217,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.104264+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:45:04.104264+0000","last_peered":"2023-11-04T01:45:04.104264+0000","last_clean":"2023-11-04T01:45:04.104264+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:45:04.104264+0000","last_undegraded":"2023-11-04T01:45:04.104264+0000","last_fullsized":"2023-11-04T01:45:04.104264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.128223+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:45:04.128223+0000","last_peered":"2023-11-04T01:45:04.128223+0000","last_clean":"2023-11-04T01:45:04.128223+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:45:04.128223+0000","last_undegraded":"2023-11-04T01:45:04.128223+0000","last_fullsized":"2023-11-04T01:45:04.128223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.148087+0000","last_change":"2023-11-04T01:45:04.140486+0000","last_active":"2023-11-04T01:45:04.148087+0000","last_peered":"2023-11-04T01:45:04.148087+0000","last_clean":"2023-11-04T01:45:04.148087+0000","last_became_active":"2023-11-04T01:45:04.140053+0000","last_became_peered":"2023-11-04T01:45:04.140053+0000","last_unstale":"2023-11-04T01:45:04.148087+0000","last_undegraded":"2023-11-04T01:45:04.148087+0000","last_fullsized":"2023-11-04T01:45:04.148087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:52.636943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097849+0000","last_change":"2023-11-04T01:45:03.111019+0000","last_active":"2023-11-04T01:45:05.097849+0000","last_peered":"2023-11-04T01:45:05.097849+0000","last_clean":"2023-11-04T01:45:05.097849+0000","last_became_active":"2023-11-04T01:45:03.110118+0000","last_became_peered":"2023-11-04T01:45:03.110118+0000","last_unstale":"2023-11-04T01:45:05.097849+0000","last_undegraded":"2023-11-04T01:45:05.097849+0000","last_fullsized":"2023-11-04T01:45:05.097849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:09.334597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127152+0000","last_change":"2023-11-04T01:44:41.934578+0000","last_active":"2023-11-04T01:45:03.127152+0000","last_peered":"2023-11-04T01:45:03.127152+0000","last_clean":"2023-11-04T01:45:03.127152+0000","last_became_active":"2023-11-04T01:44:41.932591+0000","last_became_peered":"2023-11-04T01:44:41.932591+0000","last_unstale":"2023-11-04T01:45:03.127152+0000","last_undegraded":"2023-11-04T01:45:03.127152+0000","last_fullsized":"2023-11-04T01:45:03.127152+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:29.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.096722+0000","last_change":"2023-11-04T01:44:42.906847+0000","last_active":"2023-11-04T01:45:04.096722+0000","last_peered":"2023-11-04T01:45:04.096722+0000","last_clean":"2023-11-04T01:45:04.096722+0000","last_became_active":"2023-11-04T01:44:40.908611+0000","last_became_peered":"2023-11-04T01:44:40.908611+0000","last_unstale":"2023-11-04T01:45:04.096722+0000","last_undegraded":"2023-11-04T01:45:04.096722+0000","last_fullsized":"2023-11-04T01:45:04.096722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:44.272984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044006599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.121623+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:45:04.121623+0000","last_peered":"2023-11-04T01:45:04.121623+0000","last_clean":"2023-11-04T01:45:04.121623+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:45:04.121623+0000","last_undegraded":"2023-11-04T01:45:04.121623+0000","last_fullsized":"2023-11-04T01:45:04.121623+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411706+0000","last_change":"2023-11-04T01:45:04.156985+0000","last_active":"2023-11-04T01:45:05.411706+0000","last_peered":"2023-11-04T01:45:05.411706+0000","last_clean":"2023-11-04T01:45:05.411706+0000","last_became_active":"2023-11-04T01:45:04.156495+0000","last_became_peered":"2023-11-04T01:45:04.156495+0000","last_unstale":"2023-11-04T01:45:05.411706+0000","last_undegraded":"2023-11-04T01:45:05.411706+0000","last_fullsized":"2023-11-04T01:45:05.411706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:57.946591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093859+0000","last_change":"2023-11-04T01:45:03.113950+0000","last_active":"2023-11-04T01:45:04.093859+0000","last_peered":"2023-11-04T01:45:04.093859+0000","last_clean":"2023-11-04T01:45:04.093859+0000","last_became_active":"2023-11-04T01:45:03.112073+0000","last_became_peered":"2023-11-04T01:45:03.112073+0000","last_unstale":"2023-11-04T01:45:04.093859+0000","last_undegraded":"2023-11-04T01:45:04.093859+0000","last_fullsized":"2023-11-04T01:45:04.093859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:46.142793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100214+0000","last_change":"2023-11-04T01:44:41.924659+0000","last_active":"2023-11-04T01:45:04.100214+0000","last_peered":"2023-11-04T01:45:04.100214+0000","last_clean":"2023-11-04T01:45:04.100214+0000","last_became_active":"2023-11-04T01:44:41.923887+0000","last_became_peered":"2023-11-04T01:44:41.923887+0000","last_unstale":"2023-11-04T01:45:04.100214+0000","last_undegraded":"2023-11-04T01:45:04.100214+0000","last_fullsized":"2023-11-04T01:45:04.100214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:59.201022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.096174+0000","last_change":"2023-11-04T01:44:42.906331+0000","last_active":"2023-11-04T01:45:04.096174+0000","last_peered":"2023-11-04T01:45:04.096174+0000","last_clean":"2023-11-04T01:45:04.096174+0000","last_became_active":"2023-11-04T01:44:40.923564+0000","last_became_peered":"2023-11-04T01:44:40.923564+0000","last_unstale":"2023-11-04T01:45:04.096174+0000","last_undegraded":"2023-11-04T01:45:04.096174+0000","last_fullsized":"2023-11-04T01:45:04.096174+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:58.191219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038764860000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093676+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:45:04.093676+0000","last_peered":"2023-11-04T01:45:04.093676+0000","last_clean":"2023-11-04T01:45:04.093676+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:45:04.093676+0000","last_undegraded":"2023-11-04T01:45:04.093676+0000","last_fullsized":"2023-11-04T01:45:04.093676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098131+0000","last_change":"2023-11-04T01:45:04.129183+0000","last_active":"2023-11-04T01:45:05.098131+0000","last_peered":"2023-11-04T01:45:05.098131+0000","last_clean":"2023-11-04T01:45:05.098131+0000","last_became_active":"2023-11-04T01:45:04.128483+0000","last_became_peered":"2023-11-04T01:45:04.128483+0000","last_unstale":"2023-11-04T01:45:05.098131+0000","last_undegraded":"2023-11-04T01:45:05.098131+0000","last_fullsized":"2023-11-04T01:45:05.098131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:47:38.902182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.094828+0000","last_change":"2023-11-04T01:45:03.147853+0000","last_active":"2023-11-04T01:45:05.094828+0000","last_peered":"2023-11-04T01:45:05.094828+0000","last_clean":"2023-11-04T01:45:05.094828+0000","last_became_active":"2023-11-04T01:45:03.147455+0000","last_became_peered":"2023-11-04T01:45:03.147455+0000","last_unstale":"2023-11-04T01:45:05.094828+0000","last_undegraded":"2023-11-04T01:45:05.094828+0000","last_fullsized":"2023-11-04T01:45:05.094828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:26.009816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.113795+0000","last_change":"2023-11-04T01:44:41.933323+0000","last_active":"2023-11-04T01:45:04.113795+0000","last_peered":"2023-11-04T01:45:04.113795+0000","last_clean":"2023-11-04T01:45:04.113795+0000","last_became_active":"2023-11-04T01:44:41.932545+0000","last_became_peered":"2023-11-04T01:44:41.932545+0000","last_unstale":"2023-11-04T01:45:04.113795+0000","last_undegraded":"2023-11-04T01:45:04.113795+0000","last_fullsized":"2023-11-04T01:45:04.113795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:28.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.129173+0000","last_change":"2023-11-04T01:44:43.112250+0000","last_active":"2023-11-04T01:45:03.129173+0000","last_peered":"2023-11-04T01:45:03.129173+0000","last_clean":"2023-11-04T01:45:03.129173+0000","last_became_active":"2023-11-04T01:44:40.940763+0000","last_became_peered":"2023-11-04T01:44:40.940763+0000","last_unstale":"2023-11-04T01:45:03.129173+0000","last_undegraded":"2023-11-04T01:45:03.129173+0000","last_fullsized":"2023-11-04T01:45:03.129173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:13.065066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127390+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:45:03.127390+0000","last_peered":"2023-11-04T01:45:03.127390+0000","last_clean":"2023-11-04T01:45:03.127390+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:45:03.127390+0000","last_undegraded":"2023-11-04T01:45:03.127390+0000","last_fullsized":"2023-11-04T01:45:03.127390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.099436+0000","last_change":"2023-11-04T01:45:04.149287+0000","last_active":"2023-11-04T01:45:05.099436+0000","last_peered":"2023-11-04T01:45:05.099436+0000","last_clean":"2023-11-04T01:45:05.099436+0000","last_became_active":"2023-11-04T01:45:04.148834+0000","last_became_peered":"2023-11-04T01:45:04.148834+0000","last_unstale":"2023-11-04T01:45:05.099436+0000","last_undegraded":"2023-11-04T01:45:05.099436+0000","last_fullsized":"2023-11-04T01:45:05.099436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:30.710270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097687+0000","last_change":"2023-11-04T01:45:03.136686+0000","last_active":"2023-11-04T01:45:05.097687+0000","last_peered":"2023-11-04T01:45:05.097687+0000","last_clean":"2023-11-04T01:45:05.097687+0000","last_became_active":"2023-11-04T01:45:03.134854+0000","last_became_peered":"2023-11-04T01:45:03.134854+0000","last_unstale":"2023-11-04T01:45:05.097687+0000","last_undegraded":"2023-11-04T01:45:05.097687+0000","last_fullsized":"2023-11-04T01:45:05.097687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:25:48.330977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.125933+0000","last_change":"2023-11-04T01:44:41.933572+0000","last_active":"2023-11-04T01:45:03.125933+0000","last_peered":"2023-11-04T01:45:03.125933+0000","last_clean":"2023-11-04T01:45:03.125933+0000","last_became_active":"2023-11-04T01:44:41.932825+0000","last_became_peered":"2023-11-04T01:44:41.932825+0000","last_unstale":"2023-11-04T01:45:03.125933+0000","last_undegraded":"2023-11-04T01:45:03.125933+0000","last_fullsized":"2023-11-04T01:45:03.125933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:17.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127308+0000","last_change":"2023-11-04T01:44:43.112178+0000","last_active":"2023-11-04T01:45:03.127308+0000","last_peered":"2023-11-04T01:45:03.127308+0000","last_clean":"2023-11-04T01:45:03.127308+0000","last_became_active":"2023-11-04T01:44:40.940919+0000","last_became_peered":"2023-11-04T01:44:40.940919+0000","last_unstale":"2023-11-04T01:45:03.127308+0000","last_undegraded":"2023-11-04T01:45:03.127308+0000","last_fullsized":"2023-11-04T01:45:03.127308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:26.706337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015529090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100800+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:45:04.100800+0000","last_peered":"2023-11-04T01:45:04.100800+0000","last_clean":"2023-11-04T01:45:04.100800+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:45:04.100800+0000","last_undegraded":"2023-11-04T01:45:04.100800+0000","last_fullsized":"2023-11-04T01:45:04.100800+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433943+0000","last_change":"2023-11-04T01:45:04.123063+0000","last_active":"2023-11-04T01:45:06.433943+0000","last_peered":"2023-11-04T01:45:06.433943+0000","last_clean":"2023-11-04T01:45:06.433943+0000","last_became_active":"2023-11-04T01:45:04.122186+0000","last_became_peered":"2023-11-04T01:45:04.122186+0000","last_unstale":"2023-11-04T01:45:06.433943+0000","last_undegraded":"2023-11-04T01:45:06.433943+0000","last_fullsized":"2023-11-04T01:45:06.433943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:57.946591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098532+0000","last_change":"2023-11-04T01:45:03.121095+0000","last_active":"2023-11-04T01:45:05.098532+0000","last_peered":"2023-11-04T01:45:05.098532+0000","last_clean":"2023-11-04T01:45:05.098532+0000","last_became_active":"2023-11-04T01:45:03.120657+0000","last_became_peered":"2023-11-04T01:45:03.120657+0000","last_unstale":"2023-11-04T01:45:05.098532+0000","last_undegraded":"2023-11-04T01:45:05.098532+0000","last_fullsized":"2023-11-04T01:45:05.098532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:03.785044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127508+0000","last_change":"2023-11-04T01:44:41.944543+0000","last_active":"2023-11-04T01:45:03.127508+0000","last_peered":"2023-11-04T01:45:03.127508+0000","last_clean":"2023-11-04T01:45:03.127508+0000","last_became_active":"2023-11-04T01:44:41.943902+0000","last_became_peered":"2023-11-04T01:44:41.943902+0000","last_unstale":"2023-11-04T01:45:03.127508+0000","last_undegraded":"2023-11-04T01:45:03.127508+0000","last_fullsized":"2023-11-04T01:45:03.127508+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:57.847851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101860+0000","last_change":"2023-11-04T01:44:43.177318+0000","last_active":"2023-11-04T01:45:04.101860+0000","last_peered":"2023-11-04T01:45:04.101860+0000","last_clean":"2023-11-04T01:45:04.101860+0000","last_became_active":"2023-11-04T01:44:40.940689+0000","last_became_peered":"2023-11-04T01:44:40.940689+0000","last_unstale":"2023-11-04T01:45:04.101860+0000","last_undegraded":"2023-11-04T01:45:04.101860+0000","last_fullsized":"2023-11-04T01:45:04.101860+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:28.637882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033848720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106487+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:45:03.106487+0000","last_peered":"2023-11-04T01:45:03.106487+0000","last_clean":"2023-11-04T01:45:03.106487+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:45:03.106487+0000","last_undegraded":"2023-11-04T01:45:03.106487+0000","last_fullsized":"2023-11-04T01:45:03.106487+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126984+0000","last_change":"2023-11-04T01:45:04.122667+0000","last_active":"2023-11-04T01:45:04.126984+0000","last_peered":"2023-11-04T01:45:04.126984+0000","last_clean":"2023-11-04T01:45:04.126984+0000","last_became_active":"2023-11-04T01:45:04.121928+0000","last_became_peered":"2023-11-04T01:45:04.121928+0000","last_unstale":"2023-11-04T01:45:04.126984+0000","last_undegraded":"2023-11-04T01:45:04.126984+0000","last_fullsized":"2023-11-04T01:45:04.126984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:50.290527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.150350+0000","last_change":"2023-11-04T01:45:03.113924+0000","last_active":"2023-11-04T01:45:04.150350+0000","last_peered":"2023-11-04T01:45:04.150350+0000","last_clean":"2023-11-04T01:45:04.150350+0000","last_became_active":"2023-11-04T01:45:03.113456+0000","last_became_peered":"2023-11-04T01:45:03.113456+0000","last_unstale":"2023-11-04T01:45:04.150350+0000","last_undegraded":"2023-11-04T01:45:04.150350+0000","last_fullsized":"2023-11-04T01:45:04.150350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:05:38.080406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.129143+0000","last_change":"2023-11-04T01:44:41.934066+0000","last_active":"2023-11-04T01:45:03.129143+0000","last_peered":"2023-11-04T01:45:03.129143+0000","last_clean":"2023-11-04T01:45:03.129143+0000","last_became_active":"2023-11-04T01:44:41.933308+0000","last_became_peered":"2023-11-04T01:44:41.933308+0000","last_unstale":"2023-11-04T01:45:03.129143+0000","last_undegraded":"2023-11-04T01:45:03.129143+0000","last_fullsized":"2023-11-04T01:45:03.129143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:36.172813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.117291+0000","last_change":"2023-11-04T01:44:42.903075+0000","last_active":"2023-11-04T01:45:04.117291+0000","last_peered":"2023-11-04T01:45:04.117291+0000","last_clean":"2023-11-04T01:45:04.117291+0000","last_became_active":"2023-11-04T01:44:40.942840+0000","last_became_peered":"2023-11-04T01:44:40.942840+0000","last_unstale":"2023-11-04T01:45:04.117291+0000","last_undegraded":"2023-11-04T01:45:04.117291+0000","last_fullsized":"2023-11-04T01:45:04.117291+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:04.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015750029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127719+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:45:03.127719+0000","last_peered":"2023-11-04T01:45:03.127719+0000","last_clean":"2023-11-04T01:45:03.127719+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:45:03.127719+0000","last_undegraded":"2023-11-04T01:45:03.127719+0000","last_fullsized":"2023-11-04T01:45:03.127719+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096282+0000","last_change":"2023-11-04T01:45:04.131711+0000","last_active":"2023-11-04T01:45:05.096282+0000","last_peered":"2023-11-04T01:45:05.096282+0000","last_clean":"2023-11-04T01:45:05.096282+0000","last_became_active":"2023-11-04T01:45:04.130929+0000","last_became_peered":"2023-11-04T01:45:04.130929+0000","last_unstale":"2023-11-04T01:45:05.096282+0000","last_undegraded":"2023-11-04T01:45:05.096282+0000","last_fullsized":"2023-11-04T01:45:05.096282+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:56:46.899099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.099241+0000","last_change":"2023-11-04T01:45:03.120950+0000","last_active":"2023-11-04T01:45:05.099241+0000","last_peered":"2023-11-04T01:45:05.099241+0000","last_clean":"2023-11-04T01:45:05.099241+0000","last_became_active":"2023-11-04T01:45:03.120667+0000","last_became_peered":"2023-11-04T01:45:03.120667+0000","last_unstale":"2023-11-04T01:45:05.099241+0000","last_undegraded":"2023-11-04T01:45:05.099241+0000","last_fullsized":"2023-11-04T01:45:05.099241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:38.603775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.128013+0000","last_change":"2023-11-04T01:44:41.918892+0000","last_active":"2023-11-04T01:45:04.128013+0000","last_peered":"2023-11-04T01:45:04.128013+0000","last_clean":"2023-11-04T01:45:04.128013+0000","last_became_active":"2023-11-04T01:44:41.917911+0000","last_became_peered":"2023-11-04T01:44:41.917911+0000","last_unstale":"2023-11-04T01:45:04.128013+0000","last_undegraded":"2023-11-04T01:45:04.128013+0000","last_fullsized":"2023-11-04T01:45:04.128013+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:53.093358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.104189+0000","last_change":"2023-11-04T01:44:43.177231+0000","last_active":"2023-11-04T01:45:04.104189+0000","last_peered":"2023-11-04T01:45:04.104189+0000","last_clean":"2023-11-04T01:45:04.104189+0000","last_became_active":"2023-11-04T01:44:40.929373+0000","last_became_peered":"2023-11-04T01:44:40.929373+0000","last_unstale":"2023-11-04T01:45:04.104189+0000","last_undegraded":"2023-11-04T01:45:04.104189+0000","last_fullsized":"2023-11-04T01:45:04.104189+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:03.457810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005564182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094642+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:45:04.094642+0000","last_peered":"2023-11-04T01:45:04.094642+0000","last_clean":"2023-11-04T01:45:04.094642+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:45:04.094642+0000","last_undegraded":"2023-11-04T01:45:04.094642+0000","last_fullsized":"2023-11-04T01:45:04.094642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135564+0000","last_change":"2023-11-04T01:45:04.124512+0000","last_active":"2023-11-04T01:45:04.135564+0000","last_peered":"2023-11-04T01:45:04.135564+0000","last_clean":"2023-11-04T01:45:04.135564+0000","last_became_active":"2023-11-04T01:45:04.123649+0000","last_became_peered":"2023-11-04T01:45:04.123649+0000","last_unstale":"2023-11-04T01:45:04.135564+0000","last_undegraded":"2023-11-04T01:45:04.135564+0000","last_fullsized":"2023-11-04T01:45:04.135564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432327+0000","last_change":"2023-11-04T01:45:03.131113+0000","last_active":"2023-11-04T01:45:06.432327+0000","last_peered":"2023-11-04T01:45:06.432327+0000","last_clean":"2023-11-04T01:45:06.432327+0000","last_became_active":"2023-11-04T01:45:03.130641+0000","last_became_peered":"2023-11-04T01:45:03.130641+0000","last_unstale":"2023-11-04T01:45:06.432327+0000","last_undegraded":"2023-11-04T01:45:06.432327+0000","last_fullsized":"2023-11-04T01:45:06.432327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:51.329197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093302+0000","last_change":"2023-11-04T01:44:41.918887+0000","last_active":"2023-11-04T01:45:04.093302+0000","last_peered":"2023-11-04T01:45:04.093302+0000","last_clean":"2023-11-04T01:45:04.093302+0000","last_became_active":"2023-11-04T01:44:41.918464+0000","last_became_peered":"2023-11-04T01:44:41.918464+0000","last_unstale":"2023-11-04T01:45:04.093302+0000","last_undegraded":"2023-11-04T01:45:04.093302+0000","last_fullsized":"2023-11-04T01:45:04.093302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:59.577071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.108093+0000","last_change":"2023-11-04T01:44:43.174324+0000","last_active":"2023-11-04T01:45:04.108093+0000","last_peered":"2023-11-04T01:45:04.108093+0000","last_clean":"2023-11-04T01:45:04.108093+0000","last_became_active":"2023-11-04T01:44:40.924963+0000","last_became_peered":"2023-11-04T01:44:40.924963+0000","last_unstale":"2023-11-04T01:45:04.108093+0000","last_undegraded":"2023-11-04T01:45:04.108093+0000","last_fullsized":"2023-11-04T01:45:04.108093+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:49:16.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016466950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094446+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:45:04.094446+0000","last_peered":"2023-11-04T01:45:04.094446+0000","last_clean":"2023-11-04T01:45:04.094446+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:45:04.094446+0000","last_undegraded":"2023-11-04T01:45:04.094446+0000","last_fullsized":"2023-11-04T01:45:04.094446+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097774+0000","last_change":"2023-11-04T01:45:04.145720+0000","last_active":"2023-11-04T01:45:05.097774+0000","last_peered":"2023-11-04T01:45:05.097774+0000","last_clean":"2023-11-04T01:45:05.097774+0000","last_became_active":"2023-11-04T01:45:04.145429+0000","last_became_peered":"2023-11-04T01:45:04.145429+0000","last_unstale":"2023-11-04T01:45:05.097774+0000","last_undegraded":"2023-11-04T01:45:05.097774+0000","last_fullsized":"2023-11-04T01:45:05.097774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:28:51.374198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432538+0000","last_change":"2023-11-04T01:45:03.117374+0000","last_active":"2023-11-04T01:45:06.432538+0000","last_peered":"2023-11-04T01:45:06.432538+0000","last_clean":"2023-11-04T01:45:06.432538+0000","last_became_active":"2023-11-04T01:45:03.116962+0000","last_became_peered":"2023-11-04T01:45:03.116962+0000","last_unstale":"2023-11-04T01:45:06.432538+0000","last_undegraded":"2023-11-04T01:45:06.432538+0000","last_fullsized":"2023-11-04T01:45:06.432538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:21.825258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103488+0000","last_change":"2023-11-04T01:44:41.929589+0000","last_active":"2023-11-04T01:45:04.103488+0000","last_peered":"2023-11-04T01:45:04.103488+0000","last_clean":"2023-11-04T01:45:04.103488+0000","last_became_active":"2023-11-04T01:44:41.929209+0000","last_became_peered":"2023-11-04T01:44:41.929209+0000","last_unstale":"2023-11-04T01:45:04.103488+0000","last_undegraded":"2023-11-04T01:45:04.103488+0000","last_fullsized":"2023-11-04T01:45:04.103488+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:56.528258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106333+0000","last_change":"2023-11-04T01:44:43.175322+0000","last_active":"2023-11-04T01:45:03.106333+0000","last_peered":"2023-11-04T01:45:03.106333+0000","last_clean":"2023-11-04T01:45:03.106333+0000","last_became_active":"2023-11-04T01:44:40.931389+0000","last_became_peered":"2023-11-04T01:44:40.931389+0000","last_unstale":"2023-11-04T01:45:03.106333+0000","last_undegraded":"2023-11-04T01:45:03.106333+0000","last_fullsized":"2023-11-04T01:45:03.106333+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022947649999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116090+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:45:04.116090+0000","last_peered":"2023-11-04T01:45:04.116090+0000","last_clean":"2023-11-04T01:45:04.116090+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:45:04.116090+0000","last_undegraded":"2023-11-04T01:45:04.116090+0000","last_fullsized":"2023-11-04T01:45:04.116090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097440+0000","last_change":"2023-11-04T01:45:04.144745+0000","last_active":"2023-11-04T01:45:05.097440+0000","last_peered":"2023-11-04T01:45:05.097440+0000","last_clean":"2023-11-04T01:45:05.097440+0000","last_became_active":"2023-11-04T01:45:04.129378+0000","last_became_peered":"2023-11-04T01:45:04.129378+0000","last_unstale":"2023-11-04T01:45:05.097440+0000","last_undegraded":"2023-11-04T01:45:05.097440+0000","last_fullsized":"2023-11-04T01:45:05.097440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:27.109383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411619+0000","last_change":"2023-11-04T01:45:03.144010+0000","last_active":"2023-11-04T01:45:05.411619+0000","last_peered":"2023-11-04T01:45:05.411619+0000","last_clean":"2023-11-04T01:45:05.411619+0000","last_became_active":"2023-11-04T01:45:03.143319+0000","last_became_peered":"2023-11-04T01:45:03.143319+0000","last_unstale":"2023-11-04T01:45:05.411619+0000","last_undegraded":"2023-11-04T01:45:05.411619+0000","last_fullsized":"2023-11-04T01:45:05.411619+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:48.392129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109407+0000","last_change":"2023-11-04T01:44:41.935051+0000","last_active":"2023-11-04T01:45:03.109407+0000","last_peered":"2023-11-04T01:45:03.109407+0000","last_clean":"2023-11-04T01:45:03.109407+0000","last_became_active":"2023-11-04T01:44:41.934245+0000","last_became_peered":"2023-11-04T01:44:41.934245+0000","last_unstale":"2023-11-04T01:45:03.109407+0000","last_undegraded":"2023-11-04T01:45:03.109407+0000","last_fullsized":"2023-11-04T01:45:03.109407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:58.744375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101655+0000","last_change":"2023-11-04T01:44:43.174084+0000","last_active":"2023-11-04T01:45:04.101655+0000","last_peered":"2023-11-04T01:45:04.101655+0000","last_clean":"2023-11-04T01:45:04.101655+0000","last_became_active":"2023-11-04T01:44:40.923078+0000","last_became_peered":"2023-11-04T01:44:40.923078+0000","last_unstale":"2023-11-04T01:45:04.101655+0000","last_undegraded":"2023-11-04T01:45:04.101655+0000","last_fullsized":"2023-11-04T01:45:04.101655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:30.967677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015459650000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.120650+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:45:04.120650+0000","last_peered":"2023-11-04T01:45:04.120650+0000","last_clean":"2023-11-04T01:45:04.120650+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:45:04.120650+0000","last_undegraded":"2023-11-04T01:45:04.120650+0000","last_fullsized":"2023-11-04T01:45:04.120650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.163393+0000","last_change":"2023-11-04T01:45:04.155555+0000","last_active":"2023-11-04T01:45:04.163393+0000","last_peered":"2023-11-04T01:45:04.163393+0000","last_clean":"2023-11-04T01:45:04.163393+0000","last_became_active":"2023-11-04T01:45:04.154964+0000","last_became_peered":"2023-11-04T01:45:04.154964+0000","last_unstale":"2023-11-04T01:45:04.163393+0000","last_undegraded":"2023-11-04T01:45:04.163393+0000","last_fullsized":"2023-11-04T01:45:04.163393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:40.511964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432872+0000","last_change":"2023-11-04T01:45:03.119062+0000","last_active":"2023-11-04T01:45:06.432872+0000","last_peered":"2023-11-04T01:45:06.432872+0000","last_clean":"2023-11-04T01:45:06.432872+0000","last_became_active":"2023-11-04T01:45:03.118627+0000","last_became_peered":"2023-11-04T01:45:03.118627+0000","last_unstale":"2023-11-04T01:45:06.432872+0000","last_undegraded":"2023-11-04T01:45:06.432872+0000","last_fullsized":"2023-11-04T01:45:06.432872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:37.556118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.113397+0000","last_change":"2023-11-04T01:44:41.916693+0000","last_active":"2023-11-04T01:45:04.113397+0000","last_peered":"2023-11-04T01:45:04.113397+0000","last_clean":"2023-11-04T01:45:04.113397+0000","last_became_active":"2023-11-04T01:44:41.914418+0000","last_became_peered":"2023-11-04T01:44:41.914418+0000","last_unstale":"2023-11-04T01:45:04.113397+0000","last_undegraded":"2023-11-04T01:45:04.113397+0000","last_fullsized":"2023-11-04T01:45:04.113397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:02.978838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094176+0000","last_change":"2023-11-04T01:44:42.903798+0000","last_active":"2023-11-04T01:45:04.094176+0000","last_peered":"2023-11-04T01:45:04.094176+0000","last_clean":"2023-11-04T01:45:04.094176+0000","last_became_active":"2023-11-04T01:44:40.921927+0000","last_became_peered":"2023-11-04T01:44:40.921927+0000","last_unstale":"2023-11-04T01:45:04.094176+0000","last_undegraded":"2023-11-04T01:45:04.094176+0000","last_fullsized":"2023-11-04T01:45:04.094176+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:41.296405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018315269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.115689+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:45:04.115689+0000","last_peered":"2023-11-04T01:45:04.115689+0000","last_clean":"2023-11-04T01:45:04.115689+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:45:04.115689+0000","last_undegraded":"2023-11-04T01:45:04.115689+0000","last_fullsized":"2023-11-04T01:45:04.115689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135145+0000","last_change":"2023-11-04T01:45:04.133109+0000","last_active":"2023-11-04T01:45:04.135145+0000","last_peered":"2023-11-04T01:45:04.135145+0000","last_clean":"2023-11-04T01:45:04.135145+0000","last_became_active":"2023-11-04T01:45:04.132752+0000","last_became_peered":"2023-11-04T01:45:04.132752+0000","last_unstale":"2023-11-04T01:45:04.135145+0000","last_undegraded":"2023-11-04T01:45:04.135145+0000","last_fullsized":"2023-11-04T01:45:04.135145+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.105449+0000","last_change":"2023-11-04T01:45:03.126241+0000","last_active":"2023-11-04T01:45:04.105449+0000","last_peered":"2023-11-04T01:45:04.105449+0000","last_clean":"2023-11-04T01:45:04.105449+0000","last_became_active":"2023-11-04T01:45:03.125856+0000","last_became_peered":"2023-11-04T01:45:03.125856+0000","last_unstale":"2023-11-04T01:45:04.105449+0000","last_undegraded":"2023-11-04T01:45:04.105449+0000","last_fullsized":"2023-11-04T01:45:04.105449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:40:45.346926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109267+0000","last_change":"2023-11-04T01:44:41.944011+0000","last_active":"2023-11-04T01:45:03.109267+0000","last_peered":"2023-11-04T01:45:03.109267+0000","last_clean":"2023-11-04T01:45:03.109267+0000","last_became_active":"2023-11-04T01:44:41.943702+0000","last_became_peered":"2023-11-04T01:44:41.943702+0000","last_unstale":"2023-11-04T01:45:03.109267+0000","last_undegraded":"2023-11-04T01:45:03.109267+0000","last_fullsized":"2023-11-04T01:45:03.109267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:57.519730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.122110+0000","last_change":"2023-11-04T01:44:42.902919+0000","last_active":"2023-11-04T01:45:04.122110+0000","last_peered":"2023-11-04T01:45:04.122110+0000","last_clean":"2023-11-04T01:45:04.122110+0000","last_became_active":"2023-11-04T01:44:40.918933+0000","last_became_peered":"2023-11-04T01:44:40.918933+0000","last_unstale":"2023-11-04T01:45:04.122110+0000","last_undegraded":"2023-11-04T01:45:04.122110+0000","last_fullsized":"2023-11-04T01:45:04.122110+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:47.321809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002224087,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.110609+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:45:04.110609+0000","last_peered":"2023-11-04T01:45:04.110609+0000","last_clean":"2023-11-04T01:45:04.110609+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:45:04.110609+0000","last_undegraded":"2023-11-04T01:45:04.110609+0000","last_fullsized":"2023-11-04T01:45:04.110609+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434321+0000","last_change":"2023-11-04T01:45:04.133624+0000","last_active":"2023-11-04T01:45:06.434321+0000","last_peered":"2023-11-04T01:45:06.434321+0000","last_clean":"2023-11-04T01:45:06.434321+0000","last_became_active":"2023-11-04T01:45:04.132951+0000","last_became_peered":"2023-11-04T01:45:04.132951+0000","last_unstale":"2023-11-04T01:45:06.434321+0000","last_undegraded":"2023-11-04T01:45:06.434321+0000","last_fullsized":"2023-11-04T01:45:06.434321+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.095456+0000","last_change":"2023-11-04T01:45:03.127489+0000","last_active":"2023-11-04T01:45:05.095456+0000","last_peered":"2023-11-04T01:45:05.095456+0000","last_clean":"2023-11-04T01:45:05.095456+0000","last_became_active":"2023-11-04T01:45:03.127137+0000","last_became_peered":"2023-11-04T01:45:03.127137+0000","last_unstale":"2023-11-04T01:45:05.095456+0000","last_undegraded":"2023-11-04T01:45:05.095456+0000","last_fullsized":"2023-11-04T01:45:05.095456+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:36:40.560900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094420+0000","last_change":"2023-11-04T01:44:41.926845+0000","last_active":"2023-11-04T01:45:04.094420+0000","last_peered":"2023-11-04T01:45:04.094420+0000","last_clean":"2023-11-04T01:45:04.094420+0000","last_became_active":"2023-11-04T01:44:41.926160+0000","last_became_peered":"2023-11-04T01:44:41.926160+0000","last_unstale":"2023-11-04T01:45:04.094420+0000","last_undegraded":"2023-11-04T01:45:04.094420+0000","last_fullsized":"2023-11-04T01:45:04.094420+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:09.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.104549+0000","last_change":"2023-11-04T01:44:43.172635+0000","last_active":"2023-11-04T01:45:03.104549+0000","last_peered":"2023-11-04T01:45:03.104549+0000","last_clean":"2023-11-04T01:45:03.104549+0000","last_became_active":"2023-11-04T01:44:40.944235+0000","last_became_peered":"2023-11-04T01:44:40.944235+0000","last_unstale":"2023-11-04T01:45:03.104549+0000","last_undegraded":"2023-11-04T01:45:03.104549+0000","last_fullsized":"2023-11-04T01:45:03.104549+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:23.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025398959999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106500+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:45:03.106500+0000","last_peered":"2023-11-04T01:45:03.106500+0000","last_clean":"2023-11-04T01:45:03.106500+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:45:03.106500+0000","last_undegraded":"2023-11-04T01:45:03.106500+0000","last_fullsized":"2023-11-04T01:45:03.106500+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.138380+0000","last_change":"2023-11-04T01:45:04.133627+0000","last_active":"2023-11-04T01:45:04.138380+0000","last_peered":"2023-11-04T01:45:04.138380+0000","last_clean":"2023-11-04T01:45:04.138380+0000","last_became_active":"2023-11-04T01:45:04.133260+0000","last_became_peered":"2023-11-04T01:45:04.133260+0000","last_unstale":"2023-11-04T01:45:04.138380+0000","last_undegraded":"2023-11-04T01:45:04.138380+0000","last_fullsized":"2023-11-04T01:45:04.138380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:52:40.425687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096078+0000","last_change":"2023-11-04T01:45:03.121289+0000","last_active":"2023-11-04T01:45:05.096078+0000","last_peered":"2023-11-04T01:45:05.096078+0000","last_clean":"2023-11-04T01:45:05.096078+0000","last_became_active":"2023-11-04T01:45:03.120805+0000","last_became_peered":"2023-11-04T01:45:03.120805+0000","last_unstale":"2023-11-04T01:45:05.096078+0000","last_undegraded":"2023-11-04T01:45:05.096078+0000","last_fullsized":"2023-11-04T01:45:05.096078+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:00:35.388907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103720+0000","last_change":"2023-11-04T01:44:41.927015+0000","last_active":"2023-11-04T01:45:04.103720+0000","last_peered":"2023-11-04T01:45:04.103720+0000","last_clean":"2023-11-04T01:45:04.103720+0000","last_became_active":"2023-11-04T01:44:41.926208+0000","last_became_peered":"2023-11-04T01:44:41.926208+0000","last_unstale":"2023-11-04T01:45:04.103720+0000","last_undegraded":"2023-11-04T01:45:04.103720+0000","last_fullsized":"2023-11-04T01:45:04.103720+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:33.265407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094629+0000","last_change":"2023-11-04T01:44:42.903587+0000","last_active":"2023-11-04T01:45:04.094629+0000","last_peered":"2023-11-04T01:45:04.094629+0000","last_clean":"2023-11-04T01:45:04.094629+0000","last_became_active":"2023-11-04T01:44:40.914477+0000","last_became_peered":"2023-11-04T01:44:40.914477+0000","last_unstale":"2023-11-04T01:45:04.094629+0000","last_undegraded":"2023-11-04T01:45:04.094629+0000","last_fullsized":"2023-11-04T01:45:04.094629+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.324851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021038049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.102821+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:45:04.102821+0000","last_peered":"2023-11-04T01:45:04.102821+0000","last_clean":"2023-11-04T01:45:04.102821+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:45:04.102821+0000","last_undegraded":"2023-11-04T01:45:04.102821+0000","last_fullsized":"2023-11-04T01:45:04.102821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.135104+0000","last_change":"2023-11-04T01:45:04.130675+0000","last_active":"2023-11-04T01:45:04.135104+0000","last_peered":"2023-11-04T01:45:04.135104+0000","last_clean":"2023-11-04T01:45:04.135104+0000","last_became_active":"2023-11-04T01:45:04.130191+0000","last_became_peered":"2023-11-04T01:45:04.130191+0000","last_unstale":"2023-11-04T01:45:04.135104+0000","last_undegraded":"2023-11-04T01:45:04.135104+0000","last_fullsized":"2023-11-04T01:45:04.135104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:57.946591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096525+0000","last_change":"2023-11-04T01:45:03.121322+0000","last_active":"2023-11-04T01:45:05.096525+0000","last_peered":"2023-11-04T01:45:05.096525+0000","last_clean":"2023-11-04T01:45:05.096525+0000","last_became_active":"2023-11-04T01:45:03.120985+0000","last_became_peered":"2023-11-04T01:45:03.120985+0000","last_unstale":"2023-11-04T01:45:05.096525+0000","last_undegraded":"2023-11-04T01:45:05.096525+0000","last_fullsized":"2023-11-04T01:45:05.096525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:19.631540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.128926+0000","last_change":"2023-11-04T01:44:41.932084+0000","last_active":"2023-11-04T01:45:03.128926+0000","last_peered":"2023-11-04T01:45:03.128926+0000","last_clean":"2023-11-04T01:45:03.128926+0000","last_became_active":"2023-11-04T01:44:41.931308+0000","last_became_peered":"2023-11-04T01:44:41.931308+0000","last_unstale":"2023-11-04T01:45:03.128926+0000","last_undegraded":"2023-11-04T01:45:03.128926+0000","last_fullsized":"2023-11-04T01:45:03.128926+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:02.241295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103980+0000","last_change":"2023-11-04T01:44:43.175475+0000","last_active":"2023-11-04T01:45:04.103980+0000","last_peered":"2023-11-04T01:45:04.103980+0000","last_clean":"2023-11-04T01:45:04.103980+0000","last_became_active":"2023-11-04T01:44:40.930314+0000","last_became_peered":"2023-11-04T01:44:40.930314+0000","last_unstale":"2023-11-04T01:45:04.103980+0000","last_undegraded":"2023-11-04T01:45:04.103980+0000","last_fullsized":"2023-11-04T01:45:04.103980+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:59.746779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042346939999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101860+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:45:04.101860+0000","last_peered":"2023-11-04T01:45:04.101860+0000","last_clean":"2023-11-04T01:45:04.101860+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:45:04.101860+0000","last_undegraded":"2023-11-04T01:45:04.101860+0000","last_fullsized":"2023-11-04T01:45:04.101860+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.097460+0000","last_change":"2023-11-04T01:45:04.150277+0000","last_active":"2023-11-04T01:45:05.097460+0000","last_peered":"2023-11-04T01:45:05.097460+0000","last_clean":"2023-11-04T01:45:05.097460+0000","last_became_active":"2023-11-04T01:45:04.149979+0000","last_became_peered":"2023-11-04T01:45:04.149979+0000","last_unstale":"2023-11-04T01:45:05.097460+0000","last_undegraded":"2023-11-04T01:45:05.097460+0000","last_fullsized":"2023-11-04T01:45:05.097460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:21.516748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.125253+0000","last_change":"2023-11-04T01:45:03.137987+0000","last_active":"2023-11-04T01:45:04.125253+0000","last_peered":"2023-11-04T01:45:04.125253+0000","last_clean":"2023-11-04T01:45:04.125253+0000","last_became_active":"2023-11-04T01:45:03.137175+0000","last_became_peered":"2023-11-04T01:45:03.137175+0000","last_unstale":"2023-11-04T01:45:04.125253+0000","last_undegraded":"2023-11-04T01:45:04.125253+0000","last_fullsized":"2023-11-04T01:45:04.125253+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:15:28.709088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.128234+0000","last_change":"2023-11-04T01:44:41.921366+0000","last_active":"2023-11-04T01:45:03.128234+0000","last_peered":"2023-11-04T01:45:03.128234+0000","last_clean":"2023-11-04T01:45:03.128234+0000","last_became_active":"2023-11-04T01:44:41.920641+0000","last_became_peered":"2023-11-04T01:44:41.920641+0000","last_unstale":"2023-11-04T01:45:03.128234+0000","last_undegraded":"2023-11-04T01:45:03.128234+0000","last_fullsized":"2023-11-04T01:45:03.128234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.316345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.129049+0000","last_change":"2023-11-04T01:44:43.113042+0000","last_active":"2023-11-04T01:45:03.129049+0000","last_peered":"2023-11-04T01:45:03.129049+0000","last_clean":"2023-11-04T01:45:03.129049+0000","last_became_active":"2023-11-04T01:44:40.944546+0000","last_became_peered":"2023-11-04T01:44:40.944546+0000","last_unstale":"2023-11-04T01:45:03.129049+0000","last_undegraded":"2023-11-04T01:45:03.129049+0000","last_fullsized":"2023-11-04T01:45:03.129049+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:09.170503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00104459,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.095131+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:45:04.095131+0000","last_peered":"2023-11-04T01:45:04.095131+0000","last_clean":"2023-11-04T01:45:04.095131+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:45:04.095131+0000","last_undegraded":"2023-11-04T01:45:04.095131+0000","last_fullsized":"2023-11-04T01:45:04.095131+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.412158+0000","last_change":"2023-11-04T01:45:04.137617+0000","last_active":"2023-11-04T01:45:05.412158+0000","last_peered":"2023-11-04T01:45:05.412158+0000","last_clean":"2023-11-04T01:45:05.412158+0000","last_became_active":"2023-11-04T01:45:04.137018+0000","last_became_peered":"2023-11-04T01:45:04.137018+0000","last_unstale":"2023-11-04T01:45:05.412158+0000","last_undegraded":"2023-11-04T01:45:05.412158+0000","last_fullsized":"2023-11-04T01:45:05.412158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:59:03.633030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432328+0000","last_change":"2023-11-04T01:45:03.137935+0000","last_active":"2023-11-04T01:45:06.432328+0000","last_peered":"2023-11-04T01:45:06.432328+0000","last_clean":"2023-11-04T01:45:06.432328+0000","last_became_active":"2023-11-04T01:45:03.137485+0000","last_became_peered":"2023-11-04T01:45:03.137485+0000","last_unstale":"2023-11-04T01:45:06.432328+0000","last_undegraded":"2023-11-04T01:45:06.432328+0000","last_fullsized":"2023-11-04T01:45:06.432328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:20:09.334597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127370+0000","last_change":"2023-11-04T01:44:41.944522+0000","last_active":"2023-11-04T01:45:03.127370+0000","last_peered":"2023-11-04T01:45:03.127370+0000","last_clean":"2023-11-04T01:45:03.127370+0000","last_became_active":"2023-11-04T01:44:41.943801+0000","last_became_peered":"2023-11-04T01:44:41.943801+0000","last_unstale":"2023-11-04T01:45:03.127370+0000","last_undegraded":"2023-11-04T01:45:03.127370+0000","last_fullsized":"2023-11-04T01:45:03.127370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:01.424092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126664+0000","last_change":"2023-11-04T01:44:42.907186+0000","last_active":"2023-11-04T01:45:04.126664+0000","last_peered":"2023-11-04T01:45:04.126664+0000","last_clean":"2023-11-04T01:45:04.126664+0000","last_became_active":"2023-11-04T01:44:40.918060+0000","last_became_peered":"2023-11-04T01:44:40.918060+0000","last_unstale":"2023-11-04T01:45:04.126664+0000","last_undegraded":"2023-11-04T01:45:04.126664+0000","last_fullsized":"2023-11-04T01:45:04.126664+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:29.430028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016383540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.126794+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:45:03.126794+0000","last_peered":"2023-11-04T01:45:03.126794+0000","last_clean":"2023-11-04T01:45:03.126794+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:45:03.126794+0000","last_undegraded":"2023-11-04T01:45:03.126794+0000","last_fullsized":"2023-11-04T01:45:03.126794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.142256+0000","last_change":"2023-11-04T01:45:04.137444+0000","last_active":"2023-11-04T01:45:04.142256+0000","last_peered":"2023-11-04T01:45:04.142256+0000","last_clean":"2023-11-04T01:45:04.142256+0000","last_became_active":"2023-11-04T01:45:04.137117+0000","last_became_peered":"2023-11-04T01:45:04.137117+0000","last_unstale":"2023-11-04T01:45:04.142256+0000","last_undegraded":"2023-11-04T01:45:04.142256+0000","last_fullsized":"2023-11-04T01:45:04.142256+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:45.466522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.162039+0000","last_change":"2023-11-04T01:45:03.134341+0000","last_active":"2023-11-04T01:45:04.162039+0000","last_peered":"2023-11-04T01:45:04.162039+0000","last_clean":"2023-11-04T01:45:04.162039+0000","last_became_active":"2023-11-04T01:45:03.133098+0000","last_became_peered":"2023-11-04T01:45:03.133098+0000","last_unstale":"2023-11-04T01:45:04.162039+0000","last_undegraded":"2023-11-04T01:45:04.162039+0000","last_fullsized":"2023-11-04T01:45:04.162039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:14.278347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109130+0000","last_change":"2023-11-04T01:44:41.934242+0000","last_active":"2023-11-04T01:45:03.109130+0000","last_peered":"2023-11-04T01:45:03.109130+0000","last_clean":"2023-11-04T01:45:03.109130+0000","last_became_active":"2023-11-04T01:44:41.933915+0000","last_became_peered":"2023-11-04T01:44:41.933915+0000","last_unstale":"2023-11-04T01:45:03.109130+0000","last_undegraded":"2023-11-04T01:45:03.109130+0000","last_fullsized":"2023-11-04T01:45:03.109130+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:00.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101437+0000","last_change":"2023-11-04T01:44:43.173395+0000","last_active":"2023-11-04T01:45:04.101437+0000","last_peered":"2023-11-04T01:45:04.101437+0000","last_clean":"2023-11-04T01:45:04.101437+0000","last_became_active":"2023-11-04T01:44:40.917492+0000","last_became_peered":"2023-11-04T01:44:40.917492+0000","last_unstale":"2023-11-04T01:45:04.101437+0000","last_undegraded":"2023-11-04T01:45:04.101437+0000","last_fullsized":"2023-11-04T01:45:04.101437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:09.142444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012455719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116927+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:45:04.116927+0000","last_peered":"2023-11-04T01:45:04.116927+0000","last_clean":"2023-11-04T01:45:04.116927+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:45:04.116927+0000","last_undegraded":"2023-11-04T01:45:04.116927+0000","last_fullsized":"2023-11-04T01:45:04.116927+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.094643+0000","last_change":"2023-11-04T01:45:04.158816+0000","last_active":"2023-11-04T01:45:05.094643+0000","last_peered":"2023-11-04T01:45:05.094643+0000","last_clean":"2023-11-04T01:45:05.094643+0000","last_became_active":"2023-11-04T01:45:04.158474+0000","last_became_peered":"2023-11-04T01:45:04.158474+0000","last_unstale":"2023-11-04T01:45:05.094643+0000","last_undegraded":"2023-11-04T01:45:05.094643+0000","last_fullsized":"2023-11-04T01:45:05.094643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:23.611357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.144727+0000","last_change":"2023-11-04T01:45:03.139843+0000","last_active":"2023-11-04T01:45:04.144727+0000","last_peered":"2023-11-04T01:45:04.144727+0000","last_clean":"2023-11-04T01:45:04.144727+0000","last_became_active":"2023-11-04T01:45:03.139021+0000","last_became_peered":"2023-11-04T01:45:03.139021+0000","last_unstale":"2023-11-04T01:45:04.144727+0000","last_undegraded":"2023-11-04T01:45:04.144727+0000","last_fullsized":"2023-11-04T01:45:04.144727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:37:09.516600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093582+0000","last_change":"2023-11-04T01:44:41.914046+0000","last_active":"2023-11-04T01:45:04.093582+0000","last_peered":"2023-11-04T01:45:04.093582+0000","last_clean":"2023-11-04T01:45:04.093582+0000","last_became_active":"2023-11-04T01:44:41.913611+0000","last_became_peered":"2023-11-04T01:44:41.913611+0000","last_unstale":"2023-11-04T01:45:04.093582+0000","last_undegraded":"2023-11-04T01:45:04.093582+0000","last_fullsized":"2023-11-04T01:45:04.093582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:00.756582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109608+0000","last_change":"2023-11-04T01:44:43.177428+0000","last_active":"2023-11-04T01:45:03.109608+0000","last_peered":"2023-11-04T01:45:03.109608+0000","last_clean":"2023-11-04T01:45:03.109608+0000","last_became_active":"2023-11-04T01:44:40.909113+0000","last_became_peered":"2023-11-04T01:44:40.909113+0000","last_unstale":"2023-11-04T01:45:03.109608+0000","last_undegraded":"2023-11-04T01:45:03.109608+0000","last_fullsized":"2023-11-04T01:45:03.109608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:27.620457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001590373,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100450+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:45:04.100450+0000","last_peered":"2023-11-04T01:45:04.100450+0000","last_clean":"2023-11-04T01:45:04.100450+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:45:04.100450+0000","last_undegraded":"2023-11-04T01:45:04.100450+0000","last_fullsized":"2023-11-04T01:45:04.100450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096082+0000","last_change":"2023-11-04T01:45:04.124199+0000","last_active":"2023-11-04T01:45:05.096082+0000","last_peered":"2023-11-04T01:45:05.096082+0000","last_clean":"2023-11-04T01:45:05.096082+0000","last_became_active":"2023-11-04T01:45:04.122519+0000","last_became_peered":"2023-11-04T01:45:04.122519+0000","last_unstale":"2023-11-04T01:45:05.096082+0000","last_undegraded":"2023-11-04T01:45:05.096082+0000","last_fullsized":"2023-11-04T01:45:05.096082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:10.478508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433802+0000","last_change":"2023-11-04T01:45:03.147696+0000","last_active":"2023-11-04T01:45:06.433802+0000","last_peered":"2023-11-04T01:45:06.433802+0000","last_clean":"2023-11-04T01:45:06.433802+0000","last_became_active":"2023-11-04T01:45:03.147230+0000","last_became_peered":"2023-11-04T01:45:03.147230+0000","last_unstale":"2023-11-04T01:45:06.433802+0000","last_undegraded":"2023-11-04T01:45:06.433802+0000","last_fullsized":"2023-11-04T01:45:06.433802+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:47:43.928183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106265+0000","last_change":"2023-11-04T01:44:41.932864+0000","last_active":"2023-11-04T01:45:03.106265+0000","last_peered":"2023-11-04T01:45:03.106265+0000","last_clean":"2023-11-04T01:45:03.106265+0000","last_became_active":"2023-11-04T01:44:41.932047+0000","last_became_peered":"2023-11-04T01:44:41.932047+0000","last_unstale":"2023-11-04T01:45:03.106265+0000","last_undegraded":"2023-11-04T01:45:03.106265+0000","last_fullsized":"2023-11-04T01:45:03.106265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109249+0000","last_change":"2023-11-04T01:44:43.176420+0000","last_active":"2023-11-04T01:45:03.109249+0000","last_peered":"2023-11-04T01:45:03.109249+0000","last_clean":"2023-11-04T01:45:03.109249+0000","last_became_active":"2023-11-04T01:44:40.912610+0000","last_became_peered":"2023-11-04T01:44:40.912610+0000","last_unstale":"2023-11-04T01:45:03.109249+0000","last_undegraded":"2023-11-04T01:45:03.109249+0000","last_fullsized":"2023-11-04T01:45:03.109249+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:26.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010551130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.118291+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:45:04.118291+0000","last_peered":"2023-11-04T01:45:04.118291+0000","last_clean":"2023-11-04T01:45:04.118291+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:45:04.118291+0000","last_undegraded":"2023-11-04T01:45:04.118291+0000","last_fullsized":"2023-11-04T01:45:04.118291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.163485+0000","last_change":"2023-11-04T01:45:04.157605+0000","last_active":"2023-11-04T01:45:04.163485+0000","last_peered":"2023-11-04T01:45:04.163485+0000","last_clean":"2023-11-04T01:45:04.163485+0000","last_became_active":"2023-11-04T01:45:04.157198+0000","last_became_peered":"2023-11-04T01:45:04.157198+0000","last_unstale":"2023-11-04T01:45:04.163485+0000","last_undegraded":"2023-11-04T01:45:04.163485+0000","last_fullsized":"2023-11-04T01:45:04.163485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:52:38.245774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098279+0000","last_change":"2023-11-04T01:45:03.120368+0000","last_active":"2023-11-04T01:45:05.098279+0000","last_peered":"2023-11-04T01:45:05.098279+0000","last_clean":"2023-11-04T01:45:05.098279+0000","last_became_active":"2023-11-04T01:45:03.119921+0000","last_became_peered":"2023-11-04T01:45:03.119921+0000","last_unstale":"2023-11-04T01:45:05.098279+0000","last_undegraded":"2023-11-04T01:45:05.098279+0000","last_fullsized":"2023-11-04T01:45:05.098279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:16:51.329197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100659+0000","last_change":"2023-11-04T01:44:41.924679+0000","last_active":"2023-11-04T01:45:04.100659+0000","last_peered":"2023-11-04T01:45:04.100659+0000","last_clean":"2023-11-04T01:45:04.100659+0000","last_became_active":"2023-11-04T01:44:41.923856+0000","last_became_peered":"2023-11-04T01:44:41.923856+0000","last_unstale":"2023-11-04T01:45:04.100659+0000","last_undegraded":"2023-11-04T01:45:04.100659+0000","last_fullsized":"2023-11-04T01:45:04.100659+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:09.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.121386+0000","last_change":"2023-11-04T01:44:42.903545+0000","last_active":"2023-11-04T01:45:04.121386+0000","last_peered":"2023-11-04T01:45:04.121386+0000","last_clean":"2023-11-04T01:45:04.121386+0000","last_became_active":"2023-11-04T01:44:40.920627+0000","last_became_peered":"2023-11-04T01:44:40.920627+0000","last_unstale":"2023-11-04T01:45:04.121386+0000","last_undegraded":"2023-11-04T01:45:04.121386+0000","last_fullsized":"2023-11-04T01:45:04.121386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:23.948002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032735189999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.108463+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:45:04.108463+0000","last_peered":"2023-11-04T01:45:04.108463+0000","last_clean":"2023-11-04T01:45:04.108463+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:45:04.108463+0000","last_undegraded":"2023-11-04T01:45:04.108463+0000","last_fullsized":"2023-11-04T01:45:04.108463+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411188+0000","last_change":"2023-11-04T01:45:04.156790+0000","last_active":"2023-11-04T01:45:05.411188+0000","last_peered":"2023-11-04T01:45:05.411188+0000","last_clean":"2023-11-04T01:45:05.411188+0000","last_became_active":"2023-11-04T01:45:04.156521+0000","last_became_peered":"2023-11-04T01:45:04.156521+0000","last_unstale":"2023-11-04T01:45:05.411188+0000","last_undegraded":"2023-11-04T01:45:05.411188+0000","last_fullsized":"2023-11-04T01:45:05.411188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:37:10.528724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"79'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434685+0000","last_change":"2023-11-04T01:45:03.124669+0000","last_active":"2023-11-04T01:45:06.434685+0000","last_peered":"2023-11-04T01:45:06.434685+0000","last_clean":"2023-11-04T01:45:06.434685+0000","last_became_active":"2023-11-04T01:45:03.124253+0000","last_became_peered":"2023-11-04T01:45:03.124253+0000","last_unstale":"2023-11-04T01:45:06.434685+0000","last_undegraded":"2023-11-04T01:45:06.434685+0000","last_fullsized":"2023-11-04T01:45:06.434685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:26:18.704719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109681+0000","last_change":"2023-11-04T01:44:41.920012+0000","last_active":"2023-11-04T01:45:03.109681+0000","last_peered":"2023-11-04T01:45:03.109681+0000","last_clean":"2023-11-04T01:45:03.109681+0000","last_became_active":"2023-11-04T01:44:41.919196+0000","last_became_peered":"2023-11-04T01:44:41.919196+0000","last_unstale":"2023-11-04T01:45:03.109681+0000","last_undegraded":"2023-11-04T01:45:03.109681+0000","last_fullsized":"2023-11-04T01:45:03.109681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.168935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.113725+0000","last_change":"2023-11-04T01:44:42.902675+0000","last_active":"2023-11-04T01:45:04.113725+0000","last_peered":"2023-11-04T01:45:04.113725+0000","last_clean":"2023-11-04T01:45:04.113725+0000","last_became_active":"2023-11-04T01:44:40.923318+0000","last_became_peered":"2023-11-04T01:44:40.923318+0000","last_unstale":"2023-11-04T01:45:04.113725+0000","last_undegraded":"2023-11-04T01:45:04.113725+0000","last_fullsized":"2023-11-04T01:45:04.113725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:17.305049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022310820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116254+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:45:04.116254+0000","last_peered":"2023-11-04T01:45:04.116254+0000","last_clean":"2023-11-04T01:45:04.116254+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:45:04.116254+0000","last_undegraded":"2023-11-04T01:45:04.116254+0000","last_fullsized":"2023-11-04T01:45:04.116254+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098415+0000","last_change":"2023-11-04T01:45:04.145562+0000","last_active":"2023-11-04T01:45:05.098415+0000","last_peered":"2023-11-04T01:45:05.098415+0000","last_clean":"2023-11-04T01:45:05.098415+0000","last_became_active":"2023-11-04T01:45:04.145280+0000","last_became_peered":"2023-11-04T01:45:04.145280+0000","last_unstale":"2023-11-04T01:45:05.098415+0000","last_undegraded":"2023-11-04T01:45:05.098415+0000","last_fullsized":"2023-11-04T01:45:05.098415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:31:37.444567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"79'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.098722+0000","last_change":"2023-11-04T01:45:03.110619+0000","last_active":"2023-11-04T01:45:05.098722+0000","last_peered":"2023-11-04T01:45:05.098722+0000","last_clean":"2023-11-04T01:45:05.098722+0000","last_became_active":"2023-11-04T01:45:03.110285+0000","last_became_peered":"2023-11-04T01:45:03.110285+0000","last_unstale":"2023-11-04T01:45:05.098722+0000","last_undegraded":"2023-11-04T01:45:05.098722+0000","last_fullsized":"2023-11-04T01:45:05.098722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:44:21.825258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.127755+0000","last_change":"2023-11-04T01:44:41.925191+0000","last_active":"2023-11-04T01:45:04.127755+0000","last_peered":"2023-11-04T01:45:04.127755+0000","last_clean":"2023-11-04T01:45:04.127755+0000","last_became_active":"2023-11-04T01:44:41.924485+0000","last_became_peered":"2023-11-04T01:44:41.924485+0000","last_unstale":"2023-11-04T01:45:04.127755+0000","last_undegraded":"2023-11-04T01:45:04.127755+0000","last_fullsized":"2023-11-04T01:45:04.127755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:58:41.435918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103844+0000","last_change":"2023-11-04T01:44:43.174754+0000","last_active":"2023-11-04T01:45:04.103844+0000","last_peered":"2023-11-04T01:45:04.103844+0000","last_clean":"2023-11-04T01:45:04.103844+0000","last_became_active":"2023-11-04T01:44:40.921452+0000","last_became_peered":"2023-11-04T01:44:40.921452+0000","last_unstale":"2023-11-04T01:45:04.103844+0000","last_undegraded":"2023-11-04T01:45:04.103844+0000","last_fullsized":"2023-11-04T01:45:04.103844+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:08.209205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039894290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":51,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109993+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:45:03.109993+0000","last_peered":"2023-11-04T01:45:03.109993+0000","last_clean":"2023-11-04T01:45:03.109993+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:45:03.109993+0000","last_undegraded":"2023-11-04T01:45:03.109993+0000","last_fullsized":"2023-11-04T01:45:03.109993+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410741+0000","last_change":"2023-11-04T01:45:04.141096+0000","last_active":"2023-11-04T01:45:05.410741+0000","last_peered":"2023-11-04T01:45:05.410741+0000","last_clean":"2023-11-04T01:45:05.410741+0000","last_became_active":"2023-11-04T01:45:04.140574+0000","last_became_peered":"2023-11-04T01:45:04.140574+0000","last_unstale":"2023-11-04T01:45:05.410741+0000","last_undegraded":"2023-11-04T01:45:05.410741+0000","last_fullsized":"2023-11-04T01:45:05.410741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:47.154917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410719+0000","last_change":"2023-11-04T01:45:03.144587+0000","last_active":"2023-11-04T01:45:05.410719+0000","last_peered":"2023-11-04T01:45:05.410719+0000","last_clean":"2023-11-04T01:45:05.410719+0000","last_became_active":"2023-11-04T01:45:03.143278+0000","last_became_peered":"2023-11-04T01:45:03.143278+0000","last_unstale":"2023-11-04T01:45:05.410719+0000","last_undegraded":"2023-11-04T01:45:05.410719+0000","last_fullsized":"2023-11-04T01:45:05.410719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:37.556118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.103789+0000","last_change":"2023-11-04T01:44:41.925691+0000","last_active":"2023-11-04T01:45:04.103789+0000","last_peered":"2023-11-04T01:45:04.103789+0000","last_clean":"2023-11-04T01:45:04.103789+0000","last_became_active":"2023-11-04T01:44:41.924864+0000","last_became_peered":"2023-11-04T01:44:41.924864+0000","last_unstale":"2023-11-04T01:45:04.103789+0000","last_undegraded":"2023-11-04T01:45:04.103789+0000","last_fullsized":"2023-11-04T01:45:04.103789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:45.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.096531+0000","last_change":"2023-11-04T01:44:42.906340+0000","last_active":"2023-11-04T01:45:04.096531+0000","last_peered":"2023-11-04T01:45:04.096531+0000","last_clean":"2023-11-04T01:45:04.096531+0000","last_became_active":"2023-11-04T01:44:40.910288+0000","last_became_peered":"2023-11-04T01:44:40.910288+0000","last_unstale":"2023-11-04T01:45:04.096531+0000","last_undegraded":"2023-11-04T01:45:04.096531+0000","last_fullsized":"2023-11-04T01:45:04.096531+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:47.297826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042925560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.121206+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:45:04.121206+0000","last_peered":"2023-11-04T01:45:04.121206+0000","last_clean":"2023-11-04T01:45:04.121206+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:45:04.121206+0000","last_undegraded":"2023-11-04T01:45:04.121206+0000","last_fullsized":"2023-11-04T01:45:04.121206+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.125247+0000","last_change":"2023-11-04T01:45:04.118872+0000","last_active":"2023-11-04T01:45:04.125247+0000","last_peered":"2023-11-04T01:45:04.125247+0000","last_clean":"2023-11-04T01:45:04.125247+0000","last_became_active":"2023-11-04T01:45:04.118045+0000","last_became_peered":"2023-11-04T01:45:04.118045+0000","last_unstale":"2023-11-04T01:45:04.125247+0000","last_undegraded":"2023-11-04T01:45:04.125247+0000","last_fullsized":"2023-11-04T01:45:04.125247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"79'8","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.164054+0000","last_change":"2023-11-04T01:45:03.148766+0000","last_active":"2023-11-04T01:45:04.164054+0000","last_peered":"2023-11-04T01:45:04.164054+0000","last_clean":"2023-11-04T01:45:04.164054+0000","last_became_active":"2023-11-04T01:45:03.148025+0000","last_became_peered":"2023-11-04T01:45:03.148025+0000","last_unstale":"2023-11-04T01:45:04.164054+0000","last_undegraded":"2023-11-04T01:45:04.164054+0000","last_fullsized":"2023-11-04T01:45:04.164054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:14:01.334400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.108912+0000","last_change":"2023-11-04T01:44:41.918620+0000","last_active":"2023-11-04T01:45:03.108912+0000","last_peered":"2023-11-04T01:45:03.108912+0000","last_clean":"2023-11-04T01:45:03.108912+0000","last_became_active":"2023-11-04T01:44:41.918291+0000","last_became_peered":"2023-11-04T01:44:41.918291+0000","last_unstale":"2023-11-04T01:45:03.108912+0000","last_undegraded":"2023-11-04T01:45:03.108912+0000","last_fullsized":"2023-11-04T01:45:03.108912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.110059+0000","last_change":"2023-11-04T01:44:43.173305+0000","last_active":"2023-11-04T01:45:04.110059+0000","last_peered":"2023-11-04T01:45:04.110059+0000","last_clean":"2023-11-04T01:45:04.110059+0000","last_became_active":"2023-11-04T01:44:40.918163+0000","last_became_peered":"2023-11-04T01:44:40.918163+0000","last_unstale":"2023-11-04T01:45:04.110059+0000","last_undegraded":"2023-11-04T01:45:04.110059+0000","last_fullsized":"2023-11-04T01:45:04.110059+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:21.563078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011642689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.102427+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:45:04.102427+0000","last_peered":"2023-11-04T01:45:04.102427+0000","last_clean":"2023-11-04T01:45:04.102427+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:45:04.102427+0000","last_undegraded":"2023-11-04T01:45:04.102427+0000","last_fullsized":"2023-11-04T01:45:04.102427+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.410595+0000","last_change":"2023-11-04T01:45:04.136173+0000","last_active":"2023-11-04T01:45:05.410595+0000","last_peered":"2023-11-04T01:45:05.410595+0000","last_clean":"2023-11-04T01:45:05.410595+0000","last_became_active":"2023-11-04T01:45:04.135721+0000","last_became_peered":"2023-11-04T01:45:04.135721+0000","last_unstale":"2023-11-04T01:45:05.410595+0000","last_undegraded":"2023-11-04T01:45:05.410595+0000","last_fullsized":"2023-11-04T01:45:05.410595+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:50.290527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433532+0000","last_change":"2023-11-04T01:45:03.148299+0000","last_active":"2023-11-04T01:45:06.433532+0000","last_peered":"2023-11-04T01:45:06.433532+0000","last_clean":"2023-11-04T01:45:06.433532+0000","last_became_active":"2023-11-04T01:45:03.147980+0000","last_became_peered":"2023-11-04T01:45:03.147980+0000","last_unstale":"2023-11-04T01:45:06.433532+0000","last_undegraded":"2023-11-04T01:45:06.433532+0000","last_fullsized":"2023-11-04T01:45:06.433532+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:27.353924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.116254+0000","last_change":"2023-11-04T01:44:41.918947+0000","last_active":"2023-11-04T01:45:04.116254+0000","last_peered":"2023-11-04T01:45:04.116254+0000","last_clean":"2023-11-04T01:45:04.116254+0000","last_became_active":"2023-11-04T01:44:41.918140+0000","last_became_peered":"2023-11-04T01:44:41.918140+0000","last_unstale":"2023-11-04T01:45:04.116254+0000","last_undegraded":"2023-11-04T01:45:04.116254+0000","last_fullsized":"2023-11-04T01:45:04.116254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:58.268543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.106196+0000","last_change":"2023-11-04T01:44:43.173435+0000","last_active":"2023-11-04T01:45:03.106196+0000","last_peered":"2023-11-04T01:45:03.106196+0000","last_clean":"2023-11-04T01:45:03.106196+0000","last_became_active":"2023-11-04T01:44:40.934905+0000","last_became_peered":"2023-11-04T01:44:40.934905+0000","last_unstale":"2023-11-04T01:45:03.106196+0000","last_undegraded":"2023-11-04T01:45:03.106196+0000","last_fullsized":"2023-11-04T01:45:03.106196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:59.915687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324778,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.117306+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:45:04.117306+0000","last_peered":"2023-11-04T01:45:04.117306+0000","last_clean":"2023-11-04T01:45:04.117306+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:45:04.117306+0000","last_undegraded":"2023-11-04T01:45:04.117306+0000","last_fullsized":"2023-11-04T01:45:04.117306+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.432630+0000","last_change":"2023-11-04T01:45:04.132591+0000","last_active":"2023-11-04T01:45:06.432630+0000","last_peered":"2023-11-04T01:45:06.432630+0000","last_clean":"2023-11-04T01:45:06.432630+0000","last_became_active":"2023-11-04T01:45:04.132219+0000","last_became_peered":"2023-11-04T01:45:04.132219+0000","last_unstale":"2023-11-04T01:45:06.432630+0000","last_undegraded":"2023-11-04T01:45:06.432630+0000","last_fullsized":"2023-11-04T01:45:06.432630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:05:56.701946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411707+0000","last_change":"2023-11-04T01:45:03.135777+0000","last_active":"2023-11-04T01:45:05.411707+0000","last_peered":"2023-11-04T01:45:05.411707+0000","last_clean":"2023-11-04T01:45:05.411707+0000","last_became_active":"2023-11-04T01:45:03.134717+0000","last_became_peered":"2023-11-04T01:45:03.134717+0000","last_unstale":"2023-11-04T01:45:05.411707+0000","last_undegraded":"2023-11-04T01:45:05.411707+0000","last_fullsized":"2023-11-04T01:45:05.411707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:01:19.929364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.105143+0000","last_change":"2023-11-04T01:44:41.935218+0000","last_active":"2023-11-04T01:45:03.105143+0000","last_peered":"2023-11-04T01:45:03.105143+0000","last_clean":"2023-11-04T01:45:03.105143+0000","last_became_active":"2023-11-04T01:44:41.934439+0000","last_became_peered":"2023-11-04T01:44:41.934439+0000","last_unstale":"2023-11-04T01:45:03.105143+0000","last_undegraded":"2023-11-04T01:45:03.105143+0000","last_fullsized":"2023-11-04T01:45:03.105143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:16.371130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126152+0000","last_change":"2023-11-04T01:44:42.905649+0000","last_active":"2023-11-04T01:45:04.126152+0000","last_peered":"2023-11-04T01:45:04.126152+0000","last_clean":"2023-11-04T01:45:04.126152+0000","last_became_active":"2023-11-04T01:44:40.923902+0000","last_became_peered":"2023-11-04T01:44:40.923902+0000","last_unstale":"2023-11-04T01:45:04.126152+0000","last_undegraded":"2023-11-04T01:45:04.126152+0000","last_fullsized":"2023-11-04T01:45:04.126152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:10.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015906259999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":59,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.094846+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:45:04.094846+0000","last_peered":"2023-11-04T01:45:04.094846+0000","last_clean":"2023-11-04T01:45:04.094846+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:45:04.094846+0000","last_undegraded":"2023-11-04T01:45:04.094846+0000","last_fullsized":"2023-11-04T01:45:04.094846+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411836+0000","last_change":"2023-11-04T01:45:04.158187+0000","last_active":"2023-11-04T01:45:05.411836+0000","last_peered":"2023-11-04T01:45:05.411836+0000","last_clean":"2023-11-04T01:45:05.411836+0000","last_became_active":"2023-11-04T01:45:04.157717+0000","last_became_peered":"2023-11-04T01:45:04.157717+0000","last_unstale":"2023-11-04T01:45:05.411836+0000","last_undegraded":"2023-11-04T01:45:05.411836+0000","last_fullsized":"2023-11-04T01:45:05.411836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:33.430345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"79'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096380+0000","last_change":"2023-11-04T01:45:03.143798+0000","last_active":"2023-11-04T01:45:05.096380+0000","last_peered":"2023-11-04T01:45:05.096380+0000","last_clean":"2023-11-04T01:45:05.096380+0000","last_became_active":"2023-11-04T01:45:03.143464+0000","last_became_peered":"2023-11-04T01:45:03.143464+0000","last_unstale":"2023-11-04T01:45:05.096380+0000","last_undegraded":"2023-11-04T01:45:05.096380+0000","last_fullsized":"2023-11-04T01:45:05.096380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:14:15.730743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.093947+0000","last_change":"2023-11-04T01:44:41.934607+0000","last_active":"2023-11-04T01:45:04.093947+0000","last_peered":"2023-11-04T01:45:04.093947+0000","last_clean":"2023-11-04T01:45:04.093947+0000","last_became_active":"2023-11-04T01:44:41.934198+0000","last_became_peered":"2023-11-04T01:44:41.934198+0000","last_unstale":"2023-11-04T01:45:04.093947+0000","last_undegraded":"2023-11-04T01:45:04.093947+0000","last_fullsized":"2023-11-04T01:45:04.093947+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:38.701974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.111389+0000","last_change":"2023-11-04T01:44:43.172018+0000","last_active":"2023-11-04T01:45:04.111389+0000","last_peered":"2023-11-04T01:45:04.111389+0000","last_clean":"2023-11-04T01:45:04.111389+0000","last_became_active":"2023-11-04T01:44:40.912370+0000","last_became_peered":"2023-11-04T01:44:40.912370+0000","last_unstale":"2023-11-04T01:45:04.111389+0000","last_undegraded":"2023-11-04T01:45:04.111389+0000","last_fullsized":"2023-11-04T01:45:04.111389+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:13:11.680326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061865800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.127608+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:45:04.127608+0000","last_peered":"2023-11-04T01:45:04.127608+0000","last_clean":"2023-11-04T01:45:04.127608+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:45:04.127608+0000","last_undegraded":"2023-11-04T01:45:04.127608+0000","last_fullsized":"2023-11-04T01:45:04.127608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.099428+0000","last_change":"2023-11-04T01:45:04.144100+0000","last_active":"2023-11-04T01:45:05.099428+0000","last_peered":"2023-11-04T01:45:05.099428+0000","last_clean":"2023-11-04T01:45:05.099428+0000","last_became_active":"2023-11-04T01:45:04.143710+0000","last_became_peered":"2023-11-04T01:45:04.143710+0000","last_unstale":"2023-11-04T01:45:05.099428+0000","last_undegraded":"2023-11-04T01:45:05.099428+0000","last_fullsized":"2023-11-04T01:45:05.099428+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:16.828619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"79'6","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.411209+0000","last_change":"2023-11-04T01:45:03.136641+0000","last_active":"2023-11-04T01:45:05.411209+0000","last_peered":"2023-11-04T01:45:05.411209+0000","last_clean":"2023-11-04T01:45:05.411209+0000","last_became_active":"2023-11-04T01:45:03.135904+0000","last_became_peered":"2023-11-04T01:45:03.135904+0000","last_unstale":"2023-11-04T01:45:05.411209+0000","last_undegraded":"2023-11-04T01:45:05.411209+0000","last_fullsized":"2023-11-04T01:45:05.411209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:49.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.101228+0000","last_change":"2023-11-04T01:44:41.926616+0000","last_active":"2023-11-04T01:45:04.101228+0000","last_peered":"2023-11-04T01:45:04.101228+0000","last_clean":"2023-11-04T01:45:04.101228+0000","last_became_active":"2023-11-04T01:44:41.926311+0000","last_became_peered":"2023-11-04T01:44:41.926311+0000","last_unstale":"2023-11-04T01:45:04.101228+0000","last_undegraded":"2023-11-04T01:45:04.101228+0000","last_fullsized":"2023-11-04T01:45:04.101228+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:11.379149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109344+0000","last_change":"2023-11-04T01:44:43.178007+0000","last_active":"2023-11-04T01:45:03.109344+0000","last_peered":"2023-11-04T01:45:03.109344+0000","last_clean":"2023-11-04T01:45:03.109344+0000","last_became_active":"2023-11-04T01:44:40.918444+0000","last_became_peered":"2023-11-04T01:44:40.918444+0000","last_unstale":"2023-11-04T01:45:03.109344+0000","last_undegraded":"2023-11-04T01:45:03.109344+0000","last_fullsized":"2023-11-04T01:45:03.109344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029560530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.104699+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:45:04.104699+0000","last_peered":"2023-11-04T01:45:04.104699+0000","last_clean":"2023-11-04T01:45:04.104699+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:45:04.104699+0000","last_undegraded":"2023-11-04T01:45:04.104699+0000","last_fullsized":"2023-11-04T01:45:04.104699+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.433211+0000","last_change":"2023-11-04T01:45:04.119883+0000","last_active":"2023-11-04T01:45:06.433211+0000","last_peered":"2023-11-04T01:45:06.433211+0000","last_clean":"2023-11-04T01:45:06.433211+0000","last_became_active":"2023-11-04T01:45:04.119122+0000","last_became_peered":"2023-11-04T01:45:04.119122+0000","last_unstale":"2023-11-04T01:45:06.433211+0000","last_undegraded":"2023-11-04T01:45:06.433211+0000","last_fullsized":"2023-11-04T01:45:06.433211+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:09:45.466522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:06.434740+0000","last_change":"2023-11-04T01:45:03.148003+0000","last_active":"2023-11-04T01:45:06.434740+0000","last_peered":"2023-11-04T01:45:06.434740+0000","last_clean":"2023-11-04T01:45:06.434740+0000","last_became_active":"2023-11-04T01:45:03.147377+0000","last_became_peered":"2023-11-04T01:45:03.147377+0000","last_unstale":"2023-11-04T01:45:06.434740+0000","last_undegraded":"2023-11-04T01:45:06.434740+0000","last_fullsized":"2023-11-04T01:45:06.434740+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:49.815248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.109762+0000","last_change":"2023-11-04T01:44:41.910669+0000","last_active":"2023-11-04T01:45:03.109762+0000","last_peered":"2023-11-04T01:45:03.109762+0000","last_clean":"2023-11-04T01:45:03.109762+0000","last_became_active":"2023-11-04T01:44:41.910257+0000","last_became_peered":"2023-11-04T01:44:41.910257+0000","last_unstale":"2023-11-04T01:45:03.109762+0000","last_undegraded":"2023-11-04T01:45:03.109762+0000","last_fullsized":"2023-11-04T01:45:03.109762+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:15.837643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.127177+0000","last_change":"2023-11-04T01:44:43.112877+0000","last_active":"2023-11-04T01:45:03.127177+0000","last_peered":"2023-11-04T01:45:03.127177+0000","last_clean":"2023-11-04T01:45:03.127177+0000","last_became_active":"2023-11-04T01:44:40.940708+0000","last_became_peered":"2023-11-04T01:44:40.940708+0000","last_unstale":"2023-11-04T01:45:03.127177+0000","last_undegraded":"2023-11-04T01:45:03.127177+0000","last_fullsized":"2023-11-04T01:45:03.127177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:09.389684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022320399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.126670+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:45:04.126670+0000","last_peered":"2023-11-04T01:45:04.126670+0000","last_clean":"2023-11-04T01:45:04.126670+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:45:04.126670+0000","last_undegraded":"2023-11-04T01:45:04.126670+0000","last_fullsized":"2023-11-04T01:45:04.126670+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-11-04T01:45:05.096523+0000","last_change":"2023-11-04T01:45:04.133341+0000","last_active":"2023-11-04T01:45:05.096523+0000","last_peered":"2023-11-04T01:45:05.096523+0000","last_clean":"2023-11-04T01:45:05.096523+0000","last_became_active":"2023-11-04T01:45:04.132519+0000","last_became_peered":"2023-11-04T01:45:04.132519+0000","last_unstale":"2023-11-04T01:45:05.096523+0000","last_undegraded":"2023-11-04T01:45:05.096523+0000","last_fullsized":"2023-11-04T01:45:05.096523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:03.080201+0000","last_clean_scrub_stamp":"2023-11-04T01:45:03.080201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:11.031337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.109882+0000","last_change":"2023-11-04T01:45:03.140200+0000","last_active":"2023-11-04T01:45:04.109882+0000","last_peered":"2023-11-04T01:45:04.109882+0000","last_clean":"2023-11-04T01:45:04.109882+0000","last_became_active":"2023-11-04T01:45:03.139232+0000","last_became_peered":"2023-11-04T01:45:03.139232+0000","last_unstale":"2023-11-04T01:45:04.109882+0000","last_undegraded":"2023-11-04T01:45:04.109882+0000","last_fullsized":"2023-11-04T01:45:04.109882+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:02.068077+0000","last_clean_scrub_stamp":"2023-11-04T01:45:02.068077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:11:02.402618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.107886+0000","last_change":"2023-11-04T01:44:41.934098+0000","last_active":"2023-11-04T01:45:04.107886+0000","last_peered":"2023-11-04T01:45:04.107886+0000","last_clean":"2023-11-04T01:45:04.107886+0000","last_became_active":"2023-11-04T01:44:41.933709+0000","last_became_peered":"2023-11-04T01:44:41.933709+0000","last_unstale":"2023-11-04T01:45:04.107886+0000","last_undegraded":"2023-11-04T01:45:04.107886+0000","last_fullsized":"2023-11-04T01:45:04.107886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:56.613949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-11-04T01:45:03.103070+0000","last_change":"2023-11-04T01:44:43.172536+0000","last_active":"2023-11-04T01:45:03.103070+0000","last_peered":"2023-11-04T01:45:03.103070+0000","last_clean":"2023-11-04T01:45:03.103070+0000","last_became_active":"2023-11-04T01:44:40.923754+0000","last_became_peered":"2023-11-04T01:44:40.923754+0000","last_unstale":"2023-11-04T01:45:03.103070+0000","last_undegraded":"2023-11-04T01:45:03.103070+0000","last_fullsized":"2023-11-04T01:45:03.103070+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:16.408984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026512620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-11-04T01:45:04.100723+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:45:04.100723+0000","last_peered":"2023-11-04T01:45:04.100723+0000","last_clean":"2023-11-04T01:45:04.100723+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:45:04.100723+0000","last_undegraded":"2023-11-04T01:45:04.100723+0000","last_fullsized":"2023-11-04T01:45:04.100723+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":1028762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.308,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0069999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.32800000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.86399999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.35299999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.69999999999999996},"min":{"1min":0.35199999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.433}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.40400000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.496},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.371,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.58899999999999997}]},{"osd":4,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.88500000000000001,"15min":0.877},"min":{"1min":0.57299999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.98099999999999998},"min":{"1min":0.65300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3640000000000001,"5min":1.365,"15min":1.365},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3540000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.018,"5min":1.0089999999999999,"15min":1.0069999999999999},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3859999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.879}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.998,"15min":0.99199999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.002,"5min":1.0620000000000001,"15min":1.0720000000000001},"min":{"1min":0.70199999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.373,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.048,"15min":1.0509999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4159999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.093,"5min":1.079,"15min":1.077},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.80000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":445141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.502}]},{"osd":2,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67700000000000005,"15min":0.67100000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.66500000000000004,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.143,"5min":1.885,"15min":1.885},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.66300000000000003}]},{"osd":4,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.88700000000000001,"15min":0.89800000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0569999999999999,"5min":1.526,"15min":1.526},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.80700000000000005}]},{"osd":5,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.97099999999999997,"15min":0.96499999999999997},"min":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.98599999999999999,"15min":1.002},"min":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2410000000000001,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":0.60299999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0089999999999999,"15min":1.006},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0509999999999999,"15min":1.0469999999999999},"min":{"1min":0.61599999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.82199999999999995}]},{"osd":7,"last update":"Sat Nov 4 01:44:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.095,"15min":1.0960000000000001},"min":{"1min":0.628,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0249999999999999,"15min":1.0329999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.369,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.63700000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":437708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.89600000000000002},"min":{"1min":0.55300000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.276,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83999999999999997,"15min":0.84799999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.333,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.95299999999999996}]},{"osd":1,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.875},"min":{"1min":0.51600000000000001,"5min":0.503,"15min":0.503},"max":{"1min":1.137,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.89300000000000002}]},{"osd":2,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.86799999999999999,"15min":0.85699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.319,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.89600000000000002,"15min":0.90200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1040000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.90100000000000002,"15min":0.90200000000000002},"min":{"1min":0.66700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2350000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.002,"15min":1.0089999999999999},"min":{"1min":0.65900000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2989999999999999,"5min":1.514,"15min":1.514},"last":0.81399999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.073,"15min":1.077},"min":{"1min":0.83999999999999997,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.2729999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0649999999999999,"15min":1.069},"min":{"1min":0.69499999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.232,"5min":2.609,"15min":2.609},"last":1.2170000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.1539999999999999,"15min":1.1759999999999999},"min":{"1min":0.77800000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.387,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.048},{"interface":"front","average":{"1min":1.125,"5min":2.4529999999999998,"15min":2.6749999999999998},"min":{"1min":0.82899999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.3660000000000001,"5min":40.195,"15min":40.195},"last":1.109}]},{"osd":6,"last update":"Sat Nov 4 01:44:13 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2909999999999999,"15min":1.319},"min":{"1min":0.94699999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.2849999999999999,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1399999999999999,"15min":1.1499999999999999},"min":{"1min":0.77000000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5529999999999999,"5min":1.637,"15min":1.637},"last":1.26}]}]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":446807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.91000000000000003,"15min":0.89800000000000002},"min":{"1min":0.53600000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.413,"5min":1.623,"15min":1.623},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94199999999999995,"15min":0.94699999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4039999999999999,"5min":1.724,"15min":1.724},"last":1.25}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.95399999999999996,"15min":0.96299999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.444,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1539999999999999,"5min":1.244,"15min":1.244},"last":1.0660000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.0089999999999999,"15min":1.0169999999999999},"min":{"1min":0.61899999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4330000000000001,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.02,"15min":1.03},"min":{"1min":0.69999999999999996,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.298,"5min":1.976,"15min":1.976},"last":1.0309999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0029999999999999,"15min":1.0049999999999999},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.335,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.075,"5min":1.1279999999999999,"15min":1.137},"min":{"1min":0.78600000000000003,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.546,"5min":2.161,"15min":2.161},"last":1.1399999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.95199999999999996,"15min":0.95799999999999996},"min":{"1min":0.63,"5min":0.495,"15min":0.495},"max":{"1min":1.333,"5min":1.538,"15min":1.538},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.1220000000000001},"min":{"1min":0.70199999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.516,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.998}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.0489999999999999,"15min":1.0600000000000001},"min":{"1min":0.69799999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.204,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.095,"5min":1.161,"15min":1.1719999999999999},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.484,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.70899999999999996}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.1639999999999999,"15min":1.1779999999999999},"min":{"1min":0.76900000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.8919999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.075,"5min":1.1060000000000001,"15min":1.111},"min":{"1min":0.83299999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.387,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.179}]}]},{"osd":5,"up_from":14,"seq":60129542181,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1548288,"data_stored":1028076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.86799999999999999,"15min":0.876},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.23,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.901}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.321,"15min":1.321},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":1.3919999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85399999999999998,"15min":0.85199999999999998},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0800000000000001,"5min":1.28,"15min":1.28},"last":1.6850000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97999999999999998,"15min":0.98799999999999999},"min":{"1min":0.68999999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.3320000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.2050000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.874,"15min":0.875},"min":{"1min":0.55600000000000005,"5min":0.505,"15min":0.505},"max":{"1min":1.1559999999999999,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.024,"5min":0.93600000000000005,"15min":0.92200000000000004},"min":{"1min":0.72599999999999998,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.8120000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.98499999999999999,"15min":0.98399999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.343,"5min":1.401,"15min":1.401},"last":1.986},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0129999999999999,"15min":1.0269999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2629999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.125}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1479999999999999,"15min":1.1659999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3879999999999999,"5min":1.627,"15min":1.627},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.181,"15min":1.1779999999999999},"min":{"1min":1.026,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.399,"5min":1.526,"15min":1.526},"last":2.1429999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.137,"15min":1.1459999999999999},"min":{"1min":0.81799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.409,"5min":1.49,"15min":1.49},"last":1.54},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.22,"15min":1.23},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.496,"5min":1.536,"15min":1.536},"last":1.6240000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":437708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.95799999999999996,"15min":0.97599999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.758,"15min":1.758},"last":0.89400000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90500000000000003,"15min":0.90800000000000003},"min":{"1min":0.59099999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.46,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.173,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.96099999999999997,"15min":0.96499999999999997},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.278},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.65900000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1839999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0940000000000001}]},{"osd":3,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.2889999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1,"5min":1.0920000000000001,"15min":1.1080000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.546,"5min":1.833,"15min":1.833},"last":1.052}]},{"osd":5,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.95999999999999996,"15min":0.96399999999999997},"min":{"1min":0.61499999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3420000000000001,"5min":1.369,"15min":1.369},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.999,"15min":1.002},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.85199999999999998}]},{"osd":6,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1279999999999999,"15min":1.125},"min":{"1min":0.77200000000000002,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.7410000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.026,"15min":1.014},"min":{"1min":0.84599999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.4399999999999999,"5min":1.554,"15min":1.554},"last":1.169}]},{"osd":7,"last update":"Sat Nov 4 01:44:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0660000000000001,"15min":1.0580000000000001},"min":{"1min":0.75600000000000001,"5min":0.63,"15min":0.63},"max":{"1min":1.292,"5min":1.417,"15min":1.417},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.206,"15min":1.202},"min":{"1min":0.96799999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.206}]}]},{"osd":3,"up_from":14,"seq":60129542181,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":446795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85999999999999999,"5min":1.167,"15min":1.167},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.64500000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.252,"5min":1.429,"15min":1.429},"last":0.34799999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72899999999999998,"15min":0.72099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.40799999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1890000000000001,"5min":1.252,"15min":1.252},"last":0.38300000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.88500000000000001,"15min":0.86699999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.96599999999999997,"15min":0.96799999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4159999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0049999999999999,"15min":1.0069999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4330000000000001,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.036,"15min":1.034},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.435}]},{"osd":6,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.95599999999999996,"15min":0.94799999999999995},"min":{"1min":0.67800000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.357,"5min":1.369,"15min":1.369},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.0680000000000001,"15min":1.0700000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.747}]},{"osd":7,"last update":"Sat Nov 4 01:44:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.048,"15min":1.0429999999999999},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.0469999999999999,"15min":1.0369999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.76200000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":438312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.629},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.32000000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66400000000000003,"15min":0.66300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58999999999999997,"15min":0.59499999999999997},"min":{"1min":0.318,"5min":0.308,"15min":0.308},"max":{"1min":0.81799999999999995,"5min":1.022,"15min":1.022},"last":0.52700000000000002}]},{"osd":3,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.38100000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.054,"5min":1.181,"15min":1.181},"last":0.51400000000000001}]},{"osd":4,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.258,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.92400000000000004,"15min":0.92200000000000004},"min":{"1min":0.55900000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.411,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.879,"15min":0.877},"min":{"1min":0.61299999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.876},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.94699999999999995,"15min":0.94299999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96599999999999997},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2290000000000001,"5min":1.603,"15min":1.603},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":0.97999999999999998},"min":{"1min":0.66600000000000004,"5min":0.621,"15min":0.621},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.85699999999999998}]},{"osd":7,"last update":"Sat Nov 4 01:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.002,"15min":1},"min":{"1min":0.69099999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.377,"5min":1.411,"15min":1.411},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.01,"15min":1.014},"min":{"1min":0.68200000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.272,"5min":1.613,"15min":1.613},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:45:08.562 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:45:08.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:45:08.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.726+0000 7f05ab3dd640 1 Processor -- start 2023-11-04T01:45:08.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.726+0000 7f05ab3dd640 1 -- start start 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05ab3dd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f05a40ccbf0 0x7f05a415beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05ab3dd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05a40cf030 0x7f05a40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05ab3dd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a40cfd50 con 0x7f05a4158be0 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05ab3dd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40b65f0 con 0x7f05a40cf030 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05ab3dd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40cfb40 con 0x7f05a40ccbf0 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05a40cf030 0x7f05a40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05a40cf030 0x7f05a40b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37678/0 (socket says 172.21.15.2:37678) 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 -- 172.21.15.2:0/4046251422 learned_addr learned my addr 172.21.15.2:0/4046251422 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a8978640 1 --2- 172.21.15.2:0/4046251422 >> v2:172.21.15.90:3300/0 conn(0x7f05a40ccbf0 0x7f05a415beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 -- 172.21.15.2:0/4046251422 >> v2:172.21.15.90:3300/0 conn(0x7f05a40ccbf0 msgr2=0x7f05a415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 --2- 172.21.15.2:0/4046251422 >> v2:172.21.15.90:3300/0 conn(0x7f05a40ccbf0 0x7f05a415beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 -- 172.21.15.2:0/4046251422 >> v1:172.21.15.90:6789/0 conn(0x7f05a4158be0 legacy=0x7f05a40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:08.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 -- 172.21.15.2:0/4046251422 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40d0030 con 0x7f05a40cf030 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f05a997a640 1 --2- 172.21.15.2:0/4046251422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40cf030 0x7f05a40b3360 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f05a40d1df0 tx=0x7f059c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f13266ec85b039 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f059bfff640 1 -- 172.21.15.2:0/4046251422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0aa5f0 con 0x7f05a40cf030 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f059bfff640 1 -- 172.21.15.2:0/4046251422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c0aa750 con 0x7f05a40cf030 2023-11-04T01:45:08.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.730+0000 7f059bfff640 1 -- 172.21.15.2:0/4046251422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0aaae0 con 0x7f05a40cf030 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- 172.21.15.2:0/4046251422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40cf030 msgr2=0x7f05a40b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/4046251422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40cf030 0x7f05a40b3360 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f05a40d1df0 tx=0x7f059c01c490 comp rx=0 tx=0).stop 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- 172.21.15.2:0/4046251422 shutdown_connections 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/4046251422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40cf030 0x7f05a40b3360 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/4046251422 >> v2:172.21.15.90:3300/0 conn(0x7f05a40ccbf0 0x7f05a415beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- 172.21.15.2:0/4046251422 >> 172.21.15.2:0/4046251422 conn(0x7f05a406f750 msgr2=0x7f05a406fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- 172.21.15.2:0/4046251422 shutdown_connections 2023-11-04T01:45:08.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- 172.21.15.2:0/4046251422 wait complete. 2023-11-04T01:45:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 Processor -- start 2023-11-04T01:45:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- start start 2023-11-04T01:45:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40ccbf0 0x7f05a40c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05a40cf030 0x7f05a40c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05a4158be0 0x7f05a41f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40c54a0 con 0x7f05a40ccbf0 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40c4890 con 0x7f05a40cf030 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05ab3dd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40c4b70 con 0x7f05a4158be0 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40ccbf0 0x7f05a40c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40ccbf0 0x7f05a40c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37694/0 (socket says 172.21.15.2:37694) 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 -- 172.21.15.2:0/3916896032 learned_addr learned my addr 172.21.15.2:0/3916896032 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a8978640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05a40cf030 0x7f05a40c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a997a640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05a4158be0 0x7f05a41f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 -- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05a4158be0 msgr2=0x7f05a41f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05a4158be0 0x7f05a41f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 -- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05a40cf030 msgr2=0x7f05a40c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05a40cf030 0x7f05a40c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 -- 172.21.15.2:0/3916896032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0094d0 con 0x7f05a40ccbf0 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f05a9179640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40ccbf0 0x7f05a40c94e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f05a000ba50 tx=0x7f05a000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.734+0000 7f0599ffb640 1 -- 172.21.15.2:0/3916896032 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a000cbe0 con 0x7f05a40ccbf0 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f0599ffb640 1 -- 172.21.15.2:0/3916896032 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a000cd80 con 0x7f05a40ccbf0 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a40c4e50 con 0x7f05a40ccbf0 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f0599ffb640 1 -- 172.21.15.2:0/3916896032 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0014680 con 0x7f05a40ccbf0 2023-11-04T01:45:08.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a40c44f0 con 0x7f05a40ccbf0 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a40c5300 con 0x7f05a40ccbf0 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f0599ffb640 1 -- 172.21.15.2:0/3916896032 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f05a00147e0 con 0x7f05a40ccbf0 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f0599ffb640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05880664a0 0x7f0588068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f0599ffb640 1 -- 172.21.15.2:0/3916896032 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f05a0084150 con 0x7f05a40ccbf0 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f05a8978640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05880664a0 0x7f0588068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.738+0000 7f05a8978640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05880664a0 0x7f0588068960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f05a40c7a90 tx=0x7f0594008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:08.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.742+0000 7f0599ffb640 1 -- 172.21.15.2:0/3916896032 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05a40c5300 con 0x7f05a40ccbf0 2023-11-04T01:45:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.950+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f05a40c5300 con 0x7f05a40ccbf0 2023-11-04T01:45:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.954+0000 7f0599ffb640 1 -- 172.21.15.2:0/3916896032 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f05a40c5300 con 0x7f05a40ccbf0 2023-11-04T01:45:08.959 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-04T01:45:08.959 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ== 2023-11-04T01:45:08.959 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-04T01:45:08.959 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-04T01:45:08.959 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:45:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-04T01:45:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05880664a0 msgr2=0x7f0588068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05880664a0 0x7f0588068960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f05a40c7a90 tx=0x7f0594008040 comp rx=0 tx=0).stop 2023-11-04T01:45:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40ccbf0 msgr2=0x7f05a40c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40ccbf0 0x7f05a40c94e0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f05a000ba50 tx=0x7f05a000bf10 comp rx=0 tx=0).stop 2023-11-04T01:45:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 shutdown_connections 2023-11-04T01:45:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05880664a0 0x7f0588068960 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05a4158be0 0x7f05a41f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05a40cf030 0x7f05a40c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 --2- 172.21.15.2:0/3916896032 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05a40ccbf0 0x7f05a40c94e0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 >> 172.21.15.2:0/3916896032 conn(0x7f05a406f750 msgr2=0x7f05a40c3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 shutdown_connections 2023-11-04T01:45:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:08.958+0000 7f05ab3dd640 1 -- 172.21.15.2:0/3916896032 wait complete. 2023-11-04T01:45:08.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:09.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.090+0000 7f6c46ace640 1 Processor -- start 2023-11-04T01:45:09.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.090+0000 7f6c46ace640 1 -- start start 2023-11-04T01:45:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c46ace640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6c400b0630 0x7f6c400b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c46ace640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c400b0fd0 con 0x7f6c4015ed00 2023-11-04T01:45:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c46ace640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4006bb30 con 0x7f6c4015b320 2023-11-04T01:45:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c46ace640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4006c7b0 con 0x7f6c400b0630 2023-11-04T01:45:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4506b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c4015ed00 0x7f6c4015f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40576/0 (socket says 172.21.15.2:40576) 2023-11-04T01:45:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4506b640 1 -- 172.21.15.2:0/2860949682 learned_addr learned my addr 172.21.15.2:0/2860949682 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:09.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3ffff640 1 --2- 172.21.15.2:0/2860949682 >> v2:172.21.15.90:3300/0 conn(0x7f6c400b0630 0x7f6c400b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851049055 0 0) 0x7f6c400b0fd0 con 0x7f6c4015ed00 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c28003530 con 0x7f6c4015ed00 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1494870059 0 0) 0x7f6c28003530 con 0x7f6c4015ed00 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 >> v2:172.21.15.90:3300/0 conn(0x7f6c400b0630 msgr2=0x7f6c400b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 --2- 172.21.15.2:0/2860949682 >> v2:172.21.15.90:3300/0 conn(0x7f6c400b0630 0x7f6c400b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 >> v1:172.21.15.90:6789/0 conn(0x7f6c4015b320 legacy=0x7f6c4006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4006be10 con 0x7f6c4015ed00 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f6c38001a00 con 0x7f6c4015ed00 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 >> v1:172.21.15.2:6789/0 conn(0x7f6c4015ed00 legacy=0x7f6c4015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c28003980 0x7f6c28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c280047d0 0x7f6c28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28005190 0x7f6c2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4006c7b0 con 0x7f6c28003980 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2800c130 con 0x7f6c280047d0 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2800c2f0 con 0x7f6c28005190 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4486a640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c28003980 0x7f6c28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3ffff640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c280047d0 0x7f6c28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4486a640 1 -- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28005190 msgr2=0x7f6c2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4486a640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28005190 0x7f6c2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4486a640 1 -- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c280047d0 msgr2=0x7f6c28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4486a640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c280047d0 0x7f6c28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4486a640 1 -- 172.21.15.2:0/2860949682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c28003530 con 0x7f6c28003980 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4506b640 1 -- 172.21.15.2:0/2860949682 reap_dead start 2023-11-04T01:45:09.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3ffff640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c280047d0 0x7f6c28004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c4486a640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c28003980 0x7f6c28003da0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001780 tx=0x7f6c3401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53246197a6a0683 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340052d0 con 0x7f6c28003980 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c340a7050 con 0x7f6c28003980 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.094+0000 7f6c3f7fe640 1 -- 172.21.15.2:0/2860949682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34003600 con 0x7f6c28003980 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- 172.21.15.2:0/2860949682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c28003980 msgr2=0x7f6c28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c28003980 0x7f6c28003da0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001780 tx=0x7f6c3401c3b0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- 172.21.15.2:0/2860949682 shutdown_connections 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 --2- 172.21.15.2:0/2860949682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c28003980 0x7f6c28003da0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- 172.21.15.2:0/2860949682 >> 172.21.15.2:0/2860949682 conn(0x7f6c400cebb0 msgr2=0x7f6c400cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- 172.21.15.2:0/2860949682 shutdown_connections 2023-11-04T01:45:09.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- 172.21.15.2:0/2860949682 wait complete. 2023-11-04T01:45:09.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 Processor -- start 2023-11-04T01:45:09.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- start start 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28003980 0x7f6c40158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40155f30 0x7f6c401596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c401442f0 0x7f6c400ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40158730 con 0x7f6c40155f30 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40157ba0 con 0x7f6c401442f0 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40159be0 con 0x7f6c28003980 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40155f30 0x7f6c401596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40155f30 0x7f6c401596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37706/0 (socket says 172.21.15.2:37706) 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 -- 172.21.15.2:0/3592554049 learned_addr learned my addr 172.21.15.2:0/3592554049 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c4506b640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c401442f0 0x7f6c400ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c4486a640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28003980 0x7f6c40158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 -- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28003980 msgr2=0x7f6c40158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28003980 0x7f6c40158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 -- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c401442f0 msgr2=0x7f6c400ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c401442f0 0x7f6c400ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 -- 172.21.15.2:0/3592554049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40157e00 con 0x7f6c40155f30 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3ffff640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40155f30 0x7f6c401596a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6c300107c0 tx=0x7f6c30010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3d7fa640 1 -- 172.21.15.2:0/3592554049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30004220 con 0x7f6c40155f30 2023-11-04T01:45:09.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3d7fa640 1 -- 172.21.15.2:0/3592554049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30004380 con 0x7f6c40155f30 2023-11-04T01:45:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c401580e0 con 0x7f6c40155f30 2023-11-04T01:45:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c3d7fa640 1 -- 172.21.15.2:0/3592554049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000eb80 con 0x7f6c40155f30 2023-11-04T01:45:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.098+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c40144770 con 0x7f6c40155f30 2023-11-04T01:45:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.102+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c400744a0 con 0x7f6c40155f30 2023-11-04T01:45:09.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.102+0000 7f6c3d7fa640 1 -- 172.21.15.2:0/3592554049 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c3000ece0 con 0x7f6c40155f30 2023-11-04T01:45:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.102+0000 7f6c3d7fa640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c2c0664d0 0x7f6c2c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.102+0000 7f6c3d7fa640 1 -- 172.21.15.2:0/3592554049 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f6c30084290 con 0x7f6c40155f30 2023-11-04T01:45:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.102+0000 7f6c4486a640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c2c0664d0 0x7f6c2c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.102+0000 7f6c4486a640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c2c0664d0 0x7f6c2c068990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001750 tx=0x7f6c340011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.106+0000 7f6c3d7fa640 1 -- 172.21.15.2:0/3592554049 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c300512e0 con 0x7f6c40155f30 2023-11-04T01:45:09.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c4006cbc0 con 0x7f6c40155f30 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c3d7fa640 1 -- 172.21.15.2:0/3592554049 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f6c30054900 con 0x7f6c40155f30 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1649859495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1649859495},{"type":"v1","addr":"172.21.15.90:6837","nonce":1649859495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/821298795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":821298795},{"type":"v1","addr":"172.21.15.2:6833","nonce":821298795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1371690425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1371690425},{"type":"v1","addr":"172.21.15.2:6835","nonce":1371690425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:45:03.466495+0000","modified":"2023-11-04T01:45:06.473015+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1445624388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1445624388},{"type":"v1","addr":"172.21.15.90:6835","nonce":1445624388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:45:09.293 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 34 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c2c0664d0 msgr2=0x7f6c2c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c2c0664d0 0x7f6c2c068990 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6c34001750 tx=0x7f6c340011a0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40155f30 msgr2=0x7f6c401596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40155f30 0x7f6c401596a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6c300107c0 tx=0x7f6c30010c80 comp rx=0 tx=0).stop 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 shutdown_connections 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c2c0664d0 0x7f6c2c068990 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c401442f0 0x7f6c400ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c40155f30 0x7f6c401596a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 --2- 172.21.15.2:0/3592554049 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c28003980 0x7f6c40158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 >> 172.21.15.2:0/3592554049 conn(0x7f6c400cebb0 msgr2=0x7f6c4015e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 shutdown_connections 2023-11-04T01:45:09.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.290+0000 7f6c46ace640 1 -- 172.21.15.2:0/3592554049 wait complete. 2023-11-04T01:45:09.712 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:45:03.466495+0000', 'modified': '2023-11-04T01:45:06.473015+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6681}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6681': {'gid': 6681, 'name': 'b', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6835/1445624388', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1445624388}, {'type': 'v1', 'addr': '172.21.15.90:6835', 'nonce': 1445624388}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:09.712 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:45:09.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-04T01:45:09.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 Processor -- start 2023-11-04T01:45:09.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 -- start start 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc3d015afd0 0x7fc3d00715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3d006f8f0 0x7fc3d00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d00b0b70 0x7fc3d00c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d0070140 con 0x7fc3d006f8f0 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d00b1000 con 0x7fc3d015afd0 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3d61a8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d006c9f0 con 0x7fc3d00b0b70 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3d006f8f0 0x7fc3d00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc3d006f8f0 0x7fc3d00b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37710/0 (socket says 172.21.15.2:37710) 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 -- 172.21.15.2:0/2224984249 learned_addr learned my addr 172.21.15.2:0/2224984249 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/2224984249 >> v2:172.21.15.90:3300/0 conn(0x7fc3d015afd0 0x7fc3d00715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 -- 172.21.15.2:0/2224984249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d00b0b70 msgr2=0x7fc3d00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3cffff640 1 --2- 172.21.15.2:0/2224984249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d00b0b70 0x7fc3d00c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/2224984249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d00b0b70 0x7fc3d00c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 -- 172.21.15.2:0/2224984249 >> v2:172.21.15.90:3300/0 conn(0x7fc3d015afd0 msgr2=0x7fc3d00715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/2224984249 >> v2:172.21.15.90:3300/0 conn(0x7fc3d015afd0 0x7fc3d00715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3ceffd640 1 -- 172.21.15.2:0/2224984249 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00c2670 con 0x7fc3d006f8f0 2023-11-04T01:45:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.842+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/2224984249 >> v2:172.21.15.90:3300/0 conn(0x7fc3d015afd0 0x7fc3d00715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/2224984249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d00b0630 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00ce980 tx=0x7fc3b801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5091519fa6c78fd8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3ce7fc640 1 -- 172.21.15.2:0/2224984249 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80ab600 con 0x7fc3d006f8f0 2023-11-04T01:45:09.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3ce7fc640 1 -- 172.21.15.2:0/2224984249 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b80a7050 con 0x7fc3d006f8f0 2023-11-04T01:45:09.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3ce7fc640 1 -- 172.21.15.2:0/2224984249 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80ab980 con 0x7fc3d006f8f0 2023-11-04T01:45:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 -- 172.21.15.2:0/2224984249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 msgr2=0x7fc3d00b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/2224984249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d00b0630 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00ce980 tx=0x7fc3b801c210 comp rx=0 tx=0).stop 2023-11-04T01:45:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 -- 172.21.15.2:0/2224984249 shutdown_connections 2023-11-04T01:45:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/2224984249 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d00b0b70 0x7fc3d00c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/2224984249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d00b0630 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/2224984249 >> v2:172.21.15.90:3300/0 conn(0x7fc3d015afd0 0x7fc3d00715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 -- 172.21.15.2:0/2224984249 >> 172.21.15.2:0/2224984249 conn(0x7fc3d00cebb0 msgr2=0x7fc3d00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 -- 172.21.15.2:0/2224984249 shutdown_connections 2023-11-04T01:45:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 -- 172.21.15.2:0/2224984249 wait complete. 2023-11-04T01:45:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 Processor -- start 2023-11-04T01:45:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.846+0000 7fc3d61a8640 1 -- start start 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d0151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00b0b70 0x7fc3d0152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d015afd0 0x7fc3d00b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d014a470 con 0x7fc3d006f8f0 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0151d60 con 0x7fc3d00b0b70 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0152040 con 0x7fc3d015afd0 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d0151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d0151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37716/0 (socket says 172.21.15.2:37716) 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/166866077 learned_addr learned my addr 172.21.15.2:0/166866077 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00b0b70 0x7fc3d0152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cffff640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d015afd0 0x7fc3d00b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d015afd0 msgr2=0x7fc3d00b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d015afd0 0x7fc3d00b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00b0b70 msgr2=0x7fc3d0152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00b0b70 0x7fc3d0152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/166866077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80094d0 con 0x7fc3d006f8f0 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cffff640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d015afd0 0x7fc3d00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d0151780 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c7c0 tx=0x7fc3c800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3c7fff640 1 -- 172.21.15.2:0/166866077 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8007a30 con 0x7fc3d006f8f0 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3c7fff640 1 -- 172.21.15.2:0/166866077 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8007b90 con 0x7fc3d006f8f0 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d0152320 con 0x7fc3d006f8f0 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3c7fff640 1 -- 172.21.15.2:0/166866077 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800ce70 con 0x7fc3d006f8f0 2023-11-04T01:45:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d01528e0 con 0x7fc3d006f8f0 2023-11-04T01:45:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3c7fff640 1 -- 172.21.15.2:0/166866077 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc3c80113f0 con 0x7fc3d006f8f0 2023-11-04T01:45:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3c7fff640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3b00664a0 0x7fc3b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3c7fff640 1 -- 172.21.15.2:0/166866077 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc3c8084720 con 0x7fc3d006f8f0 2023-11-04T01:45:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.850+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3b00664a0 0x7fc3b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 Processor -- start 2023-11-04T01:45:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- start start 2023-11-04T01:45:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3b00664a0 0x7fc3b0068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80ad000 tx=0x7fc3b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408776380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408729600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408729f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564085f4460 con 0x556408729b40 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x556408585690 con 0x5564087768c0 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x556408582bc0 con 0x556408775fa0 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408729f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408729f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37730/0 (socket says 172.21.15.2:37730) 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 -- 172.21.15.2:0/2268369397 learned_addr learned my addr 172.21.15.2:0/2268369397 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408729600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408776380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 -- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 msgr2=0x556408776380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408776380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 -- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 msgr2=0x556408729600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408729600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 -- 172.21.15.2:0/2268369397 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556408276890 con 0x556408729b40 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408729600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3cffff640 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408729f20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0008c50 tx=0x7fc3c000d5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f3de894d61cb2a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3c57fa640 1 -- 172.21.15.2:0/2268369397 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0008e60 con 0x556408729b40 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3c57fa640 1 -- 172.21.15.2:0/2268369397 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000a030 con 0x556408729b40 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3c57fa640 1 -- 172.21.15.2:0/2268369397 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000de60 con 0x556408729b40 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- 172.21.15.2:0/2268369397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 msgr2=0x556408729f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408729f20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0008c50 tx=0x7fc3c000d5b0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- 172.21.15.2:0/2268369397 shutdown_connections 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408729f20 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408729600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/2268369397 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408776380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- 172.21.15.2:0/2268369397 >> 172.21.15.2:0/2268369397 conn(0x556408756d40 msgr2=0x556408759130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- 172.21.15.2:0/2268369397 shutdown_connections 2023-11-04T01:45:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- 172.21.15.2:0/2268369397 wait complete. 2023-11-04T01:45:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 -- start start 2023-11-04T01:45:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.854+0000 7fc3d92d5000 1 Processor -- start 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408729b40 0x55640872f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408775fa0 0x55640872ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5564087768c0 0x556408730460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640857e4b0 con 0x556408775fa0 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x556408536aa0 con 0x556408729b40 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55640853c940 con 0x5564087768c0 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 10 client.0 _ll_register_callbacks cb 0x556408717460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408775fa0 0x55640872ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408775fa0 0x55640872ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37734/0 (socket says 172.21.15.2:37734) 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 -- 172.21.15.2:0/1168029909 learned_addr learned my addr 172.21.15.2:0/1168029909 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408729b40 0x55640872f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3cffff640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5564087768c0 0x556408730460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 -- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5564087768c0 msgr2=0x556408730460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5564087768c0 0x556408730460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 -- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408729b40 msgr2=0x55640872f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408729b40 0x55640872f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 -- 172.21.15.2:0/1168029909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c000c040 con 0x556408775fa0 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3cffff640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5564087768c0 0x556408730460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408775fa0 0x55640872ff20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc3b801c250 tx=0x7fc3b801aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e675157087d4828c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/1168029909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80b6920 con 0x556408775fa0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/1168029909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc3b80b6a80 con 0x556408775fa0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55640853be10 con 0x556408775fa0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/1168029909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3b80b6c40 con 0x556408775fa0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 10 client.6840 fetch_fsmap learned FSMap version 34 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55640853f1a0 con 0x556408775fa0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/1168029909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55640853be10 con 0x556408775fa0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/1168029909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3b80c0420 con 0x556408775fa0 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 10 client.6840 fetch_fsmap finished waiting for FSMap version 34 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 10 client.6840 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 20 client.6840 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x556408730d30 0x556408787720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 4 client.6840 mds_command: new command op to 6681 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 --> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55640857ce00 con 0x556408730d30 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x556408730d30 0x556408787720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x556408730d30 0x556408787720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7efb157530bd3a8 server_cookie=9a2df47b1566063f in_seq=0 out_seq=0 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.858+0000 7fc3ae7fc640 10 client.6840 ms_handle_connect on v2:172.21.15.90:6834/1445624388 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/1168029909 <== mds.0 v2:172.21.15.90:6834/1445624388 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55640857ce00 con 0x556408730d30 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3ae7fc640 10 client.6840 handle_command_reply: tid=0 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 client.6840 shutdown 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408775fa0 msgr2=0x55640872ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408775fa0 0x55640872ff20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc3b801c250 tx=0x7fc3b801aa50 comp rx=0 tx=0).stop 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 shutdown_connections 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x556408730d30 0x556408787720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5564087768c0 0x556408730460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408775fa0 0x55640872ff20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3ae7fc640 0 client.6840 ms_handle_reset on v2:172.21.15.90:6834/1445624388 2023-11-04T01:45:09.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/1168029909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408729b40 0x55640872f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 >> 172.21.15.2:0/1168029909 conn(0x556408756d40 msgr2=0x556408759130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 shutdown_connections 2023-11-04T01:45:09.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 1 -- 172.21.15.2:0/1168029909 wait complete. 2023-11-04T01:45:09.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.862+0000 7fc3d92d5000 20 client.6840 trim_cache size 0 max 16384 2023-11-04T01:45:09.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 Processor -- start 2023-11-04T01:45:09.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- start start 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408731820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408731d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408774050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x556408237940 con 0x556408729b40 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x556408519750 con 0x5564087768c0 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x556408579e20 con 0x556408775fa0 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408731820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408731820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37744/0 (socket says 172.21.15.2:37744) 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/311182903 learned_addr learned my addr 172.21.15.2:0/311182903 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cffff640 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408774050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408731d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 msgr2=0x556408731d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408731d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 msgr2=0x556408774050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408774050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 -- 172.21.15.2:0/311182903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564085254a0 con 0x556408729b40 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408731820 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8055450 tx=0x7fc3c8082780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b5c2e30b4732b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3c5ffb640 1 -- 172.21.15.2:0/311182903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8053600 con 0x556408729b40 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3c5ffb640 1 -- 172.21.15.2:0/311182903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c8053860 con 0x556408729b40 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3c5ffb640 1 -- 172.21.15.2:0/311182903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80549b0 con 0x556408729b40 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- 172.21.15.2:0/311182903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 msgr2=0x556408731820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408731820 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8055450 tx=0x7fc3c8082780 comp rx=0 tx=0).stop 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- 172.21.15.2:0/311182903 shutdown_connections 2023-11-04T01:45:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5564087768c0 0x556408774050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408775fa0 0x556408731d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/311182903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556408729b40 0x556408731820 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- 172.21.15.2:0/311182903 >> 172.21.15.2:0/311182903 conn(0x556408756d40 msgr2=0x556408731110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- 172.21.15.2:0/311182903 shutdown_connections 2023-11-04T01:45:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- 172.21.15.2:0/311182903 wait complete. 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 -- start start 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.878+0000 7fc3d92d5000 1 Processor -- start 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408729b40 0x556408788b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408775fa0 0x5564087931b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5564087768c0 0x5564087936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564082771b0 con 0x5564087768c0 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564085be830 con 0x556408775fa0 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55640857b8b0 con 0x556408729b40 2023-11-04T01:45:09.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 10 client.0 _ll_register_callbacks cb 0x7fc3c0008590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5564087768c0 0x5564087936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5564087768c0 0x5564087936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37748/0 (socket says 172.21.15.2:37748) 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 -- 172.21.15.2:0/3041018973 learned_addr learned my addr 172.21.15.2:0/3041018973 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ceffd640 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408775fa0 0x5564087931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408729b40 0x556408788b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 -- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408729b40 msgr2=0x556408788b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408729b40 0x556408788b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 -- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408775fa0 msgr2=0x5564087931b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408775fa0 0x5564087931b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 -- 172.21.15.2:0/3041018973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d01528e0 con 0x5564087768c0 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cffff640 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5564087768c0 0x5564087936f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0015040 tx=0x7fc3c0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44eecb199ef60f2d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/3041018973 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0008e60 con 0x5564087768c0 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/3041018973 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc3c0004040 con 0x5564087768c0 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556408548d10 con 0x5564087768c0 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/3041018973 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c0004220 con 0x5564087768c0 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 10 client.6846 fetch_fsmap learned FSMap version 34 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x556408276cc0 con 0x5564087768c0 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/3041018973 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556408548d10 con 0x5564087768c0 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/3041018973 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc3c0004380 con 0x5564087768c0 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 10 client.6846 fetch_fsmap finished waiting for FSMap version 34 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 10 client.6846 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 20 client.6846 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x5564087d6940 0x5564087d6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 4 client.6846 mds_command: new command op to 6681 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 --> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556408577490 con 0x5564087d6940 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x5564087d6940 0x5564087d6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3cf7fe640 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x5564087d6940 0x5564087d6d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7918378e656fbf26 server_cookie=fc2672790fb51867 in_seq=0 out_seq=0 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 10 client.6846 ms_handle_connect on v2:172.21.15.90:6834/1445624388 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 1 -- 172.21.15.2:0/3041018973 <== mds.0 v2:172.21.15.90:6834/1445624388 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556408577490 con 0x5564087d6940 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 10 client.6846 handle_command_reply: tid=0 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 client.6846 shutdown 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5564087768c0 msgr2=0x5564087936f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5564087768c0 0x5564087936f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0015040 tx=0x7fc3c0004ac0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 shutdown_connections 2023-11-04T01:45:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:6834/1445624388,v1:172.21.15.90:6835/1445624388] conn(0x5564087d6940 0x5564087d6d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5564087768c0 0x5564087936f0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x556408775fa0 0x5564087931b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3ae7fc640 0 client.6846 ms_handle_reset on v2:172.21.15.90:6834/1445624388 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 --2- 172.21.15.2:0/3041018973 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x556408729b40 0x556408788b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 >> 172.21.15.2:0/3041018973 conn(0x556408756d40 msgr2=0x5564087319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 shutdown_connections 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 1 -- 172.21.15.2:0/3041018973 wait complete. 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d92d5000 20 client.6846 trim_cache size 0 max 16384 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:45:09.892 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 6681, 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 5.7585499039999997, 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 34, 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 80, 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 80, 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 11.825917947000001 2023-11-04T01:45:09.893 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:45:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3b00664a0 msgr2=0x7fc3b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3b00664a0 0x7fc3b0068960 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80ad000 tx=0x7fc3b8008040 comp rx=0 tx=0).stop 2023-11-04T01:45:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 msgr2=0x7fc3d0151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d0151780 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c7c0 tx=0x7fc3c800cc80 comp rx=0 tx=0).stop 2023-11-04T01:45:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 shutdown_connections 2023-11-04T01:45:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.882+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc3b00664a0 0x7fc3b0068960 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.886+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc3d015afd0 0x7fc3d00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.886+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3d00b0b70 0x7fc3d0152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.886+0000 7fc3d61a8640 1 --2- 172.21.15.2:0/166866077 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3d006f8f0 0x7fc3d0151780 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.886+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 >> 172.21.15.2:0/166866077 conn(0x7fc3d00cebb0 msgr2=0x7fc3d015a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.886+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 shutdown_connections 2023-11-04T01:45:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:09.886+0000 7fc3d61a8640 1 -- 172.21.15.2:0/166866077 wait complete. 2023-11-04T01:45:09.903 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:45:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.010+0000 7f3e14ea4640 1 Processor -- start 2023-11-04T01:45:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.010+0000 7f3e14ea4640 1 -- start start 2023-11-04T01:45:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e14ea4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10161500 0x7f3e100ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e14ea4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3e10165b70 0x7f3e100b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e14ea4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100d02f0 con 0x7f3e100b2d10 2023-11-04T01:45:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e14ea4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e100b31c0 con 0x7f3e10165b70 2023-11-04T01:45:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e14ea4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1006d2d0 con 0x7f3e10161500 2023-11-04T01:45:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0e59c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10161500 0x7f3e100ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3e10165b70 0x7f3e100b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3e10165b70 0x7f3e100b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:49758/0 (socket says 172.21.15.2:49758) 2023-11-04T01:45:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 -- 172.21.15.2:0/3175150840 learned_addr learned my addr 172.21.15.2:0/3175150840 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 -- 172.21.15.2:0/3175150840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10161500 msgr2=0x7f3e100ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 --2- 172.21.15.2:0/3175150840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10161500 0x7f3e100ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 -- 172.21.15.2:0/3175150840 >> v1:172.21.15.90:6789/0 conn(0x7f3e100b2d10 legacy=0x7f3e1006b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 -- 172.21.15.2:0/3175150840 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e10166080 con 0x7f3e10165b70 2023-11-04T01:45:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0dd9b640 1 --2- 172.21.15.2:0/3175150840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10165b70 0x7f3e100b27d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009870 tx=0x7f3df801c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5659e0df740ebe47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0d59a640 1 -- 172.21.15.2:0/3175150840 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80ab600 con 0x7f3e10165b70 2023-11-04T01:45:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0d59a640 1 -- 172.21.15.2:0/3175150840 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df80a7050 con 0x7f3e10165b70 2023-11-04T01:45:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.014+0000 7f3e0d59a640 1 -- 172.21.15.2:0/3175150840 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df80ab980 con 0x7f3e10165b70 2023-11-04T01:45:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/3175150840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10165b70 msgr2=0x7f3e100b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/3175150840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10165b70 0x7f3e100b27d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3df8009870 tx=0x7f3df801c540 comp rx=0 tx=0).stop 2023-11-04T01:45:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/3175150840 shutdown_connections 2023-11-04T01:45:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/3175150840 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10165b70 0x7f3e100b27d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/3175150840 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10161500 0x7f3e100ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/3175150840 >> 172.21.15.2:0/3175150840 conn(0x7f3e100cd7d0 msgr2=0x7f3e100cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/3175150840 shutdown_connections 2023-11-04T01:45:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/3175150840 wait complete. 2023-11-04T01:45:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 Processor -- start 2023-11-04T01:45:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- start start 2023-11-04T01:45:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e100b2d10 0x7f3e100cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10161500 0x7f3e100b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10165b70 0x7f3e100b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100b4630 con 0x7f3e100b2d10 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c8630 con 0x7f3e10161500 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c7e20 con 0x7f3e10165b70 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e100b2d10 0x7f3e100cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e100b2d10 0x7f3e100cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37762/0 (socket says 172.21.15.2:37762) 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 -- 172.21.15.2:0/2452320164 learned_addr learned my addr 172.21.15.2:0/2452320164 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0dd9b640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10161500 0x7f3e100b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0ed9d640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10165b70 0x7f3e100b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 -- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10165b70 msgr2=0x7f3e100b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10165b70 0x7f3e100b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 -- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10161500 msgr2=0x7f3e100b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10161500 0x7f3e100b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 -- 172.21.15.2:0/2452320164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80094d0 con 0x7f3e100b2d10 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0dd9b640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10161500 0x7f3e100b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e0e59c640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e100b2d10 0x7f3e100cc710 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000efc0 tx=0x7f3e0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e06ffd640 1 -- 172.21.15.2:0/2452320164 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00014480 con 0x7f3e100b2d10 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e100cc280 con 0x7f3e100b2d10 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e06ffd640 1 -- 172.21.15.2:0/2452320164 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000f040 con 0x7f3e100b2d10 2023-11-04T01:45:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e06ffd640 1 -- 172.21.15.2:0/2452320164 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00014800 con 0x7f3e100b2d10 2023-11-04T01:45:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e100c8350 con 0x7f3e100b2d10 2023-11-04T01:45:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.018+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e100744a0 con 0x7f3e100b2d10 2023-11-04T01:45:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.022+0000 7f3e06ffd640 1 -- 172.21.15.2:0/2452320164 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e00014960 con 0x7f3e100b2d10 2023-11-04T01:45:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.022+0000 7f3e06ffd640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3df00664d0 0x7f3df0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.022+0000 7f3e06ffd640 1 -- 172.21.15.2:0/2452320164 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f3e000855c0 con 0x7f3e100b2d10 2023-11-04T01:45:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.022+0000 7f3e0dd9b640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3df00664d0 0x7f3df0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.022+0000 7f3e0dd9b640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3df00664d0 0x7f3df0068990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3df80ad000 tx=0x7f3df80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.026+0000 7f3e06ffd640 1 -- 172.21.15.2:0/2452320164 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e000526a0 con 0x7f3e100b2d10 2023-11-04T01:45:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.210+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3e100b6cd0 con 0x7f3e100b2d10 2023-11-04T01:45:10.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.210+0000 7f3e06ffd640 1 -- 172.21.15.2:0/2452320164 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3e00055cc0 con 0x7f3e100b2d10 2023-11-04T01:45:10.214 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3df00664d0 msgr2=0x7f3df0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3df00664d0 0x7f3df0068990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3df80ad000 tx=0x7f3df80a6000 comp rx=0 tx=0).stop 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e100b2d10 msgr2=0x7f3e100cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e100b2d10 0x7f3e100cc710 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000efc0 tx=0x7f3e0000c490 comp rx=0 tx=0).stop 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 shutdown_connections 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3df00664d0 0x7f3df0068990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e10165b70 0x7f3e100b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e10161500 0x7f3e100b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 --2- 172.21.15.2:0/2452320164 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e100b2d10 0x7f3e100cc710 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 >> 172.21.15.2:0/2452320164 conn(0x7f3e100cd7d0 msgr2=0x7f3e100cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:10.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 shutdown_connections 2023-11-04T01:45:10.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:10.214+0000 7f3e14ea4640 1 -- 172.21.15.2:0/2452320164 wait complete. 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:45:10.231 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:10.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.232 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:45:10.237 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:10.238 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42034sec preferred_lft 42034sec 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:45:10.239 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:10.240 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:45:10.241 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.241 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:45:10.241 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:10.241 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:45:10.241 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:10.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.241 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:45:10.291 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:45:10.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.293 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:45:10.341 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:45:10.341 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:45:10.341 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:45:10.341 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:45:10.341 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:45:10.341 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:45:10.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.342 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:45:10.342 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:45:10.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:45:10.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:45:10.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:45:10.342 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:45:10.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.413 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:45:10.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:45:10.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:45:10.460 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:10.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:45:10.515 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:45:10.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:45:10.515 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:10.564 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:10.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:45:10.564 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:10.611 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:45:10.662 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:45:10.662 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:45:10.662 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:45:10.662 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:45:10.662 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:45:10.663 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:45:10.664 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:10.665 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:10.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.666 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:45:10.712 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:45:10.712 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:45:10.756 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:45:10.763 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:45:10.763 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:45:10.763 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:45:10.763 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:45:10.763 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:45:10.764 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:10.765 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:10.766 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:10.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:10.767 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:45:10.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:45:10.838+0000 7fa5a3f50580 -1 init, newargv = 0x55cb9eec9710 newargc=15 2023-11-04T01:45:10.842 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[53208]: starting ceph client 2023-11-04T01:45:10.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[53208]: starting fuse 2023-11-04T01:45:11.916 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:45:11.924 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:45:11.924 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:45:11.925 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:45:11.926 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:45:11.927 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:45:11.927 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:11.927 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:11.927 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:11.927 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:11.927 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:11.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:11.928 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:45:11.976 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:45:11.976 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:45:11.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:45:11.976 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:45:11.976 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:45:11.976 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:45:11.977 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:45:11.978 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:45:12.103 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.53208.asok 2023-11-04T01:45:12.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:12.115 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53208.asok 2023-11-04T01:45:12.115 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:45:12.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.53208.asok status 2023-11-04T01:45:12.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:45:12.323 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "53208", 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 6858, 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:45:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 6858 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1021664145 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1021664145 2023-11-04T01:45:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.6858 192.168.0.1:0/1021664145", 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/1021664145", 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 34, 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 80, 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:45:12.326 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:45:12.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:12.345 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:45:12.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:45:12.345 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:12.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:45:12.397 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:45:12.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:12.404 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:12.404 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:45:12.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:12.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:45:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:12.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:45:12.642 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:45:12.642 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:45:12.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:12.642 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps) 2023-11-04T01:45:12.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps false --yes-i-really-mean-it 2023-11-04T01:45:12.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc84054b640 1 Processor -- start 2023-11-04T01:45:12.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc84054b640 1 -- start start 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc84054b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc838159df0 0x7fc8380cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc84054b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc83806b270 0x7fc83806b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc84054b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc838070c60 con 0x7fc8380cca30 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc84054b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8380ca2f0 con 0x7fc83806b270 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc84054b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83806bc20 con 0x7fc838159df0 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc83eae8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc83806b270 0x7fc83806b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc83dae6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8380cca30 0x7fc8380cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51714/0 (socket says 172.21.15.2:51714) 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc83dae6640 1 -- 172.21.15.2:0/1179820233 learned_addr learned my addr 172.21.15.2:0/1179820233 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:12.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.834+0000 7fc83e2e7640 1 --2- 172.21.15.2:0/1179820233 >> v2:172.21.15.90:3300/0 conn(0x7fc838159df0 0x7fc8380cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83eae8640 1 -- 172.21.15.2:0/1179820233 >> v2:172.21.15.90:3300/0 conn(0x7fc838159df0 msgr2=0x7fc8380cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:12.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83eae8640 1 --2- 172.21.15.2:0/1179820233 >> v2:172.21.15.90:3300/0 conn(0x7fc838159df0 0x7fc8380cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83eae8640 1 -- 172.21.15.2:0/1179820233 >> v1:172.21.15.2:6789/0 conn(0x7fc8380cca30 legacy=0x7fc8380cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83eae8640 1 -- 172.21.15.2:0/1179820233 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380cd910 con 0x7fc83806b270 2023-11-04T01:45:12.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83e2e7640 1 --2- 172.21.15.2:0/1179820233 >> v2:172.21.15.90:3300/0 conn(0x7fc838159df0 0x7fc8380cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:12.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83eae8640 1 --2- 172.21.15.2:0/1179820233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc83806b6e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc83806f630 tx=0x7fc82801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4e39b8202688f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:12.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83d2e5640 1 -- 172.21.15.2:0/1179820233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280ab610 con 0x7fc83806b270 2023-11-04T01:45:12.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83d2e5640 1 -- 172.21.15.2:0/1179820233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280ab770 con 0x7fc83806b270 2023-11-04T01:45:12.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc83d2e5640 1 -- 172.21.15.2:0/1179820233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280abb00 con 0x7fc83806b270 2023-11-04T01:45:12.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 -- 172.21.15.2:0/1179820233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 msgr2=0x7fc83806b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 --2- 172.21.15.2:0/1179820233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc83806b6e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc83806f630 tx=0x7fc82801c410 comp rx=0 tx=0).stop 2023-11-04T01:45:12.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 -- 172.21.15.2:0/1179820233 shutdown_connections 2023-11-04T01:45:12.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 --2- 172.21.15.2:0/1179820233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc83806b6e0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 --2- 172.21.15.2:0/1179820233 >> v2:172.21.15.90:3300/0 conn(0x7fc838159df0 0x7fc8380cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 -- 172.21.15.2:0/1179820233 >> 172.21.15.2:0/1179820233 conn(0x7fc8380cbd80 msgr2=0x7fc8380cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:12.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 -- 172.21.15.2:0/1179820233 shutdown_connections 2023-11-04T01:45:12.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.838+0000 7fc84054b640 1 -- 172.21.15.2:0/1179820233 wait complete. 2023-11-04T01:45:12.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 Processor -- start 2023-11-04T01:45:12.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 -- start start 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc838150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8380cca30 0x7fc83806a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc838159df0 0x7fc83806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838151450 con 0x7fc83806b270 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380c6740 con 0x7fc8380cca30 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380c6a20 con 0x7fc838159df0 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc838150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc838150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37950/0 (socket says 172.21.15.2:37950) 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 -- 172.21.15.2:0/4292705825 learned_addr learned my addr 172.21.15.2:0/4292705825 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83dae6640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8380cca30 0x7fc83806a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83eae8640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc838159df0 0x7fc83806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 -- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc838159df0 msgr2=0x7fc83806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc838159df0 0x7fc83806a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 -- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8380cca30 msgr2=0x7fc83806a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8380cca30 0x7fc83806a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 -- 172.21.15.2:0/4292705825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009420 con 0x7fc83806b270 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc83e2e7640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc838150f10 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc83400d800 tx=0x7fc83400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc82effd640 1 -- 172.21.15.2:0/4292705825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340096c0 con 0x7fc83806b270 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc82effd640 1 -- 172.21.15.2:0/4292705825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc834009820 con 0x7fc83806b270 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc82effd640 1 -- 172.21.15.2:0/4292705825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834009bd0 con 0x7fc83806b270 2023-11-04T01:45:12.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380c6d00 con 0x7fc83806b270 2023-11-04T01:45:12.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380c72c0 con 0x7fc83806b270 2023-11-04T01:45:12.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.842+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8380675f0 con 0x7fc83806b270 2023-11-04T01:45:12.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.846+0000 7fc82effd640 1 -- 172.21.15.2:0/4292705825 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc834009d30 con 0x7fc83806b270 2023-11-04T01:45:12.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.846+0000 7fc82effd640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc8240664a0 0x7fc824068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:12.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.846+0000 7fc82effd640 1 -- 172.21.15.2:0/4292705825 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc834084920 con 0x7fc83806b270 2023-11-04T01:45:12.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.846+0000 7fc83dae6640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc8240664a0 0x7fc824068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:12.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.846+0000 7fc83dae6640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc8240664a0 0x7fc824068960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc8380cee90 tx=0x7fc830009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:12.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:12.850+0000 7fc82effd640 1 -- 172.21.15.2:0/4292705825 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc834051a00 con 0x7fc83806b270 2023-11-04T01:45:13.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.042+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc8380b5280 con 0x7fc83806b270 2023-11-04T01:45:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc82effd640 1 -- 172.21.15.2:0/4292705825 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "false", "yes_i_really_mean_it": true}]=0 disabled new snapshots v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc834055020 con 0x7fc83806b270 2023-11-04T01:45:13.952 INFO:teuthology.orchestra.run.smithi002.stderr:disabled new snapshots 2023-11-04T01:45:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc8240664a0 msgr2=0x7fc824068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc8240664a0 0x7fc824068960 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc8380cee90 tx=0x7fc830009040 comp rx=0 tx=0).stop 2023-11-04T01:45:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 msgr2=0x7fc838150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc838150f10 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc83400d800 tx=0x7fc83400dcc0 comp rx=0 tx=0).stop 2023-11-04T01:45:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 shutdown_connections 2023-11-04T01:45:13.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc8240664a0 0x7fc824068960 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc838159df0 0x7fc83806a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8380cca30 0x7fc83806a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 --2- 172.21.15.2:0/4292705825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc83806b270 0x7fc838150f10 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.950+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 >> 172.21.15.2:0/4292705825 conn(0x7fc8380cbd80 msgr2=0x7fc838158590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.954+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 shutdown_connections 2023-11-04T01:45:13.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:13.954+0000 7fc84054b640 1 -- 172.21.15.2:0/4292705825 wait complete. 2023-11-04T01:45:13.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:13.975 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:45:13.986 INFO:teuthology.orchestra.run.smithi002.stderr:mkdir: cannot create directory 'test-allow-snaps/.snap/snap00': Operation not permitted 2023-11-04T01:45:13.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:13.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:45:14.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.154+0000 7fa0c68af640 1 Processor -- start 2023-11-04T01:45:14.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.154+0000 7fa0c68af640 1 -- start start 2023-11-04T01:45:14.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c68af640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 0x7fa0c00ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c68af640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00cd590 con 0x7fa0c015cec0 2023-11-04T01:45:14.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c68af640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00ad250 con 0x7fa0c00ace00 2023-11-04T01:45:14.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c68af640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00662d0 con 0x7fa0c00ceb20 2023-11-04T01:45:14.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa0c015cec0 0x7fa0c00ae4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51716/0 (socket says 172.21.15.2:51716) 2023-11-04T01:45:14.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bffff640 1 -- 172.21.15.2:0/4216877315 learned_addr learned my addr 172.21.15.2:0/4216877315 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:14.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706404361 0 0) 0x7fa0b0001120 con 0x7fa0c015cec0 2023-11-04T01:45:14.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ac003530 con 0x7fa0c015cec0 2023-11-04T01:45:14.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0b77fe640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 0x7fa0c00ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3245373291 0 0) 0x7fa0ac003530 con 0x7fa0c015cec0 2023-11-04T01:45:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 msgr2=0x7fa0c00ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 0x7fa0c00ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 >> v1:172.21.15.90:6789/0 conn(0x7fa0c00ace00 legacy=0x7fa0c006a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00ccfd0 con 0x7fa0c015cec0 2023-11-04T01:45:14.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa0b0001810 con 0x7fa0c015cec0 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0b77fe640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 0x7fa0c00ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 >> v1:172.21.15.2:6789/0 conn(0x7fa0c015cec0 legacy=0x7fa0c00ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0ac0039b0 0x7fa0ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 0x7fa0ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00662d0 con 0x7fa0ac004d10 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac00baa0 con 0x7fa0ac0039b0 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac00bc60 con 0x7fa0c00ceb20 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c4e4c640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bffff640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0ac0039b0 0x7fa0ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0b77fe640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 0x7fa0ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c4e4c640 1 -- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 msgr2=0x7fa0ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c4e4c640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00ceb20 0x7fa0ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c4e4c640 1 -- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0ac0039b0 msgr2=0x7fa0ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c4e4c640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0ac0039b0 0x7fa0ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c4e4c640 1 -- 172.21.15.2:0/4216877315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac003530 con 0x7fa0ac004d10 2023-11-04T01:45:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0c4e4c640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0ac005190 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8001ca0 tx=0x7fa0b801c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfae3eec3298f77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8003b80 con 0x7fa0ac004d10 2023-11-04T01:45:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8003ce0 con 0x7fa0ac004d10 2023-11-04T01:45:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.158+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/4216877315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8005310 con 0x7fa0ac004d10 2023-11-04T01:45:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- 172.21.15.2:0/4216877315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 msgr2=0x7fa0ac005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 --2- 172.21.15.2:0/4216877315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0ac005190 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8001ca0 tx=0x7fa0b801c5a0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c4e4c640 1 -- 172.21.15.2:0/4216877315 reap_dead start 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- 172.21.15.2:0/4216877315 shutdown_connections 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- 172.21.15.2:0/4216877315 >> 172.21.15.2:0/4216877315 conn(0x7fa0c006c1d0 msgr2=0x7fa0c006c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- 172.21.15.2:0/4216877315 shutdown_connections 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- 172.21.15.2:0/4216877315 wait complete. 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 Processor -- start 2023-11-04T01:45:14.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- start start 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0c00c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00c2db0 0x7fa0c0150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c015add0 0x7fa0c00af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0150d60 con 0x7fa0ac004d10 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00ad8d0 con 0x7fa0c00c2db0 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c015b540 con 0x7fa0c015add0 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0c00c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0c00c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37972/0 (socket says 172.21.15.2:37972) 2023-11-04T01:45:14.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 -- 172.21.15.2:0/456681824 learned_addr learned my addr 172.21.15.2:0/456681824 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0b77fe640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00c2db0 0x7fa0c0150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c4e4c640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c015add0 0x7fa0c00af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 -- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c015add0 msgr2=0x7fa0c00af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c015add0 0x7fa0c00af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 -- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00c2db0 msgr2=0x7fa0c0150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00c2db0 0x7fa0c0150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 -- 172.21.15.2:0/456681824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c015b820 con 0x7fa0ac004d10 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bffff640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0c00c58b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0005fd0 tx=0x7fa0b000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bd7fa640 1 -- 172.21.15.2:0/456681824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b000c8d0 con 0x7fa0ac004d10 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bd7fa640 1 -- 172.21.15.2:0/456681824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b000ca30 con 0x7fa0ac004d10 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c00adb20 con 0x7fa0ac004d10 2023-11-04T01:45:14.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0bd7fa640 1 -- 172.21.15.2:0/456681824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b000cde0 con 0x7fa0ac004d10 2023-11-04T01:45:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.162+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c015b260 con 0x7fa0ac004d10 2023-11-04T01:45:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.166+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c00ae040 con 0x7fa0ac004d10 2023-11-04T01:45:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.166+0000 7fa0bd7fa640 1 -- 172.21.15.2:0/456681824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0b001d460 con 0x7fa0ac004d10 2023-11-04T01:45:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.166+0000 7fa0bd7fa640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0a00664a0 0x7fa0a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.166+0000 7fa0bd7fa640 1 -- 172.21.15.2:0/456681824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa0b0084150 con 0x7fa0ac004d10 2023-11-04T01:45:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.166+0000 7fa0b77fe640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0a00664a0 0x7fa0a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:14.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.166+0000 7fa0b77fe640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0a00664a0 0x7fa0a0068960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00c31d0 tx=0x7fa0a8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:14.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.170+0000 7fa0bd7fa640 1 -- 172.21.15.2:0/456681824 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0c00ae040 con 0x7fa0ac004d10 2023-11-04T01:45:14.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.362+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa0c00cd590 con 0x7fa0ac004d10 2023-11-04T01:45:14.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.950+0000 7fa0bd7fa640 1 -- 172.21.15.2:0/456681824 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v36) v1 ==== 167+0+0 (secure 0 0 0) 0x7fa0c00cd590 con 0x7fa0ac004d10 2023-11-04T01:45:14.955 INFO:teuthology.orchestra.run.smithi002.stderr:enabled new snapshots 2023-11-04T01:45:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0a00664a0 msgr2=0x7fa0a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0a00664a0 0x7fa0a0068960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00c31d0 tx=0x7fa0a8008040 comp rx=0 tx=0).stop 2023-11-04T01:45:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 msgr2=0x7fa0c00c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0c00c58b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0005fd0 tx=0x7fa0b000ec80 comp rx=0 tx=0).stop 2023-11-04T01:45:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 shutdown_connections 2023-11-04T01:45:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0a00664a0 0x7fa0a0068960 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c015add0 0x7fa0c00af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00c2db0 0x7fa0c0150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 --2- 172.21.15.2:0/456681824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0ac004d10 0x7fa0c00c58b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.954+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 >> 172.21.15.2:0/456681824 conn(0x7fa0c006c1d0 msgr2=0x7fa0c00b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.958+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 shutdown_connections 2023-11-04T01:45:14.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:14.958+0000 7fa0c68af640 1 -- 172.21.15.2:0/456681824 wait complete. 2023-11-04T01:45:14.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:14.982 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test-allow-snaps/.snap/snap00) 2023-11-04T01:45:15.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:15.002 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps/.snap/snap00) 2023-11-04T01:45:15.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:15.063 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir test-allow-snaps) 2023-11-04T01:45:15.119 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:45:15.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:45:15.225 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:45:15.276 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:45:15.276 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:45:15.276 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:15.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff9966fe640 1 Processor -- start 2023-11-04T01:45:15.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff9966fe640 1 -- start start 2023-11-04T01:45:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff9966fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff9900715d0 0x7ff9900b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff9966fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9900c2670 con 0x7ff9900b0b70 2023-11-04T01:45:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff9966fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99006bc30 con 0x7ff99015afd0 2023-11-04T01:45:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff9966fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff990070140 con 0x7ff9900715d0 2023-11-04T01:45:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff994c9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff9900b0b70 0x7ff99015ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51726/0 (socket says 172.21.15.2:51726) 2023-11-04T01:45:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff994c9b640 1 -- 172.21.15.2:0/382364474 learned_addr learned my addr 172.21.15.2:0/382364474 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:15.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98f7fe640 1 --2- 172.21.15.2:0/382364474 >> v2:172.21.15.90:3300/0 conn(0x7ff9900715d0 0x7ff9900b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965180967 0 0) 0x7ff9900c2670 con 0x7ff9900b0b70 2023-11-04T01:45:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff978003530 con 0x7ff9900b0b70 2023-11-04T01:45:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 962993146 0 0) 0x7ff978003530 con 0x7ff9900b0b70 2023-11-04T01:45:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 >> v2:172.21.15.90:3300/0 conn(0x7ff9900715d0 msgr2=0x7ff9900b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:15.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 --2- 172.21.15.2:0/382364474 >> v2:172.21.15.90:3300/0 conn(0x7ff9900715d0 0x7ff9900b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 >> v1:172.21.15.90:6789/0 conn(0x7ff99015afd0 legacy=0x7ff99006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99006bf10 con 0x7ff9900b0b70 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff988001a00 con 0x7ff9900b0b70 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 >> v1:172.21.15.2:6789/0 conn(0x7ff9900b0b70 legacy=0x7ff99015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff978003980 0x7ff978003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9780047d0 0x7ff978004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978005190 0x7ff97800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff990070140 con 0x7ff978003980 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97800c030 con 0x7ff978005190 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97800c1f0 con 0x7ff9780047d0 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98ffff640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff978003980 0x7ff978003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff994c9b640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978005190 0x7ff97800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98f7fe640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9780047d0 0x7ff978004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98ffff640 1 -- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9780047d0 msgr2=0x7ff978004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98ffff640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff9780047d0 0x7ff978004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98ffff640 1 -- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978005190 msgr2=0x7ff97800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98ffff640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978005190 0x7ff97800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff98ffff640 1 -- 172.21.15.2:0/382364474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff978003530 con 0x7ff978003980 2023-11-04T01:45:15.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.462+0000 7ff994c9b640 1 -- 172.21.15.2:0/382364474 reap_dead start 2023-11-04T01:45:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff98ffff640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff978003980 0x7ff978003da0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff980001780 tx=0x7ff98001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26540fdf186c5e13 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9800052d0 con 0x7ff978003980 2023-11-04T01:45:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9800a7050 con 0x7ff978003980 2023-11-04T01:45:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff98effd640 1 -- 172.21.15.2:0/382364474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980003600 con 0x7ff978003980 2023-11-04T01:45:15.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 -- 172.21.15.2:0/382364474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff978003980 msgr2=0x7ff978003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff978003980 0x7ff978003da0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff980001780 tx=0x7ff98001c3e0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 -- 172.21.15.2:0/382364474 shutdown_connections 2023-11-04T01:45:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 --2- 172.21.15.2:0/382364474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff978003980 0x7ff978003da0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 -- 172.21.15.2:0/382364474 >> 172.21.15.2:0/382364474 conn(0x7ff9900cebb0 msgr2=0x7ff9900cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 -- 172.21.15.2:0/382364474 shutdown_connections 2023-11-04T01:45:15.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 -- 172.21.15.2:0/382364474 wait complete. 2023-11-04T01:45:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 Processor -- start 2023-11-04T01:45:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.466+0000 7ff9966fe640 1 -- start start 2023-11-04T01:45:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978003980 0x7ff9900b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff990157030 0x7ff9901f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9901ea1e0 0x7ff9901564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900b29c0 con 0x7ff9901ea1e0 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900b1db0 con 0x7ff978003980 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900b2090 con 0x7ff990157030 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9901ea1e0 0x7ff9901564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9901ea1e0 0x7ff9901564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37994/0 (socket says 172.21.15.2:37994) 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 -- 172.21.15.2:0/512442376 learned_addr learned my addr 172.21.15.2:0/512442376 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98ffff640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978003980 0x7ff9900b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98f7fe640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff990157030 0x7ff9901f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 -- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff990157030 msgr2=0x7ff9901f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff990157030 0x7ff9901f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 -- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978003980 msgr2=0x7ff9900b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978003980 0x7ff9900b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 -- 172.21.15.2:0/512442376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900b2370 con 0x7ff9901ea1e0 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff994c9b640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9901ea1e0 0x7ff9901564a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff9900b1410 tx=0x7ff988007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98cff9640 1 -- 172.21.15.2:0/512442376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98800abb0 con 0x7ff9901ea1e0 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98cff9640 1 -- 172.21.15.2:0/512442376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98800ad30 con 0x7ff9901ea1e0 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9900b2650 con 0x7ff9901ea1e0 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98cff9640 1 -- 172.21.15.2:0/512442376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98800aea0 con 0x7ff9901ea1e0 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9901ea660 con 0x7ff9901ea1e0 2023-11-04T01:45:15.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9900b2b30 con 0x7ff9901ea1e0 2023-11-04T01:45:15.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98cff9640 1 -- 172.21.15.2:0/512442376 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff988013630 con 0x7ff9901ea1e0 2023-11-04T01:45:15.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98cff9640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff97c0664a0 0x7ff97c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98cff9640 1 -- 172.21.15.2:0/512442376 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7ff9880849c0 con 0x7ff9901ea1e0 2023-11-04T01:45:15.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.470+0000 7ff98ffff640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff97c0664a0 0x7ff97c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.474+0000 7ff98ffff640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff97c0664a0 0x7ff97c068960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff980001750 tx=0x7ff9800011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.478+0000 7ff98cff9640 1 -- 172.21.15.2:0/512442376 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff988051970 con 0x7ff9901ea1e0 2023-11-04T01:45:15.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.634+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9900744a0 con 0x7ff9901ea1e0 2023-11-04T01:45:15.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.634+0000 7ff98cff9640 1 -- 172.21.15.2:0/512442376 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+21704 (secure 0 0 0) 0x7ff988054f90 con 0x7ff9901ea1e0 2023-11-04T01:45:15.639 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:15.639 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:05.086327+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:01.698844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:02.463984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:15.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff97c0664a0 msgr2=0x7ff97c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff97c0664a0 0x7ff97c068960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff980001750 tx=0x7ff9800011a0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9901ea1e0 msgr2=0x7ff9901564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9901ea1e0 0x7ff9901564a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff9900b1410 tx=0x7ff988007bd0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 shutdown_connections 2023-11-04T01:45:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff97c0664a0 0x7ff97c068960 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9901ea1e0 0x7ff9901564a0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff990157030 0x7ff9901f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 --2- 172.21.15.2:0/512442376 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff978003980 0x7ff9900b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 >> 172.21.15.2:0/512442376 conn(0x7ff9900cebb0 msgr2=0x7ff9900afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 shutdown_connections 2023-11-04T01:45:15.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.638+0000 7ff9966fe640 1 -- 172.21.15.2:0/512442376 wait complete. 2023-11-04T01:45:15.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:45:01.698844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:45:02.463984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:45:15.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:45:15.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.770+0000 7f0fd1e02640 1 Processor -- start 2023-11-04T01:45:15.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.770+0000 7f0fd1e02640 1 -- start start 2023-11-04T01:45:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0fcc159f00 0x7f0fcc0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0fcc071250 0x7f0fcc0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fcc0b3c10 con 0x7f0fcc06de30 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc0cdb70 con 0x7f0fcc159f00 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc0cde50 con 0x7f0fcc071250 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0fcc159f00 0x7f0fcc0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcaffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0fcc06de30 0x7f0fcc070b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51736/0 (socket says 172.21.15.2:51736) 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcaffd640 1 -- 172.21.15.2:0/2005157480 learned_addr learned my addr 172.21.15.2:0/2005157480 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcbfff640 1 --2- 172.21.15.2:0/2005157480 >> v2:172.21.15.90:3300/0 conn(0x7f0fcc071250 0x7f0fcc0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcb7fe640 1 -- 172.21.15.2:0/2005157480 >> v2:172.21.15.90:3300/0 conn(0x7f0fcc071250 msgr2=0x7f0fcc0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcb7fe640 1 --2- 172.21.15.2:0/2005157480 >> v2:172.21.15.90:3300/0 conn(0x7f0fcc071250 0x7f0fcc0b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcb7fe640 1 -- 172.21.15.2:0/2005157480 >> v1:172.21.15.2:6789/0 conn(0x7f0fcc06de30 legacy=0x7f0fcc070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcb7fe640 1 -- 172.21.15.2:0/2005157480 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc15a2e0 con 0x7f0fcc159f00 2023-11-04T01:45:15.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fca7fc640 1 -- 172.21.15.2:0/2005157480 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028183297 0 0) 0x7f0fcc0b3c10 con 0x7f0fcc06de30 2023-11-04T01:45:15.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fcb7fe640 1 --2- 172.21.15.2:0/2005157480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc159f00 0x7f0fcc0719e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc06eb10 tx=0x7f0fbc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d3d01400b5172a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fca7fc640 1 -- 172.21.15.2:0/2005157480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0ac600 con 0x7f0fcc159f00 2023-11-04T01:45:15.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fca7fc640 1 -- 172.21.15.2:0/2005157480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0a8050 con 0x7f0fcc159f00 2023-11-04T01:45:15.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fca7fc640 1 -- 172.21.15.2:0/2005157480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0ac980 con 0x7f0fcc159f00 2023-11-04T01:45:15.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 -- 172.21.15.2:0/2005157480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc159f00 msgr2=0x7f0fcc0719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/2005157480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc159f00 0x7f0fcc0719e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc06eb10 tx=0x7f0fbc01c3a0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 -- 172.21.15.2:0/2005157480 shutdown_connections 2023-11-04T01:45:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/2005157480 >> v2:172.21.15.90:3300/0 conn(0x7f0fcc071250 0x7f0fcc0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/2005157480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc159f00 0x7f0fcc0719e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.774+0000 7f0fd1e02640 1 -- 172.21.15.2:0/2005157480 >> 172.21.15.2:0/2005157480 conn(0x7f0fcc0cfc70 msgr2=0x7f0fcc0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- 172.21.15.2:0/2005157480 shutdown_connections 2023-11-04T01:45:15.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- 172.21.15.2:0/2005157480 wait complete. 2023-11-04T01:45:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 Processor -- start 2023-11-04T01:45:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- start start 2023-11-04T01:45:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fcc071250 0x7f0fcc142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc159f00 0x7f0fcc141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc15bc40 0x7f0fcc1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc15c0d0 con 0x7f0fcc15bc40 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc15c3b0 con 0x7f0fcc159f00 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc15c690 con 0x7f0fcc071250 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc15bc40 0x7f0fcc1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc15bc40 0x7f0fcc1589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38016/0 (socket says 172.21.15.2:38016) 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 -- 172.21.15.2:0/844178106 learned_addr learned my addr 172.21.15.2:0/844178106 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcaffd640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc159f00 0x7f0fcc141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcb7fe640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fcc071250 0x7f0fcc142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 -- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fcc071250 msgr2=0x7f0fcc142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fcc071250 0x7f0fcc142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 -- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc159f00 msgr2=0x7f0fcc141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc159f00 0x7f0fcc141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 -- 172.21.15.2:0/844178106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc009420 con 0x7f0fcc15bc40 2023-11-04T01:45:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcaffd640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc159f00 0x7f0fcc141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fcbfff640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc15bc40 0x7f0fcc1589b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4007e30 tx=0x7f0fc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fb3fff640 1 -- 172.21.15.2:0/844178106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4014620 con 0x7f0fcc15bc40 2023-11-04T01:45:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fb3fff640 1 -- 172.21.15.2:0/844178106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400ee90 con 0x7f0fcc15bc40 2023-11-04T01:45:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc14df50 con 0x7f0fcc15bc40 2023-11-04T01:45:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fb3fff640 1 -- 172.21.15.2:0/844178106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40149c0 con 0x7f0fcc15bc40 2023-11-04T01:45:15.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc149fe0 con 0x7f0fcc15bc40 2023-11-04T01:45:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.778+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc068310 con 0x7f0fcc15bc40 2023-11-04T01:45:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.782+0000 7f0fb3fff640 1 -- 172.21.15.2:0/844178106 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0fc4014b20 con 0x7f0fcc15bc40 2023-11-04T01:45:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.782+0000 7f0fb3fff640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0fb80664a0 0x7f0fb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.782+0000 7f0fb3fff640 1 -- 172.21.15.2:0/844178106 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f0fc4084d10 con 0x7f0fcc15bc40 2023-11-04T01:45:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.782+0000 7f0fcb7fe640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0fb80664a0 0x7f0fb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:15.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.782+0000 7f0fcb7fe640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0fb80664a0 0x7f0fb8068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0ae000 tx=0x7f0fbc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:15.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.786+0000 7f0fb3fff640 1 -- 172.21.15.2:0/844178106 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0fc4051cc0 con 0x7f0fcc15bc40 2023-11-04T01:45:15.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.934+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fcc0675f0 con 0x7f0fcc15bc40 2023-11-04T01:45:15.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.934+0000 7f0fb3fff640 1 -- 172.21.15.2:0/844178106 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fc40552e0 con 0x7f0fcc15bc40 2023-11-04T01:45:15.938 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:45:15.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0fb80664a0 msgr2=0x7f0fb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0fb80664a0 0x7f0fb8068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0ae000 tx=0x7f0fbc008040 comp rx=0 tx=0).stop 2023-11-04T01:45:15.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc15bc40 msgr2=0x7f0fcc1589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc15bc40 0x7f0fcc1589b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4007e30 tx=0x7f0fc400e4b0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 shutdown_connections 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0fb80664a0 0x7f0fb8068960 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0fcc15bc40 0x7f0fcc1589b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0fcc159f00 0x7f0fcc141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 --2- 172.21.15.2:0/844178106 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0fcc071250 0x7f0fcc142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 >> 172.21.15.2:0/844178106 conn(0x7f0fcc0cfc70 msgr2=0x7f0fcc0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 shutdown_connections 2023-11-04T01:45:15.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:15.938+0000 7f0fd1e02640 1 -- 172.21.15.2:0/844178106 wait complete. 2023-11-04T01:45:15.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:45:16.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26b4e8f640 1 Processor -- start 2023-11-04T01:45:16.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26b4e8f640 1 -- start start 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26b4e8f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f26b0144840 0x7f26b015f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26b4e8f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f26b0070b40 0x7f26b00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26b4e8f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b006cc10 con 0x7f26b00b54d0 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26b4e8f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b00b5960 con 0x7f26b0070b40 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26b4e8f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b0071d10 con 0x7f26b0144840 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26aed9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f26b00b54d0 0x7f26b006a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51746/0 (socket says 172.21.15.2:51746) 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26aed9d640 1 -- 172.21.15.2:0/715975493 learned_addr learned my addr 172.21.15.2:0/715975493 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26add9b640 1 --2- 172.21.15.2:0/715975493 >> v2:172.21.15.2:3300/0 conn(0x7f26b0070b40 0x7f26b00b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26ae59c640 1 --2- 172.21.15.2:0/715975493 >> v2:172.21.15.90:3300/0 conn(0x7f26b0144840 0x7f26b015f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26ad59a640 1 -- 172.21.15.2:0/715975493 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955461312 0 0) 0x7f26b006cc10 con 0x7f26b00b54d0 2023-11-04T01:45:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26ad59a640 1 -- 172.21.15.2:0/715975493 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2698003530 con 0x7f26b00b54d0 2023-11-04T01:45:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26add9b640 1 -- 172.21.15.2:0/715975493 >> v2:172.21.15.90:3300/0 conn(0x7f26b0144840 msgr2=0x7f26b015f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26add9b640 1 --2- 172.21.15.2:0/715975493 >> v2:172.21.15.90:3300/0 conn(0x7f26b0144840 0x7f26b015f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26add9b640 1 -- 172.21.15.2:0/715975493 >> v1:172.21.15.2:6789/0 conn(0x7f26b00b54d0 legacy=0x7f26b006a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.082+0000 7f26add9b640 1 -- 172.21.15.2:0/715975493 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b015fb20 con 0x7f26b0070b40 2023-11-04T01:45:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26add9b640 1 --2- 172.21.15.2:0/715975493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b0070b40 0x7f26b00b4f90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f26b006f9d0 tx=0x7f26a401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42217ad63fc1b26 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26ad59a640 1 -- 172.21.15.2:0/715975493 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40ab600 con 0x7f26b0070b40 2023-11-04T01:45:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26ad59a640 1 -- 172.21.15.2:0/715975493 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a40a7050 con 0x7f26b0070b40 2023-11-04T01:45:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26ad59a640 1 -- 172.21.15.2:0/715975493 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40ab960 con 0x7f26b0070b40 2023-11-04T01:45:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 -- 172.21.15.2:0/715975493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b0070b40 msgr2=0x7f26b00b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/715975493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b0070b40 0x7f26b00b4f90 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f26b006f9d0 tx=0x7f26a401c3a0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 -- 172.21.15.2:0/715975493 shutdown_connections 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/715975493 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b0070b40 0x7f26b00b4f90 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/715975493 >> v2:172.21.15.90:3300/0 conn(0x7f26b0144840 0x7f26b015f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 -- 172.21.15.2:0/715975493 >> 172.21.15.2:0/715975493 conn(0x7f26b00cfc70 msgr2=0x7f26b00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 -- 172.21.15.2:0/715975493 shutdown_connections 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 -- 172.21.15.2:0/715975493 wait complete. 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 Processor -- start 2023-11-04T01:45:16.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.086+0000 7f26b4e8f640 1 -- start start 2023-11-04T01:45:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26b0070b40 0x7f26b015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b00b54d0 0x7f26b0135190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26b0144840 0x7f26b015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b01356d0 con 0x7f26b00b54d0 2023-11-04T01:45:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b015cac0 con 0x7f26b0070b40 2023-11-04T01:45:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b0158920 con 0x7f26b0144840 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b00b54d0 0x7f26b0135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b00b54d0 0x7f26b0135190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38034/0 (socket says 172.21.15.2:38034) 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 -- 172.21.15.2:0/3351797016 learned_addr learned my addr 172.21.15.2:0/3351797016 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26ae59c640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26b0070b40 0x7f26b015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 -- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26b0144840 msgr2=0x7f26b015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26b0144840 0x7f26b015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 -- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26b0070b40 msgr2=0x7f26b015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26b0070b40 0x7f26b015e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 -- 172.21.15.2:0/3351797016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4009420 con 0x7f26b00b54d0 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26add9b640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b00b54d0 0x7f26b0135190 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f26a401c880 tx=0x7f26a4019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f269effd640 1 -- 172.21.15.2:0/3351797016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4003a30 con 0x7f26b00b54d0 2023-11-04T01:45:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f269effd640 1 -- 172.21.15.2:0/3351797016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4003b90 con 0x7f26b00b54d0 2023-11-04T01:45:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f269effd640 1 -- 172.21.15.2:0/3351797016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a40ab400 con 0x7f26b00b54d0 2023-11-04T01:45:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b01591c0 con 0x7f26b00b54d0 2023-11-04T01:45:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b015c7e0 con 0x7f26b00b54d0 2023-11-04T01:45:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b0159350 con 0x7f26b00b54d0 2023-11-04T01:45:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f269effd640 1 -- 172.21.15.2:0/3351797016 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26a40b2040 con 0x7f26b00b54d0 2023-11-04T01:45:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f269effd640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2690066470 0x7f2690068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f269effd640 1 -- 172.21.15.2:0/3351797016 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f26a411e050 con 0x7f26b00b54d0 2023-11-04T01:45:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.090+0000 7f26ae59c640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2690066470 0x7f2690068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.094+0000 7f26ae59c640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2690066470 0x7f2690068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f26a80074a0 tx=0x7f26a800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.094+0000 7f269effd640 1 -- 172.21.15.2:0/3351797016 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26a40eb0a0 con 0x7f26b00b54d0 2023-11-04T01:45:16.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.250+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f26b00675f0 con 0x7f26b00b54d0 2023-11-04T01:45:16.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f269effd640 1 -- 172.21.15.2:0/3351797016 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v80) v1 ==== 103+0+11 (secure 0 0 0) 0x7f26a40ee6c0 con 0x7f26b00b54d0 2023-11-04T01:45:16.255 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2690066470 msgr2=0x7f2690068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2690066470 0x7f2690068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f26a80074a0 tx=0x7f26a800b040 comp rx=0 tx=0).stop 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b00b54d0 msgr2=0x7f26b0135190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b00b54d0 0x7f26b0135190 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f26a401c880 tx=0x7f26a4019140 comp rx=0 tx=0).stop 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 shutdown_connections 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2690066470 0x7f2690068930 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26b0144840 0x7f26b015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26b00b54d0 0x7f26b0135190 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 --2- 172.21.15.2:0/3351797016 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26b0070b40 0x7f26b015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 >> 172.21.15.2:0/3351797016 conn(0x7f26b00cfc70 msgr2=0x7f26b00cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 shutdown_connections 2023-11-04T01:45:16.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.254+0000 7f26b4e8f640 1 -- 172.21.15.2:0/3351797016 wait complete. 2023-11-04T01:45:16.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:45:16.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0c5661640 1 Processor -- start 2023-11-04T01:45:16.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0c5661640 1 -- start start 2023-11-04T01:45:16.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0c5661640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c00cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0c5661640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa0c00d1940 0x7fa0c00d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0c5661640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00b5e00 con 0x7fa0c015d0b0 2023-11-04T01:45:16.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0c5661640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0c00d1520 con 0x7fa0c00d1940 2023-11-04T01:45:16.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0c5661640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c00d0190 con 0x7fa0c00cf810 2023-11-04T01:45:16.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0be7fc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c00cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0bf7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa0c00d1940 0x7fa0c00d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0bf7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa0c00d1940 0x7fa0c00d1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:55910/0 (socket says 172.21.15.2:55910) 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/3754999494 learned_addr learned my addr 172.21.15.2:0/3754999494 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0be7fc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c00cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:40102/0 (socket says 172.21.15.2:40102) 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0beffd640 1 --1- 172.21.15.2:0/3754999494 >> v1:172.21.15.90:6789/0 conn(0x7fa0c015d0b0 0x7fa0c0160bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:53488/0 (socket says 172.21.15.2:53488) 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/3754999494 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 msgr2=0x7fa0c00cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/3754999494 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c00cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/3754999494 >> v1:172.21.15.90:6789/0 conn(0x7fa0c015d0b0 legacy=0x7fa0c0160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.402+0000 7fa0bf7fe640 1 -- 172.21.15.2:0/3754999494 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c015d490 con 0x7fa0c00d1940 2023-11-04T01:45:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/3754999494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00d1940 0x7fa0c00d1dd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009e50 tx=0x7fa0b801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37a928d3a6fdcc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0bdffb640 1 -- 172.21.15.2:0/3754999494 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80a58e0 con 0x7fa0c00d1940 2023-11-04T01:45:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0bdffb640 1 -- 172.21.15.2:0/3754999494 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b80a5a40 con 0x7fa0c00d1940 2023-11-04T01:45:16.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0bdffb640 1 -- 172.21.15.2:0/3754999494 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80a5dd0 con 0x7fa0c00d1940 2023-11-04T01:45:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- 172.21.15.2:0/3754999494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00d1940 msgr2=0x7fa0c00d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 --2- 172.21.15.2:0/3754999494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00d1940 0x7fa0c00d1dd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009e50 tx=0x7fa0b801ca10 comp rx=0 tx=0).stop 2023-11-04T01:45:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- 172.21.15.2:0/3754999494 shutdown_connections 2023-11-04T01:45:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 --2- 172.21.15.2:0/3754999494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c00d1940 0x7fa0c00d1dd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 --2- 172.21.15.2:0/3754999494 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c00cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- 172.21.15.2:0/3754999494 >> 172.21.15.2:0/3754999494 conn(0x7fa0c006a890 msgr2=0x7fa0c006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:16.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- 172.21.15.2:0/3754999494 shutdown_connections 2023-11-04T01:45:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- 172.21.15.2:0/3754999494 wait complete. 2023-11-04T01:45:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 Processor -- start 2023-11-04T01:45:16.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- start start 2023-11-04T01:45:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c0154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c00d1940 0x7fa0c0156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015d0b0 0x7fa0c0158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0155a70 con 0x7fa0c00d1940 2023-11-04T01:45:16.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0154e60 con 0x7fa0c015d0b0 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.406+0000 7fa0c5661640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c0155140 con 0x7fa0c00cf810 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c00d1940 0x7fa0c0156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c00d1940 0x7fa0c0156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38040/0 (socket says 172.21.15.2:38040) 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 -- 172.21.15.2:0/894151170 learned_addr learned my addr 172.21.15.2:0/894151170 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0beffd640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c0154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015d0b0 0x7fa0c0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 -- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 msgr2=0x7fa0c0154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c0154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 -- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015d0b0 msgr2=0x7fa0c0158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015d0b0 0x7fa0c0158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 -- 172.21.15.2:0/894151170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8009b30 con 0x7fa0c00d1940 2023-11-04T01:45:16.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0bf7fe640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015d0b0 0x7fa0c0158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0be7fc640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c00d1940 0x7fa0c0156460 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400e870 tx=0x7fa0b400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0a77fe640 1 -- 172.21.15.2:0/894151170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4009510 con 0x7fa0c00d1940 2023-11-04T01:45:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0a77fe640 1 -- 172.21.15.2:0/894151170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b400eec0 con 0x7fa0c00d1940 2023-11-04T01:45:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c0155420 con 0x7fa0c00d1940 2023-11-04T01:45:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0a77fe640 1 -- 172.21.15.2:0/894151170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400cb40 con 0x7fa0c00d1940 2023-11-04T01:45:16.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c0154b10 con 0x7fa0c00d1940 2023-11-04T01:45:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0c00cad70 con 0x7fa0c00d1940 2023-11-04T01:45:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0a77fe640 1 -- 172.21.15.2:0/894151170 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0b400cca0 con 0x7fa0c00d1940 2023-11-04T01:45:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0a77fe640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ac0664a0 0x7fa0ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0a77fe640 1 -- 172.21.15.2:0/894151170 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa0b40843a0 con 0x7fa0c00d1940 2023-11-04T01:45:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.410+0000 7fa0beffd640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ac0664a0 0x7fa0ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.414+0000 7fa0beffd640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ac0664a0 0x7fa0ac068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00b5910 tx=0x7fa0b0007cf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.414+0000 7fa0a77fe640 1 -- 172.21.15.2:0/894151170 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa0b4051480 con 0x7fa0c00d1940 2023-11-04T01:45:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fa0c00744a0 con 0x7fa0c00d1940 2023-11-04T01:45:16.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0a77fe640 1 -- 172.21.15.2:0/894151170 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v80) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa0b4054aa0 con 0x7fa0c00d1940 2023-11-04T01:45:16.573 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ac0664a0 msgr2=0x7fa0ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ac0664a0 0x7fa0ac068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00b5910 tx=0x7fa0b0007cf0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c00d1940 msgr2=0x7fa0c0156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c00d1940 0x7fa0c0156460 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400e870 tx=0x7fa0b400ec70 comp rx=0 tx=0).stop 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 shutdown_connections 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ac0664a0 0x7fa0ac068960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0c015d0b0 0x7fa0c0158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0c00d1940 0x7fa0c0156460 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 --2- 172.21.15.2:0/894151170 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0c00cf810 0x7fa0c0154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 >> 172.21.15.2:0/894151170 conn(0x7fa0c006a890 msgr2=0x7fa0c015ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 shutdown_connections 2023-11-04T01:45:16.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.570+0000 7fa0c5661640 1 -- 172.21.15.2:0/894151170 wait complete. 2023-11-04T01:45:16.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:45:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d90630640 1 Processor -- start 2023-11-04T01:45:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d90630640 1 -- start start 2023-11-04T01:45:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d90630640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 0x7f8d8806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d90630640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d88160cb0 con 0x7f8d880b26c0 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d90630640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d88160f50 con 0x7f8d8806c1c0 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d90630640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88161230 con 0x7f8d8806b580 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8d880b26c0 0x7f8d880b2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51762/0 (socket says 172.21.15.2:51762) 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 -- 172.21.15.2:0/3873953825 learned_addr learned my addr 172.21.15.2:0/3873953825 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8dbcb640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 0x7f8d8806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837411813 0 0) 0x7f8d88160cb0 con 0x7f8d880b26c0 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d74003530 con 0x7f8d880b26c0 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 267645592 0 0) 0x7f8d74003530 con 0x7f8d880b26c0 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 msgr2=0x7f8d8806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:16.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 0x7f8d8806bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 >> v1:172.21.15.90:6789/0 conn(0x7f8d8806c1c0 legacy=0x7f8d8815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88161510 con 0x7f8d880b26c0 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f8d84001800 con 0x7f8d880b26c0 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 >> v1:172.21.15.2:6789/0 conn(0x7f8d880b26c0 legacy=0x7f8d880b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 0x7f8d740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d74004d10 0x7f8d74005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88161230 con 0x7f8d740039b0 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7400ba70 con 0x7f8d74004d10 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7400bc30 con 0x7f8d8806b580 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8dbcb640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 0x7f8d740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8ebcd640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d74004d10 0x7f8d74005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 -- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 msgr2=0x7f8d740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d8806b580 0x7f8d740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 -- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d74004d10 msgr2=0x7f8d74005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d74004d10 0x7f8d74005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.714+0000 7f8d8e3cc640 1 -- 172.21.15.2:0/3873953825 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74003530 con 0x7f8d740039b0 2023-11-04T01:45:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d8e3cc640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400c210 tx=0x7f8d8401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97387af39d408b8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84007270 con 0x7f8d740039b0 2023-11-04T01:45:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d840073f0 con 0x7f8d740039b0 2023-11-04T01:45:16.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d8d3ca640 1 -- 172.21.15.2:0/3873953825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840057b0 con 0x7f8d740039b0 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- 172.21.15.2:0/3873953825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d740039b0 msgr2=0x7f8d74003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 --2- 172.21.15.2:0/3873953825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d740039b0 0x7f8d74003dd0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400c210 tx=0x7f8d8401cc00 comp rx=0 tx=0).stop 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d8ebcd640 1 -- 172.21.15.2:0/3873953825 reap_dead start 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- 172.21.15.2:0/3873953825 shutdown_connections 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- 172.21.15.2:0/3873953825 >> 172.21.15.2:0/3873953825 conn(0x7f8d8809a030 msgr2=0x7f8d880d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- 172.21.15.2:0/3873953825 shutdown_connections 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- 172.21.15.2:0/3873953825 wait complete. 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 Processor -- start 2023-11-04T01:45:16.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- start start 2023-11-04T01:45:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d740039b0 0x7f8d88158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d881593f0 0x7f8d88165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d880c46c0 0x7f8d880b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88166ec0 con 0x7f8d881593f0 2023-11-04T01:45:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d881599a0 con 0x7f8d880c46c0 2023-11-04T01:45:16.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.718+0000 7f8d90630640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88159f20 con 0x7f8d740039b0 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d881593f0 0x7f8d88165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d881593f0 0x7f8d88165f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38050/0 (socket says 172.21.15.2:38050) 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 -- 172.21.15.2:0/1806013138 learned_addr learned my addr 172.21.15.2:0/1806013138 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8ebcd640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d880c46c0 0x7f8d880b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8e3cc640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d740039b0 0x7f8d88158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 -- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d740039b0 msgr2=0x7f8d88158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d740039b0 0x7f8d88158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 -- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d880c46c0 msgr2=0x7f8d880b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d880c46c0 0x7f8d880b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 -- 172.21.15.2:0/1806013138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88166900 con 0x7f8d881593f0 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8dbcb640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d881593f0 0x7f8d88165f90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8d78011610 tx=0x7f8d78011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d7effd640 1 -- 172.21.15.2:0/1806013138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800f8f0 con 0x7f8d881593f0 2023-11-04T01:45:16.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d7effd640 1 -- 172.21.15.2:0/1806013138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7800fa50 con 0x7f8d881593f0 2023-11-04T01:45:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d88166be0 con 0x7f8d881593f0 2023-11-04T01:45:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d7effd640 1 -- 172.21.15.2:0/1806013138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800fdc0 con 0x7f8d881593f0 2023-11-04T01:45:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d88158f80 con 0x7f8d881593f0 2023-11-04T01:45:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d880744a0 con 0x7f8d881593f0 2023-11-04T01:45:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d7effd640 1 -- 172.21.15.2:0/1806013138 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d78015460 con 0x7f8d881593f0 2023-11-04T01:45:16.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d7effd640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8d6c0664a0 0x7f8d6c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d7effd640 1 -- 172.21.15.2:0/1806013138 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f8d78084ba0 con 0x7f8d881593f0 2023-11-04T01:45:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8e3cc640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8d6c0664a0 0x7f8d6c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:16.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.722+0000 7f8d8e3cc640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8d6c0664a0 0x7f8d6c068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8d840ab000 tx=0x7f8d840a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:16.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.726+0000 7f8d7effd640 1 -- 172.21.15.2:0/1806013138 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d78051ca0 con 0x7f8d881593f0 2023-11-04T01:45:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f8d8806ba60 con 0x7f8d881593f0 2023-11-04T01:45:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d7effd640 1 -- 172.21.15.2:0/1806013138 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v80) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8d780552c0 con 0x7f8d881593f0 2023-11-04T01:45:16.884 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8d6c0664a0 msgr2=0x7f8d6c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8d6c0664a0 0x7f8d6c068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8d840ab000 tx=0x7f8d840a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d881593f0 msgr2=0x7f8d88165f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d881593f0 0x7f8d88165f90 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8d78011610 tx=0x7f8d78011ad0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 shutdown_connections 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8d6c0664a0 0x7f8d6c068960 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d880c46c0 0x7f8d880b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d881593f0 0x7f8d88165f90 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 --2- 172.21.15.2:0/1806013138 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8d740039b0 0x7f8d88158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 >> 172.21.15.2:0/1806013138 conn(0x7f8d8809a030 msgr2=0x7f8d880b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 shutdown_connections 2023-11-04T01:45:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:16.882+0000 7f8d90630640 1 -- 172.21.15.2:0/1806013138 wait complete. 2023-11-04T01:45:16.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:45:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f338b6a4640 1 Processor -- start 2023-11-04T01:45:17.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f338b6a4640 1 -- start start 2023-11-04T01:45:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f338b6a4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f33840cd670 0x7f33840ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f338b6a4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f338406cfc0 0x7f338415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f338b6a4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3384160c50 con 0x7f33840cda50 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f338b6a4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840cedf0 con 0x7f33840cd670 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f338b6a4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3384160ef0 con 0x7f338406cfc0 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3389440640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f33840cd670 0x7f33840ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3389c41640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f33840cda50 0x7f33840af8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51774/0 (socket says 172.21.15.2:51774) 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3389c41640 1 -- 172.21.15.2:0/3855578988 learned_addr learned my addr 172.21.15.2:0/3855578988 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3388c3f640 1 --2- 172.21.15.2:0/3855578988 >> v2:172.21.15.90:3300/0 conn(0x7f338406cfc0 0x7f338415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3389440640 1 -- 172.21.15.2:0/3855578988 >> v2:172.21.15.90:3300/0 conn(0x7f338406cfc0 msgr2=0x7f338415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3389440640 1 --2- 172.21.15.2:0/3855578988 >> v2:172.21.15.90:3300/0 conn(0x7f338406cfc0 0x7f338415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3389440640 1 -- 172.21.15.2:0/3855578988 >> v1:172.21.15.2:6789/0 conn(0x7f33840cda50 legacy=0x7f33840af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3389440640 1 -- 172.21.15.2:0/3855578988 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33841611d0 con 0x7f33840cd670 2023-11-04T01:45:17.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.022+0000 7f3388c3f640 1 --2- 172.21.15.2:0/3855578988 >> v2:172.21.15.90:3300/0 conn(0x7f338406cfc0 0x7f338415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:17.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f3389440640 1 --2- 172.21.15.2:0/3855578988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840ce8b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f338406f190 tx=0x7f337801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a3a20cdb3ced77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f3377fff640 1 -- 172.21.15.2:0/3855578988 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780ab610 con 0x7f33840cd670 2023-11-04T01:45:17.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f3377fff640 1 -- 172.21.15.2:0/3855578988 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33780ab770 con 0x7f33840cd670 2023-11-04T01:45:17.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f3377fff640 1 -- 172.21.15.2:0/3855578988 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780abb00 con 0x7f33840cd670 2023-11-04T01:45:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 -- 172.21.15.2:0/3855578988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 msgr2=0x7f33840ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 --2- 172.21.15.2:0/3855578988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840ce8b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f338406f190 tx=0x7f337801c410 comp rx=0 tx=0).stop 2023-11-04T01:45:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 -- 172.21.15.2:0/3855578988 shutdown_connections 2023-11-04T01:45:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 --2- 172.21.15.2:0/3855578988 >> v2:172.21.15.90:3300/0 conn(0x7f338406cfc0 0x7f338415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 --2- 172.21.15.2:0/3855578988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840ce8b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 -- 172.21.15.2:0/3855578988 >> 172.21.15.2:0/3855578988 conn(0x7f3384065dc0 msgr2=0x7f33840661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 -- 172.21.15.2:0/3855578988 shutdown_connections 2023-11-04T01:45:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 -- 172.21.15.2:0/3855578988 wait complete. 2023-11-04T01:45:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 Processor -- start 2023-11-04T01:45:17.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.026+0000 7f338b6a4640 1 -- start start 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f338406cfc0 0x7f338414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33840cda50 0x7f3384155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338414d920 con 0x7f33840cd670 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33840c8790 con 0x7f338406cfc0 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33840c8a70 con 0x7f33840cda50 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38070/0 (socket says 172.21.15.2:38070) 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 -- 172.21.15.2:0/2597003912 learned_addr learned my addr 172.21.15.2:0/2597003912 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3389440640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f338406cfc0 0x7f338414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3389c41640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33840cda50 0x7f3384155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 -- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33840cda50 msgr2=0x7f3384155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33840cda50 0x7f3384155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 -- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f338406cfc0 msgr2=0x7f338414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f338406cfc0 0x7f338414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 -- 172.21.15.2:0/2597003912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33780093b0 con 0x7f33840cd670 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3388c3f640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840c7db0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f338000cde0 tx=0x7f338000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3375ffb640 1 -- 172.21.15.2:0/2597003912 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000f680 con 0x7f33840cd670 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3375ffb640 1 -- 172.21.15.2:0/2597003912 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000f7e0 con 0x7f33840cd670 2023-11-04T01:45:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33840c8d50 con 0x7f33840cd670 2023-11-04T01:45:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3375ffb640 1 -- 172.21.15.2:0/2597003912 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338000fb90 con 0x7f33840cd670 2023-11-04T01:45:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33840c9310 con 0x7f33840cd670 2023-11-04T01:45:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33840675f0 con 0x7f33840cd670 2023-11-04T01:45:17.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3375ffb640 1 -- 172.21.15.2:0/2597003912 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f338000b040 con 0x7f33840cd670 2023-11-04T01:45:17.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3375ffb640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33680664a0 0x7f3368068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3375ffb640 1 -- 172.21.15.2:0/2597003912 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f3380084d60 con 0x7f33840cd670 2023-11-04T01:45:17.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.030+0000 7f3389440640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33680664a0 0x7f3368068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.034+0000 7f3389440640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33680664a0 0x7f3368068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f33780af000 tx=0x7f33780a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.034+0000 7f3375ffb640 1 -- 172.21.15.2:0/2597003912 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3380051ef0 con 0x7f33840cd670 2023-11-04T01:45:17.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.190+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33840b6c60 con 0x7f33840cd670 2023-11-04T01:45:17.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.190+0000 7f3375ffb640 1 -- 172.21.15.2:0/2597003912 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3380055510 con 0x7f33840cd670 2023-11-04T01:45:17.194 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33680664a0 msgr2=0x7f3368068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33680664a0 0x7f3368068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f33780af000 tx=0x7f33780a7000 comp rx=0 tx=0).stop 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 msgr2=0x7f33840c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840c7db0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f338000cde0 tx=0x7f338000a650 comp rx=0 tx=0).stop 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 shutdown_connections 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f33680664a0 0x7f3368068960 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f33840cda50 0x7f3384155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33840cd670 0x7f33840c7db0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 --2- 172.21.15.2:0/2597003912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f338406cfc0 0x7f338414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 >> 172.21.15.2:0/2597003912 conn(0x7f3384065dc0 msgr2=0x7f338406bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:17.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 shutdown_connections 2023-11-04T01:45:17.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.194+0000 7f338b6a4640 1 -- 172.21.15.2:0/2597003912 wait complete. 2023-11-04T01:45:17.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:45:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.338+0000 7f7528b5b640 1 Processor -- start 2023-11-04T01:45:17.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7528b5b640 1 -- start start 2023-11-04T01:45:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7528b5b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f752415d0b0 0x7f7524160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7528b5b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75240cff20 0x7f75240d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7528b5b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75240b5e00 con 0x7f75241610f0 2023-11-04T01:45:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7528b5b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75240d1520 con 0x7f752415d0b0 2023-11-04T01:45:17.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7528b5b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752415d490 con 0x7f75240cff20 2023-11-04T01:45:17.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7522d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75240cff20 0x7f75240d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f752259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f752415d0b0 0x7f7524160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f752259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f752415d0b0 0x7f7524160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:55958/0 (socket says 172.21.15.2:55958) 2023-11-04T01:45:17.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7521d9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f75241610f0 0x7f75240cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:53516/0 (socket says 172.21.15.2:53516) 2023-11-04T01:45:17.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f752259c640 1 -- 172.21.15.2:0/674727506 learned_addr learned my addr 172.21.15.2:0/674727506 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:17.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f752259c640 1 -- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75240cff20 msgr2=0x7f75240d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:17.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f752259c640 1 --2- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75240cff20 0x7f75240d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f752259c640 1 -- 172.21.15.2:0/674727506 >> v1:172.21.15.90:6789/0 conn(0x7f75241610f0 legacy=0x7f75240cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f752259c640 1 -- 172.21.15.2:0/674727506 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75240b8930 con 0x7f752415d0b0 2023-11-04T01:45:17.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.342+0000 7f7522d9d640 1 --2- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75240cff20 0x7f75240d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f752259c640 1 --2- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415d0b0 0x7f7524160bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7514009870 tx=0x7f751401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb742ecf23901b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f752159a640 1 -- 172.21.15.2:0/674727506 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140ab650 con 0x7f752415d0b0 2023-11-04T01:45:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f752159a640 1 -- 172.21.15.2:0/674727506 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75140ab7b0 con 0x7f752415d0b0 2023-11-04T01:45:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f752159a640 1 -- 172.21.15.2:0/674727506 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140abb40 con 0x7f752415d0b0 2023-11-04T01:45:17.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 -- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415d0b0 msgr2=0x7f7524160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 --2- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415d0b0 0x7f7524160bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7514009870 tx=0x7f751401c540 comp rx=0 tx=0).stop 2023-11-04T01:45:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 -- 172.21.15.2:0/674727506 shutdown_connections 2023-11-04T01:45:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 --2- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75240cff20 0x7f75240d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 --2- 172.21.15.2:0/674727506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f752415d0b0 0x7f7524160bb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 -- 172.21.15.2:0/674727506 >> 172.21.15.2:0/674727506 conn(0x7f752406a890 msgr2=0x7f752406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 -- 172.21.15.2:0/674727506 shutdown_connections 2023-11-04T01:45:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 -- 172.21.15.2:0/674727506 wait complete. 2023-11-04T01:45:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.346+0000 7f7528b5b640 1 Processor -- start 2023-11-04T01:45:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 -- start start 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75240cff20 0x7f7524153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f752415d0b0 0x7f7524152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75241610f0 0x7f752414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752414e270 con 0x7f752415d0b0 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75241589b0 con 0x7f75240cff20 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7524152590 con 0x7f75241610f0 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f752415d0b0 0x7f7524152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f752415d0b0 0x7f7524152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38072/0 (socket says 172.21.15.2:38072) 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 -- 172.21.15.2:0/1738121505 learned_addr learned my addr 172.21.15.2:0/1738121505 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f752259c640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75240cff20 0x7f7524153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7522d9d640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75241610f0 0x7f752414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 -- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75241610f0 msgr2=0x7f752414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75241610f0 0x7f752414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 -- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75240cff20 msgr2=0x7f7524153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75240cff20 0x7f7524153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 -- 172.21.15.2:0/1738121505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c009a70 con 0x7f752415d0b0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7521d9b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f752415d0b0 0x7f7524152050 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f751800c3a0 tx=0x7f751800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7512ffd640 1 -- 172.21.15.2:0/1738121505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75180074e0 con 0x7f752415d0b0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7512ffd640 1 -- 172.21.15.2:0/1738121505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7518007640 con 0x7f752415d0b0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7512ffd640 1 -- 172.21.15.2:0/1738121505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518004a30 con 0x7f752415d0b0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75140094d0 con 0x7f752415d0b0 2023-11-04T01:45:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524158080 con 0x7f752415d0b0 2023-11-04T01:45:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75240744a0 con 0x7f752415d0b0 2023-11-04T01:45:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.350+0000 7f7512ffd640 1 -- 172.21.15.2:0/1738121505 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7518004b90 con 0x7f752415d0b0 2023-11-04T01:45:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.354+0000 7f7512ffd640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75040664a0 0x7f7504068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.354+0000 7f7512ffd640 1 -- 172.21.15.2:0/1738121505 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f7518083bc0 con 0x7f752415d0b0 2023-11-04T01:45:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.354+0000 7f752259c640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75040664a0 0x7f7504068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.354+0000 7f752259c640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75040664a0 0x7f7504068960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f75140af000 tx=0x7f75140b6040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.358+0000 7f7512ffd640 1 -- 172.21.15.2:0/1738121505 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7518050c00 con 0x7f752415d0b0 2023-11-04T01:45:17.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75240d0a10 con 0x7f752415d0b0 2023-11-04T01:45:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7512ffd640 1 -- 172.21.15.2:0/1738121505 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7518054220 con 0x7f752415d0b0 2023-11-04T01:45:17.508 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:45:17.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75040664a0 msgr2=0x7f7504068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75040664a0 0x7f7504068960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f75140af000 tx=0x7f75140b6040 comp rx=0 tx=0).stop 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f752415d0b0 msgr2=0x7f7524152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f752415d0b0 0x7f7524152050 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f751800c3a0 tx=0x7f751800c860 comp rx=0 tx=0).stop 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 shutdown_connections 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75040664a0 0x7f7504068960 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75241610f0 0x7f752414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f752415d0b0 0x7f7524152050 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 --2- 172.21.15.2:0/1738121505 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75240cff20 0x7f7524153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 >> 172.21.15.2:0/1738121505 conn(0x7f752406a890 msgr2=0x7f752415dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 shutdown_connections 2023-11-04T01:45:17.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.506+0000 7f7528b5b640 1 -- 172.21.15.2:0/1738121505 wait complete. 2023-11-04T01:45:17.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:45:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c6865a640 1 Processor -- start 2023-11-04T01:45:17.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c6865a640 1 -- start start 2023-11-04T01:45:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c6865a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c600b4990 0x7f6c600b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c6865a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600b6070 con 0x7f6c600b74f0 2023-11-04T01:45:17.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c6865a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600b8ed0 con 0x7f6c600d0690 2023-11-04T01:45:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c6865a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c600ce590 con 0x7f6c600b4990 2023-11-04T01:45:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c66bf7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c600b74f0 0x7f6c600cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51780/0 (socket says 172.21.15.2:51780) 2023-11-04T01:45:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c66bf7640 1 -- 172.21.15.2:0/2241032348 learned_addr learned my addr 172.21.15.2:0/2241032348 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c663f6640 1 --2- 172.21.15.2:0/2241032348 >> v2:172.21.15.2:3300/0 conn(0x7f6c600b4990 0x7f6c600b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c653f4640 1 -- 172.21.15.2:0/2241032348 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209079665 0 0) 0x7f6c600b6070 con 0x7f6c600b74f0 2023-11-04T01:45:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c653f4640 1 -- 172.21.15.2:0/2241032348 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c4c003530 con 0x7f6c600b74f0 2023-11-04T01:45:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c663f6640 1 -- 172.21.15.2:0/2241032348 >> v1:172.21.15.90:6789/0 conn(0x7f6c600d0690 legacy=0x7f6c600cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c663f6640 1 -- 172.21.15.2:0/2241032348 >> v1:172.21.15.2:6789/0 conn(0x7f6c600b74f0 legacy=0x7f6c600cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.642+0000 7f6c663f6640 1 -- 172.21.15.2:0/2241032348 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600b52b0 con 0x7f6c600b4990 2023-11-04T01:45:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c663f6640 1 --2- 172.21.15.2:0/2241032348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b4990 0x7f6c600b4d70 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0097c0 tx=0x7f6c5c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e94bc86f39909c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c653f4640 1 -- 172.21.15.2:0/2241032348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0a8970 con 0x7f6c600b4990 2023-11-04T01:45:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c653f4640 1 -- 172.21.15.2:0/2241032348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0a8ad0 con 0x7f6c600b4990 2023-11-04T01:45:17.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c653f4640 1 -- 172.21.15.2:0/2241032348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0a8e60 con 0x7f6c600b4990 2023-11-04T01:45:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c6865a640 1 -- 172.21.15.2:0/2241032348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b4990 msgr2=0x7f6c600b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c6865a640 1 --2- 172.21.15.2:0/2241032348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b4990 0x7f6c600b4d70 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0097c0 tx=0x7f6c5c01ec70 comp rx=0 tx=0).stop 2023-11-04T01:45:17.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c6865a640 1 -- 172.21.15.2:0/2241032348 shutdown_connections 2023-11-04T01:45:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c6865a640 1 --2- 172.21.15.2:0/2241032348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b4990 0x7f6c600b4d70 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c6865a640 1 -- 172.21.15.2:0/2241032348 >> 172.21.15.2:0/2241032348 conn(0x7f6c600cf990 msgr2=0x7f6c600cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c6865a640 1 -- 172.21.15.2:0/2241032348 shutdown_connections 2023-11-04T01:45:17.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.646+0000 7f6c6865a640 1 -- 172.21.15.2:0/2241032348 wait complete. 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 Processor -- start 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 -- start start 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c600b4990 0x7f6c6015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b74f0 0x7f6c6015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c600d0690 0x7f6c601430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60160350 con 0x7f6c600b74f0 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60159390 con 0x7f6c600b4990 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60156f50 con 0x7f6c600d0690 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b74f0 0x7f6c6015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b74f0 0x7f6c6015ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38102/0 (socket says 172.21.15.2:38102) 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 -- 172.21.15.2:0/3970313264 learned_addr learned my addr 172.21.15.2:0/3970313264 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c663f6640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c600b4990 0x7f6c6015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c66bf7640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c600d0690 0x7f6c601430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 -- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c600d0690 msgr2=0x7f6c601430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c600d0690 0x7f6c601430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 -- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c600b4990 msgr2=0x7f6c6015fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c600b4990 0x7f6c6015fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 -- 172.21.15.2:0/3970313264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c009420 con 0x7f6c600b74f0 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c65bf5640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b74f0 0x7f6c6015ed20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000c390 tx=0x7f6c5000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c56ffd640 1 -- 172.21.15.2:0/3970313264 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500052d0 con 0x7f6c600b74f0 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c56ffd640 1 -- 172.21.15.2:0/3970313264 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50005430 con 0x7f6c600b74f0 2023-11-04T01:45:17.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c601566b0 con 0x7f6c600b74f0 2023-11-04T01:45:17.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c56ffd640 1 -- 172.21.15.2:0/3970313264 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50003820 con 0x7f6c600b74f0 2023-11-04T01:45:17.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c60156c70 con 0x7f6c600b74f0 2023-11-04T01:45:17.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.650+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c60159500 con 0x7f6c600b74f0 2023-11-04T01:45:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.654+0000 7f6c56ffd640 1 -- 172.21.15.2:0/3970313264 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6c50003980 con 0x7f6c600b74f0 2023-11-04T01:45:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.654+0000 7f6c56ffd640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c440664d0 0x7f6c44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.654+0000 7f6c56ffd640 1 -- 172.21.15.2:0/3970313264 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f6c500837d0 con 0x7f6c600b74f0 2023-11-04T01:45:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.654+0000 7f6c663f6640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c440664d0 0x7f6c44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:17.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.654+0000 7f6c663f6640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c440664d0 0x7f6c44068990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0b2000 tx=0x7f6c5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:17.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.658+0000 7f6c56ffd640 1 -- 172.21.15.2:0/3970313264 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6c50050820 con 0x7f6c600b74f0 2023-11-04T01:45:17.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.822+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c600744a0 con 0x7f6c600b74f0 2023-11-04T01:45:17.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c56ffd640 1 -- 172.21.15.2:0/3970313264 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c50053e40 con 0x7f6c600b74f0 2023-11-04T01:45:17.827 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c440664d0 msgr2=0x7f6c44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c440664d0 0x7f6c44068990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0b2000 tx=0x7f6c5c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b74f0 msgr2=0x7f6c6015ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b74f0 0x7f6c6015ed20 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6c5000c390 tx=0x7f6c5000c850 comp rx=0 tx=0).stop 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 shutdown_connections 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6c440664d0 0x7f6c44068990 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6c600d0690 0x7f6c601430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c600b74f0 0x7f6c6015ed20 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 --2- 172.21.15.2:0/3970313264 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c600b4990 0x7f6c6015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:17.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 >> 172.21.15.2:0/3970313264 conn(0x7f6c600cf990 msgr2=0x7f6c600b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 shutdown_connections 2023-11-04T01:45:17.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17.826+0000 7f6c6865a640 1 -- 172.21.15.2:0/3970313264 wait complete. 2023-11-04T01:45:17.846 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:45:17.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:45:17.847 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:45:17.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[53208]: fuse finished with error 0 and tester_r 0 2023-11-04T01:45:17.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:17.905 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:45:17.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:17.905 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:45:17.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:45:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:17.917 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:45:17.917 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:17.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:45:17.923 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:45:17.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:17.923 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:45:17.971 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:45:17.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:17.972 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:45:17.972 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:17.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:45:17.977 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:45:17.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:17.978 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:45:18.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:18.024 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:45:18.024 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:45:18.024 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:18.030 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:45:18.031 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:45:18.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:18.031 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:45:18.083 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:45:18.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:45:18.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:18.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.214+0000 7f8827f1c640 1 Processor -- start 2023-11-04T01:45:18.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.214+0000 7f8827f1c640 1 -- start start 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8827f1c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f88200b0d40 0x7f8820166010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8827f1c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88200c2670 con 0x7f88200715d0 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8827f1c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882006bc30 con 0x7f882015afd0 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8827f1c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8820070140 con 0x7f88200b0d40 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88254b7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f88200715d0 0x7f88200b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51786/0 (socket says 172.21.15.2:51786) 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88254b7640 1 -- 172.21.15.2:0/3161360828 learned_addr learned my addr 172.21.15.2:0/3161360828 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740720204 0 0) 0x7f88200c2670 con 0x7f88200715d0 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 --2- 172.21.15.2:0/3161360828 >> v2:172.21.15.90:3300/0 conn(0x7f88200b0d40 0x7f8820166010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8808003530 con 0x7f88200715d0 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636452023 0 0) 0x7f8808003530 con 0x7f88200715d0 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 >> v2:172.21.15.90:3300/0 conn(0x7f88200b0d40 msgr2=0x7f8820166010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 --2- 172.21.15.2:0/3161360828 >> v2:172.21.15.90:3300/0 conn(0x7f88200b0d40 0x7f8820166010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 >> v1:172.21.15.90:6789/0 conn(0x7f882015afd0 legacy=0x7f882006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882006bf10 con 0x7f88200715d0 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f8814001680 con 0x7f88200715d0 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 >> v1:172.21.15.2:6789/0 conn(0x7f88200715d0 legacy=0x7f88200b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808003980 0x7f8808003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88080047d0 0x7f8808004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8808005190 0x7f880800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8820070140 con 0x7f8808005190 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880800c030 con 0x7f8808003980 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880800c1f0 con 0x7f88080047d0 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8808005190 0x7f880800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88254b7640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88080047d0 0x7f8808004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 -- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88080047d0 msgr2=0x7f8808004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8825cb8640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808003980 0x7f8808003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88080047d0 0x7f8808004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 -- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808003980 msgr2=0x7f8808003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808003980 0x7f8808003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 -- 172.21.15.2:0/3161360828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808003530 con 0x7f8808005190 2023-11-04T01:45:18.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f8825cb8640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808003980 0x7f8808003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 -- 172.21.15.2:0/3161360828 reap_dead start 2023-11-04T01:45:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.218+0000 7f88264b9640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8808005190 0x7f880800b990 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f88200c8d60 tx=0x7f881001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d09434de21f2074 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100a5620 con 0x7f8808005190 2023-11-04T01:45:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88100a5780 con 0x7f8808005190 2023-11-04T01:45:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8824cb6640 1 -- 172.21.15.2:0/3161360828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100a5b10 con 0x7f8808005190 2023-11-04T01:45:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- 172.21.15.2:0/3161360828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8808005190 msgr2=0x7f880800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8808005190 0x7f880800b990 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f88200c8d60 tx=0x7f881001ca30 comp rx=0 tx=0).stop 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- 172.21.15.2:0/3161360828 shutdown_connections 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 --2- 172.21.15.2:0/3161360828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8808005190 0x7f880800b990 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- 172.21.15.2:0/3161360828 >> 172.21.15.2:0/3161360828 conn(0x7f88200cebb0 msgr2=0x7f88200cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- 172.21.15.2:0/3161360828 shutdown_connections 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- 172.21.15.2:0/3161360828 wait complete. 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 Processor -- start 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- start start 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808005190 0x7f882014b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88200b17d0 0x7f88200b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88201575e0 0x7f8820157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882015fc90 con 0x7f88200b17d0 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8820157fd0 con 0x7f8808005190 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88200b30e0 con 0x7f88201575e0 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88200b17d0 0x7f88200b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88200b17d0 0x7f88200b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38112/0 (socket says 172.21.15.2:38112) 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 -- 172.21.15.2:0/4136078989 learned_addr learned my addr 172.21.15.2:0/4136078989 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88264b9640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88201575e0 0x7f8820157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8825cb8640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808005190 0x7f882014b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 -- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88201575e0 msgr2=0x7f8820157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88201575e0 0x7f8820157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 -- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808005190 msgr2=0x7f882014b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808005190 0x7f882014b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 -- 172.21.15.2:0/4136078989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88201f09f0 con 0x7f88200b17d0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f88254b7640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88200b17d0 0x7f88200b1c30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8814001210 tx=0x7f881400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f881e7fc640 1 -- 172.21.15.2:0/4136078989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140074e0 con 0x7f88200b17d0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f881e7fc640 1 -- 172.21.15.2:0/4136078989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8814007640 con 0x7f88200b17d0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882014fa90 con 0x7f88200b17d0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f881e7fc640 1 -- 172.21.15.2:0/4136078989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140049f0 con 0x7f88200b17d0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.222+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88200b2270 con 0x7f88200b17d0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.226+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88200744a0 con 0x7f88200b17d0 2023-11-04T01:45:18.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.226+0000 7f881e7fc640 1 -- 172.21.15.2:0/4136078989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8814004b50 con 0x7f88200b17d0 2023-11-04T01:45:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.226+0000 7f881e7fc640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f880c0664d0 0x7f880c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.226+0000 7f881e7fc640 1 -- 172.21.15.2:0/4136078989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f8814083b20 con 0x7f88200b17d0 2023-11-04T01:45:18.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.226+0000 7f8825cb8640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f880c0664d0 0x7f880c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.226+0000 7f8825cb8640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f880c0664d0 0x7f880c068990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f88180012f0 tx=0x7f8818009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.230+0000 7f881e7fc640 1 -- 172.21.15.2:0/4136078989 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8814050b60 con 0x7f88200b17d0 2023-11-04T01:45:18.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.422+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88200b3220 con 0x7f88200b17d0 2023-11-04T01:45:18.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.422+0000 7f881e7fc640 1 -- 172.21.15.2:0/4136078989 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f881400de60 con 0x7f88200b17d0 2023-11-04T01:45:18.427 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:18.427 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1649859495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1649859495},{"type":"v1","addr":"172.21.15.90:6837","nonce":1649859495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/821298795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":821298795},{"type":"v1","addr":"172.21.15.2:6833","nonce":821298795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1371690425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1371690425},{"type":"v1","addr":"172.21.15.2:6835","nonce":1371690425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:03.466495+0000","modified":"2023-11-04T01:45:14.365070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1445624388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1445624388},{"type":"v1","addr":"172.21.15.90:6835","nonce":1445624388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:45:18.427 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2023-11-04T01:45:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f880c0664d0 msgr2=0x7f880c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f880c0664d0 0x7f880c068990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f88180012f0 tx=0x7f8818009040 comp rx=0 tx=0).stop 2023-11-04T01:45:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88200b17d0 msgr2=0x7f88200b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88200b17d0 0x7f88200b1c30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8814001210 tx=0x7f881400dc70 comp rx=0 tx=0).stop 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 shutdown_connections 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f880c0664d0 0x7f880c068990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88201575e0 0x7f8820157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88200b17d0 0x7f88200b1c30 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 --2- 172.21.15.2:0/4136078989 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8808005190 0x7f882014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 >> 172.21.15.2:0/4136078989 conn(0x7f88200cebb0 msgr2=0x7f88201589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 shutdown_connections 2023-11-04T01:45:18.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.426+0000 7f8827f1c640 1 -- 172.21.15.2:0/4136078989 wait complete. 2023-11-04T01:45:18.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.554+0000 7f912fed9640 1 Processor -- start 2023-11-04T01:45:18.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.554+0000 7f912fed9640 1 -- start start 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912fed9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f91280b4990 0x7f91280b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912fed9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91280b6070 con 0x7f91280d0690 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912fed9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91280b8ed0 con 0x7f91280b74f0 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912fed9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91280ce590 con 0x7f91280b4990 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912d474640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f91280d0690 0x7f91280cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51796/0 (socket says 172.21.15.2:51796) 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912d474640 1 -- 172.21.15.2:0/1385480815 learned_addr learned my addr 172.21.15.2:0/1385480815 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912dc75640 1 --2- 172.21.15.2:0/1385480815 >> v2:172.21.15.90:3300/0 conn(0x7f91280b4990 0x7f91280b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125233129 0 0) 0x7f91280b6070 con 0x7f91280d0690 2023-11-04T01:45:18.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f910c003530 con 0x7f91280d0690 2023-11-04T01:45:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4120927038 0 0) 0x7f910c003530 con 0x7f91280d0690 2023-11-04T01:45:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 >> v2:172.21.15.90:3300/0 conn(0x7f91280b4990 msgr2=0x7f91280b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 --2- 172.21.15.2:0/1385480815 >> v2:172.21.15.90:3300/0 conn(0x7f91280b4990 0x7f91280b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 >> v1:172.21.15.90:6789/0 conn(0x7f91280b74f0 legacy=0x7f91280cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280b52b0 con 0x7f91280d0690 2023-11-04T01:45:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f9114001a00 con 0x7f91280d0690 2023-11-04T01:45:18.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 >> v1:172.21.15.2:6789/0 conn(0x7f91280d0690 legacy=0x7f91280cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c003980 0x7f910c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f910c005190 0x7f910c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280ce590 con 0x7f910c005190 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00c040 con 0x7f910c0047d0 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c00c200 con 0x7f910c003980 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912d474640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912dc75640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c003980 0x7f910c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912e476640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f910c005190 0x7f910c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912e476640 1 -- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c003980 msgr2=0x7f910c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912e476640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c003980 0x7f910c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912e476640 1 -- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f910c0047d0 msgr2=0x7f910c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912e476640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912e476640 1 -- 172.21.15.2:0/1385480815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c003530 con 0x7f910c005190 2023-11-04T01:45:18.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.558+0000 7f912d474640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f910c0047d0 0x7f910c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912e476640 1 -- 172.21.15.2:0/1385480815 reap_dead start 2023-11-04T01:45:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912e476640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f910c005190 0x7f910c00b990 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9120001750 tx=0x7f912001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97ac4144fd6ab68 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91200052d0 con 0x7f910c005190 2023-11-04T01:45:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91200a7050 con 0x7f910c005190 2023-11-04T01:45:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912cc73640 1 -- 172.21.15.2:0/1385480815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120003600 con 0x7f910c005190 2023-11-04T01:45:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 -- 172.21.15.2:0/1385480815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f910c005190 msgr2=0x7f910c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f910c005190 0x7f910c00b990 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9120001750 tx=0x7f912001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 -- 172.21.15.2:0/1385480815 shutdown_connections 2023-11-04T01:45:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 --2- 172.21.15.2:0/1385480815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f910c005190 0x7f910c00b990 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 -- 172.21.15.2:0/1385480815 >> 172.21.15.2:0/1385480815 conn(0x7f91280cf990 msgr2=0x7f91280cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:18.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 -- 172.21.15.2:0/1385480815 shutdown_connections 2023-11-04T01:45:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 -- 172.21.15.2:0/1385480815 wait complete. 2023-11-04T01:45:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.562+0000 7f912fed9640 1 Processor -- start 2023-11-04T01:45:18.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 -- start start 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c005190 0x7f91280cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91280b1700 0x7f91280ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f912815ada0 0x7f91280cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280ccfc0 con 0x7f91280b1700 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91280abfa0 con 0x7f912815ada0 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280ac280 con 0x7f910c005190 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91280b1700 0x7f91280ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91280b1700 0x7f91280ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38134/0 (socket says 172.21.15.2:38134) 2023-11-04T01:45:18.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 -- 172.21.15.2:0/74383925 learned_addr learned my addr 172.21.15.2:0/74383925 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912e476640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f912815ada0 0x7f91280cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 -- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c005190 msgr2=0x7f91280cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c005190 0x7f91280cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 -- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f912815ada0 msgr2=0x7f91280cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f912815ada0 0x7f91280cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 -- 172.21.15.2:0/74383925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280cb1d0 con 0x7f91280b1700 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912d474640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91280b1700 0x7f91280ab750 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f911400a260 tx=0x7f9114007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f91267fc640 1 -- 172.21.15.2:0/74383925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140133f0 con 0x7f91280b1700 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f91267fc640 1 -- 172.21.15.2:0/74383925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114013550 con 0x7f91280b1700 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91280cb4b0 con 0x7f91280b1700 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f91267fc640 1 -- 172.21.15.2:0/74383925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140138c0 con 0x7f91280b1700 2023-11-04T01:45:18.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91280abc90 con 0x7f91280b1700 2023-11-04T01:45:18.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91280cb030 con 0x7f91280b1700 2023-11-04T01:45:18.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f91267fc640 1 -- 172.21.15.2:0/74383925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9114013a20 con 0x7f91280b1700 2023-11-04T01:45:18.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f91267fc640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f91100664d0 0x7f9110068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f91267fc640 1 -- 172.21.15.2:0/74383925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f9114085170 con 0x7f91280b1700 2023-11-04T01:45:18.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.566+0000 7f912dc75640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f91100664d0 0x7f9110068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.570+0000 7f912dc75640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f91100664d0 0x7f9110068990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9118009a60 tx=0x7f9118009340 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.570+0000 7f91267fc640 1 -- 172.21.15.2:0/74383925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f91280cb030 con 0x7f91280b1700 2023-11-04T01:45:18.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.726+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91280cb030 con 0x7f91280b1700 2023-11-04T01:45:18.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.730+0000 7f91267fc640 1 -- 172.21.15.2:0/74383925 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+21704 (secure 0 0 0) 0x7f91280cb030 con 0x7f91280b1700 2023-11-04T01:45:18.735 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:18.735 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":80,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:05.086327+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:01.698844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:02.463984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f91100664d0 msgr2=0x7f9110068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f91100664d0 0x7f9110068990 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9118009a60 tx=0x7f9118009340 comp rx=0 tx=0).stop 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91280b1700 msgr2=0x7f91280ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91280b1700 0x7f91280ab750 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f911400a260 tx=0x7f9114007430 comp rx=0 tx=0).stop 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 shutdown_connections 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f91100664d0 0x7f9110068990 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f912815ada0 0x7f91280cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91280b1700 0x7f91280ab750 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 --2- 172.21.15.2:0/74383925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f910c005190 0x7f91280cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 >> 172.21.15.2:0/74383925 conn(0x7f91280cf990 msgr2=0x7f912815f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 shutdown_connections 2023-11-04T01:45:18.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.734+0000 7f912fed9640 1 -- 172.21.15.2:0/74383925 wait complete. 2023-11-04T01:45:18.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:45:01.698844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:45:02.463984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:45:18.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:45:18.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a62ca1640 1 Processor -- start 2023-11-04T01:45:18.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a62ca1640 1 -- start start 2023-11-04T01:45:18.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a62ca1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c159f00 0x7f9a5c0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a62ca1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a5c06de30 0x7f9a5c0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a62ca1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c0b3c10 con 0x7f9a5c070b40 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a62ca1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c0cdb70 con 0x7f9a5c06de30 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a62ca1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0cde50 con 0x7f9a5c159f00 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a5bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a5c06de30 0x7f9a5c0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a5bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a5c06de30 0x7f9a5c0b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38146/0 (socket says 172.21.15.2:38146) 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a5bfff640 1 -- 172.21.15.2:0/862390844 learned_addr learned my addr 172.21.15.2:0/862390844 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a5bfff640 1 -- 172.21.15.2:0/862390844 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c159f00 msgr2=0x7f9a5c0719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a60a3d640 1 --2- 172.21.15.2:0/862390844 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c159f00 0x7f9a5c0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a5bfff640 1 --2- 172.21.15.2:0/862390844 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c159f00 0x7f9a5c0719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a5bfff640 1 -- 172.21.15.2:0/862390844 >> v1:172.21.15.90:6789/0 conn(0x7f9a5c070b40 legacy=0x7f9a5c0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:18.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.886+0000 7f9a5bfff640 1 -- 172.21.15.2:0/862390844 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c15a2e0 con 0x7f9a5c06de30 2023-11-04T01:45:18.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 --2- 172.21.15.2:0/862390844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c06de30 0x7f9a5c0b36d0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000bb10 tx=0x7f9a5001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f93e8dfd0ec52cb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5b7fe640 1 -- 172.21.15.2:0/862390844 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500a7b20 con 0x7f9a5c06de30 2023-11-04T01:45:18.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5b7fe640 1 -- 172.21.15.2:0/862390844 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a500a7c80 con 0x7f9a5c06de30 2023-11-04T01:45:18.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5b7fe640 1 -- 172.21.15.2:0/862390844 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500af440 con 0x7f9a5c06de30 2023-11-04T01:45:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- 172.21.15.2:0/862390844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c06de30 msgr2=0x7f9a5c0b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/862390844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c06de30 0x7f9a5c0b36d0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000bb10 tx=0x7f9a5001eb10 comp rx=0 tx=0).stop 2023-11-04T01:45:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- 172.21.15.2:0/862390844 shutdown_connections 2023-11-04T01:45:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/862390844 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c06de30 0x7f9a5c0b36d0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/862390844 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c159f00 0x7f9a5c0719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- 172.21.15.2:0/862390844 >> 172.21.15.2:0/862390844 conn(0x7f9a5c0cfc70 msgr2=0x7f9a5c0d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- 172.21.15.2:0/862390844 shutdown_connections 2023-11-04T01:45:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- 172.21.15.2:0/862390844 wait complete. 2023-11-04T01:45:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 Processor -- start 2023-11-04T01:45:18.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- start start 2023-11-04T01:45:18.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c070b40 0x7f9a5c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c159f00 0x7f9a5c163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a5c1642e0 0x7f9a5c14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c164c40 con 0x7f9a5c159f00 2023-11-04T01:45:18.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c164770 con 0x7f9a5c1642e0 2023-11-04T01:45:18.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a62ca1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c14af60 con 0x7f9a5c070b40 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c159f00 0x7f9a5c163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c159f00 0x7f9a5c163da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38154/0 (socket says 172.21.15.2:38154) 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 -- 172.21.15.2:0/4209480545 learned_addr learned my addr 172.21.15.2:0/4209480545 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a60a3d640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c070b40 0x7f9a5c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a6123e640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a5c1642e0 0x7f9a5c14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 -- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c070b40 msgr2=0x7f9a5c15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c070b40 0x7f9a5c15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 -- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a5c1642e0 msgr2=0x7f9a5c14fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a5c1642e0 0x7f9a5c14fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 -- 172.21.15.2:0/4209480545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5000b770 con 0x7f9a5c159f00 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a5bfff640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c159f00 0x7f9a5c163da0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b2c0 tx=0x7f9a5001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.890+0000 7f9a597fa640 1 -- 172.21.15.2:0/4209480545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500ba460 con 0x7f9a5c159f00 2023-11-04T01:45:18.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a597fa640 1 -- 172.21.15.2:0/4209480545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a500ba5e0 con 0x7f9a5c159f00 2023-11-04T01:45:18.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c164960 con 0x7f9a5c159f00 2023-11-04T01:45:18.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a597fa640 1 -- 172.21.15.2:0/4209480545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500ba990 con 0x7f9a5c159f00 2023-11-04T01:45:18.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c157cb0 con 0x7f9a5c159f00 2023-11-04T01:45:18.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c157830 con 0x7f9a5c159f00 2023-11-04T01:45:18.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a597fa640 1 -- 172.21.15.2:0/4209480545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a500c33b0 con 0x7f9a5c159f00 2023-11-04T01:45:18.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a597fa640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a480664d0 0x7f9a48068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:18.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a597fa640 1 -- 172.21.15.2:0/4209480545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f9a5011f090 con 0x7f9a5c159f00 2023-11-04T01:45:18.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a60a3d640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a480664d0 0x7f9a48068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:18.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.894+0000 7f9a60a3d640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a480664d0 0x7f9a48068990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0070b0 tx=0x7f9a4c007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:18.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:18.898+0000 7f9a597fa640 1 -- 172.21.15.2:0/4209480545 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9a5c157830 con 0x7f9a5c159f00 2023-11-04T01:45:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.062+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a5c157830 con 0x7f9a5c159f00 2023-11-04T01:45:19.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.062+0000 7f9a597fa640 1 -- 172.21.15.2:0/4209480545 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a5c157830 con 0x7f9a5c159f00 2023-11-04T01:45:19.065 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a480664d0 msgr2=0x7f9a48068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a480664d0 0x7f9a48068990 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0070b0 tx=0x7f9a4c007040 comp rx=0 tx=0).stop 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c159f00 msgr2=0x7f9a5c163da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c159f00 0x7f9a5c163da0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b2c0 tx=0x7f9a5001b8b0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 shutdown_connections 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a480664d0 0x7f9a48068990 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a5c1642e0 0x7f9a5c14fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a5c159f00 0x7f9a5c163da0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 --2- 172.21.15.2:0/4209480545 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a5c070b40 0x7f9a5c15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 >> 172.21.15.2:0/4209480545 conn(0x7f9a5c0cfc70 msgr2=0x7f9a5c0b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 shutdown_connections 2023-11-04T01:45:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.066+0000 7f9a62ca1640 1 -- 172.21.15.2:0/4209480545 wait complete. 2023-11-04T01:45:19.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:45:19.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087920d640 1 Processor -- start 2023-11-04T01:45:19.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087920d640 1 -- start start 2023-11-04T01:45:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087920d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08740b56a0 0x7f0874165f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087920d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087406cc10 con 0x7f0874070b40 2023-11-04T01:45:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087920d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0874071d10 con 0x7f0874144840 2023-11-04T01:45:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087920d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0874071100 con 0x7f08740b56a0 2023-11-04T01:45:19.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087359e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08740b56a0 0x7f0874165f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087259c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0874070b40 0x7f08740b4f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51808/0 (socket says 172.21.15.2:51808) 2023-11-04T01:45:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087259c640 1 -- 172.21.15.2:0/1055402499 learned_addr learned my addr 172.21.15.2:0/1055402499 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087359e640 1 -- 172.21.15.2:0/1055402499 >> v1:172.21.15.90:6789/0 conn(0x7f0874144840 legacy=0x7f087415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087359e640 1 -- 172.21.15.2:0/1055402499 >> v1:172.21.15.2:6789/0 conn(0x7f0874070b40 legacy=0x7f08740b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.214+0000 7f087359e640 1 -- 172.21.15.2:0/1055402499 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740713e0 con 0x7f08740b56a0 2023-11-04T01:45:19.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087359e640 1 --2- 172.21.15.2:0/1055402499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08740b56a0 0x7f0874165f60 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f08640097f0 tx=0x7f086401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a9a15f849fe166 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f0871d9b640 1 -- 172.21.15.2:0/1055402499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640ab600 con 0x7f08740b56a0 2023-11-04T01:45:19.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f0871d9b640 1 -- 172.21.15.2:0/1055402499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640a7050 con 0x7f08740b56a0 2023-11-04T01:45:19.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f0871d9b640 1 -- 172.21.15.2:0/1055402499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640ab980 con 0x7f08740b56a0 2023-11-04T01:45:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- 172.21.15.2:0/1055402499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08740b56a0 msgr2=0x7f0874165f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 --2- 172.21.15.2:0/1055402499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08740b56a0 0x7f0874165f60 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f08640097f0 tx=0x7f086401c380 comp rx=0 tx=0).stop 2023-11-04T01:45:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- 172.21.15.2:0/1055402499 shutdown_connections 2023-11-04T01:45:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 --2- 172.21.15.2:0/1055402499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08740b56a0 0x7f0874165f60 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- 172.21.15.2:0/1055402499 >> 172.21.15.2:0/1055402499 conn(0x7f08740cfc70 msgr2=0x7f08740d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:19.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- 172.21.15.2:0/1055402499 shutdown_connections 2023-11-04T01:45:19.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- 172.21.15.2:0/1055402499 wait complete. 2023-11-04T01:45:19.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 Processor -- start 2023-11-04T01:45:19.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- start start 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0874070b40 0x7f0874137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08740b56a0 0x7f087415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0874144840 0x7f0874138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087415a890 con 0x7f0874144840 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087415ab60 con 0x7f0874070b40 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087920d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087415cc20 con 0x7f08740b56a0 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0874144840 0x7f0874138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0874144840 0x7f0874138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38182/0 (socket says 172.21.15.2:38182) 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.218+0000 7f087359e640 1 -- 172.21.15.2:0/3701969160 learned_addr learned my addr 172.21.15.2:0/3701969160 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f0872d9d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0874070b40 0x7f0874137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087259c640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08740b56a0 0x7f087415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087359e640 1 -- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08740b56a0 msgr2=0x7f087415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087359e640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08740b56a0 0x7f087415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087359e640 1 -- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0874070b40 msgr2=0x7f0874137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087359e640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0874070b40 0x7f0874137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087359e640 1 -- 172.21.15.2:0/3701969160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864009420 con 0x7f0874144840 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087359e640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0874144840 0x7f0874138360 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f08640097f0 tx=0x7f0864019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f085b7fe640 1 -- 172.21.15.2:0/3701969160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640b4600 con 0x7f0874144840 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f085b7fe640 1 -- 172.21.15.2:0/3701969160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08640b4780 con 0x7f0874144840 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08741662f0 con 0x7f0874144840 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f085b7fe640 1 -- 172.21.15.2:0/3701969160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640b4b30 con 0x7f0874144840 2023-11-04T01:45:19.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087415c250 con 0x7f0874144840 2023-11-04T01:45:19.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087415c3e0 con 0x7f0874144840 2023-11-04T01:45:19.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f085b7fe640 1 -- 172.21.15.2:0/3701969160 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08640b2040 con 0x7f0874144840 2023-11-04T01:45:19.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f085b7fe640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08600664d0 0x7f0860068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f085b7fe640 1 -- 172.21.15.2:0/3701969160 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f086411e3b0 con 0x7f0874144840 2023-11-04T01:45:19.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f0872d9d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08600664d0 0x7f0860068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.222+0000 7f0872d9d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08600664d0 0x7f0860068990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f086c00b450 tx=0x7f086c00d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.226+0000 7f085b7fe640 1 -- 172.21.15.2:0/3701969160 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08640eb480 con 0x7f0874144840 2023-11-04T01:45:19.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.378+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f08740d09e0 con 0x7f0874144840 2023-11-04T01:45:19.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.378+0000 7f085b7fe640 1 -- 172.21.15.2:0/3701969160 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v81) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08640eeaa0 con 0x7f0874144840 2023-11-04T01:45:19.382 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08600664d0 msgr2=0x7f0860068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08600664d0 0x7f0860068990 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f086c00b450 tx=0x7f086c00d040 comp rx=0 tx=0).stop 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0874144840 msgr2=0x7f0874138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0874144840 0x7f0874138360 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f08640097f0 tx=0x7f0864019120 comp rx=0 tx=0).stop 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 shutdown_connections 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08600664d0 0x7f0860068990 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0874144840 0x7f0874138360 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08740b56a0 0x7f087415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 --2- 172.21.15.2:0/3701969160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0874070b40 0x7f0874137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 >> 172.21.15.2:0/3701969160 conn(0x7f08740cfc70 msgr2=0x7f087406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:19.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 shutdown_connections 2023-11-04T01:45:19.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.382+0000 7f087920d640 1 -- 172.21.15.2:0/3701969160 wait complete. 2023-11-04T01:45:19.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:45:19.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1316fab640 1 Processor -- start 2023-11-04T01:45:19.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1316fab640 1 -- start start 2023-11-04T01:45:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1316fab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13100b0c20 0x7f131015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1316fab640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015c160 0x7f13100ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1316fab640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100cb130 con 0x7f131015acb0 2023-11-04T01:45:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1316fab640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f131015bd40 con 0x7f13100b0c20 2023-11-04T01:45:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1316fab640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131006fd80 con 0x7f131015c160 2023-11-04T01:45:19.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13100b0c20 0x7f131015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f13100b0c20 0x7f131015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38194/0 (socket says 172.21.15.2:38194) 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 -- 172.21.15.2:0/2627785681 learned_addr learned my addr 172.21.15.2:0/2627785681 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1315548640 1 --2- 172.21.15.2:0/2627785681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015c160 0x7f13100ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 -- 172.21.15.2:0/2627785681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015c160 msgr2=0x7f13100ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 --2- 172.21.15.2:0/2627785681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015c160 0x7f13100ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 -- 172.21.15.2:0/2627785681 >> v1:172.21.15.90:6789/0 conn(0x7f131015acb0 legacy=0x7f13100b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 -- 172.21.15.2:0/2627785681 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131015b680 con 0x7f13100b0c20 2023-11-04T01:45:19.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f1315548640 1 --2- 172.21.15.2:0/2627785681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015c160 0x7f13100ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:19.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.510+0000 7f130ffff640 1 --2- 172.21.15.2:0/2627785681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f131015b090 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1300009870 tx=0x7f130001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856bcbb1ba670a35 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130f7fe640 1 -- 172.21.15.2:0/2627785681 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000a95f0 con 0x7f13100b0c20 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130f7fe640 1 -- 172.21.15.2:0/2627785681 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13000a9750 con 0x7f13100b0c20 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130f7fe640 1 -- 172.21.15.2:0/2627785681 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13000a9ae0 con 0x7f13100b0c20 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- 172.21.15.2:0/2627785681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 msgr2=0x7f131015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 --2- 172.21.15.2:0/2627785681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f131015b090 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f1300009870 tx=0x7f130001c510 comp rx=0 tx=0).stop 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- 172.21.15.2:0/2627785681 shutdown_connections 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 --2- 172.21.15.2:0/2627785681 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015c160 0x7f13100ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 --2- 172.21.15.2:0/2627785681 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f131015b090 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- 172.21.15.2:0/2627785681 >> 172.21.15.2:0/2627785681 conn(0x7f13100cb510 msgr2=0x7f13100cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- 172.21.15.2:0/2627785681 shutdown_connections 2023-11-04T01:45:19.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- 172.21.15.2:0/2627785681 wait complete. 2023-11-04T01:45:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 Processor -- start 2023-11-04T01:45:19.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- start start 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f13100af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015acb0 0x7f1310151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015c160 0x7f13100b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13101522c0 con 0x7f13100b0c20 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131015a610 con 0x7f131015c160 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1310151c40 con 0x7f131015acb0 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f13100af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f13100af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38210/0 (socket says 172.21.15.2:38210) 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 -- 172.21.15.2:0/2328378948 learned_addr learned my addr 172.21.15.2:0/2328378948 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130ffff640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015acb0 0x7f1310151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1315548640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015c160 0x7f13100b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 -- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015acb0 msgr2=0x7f1310151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015acb0 0x7f1310151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 -- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015c160 msgr2=0x7f13100b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015c160 0x7f13100b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 -- 172.21.15.2:0/2328378948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000094d0 con 0x7f13100b0c20 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130ffff640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015acb0 0x7f1310151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1314d47640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f13100af540 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f130400c500 tx=0x7f130400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130d7fa640 1 -- 172.21.15.2:0/2328378948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304005220 con 0x7f13100b0c20 2023-11-04T01:45:19.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130d7fa640 1 -- 172.21.15.2:0/2328378948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304005380 con 0x7f13100b0c20 2023-11-04T01:45:19.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f130d7fa640 1 -- 172.21.15.2:0/2328378948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304007270 con 0x7f13100b0c20 2023-11-04T01:45:19.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13100afa80 con 0x7f13100b0c20 2023-11-04T01:45:19.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.514+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131015a330 con 0x7f13100b0c20 2023-11-04T01:45:19.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.518+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13100744a0 con 0x7f13100b0c20 2023-11-04T01:45:19.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.518+0000 7f130d7fa640 1 -- 172.21.15.2:0/2328378948 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f13040073d0 con 0x7f13100b0c20 2023-11-04T01:45:19.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.518+0000 7f130d7fa640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12fc0664a0 0x7f12fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.518+0000 7f130d7fa640 1 -- 172.21.15.2:0/2328378948 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f1304083c60 con 0x7f13100b0c20 2023-11-04T01:45:19.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.518+0000 7f130ffff640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12fc0664a0 0x7f12fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.518+0000 7f130ffff640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12fc0664a0 0x7f12fc068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13000ae000 tx=0x7f13000b3040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.522+0000 7f130d7fa640 1 -- 172.21.15.2:0/2328378948 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1304050bf0 con 0x7f13100b0c20 2023-11-04T01:45:19.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.678+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f13100cde30 con 0x7f13100b0c20 2023-11-04T01:45:19.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.678+0000 7f130d7fa640 1 -- 172.21.15.2:0/2328378948 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v81) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1304054210 con 0x7f13100b0c20 2023-11-04T01:45:19.682 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12fc0664a0 msgr2=0x7f12fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12fc0664a0 0x7f12fc068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13000ae000 tx=0x7f13000b3040 comp rx=0 tx=0).stop 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 msgr2=0x7f13100af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f13100af540 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f130400c500 tx=0x7f130400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 shutdown_connections 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f12fc0664a0 0x7f12fc068960 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f131015c160 0x7f13100b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f131015acb0 0x7f1310151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 --2- 172.21.15.2:0/2328378948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13100b0c20 0x7f13100af540 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 >> 172.21.15.2:0/2328378948 conn(0x7f13100cb510 msgr2=0x7f131015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:19.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 shutdown_connections 2023-11-04T01:45:19.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.682+0000 7f1316fab640 1 -- 172.21.15.2:0/2328378948 wait complete. 2023-11-04T01:45:19.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:45:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.826+0000 7ff2f2acc640 1 Processor -- start 2023-11-04T01:45:19.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.826+0000 7ff2f2acc640 1 -- start start 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f2acc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2ec15d0b0 0x7ff2ec160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f2acc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2ec0cff20 0x7ff2ec0d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f2acc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec0b5e00 con 0x7ff2ec1610f0 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f2acc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0d1520 con 0x7ff2ec0cff20 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f2acc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec15d490 con 0x7ff2ec15d0b0 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f1069640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2ec0cff20 0x7ff2ec0d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2ebfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff2ec1610f0 0x7ff2ec0cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51814/0 (socket says 172.21.15.2:51814) 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2ebfff640 1 -- 172.21.15.2:0/2651856566 learned_addr learned my addr 172.21.15.2:0/2651856566 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f0868640 1 --2- 172.21.15.2:0/2651856566 >> v2:172.21.15.90:3300/0 conn(0x7ff2ec15d0b0 0x7ff2ec160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2eb7fe640 1 -- 172.21.15.2:0/2651856566 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986619 0 0) 0x7ff2ec0b5e00 con 0x7ff2ec1610f0 2023-11-04T01:45:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2eb7fe640 1 -- 172.21.15.2:0/2651856566 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d4003530 con 0x7ff2ec1610f0 2023-11-04T01:45:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f1069640 1 -- 172.21.15.2:0/2651856566 >> v2:172.21.15.90:3300/0 conn(0x7ff2ec15d0b0 msgr2=0x7ff2ec160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f1069640 1 --2- 172.21.15.2:0/2651856566 >> v2:172.21.15.90:3300/0 conn(0x7ff2ec15d0b0 0x7ff2ec160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f1069640 1 -- 172.21.15.2:0/2651856566 >> v1:172.21.15.2:6789/0 conn(0x7ff2ec1610f0 legacy=0x7ff2ec0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f1069640 1 -- 172.21.15.2:0/2651856566 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec0b8930 con 0x7ff2ec0cff20 2023-11-04T01:45:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.830+0000 7ff2f1069640 1 --2- 172.21.15.2:0/2651856566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec0cff20 0x7ff2ec0d1940 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec06b900 tx=0x7ff2e001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8edaac4f32d28b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2eb7fe640 1 -- 172.21.15.2:0/2651856566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00ab600 con 0x7ff2ec0cff20 2023-11-04T01:45:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2eb7fe640 1 -- 172.21.15.2:0/2651856566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00a7050 con 0x7ff2ec0cff20 2023-11-04T01:45:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2eb7fe640 1 -- 172.21.15.2:0/2651856566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00ab980 con 0x7ff2ec0cff20 2023-11-04T01:45:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- 172.21.15.2:0/2651856566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec0cff20 msgr2=0x7ff2ec0d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/2651856566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec0cff20 0x7ff2ec0d1940 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec06b900 tx=0x7ff2e001c460 comp rx=0 tx=0).stop 2023-11-04T01:45:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- 172.21.15.2:0/2651856566 shutdown_connections 2023-11-04T01:45:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/2651856566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec0cff20 0x7ff2ec0d1940 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/2651856566 >> v2:172.21.15.90:3300/0 conn(0x7ff2ec15d0b0 0x7ff2ec160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- 172.21.15.2:0/2651856566 >> 172.21.15.2:0/2651856566 conn(0x7ff2ec06a890 msgr2=0x7ff2ec06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- 172.21.15.2:0/2651856566 shutdown_connections 2023-11-04T01:45:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- 172.21.15.2:0/2651856566 wait complete. 2023-11-04T01:45:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 Processor -- start 2023-11-04T01:45:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- start start 2023-11-04T01:45:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2ec0cff20 0x7ff2ec15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ec15d0b0 0x7ff2ec0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec1610f0 0x7ff2ec0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec15b710 con 0x7ff2ec1610f0 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec15b9f0 con 0x7ff2ec15d0b0 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec15bcd0 con 0x7ff2ec0cff20 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec1610f0 0x7ff2ec0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec1610f0 0x7ff2ec0c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38218/0 (socket says 172.21.15.2:38218) 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 -- 172.21.15.2:0/3079088828 learned_addr learned my addr 172.21.15.2:0/3079088828 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2ebfff640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ec15d0b0 0x7ff2ec0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f0868640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2ec0cff20 0x7ff2ec15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 -- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2ec0cff20 msgr2=0x7ff2ec15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2ec0cff20 0x7ff2ec15aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 -- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ec15d0b0 msgr2=0x7ff2ec0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ec15d0b0 0x7ff2ec0c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 -- 172.21.15.2:0/3079088828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0009420 con 0x7ff2ec1610f0 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2ebfff640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ec15d0b0 0x7ff2ec0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f1069640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec1610f0 0x7ff2ec0c8dc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00ae040 tx=0x7ff2e0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2e97fa640 1 -- 172.21.15.2:0/3079088828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00b4410 con 0x7ff2ec1610f0 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2e97fa640 1 -- 172.21.15.2:0/3079088828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00b4590 con 0x7ff2ec1610f0 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2e97fa640 1 -- 172.21.15.2:0/3079088828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00b4940 con 0x7ff2ec1610f0 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.834+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec15bfb0 con 0x7ff2ec1610f0 2023-11-04T01:45:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.838+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec140730 con 0x7ff2ec1610f0 2023-11-04T01:45:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.838+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec0744a0 con 0x7ff2ec1610f0 2023-11-04T01:45:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.838+0000 7ff2e97fa640 1 -- 172.21.15.2:0/3079088828 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2e00b2040 con 0x7ff2ec1610f0 2023-11-04T01:45:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.838+0000 7ff2e97fa640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d80664a0 0x7ff2d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.838+0000 7ff2e97fa640 1 -- 172.21.15.2:0/3079088828 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7ff2e011e180 con 0x7ff2ec1610f0 2023-11-04T01:45:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.838+0000 7ff2f0868640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d80664a0 0x7ff2d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.838+0000 7ff2f0868640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d80664a0 0x7ff2d8068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009790 tx=0x7ff2e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.842+0000 7ff2e97fa640 1 -- 172.21.15.2:0/3079088828 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2e00eb110 con 0x7ff2ec1610f0 2023-11-04T01:45:20.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.998+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff2ec0c8660 con 0x7ff2ec1610f0 2023-11-04T01:45:20.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:19.998+0000 7ff2e97fa640 1 -- 172.21.15.2:0/3079088828 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v81) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff2e00b00b0 con 0x7ff2ec1610f0 2023-11-04T01:45:20.003 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:20.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d80664a0 msgr2=0x7ff2d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d80664a0 0x7ff2d8068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4009790 tx=0x7ff2e4008040 comp rx=0 tx=0).stop 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec1610f0 msgr2=0x7ff2ec0c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec1610f0 0x7ff2ec0c8dc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00ae040 tx=0x7ff2e0019200 comp rx=0 tx=0).stop 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 shutdown_connections 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2d80664a0 0x7ff2d8068960 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2ec1610f0 0x7ff2ec0c8dc0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2ec15d0b0 0x7ff2ec0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 --2- 172.21.15.2:0/3079088828 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2ec0cff20 0x7ff2ec15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 >> 172.21.15.2:0/3079088828 conn(0x7ff2ec06a890 msgr2=0x7ff2ec0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 shutdown_connections 2023-11-04T01:45:20.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.002+0000 7ff2f2acc640 1 -- 172.21.15.2:0/3079088828 wait complete. 2023-11-04T01:45:20.023 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:45:20.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 Processor -- start 2023-11-04T01:45:20.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 -- start start 2023-11-04T01:45:20.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57c00cd670 0x7f57c00ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f57c006cfc0 0x7f57c015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 0x7f57c015d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c015d600 con 0x7f57c00cd670 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c0160c50 con 0x7f57c006cfc0 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57c5d78640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00cedf0 con 0x7f57c00cda50 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57c00cd670 0x7f57c00ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57c00cd670 0x7f57c00ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38232/0 (socket says 172.21.15.2:38232) 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4006355081 learned_addr learned my addr 172.21.15.2:0/4006355081 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57b6ffd640 1 --2- 172.21.15.2:0/4006355081 >> v2:172.21.15.90:3300/0 conn(0x7f57c006cfc0 0x7f57c015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4006355081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 msgr2=0x7f57c015d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/4006355081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 0x7f57c015d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4006355081 >> v2:172.21.15.90:3300/0 conn(0x7f57c006cfc0 msgr2=0x7f57c015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/4006355081 >> v2:172.21.15.90:3300/0 conn(0x7f57c006cfc0 0x7f57c015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.142+0000 7f57bf7fe640 1 -- 172.21.15.2:0/4006355081 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c0160ef0 con 0x7f57c00cd670 2023-11-04T01:45:20.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/4006355081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00ce8b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f57c006f190 tx=0x7f57b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69db0716adf244d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57beffd640 1 -- 172.21.15.2:0/4006355081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00aa5f0 con 0x7f57c00cd670 2023-11-04T01:45:20.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57beffd640 1 -- 172.21.15.2:0/4006355081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b00aa750 con 0x7f57c00cd670 2023-11-04T01:45:20.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57beffd640 1 -- 172.21.15.2:0/4006355081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00aaae0 con 0x7f57c00cd670 2023-11-04T01:45:20.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 -- 172.21.15.2:0/4006355081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 msgr2=0x7f57c00ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 --2- 172.21.15.2:0/4006355081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00ce8b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f57c006f190 tx=0x7f57b001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 -- 172.21.15.2:0/4006355081 shutdown_connections 2023-11-04T01:45:20.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 --2- 172.21.15.2:0/4006355081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 0x7f57c015d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 --2- 172.21.15.2:0/4006355081 >> v2:172.21.15.90:3300/0 conn(0x7f57c006cfc0 0x7f57c015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 --2- 172.21.15.2:0/4006355081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00ce8b0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 -- 172.21.15.2:0/4006355081 >> 172.21.15.2:0/4006355081 conn(0x7f57c0065dc0 msgr2=0x7f57c00661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:20.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 -- 172.21.15.2:0/4006355081 shutdown_connections 2023-11-04T01:45:20.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 -- 172.21.15.2:0/4006355081 wait complete. 2023-11-04T01:45:20.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 Processor -- start 2023-11-04T01:45:20.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.146+0000 7f57c5d78640 1 -- start start 2023-11-04T01:45:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c006cfc0 0x7f57c00ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 0x7f57c00c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0152940 con 0x7f57c00cd670 2023-11-04T01:45:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00af060 con 0x7f57c006cfc0 2023-11-04T01:45:20.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0153050 con 0x7f57c00cda50 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38240/0 (socket says 172.21.15.2:38240) 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 -- 172.21.15.2:0/3831738233 learned_addr learned my addr 172.21.15.2:0/3831738233 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c006cfc0 0x7f57c00ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bffff640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 0x7f57c00c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 -- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 msgr2=0x7f57c00c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 0x7f57c00c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 -- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c006cfc0 msgr2=0x7f57c00ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c006cfc0 0x7f57c00ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 -- 172.21.15.2:0/3831738233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0009470 con 0x7f57c00cd670 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57b6ffd640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00c7db0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f57a800d7d0 tx=0x7f57a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bcff9640 1 -- 172.21.15.2:0/3831738233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8018070 con 0x7f57c00cd670 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bcff9640 1 -- 172.21.15.2:0/3831738233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8004020 con 0x7f57c00cd670 2023-11-04T01:45:20.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c00aeaa0 con 0x7f57c00cd670 2023-11-04T01:45:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bcff9640 1 -- 172.21.15.2:0/3831738233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80041d0 con 0x7f57c00cd670 2023-11-04T01:45:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0152ce0 con 0x7f57c00cd670 2023-11-04T01:45:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0152b40 con 0x7f57c00cd670 2023-11-04T01:45:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bcff9640 1 -- 172.21.15.2:0/3831738233 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57a8004330 con 0x7f57c00cd670 2023-11-04T01:45:20.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bcff9640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57a00664a0 0x7f57a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bcff9640 1 -- 172.21.15.2:0/3831738233 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f57a80841c0 con 0x7f57c00cd670 2023-11-04T01:45:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.150+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57a00664a0 0x7f57a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.154+0000 7f57bf7fe640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57a00664a0 0x7f57a0068960 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57b00ae000 tx=0x7f57b00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.154+0000 7f57bcff9640 1 -- 172.21.15.2:0/3831738233 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57c0152b40 con 0x7f57c00cd670 2023-11-04T01:45:20.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.310+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57c0152b40 con 0x7f57c00cd670 2023-11-04T01:45:20.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57bcff9640 1 -- 172.21.15.2:0/3831738233 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57c0152b40 con 0x7f57c00cd670 2023-11-04T01:45:20.315 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:20.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57a00664a0 msgr2=0x7f57a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57a00664a0 0x7f57a0068960 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57b00ae000 tx=0x7f57b00a7000 comp rx=0 tx=0).stop 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 msgr2=0x7f57c00c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00c7db0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f57a800d7d0 tx=0x7f57a800dc90 comp rx=0 tx=0).stop 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 shutdown_connections 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57a00664a0 0x7f57a0068960 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57c00cda50 0x7f57c00c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57c00cd670 0x7f57c00c7db0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 --2- 172.21.15.2:0/3831738233 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57c006cfc0 0x7f57c00ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 >> 172.21.15.2:0/3831738233 conn(0x7f57c0065dc0 msgr2=0x7f57c00b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 shutdown_connections 2023-11-04T01:45:20.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.314+0000 7f57c5d78640 1 -- 172.21.15.2:0/3831738233 wait complete. 2023-11-04T01:45:20.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:45:20.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f31051a9640 1 Processor -- start 2023-11-04T01:45:20.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f31051a9640 1 -- start start 2023-11-04T01:45:20.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f31051a9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 0x7f31000d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f31051a9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000d08e0 con 0x7f310015d6c0 2023-11-04T01:45:20.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f31051a9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31000d2080 con 0x7f31000d0ad0 2023-11-04T01:45:20.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f31051a9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000d2360 con 0x7f31000b5090 2023-11-04T01:45:20.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fed9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f310015d6c0 0x7f31000b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51826/0 (socket says 172.21.15.2:51826) 2023-11-04T01:45:20.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fed9d640 1 -- 172.21.15.2:0/1300688082 learned_addr learned my addr 172.21.15.2:0/1300688082 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:20.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178570846 0 0) 0x7f31000d08e0 con 0x7f310015d6c0 2023-11-04T01:45:20.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30f659c640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 0x7f31000d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec003530 con 0x7f310015d6c0 2023-11-04T01:45:20.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919480285 0 0) 0x7f30ec003530 con 0x7f310015d6c0 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 msgr2=0x7f31000d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 0x7f31000d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 >> v1:172.21.15.90:6789/0 conn(0x7f31000d0ad0 legacy=0x7f31000b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000d2640 con 0x7f310015d6c0 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f30f0001680 con 0x7f310015d6c0 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 >> v1:172.21.15.2:6789/0 conn(0x7f310015d6c0 legacy=0x7f31000b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 0x7f30ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30ec003f30 0x7f30ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ec004d10 0x7f30ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000d2360 con 0x7f30ec004d10 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00bb00 con 0x7f30ec003f30 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec00bcc0 con 0x7f31000b5090 2023-11-04T01:45:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30ff59e640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ec004d10 0x7f30ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30fed9d640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 0x7f30ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30f659c640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30ec003f30 0x7f30ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30ff59e640 1 -- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 msgr2=0x7f30ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30ff59e640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31000b5090 0x7f30ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30ff59e640 1 -- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30ec003f30 msgr2=0x7f30ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30ff59e640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30ec003f30 0x7f30ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.466+0000 7f30ff59e640 1 -- 172.21.15.2:0/1300688082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec003530 con 0x7f30ec004d10 2023-11-04T01:45:20.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f30ff59e640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ec004d10 0x7f30ec005190 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f30f8001e70 tx=0x7f30f801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3768ea62b4786f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8003b80 con 0x7f30ec004d10 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f8003ce0 con 0x7f30ec004d10 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f30fe59c640 1 -- 172.21.15.2:0/1300688082 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f80052c0 con 0x7f30ec004d10 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 -- 172.21.15.2:0/1300688082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ec004d10 msgr2=0x7f30ec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 --2- 172.21.15.2:0/1300688082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30ec004d10 0x7f30ec005190 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f30f8001e70 tx=0x7f30f801c760 comp rx=0 tx=0).stop 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f30ff59e640 1 -- 172.21.15.2:0/1300688082 reap_dead start 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 -- 172.21.15.2:0/1300688082 shutdown_connections 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 -- 172.21.15.2:0/1300688082 >> 172.21.15.2:0/1300688082 conn(0x7f31000cf980 msgr2=0x7f31000cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 -- 172.21.15.2:0/1300688082 shutdown_connections 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 -- 172.21.15.2:0/1300688082 wait complete. 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 Processor -- start 2023-11-04T01:45:20.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 -- start start 2023-11-04T01:45:20.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.470+0000 7f31051a9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f310014b630 0x7f310015ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31001604b0 0x7f310015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f310015e130 0x7f3100154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310015f4e0 con 0x7f310014b630 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100160930 con 0x7f310015e130 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310014ba10 con 0x7f31001604b0 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f310014b630 0x7f310015ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f310014b630 0x7f310015ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38248/0 (socket says 172.21.15.2:38248) 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 -- 172.21.15.2:0/3787386245 learned_addr learned my addr 172.21.15.2:0/3787386245 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:20.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30ff59e640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f310015e130 0x7f3100154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f659c640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31001604b0 0x7f310015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 -- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31001604b0 msgr2=0x7f310015dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31001604b0 0x7f310015dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 -- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f310015e130 msgr2=0x7f3100154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f310015e130 0x7f3100154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 -- 172.21.15.2:0/3787386245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310015e960 con 0x7f310014b630 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30fed9d640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f310014b630 0x7f310015ff70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f30f000eaf0 tx=0x7f30f0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f7fff640 1 -- 172.21.15.2:0/3787386245 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000c870 con 0x7f310014b630 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f7fff640 1 -- 172.21.15.2:0/3787386245 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000c9d0 con 0x7f310014b630 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310015ec40 con 0x7f310014b630 2023-11-04T01:45:20.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f7fff640 1 -- 172.21.15.2:0/3787386245 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000cd80 con 0x7f310014b630 2023-11-04T01:45:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310015f200 con 0x7f310014b630 2023-11-04T01:45:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31000675f0 con 0x7f310014b630 2023-11-04T01:45:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f7fff640 1 -- 172.21.15.2:0/3787386245 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30f001d460 con 0x7f310014b630 2023-11-04T01:45:20.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f7fff640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30e00664a0 0x7f30e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f7fff640 1 -- 172.21.15.2:0/3787386245 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f30f0084320 con 0x7f310014b630 2023-11-04T01:45:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.474+0000 7f30f659c640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30e00664a0 0x7f30e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.478+0000 7f30f659c640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30e00664a0 0x7f30e0068960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f310015ff00 tx=0x7f30e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.478+0000 7f30f7fff640 1 -- 172.21.15.2:0/3787386245 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f30f00513d0 con 0x7f310014b630 2023-11-04T01:45:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.634+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31000cd650 con 0x7f310014b630 2023-11-04T01:45:20.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.634+0000 7f30f7fff640 1 -- 172.21.15.2:0/3787386245 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30f00549f0 con 0x7f310014b630 2023-11-04T01:45:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:45:20.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30e00664a0 msgr2=0x7f30e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30e00664a0 0x7f30e0068960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f310015ff00 tx=0x7f30e8008040 comp rx=0 tx=0).stop 2023-11-04T01:45:20.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f310014b630 msgr2=0x7f310015ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f310014b630 0x7f310015ff70 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f30f000eaf0 tx=0x7f30f0001710 comp rx=0 tx=0).stop 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 shutdown_connections 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30e00664a0 0x7f30e0068960 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f310015e130 0x7f3100154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31001604b0 0x7f310015dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 --2- 172.21.15.2:0/3787386245 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f310014b630 0x7f310015ff70 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 >> 172.21.15.2:0/3787386245 conn(0x7f31000cf980 msgr2=0x7f31000d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 shutdown_connections 2023-11-04T01:45:20.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.638+0000 7f31051a9640 1 -- 172.21.15.2:0/3787386245 wait complete. 2023-11-04T01:45:20.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:20.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.778+0000 7f07048f6640 1 Processor -- start 2023-11-04T01:45:20.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.778+0000 7f07048f6640 1 -- start start 2023-11-04T01:45:20.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f07048f6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f07000c2670 0x7f07000b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f07048f6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 0x7f070015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f07048f6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07000b0fc0 con 0x7f070015b290 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f07048f6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070006c740 con 0x7f07000c2670 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f07048f6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070015b670 con 0x7f07000b0b70 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fe59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f070015b290 0x7f070006f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51832/0 (socket says 172.21.15.2:51832) 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fe59c640 1 -- 172.21.15.2:0/3787169038 learned_addr learned my addr 172.21.15.2:0/3787169038 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fdd9b640 1 --2- 172.21.15.2:0/3787169038 >> v2:172.21.15.90:3300/0 conn(0x7f07000c2670 0x7f07000b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fed9d640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 0x7f070015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727483310 0 0) 0x7f06e8001120 con 0x7f070015b290 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ec003530 con 0x7f070015b290 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 97090191 0 0) 0x7f06ec003530 con 0x7f070015b290 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 msgr2=0x7f070015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 0x7f070015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 >> v2:172.21.15.90:3300/0 conn(0x7f07000c2670 msgr2=0x7f07000b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 --2- 172.21.15.2:0/3787169038 >> v2:172.21.15.90:3300/0 conn(0x7f07000c2670 0x7f07000b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070006bb30 con 0x7f070015b290 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f06e8001810 con 0x7f070015b290 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 >> v1:172.21.15.2:6789/0 conn(0x7f070015b290 legacy=0x7f070006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec003980 0x7f06ec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 0x7f06ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06ec004d10 0x7f06ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070006c740 con 0x7f06ec004d10 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070015b670 con 0x7f06ec003980 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec00b9c0 con 0x7f07000b0b70 2023-11-04T01:45:20.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fed9d640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06ec004d10 0x7f06ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fe59c640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec003980 0x7f06ec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fdd9b640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 0x7f06ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fed9d640 1 -- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 msgr2=0x7f06ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fed9d640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000b0b70 0x7f06ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fed9d640 1 -- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec003980 msgr2=0x7f06ec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fed9d640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec003980 0x7f06ec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fed9d640 1 -- 172.21.15.2:0/3787169038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec003530 con 0x7f06ec004d10 2023-11-04T01:45:20.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.782+0000 7f06fe59c640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec003980 0x7f06ec003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:20.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fed9d640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06ec004d10 0x7f06ec005190 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009fc0 tx=0x7f06f801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6b78a773d0f593 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80a5c70 con 0x7f06ec004d10 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f800f040 con 0x7f06ec004d10 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fd59a640 1 -- 172.21.15.2:0/3787169038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80ad440 con 0x7f06ec004d10 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- 172.21.15.2:0/3787169038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06ec004d10 msgr2=0x7f06ec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 --2- 172.21.15.2:0/3787169038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f06ec004d10 0x7f06ec005190 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009fc0 tx=0x7f06f801cc60 comp rx=0 tx=0).stop 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fed9d640 1 -- 172.21.15.2:0/3787169038 reap_dead start 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- 172.21.15.2:0/3787169038 shutdown_connections 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- 172.21.15.2:0/3787169038 >> 172.21.15.2:0/3787169038 conn(0x7f07000cebb0 msgr2=0x7f07000cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- 172.21.15.2:0/3787169038 shutdown_connections 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- 172.21.15.2:0/3787169038 wait complete. 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 Processor -- start 2023-11-04T01:45:20.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- start start 2023-11-04T01:45:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec004d10 0x7f07001f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07000c3280 0x7f07000cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000c48c0 0x7f07000c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07001f5330 con 0x7f07000c3280 2023-11-04T01:45:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07000cba20 con 0x7f06ec004d10 2023-11-04T01:45:20.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f07048f6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07000c3820 con 0x7f07000c48c0 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fe59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec004d10 0x7f07001f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07000c3280 0x7f07000cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fe59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec004d10 0x7f07001f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:56132/0 (socket says 172.21.15.2:56132) 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fe59c640 1 -- 172.21.15.2:0/2357464968 learned_addr learned my addr 172.21.15.2:0/2357464968 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fed9d640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000c48c0 0x7f07000c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fdd9b640 1 -- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000c48c0 msgr2=0x7f07000c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fdd9b640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000c48c0 0x7f07000c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fdd9b640 1 -- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec004d10 msgr2=0x7f07001f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fdd9b640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec004d10 0x7f07001f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.786+0000 7f06fdd9b640 1 -- 172.21.15.2:0/2357464968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000c3b00 con 0x7f07000c3280 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06fdd9b640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07000c3280 0x7f07000cb4e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f06f0011560 tx=0x7f06f0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06f6ffd640 1 -- 172.21.15.2:0/2357464968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0004500 con 0x7f07000c3280 2023-11-04T01:45:20.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06f6ffd640 1 -- 172.21.15.2:0/2357464968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f0003620 con 0x7f07000c3280 2023-11-04T01:45:20.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07000c3de0 con 0x7f07000c3280 2023-11-04T01:45:20.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06f6ffd640 1 -- 172.21.15.2:0/2357464968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00039b0 con 0x7f07000c3280 2023-11-04T01:45:20.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07000c43a0 con 0x7f07000c3280 2023-11-04T01:45:20.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0700068310 con 0x7f07000c3280 2023-11-04T01:45:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06f6ffd640 1 -- 172.21.15.2:0/2357464968 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f06f0003b10 con 0x7f07000c3280 2023-11-04T01:45:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06f6ffd640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06e00664a0 0x7f06e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06f6ffd640 1 -- 172.21.15.2:0/2357464968 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f06f0084960 con 0x7f07000c3280 2023-11-04T01:45:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06fe59c640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06e00664a0 0x7f06e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:20.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.790+0000 7f06fe59c640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06e00664a0 0x7f06e0068960 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f06e80012c0 tx=0x7f06e8001250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:20.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.794+0000 7f06f6ffd640 1 -- 172.21.15.2:0/2357464968 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06f00519b0 con 0x7f07000c3280 2023-11-04T01:45:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.986+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07000744a0 con 0x7f07000c3280 2023-11-04T01:45:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.986+0000 7f06f6ffd640 1 -- 172.21.15.2:0/2357464968 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f06f0054fd0 con 0x7f07000c3280 2023-11-04T01:45:20.991 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:20.991 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1649859495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1649859495},{"type":"v1","addr":"172.21.15.90:6837","nonce":1649859495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/821298795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":821298795},{"type":"v1","addr":"172.21.15.2:6833","nonce":821298795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1371690425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1371690425},{"type":"v1","addr":"172.21.15.2:6835","nonce":1371690425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:03.466495+0000","modified":"2023-11-04T01:45:14.365070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1445624388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1445624388},{"type":"v1","addr":"172.21.15.90:6835","nonce":1445624388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:45:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06e00664a0 msgr2=0x7f06e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06e00664a0 0x7f06e0068960 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f06e80012c0 tx=0x7f06e8001250 comp rx=0 tx=0).stop 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07000c3280 msgr2=0x7f07000cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07000c3280 0x7f07000cb4e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f06f0011560 tx=0x7f06f0011a20 comp rx=0 tx=0).stop 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 shutdown_connections 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f06e00664a0 0x7f06e0068960 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07000c48c0 0x7f07000c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07000c3280 0x7f07000cb4e0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 --2- 172.21.15.2:0/2357464968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06ec004d10 0x7f07001f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:20.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 >> 172.21.15.2:0/2357464968 conn(0x7f07000cebb0 msgr2=0x7f07000b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:20.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 shutdown_connections 2023-11-04T01:45:20.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:20.990+0000 7f07048f6640 1 -- 172.21.15.2:0/2357464968 wait complete. 2023-11-04T01:45:21.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f47447bd640 1 Processor -- start 2023-11-04T01:45:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f47447bd640 1 -- start start 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f47447bd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce720 0x7f473c06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f47447bd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f473c0ce070 0x7f473c06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f47447bd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c159e30 con 0x7f473c159a50 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f47447bd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c0ccfd0 con 0x7f473c0ce070 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f47447bd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0cd2b0 con 0x7f473c0ce720 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4742d5a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f473c0ce070 0x7f473c06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4742d5a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f473c0ce070 0x7f473c06bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38266/0 (socket says 172.21.15.2:38266) 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4742d5a640 1 -- 172.21.15.2:0/1749759360 learned_addr learned my addr 172.21.15.2:0/1749759360 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4741d58640 1 --2- 172.21.15.2:0/1749759360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce720 0x7f473c06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4742d5a640 1 -- 172.21.15.2:0/1749759360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce720 msgr2=0x7f473c06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4742d5a640 1 --2- 172.21.15.2:0/1749759360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce720 0x7f473c06ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4742d5a640 1 -- 172.21.15.2:0/1749759360 >> v1:172.21.15.90:6789/0 conn(0x7f473c159a50 legacy=0x7f473c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.134+0000 7f4742d5a640 1 -- 172.21.15.2:0/1749759360 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0cd590 con 0x7f473c0ce070 2023-11-04T01:45:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4742d5a640 1 --2- 172.21.15.2:0/1749759360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce070 0x7f473c06bfd0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f47340098a0 tx=0x7f4734020f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac08e7ea49645ef server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741557640 1 -- 172.21.15.2:0/1749759360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47340aac20 con 0x7f473c0ce070 2023-11-04T01:45:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741557640 1 -- 172.21.15.2:0/1749759360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47340aad80 con 0x7f473c0ce070 2023-11-04T01:45:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741557640 1 -- 172.21.15.2:0/1749759360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47340b2660 con 0x7f473c0ce070 2023-11-04T01:45:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- 172.21.15.2:0/1749759360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce070 msgr2=0x7f473c06bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 --2- 172.21.15.2:0/1749759360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce070 0x7f473c06bfd0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f47340098a0 tx=0x7f4734020f20 comp rx=0 tx=0).stop 2023-11-04T01:45:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- 172.21.15.2:0/1749759360 shutdown_connections 2023-11-04T01:45:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 --2- 172.21.15.2:0/1749759360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce070 0x7f473c06bfd0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 --2- 172.21.15.2:0/1749759360 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce720 0x7f473c06ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- 172.21.15.2:0/1749759360 >> 172.21.15.2:0/1749759360 conn(0x7f473c0cebb0 msgr2=0x7f473c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- 172.21.15.2:0/1749759360 shutdown_connections 2023-11-04T01:45:21.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- 172.21.15.2:0/1749759360 wait complete. 2023-11-04T01:45:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 Processor -- start 2023-11-04T01:45:21.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- start start 2023-11-04T01:45:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce070 0x7f473c15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce720 0x7f473c1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473c159a50 0x7f473c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c149620 con 0x7f473c0ce720 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1543c0 con 0x7f473c159a50 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f47447bd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c157a60 con 0x7f473c0ce070 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce720 0x7f473c1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce720 0x7f473c1490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38274/0 (socket says 172.21.15.2:38274) 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 -- 172.21.15.2:0/3623530511 learned_addr learned my addr 172.21.15.2:0/3623530511 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4742d5a640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473c159a50 0x7f473c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4742559640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce070 0x7f473c15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 -- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce070 msgr2=0x7f473c15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce070 0x7f473c15caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 -- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473c159a50 msgr2=0x7f473c153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473c159a50 0x7f473c153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4741d58640 1 -- 172.21.15.2:0/3623530511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340094d0 con 0x7f473c0ce720 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.138+0000 7f4742559640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce070 0x7f473c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4741d58640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce720 0x7f473c1490e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f472c00e900 tx=0x7f472c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4732ffd640 1 -- 172.21.15.2:0/3623530511 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c009690 con 0x7f473c0ce720 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4732ffd640 1 -- 172.21.15.2:0/3623530511 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00ca00 con 0x7f473c0ce720 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c157d40 con 0x7f473c0ce720 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4732ffd640 1 -- 172.21.15.2:0/3623530511 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00cd90 con 0x7f473c0ce720 2023-11-04T01:45:21.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c158300 con 0x7f473c0ce720 2023-11-04T01:45:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c0744a0 con 0x7f473c0ce720 2023-11-04T01:45:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4732ffd640 1 -- 172.21.15.2:0/3623530511 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f472c013470 con 0x7f473c0ce720 2023-11-04T01:45:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4732ffd640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f47200664a0 0x7f4720068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4732ffd640 1 -- 172.21.15.2:0/3623530511 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f472c0844d0 con 0x7f473c0ce720 2023-11-04T01:45:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4742559640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f47200664a0 0x7f4720068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.142+0000 7f4742559640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f47200664a0 0x7f4720068960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4738007fd0 tx=0x7f4738009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.146+0000 7f4732ffd640 1 -- 172.21.15.2:0/3623530511 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f472c0514f0 con 0x7f473c0ce720 2023-11-04T01:45:21.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.302+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f473c155ce0 con 0x7f473c0ce720 2023-11-04T01:45:21.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.306+0000 7f4732ffd640 1 -- 172.21.15.2:0/3623530511 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+21814 (secure 0 0 0) 0x7f472c054b10 con 0x7f473c0ce720 2023-11-04T01:45:21.310 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:21.310 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:18.979863+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:01.698844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:02.463984+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":81,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:21.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f47200664a0 msgr2=0x7f4720068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f47200664a0 0x7f4720068960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4738007fd0 tx=0x7f4738009040 comp rx=0 tx=0).stop 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce720 msgr2=0x7f473c1490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce720 0x7f473c1490e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f472c00e900 tx=0x7f472c00edc0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 shutdown_connections 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f47200664a0 0x7f4720068960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f473c159a50 0x7f473c153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f473c0ce720 0x7f473c1490e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 --2- 172.21.15.2:0/3623530511 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f473c0ce070 0x7f473c15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 >> 172.21.15.2:0/3623530511 conn(0x7f473c0cebb0 msgr2=0x7f473c070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 shutdown_connections 2023-11-04T01:45:21.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.310+0000 7f47447bd640 1 -- 172.21.15.2:0/3623530511 wait complete. 2023-11-04T01:45:21.329 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-04T01:45:21.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:21.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1767db1640 1 Processor -- start 2023-11-04T01:45:21.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1767db1640 1 -- start start 2023-11-04T01:45:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1767db1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17600d0430 0x7f17600cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1767db1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f17600d08c0 0x7f17600cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1767db1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176006d320 con 0x7f1760161770 2023-11-04T01:45:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1767db1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1760161b50 con 0x7f17600d08c0 2023-11-04T01:45:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1767db1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176006cd60 con 0x7f17600d0430 2023-11-04T01:45:21.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1765b4d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1760161770 0x7f176006e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39324/0 (socket says 172.21.15.2:39324) 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1765b4d640 1 -- 172.21.15.2:0/1189140931 learned_addr learned my addr 172.21.15.2:0/1189140931 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f176634e640 1 --2- 172.21.15.2:0/1189140931 >> v2:172.21.15.2:3300/0 conn(0x7f17600d08c0 0x7f17600cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f176534c640 1 --2- 172.21.15.2:0/1189140931 >> v2:172.21.15.90:3300/0 conn(0x7f17600d0430 0x7f17600cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1764b4b640 1 -- 172.21.15.2:0/1189140931 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458651939 0 0) 0x7f17580014a0 con 0x7f1760161770 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f1764b4b640 1 -- 172.21.15.2:0/1189140931 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f174c003530 con 0x7f1760161770 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f176634e640 1 -- 172.21.15.2:0/1189140931 >> v2:172.21.15.90:3300/0 conn(0x7f17600d0430 msgr2=0x7f17600cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f176634e640 1 --2- 172.21.15.2:0/1189140931 >> v2:172.21.15.90:3300/0 conn(0x7f17600d0430 0x7f17600cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f176634e640 1 -- 172.21.15.2:0/1189140931 >> v1:172.21.15.2:6789/0 conn(0x7f1760161770 legacy=0x7f176006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f176634e640 1 -- 172.21.15.2:0/1189140931 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176006d040 con 0x7f17600d08c0 2023-11-04T01:45:21.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.446+0000 7f176534c640 1 --2- 172.21.15.2:0/1189140931 >> v2:172.21.15.90:3300/0 conn(0x7f17600d0430 0x7f17600cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:21.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 --2- 172.21.15.2:0/1189140931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17600d08c0 0x7f17600cdd10 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1760068830 tx=0x7f175c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b458ecf0a2f65533 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1764b4b640 1 -- 172.21.15.2:0/1189140931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0ac600 con 0x7f17600d08c0 2023-11-04T01:45:21.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1764b4b640 1 -- 172.21.15.2:0/1189140931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0a8050 con 0x7f17600d08c0 2023-11-04T01:45:21.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1764b4b640 1 -- 172.21.15.2:0/1189140931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0ac980 con 0x7f17600d08c0 2023-11-04T01:45:21.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- 172.21.15.2:0/1189140931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17600d08c0 msgr2=0x7f17600cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 --2- 172.21.15.2:0/1189140931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17600d08c0 0x7f17600cdd10 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1760068830 tx=0x7f175c01c3a0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- 172.21.15.2:0/1189140931 shutdown_connections 2023-11-04T01:45:21.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 --2- 172.21.15.2:0/1189140931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f17600d08c0 0x7f17600cdd10 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 --2- 172.21.15.2:0/1189140931 >> v2:172.21.15.90:3300/0 conn(0x7f17600d0430 0x7f17600cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- 172.21.15.2:0/1189140931 >> 172.21.15.2:0/1189140931 conn(0x7f17600b28f0 msgr2=0x7f17600b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- 172.21.15.2:0/1189140931 shutdown_connections 2023-11-04T01:45:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- 172.21.15.2:0/1189140931 wait complete. 2023-11-04T01:45:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 Processor -- start 2023-11-04T01:45:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- start start 2023-11-04T01:45:21.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17600d0430 0x7f17601526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600d08c0 0x7f1760158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1760161770 0x7f176014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17600cc980 con 0x7f1760161770 2023-11-04T01:45:21.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1760152cb0 con 0x7f17600d08c0 2023-11-04T01:45:21.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1760152f90 con 0x7f17600d0430 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1760161770 0x7f176014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1760161770 0x7f176014fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45468/0 (socket says 172.21.15.2:45468) 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 -- 172.21.15.2:0/3849034017 learned_addr learned my addr 172.21.15.2:0/3849034017 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 -- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17600d0430 msgr2=0x7f17601526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17600d0430 0x7f17601526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 -- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600d08c0 msgr2=0x7f1760158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600d08c0 0x7f1760158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 -- 172.21.15.2:0/3849034017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009420 con 0x7f1760161770 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f176634e640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1760161770 0x7f176014fe90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f175c019fd0 tx=0x7f175c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f17567fc640 1 -- 172.21.15.2:0/3849034017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0b7450 con 0x7f1760161770 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f17567fc640 1 -- 172.21.15.2:0/3849034017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0b75b0 con 0x7f1760161770 2023-11-04T01:45:21.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f17567fc640 1 -- 172.21.15.2:0/3849034017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0b7960 con 0x7f1760161770 2023-11-04T01:45:21.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1760153270 con 0x7f1760161770 2023-11-04T01:45:21.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.450+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17601510d0 con 0x7f1760161770 2023-11-04T01:45:21.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.454+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17600ccac0 con 0x7f1760161770 2023-11-04T01:45:21.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.454+0000 7f17567fc640 1 -- 172.21.15.2:0/3849034017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f175c0b3070 con 0x7f1760161770 2023-11-04T01:45:21.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.454+0000 7f17567fc640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17440664a0 0x7f1744068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.454+0000 7f17567fc640 1 -- 172.21.15.2:0/3849034017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f175c11e8e0 con 0x7f1760161770 2023-11-04T01:45:21.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.454+0000 7f1765b4d640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17440664a0 0x7f1744068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.454+0000 7f1765b4d640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17440664a0 0x7f1744068960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1758005c10 tx=0x7f17580014e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.458+0000 7f17567fc640 1 -- 172.21.15.2:0/3849034017 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17600ccac0 con 0x7f1760161770 2023-11-04T01:45:21.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.642+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17600ccac0 con 0x7f1760161770 2023-11-04T01:45:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.642+0000 7f17567fc640 1 -- 172.21.15.2:0/3849034017 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4906 (secure 0 0 0) 0x7f17600ccac0 con 0x7f1760161770 2023-11-04T01:45:21.646 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:21.646 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1649859495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1649859495},{"type":"v1","addr":"172.21.15.90:6837","nonce":1649859495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/821298795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":821298795},{"type":"v1","addr":"172.21.15.2:6833","nonce":821298795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1371690425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1371690425},{"type":"v1","addr":"172.21.15.2:6835","nonce":1371690425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:03.466495+0000","modified":"2023-11-04T01:45:14.365070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1445624388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1445624388},{"type":"v1","addr":"172.21.15.90:6835","nonce":1445624388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:45:21.646 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2023-11-04T01:45:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17440664a0 msgr2=0x7f1744068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17440664a0 0x7f1744068960 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1758005c10 tx=0x7f17580014e0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1760161770 msgr2=0x7f176014fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1760161770 0x7f176014fe90 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f175c019fd0 tx=0x7f175c01abe0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 shutdown_connections 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17440664a0 0x7f1744068960 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1760161770 0x7f176014fe90 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17600d08c0 0x7f1760158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 --2- 172.21.15.2:0/3849034017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f17600d0430 0x7f17601526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 >> 172.21.15.2:0/3849034017 conn(0x7f17600b28f0 msgr2=0x7f17601606a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 shutdown_connections 2023-11-04T01:45:21.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.646+0000 7f1767db1640 1 -- 172.21.15.2:0/3849034017 wait complete. 2023-11-04T01:45:21.664 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.770+0000 7fa490399640 1 Processor -- start 2023-11-04T01:45:21.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa490399640 1 -- start start 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa490399640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4880b27d0 0x7fa4880d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa490399640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48815b150 0x7fa4880cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa490399640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48815f980 con 0x7fa4880b2bb0 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa490399640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48815f4f0 con 0x7fa4880b27d0 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa490399640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880d0af0 con 0x7fa48815b150 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4880b27d0 0x7fa4880d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa4880b27d0 0x7fa4880d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45472/0 (socket says 172.21.15.2:45472) 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 -- 172.21.15.2:0/2648509592 learned_addr learned my addr 172.21.15.2:0/2648509592 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48d934640 1 --2- 172.21.15.2:0/2648509592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48815b150 0x7fa4880cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 -- 172.21.15.2:0/2648509592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48815b150 msgr2=0x7fa4880cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:21.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 --2- 172.21.15.2:0/2648509592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48815b150 0x7fa4880cfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 -- 172.21.15.2:0/2648509592 >> v1:172.21.15.90:6789/0 conn(0x7fa4880b2bb0 legacy=0x7fa4880ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:21.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 -- 172.21.15.2:0/2648509592 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4880cb6d0 con 0x7fa4880b27d0 2023-11-04T01:45:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48e135640 1 --2- 172.21.15.2:0/2648509592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4880b27d0 0x7fa4880d0510 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa484009870 tx=0x7fa48401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46037caf05d0e600 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48d133640 1 -- 172.21.15.2:0/2648509592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ab600 con 0x7fa4880b27d0 2023-11-04T01:45:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48d133640 1 -- 172.21.15.2:0/2648509592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840a7050 con 0x7fa4880b27d0 2023-11-04T01:45:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.774+0000 7fa48d133640 1 -- 172.21.15.2:0/2648509592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ab980 con 0x7fa4880b27d0 2023-11-04T01:45:21.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- 172.21.15.2:0/2648509592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4880b27d0 msgr2=0x7fa4880d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 --2- 172.21.15.2:0/2648509592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4880b27d0 0x7fa4880d0510 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa484009870 tx=0x7fa48401c470 comp rx=0 tx=0).stop 2023-11-04T01:45:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- 172.21.15.2:0/2648509592 shutdown_connections 2023-11-04T01:45:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 --2- 172.21.15.2:0/2648509592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa48815b150 0x7fa4880cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 --2- 172.21.15.2:0/2648509592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa4880b27d0 0x7fa4880d0510 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- 172.21.15.2:0/2648509592 >> 172.21.15.2:0/2648509592 conn(0x7fa4880cd7d0 msgr2=0x7fa4880cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- 172.21.15.2:0/2648509592 shutdown_connections 2023-11-04T01:45:21.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- 172.21.15.2:0/2648509592 wait complete. 2023-11-04T01:45:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 Processor -- start 2023-11-04T01:45:21.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- start start 2023-11-04T01:45:21.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4880b27d0 0x7fa48815de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4880b2bb0 0x7fa48814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48815b150 0x7fa4880b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b51d0 con 0x7fa48815b150 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b4550 con 0x7fa4880b27d0 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b4830 con 0x7fa4880b2bb0 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48815b150 0x7fa4880b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48815b150 0x7fa4880b55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45484/0 (socket says 172.21.15.2:45484) 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 -- 172.21.15.2:0/666919829 learned_addr learned my addr 172.21.15.2:0/666919829 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48d934640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4880b2bb0 0x7fa48814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e135640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4880b27d0 0x7fa48815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 -- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4880b2bb0 msgr2=0x7fa48814bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4880b2bb0 0x7fa48814bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 -- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4880b27d0 msgr2=0x7fa48815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4880b27d0 0x7fa48815de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 -- 172.21.15.2:0/666919829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840094d0 con 0x7fa48815b150 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa48e936640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48815b150 0x7fa4880b55f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b970 tx=0x7fa48000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa47effd640 1 -- 172.21.15.2:0/666919829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000cb40 con 0x7fa48815b150 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa47effd640 1 -- 172.21.15.2:0/666919829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000cca0 con 0x7fa48815b150 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4880b4b10 con 0x7fa48815b150 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa47effd640 1 -- 172.21.15.2:0/666919829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480014680 con 0x7fa48815b150 2023-11-04T01:45:21.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.778+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880b4200 con 0x7fa48815b150 2023-11-04T01:45:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.782+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4880b5310 con 0x7fa48815b150 2023-11-04T01:45:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.782+0000 7fa47effd640 1 -- 172.21.15.2:0/666919829 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa48001d3b0 con 0x7fa48815b150 2023-11-04T01:45:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.782+0000 7fa47effd640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa46c0664a0 0x7fa46c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.782+0000 7fa47effd640 1 -- 172.21.15.2:0/666919829 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fa4800840c0 con 0x7fa48815b150 2023-11-04T01:45:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.782+0000 7fa48e135640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa46c0664a0 0x7fa46c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:21.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.782+0000 7fa48e135640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa46c0664a0 0x7fa46c068960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ad000 tx=0x7fa4840a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:21.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.786+0000 7fa47effd640 1 -- 172.21.15.2:0/666919829 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4880b5310 con 0x7fa48815b150 2023-11-04T01:45:21.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.974+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4880b5310 con 0x7fa48815b150 2023-11-04T01:45:21.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa47effd640 1 -- 172.21.15.2:0/666919829 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4906 (secure 0 0 0) 0x7fa4880b5310 con 0x7fa48815b150 2023-11-04T01:45:21.980 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:21.980 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1649859495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1649859495},{"type":"v1","addr":"172.21.15.90:6837","nonce":1649859495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/821298795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":821298795},{"type":"v1","addr":"172.21.15.2:6833","nonce":821298795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1371690425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1371690425},{"type":"v1","addr":"172.21.15.2:6835","nonce":1371690425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:03.466495+0000","modified":"2023-11-04T01:45:14.365070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"b","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6835/1445624388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1445624388},{"type":"v1","addr":"172.21.15.90:6835","nonce":1445624388}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-11-04T01:45:21.980 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 36 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa46c0664a0 msgr2=0x7fa46c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa46c0664a0 0x7fa46c068960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4840ad000 tx=0x7fa4840a6000 comp rx=0 tx=0).stop 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48815b150 msgr2=0x7fa4880b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48815b150 0x7fa4880b55f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa48000b970 tx=0x7fa48000be30 comp rx=0 tx=0).stop 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 shutdown_connections 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa46c0664a0 0x7fa46c068960 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa48815b150 0x7fa4880b55f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa4880b2bb0 0x7fa48814bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 --2- 172.21.15.2:0/666919829 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa4880b27d0 0x7fa48815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:21.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 >> 172.21.15.2:0/666919829 conn(0x7fa4880cd7d0 msgr2=0x7fa48806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:21.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 shutdown_connections 2023-11-04T01:45:21.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:21.978+0000 7fa490399640 1 -- 172.21.15.2:0/666919829 wait complete. 2023-11-04T01:45:21.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.106+0000 7fe36ad1d640 1 Processor -- start 2023-11-04T01:45:22.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.106+0000 7fe36ad1d640 1 -- start start 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe36ad1d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe36415afd0 0x7fe3640715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe36ad1d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe3640b0d40 0x7fe36415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe36ad1d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3640c2670 con 0x7fe36406f8f0 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe36ad1d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe364070140 con 0x7fe36415afd0 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe36ad1d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36406c9f0 con 0x7fe3640b0d40 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe36415afd0 0x7fe3640715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe36415afd0 0x7fe3640715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45492/0 (socket says 172.21.15.2:45492) 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 -- 172.21.15.2:0/2499269980 learned_addr learned my addr 172.21.15.2:0/2499269980 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:22.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe3692ba640 1 --2- 172.21.15.2:0/2499269980 >> v2:172.21.15.90:3300/0 conn(0x7fe3640b0d40 0x7fe36415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 -- 172.21.15.2:0/2499269980 >> v2:172.21.15.90:3300/0 conn(0x7fe3640b0d40 msgr2=0x7fe36415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:22.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 --2- 172.21.15.2:0/2499269980 >> v2:172.21.15.90:3300/0 conn(0x7fe3640b0d40 0x7fe36415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 -- 172.21.15.2:0/2499269980 >> v1:172.21.15.90:6789/0 conn(0x7fe36406f8f0 legacy=0x7fe3640b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:22.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 -- 172.21.15.2:0/2499269980 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36406bc30 con 0x7fe36415afd0 2023-11-04T01:45:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe368ab9640 1 --2- 172.21.15.2:0/2499269980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36415afd0 0x7fe3640715d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe36406f7b0 tx=0x7fe35401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bd24d5b48741ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe3637fe640 1 -- 172.21.15.2:0/2499269980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540aa5f0 con 0x7fe36415afd0 2023-11-04T01:45:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe3637fe640 1 -- 172.21.15.2:0/2499269980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3540aa750 con 0x7fe36415afd0 2023-11-04T01:45:22.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.110+0000 7fe3637fe640 1 -- 172.21.15.2:0/2499269980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540aaae0 con 0x7fe36415afd0 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- 172.21.15.2:0/2499269980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36415afd0 msgr2=0x7fe3640715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/2499269980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36415afd0 0x7fe3640715d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe36406f7b0 tx=0x7fe35401c490 comp rx=0 tx=0).stop 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- 172.21.15.2:0/2499269980 shutdown_connections 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/2499269980 >> v2:172.21.15.90:3300/0 conn(0x7fe3640b0d40 0x7fe36415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/2499269980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36415afd0 0x7fe3640715d0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- 172.21.15.2:0/2499269980 >> 172.21.15.2:0/2499269980 conn(0x7fe3640cebb0 msgr2=0x7fe3640cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- 172.21.15.2:0/2499269980 shutdown_connections 2023-11-04T01:45:22.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- 172.21.15.2:0/2499269980 wait complete. 2023-11-04T01:45:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 Processor -- start 2023-11-04T01:45:22.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- start start 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36406f8f0 0x7fe3640b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3640b0d40 0x7fe3641592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe36415afd0 0x7fe3641597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c6050 con 0x7fe36406f8f0 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c6330 con 0x7fe36415afd0 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3640c6610 con 0x7fe3640b0d40 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36406f8f0 0x7fe3640b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36406f8f0 0x7fe3640b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45504/0 (socket says 172.21.15.2:45504) 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 -- 172.21.15.2:0/1958075039 learned_addr learned my addr 172.21.15.2:0/1958075039 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:22.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe3692ba640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe36415afd0 0x7fe3641597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe363fff640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3640b0d40 0x7fe3641592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 -- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3640b0d40 msgr2=0x7fe3641592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3640b0d40 0x7fe3641592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 -- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe36415afd0 msgr2=0x7fe3641597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe36415afd0 0x7fe3641597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 -- 172.21.15.2:0/1958075039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540094d0 con 0x7fe36406f8f0 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe363fff640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3640b0d40 0x7fe3641592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe368ab9640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36406f8f0 0x7fe3640b2d20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fe3540ac040 tx=0x7fe35401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe3617fa640 1 -- 172.21.15.2:0/1958075039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540b3800 con 0x7fe36406f8f0 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe3617fa640 1 -- 172.21.15.2:0/1958075039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3540b3980 con 0x7fe36406f8f0 2023-11-04T01:45:22.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3640c68f0 con 0x7fe36406f8f0 2023-11-04T01:45:22.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe3617fa640 1 -- 172.21.15.2:0/1958075039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3540b3d30 con 0x7fe36406f8f0 2023-11-04T01:45:22.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.114+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3640b3260 con 0x7fe36406f8f0 2023-11-04T01:45:22.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.118+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3640744a0 con 0x7fe36406f8f0 2023-11-04T01:45:22.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.118+0000 7fe3617fa640 1 -- 172.21.15.2:0/1958075039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe3540b2380 con 0x7fe36406f8f0 2023-11-04T01:45:22.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.118+0000 7fe3617fa640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3500664a0 0x7fe350068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.118+0000 7fe3617fa640 1 -- 172.21.15.2:0/1958075039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7fe3540a7070 con 0x7fe36406f8f0 2023-11-04T01:45:22.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.118+0000 7fe363fff640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3500664a0 0x7fe350068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.118+0000 7fe363fff640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3500664a0 0x7fe350068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ae5c0 tx=0x7fe358009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.122+0000 7fe3617fa640 1 -- 172.21.15.2:0/1958075039 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe3540eb2a0 con 0x7fe36406f8f0 2023-11-04T01:45:22.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.278+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3640c6750 con 0x7fe36406f8f0 2023-11-04T01:45:22.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.282+0000 7fe3617fa640 1 -- 172.21.15.2:0/1958075039 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+21814 (secure 0 0 0) 0x7fe3640c6750 con 0x7fe36406f8f0 2023-11-04T01:45:22.286 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:22.286 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:18.979863+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:01.698844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:02.463984+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":81,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":14,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:22.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3500664a0 msgr2=0x7fe350068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3500664a0 0x7fe350068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe3640ae5c0 tx=0x7fe358009040 comp rx=0 tx=0).stop 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36406f8f0 msgr2=0x7fe3640b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36406f8f0 0x7fe3640b2d20 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fe3540ac040 tx=0x7fe35401acd0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 shutdown_connections 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe3500664a0 0x7fe350068960 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe36415afd0 0x7fe3641597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe3640b0d40 0x7fe3641592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 --2- 172.21.15.2:0/1958075039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe36406f8f0 0x7fe3640b2d20 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 >> 172.21.15.2:0/1958075039 conn(0x7fe3640cebb0 msgr2=0x7fe3640ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:22.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 shutdown_connections 2023-11-04T01:45:22.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.286+0000 7fe36ad1d640 1 -- 172.21.15.2:0/1958075039 wait complete. 2023-11-04T01:45:22.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-04T01:45:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad91ac640 1 Processor -- start 2023-11-04T01:45:22.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad91ac640 1 -- start start 2023-11-04T01:45:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad91ac640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1ad40b0890 0x7f1ad40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad91ac640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40ce320 con 0x7f1ad40c9960 2023-11-04T01:45:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad91ac640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40ce600 con 0x7f1ad40b0c70 2023-11-04T01:45:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad91ac640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad406d2f0 con 0x7f1ad40b0890 2023-11-04T01:45:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad2d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1ad40b0890 0x7f1ad40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad259c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1ad40c9960 0x7f1ad40704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39336/0 (socket says 172.21.15.2:39336) 2023-11-04T01:45:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad259c640 1 -- 172.21.15.2:0/410234858 learned_addr learned my addr 172.21.15.2:0/410234858 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad2d9d640 1 -- 172.21.15.2:0/410234858 >> v1:172.21.15.90:6789/0 conn(0x7f1ad40b0c70 legacy=0x7f1ad40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad2d9d640 1 -- 172.21.15.2:0/410234858 >> v1:172.21.15.2:6789/0 conn(0x7f1ad40c9960 legacy=0x7f1ad40704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad1d9b640 1 -- 172.21.15.2:0/410234858 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020124706 0 0) 0x7f1ad40ce320 con 0x7f1ad40c9960 2023-11-04T01:45:22.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.430+0000 7f1ad2d9d640 1 -- 172.21.15.2:0/410234858 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40ce8e0 con 0x7f1ad40b0890 2023-11-04T01:45:22.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad2d9d640 1 --2- 172.21.15.2:0/410234858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40b0890 0x7f1ad40cdbd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40097c0 tx=0x7f1ac401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1e7836585560ff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad1d9b640 1 -- 172.21.15.2:0/410234858 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40ab600 con 0x7f1ad40b0890 2023-11-04T01:45:22.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad1d9b640 1 -- 172.21.15.2:0/410234858 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac40a7050 con 0x7f1ad40b0890 2023-11-04T01:45:22.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad1d9b640 1 -- 172.21.15.2:0/410234858 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40ab980 con 0x7f1ad40b0890 2023-11-04T01:45:22.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- 172.21.15.2:0/410234858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40b0890 msgr2=0x7f1ad40cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/410234858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40b0890 0x7f1ad40cdbd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40097c0 tx=0x7f1ac401c440 comp rx=0 tx=0).stop 2023-11-04T01:45:22.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- 172.21.15.2:0/410234858 shutdown_connections 2023-11-04T01:45:22.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/410234858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40b0890 0x7f1ad40cdbd0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- 172.21.15.2:0/410234858 >> 172.21.15.2:0/410234858 conn(0x7f1ad40cebb0 msgr2=0x7f1ad40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:22.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- 172.21.15.2:0/410234858 shutdown_connections 2023-11-04T01:45:22.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- 172.21.15.2:0/410234858 wait complete. 2023-11-04T01:45:22.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 Processor -- start 2023-11-04T01:45:22.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- start start 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ad40b0890 0x7f1ad4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad40b0c70 0x7f1ad40b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40c9960 0x7f1ad41f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad41f7c90 con 0x7f1ad40c9960 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40b3c60 con 0x7f1ad40b0c70 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad91ac640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40b3f30 con 0x7f1ad40b0890 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40c9960 0x7f1ad41f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40c9960 0x7f1ad41f8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45512/0 (socket says 172.21.15.2:45512) 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 -- 172.21.15.2:0/2645387438 learned_addr learned my addr 172.21.15.2:0/2645387438 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 -- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ad40b0890 msgr2=0x7f1ad4150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad259c640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad40b0c70 0x7f1ad40b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad2d9d640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ad40b0890 0x7f1ad4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ad40b0890 0x7f1ad4150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 -- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad40b0c70 msgr2=0x7f1ad40b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad40b0c70 0x7f1ad40b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 -- 172.21.15.2:0/2645387438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009420 con 0x7f1ad40c9960 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad259c640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad40b0c70 0x7f1ad40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.434+0000 7f1ad359e640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40c9960 0x7f1ad41f8120 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c780 tx=0x7f1acc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1abb7fe640 1 -- 172.21.15.2:0/2645387438 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc004b70 con 0x7f1ad40c9960 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1abb7fe640 1 -- 172.21.15.2:0/2645387438 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc00ce90 con 0x7f1ad40c9960 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad40b4210 con 0x7f1ad40c9960 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1abb7fe640 1 -- 172.21.15.2:0/2645387438 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc00a850 con 0x7f1ad40c9960 2023-11-04T01:45:22.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41f7920 con 0x7f1ad40c9960 2023-11-04T01:45:22.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad41f7e00 con 0x7f1ad40c9960 2023-11-04T01:45:22.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1abb7fe640 1 -- 172.21.15.2:0/2645387438 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1acc00a9b0 con 0x7f1ad40c9960 2023-11-04T01:45:22.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1abb7fe640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1ac00664a0 0x7f1ac0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1abb7fe640 1 -- 172.21.15.2:0/2645387438 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6828+0+0 (secure 0 0 0) 0x7f1acc0844e0 con 0x7f1ad40c9960 2023-11-04T01:45:22.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1ad2d9d640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1ac00664a0 0x7f1ac0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.438+0000 7f1ad2d9d640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1ac00664a0 0x7f1ac0068960 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40ad000 tx=0x7f1ac4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.442+0000 7f1abb7fe640 1 -- 172.21.15.2:0/2645387438 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1acc051500 con 0x7f1ad40c9960 2023-11-04T01:45:22.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.626+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1ad40744a0 con 0x7f1ad40c9960 2023-11-04T01:45:22.630 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-04T01:45:22.626+0000 7f4b9aa78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-04T01:45:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.630+0000 7f1abb7fe640 1 -- 172.21.15.2:0/2645387438 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1acc054b20 con 0x7f1ad40c9960 2023-11-04T01:45:22.634 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-04T01:45:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1ac00664a0 msgr2=0x7f1ac0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1ac00664a0 0x7f1ac0068960 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40ad000 tx=0x7f1ac4008040 comp rx=0 tx=0).stop 2023-11-04T01:45:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40c9960 msgr2=0x7f1ad41f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40c9960 0x7f1ad41f8120 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00c780 tx=0x7f1acc00cc40 comp rx=0 tx=0).stop 2023-11-04T01:45:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 shutdown_connections 2023-11-04T01:45:22.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1ac00664a0 0x7f1ac0068960 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ad40c9960 0x7f1ad41f8120 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ad40b0c70 0x7f1ad40b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 --2- 172.21.15.2:0/2645387438 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1ad40b0890 0x7f1ad4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 >> 172.21.15.2:0/2645387438 conn(0x7f1ad40cebb0 msgr2=0x7f1ad4152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 shutdown_connections 2023-11-04T01:45:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.634+0000 7f1ad91ac640 1 -- 172.21.15.2:0/2645387438 wait complete. 2023-11-04T01:45:22.646 INFO:tasks.ceph.mds.b.smithi090.stderr: -2848> 2023-11-04T01:45:05.064+0000 7fa72ae85640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:22.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-04T01:45:22.686 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:45:22.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 Processor -- start 2023-11-04T01:45:22.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 -- start start 2023-11-04T01:45:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcd9015ae20 0x7fcd900ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd900d18a0 0x7fcd900b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcd900cecc0 0x7fcd900b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900cbb30 con 0x7fcd9015ae20 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd900cbe10 con 0x7fcd900cecc0 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd95d15640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900cc0f0 con 0x7fcd900d18a0 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd8f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcd9015ae20 0x7fcd900ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd8f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcd9015ae20 0x7fcd900ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45518/0 (socket says 172.21.15.2:45518) 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.774+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/1169968921 learned_addr learned my addr 172.21.15.2:0/1169968921 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8ffff640 1 --2- 172.21.15.2:0/1169968921 >> v2:172.21.15.90:3300/0 conn(0x7fcd900cecc0 0x7fcd900b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8effd640 1 --2- 172.21.15.2:0/1169968921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd900d18a0 0x7fcd900b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/1169968921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd900d18a0 msgr2=0x7fcd900b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:22.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8f7fe640 1 --2- 172.21.15.2:0/1169968921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd900d18a0 0x7fcd900b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/1169968921 >> v2:172.21.15.90:3300/0 conn(0x7fcd900cecc0 msgr2=0x7fcd900b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:22.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8f7fe640 1 --2- 172.21.15.2:0/1169968921 >> v2:172.21.15.90:3300/0 conn(0x7fcd900cecc0 0x7fcd900b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/1169968921 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900cc3d0 con 0x7fcd9015ae20 2023-11-04T01:45:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8f7fe640 1 --2- 172.21.15.2:0/1169968921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9015ae20 0x7fcd900ce780 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fcd90072980 tx=0x7fcd8001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5a8af81b4bc34f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8e7fc640 1 -- 172.21.15.2:0/1169968921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800a89b0 con 0x7fcd9015ae20 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8e7fc640 1 -- 172.21.15.2:0/1169968921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd800a8b10 con 0x7fcd9015ae20 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd8e7fc640 1 -- 172.21.15.2:0/1169968921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800a8ea0 con 0x7fcd9015ae20 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 -- 172.21.15.2:0/1169968921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9015ae20 msgr2=0x7fcd900ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 --2- 172.21.15.2:0/1169968921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9015ae20 0x7fcd900ce780 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fcd90072980 tx=0x7fcd8001ecf0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 -- 172.21.15.2:0/1169968921 shutdown_connections 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 --2- 172.21.15.2:0/1169968921 >> v2:172.21.15.90:3300/0 conn(0x7fcd900cecc0 0x7fcd900b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 --2- 172.21.15.2:0/1169968921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd900d18a0 0x7fcd900b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 --2- 172.21.15.2:0/1169968921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd9015ae20 0x7fcd900ce780 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 -- 172.21.15.2:0/1169968921 >> 172.21.15.2:0/1169968921 conn(0x7fcd9009a030 msgr2=0x7fcd900d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:22.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 -- 172.21.15.2:0/1169968921 shutdown_connections 2023-11-04T01:45:22.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.778+0000 7fcd95d15640 1 -- 172.21.15.2:0/1169968921 wait complete. 2023-11-04T01:45:22.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 Processor -- start 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 -- start start 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd900cecc0 0x7fcd900b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd9015ae20 0x7fcd900c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd900b0df0 0x7fcd900c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd901515e0 con 0x7fcd900cecc0 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b1ec0 con 0x7fcd900b0df0 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b12b0 con 0x7fcd9015ae20 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd900cecc0 0x7fcd900b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd900cecc0 0x7fcd900b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45528/0 (socket says 172.21.15.2:45528) 2023-11-04T01:45:22.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/3623902684 learned_addr learned my addr 172.21.15.2:0/3623902684 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8ffff640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd900b0df0 0x7fcd900c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd9015ae20 msgr2=0x7fcd900c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8effd640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd9015ae20 0x7fcd900c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd9015ae20 0x7fcd900c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd900b0df0 msgr2=0x7fcd900c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd900b0df0 0x7fcd900c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 -- 172.21.15.2:0/3623902684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80009470 con 0x7fcd900cecc0 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8ffff640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd900b0df0 0x7fcd900c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd8f7fe640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd900cecc0 0x7fcd900b2350 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcd8001d3a0 tx=0x7fcd8001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd77fff640 1 -- 172.21.15.2:0/3623902684 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800ba600 con 0x7fcd900cecc0 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd77fff640 1 -- 172.21.15.2:0/3623902684 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd800ba760 con 0x7fcd900cecc0 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd900b1590 con 0x7fcd900cecc0 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd77fff640 1 -- 172.21.15.2:0/3623902684 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800bab10 con 0x7fcd900cecc0 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900b1b50 con 0x7fcd900cecc0 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd900744a0 con 0x7fcd900cecc0 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd77fff640 1 -- 172.21.15.2:0/3623902684 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcd800bac70 con 0x7fcd900cecc0 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd77fff640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcd7c0664d0 0x7fcd7c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:22.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.782+0000 7fcd77fff640 1 -- 172.21.15.2:0/3623902684 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6886+0+0 (secure 0 0 0) 0x7fcd80122800 con 0x7fcd900cecc0 2023-11-04T01:45:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.786+0000 7fcd8effd640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcd7c0664d0 0x7fcd7c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.786+0000 7fcd8effd640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcd7c0664d0 0x7fcd7c068990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c7aa0 tx=0x7fcd84008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:22.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.786+0000 7fcd77fff640 1 -- 172.21.15.2:0/3623902684 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd800ef990 con 0x7fcd900cecc0 2023-11-04T01:45:22.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:22.982+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcd901517e0 con 0x7fcd900cecc0 2023-11-04T01:45:23.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.634+0000 7fcd77fff640 1 -- 172.21.15.2:0/3623902684 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd800f2fb0 con 0x7fcd900cecc0 2023-11-04T01:45:23.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcd7c0664d0 msgr2=0x7fcd7c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcd7c0664d0 0x7fcd7c068990 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcd900c7aa0 tx=0x7fcd84008040 comp rx=0 tx=0).stop 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd900cecc0 msgr2=0x7fcd900b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd900cecc0 0x7fcd900b2350 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcd8001d3a0 tx=0x7fcd8001ba90 comp rx=0 tx=0).stop 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 shutdown_connections 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcd7c0664d0 0x7fcd7c068990 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd900b0df0 0x7fcd900c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcd9015ae20 0x7fcd900c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 --2- 172.21.15.2:0/3623902684 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd900cecc0 0x7fcd900b2350 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 >> 172.21.15.2:0/3623902684 conn(0x7fcd9009a030 msgr2=0x7fcd900af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 shutdown_connections 2023-11-04T01:45:23.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.638+0000 7fcd95d15640 1 -- 172.21.15.2:0/3623902684 wait complete. 2023-11-04T01:45:23.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-04T01:45:23.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b9dde1640 1 Processor -- start 2023-11-04T01:45:23.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b9dde1640 1 -- start start 2023-11-04T01:45:23.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b9dde1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b9806b320 0x7f4b9806b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b9dde1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9806cb10 con 0x7f4b980c9220 2023-11-04T01:45:23.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b9dde1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9815a890 con 0x7f4b9815a4b0 2023-11-04T01:45:23.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b9dde1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9806bd10 con 0x7f4b9806b320 2023-11-04T01:45:23.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b96ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b9806b320 0x7f4b9806b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b96ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b9806b320 0x7f4b9806b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45542/0 (socket says 172.21.15.2:45542) 2023-11-04T01:45:23.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b96ffd640 1 -- 172.21.15.2:0/1406663811 learned_addr learned my addr 172.21.15.2:0/1406663811 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:23.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b96ffd640 1 -- 172.21.15.2:0/1406663811 >> v1:172.21.15.90:6789/0 conn(0x7f4b9815a4b0 legacy=0x7f4b980cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b96ffd640 1 -- 172.21.15.2:0/1406663811 >> v1:172.21.15.2:6789/0 conn(0x7f4b980c9220 legacy=0x7f4b98164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.790+0000 7f4b96ffd640 1 -- 172.21.15.2:0/1406663811 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9806bf00 con 0x7f4b9806b320 2023-11-04T01:45:23.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b96ffd640 1 --2- 172.21.15.2:0/1406663811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9806b320 0x7f4b9806b7d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009870 tx=0x7f4b8c01e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1adcf974d9e6da server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:23.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b967fc640 1 -- 172.21.15.2:0/1406663811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0ac430 con 0x7f4b9806b320 2023-11-04T01:45:23.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b967fc640 1 -- 172.21.15.2:0/1406663811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0ac590 con 0x7f4b9806b320 2023-11-04T01:45:23.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b967fc640 1 -- 172.21.15.2:0/1406663811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0ac920 con 0x7f4b9806b320 2023-11-04T01:45:23.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1406663811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9806b320 msgr2=0x7f4b9806b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1406663811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9806b320 0x7f4b9806b7d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009870 tx=0x7f4b8c01e6c0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1406663811 shutdown_connections 2023-11-04T01:45:23.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1406663811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9806b320 0x7f4b9806b7d0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1406663811 >> 172.21.15.2:0/1406663811 conn(0x7f4b980b0630 msgr2=0x7f4b980b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:23.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1406663811 shutdown_connections 2023-11-04T01:45:23.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1406663811 wait complete. 2023-11-04T01:45:23.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 Processor -- start 2023-11-04T01:45:23.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- start start 2023-11-04T01:45:23.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9806b320 0x7f4b98158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b980c9220 0x7f4b980c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9815a4b0 0x7f4b98152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980c65f0 con 0x7f4b9815a4b0 2023-11-04T01:45:23.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980c68d0 con 0x7f4b9806b320 2023-11-04T01:45:23.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b9dde1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980c6bb0 con 0x7f4b980c9220 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9815a4b0 0x7f4b98152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9815a4b0 0x7f4b98152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45546/0 (socket says 172.21.15.2:45546) 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b97fff640 1 -- 172.21.15.2:0/1710832563 learned_addr learned my addr 172.21.15.2:0/1710832563 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b977fe640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9806b320 0x7f4b98158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.794+0000 7f4b96ffd640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b980c9220 0x7f4b980c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b97fff640 1 -- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b980c9220 msgr2=0x7f4b980c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b97fff640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b980c9220 0x7f4b980c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b97fff640 1 -- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9806b320 msgr2=0x7f4b98158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b97fff640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9806b320 0x7f4b98158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b97fff640 1 -- 172.21.15.2:0/1710832563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0094d0 con 0x7f4b9815a4b0 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b97fff640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9815a4b0 0x7f4b98152650 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c730 tx=0x7f4b9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:23.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b7ffff640 1 -- 172.21.15.2:0/1710832563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90003b80 con 0x7f4b9815a4b0 2023-11-04T01:45:23.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b7ffff640 1 -- 172.21.15.2:0/1710832563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b90003ce0 con 0x7f4b9815a4b0 2023-11-04T01:45:23.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b980c6e90 con 0x7f4b9815a4b0 2023-11-04T01:45:23.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b7ffff640 1 -- 172.21.15.2:0/1710832563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000aa30 con 0x7f4b9815a4b0 2023-11-04T01:45:23.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9815cbc0 con 0x7f4b9815a4b0 2023-11-04T01:45:23.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b980744a0 con 0x7f4b9815a4b0 2023-11-04T01:45:23.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b7ffff640 1 -- 172.21.15.2:0/1710832563 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b9000ab90 con 0x7f4b9815a4b0 2023-11-04T01:45:23.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b7ffff640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b840664a0 0x7f4b84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:23.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b7ffff640 1 -- 172.21.15.2:0/1710832563 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6886+0+0 (secure 0 0 0) 0x7f4b90084150 con 0x7f4b9815a4b0 2023-11-04T01:45:23.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b977fe640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b840664a0 0x7f4b84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:23.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.798+0000 7f4b977fe640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b840664a0 0x7f4b84068960 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000f70 tx=0x7f4b88009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:23.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.802+0000 7f4b7ffff640 1 -- 172.21.15.2:0/1710832563 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4b90051120 con 0x7f4b9815a4b0 2023-11-04T01:45:23.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:23.958+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4b980cc350 con 0x7f4b9815a4b0 2023-11-04T01:45:24.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.554+0000 7f4b7ffff640 1 -- 172.21.15.2:0/1710832563 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4b90054740 con 0x7f4b9815a4b0 2023-11-04T01:45:24.557 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b840664a0 msgr2=0x7f4b84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b840664a0 0x7f4b84068960 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b88000f70 tx=0x7f4b88009040 comp rx=0 tx=0).stop 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9815a4b0 msgr2=0x7f4b98152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9815a4b0 0x7f4b98152650 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000c730 tx=0x7f4b9000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 shutdown_connections 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b840664a0 0x7f4b84068960 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b9815a4b0 0x7f4b98152650 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4b980c9220 0x7f4b980c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 --2- 172.21.15.2:0/1710832563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b9806b320 0x7f4b98158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.558+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 >> 172.21.15.2:0/1710832563 conn(0x7f4b980b0630 msgr2=0x7f4b980c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:24.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.562+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 shutdown_connections 2023-11-04T01:45:24.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.562+0000 7f4b9dde1640 1 -- 172.21.15.2:0/1710832563 wait complete. 2023-11-04T01:45:24.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-04T01:45:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffad14c1640 1 Processor -- start 2023-11-04T01:45:24.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffad14c1640 1 -- start start 2023-11-04T01:45:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffad14c1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 0x7ffacc0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffad14c1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffacc0b12e0 0x7ffacc0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffad14c1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0afb40 con 0x7ffacc15d3a0 2023-11-04T01:45:24.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffad14c1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0d1ff0 con 0x7ffacc0b12e0 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffad14c1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc15d780 con 0x7ffacc0d19b0 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffacc15d3a0 0x7ffacc0d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39352/0 (socket says 172.21.15.2:39352) 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 -- 172.21.15.2:0/3949610589 learned_addr learned my addr 172.21.15.2:0/3949610589 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffaca7fc640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 0x7ffacc0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacb7fe640 1 --2- 172.21.15.2:0/3949610589 >> v2:172.21.15.90:3300/0 conn(0x7ffacc0b12e0 0x7ffacc0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099020716 0 0) 0x7ffacc0afb40 con 0x7ffacc15d3a0 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab4003530 con 0x7ffacc15d3a0 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3866196377 0 0) 0x7ffab4003530 con 0x7ffacc15d3a0 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 msgr2=0x7ffacc0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 0x7ffacc0cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 >> v2:172.21.15.90:3300/0 conn(0x7ffacc0b12e0 msgr2=0x7ffacc0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:24.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 --2- 172.21.15.2:0/3949610589 >> v2:172.21.15.90:3300/0 conn(0x7ffacc0b12e0 0x7ffacc0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0d3ce0 con 0x7ffacc15d3a0 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ffabc001680 con 0x7ffacc15d3a0 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 >> v1:172.21.15.2:6789/0 conn(0x7ffacc15d3a0 legacy=0x7ffacc0d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4003980 0x7ffab4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffab40047d0 0x7ffab4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 0x7ffab4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0d1ff0 con 0x7ffab4003980 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc15d780 con 0x7ffab40047d0 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab400ba70 con 0x7ffacc0d19b0 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4003980 0x7ffab4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacb7fe640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 0x7ffab4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 -- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 msgr2=0x7ffab4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:24.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffaca7fc640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffab40047d0 0x7ffab4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc0d19b0 0x7ffab4005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 -- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffab40047d0 msgr2=0x7ffab4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffab40047d0 0x7ffab4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffacaffd640 1 -- 172.21.15.2:0/3949610589 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4003530 con 0x7ffab4003980 2023-11-04T01:45:24.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.718+0000 7ffaca7fc640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffab40047d0 0x7ffab4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffacaffd640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4003980 0x7ffab4003da0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ffabc001060 tx=0x7ffabc01cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e35e6f4b0f2592 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0058e0 con 0x7ffab4003980 2023-11-04T01:45:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc005a40 con 0x7ffab4003980 2023-11-04T01:45:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffac9ffb640 1 -- 172.21.15.2:0/3949610589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc005df0 con 0x7ffab4003980 2023-11-04T01:45:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 -- 172.21.15.2:0/3949610589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4003980 msgr2=0x7ffab4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:24.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 --2- 172.21.15.2:0/3949610589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffab4003980 0x7ffab4003da0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ffabc001060 tx=0x7ffabc01cb10 comp rx=0 tx=0).stop 2023-11-04T01:45:24.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffacb7fe640 1 -- 172.21.15.2:0/3949610589 reap_dead start 2023-11-04T01:45:24.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 -- 172.21.15.2:0/3949610589 shutdown_connections 2023-11-04T01:45:24.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 -- 172.21.15.2:0/3949610589 >> 172.21.15.2:0/3949610589 conn(0x7ffacc0d2e70 msgr2=0x7ffacc0d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:24.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 -- 172.21.15.2:0/3949610589 shutdown_connections 2023-11-04T01:45:24.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 -- 172.21.15.2:0/3949610589 wait complete. 2023-11-04T01:45:24.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 Processor -- start 2023-11-04T01:45:24.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.722+0000 7ffad14c1640 1 -- start start 2023-11-04T01:45:24.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffacc15ff50 0x7ffacc1f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc154eb0 0x7ffacc0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b8790 0x7ffacc160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0b7820 con 0x7ffacc0b8790 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1fa2b0 con 0x7ffacc15ff50 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1f9cf0 con 0x7ffacc154eb0 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b8790 0x7ffacc160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b8790 0x7ffacc160be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45556/0 (socket says 172.21.15.2:45556) 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 -- 172.21.15.2:0/670401713 learned_addr learned my addr 172.21.15.2:0/670401713 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacaffd640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffacc15ff50 0x7ffacc1f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffaca7fc640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc154eb0 0x7ffacc0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 -- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc154eb0 msgr2=0x7ffacc0b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc154eb0 0x7ffacc0b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 -- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffacc15ff50 msgr2=0x7ffacc1f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffacc15ff50 0x7ffacc1f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 -- 172.21.15.2:0/670401713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc1f9fd0 con 0x7ffacc0b8790 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacb7fe640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b8790 0x7ffacc160be0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ffacc08c820 tx=0x7ffac400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffab37fe640 1 -- 172.21.15.2:0/670401713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400fe90 con 0x7ffacc0b8790 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffab37fe640 1 -- 172.21.15.2:0/670401713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4011040 con 0x7ffacc0b8790 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc0b7a50 con 0x7ffacc0b8790 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffab37fe640 1 -- 172.21.15.2:0/670401713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4017640 con 0x7ffacc0b8790 2023-11-04T01:45:24.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc1f98e0 con 0x7ffacc0b8790 2023-11-04T01:45:24.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc0744a0 con 0x7ffacc0b8790 2023-11-04T01:45:24.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffab37fe640 1 -- 172.21.15.2:0/670401713 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffac40203b0 con 0x7ffacc0b8790 2023-11-04T01:45:24.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffab37fe640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffab80664a0 0x7ffab8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:24.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffab37fe640 1 -- 172.21.15.2:0/670401713 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6448+0+0 (secure 0 0 0) 0x7ffac4084240 con 0x7ffacc0b8790 2023-11-04T01:45:24.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.726+0000 7ffacaffd640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffab80664a0 0x7ffab8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:24.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.730+0000 7ffacaffd640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffab80664a0 0x7ffab8068960 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffab40057b0 tx=0x7ffabc001940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:24.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.734+0000 7ffab37fe640 1 -- 172.21.15.2:0/670401713 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffac40513e0 con 0x7ffacc0b8790 2023-11-04T01:45:24.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:24.850 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:24.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:24.898+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffacc0b7f00 con 0x7ffacc0b8790 2023-11-04T01:45:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.570+0000 7ffab37fe640 1 -- 172.21.15.2:0/670401713 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffac4054a00 con 0x7ffacc0b8790 2023-11-04T01:45:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffab80664a0 msgr2=0x7ffab8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffab80664a0 0x7ffab8068960 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffab40057b0 tx=0x7ffabc001940 comp rx=0 tx=0).stop 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b8790 msgr2=0x7ffacc160be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b8790 0x7ffacc160be0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ffacc08c820 tx=0x7ffac400f4a0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 shutdown_connections 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffab80664a0 0x7ffab8068960 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffacc0b8790 0x7ffacc160be0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffacc154eb0 0x7ffacc0b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 --2- 172.21.15.2:0/670401713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffacc15ff50 0x7ffacc1f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 >> 172.21.15.2:0/670401713 conn(0x7ffacc0d2e70 msgr2=0x7ffacc0d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 shutdown_connections 2023-11-04T01:45:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.574+0000 7ffad14c1640 1 -- 172.21.15.2:0/670401713 wait complete. 2023-11-04T01:45:25.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-04T01:45:25.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.778+0000 7fa325baa640 1 Processor -- start 2023-11-04T01:45:25.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.778+0000 7fa325baa640 1 -- start start 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.778+0000 7fa325baa640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 0x7fa3200b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.778+0000 7fa325baa640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32015f990 con 0x7fa32015b170 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.778+0000 7fa325baa640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32015ec10 con 0x7fa3200caca0 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.778+0000 7fa325baa640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32015f570 con 0x7fa32015ad90 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa32015b170 0x7fa3200ca590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39364/0 (socket says 172.21.15.2:39364) 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 -- 172.21.15.2:0/1271777083 learned_addr learned my addr 172.21.15.2:0/1271777083 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31f7fe640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 0x7fa3200b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747626732 0 0) 0x7fa310001120 con 0x7fa32015b170 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa30c003530 con 0x7fa32015b170 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097138987 0 0) 0x7fa30c003530 con 0x7fa32015b170 2023-11-04T01:45:25.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 msgr2=0x7fa3200b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 0x7fa3200b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 >> v1:172.21.15.90:6789/0 conn(0x7fa3200caca0 legacy=0x7fa3200ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200cd9a0 con 0x7fa32015b170 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa310001810 con 0x7fa32015b170 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 >> v1:172.21.15.2:6789/0 conn(0x7fa32015b170 legacy=0x7fa3200ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0039b0 0x7fa30c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa30c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 0x7fa30c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32015f570 con 0x7fa30c0047d0 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c00ba90 con 0x7fa30c0039b0 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c00bc50 con 0x7fa32015ad90 2023-11-04T01:45:25.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa30c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31f7fe640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0039b0 0x7fa30c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31ffff640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 0x7fa30c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 -- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 msgr2=0x7fa30c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa32015ad90 0x7fa30c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 -- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0039b0 msgr2=0x7fa30c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa30c0039b0 0x7fa30c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 -- 172.21.15.2:0/1271777083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c003530 con 0x7fa30c0047d0 2023-11-04T01:45:25.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31effd640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa30c004c50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c0e0 tx=0x7fa31001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0b9a864b704c75 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:25.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310005ae0 con 0x7fa30c0047d0 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310005c40 con 0x7fa30c0047d0 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.782+0000 7fa31e7fc640 1 -- 172.21.15.2:0/1271777083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100a5750 con 0x7fa30c0047d0 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/1271777083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 msgr2=0x7fa30c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 --2- 172.21.15.2:0/1271777083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa30c004c50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c0e0 tx=0x7fa31001cb40 comp rx=0 tx=0).stop 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31ffff640 1 -- 172.21.15.2:0/1271777083 reap_dead start 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/1271777083 shutdown_connections 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/1271777083 >> 172.21.15.2:0/1271777083 conn(0x7fa3200cb510 msgr2=0x7fa3200cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/1271777083 shutdown_connections 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/1271777083 wait complete. 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 Processor -- start 2023-11-04T01:45:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- start start 2023-11-04T01:45:25.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa3201557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3200c51e0 0x7fa320158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa320158da0 0x7fa3200c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320159220 con 0x7fa30c0047d0 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c4d50 con 0x7fa3200c51e0 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c4140 con 0x7fa320158da0 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa3201557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa3201557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45576/0 (socket says 172.21.15.2:45576) 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 -- 172.21.15.2:0/3779628390 learned_addr learned my addr 172.21.15.2:0/3779628390 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31effd640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3200c51e0 0x7fa320158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31ffff640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa320158da0 0x7fa3200c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 -- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa320158da0 msgr2=0x7fa3200c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa320158da0 0x7fa3200c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 -- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3200c51e0 msgr2=0x7fa320158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3200c51e0 0x7fa320158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 -- 172.21.15.2:0/3779628390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200c4420 con 0x7fa30c0047d0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31effd640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3200c51e0 0x7fa320158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa31f7fe640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa3201557f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa308011610 tx=0x7fa308011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa317fff640 1 -- 172.21.15.2:0/3779628390 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800f8f0 con 0x7fa30c0047d0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa317fff640 1 -- 172.21.15.2:0/3779628390 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30800fa50 con 0x7fa30c0047d0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200c4700 con 0x7fa30c0047d0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa317fff640 1 -- 172.21.15.2:0/3779628390 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800fdc0 con 0x7fa30c0047d0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa320155d30 con 0x7fa30c0047d0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.786+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3200744a0 con 0x7fa30c0047d0 2023-11-04T01:45:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.790+0000 7fa317fff640 1 -- 172.21.15.2:0/3779628390 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa308015460 con 0x7fa30c0047d0 2023-11-04T01:45:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.790+0000 7fa317fff640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3000664a0 0x7fa300068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.790+0000 7fa317fff640 1 -- 172.21.15.2:0/3779628390 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fa3080844b0 con 0x7fa30c0047d0 2023-11-04T01:45:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.790+0000 7fa31effd640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3000664a0 0x7fa300068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.790+0000 7fa31effd640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3000664a0 0x7fa300068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa3100ab000 tx=0x7fa3100a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:25.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.794+0000 7fa317fff640 1 -- 172.21.15.2:0/3779628390 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa308051800 con 0x7fa30c0047d0 2023-11-04T01:45:25.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.950+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa32015f160 con 0x7fa30c0047d0 2023-11-04T01:45:25.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa317fff640 1 -- 172.21.15.2:0/3779628390 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa308054e20 con 0x7fa30c0047d0 2023-11-04T01:45:25.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3000664a0 msgr2=0x7fa300068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3000664a0 0x7fa300068960 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa3100ab000 tx=0x7fa3100a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 msgr2=0x7fa3201557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa3201557f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa308011610 tx=0x7fa308011ad0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 shutdown_connections 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3000664a0 0x7fa300068960 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa320158da0 0x7fa3200c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3200c51e0 0x7fa320158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 --2- 172.21.15.2:0/3779628390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa30c0047d0 0x7fa3201557f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 >> 172.21.15.2:0/3779628390 conn(0x7fa3200cb510 msgr2=0x7fa3200b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 shutdown_connections 2023-11-04T01:45:25.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:25.958+0000 7fa325baa640 1 -- 172.21.15.2:0/3779628390 wait complete. 2023-11-04T01:45:25.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config' 2023-11-04T01:45:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0ccb0640 1 Processor -- start 2023-11-04T01:45:26.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0ccb0640 1 -- start start 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0ccb0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7d080715d0 0x7f7d080b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0ccb0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d080c2670 con 0x7f7d080b0b70 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0ccb0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0806bc30 con 0x7f7d0815afd0 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0ccb0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d08070140 con 0x7f7d080715d0 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d06d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7d080b0b70 0x7f7d0815ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39372/0 (socket says 172.21.15.2:39372) 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d06d9d640 1 -- 172.21.15.2:0/1750810124 learned_addr learned my addr 172.21.15.2:0/1750810124 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/1750810124 >> v2:172.21.15.90:3300/0 conn(0x7f7d080715d0 0x7f7d080b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541539947 0 0) 0x7f7d080c2670 con 0x7f7d080b0b70 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cf4003530 con 0x7f7d080b0b70 2023-11-04T01:45:26.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911628321 0 0) 0x7f7cf4003530 con 0x7f7d080b0b70 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 >> v2:172.21.15.90:3300/0 conn(0x7f7d080715d0 msgr2=0x7f7d080b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 --2- 172.21.15.2:0/1750810124 >> v2:172.21.15.90:3300/0 conn(0x7f7d080715d0 0x7f7d080b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 >> v1:172.21.15.90:6789/0 conn(0x7f7d0815afd0 legacy=0x7f7d0806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0806bf10 con 0x7f7d080b0b70 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f7cf8001680 con 0x7f7d080b0b70 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 >> v1:172.21.15.2:6789/0 conn(0x7f7d080b0b70 legacy=0x7f7d0815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cf4003980 0x7f7cf4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7cf4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf4005190 0x7f7cf400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d08070140 con 0x7f7cf40047d0 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf400c030 con 0x7f7cf4005190 2023-11-04T01:45:26.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf400c1f0 con 0x7f7cf4003980 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7cf4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d06d9d640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf4005190 0x7f7cf400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d0659c640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cf4003980 0x7f7cf4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d05d9b640 1 -- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cf4003980 msgr2=0x7f7cf4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7cf4003980 0x7f7cf4003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d05d9b640 1 -- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf4005190 msgr2=0x7f7cf400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cf4005190 0x7f7cf400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d05d9b640 1 -- 172.21.15.2:0/1750810124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4003530 con 0x7f7cf40047d0 2023-11-04T01:45:26.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.102+0000 7f7d06d9d640 1 -- 172.21.15.2:0/1750810124 reap_dead start 2023-11-04T01:45:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7cf4004c50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ae0 tx=0x7f7cf001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9829c7e8dd626bfa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00a5530 con 0x7f7cf40047d0 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00a5690 con 0x7f7cf40047d0 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0559a640 1 -- 172.21.15.2:0/1750810124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00a5a40 con 0x7f7cf40047d0 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/1750810124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 msgr2=0x7f7cf4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7cf4004c50 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ae0 tx=0x7f7cf001ca50 comp rx=0 tx=0).stop 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/1750810124 shutdown_connections 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/1750810124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7cf4004c50 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/1750810124 >> 172.21.15.2:0/1750810124 conn(0x7f7d080cebb0 msgr2=0x7f7d080cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/1750810124 shutdown_connections 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/1750810124 wait complete. 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 Processor -- start 2023-11-04T01:45:26.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.106+0000 7f7d0ccb0640 1 -- start start 2023-11-04T01:45:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7d080c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d080b41a0 0x7f7d080b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d080b2720 0x7f7d081f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080b3190 con 0x7f7cf40047d0 2023-11-04T01:45:26.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080b33e0 con 0x7f7d080b41a0 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080b36c0 con 0x7f7d080b2720 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7d080c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7d080c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45600/0 (socket says 172.21.15.2:45600) 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 -- 172.21.15.2:0/3249714527 learned_addr learned my addr 172.21.15.2:0/3249714527 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 -- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d080b2720 msgr2=0x7f7d081f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d080b2720 0x7f7d081f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 -- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d080b41a0 msgr2=0x7f7d080b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d080b41a0 0x7f7d080b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d080b41a0 0x7f7d080b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 -- 172.21.15.2:0/3249714527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d080b39a0 con 0x7f7cf40047d0 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0659c640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7d080c71b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000d830 tx=0x7f7d0000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7cfeffd640 1 -- 172.21.15.2:0/3249714527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d00003db0 con 0x7f7cf40047d0 2023-11-04T01:45:26.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7cfeffd640 1 -- 172.21.15.2:0/3249714527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d000050f0 con 0x7f7cf40047d0 2023-11-04T01:45:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d080b3c80 con 0x7f7cf40047d0 2023-11-04T01:45:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7cfeffd640 1 -- 172.21.15.2:0/3249714527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d000054a0 con 0x7f7cf40047d0 2023-11-04T01:45:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d081f18e0 con 0x7f7cf40047d0 2023-11-04T01:45:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d080744a0 con 0x7f7cf40047d0 2023-11-04T01:45:26.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7cfeffd640 1 -- 172.21.15.2:0/3249714527 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7d00005600 con 0x7f7cf40047d0 2023-11-04T01:45:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7cfeffd640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ce80664a0 0x7f7ce8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7cfeffd640 1 -- 172.21.15.2:0/3249714527 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f7d00084190 con 0x7f7cf40047d0 2023-11-04T01:45:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.110+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ce80664a0 0x7f7ce8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.114+0000 7f7d05d9b640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ce80664a0 0x7f7ce8068960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00af000 tx=0x7f7cf0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.114+0000 7f7cfeffd640 1 -- 172.21.15.2:0/3249714527 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7d00051630 con 0x7f7cf40047d0 2023-11-04T01:45:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.334+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]} v 0) v1 -- 0x7f7d0806cba0 con 0x7f7cf40047d0 2023-11-04T01:45:26.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.574+0000 7f7cfeffd640 1 -- 172.21.15.2:0/3249714527 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snapshots.TestSnapshots.test_allow_new_snaps_config"]}]=0 v192) v1 ==== 148+0+0 (secure 0 0 0) 0x7f7d00054c50 con 0x7f7cf40047d0 2023-11-04T01:45:26.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ce80664a0 msgr2=0x7f7ce8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ce80664a0 0x7f7ce8068960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00af000 tx=0x7f7cf0008040 comp rx=0 tx=0).stop 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 msgr2=0x7f7d080c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7d080c71b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f7d0000d830 tx=0x7f7d0000dcf0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 shutdown_connections 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7ce80664a0 0x7f7ce8068960 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7d080b2720 0x7f7d081f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7d080b41a0 0x7f7d080b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 --2- 172.21.15.2:0/3249714527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7cf40047d0 0x7f7d080c71b0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 >> 172.21.15.2:0/3249714527 conn(0x7f7d080cebb0 msgr2=0x7f7d08159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 shutdown_connections 2023-11-04T01:45:26.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.578+0000 7f7d0ccb0640 1 -- 172.21.15.2:0/3249714527 wait complete. 2023-11-04T01:45:26.603 INFO:tasks.cephfs_test_runner:Check whether 'allow_new_snaps' setting works ... ok 2023-11-04T01:45:26.603 INFO:tasks.cephfs_test_runner:Starting test: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) check snaptable transcation 2023-11-04T01:45:26.603 INFO:tasks.cephfs_test_runner:test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:45:26.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 Processor -- start 2023-11-04T01:45:26.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 -- start start 2023-11-04T01:45:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa19415d5c0 0x7fa1940712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1940c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa19406b7e0 0x7fa1940c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19415d9a0 con 0x7fa19415d5c0 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa194070e60 con 0x7fa19406b7e0 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19c5d4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa194070b30 con 0x7fa1940ad9e0 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa19415d5c0 0x7fa1940712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa19415d5c0 0x7fa1940712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45608/0 (socket says 172.21.15.2:45608) 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 -- 172.21.15.2:0/3729035182 learned_addr learned my addr 172.21.15.2:0/3729035182 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa199b6f640 1 --2- 172.21.15.2:0/3729035182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1940c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19ab71640 1 --2- 172.21.15.2:0/3729035182 >> v2:172.21.15.90:3300/0 conn(0x7fa19406b7e0 0x7fa1940c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 -- 172.21.15.2:0/3729035182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 msgr2=0x7fa1940c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 --2- 172.21.15.2:0/3729035182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1940c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 -- 172.21.15.2:0/3729035182 >> v2:172.21.15.90:3300/0 conn(0x7fa19406b7e0 msgr2=0x7fa1940c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 --2- 172.21.15.2:0/3729035182 >> v2:172.21.15.90:3300/0 conn(0x7fa19406b7e0 0x7fa1940c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.730+0000 7fa19a370640 1 -- 172.21.15.2:0/3729035182 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1940c90f0 con 0x7fa19415d5c0 2023-11-04T01:45:26.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.734+0000 7fa19a370640 1 --2- 172.21.15.2:0/3729035182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940712f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa19406f240 tx=0x7fa19001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da92ea0a5c3e773a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19936e640 1 -- 172.21.15.2:0/3729035182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1900aa5f0 con 0x7fa19415d5c0 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19936e640 1 -- 172.21.15.2:0/3729035182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1900aa750 con 0x7fa19415d5c0 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19936e640 1 -- 172.21.15.2:0/3729035182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1900aaae0 con 0x7fa19415d5c0 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- 172.21.15.2:0/3729035182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 msgr2=0x7fa1940712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/3729035182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940712f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa19406f240 tx=0x7fa19001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- 172.21.15.2:0/3729035182 shutdown_connections 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/3729035182 >> v2:172.21.15.90:3300/0 conn(0x7fa19406b7e0 0x7fa1940c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/3729035182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1940c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/3729035182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940712f0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- 172.21.15.2:0/3729035182 >> 172.21.15.2:0/3729035182 conn(0x7fa1940cea00 msgr2=0x7fa1940cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:26.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- 172.21.15.2:0/3729035182 shutdown_connections 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- 172.21.15.2:0/3729035182 wait complete. 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 Processor -- start 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- start start 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa19406b7e0 0x7fa19414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1941499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940c47b0 con 0x7fa19415d5c0 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19414f8c0 con 0x7fa19406b7e0 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19c5d4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940c3ba0 con 0x7fa1940ad9e0 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45616/0 (socket says 172.21.15.2:45616) 2023-11-04T01:45:26.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 -- 172.21.15.2:0/1895126649 learned_addr learned my addr 172.21.15.2:0/1895126649 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19a370640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa19406b7e0 0x7fa19414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa199b6f640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1941499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 -- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 msgr2=0x7fa1941499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1941499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 -- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa19406b7e0 msgr2=0x7fa19414f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa19406b7e0 0x7fa19414f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa19ab71640 1 -- 172.21.15.2:0/1895126649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900094d0 con 0x7fa19415d5c0 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.738+0000 7fa199b6f640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1941499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa19ab71640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940cd300 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa18c007e70 tx=0x7fa18c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa18affd640 1 -- 172.21.15.2:0/1895126649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c014620 con 0x7fa19415d5c0 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa18affd640 1 -- 172.21.15.2:0/1895126649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18c0147a0 con 0x7fa19415d5c0 2023-11-04T01:45:26.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa18affd640 1 -- 172.21.15.2:0/1895126649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18c014b50 con 0x7fa19415d5c0 2023-11-04T01:45:26.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1940c3e80 con 0x7fa19415d5c0 2023-11-04T01:45:26.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1940c4440 con 0x7fa19415d5c0 2023-11-04T01:45:26.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1940c4960 con 0x7fa19415d5c0 2023-11-04T01:45:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa18affd640 1 -- 172.21.15.2:0/1895126649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa18c014cb0 con 0x7fa19415d5c0 2023-11-04T01:45:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa18affd640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1780664d0 0x7fa178068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa18affd640 1 -- 172.21.15.2:0/1895126649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fa18c084910 con 0x7fa19415d5c0 2023-11-04T01:45:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa19a370640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1780664d0 0x7fa178068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:26.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.742+0000 7fa19a370640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1780664d0 0x7fa178068990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ae000 tx=0x7fa1900a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:26.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.746+0000 7fa18affd640 1 -- 172.21.15.2:0/1895126649 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1940c4960 con 0x7fa19415d5c0 2023-11-04T01:45:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.910+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1940c4960 con 0x7fa19415d5c0 2023-11-04T01:45:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.914+0000 7fa18affd640 1 -- 172.21.15.2:0/1895126649 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18131 (secure 0 0 0) 0x7fa1940c4960 con 0x7fa19415d5c0 2023-11-04T01:45:26.917 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:26.918 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":84,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:25.571072+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6835/1445624388":"2023-11-05T01:45:22.629936+0000","172.21.15.90:6834/1445624388":"2023-11-05T01:45:22.629936+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:26.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1780664d0 msgr2=0x7fa178068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1780664d0 0x7fa178068990 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ae000 tx=0x7fa1900a7000 comp rx=0 tx=0).stop 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 msgr2=0x7fa1940cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940cd300 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa18c007e70 tx=0x7fa18c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 shutdown_connections 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa1780664d0 0x7fa178068990 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa19415d5c0 0x7fa1940cd300 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa1940ad9e0 0x7fa1941499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 --2- 172.21.15.2:0/1895126649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa19406b7e0 0x7fa19414f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 >> 172.21.15.2:0/1895126649 conn(0x7fa1940cea00 msgr2=0x7fa1940ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 shutdown_connections 2023-11-04T01:45:26.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:26.918+0000 7fa19c5d4640 1 -- 172.21.15.2:0/1895126649 wait complete. 2023-11-04T01:45:26.937 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:45:26.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:45:27.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.058+0000 7fa36f3d0640 1 Processor -- start 2023-11-04T01:45:27.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.058+0000 7fa36f3d0640 1 -- start start 2023-11-04T01:45:27.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36f3d0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa36815af70 0x7fa3680cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36f3d0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36806d160 0x7fa3680cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36f3d0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36806c0c0 con 0x7fa36815dd80 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36f3d0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa368071200 con 0x7fa36815af70 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36f3d0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa36806c3a0 con 0x7fa36806d160 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d96d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa36815dd80 0x7fa36815e1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39374/0 (socket says 172.21.15.2:39374) 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d96d640 1 -- 172.21.15.2:0/1093478193 learned_addr learned my addr 172.21.15.2:0/1093478193 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d16c640 1 --2- 172.21.15.2:0/1093478193 >> v2:172.21.15.2:3300/0 conn(0x7fa36815af70 0x7fa3680cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36c96b640 1 --2- 172.21.15.2:0/1093478193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36806d160 0x7fa3680cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa367fff640 1 -- 172.21.15.2:0/1093478193 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663989052 0 0) 0x7fa36806c0c0 con 0x7fa36815dd80 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa367fff640 1 -- 172.21.15.2:0/1093478193 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa350003530 con 0x7fa36815dd80 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d16c640 1 -- 172.21.15.2:0/1093478193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36806d160 msgr2=0x7fa3680cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d16c640 1 --2- 172.21.15.2:0/1093478193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36806d160 0x7fa3680cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d16c640 1 -- 172.21.15.2:0/1093478193 >> v1:172.21.15.2:6789/0 conn(0x7fa36815dd80 legacy=0x7fa36815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d16c640 1 -- 172.21.15.2:0/1093478193 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36806c680 con 0x7fa36815af70 2023-11-04T01:45:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa36d16c640 1 --2- 172.21.15.2:0/1093478193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36815af70 0x7fa3680cdaa0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa3600097c0 tx=0x7fa36001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8acf9b085e1bcc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa367fff640 1 -- 172.21.15.2:0/1093478193 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600ab600 con 0x7fa36815af70 2023-11-04T01:45:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa367fff640 1 -- 172.21.15.2:0/1093478193 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600a7050 con 0x7fa36815af70 2023-11-04T01:45:27.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.062+0000 7fa367fff640 1 -- 172.21.15.2:0/1093478193 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600ab960 con 0x7fa36815af70 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1093478193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36815af70 msgr2=0x7fa3680cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1093478193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36815af70 0x7fa3680cdaa0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fa3600097c0 tx=0x7fa36001c480 comp rx=0 tx=0).stop 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1093478193 shutdown_connections 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1093478193 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36806d160 0x7fa3680cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1093478193 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36815af70 0x7fa3680cdaa0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1093478193 >> 172.21.15.2:0/1093478193 conn(0x7fa3680cb510 msgr2=0x7fa3680cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1093478193 shutdown_connections 2023-11-04T01:45:27.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1093478193 wait complete. 2023-11-04T01:45:27.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 Processor -- start 2023-11-04T01:45:27.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- start start 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36806d160 0x7fa3680c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36815af70 0x7fa368150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36815dd80 0x7fa3680ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680c4810 con 0x7fa36806d160 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680b32c0 con 0x7fa36815dd80 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3680b2fe0 con 0x7fa36815af70 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36806d160 0x7fa3680c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36806d160 0x7fa3680c25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45632/0 (socket says 172.21.15.2:45632) 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 -- 172.21.15.2:0/1720941422 learned_addr learned my addr 172.21.15.2:0/1720941422 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d96d640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36815dd80 0x7fa3680ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36c96b640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36815af70 0x7fa368150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 -- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36815af70 msgr2=0x7fa368150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36815af70 0x7fa368150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 -- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36815dd80 msgr2=0x7fa3680ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36815dd80 0x7fa3680ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 -- 172.21.15.2:0/1720941422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009420 con 0x7fa36806d160 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36d16c640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36806d160 0x7fa3680c25c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa36001ab30 tx=0x7fa360019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa365ffb640 1 -- 172.21.15.2:0/1720941422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600bb070 con 0x7fa36806d160 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa365ffb640 1 -- 172.21.15.2:0/1720941422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600abdc0 con 0x7fa36806d160 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa365ffb640 1 -- 172.21.15.2:0/1720941422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3600b4600 con 0x7fa36806d160 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3680c71d0 con 0x7fa36806d160 2023-11-04T01:45:27.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.066+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3680c7790 con 0x7fa36806d160 2023-11-04T01:45:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.070+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3680c7030 con 0x7fa36806d160 2023-11-04T01:45:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.070+0000 7fa365ffb640 1 -- 172.21.15.2:0/1720941422 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3600b2040 con 0x7fa36806d160 2023-11-04T01:45:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.070+0000 7fa365ffb640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3540664a0 0x7fa354068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.070+0000 7fa365ffb640 1 -- 172.21.15.2:0/1720941422 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fa36011d7c0 con 0x7fa36806d160 2023-11-04T01:45:27.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.070+0000 7fa36c96b640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3540664a0 0x7fa354068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.070+0000 7fa36c96b640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3540664a0 0x7fa354068960 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa35c003fd0 tx=0x7fa35c0039c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.074+0000 7fa365ffb640 1 -- 172.21.15.2:0/1720941422 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa3680c7030 con 0x7fa36806d160 2023-11-04T01:45:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.230+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3680c7030 con 0x7fa36806d160 2023-11-04T01:45:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.230+0000 7fa365ffb640 1 -- 172.21.15.2:0/1720941422 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3680c7030 con 0x7fa36806d160 2023-11-04T01:45:27.233 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3540664a0 msgr2=0x7fa354068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3540664a0 0x7fa354068960 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa35c003fd0 tx=0x7fa35c0039c0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36806d160 msgr2=0x7fa3680c25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36806d160 0x7fa3680c25c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fa36001ab30 tx=0x7fa360019220 comp rx=0 tx=0).stop 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 shutdown_connections 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa3540664a0 0x7fa354068960 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36815dd80 0x7fa3680ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa36815af70 0x7fa368150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 --2- 172.21.15.2:0/1720941422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa36806d160 0x7fa3680c25c0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 >> 172.21.15.2:0/1720941422 conn(0x7fa3680cb510 msgr2=0x7fa3680ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 shutdown_connections 2023-11-04T01:45:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.234+0000 7fa36f3d0640 1 -- 172.21.15.2:0/1720941422 wait complete. 2023-11-04T01:45:27.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:45:27.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.370+0000 7f8193099640 1 Processor -- start 2023-11-04T01:45:27.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8193099640 1 -- start start 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8193099640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f818c15acb0 0x7f818c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8193099640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15c160 0x7f818c0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8193099640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f818c0b0a50 0x7f818c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8193099640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c15bd40 con 0x7f818c0b0a50 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8193099640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c06fd80 con 0x7f818c15acb0 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8193099640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b0ee0 con 0x7f818c15c160 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f818c0b0a50 0x7f818c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f818c0b0a50 0x7f818c0ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45646/0 (socket says 172.21.15.2:45646) 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 -- 172.21.15.2:0/3691572307 learned_addr learned my addr 172.21.15.2:0/3691572307 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f818bfff640 1 --2- 172.21.15.2:0/3691572307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15c160 0x7f818c0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8190e35640 1 --2- 172.21.15.2:0/3691572307 >> v2:172.21.15.90:3300/0 conn(0x7f818c15acb0 0x7f818c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 -- 172.21.15.2:0/3691572307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15c160 msgr2=0x7f818c0b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 --2- 172.21.15.2:0/3691572307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15c160 0x7f818c0b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 -- 172.21.15.2:0/3691572307 >> v2:172.21.15.90:3300/0 conn(0x7f818c15acb0 msgr2=0x7f818c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 --2- 172.21.15.2:0/3691572307 >> v2:172.21.15.90:3300/0 conn(0x7f818c15acb0 0x7f818c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 -- 172.21.15.2:0/3691572307 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0cb130 con 0x7f818c0b0a50 2023-11-04T01:45:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.374+0000 7f8191636640 1 --2- 172.21.15.2:0/3691572307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b0a50 0x7f818c0ca490 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f818c06d550 tx=0x7f818401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85d474c06754a45 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f818b7fe640 1 -- 172.21.15.2:0/3691572307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840aa5f0 con 0x7f818c0b0a50 2023-11-04T01:45:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f818b7fe640 1 -- 172.21.15.2:0/3691572307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840aa750 con 0x7f818c0b0a50 2023-11-04T01:45:27.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f818b7fe640 1 -- 172.21.15.2:0/3691572307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840aaae0 con 0x7f818c0b0a50 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- 172.21.15.2:0/3691572307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b0a50 msgr2=0x7f818c0ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 --2- 172.21.15.2:0/3691572307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b0a50 0x7f818c0ca490 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f818c06d550 tx=0x7f818401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- 172.21.15.2:0/3691572307 shutdown_connections 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 --2- 172.21.15.2:0/3691572307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b0a50 0x7f818c0ca490 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 --2- 172.21.15.2:0/3691572307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15c160 0x7f818c0b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 --2- 172.21.15.2:0/3691572307 >> v2:172.21.15.90:3300/0 conn(0x7f818c15acb0 0x7f818c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- 172.21.15.2:0/3691572307 >> 172.21.15.2:0/3691572307 conn(0x7f818c0cb510 msgr2=0x7f818c0cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- 172.21.15.2:0/3691572307 shutdown_connections 2023-11-04T01:45:27.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- 172.21.15.2:0/3691572307 wait complete. 2023-11-04T01:45:27.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 Processor -- start 2023-11-04T01:45:27.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- start start 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c0b0a50 0x7f818c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15acb0 0x7f818c0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c15c160 0x7f818c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c150a80 con 0x7f818c15c160 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c1518c0 con 0x7f818c0b0a50 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8193099640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c150cb0 con 0x7f818c15acb0 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c15c160 0x7f818c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c15c160 0x7f818c151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45660/0 (socket says 172.21.15.2:45660) 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 -- 172.21.15.2:0/1988111316 learned_addr learned my addr 172.21.15.2:0/1988111316 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f818bfff640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15acb0 0x7f818c0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8190e35640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c0b0a50 0x7f818c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 -- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15acb0 msgr2=0x7f818c0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15acb0 0x7f818c0c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 -- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c0b0a50 msgr2=0x7f818c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c0b0a50 0x7f818c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 -- 172.21.15.2:0/1988111316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840094d0 con 0x7f818c15c160 2023-11-04T01:45:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.378+0000 7f8191636640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c15c160 0x7f818c151d50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f81840ac040 tx=0x7f818401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f81897fa640 1 -- 172.21.15.2:0/1988111316 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840b3800 con 0x7f818c15c160 2023-11-04T01:45:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f81897fa640 1 -- 172.21.15.2:0/1988111316 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840b3960 con 0x7f818c15c160 2023-11-04T01:45:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c150f90 con 0x7f818c15c160 2023-11-04T01:45:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f81897fa640 1 -- 172.21.15.2:0/1988111316 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840b3cd0 con 0x7f818c15c160 2023-11-04T01:45:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c151550 con 0x7f818c15c160 2023-11-04T01:45:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c151a70 con 0x7f818c15c160 2023-11-04T01:45:27.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f81897fa640 1 -- 172.21.15.2:0/1988111316 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81840c8430 con 0x7f818c15c160 2023-11-04T01:45:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f81897fa640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664a0 0x7f8178068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f81897fa640 1 -- 172.21.15.2:0/1988111316 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f81840a7070 con 0x7f818c15c160 2023-11-04T01:45:27.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f8190e35640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664a0 0x7f8178068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.382+0000 7f8190e35640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664a0 0x7f8178068960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f817c00b9d0 tx=0x7f817c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.386+0000 7f81897fa640 1 -- 172.21.15.2:0/1988111316 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f81840ebbd0 con 0x7f818c15c160 2023-11-04T01:45:27.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f818c151a30 con 0x7f818c15c160 2023-11-04T01:45:27.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f81897fa640 1 -- 172.21.15.2:0/1988111316 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7f81840c30a0 con 0x7f818c15c160 2023-11-04T01:45:27.548 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664a0 msgr2=0x7f8178068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664a0 0x7f8178068960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f817c00b9d0 tx=0x7f817c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c15c160 msgr2=0x7f818c151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c15c160 0x7f818c151d50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f81840ac040 tx=0x7f818401ad10 comp rx=0 tx=0).stop 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 shutdown_connections 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664a0 0x7f8178068960 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c15c160 0x7f818c151d50 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c15acb0 0x7f818c0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 --2- 172.21.15.2:0/1988111316 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c0b0a50 0x7f818c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 >> 172.21.15.2:0/1988111316 conn(0x7f818c0cb510 msgr2=0x7f818c15c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 shutdown_connections 2023-11-04T01:45:27.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.546+0000 7f8193099640 1 -- 172.21.15.2:0/1988111316 wait complete. 2023-11-04T01:45:27.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:45:27.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd778a4640 1 Processor -- start 2023-11-04T01:45:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd778a4640 1 -- start start 2023-11-04T01:45:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd778a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd7015d0b0 0x7fbd70160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd778a4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbd700cff20 0x7fbd700d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd778a4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd700b5e00 con 0x7fbd701610f0 2023-11-04T01:45:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd778a4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd700d1520 con 0x7fbd700cff20 2023-11-04T01:45:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd778a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7015d490 con 0x7fbd7015d0b0 2023-11-04T01:45:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75640640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd7015d0b0 0x7fbd70160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75e41640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbd700cff20 0x7fbd700d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75640640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd7015d0b0 0x7fbd70160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:50758/0 (socket says 172.21.15.2:50758) 2023-11-04T01:45:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75640640 1 -- 172.21.15.2:0/2036560613 learned_addr learned my addr 172.21.15.2:0/2036560613 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75640640 1 -- 172.21.15.2:0/2036560613 >> v2:172.21.15.90:3300/0 conn(0x7fbd700cff20 msgr2=0x7fbd700d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75640640 1 --2- 172.21.15.2:0/2036560613 >> v2:172.21.15.90:3300/0 conn(0x7fbd700cff20 0x7fbd700d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75640640 1 -- 172.21.15.2:0/2036560613 >> v1:172.21.15.90:6789/0 conn(0x7fbd701610f0 legacy=0x7fbd700cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.686+0000 7fbd75640640 1 -- 172.21.15.2:0/2036560613 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd700b8930 con 0x7fbd7015d0b0 2023-11-04T01:45:27.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd75640640 1 --2- 172.21.15.2:0/2036560613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd7015d0b0 0x7fbd70160bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009870 tx=0x7fbd6001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8381acf75f00b6d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd67fff640 1 -- 172.21.15.2:0/2036560613 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd600ab650 con 0x7fbd7015d0b0 2023-11-04T01:45:27.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd67fff640 1 -- 172.21.15.2:0/2036560613 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd600ab7b0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd67fff640 1 -- 172.21.15.2:0/2036560613 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd600abb40 con 0x7fbd7015d0b0 2023-11-04T01:45:27.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 -- 172.21.15.2:0/2036560613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd7015d0b0 msgr2=0x7fbd70160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 --2- 172.21.15.2:0/2036560613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd7015d0b0 0x7fbd70160bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009870 tx=0x7fbd6001c540 comp rx=0 tx=0).stop 2023-11-04T01:45:27.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 -- 172.21.15.2:0/2036560613 shutdown_connections 2023-11-04T01:45:27.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 --2- 172.21.15.2:0/2036560613 >> v2:172.21.15.90:3300/0 conn(0x7fbd700cff20 0x7fbd700d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 --2- 172.21.15.2:0/2036560613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd7015d0b0 0x7fbd70160bb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 -- 172.21.15.2:0/2036560613 >> 172.21.15.2:0/2036560613 conn(0x7fbd7006a890 msgr2=0x7fbd7006aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 -- 172.21.15.2:0/2036560613 shutdown_connections 2023-11-04T01:45:27.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 -- 172.21.15.2:0/2036560613 wait complete. 2023-11-04T01:45:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 Processor -- start 2023-11-04T01:45:27.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.690+0000 7fbd778a4640 1 -- start start 2023-11-04T01:45:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd700cff20 0x7fbd7015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7015d0b0 0x7fbd700b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd701610f0 0x7fbd7015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7015a430 con 0x7fbd7015d0b0 2023-11-04T01:45:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7014c480 con 0x7fbd700cff20 2023-11-04T01:45:27.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7015c050 con 0x7fbd701610f0 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7015d0b0 0x7fbd700b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7015d0b0 0x7fbd700b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45666/0 (socket says 172.21.15.2:45666) 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 -- 172.21.15.2:0/3531254968 learned_addr learned my addr 172.21.15.2:0/3531254968 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd75640640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd700cff20 0x7fbd7015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd75e41640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd701610f0 0x7fbd7015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 -- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd701610f0 msgr2=0x7fbd7015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd701610f0 0x7fbd7015a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 -- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd700cff20 msgr2=0x7fbd7015b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd700cff20 0x7fbd7015b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 -- 172.21.15.2:0/3531254968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd600094d0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd75e41640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd701610f0 0x7fbd7015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd74e3f640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7015d0b0 0x7fbd700b28a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00c3c0 tx=0x7fbd6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd65ffb640 1 -- 172.21.15.2:0/3531254968 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0052d0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd65ffb640 1 -- 172.21.15.2:0/3531254968 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c005430 con 0x7fbd7015d0b0 2023-11-04T01:45:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7015ae00 con 0x7fbd7015d0b0 2023-11-04T01:45:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd65ffb640 1 -- 172.21.15.2:0/3531254968 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c003840 con 0x7fbd7015d0b0 2023-11-04T01:45:27.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7015bd70 con 0x7fbd7015d0b0 2023-11-04T01:45:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7015a5e0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd65ffb640 1 -- 172.21.15.2:0/3531254968 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd6c0039a0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd65ffb640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd540664a0 0x7fbd54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.694+0000 7fbd65ffb640 1 -- 172.21.15.2:0/3531254968 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fbd6c0834a0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.698+0000 7fbd75640640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd540664a0 0x7fbd54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:27.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.698+0000 7fbd75640640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd540664a0 0x7fbd54068960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbd600af000 tx=0x7fbd600a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:27.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.698+0000 7fbd65ffb640 1 -- 172.21.15.2:0/3531254968 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd7015a5e0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.854+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7fbd700744a0 con 0x7fbd7015d0b0 2023-11-04T01:45:27.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd65ffb640 1 -- 172.21.15.2:0/3531254968 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v84) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd6c050880 con 0x7fbd7015d0b0 2023-11-04T01:45:27.859 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:27.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd540664a0 msgr2=0x7fbd54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd540664a0 0x7fbd54068960 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbd600af000 tx=0x7fbd600a7000 comp rx=0 tx=0).stop 2023-11-04T01:45:27.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7015d0b0 msgr2=0x7fbd700b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7015d0b0 0x7fbd700b28a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00c3c0 tx=0x7fbd6c00c880 comp rx=0 tx=0).stop 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 shutdown_connections 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd540664a0 0x7fbd54068960 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd701610f0 0x7fbd7015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd7015d0b0 0x7fbd700b28a0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 --2- 172.21.15.2:0/3531254968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd700cff20 0x7fbd7015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 >> 172.21.15.2:0/3531254968 conn(0x7fbd7006a890 msgr2=0x7fbd7015d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 shutdown_connections 2023-11-04T01:45:27.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:27.858+0000 7fbd778a4640 1 -- 172.21.15.2:0/3531254968 wait complete. 2023-11-04T01:45:27.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:45:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08cb98d640 1 Processor -- start 2023-11-04T01:45:28.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08cb98d640 1 -- start start 2023-11-04T01:45:28.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08cb98d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c415acb0 0x7f08c415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08cb98d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08c40b0c20 0x7f08c40ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08cb98d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c40cb130 con 0x7f08c415c160 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08cb98d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c415bd40 con 0x7f08c40b0c20 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08cb98d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c406fd80 con 0x7f08c415acb0 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c9f2a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08c40b0c20 0x7f08c40ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c8f28640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f08c415c160 0x7f08c40b0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39380/0 (socket says 172.21.15.2:39380) 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c8f28640 1 -- 172.21.15.2:0/2077595646 learned_addr learned my addr 172.21.15.2:0/2077595646 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c9729640 1 --2- 172.21.15.2:0/2077595646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c415acb0 0x7f08c415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c9f2a640 1 -- 172.21.15.2:0/2077595646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c415acb0 msgr2=0x7f08c415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c9f2a640 1 --2- 172.21.15.2:0/2077595646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c415acb0 0x7f08c415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c9f2a640 1 -- 172.21.15.2:0/2077595646 >> v1:172.21.15.2:6789/0 conn(0x7f08c415c160 legacy=0x7f08c40b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.002+0000 7f08c9f2a640 1 -- 172.21.15.2:0/2077595646 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c415b680 con 0x7f08c40b0c20 2023-11-04T01:45:28.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08c9f2a640 1 --2- 172.21.15.2:0/2077595646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c40b0c20 0x7f08c40ca490 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009d90 tx=0x7f08bc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccca0fea98c8a19 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08bbfff640 1 -- 172.21.15.2:0/2077595646 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0a5a00 con 0x7f08c40b0c20 2023-11-04T01:45:28.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08bbfff640 1 -- 172.21.15.2:0/2077595646 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc0a5b60 con 0x7f08c40b0c20 2023-11-04T01:45:28.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08bbfff640 1 -- 172.21.15.2:0/2077595646 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0ad440 con 0x7f08c40b0c20 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- 172.21.15.2:0/2077595646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c40b0c20 msgr2=0x7f08c40ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2077595646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c40b0c20 0x7f08c40ca490 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f08bc009d90 tx=0x7f08bc01c920 comp rx=0 tx=0).stop 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- 172.21.15.2:0/2077595646 shutdown_connections 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2077595646 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c40b0c20 0x7f08c40ca490 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2077595646 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c415acb0 0x7f08c415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- 172.21.15.2:0/2077595646 >> 172.21.15.2:0/2077595646 conn(0x7f08c40cb510 msgr2=0x7f08c40cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- 172.21.15.2:0/2077595646 shutdown_connections 2023-11-04T01:45:28.009 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- 172.21.15.2:0/2077595646 wait complete. 2023-11-04T01:45:28.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 Processor -- start 2023-11-04T01:45:28.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- start start 2023-11-04T01:45:28.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c40b0c20 0x7f08c414e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c415acb0 0x7f08c4154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c415c160 0x7f08c4155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40b3620 con 0x7f08c415c160 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40b2580 con 0x7f08c415acb0 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08cb98d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c40b2860 con 0x7f08c40b0c20 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08c9f2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c415c160 0x7f08c4155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08c9f2a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c415c160 0x7f08c4155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45690/0 (socket says 172.21.15.2:45690) 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08c9f2a640 1 -- 172.21.15.2:0/2619956315 learned_addr learned my addr 172.21.15.2:0/2619956315 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08c8f28640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c415acb0 0x7f08c4154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.006+0000 7f08c9729640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c40b0c20 0x7f08c414e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9f2a640 1 -- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c40b0c20 msgr2=0x7f08c414e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9f2a640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c40b0c20 0x7f08c414e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9f2a640 1 -- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c415acb0 msgr2=0x7f08c4154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9f2a640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c415acb0 0x7f08c4154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9f2a640 1 -- 172.21.15.2:0/2619956315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc009a70 con 0x7f08c415c160 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9f2a640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c415c160 0x7f08c4155130 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0b0040 tx=0x7f08bc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08b9ffb640 1 -- 172.21.15.2:0/2619956315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0add90 con 0x7f08c415c160 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08b9ffb640 1 -- 172.21.15.2:0/2619956315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc009450 con 0x7f08c415c160 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c40b2b40 con 0x7f08c415c160 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08b9ffb640 1 -- 172.21.15.2:0/2619956315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc0b9690 con 0x7f08c415c160 2023-11-04T01:45:28.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c40b3100 con 0x7f08c415c160 2023-11-04T01:45:28.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c40b32f0 con 0x7f08c415c160 2023-11-04T01:45:28.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08b9ffb640 1 -- 172.21.15.2:0/2619956315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08bc0b97f0 con 0x7f08c415c160 2023-11-04T01:45:28.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08b9ffb640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08a80664a0 0x7f08a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08b9ffb640 1 -- 172.21.15.2:0/2619956315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f08bc11f800 con 0x7f08c415c160 2023-11-04T01:45:28.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9729640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08a80664a0 0x7f08a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.010+0000 7f08c9729640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08a80664a0 0x7f08a8068960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08c4151c00 tx=0x7f08c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.014+0000 7f08b9ffb640 1 -- 172.21.15.2:0/2619956315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08bc0ecb50 con 0x7f08c415c160 2023-11-04T01:45:28.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.162+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f08c40744a0 con 0x7f08c415c160 2023-11-04T01:45:28.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.162+0000 7f08b9ffb640 1 -- 172.21.15.2:0/2619956315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f08bc0b20b0 con 0x7f08c415c160 2023-11-04T01:45:28.166 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08a80664a0 msgr2=0x7f08a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08a80664a0 0x7f08a8068960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f08c4151c00 tx=0x7f08c0008040 comp rx=0 tx=0).stop 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c415c160 msgr2=0x7f08c4155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c415c160 0x7f08c4155130 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0b0040 tx=0x7f08bc0196c0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 shutdown_connections 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08a80664a0 0x7f08a8068960 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08c415c160 0x7f08c4155130 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08c415acb0 0x7f08c4154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 --2- 172.21.15.2:0/2619956315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08c40b0c20 0x7f08c414e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 >> 172.21.15.2:0/2619956315 conn(0x7f08c40cb510 msgr2=0x7f08c4153230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 shutdown_connections 2023-11-04T01:45:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.166+0000 7f08cb98d640 1 -- 172.21.15.2:0/2619956315 wait complete. 2023-11-04T01:45:28.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable' 2023-11-04T01:45:28.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66bc958640 1 Processor -- start 2023-11-04T01:45:28.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66bc958640 1 -- start start 2023-11-04T01:45:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66bc958640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 0x7f66b80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66bc958640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b80c2670 con 0x7f66b815afd0 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66bc958640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b806bc30 con 0x7f66b80b0b70 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66bc958640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b8070140 con 0x7f66b80715d0 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f66b815afd0 0x7f66b806f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39384/0 (socket says 172.21.15.2:39384) 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b659c640 1 -- 172.21.15.2:0/746021015 learned_addr learned my addr 172.21.15.2:0/746021015 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b5d9b640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 0x7f66b80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641579856 0 0) 0x7f66b80c2670 con 0x7f66b815afd0 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a0003530 con 0x7f66b815afd0 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052194917 0 0) 0x7f66a0003530 con 0x7f66b815afd0 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 msgr2=0x7f66b80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 0x7f66b80b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 >> v1:172.21.15.90:6789/0 conn(0x7f66b80b0b70 legacy=0x7f66b815ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b806bf10 con 0x7f66b815afd0 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f66a8001680 con 0x7f66b815afd0 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 >> v1:172.21.15.2:6789/0 conn(0x7f66b815afd0 legacy=0x7f66b806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00039b0 0x7f66a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 0x7f66a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a0004d10 0x7f66a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b8070140 con 0x7f66a0004d10 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a000ba40 con 0x7f66a00039b0 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a000bc00 con 0x7f66b80715d0 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b6d9d640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a0004d10 0x7f66a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b5d9b640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 0x7f66a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b659c640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00039b0 0x7f66a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b6d9d640 1 -- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 msgr2=0x7f66a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b6d9d640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b80715d0 0x7f66a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b6d9d640 1 -- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00039b0 msgr2=0x7f66a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b6d9d640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66a00039b0 0x7f66a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.302+0000 7f66b6d9d640 1 -- 172.21.15.2:0/746021015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0003530 con 0x7f66a0004d10 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66b6d9d640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a0004d10 0x7f66a0005190 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f66b0001e40 tx=0x7f66b001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4081cf071277b5ca server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0003b80 con 0x7f66a0004d10 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b0003ce0 con 0x7f66a0004d10 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66b559a640 1 -- 172.21.15.2:0/746021015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b00052c0 con 0x7f66a0004d10 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 -- 172.21.15.2:0/746021015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a0004d10 msgr2=0x7f66a0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 --2- 172.21.15.2:0/746021015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66a0004d10 0x7f66a0005190 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f66b0001e40 tx=0x7f66b001c740 comp rx=0 tx=0).stop 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66b6d9d640 1 -- 172.21.15.2:0/746021015 reap_dead start 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 -- 172.21.15.2:0/746021015 shutdown_connections 2023-11-04T01:45:28.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 -- 172.21.15.2:0/746021015 >> 172.21.15.2:0/746021015 conn(0x7f66b80cebb0 msgr2=0x7f66b80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 -- 172.21.15.2:0/746021015 shutdown_connections 2023-11-04T01:45:28.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 -- 172.21.15.2:0/746021015 wait complete. 2023-11-04T01:45:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 Processor -- start 2023-11-04T01:45:28.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.306+0000 7f66bc958640 1 -- start start 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66b80c9dd0 0x7f66b815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b80ca1b0 0x7f66b815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b81566d0 0x7f66b8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b815d220 con 0x7f66b80c9dd0 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b8157090 con 0x7f66b80ca1b0 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b815c5a0 con 0x7f66b81566d0 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66b80c9dd0 0x7f66b815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66b80c9dd0 0x7f66b815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45696/0 (socket says 172.21.15.2:45696) 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 -- 172.21.15.2:0/1391001168 learned_addr learned my addr 172.21.15.2:0/1391001168 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b5d9b640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b80ca1b0 0x7f66b815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b6d9d640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b81566d0 0x7f66b8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 -- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b81566d0 msgr2=0x7f66b8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b81566d0 0x7f66b8156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 -- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b80ca1b0 msgr2=0x7f66b815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b80ca1b0 0x7f66b815dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 -- 172.21.15.2:0/1391001168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b815c880 con 0x7f66b80c9dd0 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b6d9d640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b81566d0 0x7f66b8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b5d9b640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b80ca1b0 0x7f66b815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b659c640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66b80c9dd0 0x7f66b815d850 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f66a80017b0 tx=0x7f66a8007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66a6ffd640 1 -- 172.21.15.2:0/1391001168 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a800f9e0 con 0x7f66b80c9dd0 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66a6ffd640 1 -- 172.21.15.2:0/1391001168 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a800fb80 con 0x7f66b80c9dd0 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b815cb60 con 0x7f66b80c9dd0 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66a6ffd640 1 -- 172.21.15.2:0/1391001168 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a80133f0 con 0x7f66b80c9dd0 2023-11-04T01:45:28.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b8154970 con 0x7f66b80c9dd0 2023-11-04T01:45:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b81f08f0 con 0x7f66b80c9dd0 2023-11-04T01:45:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66a6ffd640 1 -- 172.21.15.2:0/1391001168 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66a8013550 con 0x7f66b80c9dd0 2023-11-04T01:45:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66a6ffd640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66980664a0 0x7f6698068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66a6ffd640 1 -- 172.21.15.2:0/1391001168 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f66a8084cc0 con 0x7f66b80c9dd0 2023-11-04T01:45:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.310+0000 7f66b5d9b640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66980664a0 0x7f6698068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.314+0000 7f66b5d9b640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66980664a0 0x7f6698068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f66b80b1140 tx=0x7f66ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.314+0000 7f66a6ffd640 1 -- 172.21.15.2:0/1391001168 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66a8052180 con 0x7f66b80c9dd0 2023-11-04T01:45:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.518+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]} v 0) v1 -- 0x7f66b80744a0 con 0x7f66b80c9dd0 2023-11-04T01:45:28.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66a6ffd640 1 -- 172.21.15.2:0/1391001168 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snapshots.TestSnapshots.test_kill_mdstable"]}]=0 v194) v1 ==== 142+0+0 (secure 0 0 0) 0x7f66a80557a0 con 0x7f66b80c9dd0 2023-11-04T01:45:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66980664a0 msgr2=0x7f6698068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66980664a0 0x7f6698068960 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f66b80b1140 tx=0x7f66ac008040 comp rx=0 tx=0).stop 2023-11-04T01:45:28.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66b80c9dd0 msgr2=0x7f66b815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66b80c9dd0 0x7f66b815d850 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f66a80017b0 tx=0x7f66a8007790 comp rx=0 tx=0).stop 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 shutdown_connections 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66980664a0 0x7f6698068960 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66b81566d0 0x7f66b8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66b80ca1b0 0x7f66b815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 --2- 172.21.15.2:0/1391001168 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66b80c9dd0 0x7f66b815d850 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 >> 172.21.15.2:0/1391001168 conn(0x7f66b80cebb0 msgr2=0x7f66b815a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 shutdown_connections 2023-11-04T01:45:28.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.590+0000 7f66bc958640 1 -- 172.21.15.2:0/1391001168 wait complete. 2023-11-04T01:45:28.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-04T01:45:28.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff21b8e9640 1 Processor -- start 2023-11-04T01:45:28.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff21b8e9640 1 -- start start 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff21b8e9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff21415c160 0x7ff21415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff21b8e9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140cb130 con 0x7ff2140b0c20 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff21b8e9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21415b680 con 0x7ff21415acb0 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff21b8e9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21415bd40 con 0x7ff21415c160 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff218e84640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff2140b0c20 0x7ff2140ca490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39398/0 (socket says 172.21.15.2:39398) 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff218e84640 1 -- 172.21.15.2:0/1835335345 learned_addr learned my addr 172.21.15.2:0/1835335345 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219e86640 1 --2- 172.21.15.2:0/1835335345 >> v2:172.21.15.90:3300/0 conn(0x7ff21415c160 0x7ff21415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905864766 0 0) 0x7ff2140cb130 con 0x7ff2140b0c20 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff200003530 con 0x7ff2140b0c20 2023-11-04T01:45:28.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 178670800 0 0) 0x7ff200003530 con 0x7ff2140b0c20 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 >> v2:172.21.15.90:3300/0 conn(0x7ff21415c160 msgr2=0x7ff21415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 --2- 172.21.15.2:0/1835335345 >> v2:172.21.15.90:3300/0 conn(0x7ff21415c160 0x7ff21415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 >> v1:172.21.15.90:6789/0 conn(0x7ff21415acb0 legacy=0x7ff2140b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21415b960 con 0x7ff2140b0c20 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff204001680 con 0x7ff2140b0c20 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 >> v1:172.21.15.2:6789/0 conn(0x7ff2140b0c20 legacy=0x7ff2140ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff200003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff200005190 0x7ff20000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21415bd40 con 0x7ff200003980 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000c030 con 0x7ff200005190 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000c1f0 con 0x7ff2000047d0 2023-11-04T01:45:28.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219685640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff200003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219e86640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff200005190 0x7ff20000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff218e84640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219685640 1 -- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2000047d0 msgr2=0x7ff200004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219685640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219685640 1 -- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff200005190 msgr2=0x7ff20000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219685640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff200005190 0x7ff20000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219685640 1 -- 172.21.15.2:0/1835335345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200003530 con 0x7ff200003980 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff219e86640 1 -- 172.21.15.2:0/1835335345 reap_dead start 2023-11-04T01:45:28.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.734+0000 7ff218e84640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:28.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff219685640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff200003da0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff210001e70 tx=0x7ff21001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e025de0e2b97121a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100a7070 con 0x7ff200003980 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210003980 con 0x7ff200003980 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff20bfff640 1 -- 172.21.15.2:0/1835335345 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210003d30 con 0x7ff200003980 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 -- 172.21.15.2:0/1835335345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 msgr2=0x7ff200003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff200003da0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7ff210001e70 tx=0x7ff21001c740 comp rx=0 tx=0).stop 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 -- 172.21.15.2:0/1835335345 shutdown_connections 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/1835335345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff200003da0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 -- 172.21.15.2:0/1835335345 >> 172.21.15.2:0/1835335345 conn(0x7ff2140cb510 msgr2=0x7ff2140cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 -- 172.21.15.2:0/1835335345 shutdown_connections 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 -- 172.21.15.2:0/1835335345 wait complete. 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 Processor -- start 2023-11-04T01:45:28.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.738+0000 7ff21b8e9640 1 -- start start 2023-11-04T01:45:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff21415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff21414ed90 0x7ff21414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff214157d20 0x7ff2141581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141586e0 con 0x7ff200003980 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21406c240 con 0x7ff214157d20 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21406b630 con 0x7ff21414ed90 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff21415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff21415ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45722/0 (socket says 172.21.15.2:45722) 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 -- 172.21.15.2:0/2921818222 learned_addr learned my addr 172.21.15.2:0/2921818222 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219e86640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff214157d20 0x7ff2141581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff218e84640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff21414ed90 0x7ff21414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 -- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff21414ed90 msgr2=0x7ff21414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff21414ed90 0x7ff21414f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 -- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff214157d20 msgr2=0x7ff2141581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff214157d20 0x7ff2141581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 -- 172.21.15.2:0/2921818222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21406b910 con 0x7ff200003980 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff219685640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff21415ed60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff210000f90 tx=0x7ff200005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff209ffb640 1 -- 172.21.15.2:0/2921818222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100054e0 con 0x7ff200003980 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff209ffb640 1 -- 172.21.15.2:0/2921818222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210005640 con 0x7ff200003980 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21406bbf0 con 0x7ff200003980 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff209ffb640 1 -- 172.21.15.2:0/2921818222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210007040 con 0x7ff200003980 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21406b300 con 0x7ff200003980 2023-11-04T01:45:28.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2140ad4e0 con 0x7ff200003980 2023-11-04T01:45:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff209ffb640 1 -- 172.21.15.2:0/2921818222 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2100b2040 con 0x7ff200003980 2023-11-04T01:45:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff209ffb640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1f80664a0 0x7ff1f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff209ffb640 1 -- 172.21.15.2:0/2921818222 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7ff21011cae0 con 0x7ff200003980 2023-11-04T01:45:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.742+0000 7ff218e84640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1f80664a0 0x7ff1f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:28.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.746+0000 7ff218e84640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1f80664a0 0x7ff1f8068960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff2140c5b10 tx=0x7ff204009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:28.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.746+0000 7ff209ffb640 1 -- 172.21.15.2:0/2921818222 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2100e9f10 con 0x7ff200003980 2023-11-04T01:45:28.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.902+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff2140ad4e0 con 0x7ff200003980 2023-11-04T01:45:28.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.910+0000 7ff209ffb640 1 -- 172.21.15.2:0/2921818222 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v19)=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff2140ad4e0 con 0x7ff200003980 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1f80664a0 msgr2=0x7ff1f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1f80664a0 0x7ff1f8068960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff2140c5b10 tx=0x7ff204009040 comp rx=0 tx=0).stop 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 msgr2=0x7ff21415ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff21415ed60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7ff210000f90 tx=0x7ff200005800 comp rx=0 tx=0).stop 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 shutdown_connections 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff1f80664a0 0x7ff1f8068960 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff214157d20 0x7ff2141581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff21414ed90 0x7ff21414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 --2- 172.21.15.2:0/2921818222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff200003980 0x7ff21415ed60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 >> 172.21.15.2:0/2921818222 conn(0x7ff2140cb510 msgr2=0x7ff21415fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 shutdown_connections 2023-11-04T01:45:28.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:28.914+0000 7ff21b8e9640 1 -- 172.21.15.2:0/2921818222 wait complete. 2023-11-04T01:45:28.933 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:45:28.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:45:28.968 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:45:29.024 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:45:29.024 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:45:29.024 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:29.030 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:45:29.030 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:45:29.030 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:29.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:45:29.035 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:45:29.035 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:29.075 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:45:29.076 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:45:29.076 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:45:29.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:45:29.083 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-04T01:45:29.083 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:29.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.242+0000 7fe89b73d640 1 Processor -- start 2023-11-04T01:45:29.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.242+0000 7fe89b73d640 1 -- start start 2023-11-04T01:45:29.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe89b73d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 0x7fe89406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe89b73d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe89406f8f0 0x7fe8940b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe89b73d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940cd400 con 0x7fe89415d2b0 2023-11-04T01:45:29.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe89b73d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940ad450 con 0x7fe89406f8f0 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe89b73d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940cd6e0 con 0x7fe89415d690 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe8994d9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe89415d2b0 0x7fe8940ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39406/0 (socket says 172.21.15.2:39406) 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe8994d9640 1 -- 172.21.15.2:0/3461434583 learned_addr learned my addr 172.21.15.2:0/3461434583 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe898cd8640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 0x7fe89406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe899cda640 1 --2- 172.21.15.2:0/3461434583 >> v2:172.21.15.90:3300/0 conn(0x7fe89406f8f0 0x7fe8940b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351917619 0 0) 0x7fe8940cd400 con 0x7fe89415d2b0 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe87c003530 con 0x7fe89415d2b0 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536268123 0 0) 0x7fe87c003530 con 0x7fe89415d2b0 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 msgr2=0x7fe89406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 0x7fe89406c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 >> v2:172.21.15.90:3300/0 conn(0x7fe89406f8f0 msgr2=0x7fe8940b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 --2- 172.21.15.2:0/3461434583 >> v2:172.21.15.90:3300/0 conn(0x7fe89406f8f0 0x7fe8940b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940ad070 con 0x7fe89415d2b0 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fe88c001a00 con 0x7fe89415d2b0 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 >> v1:172.21.15.2:6789/0 conn(0x7fe89415d2b0 legacy=0x7fe8940ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe87c003980 0x7fe87c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c0047d0 0x7fe87c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 0x7fe87c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940ad450 con 0x7fe87c0047d0 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940cd6e0 con 0x7fe87c003980 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87c00b990 con 0x7fe89415d690 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe898cd8640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c0047d0 0x7fe87c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe8994d9640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe87c003980 0x7fe87c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe899cda640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 0x7fe87c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe898cd8640 1 -- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 msgr2=0x7fe87c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe898cd8640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 0x7fe87c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe898cd8640 1 -- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe87c003980 msgr2=0x7fe87c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe898cd8640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe87c003980 0x7fe87c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe898cd8640 1 -- 172.21.15.2:0/3461434583 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c003530 con 0x7fe87c0047d0 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe8994d9640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe87c003980 0x7fe87c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:29.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.246+0000 7fe899cda640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe89415d690 0x7fe87c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe898cd8640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c0047d0 0x7fe87c004c50 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe888009ae0 tx=0x7fe88801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e801a207e666ae6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880a6430 con 0x7fe87c0047d0 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8880a6590 con 0x7fe87c0047d0 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe893fff640 1 -- 172.21.15.2:0/3461434583 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8880a6940 con 0x7fe87c0047d0 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- 172.21.15.2:0/3461434583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c0047d0 msgr2=0x7fe87c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 --2- 172.21.15.2:0/3461434583 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe87c0047d0 0x7fe87c004c50 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fe888009ae0 tx=0x7fe88801c9c0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe899cda640 1 -- 172.21.15.2:0/3461434583 reap_dead start 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- 172.21.15.2:0/3461434583 shutdown_connections 2023-11-04T01:45:29.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- 172.21.15.2:0/3461434583 >> 172.21.15.2:0/3461434583 conn(0x7fe8940cebb0 msgr2=0x7fe8940cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- 172.21.15.2:0/3461434583 shutdown_connections 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- 172.21.15.2:0/3461434583 wait complete. 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 Processor -- start 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- start start 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe87c0047d0 0x7fe8940af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe894153d40 0x7fe8940afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8941eb0a0 0x7fe8941eb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941ec140 con 0x7fe8941eb0a0 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe894155dc0 con 0x7fe894153d40 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe89b73d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941ebe60 con 0x7fe87c0047d0 2023-11-04T01:45:29.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe899cda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8941eb0a0 0x7fe8941eb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe899cda640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8941eb0a0 0x7fe8941eb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45742/0 (socket says 172.21.15.2:45742) 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe899cda640 1 -- 172.21.15.2:0/2159758820 learned_addr learned my addr 172.21.15.2:0/2159758820 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe8994d9640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe87c0047d0 0x7fe8940af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.250+0000 7fe898cd8640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe894153d40 0x7fe8940afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe899cda640 1 -- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe87c0047d0 msgr2=0x7fe8940af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe899cda640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe87c0047d0 0x7fe8940af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe899cda640 1 -- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe894153d40 msgr2=0x7fe8940afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe899cda640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe894153d40 0x7fe8940afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe899cda640 1 -- 172.21.15.2:0/2159758820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89406fee0 con 0x7fe8941eb0a0 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe899cda640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8941eb0a0 0x7fe8941eb520 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe8940b16c0 tx=0x7fe884011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe891ffb640 1 -- 172.21.15.2:0/2159758820 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884004230 con 0x7fe8941eb0a0 2023-11-04T01:45:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe891ffb640 1 -- 172.21.15.2:0/2159758820 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8840043b0 con 0x7fe8941eb0a0 2023-11-04T01:45:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe894156060 con 0x7fe8941eb0a0 2023-11-04T01:45:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe891ffb640 1 -- 172.21.15.2:0/2159758820 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884015970 con 0x7fe8941eb0a0 2023-11-04T01:45:29.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8941eba60 con 0x7fe8941eb0a0 2023-11-04T01:45:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe894155c20 con 0x7fe8941eb0a0 2023-11-04T01:45:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe891ffb640 1 -- 172.21.15.2:0/2159758820 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe884015ad0 con 0x7fe8941eb0a0 2023-11-04T01:45:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe891ffb640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe8800664d0 0x7fe880068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe891ffb640 1 -- 172.21.15.2:0/2159758820 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fe884083ab0 con 0x7fe8941eb0a0 2023-11-04T01:45:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe8994d9640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe8800664d0 0x7fe880068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.254+0000 7fe8994d9640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe8800664d0 0x7fe880068990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe894070c00 tx=0x7fe88c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.258+0000 7fe891ffb640 1 -- 172.21.15.2:0/2159758820 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe894155c20 con 0x7fe8941eb0a0 2023-11-04T01:45:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.446+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe894155c20 con 0x7fe8941eb0a0 2023-11-04T01:45:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.446+0000 7fe891ffb640 1 -- 172.21.15.2:0/2159758820 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3690 (secure 0 0 0) 0x7fe894155c20 con 0x7fe8941eb0a0 2023-11-04T01:45:29.450 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:29.450 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2587728633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2587728633},{"type":"v1","addr":"172.21.15.90:6835","nonce":2587728633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":5848,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1649859495","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1649859495},{"type":"v1","addr":"172.21.15.90:6837","nonce":1649859495}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6660,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/821298795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":821298795},{"type":"v1","addr":"172.21.15.2:6833","nonce":821298795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/1371690425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1371690425},{"type":"v1","addr":"172.21.15.2:6835","nonce":1371690425}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29}],"filesystems":[]} 2023-11-04T01:45:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 38 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe8800664d0 msgr2=0x7fe880068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe8800664d0 0x7fe880068990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe894070c00 tx=0x7fe88c009040 comp rx=0 tx=0).stop 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8941eb0a0 msgr2=0x7fe8941eb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8941eb0a0 0x7fe8941eb520 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe8940b16c0 tx=0x7fe884011920 comp rx=0 tx=0).stop 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 shutdown_connections 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe8800664d0 0x7fe880068990 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8941eb0a0 0x7fe8941eb520 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe894153d40 0x7fe8940afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 --2- 172.21.15.2:0/2159758820 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe87c0047d0 0x7fe8940af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 >> 172.21.15.2:0/2159758820 conn(0x7fe8940cebb0 msgr2=0x7fe894162be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:29.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 shutdown_connections 2023-11-04T01:45:29.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.450+0000 7fe89b73d640 1 -- 172.21.15.2:0/2159758820 wait complete. 2023-11-04T01:45:29.469 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:45:29.469 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:45:29.469 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:45:29.470 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:29.470 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:45:29.470 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:45:29.470 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:45:29.470 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:29.470 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-04T01:45:29.471 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-04T01:45:29.471 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T01:45:29.471 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:29.471 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:45:29.471 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:45:29.471 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:45:29.471 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:45:29.479 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:45:29.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:45:29.480 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:45:29.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:45:29.484 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:45:29.485 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:45:29.486 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T01:45:29.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-04T01:45:29.525 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:45:29.525 DEBUG:teuthology.parallel:result is None 2023-11-04T01:45:29.525 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:45:29.526 DEBUG:teuthology.parallel:result is None 2023-11-04T01:45:29.527 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:45:29.527 DEBUG:teuthology.parallel:result is None 2023-11-04T01:45:29.528 INFO:tasks.ceph.mds.b:Started 2023-11-04T01:45:29.529 DEBUG:teuthology.parallel:result is None 2023-11-04T01:45:29.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-04T01:45:29.583 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:45:29.588 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:45:29.599 INFO:tasks.ceph.mds.b.smithi090.stdout:starting mds.b at 2023-11-04T01:45:29.599 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:45:29.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc79083e640 1 Processor -- start 2023-11-04T01:45:29.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc79083e640 1 -- start start 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc79083e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 0x7fc78c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc79083e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc78c15cd60 0x7fc78c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc79083e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0cdc80 con 0x7fc78c0b1960 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc79083e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c071e40 con 0x7fc78c15cd60 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc79083e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c15d730 con 0x7fc78c0b1d40 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc78c0b1960 0x7fc78c0ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39422/0 (socket says 172.21.15.2:39422) 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78a59c640 1 -- 172.21.15.2:0/1140599307 learned_addr learned my addr 172.21.15.2:0/1140599307 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc789d9b640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 0x7fc78c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824062537 0 0) 0x7fc78c0cdc80 con 0x7fc78c0b1960 2023-11-04T01:45:29.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc778003530 con 0x7fc78c0b1960 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/1140599307 >> v2:172.21.15.90:3300/0 conn(0x7fc78c15cd60 0x7fc78c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3085697437 0 0) 0x7fc778003530 con 0x7fc78c0b1960 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 msgr2=0x7fc78c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 0x7fc78c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 >> v2:172.21.15.90:3300/0 conn(0x7fc78c15cd60 msgr2=0x7fc78c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 --2- 172.21.15.2:0/1140599307 >> v2:172.21.15.90:3300/0 conn(0x7fc78c15cd60 0x7fc78c15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0cf5a0 con 0x7fc78c0b1960 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc77c0016a0 con 0x7fc78c0b1960 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 >> v1:172.21.15.2:6789/0 conn(0x7fc78c0b1960 legacy=0x7fc78c0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 0x7fc778003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc778003f00 0x7fc7780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc778004d10 0x7fc778005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c071e40 con 0x7fc778004d10 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c15d730 con 0x7fc778003f00 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77800b990 con 0x7fc78c0b1d40 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc778004d10 0x7fc778005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc789d9b640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc778003f00 0x7fc7780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78a59c640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 0x7fc778003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78ad9d640 1 -- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 msgr2=0x7fc778003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0b1d40 0x7fc778003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78ad9d640 1 -- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc778003f00 msgr2=0x7fc7780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc778003f00 0x7fc7780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.638+0000 7fc78ad9d640 1 -- 172.21.15.2:0/1140599307 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778003530 con 0x7fc778004d10 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc778004d10 0x7fc778005190 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc784009fc0 tx=0x7fc78401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169f2a2a7c9648a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840a5cb0 con 0x7fc778004d10 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400f040 con 0x7fc778004d10 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc78959a640 1 -- 172.21.15.2:0/1140599307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840ad680 con 0x7fc778004d10 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- 172.21.15.2:0/1140599307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc778004d10 msgr2=0x7fc778005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 --2- 172.21.15.2:0/1140599307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc778004d10 0x7fc778005190 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc784009fc0 tx=0x7fc78401cc40 comp rx=0 tx=0).stop 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc78ad9d640 1 -- 172.21.15.2:0/1140599307 reap_dead start 2023-11-04T01:45:29.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- 172.21.15.2:0/1140599307 shutdown_connections 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- 172.21.15.2:0/1140599307 >> 172.21.15.2:0/1140599307 conn(0x7fc78c06e760 msgr2=0x7fc78c06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- 172.21.15.2:0/1140599307 shutdown_connections 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- 172.21.15.2:0/1140599307 wait complete. 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 Processor -- start 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- start start 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc778004d10 0x7fc78c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c0c7360 0x7fc78c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c15f6b0 0x7fc78c0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c15ed50 con 0x7fc78c0c7360 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c06f600 con 0x7fc78c15f6b0 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c1596c0 con 0x7fc778004d10 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c0c7360 0x7fc78c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c0c7360 0x7fc78c15f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45796/0 (socket says 172.21.15.2:45796) 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 -- 172.21.15.2:0/2754560334 learned_addr learned my addr 172.21.15.2:0/2754560334 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc78ad9d640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c15f6b0 0x7fc78c0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc78a59c640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc778004d10 0x7fc78c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 -- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc778004d10 msgr2=0x7fc78c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc778004d10 0x7fc78c0c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 -- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c15f6b0 msgr2=0x7fc78c0b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c15f6b0 0x7fc78c0b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 -- 172.21.15.2:0/2754560334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c15e3b0 con 0x7fc78c0c7360 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc789d9b640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c0c7360 0x7fc78c15f170 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc774011960 tx=0x7fc774011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc782ffd640 1 -- 172.21.15.2:0/2754560334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400fa30 con 0x7fc78c0c7360 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc782ffd640 1 -- 172.21.15.2:0/2754560334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77400fb90 con 0x7fc78c0c7360 2023-11-04T01:45:29.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c15e690 con 0x7fc78c0c7360 2023-11-04T01:45:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc782ffd640 1 -- 172.21.15.2:0/2754560334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774014440 con 0x7fc78c0c7360 2023-11-04T01:45:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.642+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c15fb30 con 0x7fc78c0c7360 2023-11-04T01:45:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.646+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c15ee90 con 0x7fc78c0c7360 2023-11-04T01:45:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.646+0000 7fc782ffd640 1 -- 172.21.15.2:0/2754560334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc7740145a0 con 0x7fc78c0c7360 2023-11-04T01:45:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.646+0000 7fc782ffd640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc76c0664d0 0x7fc76c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.646+0000 7fc782ffd640 1 -- 172.21.15.2:0/2754560334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6006+0+0 (secure 0 0 0) 0x7fc774084990 con 0x7fc78c0c7360 2023-11-04T01:45:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.646+0000 7fc78a59c640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc76c0664d0 0x7fc76c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.646+0000 7fc78a59c640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc76c0664d0 0x7fc76c068990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0cde10 tx=0x7fc77c007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.650+0000 7fc782ffd640 1 -- 172.21.15.2:0/2754560334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc774051d50 con 0x7fc78c0c7360 2023-11-04T01:45:29.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:29.810+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc78c15ee90 con 0x7fc78c0c7360 2023-11-04T01:45:30.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.618+0000 7fc782ffd640 1 -- 172.21.15.2:0/2754560334 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc78c15ee90 con 0x7fc78c0c7360 2023-11-04T01:45:30.621 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-04T01:45:30.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc76c0664d0 msgr2=0x7fc76c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:30.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc76c0664d0 0x7fc76c068990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0cde10 tx=0x7fc77c007900 comp rx=0 tx=0).stop 2023-11-04T01:45:30.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c0c7360 msgr2=0x7fc78c15f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c0c7360 0x7fc78c15f170 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc774011960 tx=0x7fc774011d60 comp rx=0 tx=0).stop 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 shutdown_connections 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc76c0664d0 0x7fc76c068990 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c15f6b0 0x7fc78c0b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c0c7360 0x7fc78c15f170 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 --2- 172.21.15.2:0/2754560334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc778004d10 0x7fc78c0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 >> 172.21.15.2:0/2754560334 conn(0x7fc78c06e760 msgr2=0x7fc78c0ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:30.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.622+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 shutdown_connections 2023-11-04T01:45:30.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.626+0000 7fc79083e640 1 -- 172.21.15.2:0/2754560334 wait complete. 2023-11-04T01:45:30.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-04T01:45:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ae4beb640 1 Processor -- start 2023-11-04T01:45:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ae4beb640 1 -- start start 2023-11-04T01:45:30.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ae4beb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 0x7f3ae00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ae4beb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00b6070 con 0x7f3ae00b4990 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ae4beb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00b8ed0 con 0x7f3ae00d0ae0 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ae4beb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00d1ce0 con 0x7f3ae00d0690 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ade59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3ae00b4990 0x7f3ae00b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:39428/0 (socket says 172.21.15.2:39428) 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ade59c640 1 -- 172.21.15.2:0/1772687198 learned_addr learned my addr 172.21.15.2:0/1772687198 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 0x7f3ae00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325053731 0 0) 0x7f3ae00b6070 con 0x7f3ae00b4990 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac8003530 con 0x7f3ae00b4990 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 184169248 0 0) 0x7f3ac8003530 con 0x7f3ae00b4990 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 msgr2=0x7f3ae00b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 0x7f3ae00b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 >> v1:172.21.15.90:6789/0 conn(0x7f3ae00d0ae0 legacy=0x7f3ae00b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00d1fc0 con 0x7f3ae00b4990 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3ad0001680 con 0x7f3ae00b4990 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 >> v1:172.21.15.2:6789/0 conn(0x7f3ae00b4990 legacy=0x7f3ae00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac80039b0 0x7f3ac8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ac8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 0x7f3ac8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00d1ce0 con 0x7f3ac80047d0 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac800bad0 con 0x7f3ac80039b0 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac800bc90 con 0x7f3ae00d0690 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ac8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3ade59c640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac80039b0 0x7f3ac8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3aded9d640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 0x7f3ac8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3addd9b640 1 -- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 msgr2=0x7f3ac8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00d0690 0x7f3ac8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3addd9b640 1 -- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac80039b0 msgr2=0x7f3ac8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ac80039b0 0x7f3ac8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.774+0000 7f3addd9b640 1 -- 172.21.15.2:0/1772687198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8003530 con 0x7f3ac80047d0 2023-11-04T01:45:30.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ac8004c50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0067650 tx=0x7f3ad401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ead5ed975bac71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:30.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40a55c0 con 0x7f3ac80047d0 2023-11-04T01:45:30.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad40a5720 con 0x7f3ac80047d0 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3add59a640 1 -- 172.21.15.2:0/1772687198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40a5ad0 con 0x7f3ac80047d0 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1772687198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 msgr2=0x7f3ac8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 --2- 172.21.15.2:0/1772687198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ac8004c50 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0067650 tx=0x7f3ad401c9d0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3aded9d640 1 -- 172.21.15.2:0/1772687198 reap_dead start 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1772687198 shutdown_connections 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1772687198 >> 172.21.15.2:0/1772687198 conn(0x7f3ae00cf990 msgr2=0x7f3ae00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1772687198 shutdown_connections 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1772687198 wait complete. 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 Processor -- start 2023-11-04T01:45:30.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.778+0000 7f3ae4beb640 1 -- start start 2023-11-04T01:45:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ae01565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ae00ca9f0 0x7f3ae01f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00cae70 0x7f3ae01f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00c9fe0 con 0x7f3ac80047d0 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0156b20 con 0x7f3ae00ca9f0 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae01f3510 con 0x7f3ae00cae70 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ae01565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ae01565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45808/0 (socket says 172.21.15.2:45808) 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 -- 172.21.15.2:0/1899642609 learned_addr learned my addr 172.21.15.2:0/1899642609 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ae00ca9f0 0x7f3ae01f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aded9d640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00cae70 0x7f3ae01f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 -- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00cae70 msgr2=0x7f3ae01f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00cae70 0x7f3ae01f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 -- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ae00ca9f0 msgr2=0x7f3ae01f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ae00ca9f0 0x7f3ae01f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 -- 172.21.15.2:0/1899642609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae01f37f0 con 0x7f3ac80047d0 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aded9d640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00cae70 0x7f3ae01f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ae00ca9f0 0x7f3ae01f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ade59c640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ae01565e0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000e8f0 tx=0x7f3ad000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aceffd640 1 -- 172.21.15.2:0/1899642609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000c870 con 0x7f3ac80047d0 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aceffd640 1 -- 172.21.15.2:0/1899642609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad000c9d0 con 0x7f3ac80047d0 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aceffd640 1 -- 172.21.15.2:0/1899642609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad000cd80 con 0x7f3ac80047d0 2023-11-04T01:45:30.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae00ca1f0 con 0x7f3ac80047d0 2023-11-04T01:45:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae0159e40 con 0x7f3ac80047d0 2023-11-04T01:45:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae01f39e0 con 0x7f3ac80047d0 2023-11-04T01:45:30.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aceffd640 1 -- 172.21.15.2:0/1899642609 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ad001d460 con 0x7f3ac80047d0 2023-11-04T01:45:30.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aceffd640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ac00664d0 0x7f3ac0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:30.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3aceffd640 1 -- 172.21.15.2:0/1899642609 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f3ad0083f50 con 0x7f3ac80047d0 2023-11-04T01:45:30.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.782+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ac00664d0 0x7f3ac0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:30.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.786+0000 7f3addd9b640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ac00664d0 0x7f3ac0068990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40af000 tx=0x7f3ad40046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:30.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:30.786+0000 7f3aceffd640 1 -- 172.21.15.2:0/1899642609 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ad0051300 con 0x7f3ac80047d0 2023-11-04T01:45:31.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.002+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3ae00744a0 con 0x7f3ac80047d0 2023-11-04T01:45:31.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.002+0000 7f3aceffd640 1 -- 172.21.15.2:0/1899642609 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3ad0001620 con 0x7f3ac80047d0 2023-11-04T01:45:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:31.006 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:45:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-04T01:45:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.006 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlnFZCMBAAsgGcwY3jbh9F9NEVwbamwg==", 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDZRuAxAA6zx8mu5wQEvvcICXPTXZZQ==", 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.007 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlFSvMOBAA0k4I7A+4TRIrxBOwUdIZLw==", 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:45:31.008 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl/PDbCxAA+6y8He/9gQZa1vvdJH+iCg==", 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.009 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBIoUVlnpFvJBAAAyqa0u7D+cz+Gy4XpppWYQ==", 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBLoUVlObtjKhAAbf3wgZ9mpp8+pI1IGyIwdg==", 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.010 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBOoUVlOF4QMxAANdCz1HMyMGzyFpUv9xawYA==", 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.011 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBRoUVlMnFiOxAA2d7ZoQEhtXkAMhu0yPh4iw==", 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBYoUVlfe9FCBAA3oVMNubThpWJoxlqFzaAfg==", 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.012 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBboUVlTfGNEBAA2FNXiCKGJ2s4XeH+paqrNw==", 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.013 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBeoUVluX7oGBAAh+/toMBPGjq99EonfWEPtQ==", 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBhoUVlGhEAIhAAO8mqoIPekhVmAxnR1VKXeQ==", 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.014 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ==", 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow r", 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.015 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlDtmNGRAAFXXp/X0fnL9uuEIfj1Eadw==", 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVlPzfyFhAAbCRYmyHHFu2GDtyZOL2ISw==", 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.016 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHoUVl1jK2HhAAH1E38zcrKticBLLRR/8IuA==", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-04T01:45:31.017 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlCj8pFxAApTKY8a6VcYBWkCLKrKHorQ==", 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.018 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlcZ/jKhAAWDrmzYgapIV+SBRNrXWAjg==", 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBGoUVlhYtpKBAAn1snUSz1+SKC8frnVuvFdA==", 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-04T01:45:31.019 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-04T01:45:31.020 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-04T01:45:31.020 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.020 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:31.020 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-04T01:45:31.020 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ac00664d0 msgr2=0x7f3ac0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ac00664d0 0x7f3ac0068990 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40af000 tx=0x7f3ad40046d0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 msgr2=0x7f3ae01565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ae01565e0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000e8f0 tx=0x7f3ad000edb0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 shutdown_connections 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ac00664d0 0x7f3ac0068990 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3ae00cae70 0x7f3ae01f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3ae00ca9f0 0x7f3ae01f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 --2- 172.21.15.2:0/1899642609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ac80047d0 0x7f3ae01565e0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 >> 172.21.15.2:0/1899642609 conn(0x7f3ae00cf990 msgr2=0x7f3ae00b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 shutdown_connections 2023-11-04T01:45:31.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.006+0000 7f3ae4beb640 1 -- 172.21.15.2:0/1899642609 wait complete. 2023-11-04T01:45:31.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:31.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffac4fed640 1 Processor -- start 2023-11-04T01:45:31.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffac4fed640 1 -- start start 2023-11-04T01:45:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffac4fed640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffac00b4990 0x7ffac00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffac4fed640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffac00d0690 0x7ffac00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffac4fed640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac00b6070 con 0x7ffac00d0ae0 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffac4fed640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac00b8ed0 con 0x7ffac00b4990 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffac4fed640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac00b52b0 con 0x7ffac00d0690 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabe59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffac00b4990 0x7ffac00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabe59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffac00b4990 0x7ffac00b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45818/0 (socket says 172.21.15.2:45818) 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabe59c640 1 -- 172.21.15.2:0/992172862 learned_addr learned my addr 172.21.15.2:0/992172862 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabdd9b640 1 --2- 172.21.15.2:0/992172862 >> v2:172.21.15.90:3300/0 conn(0x7ffac00d0690 0x7ffac00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabe59c640 1 -- 172.21.15.2:0/992172862 >> v2:172.21.15.90:3300/0 conn(0x7ffac00d0690 msgr2=0x7ffac00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabe59c640 1 --2- 172.21.15.2:0/992172862 >> v2:172.21.15.90:3300/0 conn(0x7ffac00d0690 0x7ffac00cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabe59c640 1 -- 172.21.15.2:0/992172862 >> v1:172.21.15.90:6789/0 conn(0x7ffac00d0ae0 legacy=0x7ffac00cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabe59c640 1 -- 172.21.15.2:0/992172862 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00d1ce0 con 0x7ffac00b4990 2023-11-04T01:45:31.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.150+0000 7ffabdd9b640 1 --2- 172.21.15.2:0/992172862 >> v2:172.21.15.90:3300/0 conn(0x7ffac00d0690 0x7ffac00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:31.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffabe59c640 1 --2- 172.21.15.2:0/992172862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00b4990 0x7ffac00b4d70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ffac008c090 tx=0x7ffab001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21cd4831d172a58 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffabd59a640 1 -- 172.21.15.2:0/992172862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00a89b0 con 0x7ffac00b4990 2023-11-04T01:45:31.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffabd59a640 1 -- 172.21.15.2:0/992172862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab00a8b10 con 0x7ffac00b4990 2023-11-04T01:45:31.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffabd59a640 1 -- 172.21.15.2:0/992172862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00a8ea0 con 0x7ffac00b4990 2023-11-04T01:45:31.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 -- 172.21.15.2:0/992172862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00b4990 msgr2=0x7ffac00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 --2- 172.21.15.2:0/992172862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00b4990 0x7ffac00b4d70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ffac008c090 tx=0x7ffab001ecb0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 -- 172.21.15.2:0/992172862 shutdown_connections 2023-11-04T01:45:31.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 --2- 172.21.15.2:0/992172862 >> v2:172.21.15.90:3300/0 conn(0x7ffac00d0690 0x7ffac00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 --2- 172.21.15.2:0/992172862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00b4990 0x7ffac00b4d70 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 -- 172.21.15.2:0/992172862 >> 172.21.15.2:0/992172862 conn(0x7ffac00cf990 msgr2=0x7ffac00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:31.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 -- 172.21.15.2:0/992172862 shutdown_connections 2023-11-04T01:45:31.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.154+0000 7ffac4fed640 1 -- 172.21.15.2:0/992172862 wait complete. 2023-11-04T01:45:31.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 Processor -- start 2023-11-04T01:45:31.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 -- start start 2023-11-04T01:45:31.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffac00b4990 0x7ffac0160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00d0690 0x7ffac00cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffac00d0ae0 0x7ffac01f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00cc340 con 0x7ffac00d0690 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00cc620 con 0x7ffac00b4990 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00cc900 con 0x7ffac00d0ae0 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00d0690 0x7ffac00cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00d0690 0x7ffac00cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45820/0 (socket says 172.21.15.2:45820) 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 -- 172.21.15.2:0/567430343 learned_addr learned my addr 172.21.15.2:0/567430343 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabe59c640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffac00b4990 0x7ffac0160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 -- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffac00d0ae0 msgr2=0x7ffac01f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabed9d640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffac00d0ae0 0x7ffac01f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffac00d0ae0 0x7ffac01f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 -- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffac00b4990 msgr2=0x7ffac0160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffac00b4990 0x7ffac0160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 -- 172.21.15.2:0/567430343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00094d0 con 0x7ffac00d0690 2023-11-04T01:45:31.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffabdd9b640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00d0690 0x7ffac00cba40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c7f0 tx=0x7ffab400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffaaeffd640 1 -- 172.21.15.2:0/567430343 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4004220 con 0x7ffac00d0690 2023-11-04T01:45:31.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffaaeffd640 1 -- 172.21.15.2:0/567430343 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4004380 con 0x7ffac00d0690 2023-11-04T01:45:31.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac01e79b0 con 0x7ffac00d0690 2023-11-04T01:45:31.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffaaeffd640 1 -- 172.21.15.2:0/567430343 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4003840 con 0x7ffac00d0690 2023-11-04T01:45:31.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac00cbf80 con 0x7ffac00d0690 2023-11-04T01:45:31.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffaaeffd640 1 -- 172.21.15.2:0/567430343 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffab4003bb0 con 0x7ffac00d0690 2023-11-04T01:45:31.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac00744a0 con 0x7ffac00d0690 2023-11-04T01:45:31.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.158+0000 7ffaaeffd640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffaa00664a0 0x7ffaa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.162+0000 7ffaaeffd640 1 -- 172.21.15.2:0/567430343 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7ffab4083e50 con 0x7ffac00d0690 2023-11-04T01:45:31.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.162+0000 7ffabe59c640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffaa00664a0 0x7ffaa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.162+0000 7ffabe59c640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffaa00664a0 0x7ffaa0068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffab00b2000 tx=0x7ffab0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.166+0000 7ffaaeffd640 1 -- 172.21.15.2:0/567430343 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffab4051210 con 0x7ffac00d0690 2023-11-04T01:45:31.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.318+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffac00d0140 con 0x7ffac00d0690 2023-11-04T01:45:31.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.322+0000 7ffaaeffd640 1 -- 172.21.15.2:0/567430343 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18002 (secure 0 0 0) 0x7ffab4003e60 con 0x7ffac00d0690 2023-11-04T01:45:31.325 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:31.326 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":88,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:30.637265+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffaa00664a0 msgr2=0x7ffaa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffaa00664a0 0x7ffaa0068960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffab00b2000 tx=0x7ffab0008040 comp rx=0 tx=0).stop 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00d0690 msgr2=0x7ffac00cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00d0690 0x7ffac00cba40 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c7f0 tx=0x7ffab400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 shutdown_connections 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffaa00664a0 0x7ffaa0068960 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffac00d0ae0 0x7ffac01f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffac00d0690 0x7ffac00cba40 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 --2- 172.21.15.2:0/567430343 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffac00b4990 0x7ffac0160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 >> 172.21.15.2:0/567430343 conn(0x7ffac00cf990 msgr2=0x7ffac00b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 shutdown_connections 2023-11-04T01:45:31.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.326+0000 7ffac4fed640 1 -- 172.21.15.2:0/567430343 wait complete. 2023-11-04T01:45:31.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:45:31.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:45:31.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.474+0000 7f612539f640 1 Processor -- start 2023-11-04T01:45:31.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.474+0000 7f612539f640 1 -- start start 2023-11-04T01:45:31.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.474+0000 7f612539f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f612015ad90 0x7f61200b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.474+0000 7f612539f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612015f990 con 0x7f61200caca0 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f612539f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612015ec10 con 0x7f612015b170 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f612539f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612015f570 con 0x7f612015ad90 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f61200caca0 0x7f61200ad600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37148/0 (socket says 172.21.15.2:37148) 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611f7fe640 1 -- 172.21.15.2:0/3187936522 learned_addr learned my addr 172.21.15.2:0/3187936522 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f612015ad90 0x7f61200b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005978427 0 0) 0x7f61180014a0 con 0x7f61200caca0 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6108003530 con 0x7f61200caca0 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362929559 0 0) 0x7f6108003530 con 0x7f61200caca0 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f612015ad90 msgr2=0x7f61200b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f612015ad90 0x7f61200b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 >> v1:172.21.15.90:6789/0 conn(0x7f612015b170 legacy=0x7f61200ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200cd9a0 con 0x7f61200caca0 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f6118001b90 con 0x7f61200caca0 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 >> v1:172.21.15.2:6789/0 conn(0x7f61200caca0 legacy=0x7f61200ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61080039b0 0x7f6108003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6108004360 0x7f6108004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f612015ad90 0x7f6108005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612015f570 con 0x7f61080039b0 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610800ba40 con 0x7f6108004360 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610800bc00 con 0x7f612015ad90 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61080039b0 0x7f6108003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611e7fc640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6108004360 0x7f6108004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 -- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f612015ad90 msgr2=0x7f6108005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f612015ad90 0x7f6108005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 -- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6108004360 msgr2=0x7f6108004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:31.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6108004360 0x7f6108004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 -- 172.21.15.2:0/3187936522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6108003530 con 0x7f61080039b0 2023-11-04T01:45:31.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611e7fc640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6108004360 0x7f6108004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611effd640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61080039b0 0x7f6108003d90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6110009ae0 tx=0x7f611001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44ba35052722ce6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100a6470 con 0x7f61080039b0 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61100a65d0 con 0x7f61080039b0 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.478+0000 7f611dffb640 1 -- 172.21.15.2:0/3187936522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61100a6980 con 0x7f61080039b0 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- 172.21.15.2:0/3187936522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61080039b0 msgr2=0x7f6108003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 --2- 172.21.15.2:0/3187936522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61080039b0 0x7f6108003d90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6110009ae0 tx=0x7f611001ca90 comp rx=0 tx=0).stop 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 -- 172.21.15.2:0/3187936522 reap_dead start 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- 172.21.15.2:0/3187936522 shutdown_connections 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- 172.21.15.2:0/3187936522 >> 172.21.15.2:0/3187936522 conn(0x7f61200cb510 msgr2=0x7f61200cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- 172.21.15.2:0/3187936522 shutdown_connections 2023-11-04T01:45:31.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- 172.21.15.2:0/3187936522 wait complete. 2023-11-04T01:45:31.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 Processor -- start 2023-11-04T01:45:31.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- start start 2023-11-04T01:45:31.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6120165970 0x7f6120162df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61201501f0 0x7f61200c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6120159c20 0x7f612015a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612015a5e0 con 0x7f6120159c20 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200b2a90 con 0x7f6120165970 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61200c6cc0 con 0x7f61201501f0 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6120159c20 0x7f612015a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6120159c20 0x7f612015a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49998/0 (socket says 172.21.15.2:49998) 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 -- 172.21.15.2:0/1714295516 learned_addr learned my addr 172.21.15.2:0/1714295516 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611e7fc640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61201501f0 0x7f61200c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611effd640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6120165970 0x7f6120162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 -- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61201501f0 msgr2=0x7f61200c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61201501f0 0x7f61200c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 -- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6120165970 msgr2=0x7f6120162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6120165970 0x7f6120162df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 -- 172.21.15.2:0/1714295516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61200c6f60 con 0x7f6120159c20 2023-11-04T01:45:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611e7fc640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61201501f0 0x7f61200c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f611f7fe640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6120159c20 0x7f612015a0a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f61200cc380 tx=0x7f611800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f61077fe640 1 -- 172.21.15.2:0/1714295516 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6118004d70 con 0x7f6120159c20 2023-11-04T01:45:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f61077fe640 1 -- 172.21.15.2:0/1714295516 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800a5b0 con 0x7f6120159c20 2023-11-04T01:45:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61200b2440 con 0x7f6120159c20 2023-11-04T01:45:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f61077fe640 1 -- 172.21.15.2:0/1714295516 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800a960 con 0x7f6120159c20 2023-11-04T01:45:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.482+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6120165d50 con 0x7f6120159c20 2023-11-04T01:45:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.486+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61200744a0 con 0x7f6120159c20 2023-11-04T01:45:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.486+0000 7f61077fe640 1 -- 172.21.15.2:0/1714295516 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f611800aac0 con 0x7f6120159c20 2023-11-04T01:45:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.486+0000 7f61077fe640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f610c0664a0 0x7f610c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.486+0000 7f61077fe640 1 -- 172.21.15.2:0/1714295516 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f61180832b0 con 0x7f6120159c20 2023-11-04T01:45:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.486+0000 7f611effd640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f610c0664a0 0x7f610c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.486+0000 7f611effd640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f610c0664a0 0x7f610c068960 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f61100ad000 tx=0x7f61100b2040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.490+0000 7f61077fe640 1 -- 172.21.15.2:0/1714295516 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f61180507f0 con 0x7f6120159c20 2023-11-04T01:45:31.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.646+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f612015f990 con 0x7f6120159c20 2023-11-04T01:45:31.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.650+0000 7f61077fe640 1 -- 172.21.15.2:0/1714295516 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f612015f990 con 0x7f6120159c20 2023-11-04T01:45:31.653 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:45:31.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f610c0664a0 msgr2=0x7f610c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f610c0664a0 0x7f610c068960 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f61100ad000 tx=0x7f61100b2040 comp rx=0 tx=0).stop 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6120159c20 msgr2=0x7f612015a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6120159c20 0x7f612015a0a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f61200cc380 tx=0x7f611800cb90 comp rx=0 tx=0).stop 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 shutdown_connections 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f610c0664a0 0x7f610c068960 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6120159c20 0x7f612015a0a0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f61201501f0 0x7f61200c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 --2- 172.21.15.2:0/1714295516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6120165970 0x7f6120162df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 >> 172.21.15.2:0/1714295516 conn(0x7f61200cb510 msgr2=0x7f61200cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 shutdown_connections 2023-11-04T01:45:31.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.654+0000 7f612539f640 1 -- 172.21.15.2:0/1714295516 wait complete. 2023-11-04T01:45:31.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:45:31.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c9aaf640 1 Processor -- start 2023-11-04T01:45:31.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c9aaf640 1 -- start start 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c9aaf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42c4159f00 0x7f42c40719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c9aaf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4071250 0x7f42c40b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c9aaf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c40b3c10 con 0x7f42c406de30 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c9aaf640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40cdb70 con 0x7f42c4159f00 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c9aaf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40cde50 con 0x7f42c4071250 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42c4159f00 0x7f42c40719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c2ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f42c406de30 0x7f42c4070b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37160/0 (socket says 172.21.15.2:37160) 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c2ffd640 1 -- 172.21.15.2:0/3351031006 learned_addr learned my addr 172.21.15.2:0/3351031006 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c3fff640 1 --2- 172.21.15.2:0/3351031006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4071250 0x7f42c40b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c27fc640 1 -- 172.21.15.2:0/3351031006 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389119737 0 0) 0x7f42c40b3c10 con 0x7f42c406de30 2023-11-04T01:45:31.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c27fc640 1 -- 172.21.15.2:0/3351031006 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b0003530 con 0x7f42c406de30 2023-11-04T01:45:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c37fe640 1 -- 172.21.15.2:0/3351031006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4071250 msgr2=0x7f42c40b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c37fe640 1 --2- 172.21.15.2:0/3351031006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4071250 0x7f42c40b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c37fe640 1 -- 172.21.15.2:0/3351031006 >> v1:172.21.15.2:6789/0 conn(0x7f42c406de30 legacy=0x7f42c4070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.794+0000 7f42c37fe640 1 -- 172.21.15.2:0/3351031006 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c415a2e0 con 0x7f42c4159f00 2023-11-04T01:45:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c37fe640 1 --2- 172.21.15.2:0/3351031006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4159f00 0x7f42c40719e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0097c0 tx=0x7f42ac01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802a69b4405bf90a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c27fc640 1 -- 172.21.15.2:0/3351031006 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0ac620 con 0x7f42c4159f00 2023-11-04T01:45:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c27fc640 1 -- 172.21.15.2:0/3351031006 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac0ac780 con 0x7f42c4159f00 2023-11-04T01:45:31.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c27fc640 1 -- 172.21.15.2:0/3351031006 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0acaf0 con 0x7f42c4159f00 2023-11-04T01:45:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 -- 172.21.15.2:0/3351031006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4159f00 msgr2=0x7f42c40719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/3351031006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4159f00 0x7f42c40719e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0097c0 tx=0x7f42ac01c3c0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 -- 172.21.15.2:0/3351031006 shutdown_connections 2023-11-04T01:45:31.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/3351031006 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4071250 0x7f42c40b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/3351031006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4159f00 0x7f42c40719e0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 -- 172.21.15.2:0/3351031006 >> 172.21.15.2:0/3351031006 conn(0x7f42c40cfc70 msgr2=0x7f42c40d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 -- 172.21.15.2:0/3351031006 shutdown_connections 2023-11-04T01:45:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 -- 172.21.15.2:0/3351031006 wait complete. 2023-11-04T01:45:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 Processor -- start 2023-11-04T01:45:31.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.798+0000 7f42c9aaf640 1 -- start start 2023-11-04T01:45:31.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42c4071250 0x7f42c40b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4159f00 0x7f42c4143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4147120 0x7f42c41475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4145440 con 0x7f42c4147120 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40b5420 con 0x7f42c4071250 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40b5700 con 0x7f42c4159f00 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4147120 0x7f42c41475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4147120 0x7f42c41475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50026/0 (socket says 172.21.15.2:50026) 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 -- 172.21.15.2:0/4143212685 learned_addr learned my addr 172.21.15.2:0/4143212685 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c37fe640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42c4071250 0x7f42c40b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c2ffd640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4159f00 0x7f42c4143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 -- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4159f00 msgr2=0x7f42c4143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4159f00 0x7f42c4143e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 -- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42c4071250 msgr2=0x7f42c40b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42c4071250 0x7f42c40b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 -- 172.21.15.2:0/4143212685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009420 con 0x7f42c4147120 2023-11-04T01:45:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c37fe640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42c4071250 0x7f42c40b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:31.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c3fff640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4147120 0x7f42c41475d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007de0 tx=0x7f42bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42bbfff640 1 -- 172.21.15.2:0/4143212685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc014620 con 0x7f42c4147120 2023-11-04T01:45:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42bbfff640 1 -- 172.21.15.2:0/4143212685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc00ee90 con 0x7f42c4147120 2023-11-04T01:45:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c40b59e0 con 0x7f42c4147120 2023-11-04T01:45:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42bbfff640 1 -- 172.21.15.2:0/4143212685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0149e0 con 0x7f42c4147120 2023-11-04T01:45:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c415a500 con 0x7f42c4147120 2023-11-04T01:45:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c41455f0 con 0x7f42c4147120 2023-11-04T01:45:31.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42bbfff640 1 -- 172.21.15.2:0/4143212685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f42bc014b40 con 0x7f42c4147120 2023-11-04T01:45:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42bbfff640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42a40664a0 0x7f42a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42bbfff640 1 -- 172.21.15.2:0/4143212685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f42bc084a30 con 0x7f42c4147120 2023-11-04T01:45:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.802+0000 7f42c37fe640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42a40664a0 0x7f42a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:31.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.806+0000 7f42c37fe640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42a40664a0 0x7f42a4068960 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0ae000 tx=0x7f42ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:31.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.806+0000 7f42bbfff640 1 -- 172.21.15.2:0/4143212685 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42c41455f0 con 0x7f42c4147120 2023-11-04T01:45:31.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f42c40675f0 con 0x7f42c4147120 2023-11-04T01:45:31.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42bbfff640 1 -- 172.21.15.2:0/4143212685 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f42bc051d50 con 0x7f42c4147120 2023-11-04T01:45:31.960 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:31.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42a40664a0 msgr2=0x7f42a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42a40664a0 0x7f42a4068960 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0ae000 tx=0x7f42ac008040 comp rx=0 tx=0).stop 2023-11-04T01:45:31.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4147120 msgr2=0x7f42c41475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:31.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4147120 0x7f42c41475d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007de0 tx=0x7f42bc00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 shutdown_connections 2023-11-04T01:45:31.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42a40664a0 0x7f42a4068960 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42c4147120 0x7f42c41475d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42c4159f00 0x7f42c4143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 --2- 172.21.15.2:0/4143212685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42c4071250 0x7f42c40b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:31.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 >> 172.21.15.2:0/4143212685 conn(0x7f42c40cfc70 msgr2=0x7f42c406a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:31.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 shutdown_connections 2023-11-04T01:45:31.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:31.958+0000 7f42c9aaf640 1 -- 172.21.15.2:0/4143212685 wait complete. 2023-11-04T01:45:31.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:45:32.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff8a41640 1 Processor -- start 2023-11-04T01:45:32.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff8a41640 1 -- start start 2023-11-04T01:45:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff8a41640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7ff415d0b0 0x7f7ff4160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff8a41640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff41610f0 0x7f7ff40cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff8a41640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff40b5e00 con 0x7f7ff40cfd50 2023-11-04T01:45:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff8a41640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff40d1520 con 0x7f7ff415d0b0 2023-11-04T01:45:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff8a41640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40d01e0 con 0x7f7ff41610f0 2023-11-04T01:45:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff2d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7ff40cfd50 0x7f7ff40b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37172/0 (socket says 172.21.15.2:37172) 2023-11-04T01:45:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff2d9d640 1 -- 172.21.15.2:0/29266712 learned_addr learned my addr 172.21.15.2:0/29266712 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff259c640 1 --2- 172.21.15.2:0/29266712 >> v2:172.21.15.90:3300/0 conn(0x7f7ff415d0b0 0x7f7ff4160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff41610f0 0x7f7ff40cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343429159 0 0) 0x7f7ff40b5e00 con 0x7f7ff40cfd50 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fdc003530 con 0x7f7ff40cfd50 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1555820684 0 0) 0x7f7fdc003530 con 0x7f7ff40cfd50 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff41610f0 msgr2=0x7f7ff40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff41610f0 0x7f7ff40cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 >> v2:172.21.15.90:3300/0 conn(0x7f7ff415d0b0 msgr2=0x7f7ff4160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 --2- 172.21.15.2:0/29266712 >> v2:172.21.15.90:3300/0 conn(0x7f7ff415d0b0 0x7f7ff4160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff415d490 con 0x7f7ff40cfd50 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f7fec001a00 con 0x7f7ff40cfd50 2023-11-04T01:45:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 >> v1:172.21.15.2:6789/0 conn(0x7f7ff40cfd50 legacy=0x7f7ff40b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff41610f0 0x7f7fdc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7fdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fdc004d10 0x7f7fdc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40d1520 con 0x7f7fdc003f00 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40d01e0 con 0x7f7fdc004d10 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc00b990 con 0x7f7ff41610f0 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7fdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff1d9b640 1 -- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff41610f0 msgr2=0x7f7fdc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff41610f0 0x7f7fdc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff1d9b640 1 -- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fdc004d10 msgr2=0x7f7fdc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7fdc004d10 0x7f7fdc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.090+0000 7f7ff1d9b640 1 -- 172.21.15.2:0/29266712 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc003530 con 0x7f7fdc003f00 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7fdc0047d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009ae0 tx=0x7f7fe801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e7e03066c15152 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80a5680 con 0x7f7fdc003f00 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe80a57e0 con 0x7f7fdc003f00 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff159a640 1 -- 172.21.15.2:0/29266712 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80a5b90 con 0x7f7fdc003f00 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- 172.21.15.2:0/29266712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 msgr2=0x7f7fdc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 --2- 172.21.15.2:0/29266712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7fdc0047d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009ae0 tx=0x7f7fe801ca30 comp rx=0 tx=0).stop 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff2d9d640 1 -- 172.21.15.2:0/29266712 reap_dead start 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- 172.21.15.2:0/29266712 shutdown_connections 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- 172.21.15.2:0/29266712 >> 172.21.15.2:0/29266712 conn(0x7f7ff406a890 msgr2=0x7f7ff406aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- 172.21.15.2:0/29266712 shutdown_connections 2023-11-04T01:45:32.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- 172.21.15.2:0/29266712 wait complete. 2023-11-04T01:45:32.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 Processor -- start 2023-11-04T01:45:32.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- start start 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7ff4150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ff4151cb0 0x7f7ff415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff415f5a0 0x7f7ff40cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff415fa20 con 0x7f7fdc003f00 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40b2880 con 0x7f7ff4151cb0 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff8a41640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40b3400 con 0x7f7ff415f5a0 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7ff4150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7ff4150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50042/0 (socket says 172.21.15.2:50042) 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 -- 172.21.15.2:0/3424686499 learned_addr learned my addr 172.21.15.2:0/3424686499 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ff4151cb0 0x7f7ff415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff2d9d640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff415f5a0 0x7f7ff40cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 -- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff415f5a0 msgr2=0x7f7ff40cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff415f5a0 0x7f7ff40cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 -- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ff4151cb0 msgr2=0x7f7ff415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ff4151cb0 0x7f7ff415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 -- 172.21.15.2:0/3424686499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff40b2ad0 con 0x7f7fdc003f00 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ff4151cb0 0x7f7ff415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.094+0000 7f7ff259c640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7ff4150980 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400e840 tx=0x7f7fe400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7fe2ffd640 1 -- 172.21.15.2:0/3424686499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4009620 con 0x7f7fdc003f00 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7fe2ffd640 1 -- 172.21.15.2:0/3424686499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400c940 con 0x7f7fdc003f00 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff40b2db0 con 0x7f7fdc003f00 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7fe2ffd640 1 -- 172.21.15.2:0/3424686499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400ccf0 con 0x7f7fdc003f00 2023-11-04T01:45:32.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff4150ec0 con 0x7f7fdc003f00 2023-11-04T01:45:32.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff40744a0 con 0x7f7fdc003f00 2023-11-04T01:45:32.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7fe2ffd640 1 -- 172.21.15.2:0/3424686499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7fe4013470 con 0x7f7fdc003f00 2023-11-04T01:45:32.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7fe2ffd640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7fd40664a0 0x7f7fd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7fe2ffd640 1 -- 172.21.15.2:0/3424686499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f7fe4084090 con 0x7f7fdc003f00 2023-11-04T01:45:32.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7fd40664a0 0x7f7fd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.098+0000 7f7ff1d9b640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7fd40664a0 0x7f7fd4068960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80af000 tx=0x7f7fe80046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.102+0000 7f7fe2ffd640 1 -- 172.21.15.2:0/3424686499 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7fe4054ed0 con 0x7f7fdc003f00 2023-11-04T01:45:32.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.254+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f7ff40d0a10 con 0x7f7fdc003f00 2023-11-04T01:45:32.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.254+0000 7f7fe2ffd640 1 -- 172.21.15.2:0/3424686499 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v88) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7fe4054a60 con 0x7f7fdc003f00 2023-11-04T01:45:32.259 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:32.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7fd40664a0 msgr2=0x7f7fd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7fd40664a0 0x7f7fd4068960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7fe80af000 tx=0x7f7fe80046d0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 msgr2=0x7f7ff4150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7ff4150980 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400e840 tx=0x7f7fe400ed00 comp rx=0 tx=0).stop 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 shutdown_connections 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7fd40664a0 0x7f7fd4068960 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7ff415f5a0 0x7f7ff40cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ff4151cb0 0x7f7ff415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 --2- 172.21.15.2:0/3424686499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7fdc003f00 0x7f7ff4150980 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 >> 172.21.15.2:0/3424686499 conn(0x7f7ff406a890 msgr2=0x7f7ff40cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 shutdown_connections 2023-11-04T01:45:32.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.258+0000 7f7ff8a41640 1 -- 172.21.15.2:0/3424686499 wait complete. 2023-11-04T01:45:32.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:45:32.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.390+0000 7f259b379640 1 Processor -- start 2023-11-04T01:45:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.390+0000 7f259b379640 1 -- start start 2023-11-04T01:45:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f259b379640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f259406a3c0 0x7f259406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f259b379640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f259b379640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2594160b50 con 0x7f2594071a50 2023-11-04T01:45:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f259b379640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2594160e30 con 0x7f259406a3c0 2023-11-04T01:45:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f259b379640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594161110 con 0x7f259406a7a0 2023-11-04T01:45:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2599115640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f259406a3c0 0x7f259406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2599916640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2594071a50 0x7f259415c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:36000/0 (socket says 172.21.15.2:36000) 2023-11-04T01:45:32.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2599916640 1 -- 172.21.15.2:0/1097216762 learned_addr learned my addr 172.21.15.2:0/1097216762 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:32.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2598914640 1 --2- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2599115640 1 -- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 msgr2=0x7f25940cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2599115640 1 --2- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2599115640 1 -- 172.21.15.2:0/1097216762 >> v1:172.21.15.90:6789/0 conn(0x7f2594071a50 legacy=0x7f259415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.394+0000 7f2599115640 1 -- 172.21.15.2:0/1097216762 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25941613f0 con 0x7f259406a3c0 2023-11-04T01:45:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f2599115640 1 --2- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 0x7f259406e090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2590009d90 tx=0x7f259001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c32283951152a0b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f258bfff640 1 -- 172.21.15.2:0/1097216762 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25900a58f0 con 0x7f259406a3c0 2023-11-04T01:45:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f258bfff640 1 -- 172.21.15.2:0/1097216762 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25900a5a50 con 0x7f259406a3c0 2023-11-04T01:45:32.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f258bfff640 1 -- 172.21.15.2:0/1097216762 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25900a5de0 con 0x7f259406a3c0 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 -- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 msgr2=0x7f259406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 --2- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 0x7f259406e090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2590009d90 tx=0x7f259001c920 comp rx=0 tx=0).stop 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 -- 172.21.15.2:0/1097216762 shutdown_connections 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 --2- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 --2- 172.21.15.2:0/1097216762 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 0x7f259406e090 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 -- 172.21.15.2:0/1097216762 >> 172.21.15.2:0/1097216762 conn(0x7f25940cc5a0 msgr2=0x7f25940cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 -- 172.21.15.2:0/1097216762 shutdown_connections 2023-11-04T01:45:32.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 -- 172.21.15.2:0/1097216762 wait complete. 2023-11-04T01:45:32.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 Processor -- start 2023-11-04T01:45:32.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.398+0000 7f259b379640 1 -- start start 2023-11-04T01:45:32.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 0x7f25940af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594071a50 0x7f25940b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259415cd20 con 0x7f2594071a50 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25941524a0 con 0x7f259406a3c0 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2594152710 con 0x7f259406a7a0 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594071a50 0x7f25940b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594071a50 0x7f25940b0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50058/0 (socket says 172.21.15.2:50058) 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 -- 172.21.15.2:0/1363053521 learned_addr learned my addr 172.21.15.2:0/1363053521 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599115640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 0x7f25940af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2598914640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940c2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 -- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 msgr2=0x7f25940c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940c2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 -- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 msgr2=0x7f25940af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 0x7f25940af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 -- 172.21.15.2:0/1363053521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2590009a70 con 0x7f2594071a50 2023-11-04T01:45:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599916640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594071a50 0x7f25940b0cf0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c3f0 tx=0x7f258c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2589ffb640 1 -- 172.21.15.2:0/1363053521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c005cf0 con 0x7f2594071a50 2023-11-04T01:45:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25941529f0 con 0x7f2594071a50 2023-11-04T01:45:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2589ffb640 1 -- 172.21.15.2:0/1363053521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c005e50 con 0x7f2594071a50 2023-11-04T01:45:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2589ffb640 1 -- 172.21.15.2:0/1363053521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0072f0 con 0x7f2594071a50 2023-11-04T01:45:32.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2594152cd0 con 0x7f2594071a50 2023-11-04T01:45:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25940744a0 con 0x7f2594071a50 2023-11-04T01:45:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2589ffb640 1 -- 172.21.15.2:0/1363053521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f258c007450 con 0x7f2594071a50 2023-11-04T01:45:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2589ffb640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25780664a0 0x7f2578068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2589ffb640 1 -- 172.21.15.2:0/1363053521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7f258c083510 con 0x7f2594071a50 2023-11-04T01:45:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.402+0000 7f2599115640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25780664a0 0x7f2578068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.406+0000 7f2599115640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25780664a0 0x7f2578068960 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f25900af000 tx=0x7f25900a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.410+0000 7f2589ffb640 1 -- 172.21.15.2:0/1363053521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f258c050840 con 0x7f2594071a50 2023-11-04T01:45:32.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.562+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f259415df40 con 0x7f2594071a50 2023-11-04T01:45:32.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.562+0000 7f2589ffb640 1 -- 172.21.15.2:0/1363053521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v88) v1 ==== 107+0+11 (secure 0 0 0) 0x7f258c053e60 con 0x7f2594071a50 2023-11-04T01:45:32.566 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25780664a0 msgr2=0x7f2578068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25780664a0 0x7f2578068960 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f25900af000 tx=0x7f25900a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594071a50 msgr2=0x7f25940b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594071a50 0x7f25940b0cf0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c3f0 tx=0x7f258c00c8b0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 shutdown_connections 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25780664a0 0x7f2578068960 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2594071a50 0x7f25940b0cf0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f259406a7a0 0x7f25940c2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 --2- 172.21.15.2:0/1363053521 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f259406a3c0 0x7f25940af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 >> 172.21.15.2:0/1363053521 conn(0x7f25940cc5a0 msgr2=0x7f259406ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 shutdown_connections 2023-11-04T01:45:32.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.566+0000 7f259b379640 1 -- 172.21.15.2:0/1363053521 wait complete. 2023-11-04T01:45:32.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-04T01:45:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.706+0000 7fe7c9add640 1 Processor -- start 2023-11-04T01:45:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.706+0000 7fe7c9add640 1 -- start start 2023-11-04T01:45:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c9add640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c415d690 0x7fe7c406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c9add640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe7c406f8f0 0x7fe7c40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c9add640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40cd400 con 0x7fe7c415d2b0 2023-11-04T01:45:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c9add640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40ad450 con 0x7fe7c406f8f0 2023-11-04T01:45:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c9add640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40cd6e0 con 0x7fe7c415d690 2023-11-04T01:45:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe7c415d2b0 0x7fe7c40ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37174/0 (socket says 172.21.15.2:37174) 2023-11-04T01:45:32.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 -- 172.21.15.2:0/3072856054 learned_addr learned my addr 172.21.15.2:0/3072856054 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c2ffd640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c415d690 0x7fe7c406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c3fff640 1 --2- 172.21.15.2:0/3072856054 >> v2:172.21.15.90:3300/0 conn(0x7fe7c406f8f0 0x7fe7c40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178711118 0 0) 0x7fe7c40cd400 con 0x7fe7c415d2b0 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b0003530 con 0x7fe7c415d2b0 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274647370 0 0) 0x7fe7b0003530 con 0x7fe7c415d2b0 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c415d690 msgr2=0x7fe7c406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c415d690 0x7fe7c406c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 >> v2:172.21.15.90:3300/0 conn(0x7fe7c406f8f0 msgr2=0x7fe7c40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 --2- 172.21.15.2:0/3072856054 >> v2:172.21.15.90:3300/0 conn(0x7fe7c406f8f0 0x7fe7c40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40ad070 con 0x7fe7c415d2b0 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fe7b4001680 con 0x7fe7c415d2b0 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 >> v1:172.21.15.2:6789/0 conn(0x7fe7c415d2b0 legacy=0x7fe7c40ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c415d690 0x7fe7b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b0004d10 0x7fe7b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40ad450 con 0x7fe7b0003980 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40cd6e0 con 0x7fe7b0004d10 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000b990 con 0x7fe7c415d690 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 -- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c415d690 msgr2=0x7fe7b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c415d690 0x7fe7b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 -- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b0004d10 msgr2=0x7fe7b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:32.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b0004d10 0x7fe7b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.710+0000 7fe7c37fe640 1 -- 172.21.15.2:0/3072856054 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0003530 con 0x7fe7b0003980 2023-11-04T01:45:32.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400c240 tx=0x7fe7b401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22f905ab8a0bd36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40058e0 con 0x7fe7b0003980 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b4005a40 con 0x7fe7b0003980 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c27fc640 1 -- 172.21.15.2:0/3072856054 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4005e10 con 0x7fe7b0003980 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- 172.21.15.2:0/3072856054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 msgr2=0x7fe7b0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 --2- 172.21.15.2:0/3072856054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7b0003da0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400c240 tx=0x7fe7b401cc10 comp rx=0 tx=0).stop 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c3fff640 1 -- 172.21.15.2:0/3072856054 reap_dead start 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- 172.21.15.2:0/3072856054 shutdown_connections 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- 172.21.15.2:0/3072856054 >> 172.21.15.2:0/3072856054 conn(0x7fe7c40cebb0 msgr2=0x7fe7c40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- 172.21.15.2:0/3072856054 shutdown_connections 2023-11-04T01:45:32.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- 172.21.15.2:0/3072856054 wait complete. 2023-11-04T01:45:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 Processor -- start 2023-11-04T01:45:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- start start 2023-11-04T01:45:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7c4151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c40c2340 0x7fe7c40c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c41579b0 0x7fe7c4162760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41522f0 con 0x7fe7b0003980 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40c3ee0 con 0x7fe7c41579b0 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40c3510 con 0x7fe7c40c2340 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7c4151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7c4151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50080/0 (socket says 172.21.15.2:50080) 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 -- 172.21.15.2:0/875203941 learned_addr learned my addr 172.21.15.2:0/875203941 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c2ffd640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c40c2340 0x7fe7c40c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c3fff640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c41579b0 0x7fe7c4162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 -- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c40c2340 msgr2=0x7fe7c40c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c40c2340 0x7fe7c40c39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 -- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c41579b0 msgr2=0x7fe7c4162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c41579b0 0x7fe7c4162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 -- 172.21.15.2:0/875203941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c406fee0 con 0x7fe7b0003980 2023-11-04T01:45:32.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c37fe640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7c4151db0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ab040 tx=0x7fe7b0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7bbfff640 1 -- 172.21.15.2:0/875203941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40a5860 con 0x7fe7b0003980 2023-11-04T01:45:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7bbfff640 1 -- 172.21.15.2:0/875203941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40a59c0 con 0x7fe7b0003980 2023-11-04T01:45:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c40c2900 con 0x7fe7b0003980 2023-11-04T01:45:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.714+0000 7fe7bbfff640 1 -- 172.21.15.2:0/875203941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40a5d50 con 0x7fe7b0003980 2023-11-04T01:45:32.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.718+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c40c2ec0 con 0x7fe7b0003980 2023-11-04T01:45:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.718+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c40744a0 con 0x7fe7b0003980 2023-11-04T01:45:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.718+0000 7fe7bbfff640 1 -- 172.21.15.2:0/875203941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7b40047f0 con 0x7fe7b0003980 2023-11-04T01:45:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.718+0000 7fe7bbfff640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7a40664d0 0x7fe7a4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.718+0000 7fe7bbfff640 1 -- 172.21.15.2:0/875203941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fe7b411d310 con 0x7fe7b0003980 2023-11-04T01:45:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.718+0000 7fe7c2ffd640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7a40664d0 0x7fe7a4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:32.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.718+0000 7fe7c2ffd640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7a40664d0 0x7fe7a4068990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4158160 tx=0x7fe7ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:32.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.722+0000 7fe7bbfff640 1 -- 172.21.15.2:0/875203941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe7b40ea5b0 con 0x7fe7b0003980 2023-11-04T01:45:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.874+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe7c4071cb0 con 0x7fe7b0003980 2023-11-04T01:45:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.874+0000 7fe7bbfff640 1 -- 172.21.15.2:0/875203941 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) v1 ==== 84+0+287 (secure 0 0 0) 0x7fe7b40edbd0 con 0x7fe7b0003980 2023-11-04T01:45:32.877 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:32.877 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-04T01:45:32.877 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:32.877 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-04T01:45:32.877 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 6, 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "snap-test-pool" 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 11, 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "test_data_pool" 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 12, 2023-11-04T01:45:32.878 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": "test_metadata_pool" 2023-11-04T01:45:32.879 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:32.879 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-04T01:45:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.874+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7a40664d0 msgr2=0x7fe7a4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7a40664d0 0x7fe7a4068990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4158160 tx=0x7fe7ac008040 comp rx=0 tx=0).stop 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 msgr2=0x7fe7c4151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7c4151db0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ab040 tx=0x7fe7b0005800 comp rx=0 tx=0).stop 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 shutdown_connections 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe7a40664d0 0x7fe7a4068990 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7c41579b0 0x7fe7c4162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe7c40c2340 0x7fe7c40c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 --2- 172.21.15.2:0/875203941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe7b0003980 0x7fe7c4151db0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 >> 172.21.15.2:0/875203941 conn(0x7fe7c40cebb0 msgr2=0x7fe7c40cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 shutdown_connections 2023-11-04T01:45:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:32.878+0000 7fe7c9add640 1 -- 172.21.15.2:0/875203941 wait complete. 2023-11-04T01:45:32.895 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-04T01:45:32.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-04T01:45:33.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd24b72640 1 Processor -- start 2023-11-04T01:45:33.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd24b72640 1 -- start start 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd24b72640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbd200cb830 0x7fbd20164b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd24b72640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd200ce830 con 0x7fbd20070180 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd24b72640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2015d9d0 con 0x7fbd20159e00 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd24b72640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2015e650 con 0x7fbd200cb830 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1dd9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbd20070180 0x7fbd200cb120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37178/0 (socket says 172.21.15.2:37178) 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1dd9b640 1 -- 172.21.15.2:0/2487804993 learned_addr learned my addr 172.21.15.2:0/2487804993 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1ed9d640 1 --2- 172.21.15.2:0/2487804993 >> v2:172.21.15.90:3300/0 conn(0x7fbd200cb830 0x7fbd20164b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144880240 0 0) 0x7fbd200ce830 con 0x7fbd20070180 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd0c003530 con 0x7fbd20070180 2023-11-04T01:45:33.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3010816708 0 0) 0x7fbd0c003530 con 0x7fbd20070180 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 >> v2:172.21.15.90:3300/0 conn(0x7fbd200cb830 msgr2=0x7fbd20164b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 --2- 172.21.15.2:0/2487804993 >> v2:172.21.15.90:3300/0 conn(0x7fbd200cb830 0x7fbd20164b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 >> v1:172.21.15.90:6789/0 conn(0x7fbd20159e00 legacy=0x7fbd200ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2015dcb0 con 0x7fbd20070180 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fbd080016a0 con 0x7fbd20070180 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 >> v1:172.21.15.2:6789/0 conn(0x7fbd20070180 legacy=0x7fbd200cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd0c0039d0 0x7fbd0c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0047d0 0x7fbd0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd0c0051e0 0x7fbd0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015e650 con 0x7fbd0c0039d0 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c00e340 con 0x7fbd0c0051e0 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c00e500 con 0x7fbd0c0047d0 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1e59c640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd0c0039d0 0x7fbd0c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1ed9d640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd0c0051e0 0x7fbd0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1dd9b640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0047d0 0x7fbd0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1e59c640 1 -- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0047d0 msgr2=0x7fbd0c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1e59c640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0047d0 0x7fbd0c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1e59c640 1 -- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd0c0051e0 msgr2=0x7fbd0c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1e59c640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd0c0051e0 0x7fbd0c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1e59c640 1 -- 172.21.15.2:0/2487804993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c003530 con 0x7fbd0c0039d0 2023-11-04T01:45:33.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1ed9d640 1 -- 172.21.15.2:0/2487804993 reap_dead start 2023-11-04T01:45:33.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.010+0000 7fbd1dd9b640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0047d0 0x7fbd0c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:33.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd1e59c640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd0c0039d0 0x7fbd0c003df0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fbd10001750 tx=0x7fbd1001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c577af8e5371c416 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd100052d0 con 0x7fbd0c0039d0 2023-11-04T01:45:33.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd100a7050 con 0x7fbd0c0039d0 2023-11-04T01:45:33.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd1d59a640 1 -- 172.21.15.2:0/2487804993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10003600 con 0x7fbd0c0039d0 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 -- 172.21.15.2:0/2487804993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd0c0039d0 msgr2=0x7fbd0c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd0c0039d0 0x7fbd0c003df0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fbd10001750 tx=0x7fbd1001c360 comp rx=0 tx=0).stop 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 -- 172.21.15.2:0/2487804993 shutdown_connections 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 --2- 172.21.15.2:0/2487804993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd0c0039d0 0x7fbd0c003df0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 -- 172.21.15.2:0/2487804993 >> 172.21.15.2:0/2487804993 conn(0x7fbd200b0630 msgr2=0x7fbd200b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 -- 172.21.15.2:0/2487804993 shutdown_connections 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 -- 172.21.15.2:0/2487804993 wait complete. 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 Processor -- start 2023-11-04T01:45:33.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.014+0000 7fbd24b72640 1 -- start start 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0039d0 0x7fbd2014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd200c45a0 0x7fbd200c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd200ac8c0 0x7fbd200acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200ad280 con 0x7fbd200ac8c0 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015b3a0 con 0x7fbd200c45a0 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2015c200 con 0x7fbd0c0039d0 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd200ac8c0 0x7fbd200acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd200ac8c0 0x7fbd200acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50098/0 (socket says 172.21.15.2:50098) 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 -- 172.21.15.2:0/58758203 learned_addr learned my addr 172.21.15.2:0/58758203 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:33.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1dd9b640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd200c45a0 0x7fbd200c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1e59c640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0039d0 0x7fbd2014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 -- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0039d0 msgr2=0x7fbd2014f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0039d0 0x7fbd2014f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 -- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd200c45a0 msgr2=0x7fbd200c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd200c45a0 0x7fbd200c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 -- 172.21.15.2:0/58758203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2015b5f0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1ed9d640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd200ac8c0 0x7fbd200acd40 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fbd200c5ae0 tx=0x7fbd180115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd16ffd640 1 -- 172.21.15.2:0/58758203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800e070 con 0x7fbd200ac8c0 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd16ffd640 1 -- 172.21.15.2:0/58758203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18011de0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2015b8d0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd16ffd640 1 -- 172.21.15.2:0/58758203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180039a0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2015be90 con 0x7fbd200ac8c0 2023-11-04T01:45:33.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd200744a0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd16ffd640 1 -- 172.21.15.2:0/58758203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbd18003b00 con 0x7fbd200ac8c0 2023-11-04T01:45:33.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd16ffd640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd000664a0 0x7fbd00068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd16ffd640 1 -- 172.21.15.2:0/58758203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5920+0+0 (secure 0 0 0) 0x7fbd180846f0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.018+0000 7fbd1e59c640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd000664a0 0x7fbd00068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.022+0000 7fbd1e59c640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd000664a0 0x7fbd00068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c004750 tx=0x7fbd100011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.022+0000 7fbd16ffd640 1 -- 172.21.15.2:0/58758203 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd18051aa0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.182+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbd2015c020 con 0x7fbd200ac8c0 2023-11-04T01:45:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.626+0000 7fbd16ffd640 1 -- 172.21.15.2:0/58758203 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd18003db0 con 0x7fbd200ac8c0 2023-11-04T01:45:33.631 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-04T01:45:33.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd000664a0 msgr2=0x7fbd00068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd000664a0 0x7fbd00068960 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c004750 tx=0x7fbd100011a0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd200ac8c0 msgr2=0x7fbd200acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd200ac8c0 0x7fbd200acd40 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fbd200c5ae0 tx=0x7fbd180115a0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 shutdown_connections 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbd000664a0 0x7fbd00068960 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbd200ac8c0 0x7fbd200acd40 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd200c45a0 0x7fbd200c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 --2- 172.21.15.2:0/58758203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbd0c0039d0 0x7fbd2014f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 >> 172.21.15.2:0/58758203 conn(0x7fbd200b0630 msgr2=0x7fbd200c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 shutdown_connections 2023-11-04T01:45:33.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.630+0000 7fbd24b72640 1 -- 172.21.15.2:0/58758203 wait complete. 2023-11-04T01:45:33.661 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-04T01:45:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7faced03a640 1 Processor -- start 2023-11-04T01:45:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7faced03a640 1 -- start start 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7faced03a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7face80cfa50 0x7face80c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7faced03a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d0f60 0x7face80c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7faced03a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80ce1e0 con 0x7face80d39e0 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7faced03a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face80cee60 con 0x7face80cfa50 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7faced03a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80cf280 con 0x7face80d0f60 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7facde59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7face80d39e0 0x7face80b8010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37194/0 (socket says 172.21.15.2:37194) 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7facde59c640 1 -- 172.21.15.2:0/1867776189 learned_addr learned my addr 172.21.15.2:0/1867776189 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7face6d9d640 1 --2- 172.21.15.2:0/1867776189 >> v2:172.21.15.90:3300/0 conn(0x7face80cfa50 0x7face80c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.790+0000 7face759e640 1 --2- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d0f60 0x7face80c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face659c640 1 -- 172.21.15.2:0/1867776189 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66531810 0 0) 0x7face80ce1e0 con 0x7face80d39e0 2023-11-04T01:45:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face659c640 1 -- 172.21.15.2:0/1867776189 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd4003530 con 0x7face80d39e0 2023-11-04T01:45:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face6d9d640 1 -- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d0f60 msgr2=0x7face80c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:33.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face6d9d640 1 --2- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d0f60 0x7face80c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face6d9d640 1 -- 172.21.15.2:0/1867776189 >> v1:172.21.15.2:6789/0 conn(0x7face80d39e0 legacy=0x7face80b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face659c640 1 -- 172.21.15.2:0/1867776189 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2674413116 0 0) 0x7facd4003530 con 0x7face80d39e0 2023-11-04T01:45:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face6d9d640 1 -- 172.21.15.2:0/1867776189 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80ce4c0 con 0x7face80cfa50 2023-11-04T01:45:33.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face759e640 1 --2- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d0f60 0x7face80c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:45:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face6d9d640 1 --2- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80cfa50 0x7face80c5d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7facd80097a0 tx=0x7facd801eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7695e5e57bfaa6b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face659c640 1 -- 172.21.15.2:0/1867776189 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0001680 con 0x7face80cfa50 2023-11-04T01:45:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face659c640 1 -- 172.21.15.2:0/1867776189 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd80a85b0 con 0x7face80cfa50 2023-11-04T01:45:33.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7face659c640 1 -- 172.21.15.2:0/1867776189 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80a8920 con 0x7face80cfa50 2023-11-04T01:45:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 -- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80cfa50 msgr2=0x7face80c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 --2- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80cfa50 0x7face80c5d90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7facd80097a0 tx=0x7facd801eb70 comp rx=0 tx=0).stop 2023-11-04T01:45:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 -- 172.21.15.2:0/1867776189 shutdown_connections 2023-11-04T01:45:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 --2- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d0f60 0x7face80c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 --2- 172.21.15.2:0/1867776189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80cfa50 0x7face80c5d90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 -- 172.21.15.2:0/1867776189 >> 172.21.15.2:0/1867776189 conn(0x7face80d2e60 msgr2=0x7face80d3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 -- 172.21.15.2:0/1867776189 shutdown_connections 2023-11-04T01:45:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.794+0000 7faced03a640 1 -- 172.21.15.2:0/1867776189 wait complete. 2023-11-04T01:45:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 Processor -- start 2023-11-04T01:45:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 -- start start 2023-11-04T01:45:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face80cfa50 0x7face81533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80d0f60 0x7face80b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d39e0 0x7face80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80b7a50 con 0x7face80cfa50 2023-11-04T01:45:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face80b7d30 con 0x7face80d0f60 2023-11-04T01:45:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face80b8010 con 0x7face80d39e0 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face80cfa50 0x7face81533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face80cfa50 0x7face81533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50100/0 (socket says 172.21.15.2:50100) 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 -- 172.21.15.2:0/3551773604 learned_addr learned my addr 172.21.15.2:0/3551773604 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face759e640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d39e0 0x7face80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7facde59c640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80d0f60 0x7face80b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 -- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d39e0 msgr2=0x7face80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d39e0 0x7face80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 -- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80d0f60 msgr2=0x7face80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80d0f60 0x7face80b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 -- 172.21.15.2:0/3551773604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face0009a70 con 0x7face80cfa50 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7face6d9d640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face80cfa50 0x7face81533f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7facd8000c10 tx=0x7facd801b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7facdffff640 1 -- 172.21.15.2:0/3551773604 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80a9bc0 con 0x7face80cfa50 2023-11-04T01:45:33.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7facdffff640 1 -- 172.21.15.2:0/3551773604 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd80a9d20 con 0x7face80cfa50 2023-11-04T01:45:33.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd80093b0 con 0x7face80cfa50 2023-11-04T01:45:33.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7facdffff640 1 -- 172.21.15.2:0/3551773604 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8005be0 con 0x7face80cfa50 2023-11-04T01:45:33.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face80b85d0 con 0x7face80cfa50 2023-11-04T01:45:33.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.798+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face80744a0 con 0x7face80cfa50 2023-11-04T01:45:33.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.802+0000 7facdffff640 1 -- 172.21.15.2:0/3551773604 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7facd80b7040 con 0x7face80cfa50 2023-11-04T01:45:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.802+0000 7facdffff640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7facc80664a0 0x7facc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.802+0000 7facdffff640 1 -- 172.21.15.2:0/3551773604 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6290+0+0 (secure 0 0 0) 0x7facd81210e0 con 0x7face80cfa50 2023-11-04T01:45:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.802+0000 7facde59c640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7facc80664a0 0x7facc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:33.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.802+0000 7facde59c640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7facc80664a0 0x7facc8068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7face80b67e0 tx=0x7facd0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:33.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.806+0000 7facdffff640 1 -- 172.21.15.2:0/3551773604 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7facd80ee270 con 0x7face80cfa50 2023-11-04T01:45:33.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:33.962+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7face8066ab0 con 0x7face80cfa50 2023-11-04T01:45:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7facdffff640 1 -- 172.21.15.2:0/3551773604 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) v1 ==== 170+0+0 (secure 0 0 0) 0x7facd80b5020 con 0x7face80cfa50 2023-11-04T01:45:34.636 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7facc80664a0 msgr2=0x7facc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7facc80664a0 0x7facc8068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7face80b67e0 tx=0x7facd0009040 comp rx=0 tx=0).stop 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face80cfa50 msgr2=0x7face81533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face80cfa50 0x7face81533f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7facd8000c10 tx=0x7facd801b910 comp rx=0 tx=0).stop 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 shutdown_connections 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7facc80664a0 0x7facc8068960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7face80d39e0 0x7face80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7face80d0f60 0x7face80b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 --2- 172.21.15.2:0/3551773604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7face80cfa50 0x7face81533f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 >> 172.21.15.2:0/3551773604 conn(0x7face80d2e60 msgr2=0x7face806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 shutdown_connections 2023-11-04T01:45:34.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.634+0000 7faced03a640 1 -- 172.21.15.2:0/3551773604 wait complete. 2023-11-04T01:45:34.673 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-04T01:45:34.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 Processor -- start 2023-11-04T01:45:34.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 -- start start 2023-11-04T01:45:34.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e5815d0b0 0x7f3e58160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e581610f0 0x7f3e580cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3e580cfd50 0x7f3e580b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e580d1520 con 0x7f3e581610f0 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e580d01e0 con 0x7f3e580cfd50 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5c8b6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580b5e00 con 0x7f3e5815d0b0 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e581610f0 0x7f3e580cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e581610f0 0x7f3e580cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50110/0 (socket says 172.21.15.2:50110) 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 -- 172.21.15.2:0/519560715 learned_addr learned my addr 172.21.15.2:0/519560715 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e5659c640 1 --2- 172.21.15.2:0/519560715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e5815d0b0 0x7f3e58160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e56d9d640 1 --2- 172.21.15.2:0/519560715 >> v2:172.21.15.90:3300/0 conn(0x7f3e580cfd50 0x7f3e580b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 -- 172.21.15.2:0/519560715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e5815d0b0 msgr2=0x7f3e58160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 --2- 172.21.15.2:0/519560715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e5815d0b0 0x7f3e58160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 -- 172.21.15.2:0/519560715 >> v2:172.21.15.90:3300/0 conn(0x7f3e580cfd50 msgr2=0x7f3e580b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:34.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 --2- 172.21.15.2:0/519560715 >> v2:172.21.15.90:3300/0 conn(0x7f3e580cfd50 0x7f3e580b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e55d9b640 1 -- 172.21.15.2:0/519560715 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5815d490 con 0x7f3e581610f0 2023-11-04T01:45:34.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.798+0000 7f3e56d9d640 1 --2- 172.21.15.2:0/519560715 >> v2:172.21.15.90:3300/0 conn(0x7f3e580cfd50 0x7f3e580b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e55d9b640 1 --2- 172.21.15.2:0/519560715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e581610f0 0x7f3e580cf810 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3e5808c1c0 tx=0x7f3e4c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72dda622201729e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5559a640 1 -- 172.21.15.2:0/519560715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0ab600 con 0x7f3e581610f0 2023-11-04T01:45:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5559a640 1 -- 172.21.15.2:0/519560715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0a7050 con 0x7f3e581610f0 2023-11-04T01:45:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5559a640 1 -- 172.21.15.2:0/519560715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0ab980 con 0x7f3e581610f0 2023-11-04T01:45:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/519560715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e581610f0 msgr2=0x7f3e580cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/519560715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e581610f0 0x7f3e580cf810 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f3e5808c1c0 tx=0x7f3e4c01c240 comp rx=0 tx=0).stop 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/519560715 shutdown_connections 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/519560715 >> v2:172.21.15.90:3300/0 conn(0x7f3e580cfd50 0x7f3e580b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/519560715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e581610f0 0x7f3e580cf810 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/519560715 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e5815d0b0 0x7f3e58160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/519560715 >> 172.21.15.2:0/519560715 conn(0x7f3e5806a890 msgr2=0x7f3e5806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/519560715 shutdown_connections 2023-11-04T01:45:34.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/519560715 wait complete. 2023-11-04T01:45:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 Processor -- start 2023-11-04T01:45:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.802+0000 7f3e5c8b6640 1 -- start start 2023-11-04T01:45:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e580cfd50 0x7f3e5814a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e5815d0b0 0x7f3e5815d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e581610f0 0x7f3e58157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5815ec30 con 0x7f3e5815d0b0 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58156d30 con 0x7f3e581610f0 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581572f0 con 0x7f3e580cfd50 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e5815d0b0 0x7f3e5815d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e5815d0b0 0x7f3e5815d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50114/0 (socket says 172.21.15.2:50114) 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 -- 172.21.15.2:0/1935749524 learned_addr learned my addr 172.21.15.2:0/1935749524 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5659c640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e580cfd50 0x7f3e5814a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e56d9d640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e581610f0 0x7f3e58157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 -- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e580cfd50 msgr2=0x7f3e5814a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e580cfd50 0x7f3e5814a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 -- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e581610f0 msgr2=0x7f3e58157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e581610f0 0x7f3e58157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 -- 172.21.15.2:0/1935749524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0094d0 con 0x7f3e5815d0b0 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e55d9b640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e5815d0b0 0x7f3e5815d6b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ae040 tx=0x7f3e4c018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e46ffd640 1 -- 172.21.15.2:0/1935749524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0b6420 con 0x7f3e5815d0b0 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e46ffd640 1 -- 172.21.15.2:0/1935749524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c0b65a0 con 0x7f3e5815d0b0 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e58158a90 con 0x7f3e5815d0b0 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e46ffd640 1 -- 172.21.15.2:0/1935749524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0b6950 con 0x7f3e5815d0b0 2023-11-04T01:45:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e58156f80 con 0x7f3e5815d0b0 2023-11-04T01:45:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e580744a0 con 0x7f3e5815d0b0 2023-11-04T01:45:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e46ffd640 1 -- 172.21.15.2:0/1935749524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e4c0b2040 con 0x7f3e5815d0b0 2023-11-04T01:45:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.806+0000 7f3e46ffd640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e380664a0 0x7f3e38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.810+0000 7f3e46ffd640 1 -- 172.21.15.2:0/1935749524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6672+0+0 (secure 0 0 0) 0x7f3e4c11e840 con 0x7f3e5815d0b0 2023-11-04T01:45:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.810+0000 7f3e5659c640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e380664a0 0x7f3e38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:34.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.810+0000 7f3e5659c640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e380664a0 0x7f3e38068960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009af0 tx=0x7f3e48008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:34.814+0000 7f3e46ffd640 1 -- 172.21.15.2:0/1935749524 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e4c0ebbb0 con 0x7f3e5815d0b0 2023-11-04T01:45:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.006+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3e580d0e30 con 0x7f3e5815d0b0 2023-11-04T01:45:35.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.694+0000 7f3e46ffd640 1 -- 172.21.15.2:0/1935749524 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3e4c0ef1d0 con 0x7f3e5815d0b0 2023-11-04T01:45:35.700 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 15 and data pool 16 2023-11-04T01:45:35.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.714+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e380664a0 msgr2=0x7f3e38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.714+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e380664a0 0x7f3e38068960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009af0 tx=0x7f3e48008040 comp rx=0 tx=0).stop 2023-11-04T01:45:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.714+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e5815d0b0 msgr2=0x7f3e5815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.714+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e5815d0b0 0x7f3e5815d6b0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ae040 tx=0x7f3e4c018fe0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 shutdown_connections 2023-11-04T01:45:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e380664a0 0x7f3e38068960 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e581610f0 0x7f3e58157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e5815d0b0 0x7f3e5815d6b0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 --2- 172.21.15.2:0/1935749524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e580cfd50 0x7f3e5814a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 >> 172.21.15.2:0/1935749524 conn(0x7f3e5806a890 msgr2=0x7f3e580b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 shutdown_connections 2023-11-04T01:45:35.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.722+0000 7f3e5c8b6640 1 -- 172.21.15.2:0/1935749524 wait complete. 2023-11-04T01:45:35.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:35.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.862+0000 7f875112e640 1 Processor -- start 2023-11-04T01:45:35.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.862+0000 7f875112e640 1 -- start start 2023-11-04T01:45:35.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f875112e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 0x7f874c0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f875112e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c0d0a60 con 0x7f874c0cb400 2023-11-04T01:45:35.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f875112e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c0d04a0 con 0x7f874c0cd6d0 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f875112e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c15b390 con 0x7f874c15afb0 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f874c0cb400 0x7f874c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37208/0 (socket says 172.21.15.2:37208) 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 -- 172.21.15.2:0/1975160787 learned_addr learned my addr 172.21.15.2:0/1975160787 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874ad9d640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 0x7f874c0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110349109 0 0) 0x7f874c0d0a60 con 0x7f874c0cb400 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8734003530 con 0x7f874c0cb400 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2149939721 0 0) 0x7f8734003530 con 0x7f874c0cb400 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 msgr2=0x7f874c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 0x7f874c0b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 >> v1:172.21.15.90:6789/0 conn(0x7f874c0cd6d0 legacy=0x7f874c0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c0d0780 con 0x7f874c0cb400 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f8740001680 con 0x7f874c0cb400 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 >> v1:172.21.15.2:6789/0 conn(0x7f874c0cb400 legacy=0x7f874c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 0x7f87340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f87340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8734004d10 0x7f8734005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c15b390 con 0x7f8734003f30 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873400bb20 con 0x7f8734004d10 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873400bce0 con 0x7f874c15afb0 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f87340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874ad9d640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 0x7f87340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874b59e640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8734004d10 0x7f8734005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 -- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 msgr2=0x7f87340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 0x7f87340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 -- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8734004d10 msgr2=0x7f8734005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8734004d10 0x7f8734005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874a59c640 1 -- 172.21.15.2:0/1975160787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734003530 con 0x7f8734003f30 2023-11-04T01:45:35.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.866+0000 7f874ad9d640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c15afb0 0x7f87340039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874a59c640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f87340047d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f874000c190 tx=0x7f874001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb76a17644edd1c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740005ae0 con 0x7f8734003f30 2023-11-04T01:45:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740005c40 con 0x7f8734003f30 2023-11-04T01:45:35.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f8749d9b640 1 -- 172.21.15.2:0/1975160787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400a57a0 con 0x7f8734003f30 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- 172.21.15.2:0/1975160787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 msgr2=0x7f87340047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 --2- 172.21.15.2:0/1975160787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f87340047d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f874000c190 tx=0x7f874001cbd0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874b59e640 1 -- 172.21.15.2:0/1975160787 reap_dead start 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- 172.21.15.2:0/1975160787 shutdown_connections 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- 172.21.15.2:0/1975160787 >> 172.21.15.2:0/1975160787 conn(0x7f874c065dc0 msgr2=0x7f874c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- 172.21.15.2:0/1975160787 shutdown_connections 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- 172.21.15.2:0/1975160787 wait complete. 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 Processor -- start 2023-11-04T01:45:35.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- start start 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f874c0b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c0ca490 0x7f874c1f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874c0cb900 0x7f874c0cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c158d10 con 0x7f8734003f30 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0cc2c0 con 0x7f874c0cb900 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f875112e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c1f4310 con 0x7f874c0ca490 2023-11-04T01:45:35.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f874c0b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f874c0b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50126/0 (socket says 172.21.15.2:50126) 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 -- 172.21.15.2:0/2870185544 learned_addr learned my addr 172.21.15.2:0/2870185544 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 -- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c0ca490 msgr2=0x7f874c1f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c0ca490 0x7f874c1f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 -- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874c0cb900 msgr2=0x7f874c0cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874b59e640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874c0cb900 0x7f874c0cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874c0cb900 0x7f874c0cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 -- 172.21.15.2:0/2870185544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c1f45f0 con 0x7f8734003f30 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f874ad9d640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f874c0b1d30 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f873c009fd0 tx=0x7f873c011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.870+0000 7f87337fe640 1 -- 172.21.15.2:0/2870185544 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c004220 con 0x7f8734003f30 2023-11-04T01:45:35.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f87337fe640 1 -- 172.21.15.2:0/2870185544 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c004380 con 0x7f8734003f30 2023-11-04T01:45:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c1f48d0 con 0x7f8734003f30 2023-11-04T01:45:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f87337fe640 1 -- 172.21.15.2:0/2870185544 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00f9e0 con 0x7f8734003f30 2023-11-04T01:45:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c1f4ee0 con 0x7f8734003f30 2023-11-04T01:45:35.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c0675f0 con 0x7f8734003f30 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f87337fe640 1 -- 172.21.15.2:0/2870185544 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f873c00fb40 con 0x7f8734003f30 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f87337fe640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87380664a0 0x7f8738068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f87337fe640 1 -- 172.21.15.2:0/2870185544 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f873c084ce0 con 0x7f8734003f30 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f874a59c640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87380664a0 0x7f8738068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:35.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.874+0000 7f874a59c640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87380664a0 0x7f8738068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f874000c190 tx=0x7f874c0ce1f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:35.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:35.878+0000 7f87337fe640 1 -- 172.21.15.2:0/2870185544 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f873c051e10 con 0x7f8734003f30 2023-11-04T01:45:36.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.038+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f874c066b00 con 0x7f8734003f30 2023-11-04T01:45:36.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f87337fe640 1 -- 172.21.15.2:0/2870185544 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+21673 (secure 0 0 0) 0x7f873c022090 con 0x7f8734003f30 2023-11-04T01:45:36.043 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:36.043 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":91,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:35.007772+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87380664a0 msgr2=0x7f8738068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87380664a0 0x7f8738068960 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f874000c190 tx=0x7f874c0ce1f0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 msgr2=0x7f874c0b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f874c0b1d30 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f873c009fd0 tx=0x7f873c011b30 comp rx=0 tx=0).stop 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 shutdown_connections 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87380664a0 0x7f8738068960 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f874c0cb900 0x7f874c0cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f874c0ca490 0x7f874c1f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 --2- 172.21.15.2:0/2870185544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8734003f30 0x7f874c0b1d30 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 >> 172.21.15.2:0/2870185544 conn(0x7f874c065dc0 msgr2=0x7f874c0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 shutdown_connections 2023-11-04T01:45:36.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.042+0000 7f875112e640 1 -- 172.21.15.2:0/2870185544 wait complete. 2023-11-04T01:45:36.063 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa11e50640 1 Processor -- start 2023-11-04T01:45:36.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa11e50640 1 -- start start 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa11e50640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 0x7faa0c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa11e50640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0ce040 con 0x7faa0c0cb400 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa11e50640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0d0a60 con 0x7faa0c15afb0 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa11e50640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c15b390 con 0x7faa0c0cd6d0 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faa0c0cb400 0x7faa0c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37214/0 (socket says 172.21.15.2:37214) 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 -- 172.21.15.2:0/524085690 learned_addr learned my addr 172.21.15.2:0/524085690 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0bfff640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 0x7faa0c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214689437 0 0) 0x7faa0c0ce040 con 0x7faa0c0cb400 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9f4003530 con 0x7faa0c0cb400 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1575630079 0 0) 0x7fa9f4003530 con 0x7faa0c0cb400 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 msgr2=0x7faa0c0cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 0x7faa0c0cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 >> v1:172.21.15.90:6789/0 conn(0x7faa0c15afb0 legacy=0x7faa0c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0d04a0 con 0x7faa0c0cb400 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7faa000016a0 con 0x7faa0c0cb400 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 >> v1:172.21.15.2:6789/0 conn(0x7faa0c0cb400 legacy=0x7faa0c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40039b0 0x7fa9f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9f40047d0 0x7fa9f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 0x7fa9f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c15b390 con 0x7fa9f40047d0 2023-11-04T01:45:36.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f400bac0 con 0x7fa9f40039b0 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f400bc80 con 0x7faa0c0cd6d0 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9f40047d0 0x7fa9f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0bfff640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 0x7fa9f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0b7fe640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40039b0 0x7fa9f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 -- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 msgr2=0x7fa9f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0cd6d0 0x7fa9f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 -- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40039b0 msgr2=0x7fa9f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40039b0 0x7fa9f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.182+0000 7faa0affd640 1 -- 172.21.15.2:0/524085690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4003530 con 0x7fa9f40047d0 2023-11-04T01:45:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa0affd640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9f40047d0 0x7fa9f4004c50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7faa0c071ae0 tx=0x7faa0001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ad65f8b750fa7c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00005ae0 con 0x7fa9f40047d0 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa00005c40 con 0x7fa9f40047d0 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa0a7fc640 1 -- 172.21.15.2:0/524085690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00007070 con 0x7fa9f40047d0 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- 172.21.15.2:0/524085690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9f40047d0 msgr2=0x7fa9f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 --2- 172.21.15.2:0/524085690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9f40047d0 0x7fa9f4004c50 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7faa0c071ae0 tx=0x7faa0001cbe0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa0bfff640 1 -- 172.21.15.2:0/524085690 reap_dead start 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- 172.21.15.2:0/524085690 shutdown_connections 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- 172.21.15.2:0/524085690 >> 172.21.15.2:0/524085690 conn(0x7faa0c065dc0 msgr2=0x7faa0c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- 172.21.15.2:0/524085690 shutdown_connections 2023-11-04T01:45:36.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- 172.21.15.2:0/524085690 wait complete. 2023-11-04T01:45:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 Processor -- start 2023-11-04T01:45:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- start start 2023-11-04T01:45:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40047d0 0x7faa0c14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0b07d0 0x7faa0c06c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c163a00 0x7faa0c163e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c06d220 con 0x7faa0c163a00 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1f67e0 con 0x7fa9f40047d0 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.186+0000 7faa11e50640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c1643c0 con 0x7faa0c0b07d0 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c163a00 0x7faa0c163e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c163a00 0x7faa0c163e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50148/0 (socket says 172.21.15.2:50148) 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 -- 172.21.15.2:0/2826467450 learned_addr learned my addr 172.21.15.2:0/2826467450 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0affd640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0b07d0 0x7faa0c06c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 -- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0b07d0 msgr2=0x7faa0c06c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0b07d0 0x7faa0c06c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 -- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40047d0 msgr2=0x7faa0c14cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0b7fe640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40047d0 0x7faa0c14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40047d0 0x7faa0c14cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 -- 172.21.15.2:0/2826467450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c1f5ee0 con 0x7faa0c163a00 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0affd640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0b07d0 0x7faa0c06c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0bfff640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c163a00 0x7faa0c163e80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b0730 tx=0x7fa9fc011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7fa9f3fff640 1 -- 172.21.15.2:0/2826467450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004500 con 0x7faa0c163a00 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7fa9f3fff640 1 -- 172.21.15.2:0/2826467450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9fc003620 con 0x7faa0c163a00 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7fa9f3fff640 1 -- 172.21.15.2:0/2826467450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0039d0 con 0x7faa0c163a00 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c06cce0 con 0x7faa0c163a00 2023-11-04T01:45:36.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c06cf40 con 0x7faa0c163a00 2023-11-04T01:45:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c1f6920 con 0x7faa0c163a00 2023-11-04T01:45:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7fa9f3fff640 1 -- 172.21.15.2:0/2826467450 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa9fc003b30 con 0x7faa0c163a00 2023-11-04T01:45:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7fa9f3fff640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9f80664d0 0x7fa9f8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7fa9f3fff640 1 -- 172.21.15.2:0/2826467450 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa9fc0844c0 con 0x7faa0c163a00 2023-11-04T01:45:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.190+0000 7faa0b7fe640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9f80664d0 0x7fa9f8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.194+0000 7faa0b7fe640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9f80664d0 0x7fa9f8068990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faa04000f90 tx=0x7faa04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.194+0000 7fa9f3fff640 1 -- 172.21.15.2:0/2826467450 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa0c1f6920 con 0x7faa0c163a00 2023-11-04T01:45:36.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.354+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa0c1f6920 con 0x7faa0c163a00 2023-11-04T01:45:36.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.354+0000 7fa9f3fff640 1 -- 172.21.15.2:0/2826467450 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+21673 (secure 0 0 0) 0x7faa0c1f6920 con 0x7faa0c163a00 2023-11-04T01:45:36.358 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:36.358 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":91,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:35.007772+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9f80664d0 msgr2=0x7fa9f8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9f80664d0 0x7fa9f8068990 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faa04000f90 tx=0x7faa04009040 comp rx=0 tx=0).stop 2023-11-04T01:45:36.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c163a00 msgr2=0x7faa0c163e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c163a00 0x7faa0c163e80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b0730 tx=0x7fa9fc011920 comp rx=0 tx=0).stop 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 shutdown_connections 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa9f80664d0 0x7fa9f8068990 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa0c163a00 0x7faa0c163e80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faa0c0b07d0 0x7faa0c06c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 --2- 172.21.15.2:0/2826467450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9f40047d0 0x7faa0c14cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 >> 172.21.15.2:0/2826467450 conn(0x7faa0c065dc0 msgr2=0x7faa0c0b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 shutdown_connections 2023-11-04T01:45:36.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.358+0000 7faa11e50640 1 -- 172.21.15.2:0/2826467450 wait complete. 2023-11-04T01:45:36.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-04T01:45:36.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12715bb640 1 Processor -- start 2023-11-04T01:45:36.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12715bb640 1 -- start start 2023-11-04T01:45:36.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12715bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f126c15af50 0x7f126c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12715bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f126c0b32f0 0x7f126c0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12715bb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c0cd830 con 0x7f126c0cf4c0 2023-11-04T01:45:36.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12715bb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0b3780 con 0x7f126c0b32f0 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12715bb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c0cdad0 con 0x7f126c15af50 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12627fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f126c0b32f0 0x7f126c0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12627fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f126c0b32f0 0x7f126c0ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50162/0 (socket says 172.21.15.2:50162) 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12627fc640 1 -- 172.21.15.2:0/3051474659 learned_addr learned my addr 172.21.15.2:0/3051474659 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f126affd640 1 --2- 172.21.15.2:0/3051474659 >> v2:172.21.15.90:3300/0 conn(0x7f126c15af50 0x7f126c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12627fc640 1 -- 172.21.15.2:0/3051474659 >> v2:172.21.15.90:3300/0 conn(0x7f126c15af50 msgr2=0x7f126c0cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12627fc640 1 --2- 172.21.15.2:0/3051474659 >> v2:172.21.15.90:3300/0 conn(0x7f126c15af50 0x7f126c0cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12627fc640 1 -- 172.21.15.2:0/3051474659 >> v1:172.21.15.90:6789/0 conn(0x7f126c0cf4c0 legacy=0x7f126c15e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.506+0000 7f12627fc640 1 -- 172.21.15.2:0/3051474659 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0cddb0 con 0x7f126c0b32f0 2023-11-04T01:45:36.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12627fc640 1 --2- 172.21.15.2:0/3051474659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b32f0 0x7f126c0ce8b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f126c0681a0 tx=0x7f125401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d00f7fbe1465ee server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f126a7fc640 1 -- 172.21.15.2:0/3051474659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540ab650 con 0x7f126c0b32f0 2023-11-04T01:45:36.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f126a7fc640 1 -- 172.21.15.2:0/3051474659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12540ab7b0 con 0x7f126c0b32f0 2023-11-04T01:45:36.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f126a7fc640 1 -- 172.21.15.2:0/3051474659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540abb40 con 0x7f126c0b32f0 2023-11-04T01:45:36.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- 172.21.15.2:0/3051474659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b32f0 msgr2=0x7f126c0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 --2- 172.21.15.2:0/3051474659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b32f0 0x7f126c0ce8b0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f126c0681a0 tx=0x7f125401c430 comp rx=0 tx=0).stop 2023-11-04T01:45:36.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- 172.21.15.2:0/3051474659 shutdown_connections 2023-11-04T01:45:36.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 --2- 172.21.15.2:0/3051474659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0b32f0 0x7f126c0ce8b0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 --2- 172.21.15.2:0/3051474659 >> v2:172.21.15.90:3300/0 conn(0x7f126c15af50 0x7f126c0cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- 172.21.15.2:0/3051474659 >> 172.21.15.2:0/3051474659 conn(0x7f126c065dc0 msgr2=0x7f126c0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:36.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- 172.21.15.2:0/3051474659 shutdown_connections 2023-11-04T01:45:36.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- 172.21.15.2:0/3051474659 wait complete. 2023-11-04T01:45:36.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 Processor -- start 2023-11-04T01:45:36.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- start start 2023-11-04T01:45:36.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0cf4c0 0x7f126c0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f126c15af50 0x7f126c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f126c154000 0x7f126c06bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0c82f0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0b5610 con 0x7f126c15af50 2023-11-04T01:45:36.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f12715bb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c0b5b40 con 0x7f126c154000 2023-11-04T01:45:36.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.510+0000 7f126affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0cf4c0 0x7f126c0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0cf4c0 0x7f126c0c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50164/0 (socket says 172.21.15.2:50164) 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 -- 172.21.15.2:0/3243493599 learned_addr learned my addr 172.21.15.2:0/3243493599 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126b7fe640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f126c154000 0x7f126c06bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f12627fc640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f126c15af50 0x7f126c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 -- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f126c154000 msgr2=0x7f126c06bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f126c154000 0x7f126c06bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 -- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f126c15af50 msgr2=0x7f126c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f126c15af50 0x7f126c0b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 -- 172.21.15.2:0/3243493599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540094d0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126b7fe640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f126c154000 0x7f126c06bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f126affd640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0cf4c0 0x7f126c0c7db0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f125c00d7d0 tx=0x7f125c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f1263fff640 1 -- 172.21.15.2:0/3243493599 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00b6c0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f1263fff640 1 -- 172.21.15.2:0/3243493599 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c00b820 con 0x7f126c0cf4c0 2023-11-04T01:45:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c0b49f0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f1263fff640 1 -- 172.21.15.2:0/3243493599 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c00bbd0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c0b3cd0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c0675f0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f1263fff640 1 -- 172.21.15.2:0/3243493599 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f125c00bd30 con 0x7f126c0cf4c0 2023-11-04T01:45:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f1263fff640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f124c0664a0 0x7f124c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f1263fff640 1 -- 172.21.15.2:0/3243493599 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f125c0846f0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.514+0000 7f12627fc640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f124c0664a0 0x7f124c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:36.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.518+0000 7f12627fc640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f124c0664a0 0x7f124c068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f12540af000 tx=0x7f1254008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:36.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.518+0000 7f1263fff640 1 -- 172.21.15.2:0/3243493599 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f125c0517d0 con 0x7f126c0cf4c0 2023-11-04T01:45:36.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:36.710+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f126c0cceb0 con 0x7f126c0cf4c0 2023-11-04T01:45:37.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.718+0000 7f1263fff640 1 -- 172.21.15.2:0/3243493599 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7f125c054df0 con 0x7f126c0cf4c0 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f124c0664a0 msgr2=0x7f124c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f124c0664a0 0x7f124c068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f12540af000 tx=0x7f1254008040 comp rx=0 tx=0).stop 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0cf4c0 msgr2=0x7f126c0c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0cf4c0 0x7f126c0c7db0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f125c00d7d0 tx=0x7f125c00dc90 comp rx=0 tx=0).stop 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 shutdown_connections 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f124c0664a0 0x7f124c068960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f126c154000 0x7f126c06bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f126c15af50 0x7f126c0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 --2- 172.21.15.2:0/3243493599 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f126c0cf4c0 0x7f126c0c7db0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 >> 172.21.15.2:0/3243493599 conn(0x7f126c065dc0 msgr2=0x7f126c0661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 shutdown_connections 2023-11-04T01:45:37.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.722+0000 7f12715bb640 1 -- 172.21.15.2:0/3243493599 wait complete. 2023-11-04T01:45:37.746 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-04T01:45:37.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-04T01:45:37.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc435d9640 1 Processor -- start 2023-11-04T01:45:37.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc435d9640 1 -- start start 2023-11-04T01:45:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc435d9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc3c15d0b0 0x7fdc3c160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc435d9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdc3c0cff20 0x7fdc3c0d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc435d9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3c0b5e00 con 0x7fdc3c1610f0 2023-11-04T01:45:37.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc435d9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3c0d1520 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc435d9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3c15d490 con 0x7fdc3c0cff20 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41375640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc3c15d0b0 0x7fdc3c160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41375640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdc3c15d0b0 0x7fdc3c160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50180/0 (socket says 172.21.15.2:50180) 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41375640 1 -- 172.21.15.2:0/814391022 learned_addr learned my addr 172.21.15.2:0/814391022 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41b76640 1 --2- 172.21.15.2:0/814391022 >> v2:172.21.15.90:3300/0 conn(0x7fdc3c0cff20 0x7fdc3c0d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41375640 1 -- 172.21.15.2:0/814391022 >> v2:172.21.15.90:3300/0 conn(0x7fdc3c0cff20 msgr2=0x7fdc3c0d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41375640 1 --2- 172.21.15.2:0/814391022 >> v2:172.21.15.90:3300/0 conn(0x7fdc3c0cff20 0x7fdc3c0d1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41375640 1 -- 172.21.15.2:0/814391022 >> v1:172.21.15.90:6789/0 conn(0x7fdc3c1610f0 legacy=0x7fdc3c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:37.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.870+0000 7fdc41375640 1 -- 172.21.15.2:0/814391022 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0b8930 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc41375640 1 --2- 172.21.15.2:0/814391022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c160bb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0cf1b0 tx=0x7fdc3801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7723f5e5d7fa12 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc33fff640 1 -- 172.21.15.2:0/814391022 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc380aa620 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc33fff640 1 -- 172.21.15.2:0/814391022 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc380aa780 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc33fff640 1 -- 172.21.15.2:0/814391022 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc380aab10 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- 172.21.15.2:0/814391022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 msgr2=0x7fdc3c160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 --2- 172.21.15.2:0/814391022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c160bb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0cf1b0 tx=0x7fdc3801c4c0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- 172.21.15.2:0/814391022 shutdown_connections 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 --2- 172.21.15.2:0/814391022 >> v2:172.21.15.90:3300/0 conn(0x7fdc3c0cff20 0x7fdc3c0d1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 --2- 172.21.15.2:0/814391022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c160bb0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- 172.21.15.2:0/814391022 >> 172.21.15.2:0/814391022 conn(0x7fdc3c06a890 msgr2=0x7fdc3c06aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- 172.21.15.2:0/814391022 shutdown_connections 2023-11-04T01:45:37.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- 172.21.15.2:0/814391022 wait complete. 2023-11-04T01:45:37.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 Processor -- start 2023-11-04T01:45:37.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- start start 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc3c0cff20 0x7fdc3c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc3c1610f0 0x7fdc3c15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c0b2de0 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c15aaf0 con 0x7fdc3c1610f0 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc435d9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c15add0 con 0x7fdc3c0cff20 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.874+0000 7fdc40b74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c0b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50186/0 (socket says 172.21.15.2:50186) 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 -- 172.21.15.2:0/1654860558 learned_addr learned my addr 172.21.15.2:0/1654860558 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:37.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc41b76640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc3c1610f0 0x7fdc3c15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc41375640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc3c0cff20 0x7fdc3c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 -- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc3c0cff20 msgr2=0x7fdc3c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc3c0cff20 0x7fdc3c0b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 -- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc3c1610f0 msgr2=0x7fdc3c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc3c1610f0 0x7fdc3c15fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 -- 172.21.15.2:0/1654860558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc380094d0 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc41375640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc3c0cff20 0x7fdc3c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc40b74640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c0b28a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c00b410 tx=0x7fdc2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc31ffb640 1 -- 172.21.15.2:0/1654860558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c004020 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc31ffb640 1 -- 172.21.15.2:0/1654860558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c004180 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3c15b0b0 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc31ffb640 1 -- 172.21.15.2:0/1654860558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c011630 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3c0b3010 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3c0744a0 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc31ffb640 1 -- 172.21.15.2:0/1654860558 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdc2c011790 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc31ffb640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdc200664a0 0x7fdc20068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:37.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc31ffb640 1 -- 172.21.15.2:0/1654860558 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fdc2c083ff0 con 0x7fdc3c15d0b0 2023-11-04T01:45:37.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.878+0000 7fdc41375640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdc200664a0 0x7fdc20068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:37.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.882+0000 7fdc41375640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdc200664a0 0x7fdc20068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdc380ae000 tx=0x7fdc38008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:37.882+0000 7fdc31ffb640 1 -- 172.21.15.2:0/1654860558 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc2c051040 con 0x7fdc3c15d0b0 2023-11-04T01:45:38.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.082+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc3c0cd0d0 con 0x7fdc3c15d0b0 2023-11-04T01:45:38.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc31ffb640 1 -- 172.21.15.2:0/1654860558 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc2c054660 con 0x7fdc3c15d0b0 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdc200664a0 msgr2=0x7fdc20068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdc200664a0 0x7fdc20068960 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdc380ae000 tx=0x7fdc38008040 comp rx=0 tx=0).stop 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 msgr2=0x7fdc3c0b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c0b28a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c00b410 tx=0x7fdc2c00b8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 shutdown_connections 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdc200664a0 0x7fdc20068960 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdc3c1610f0 0x7fdc3c15fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc3c15d0b0 0x7fdc3c0b28a0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 --2- 172.21.15.2:0/1654860558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdc3c0cff20 0x7fdc3c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 >> 172.21.15.2:0/1654860558 conn(0x7fdc3c06a890 msgr2=0x7fdc3c0b7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 shutdown_connections 2023-11-04T01:45:38.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.734+0000 7fdc435d9640 1 -- 172.21.15.2:0/1654860558 wait complete. 2023-11-04T01:45:38.761 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-04T01:45:38.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:38.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.890+0000 7fb2d0f17640 1 Processor -- start 2023-11-04T01:45:38.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.890+0000 7fb2d0f17640 1 -- start start 2023-11-04T01:45:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2d0f17640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2cc15d2b0 0x7fb2cc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2d0f17640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d690 0x7fb2cc0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2d0f17640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2cc0cd160 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2d0f17640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc0ad450 con 0x7fb2cc15d2b0 2023-11-04T01:45:38.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2d0f17640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0cd400 con 0x7fb2cc15d690 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2cc15d2b0 0x7fb2cc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2cc15d2b0 0x7fb2cc06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50192/0 (socket says 172.21.15.2:50192) 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1634041128 learned_addr learned my addr 172.21.15.2:0/1634041128 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2c9d9b640 1 --2- 172.21.15.2:0/1634041128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d690 0x7fb2cc0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1634041128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d690 msgr2=0x7fb2cc0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 --2- 172.21.15.2:0/1634041128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d690 0x7fb2cc0ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1634041128 >> v1:172.21.15.90:6789/0 conn(0x7fb2cc06f8f0 legacy=0x7fb2cc0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:38.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1634041128 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0cd6e0 con 0x7fb2cc15d2b0 2023-11-04T01:45:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2ca59c640 1 --2- 172.21.15.2:0/1634041128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc15d2b0 0x7fb2cc06c630 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009e50 tx=0x7fb2bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653858d997c2ab71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2c959a640 1 -- 172.21.15.2:0/1634041128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0a57b0 con 0x7fb2cc15d2b0 2023-11-04T01:45:38.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2c959a640 1 -- 172.21.15.2:0/1634041128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc0a5910 con 0x7fb2cc15d2b0 2023-11-04T01:45:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.894+0000 7fb2c959a640 1 -- 172.21.15.2:0/1634041128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0a5ca0 con 0x7fb2cc15d2b0 2023-11-04T01:45:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1634041128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc15d2b0 msgr2=0x7fb2cc06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1634041128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc15d2b0 0x7fb2cc06c630 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009e50 tx=0x7fb2bc01c910 comp rx=0 tx=0).stop 2023-11-04T01:45:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1634041128 shutdown_connections 2023-11-04T01:45:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1634041128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d690 0x7fb2cc0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1634041128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc15d2b0 0x7fb2cc06c630 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1634041128 >> 172.21.15.2:0/1634041128 conn(0x7fb2cc0cebb0 msgr2=0x7fb2cc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1634041128 shutdown_connections 2023-11-04T01:45:38.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1634041128 wait complete. 2023-11-04T01:45:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 Processor -- start 2023-11-04T01:45:38.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- start start 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc06f8f0 0x7fb2cc0cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d2b0 0x7fb2cc0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc15d690 0x7fb2cc15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0cc230 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc15e2b0 con 0x7fb2cc15d690 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc15daa0 con 0x7fb2cc15d2b0 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc06f8f0 0x7fb2cc0cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc06f8f0 0x7fb2cc0cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50208/0 (socket says 172.21.15.2:50208) 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1054768564 learned_addr learned my addr 172.21.15.2:0/1054768564 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2c9d9b640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d2b0 0x7fb2cc0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2cad9d640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc15d690 0x7fb2cc15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d2b0 msgr2=0x7fb2cc0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d2b0 0x7fb2cc0cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc15d690 msgr2=0x7fb2cc15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc15d690 0x7fb2cc15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 -- 172.21.15.2:0/1054768564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc009b30 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2cad9d640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc15d690 0x7fb2cc15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2c9d9b640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d2b0 0x7fb2cc0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2ca59c640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc06f8f0 0x7fb2cc0cbcf0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc01afc0 tx=0x7fb2bc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:38.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2baffd640 1 -- 172.21.15.2:0/1054768564 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0b8670 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2baffd640 1 -- 172.21.15.2:0/1054768564 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc0b87d0 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc0cb3d0 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2baffd640 1 -- 172.21.15.2:0/1054768564 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0b8b60 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.898+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc15dfd0 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.902+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc0744a0 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.902+0000 7fb2baffd640 1 -- 172.21.15.2:0/1054768564 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2bc0b8cc0 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.902+0000 7fb2baffd640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2ac0664a0 0x7fb2ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.902+0000 7fb2baffd640 1 -- 172.21.15.2:0/1054768564 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fb2bc11fd90 con 0x7fb2cc06f8f0 2023-11-04T01:45:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.902+0000 7fb2c9d9b640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2ac0664a0 0x7fb2ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:38.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.902+0000 7fb2c9d9b640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2ac0664a0 0x7fb2ac068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc160ba0 tx=0x7fb2c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:38.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:38.906+0000 7fb2baffd640 1 -- 172.21.15.2:0/1054768564 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2bc0ece80 con 0x7fb2cc06f8f0 2023-11-04T01:45:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.094+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2cc071cb0 con 0x7fb2cc06f8f0 2023-11-04T01:45:39.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2baffd640 1 -- 172.21.15.2:0/1054768564 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4906 (secure 0 0 0) 0x7fb2bc0f04a0 con 0x7fb2cc06f8f0 2023-11-04T01:45:39.099 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:39.099 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7128,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:38.085913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:39.100 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2ac0664a0 msgr2=0x7fb2ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2ac0664a0 0x7fb2ac068960 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc160ba0 tx=0x7fb2c0008040 comp rx=0 tx=0).stop 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc06f8f0 msgr2=0x7fb2cc0cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc06f8f0 0x7fb2cc0cbcf0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc01afc0 tx=0x7fb2bc0196b0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 shutdown_connections 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2ac0664a0 0x7fb2ac068960 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2cc15d690 0x7fb2cc15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2cc15d2b0 0x7fb2cc0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 --2- 172.21.15.2:0/1054768564 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2cc06f8f0 0x7fb2cc0cbcf0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 >> 172.21.15.2:0/1054768564 conn(0x7fb2cc0cebb0 msgr2=0x7fb2cc0b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 shutdown_connections 2023-11-04T01:45:39.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.098+0000 7fb2d0f17640 1 -- 172.21.15.2:0/1054768564 wait complete. 2023-11-04T01:45:39.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:45:39.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.230+0000 7f30c4caa640 1 Processor -- start 2023-11-04T01:45:39.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30c4caa640 1 -- start start 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30c4caa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f30c00b4990 0x7f30c00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30c4caa640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30c00b74f0 0x7f30c00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30c4caa640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c00b6070 con 0x7f30c00d0690 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30c4caa640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00b8ed0 con 0x7f30c00b74f0 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30c4caa640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c00b52b0 con 0x7f30c00b4990 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30c00b74f0 0x7f30c00cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30c00b74f0 0x7f30c00cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50220/0 (socket says 172.21.15.2:50220) 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 -- 172.21.15.2:0/1236656112 learned_addr learned my addr 172.21.15.2:0/1236656112 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30be59c640 1 --2- 172.21.15.2:0/1236656112 >> v2:172.21.15.90:3300/0 conn(0x7f30c00b4990 0x7f30c00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 -- 172.21.15.2:0/1236656112 >> v2:172.21.15.90:3300/0 conn(0x7f30c00b4990 msgr2=0x7f30c00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 --2- 172.21.15.2:0/1236656112 >> v2:172.21.15.90:3300/0 conn(0x7f30c00b4990 0x7f30c00b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 -- 172.21.15.2:0/1236656112 >> v1:172.21.15.90:6789/0 conn(0x7f30c00d0690 legacy=0x7f30c00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 -- 172.21.15.2:0/1236656112 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00d1ce0 con 0x7f30c00b74f0 2023-11-04T01:45:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bed9d640 1 --2- 172.21.15.2:0/1236656112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00b74f0 0x7f30c00cde80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f30c0160ce0 tx=0x7f30b001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c1c86b11936d72 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.234+0000 7f30bd59a640 1 -- 172.21.15.2:0/1236656112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00a89f0 con 0x7f30c00b74f0 2023-11-04T01:45:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bd59a640 1 -- 172.21.15.2:0/1236656112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b00a8b50 con 0x7f30c00b74f0 2023-11-04T01:45:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bd59a640 1 -- 172.21.15.2:0/1236656112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00b0440 con 0x7f30c00b74f0 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- 172.21.15.2:0/1236656112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00b74f0 msgr2=0x7f30c00cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 --2- 172.21.15.2:0/1236656112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00b74f0 0x7f30c00cde80 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f30c0160ce0 tx=0x7f30b001ecf0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- 172.21.15.2:0/1236656112 shutdown_connections 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 --2- 172.21.15.2:0/1236656112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00b74f0 0x7f30c00cde80 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 --2- 172.21.15.2:0/1236656112 >> v2:172.21.15.90:3300/0 conn(0x7f30c00b4990 0x7f30c00b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- 172.21.15.2:0/1236656112 >> 172.21.15.2:0/1236656112 conn(0x7f30c00cf990 msgr2=0x7f30c00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- 172.21.15.2:0/1236656112 shutdown_connections 2023-11-04T01:45:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- 172.21.15.2:0/1236656112 wait complete. 2023-11-04T01:45:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 Processor -- start 2023-11-04T01:45:39.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- start start 2023-11-04T01:45:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c00b4990 0x7f30c0156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c00b74f0 0x7f30c00d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00d0690 0x7f30c00c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0157580 con 0x7f30c00d0690 2023-11-04T01:45:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0156900 con 0x7f30c00b4990 2023-11-04T01:45:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0156be0 con 0x7f30c00b74f0 2023-11-04T01:45:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00d0690 0x7f30c00c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00d0690 0x7f30c00c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50234/0 (socket says 172.21.15.2:50234) 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 -- 172.21.15.2:0/3094537794 learned_addr learned my addr 172.21.15.2:0/3094537794 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30be59c640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c00b4990 0x7f30c0156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bdd9b640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c00b74f0 0x7f30c00d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 -- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c00b74f0 msgr2=0x7f30c00d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c00b74f0 0x7f30c00d35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 -- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c00b4990 msgr2=0x7f30c0156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c00b4990 0x7f30c0156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 -- 172.21.15.2:0/3094537794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00094d0 con 0x7f30c00d0690 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30be59c640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c00b4990 0x7f30c0156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30bed9d640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00d0690 0x7f30c00c87b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f30b00b3040 tx=0x7f30b001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30b6ffd640 1 -- 172.21.15.2:0/3094537794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00b0d20 con 0x7f30c00d0690 2023-11-04T01:45:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30b6ffd640 1 -- 172.21.15.2:0/3094537794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b00b0e80 con 0x7f30c00d0690 2023-11-04T01:45:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c0156ec0 con 0x7f30c00d0690 2023-11-04T01:45:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30b6ffd640 1 -- 172.21.15.2:0/3094537794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00bb670 con 0x7f30c00d0690 2023-11-04T01:45:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.238+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c0154110 con 0x7f30c00d0690 2023-11-04T01:45:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.242+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c01576c0 con 0x7f30c00d0690 2023-11-04T01:45:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.242+0000 7f30b6ffd640 1 -- 172.21.15.2:0/3094537794 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30b00b7070 con 0x7f30c00d0690 2023-11-04T01:45:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.242+0000 7f30b6ffd640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30a00664d0 0x7f30a0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.242+0000 7f30b6ffd640 1 -- 172.21.15.2:0/3094537794 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f30b01224f0 con 0x7f30c00d0690 2023-11-04T01:45:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.242+0000 7f30be59c640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30a00664d0 0x7f30a0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.242+0000 7f30be59c640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30a00664d0 0x7f30a0068990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f30c00ccfb0 tx=0x7f30b800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.246+0000 7f30b6ffd640 1 -- 172.21.15.2:0/3094537794 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f30c01576c0 con 0x7f30c00d0690 2023-11-04T01:45:39.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.402+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30c01576c0 con 0x7f30c00d0690 2023-11-04T01:45:39.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30b6ffd640 1 -- 172.21.15.2:0/3094537794 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+21660 (secure 0 0 0) 0x7f30c01576c0 con 0x7f30c00d0690 2023-11-04T01:45:39.408 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:45:36.694427+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30a00664d0 msgr2=0x7f30a0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30a00664d0 0x7f30a0068990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f30c00ccfb0 tx=0x7f30b800b040 comp rx=0 tx=0).stop 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00d0690 msgr2=0x7f30c00c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00d0690 0x7f30c00c87b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f30b00b3040 tx=0x7f30b001ba90 comp rx=0 tx=0).stop 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 shutdown_connections 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30a00664d0 0x7f30a0068990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30c00d0690 0x7f30c00c87b0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30c00b74f0 0x7f30c00d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 --2- 172.21.15.2:0/3094537794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c00b4990 0x7f30c0156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 >> 172.21.15.2:0/3094537794 conn(0x7f30c00cf990 msgr2=0x7f30c015f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 shutdown_connections 2023-11-04T01:45:39.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.406+0000 7f30c4caa640 1 -- 172.21.15.2:0/3094537794 wait complete. 2023-11-04T01:45:39.426 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-04T01:45:39.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:45:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04ca083640 1 Processor -- start 2023-11-04T01:45:39.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04ca083640 1 -- start start 2023-11-04T01:45:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04ca083640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f04c40b0a90 0x7f04c415f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04ca083640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c406bb30 con 0x7f04c415b320 2023-11-04T01:45:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04ca083640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c406be10 con 0x7f04c40b0630 2023-11-04T01:45:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04ca083640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c406c7b0 con 0x7f04c40b0a90 2023-11-04T01:45:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f04c415b320 0x7f04c406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37222/0 (socket says 172.21.15.2:37222) 2023-11-04T01:45:39.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 -- 172.21.15.2:0/1287475772 learned_addr learned my addr 172.21.15.2:0/1287475772 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c3fff640 1 --2- 172.21.15.2:0/1287475772 >> v2:172.21.15.90:3300/0 conn(0x7f04c40b0a90 0x7f04c415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508353875 0 0) 0x7f04c406bb30 con 0x7f04c415b320 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b0003530 con 0x7f04c415b320 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284762962 0 0) 0x7f04b0003530 con 0x7f04c415b320 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 >> v2:172.21.15.90:3300/0 conn(0x7f04c40b0a90 msgr2=0x7f04c415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 --2- 172.21.15.2:0/1287475772 >> v2:172.21.15.90:3300/0 conn(0x7f04c40b0a90 0x7f04c415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 >> v1:172.21.15.90:6789/0 conn(0x7f04c40b0630 legacy=0x7f04c415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c406c0f0 con 0x7f04c415b320 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f04b4001680 con 0x7f04c415b320 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 >> v1:172.21.15.2:6789/0 conn(0x7f04c415b320 legacy=0x7f04c406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0003980 0x7f04b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04b00047d0 0x7f04b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0005190 0x7f04b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c406c7b0 con 0x7f04b0003980 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b000c130 con 0x7f04b0005190 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b000c2f0 con 0x7f04b00047d0 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0003980 0x7f04b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04baffd640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04b00047d0 0x7f04b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c3fff640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0005190 0x7f04b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 -- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04b00047d0 msgr2=0x7f04b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04b00047d0 0x7f04b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 -- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0005190 msgr2=0x7f04b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0005190 0x7f04b000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c37fe640 1 -- 172.21.15.2:0/1287475772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0003530 con 0x7f04b0003980 2023-11-04T01:45:39.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.546+0000 7f04c3fff640 1 -- 172.21.15.2:0/1287475772 reap_dead start 2023-11-04T01:45:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04c37fe640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0003980 0x7f04b0003da0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c1c0 tx=0x7f04b401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d44cf05ec1bf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4005ae0 con 0x7f04b0003980 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4005c40 con 0x7f04b0003980 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04c2ffd640 1 -- 172.21.15.2:0/1287475772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40072b0 con 0x7f04b0003980 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- 172.21.15.2:0/1287475772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0003980 msgr2=0x7f04b0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0003980 0x7f04b0003da0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f04b400c1c0 tx=0x7f04b401cbb0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- 172.21.15.2:0/1287475772 shutdown_connections 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 --2- 172.21.15.2:0/1287475772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04b0003980 0x7f04b0003da0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- 172.21.15.2:0/1287475772 >> 172.21.15.2:0/1287475772 conn(0x7f04c40cebb0 msgr2=0x7f04c40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- 172.21.15.2:0/1287475772 shutdown_connections 2023-11-04T01:45:39.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- 172.21.15.2:0/1287475772 wait complete. 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 Processor -- start 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- start start 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0003980 0x7f04c414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04c41f44c0 0x7f04c415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c415e530 0x7f04c4151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c415e9c0 con 0x7f04c415e530 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41500b0 con 0x7f04b0003980 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.550+0000 7f04ca083640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c414e5e0 con 0x7f04c41f44c0 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c415e530 0x7f04c4151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c415e530 0x7f04c4151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50250/0 (socket says 172.21.15.2:50250) 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 -- 172.21.15.2:0/544479826 learned_addr learned my addr 172.21.15.2:0/544479826 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 -- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04c41f44c0 msgr2=0x7f04c415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04baffd640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04c41f44c0 0x7f04c415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c37fe640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0003980 0x7f04c414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04c41f44c0 0x7f04c415dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 -- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0003980 msgr2=0x7f04c414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0003980 0x7f04c414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 -- 172.21.15.2:0/544479826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4150820 con 0x7f04c415e530 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c3fff640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c415e530 0x7f04c4151e50 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009f50 tx=0x7f04bc00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c0ff9640 1 -- 172.21.15.2:0/544479826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc016420 con 0x7f04c415e530 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c0ff9640 1 -- 172.21.15.2:0/544479826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc0165a0 con 0x7f04c415e530 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c4153340 con 0x7f04c415e530 2023-11-04T01:45:39.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c0ff9640 1 -- 172.21.15.2:0/544479826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc016950 con 0x7f04c415e530 2023-11-04T01:45:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c4152d80 con 0x7f04c415e530 2023-11-04T01:45:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c41509b0 con 0x7f04c415e530 2023-11-04T01:45:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c0ff9640 1 -- 172.21.15.2:0/544479826 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04bc016ab0 con 0x7f04c415e530 2023-11-04T01:45:39.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c0ff9640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a40664d0 0x7f04a4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c0ff9640 1 -- 172.21.15.2:0/544479826 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f04bc0852c0 con 0x7f04c415e530 2023-11-04T01:45:39.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c37fe640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a40664d0 0x7f04a4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.554+0000 7f04c37fe640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a40664d0 0x7f04a4068990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f04b40ab000 tx=0x7f04b40a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.558+0000 7f04c0ff9640 1 -- 172.21.15.2:0/544479826 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f04bc052310 con 0x7f04c415e530 2023-11-04T01:45:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.710+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04c415b710 con 0x7f04a40664d0 2023-11-04T01:45:39.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.762+0000 7f04c0ff9640 1 -- 172.21.15.2:0/544479826 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+530273 (secure 0 0 0) 0x7f04b4005920 con 0x7f04a40664d0 2023-11-04T01:45:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:39.773 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a40664d0 msgr2=0x7f04a4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a40664d0 0x7f04a4068990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f04b40ab000 tx=0x7f04b40a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c415e530 msgr2=0x7f04c4151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c415e530 0x7f04c4151e50 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009f50 tx=0x7f04bc00f520 comp rx=0 tx=0).stop 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 shutdown_connections 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a40664d0 0x7f04a4068990 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04c415e530 0x7f04c4151e50 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04c41f44c0 0x7f04c415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 --2- 172.21.15.2:0/544479826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04b0003980 0x7f04c414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 >> 172.21.15.2:0/544479826 conn(0x7f04c40cebb0 msgr2=0x7f04c4157080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 shutdown_connections 2023-11-04T01:45:39.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.770+0000 7f04ca083640 1 -- 172.21.15.2:0/544479826 wait complete. 2023-11-04T01:45:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-11-04T01:45:38.844468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":252,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250992,"kb_used_data":9836,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723728,"statfs":{"total":773094113280,"available":772837097472,"internally_reserved":0,"allocated":10072064,"data_stored":5321328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.210809"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730885+0000","last_change":"2023-11-04T01:45:35.719965+0000","last_active":"2023-11-04T01:45:35.730885+0000","last_peered":"2023-11-04T01:45:35.730885+0000","last_clean":"2023-11-04T01:45:35.730885+0000","last_became_active":"2023-11-04T01:45:35.719022+0000","last_became_peered":"2023-11-04T01:45:35.719022+0000","last_unstale":"2023-11-04T01:45:35.730885+0000","last_undegraded":"2023-11-04T01:45:35.730885+0000","last_fullsized":"2023-11-04T01:45:35.730885+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:57.504771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714298+0000","last_change":"2023-11-04T01:45:35.718414+0000","last_active":"2023-11-04T01:45:36.714298+0000","last_peered":"2023-11-04T01:45:36.714298+0000","last_clean":"2023-11-04T01:45:36.714298+0000","last_became_active":"2023-11-04T01:45:35.718110+0000","last_became_peered":"2023-11-04T01:45:35.718110+0000","last_unstale":"2023-11-04T01:45:36.714298+0000","last_undegraded":"2023-11-04T01:45:36.714298+0000","last_fullsized":"2023-11-04T01:45:36.714298+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:41:17.909017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731275+0000","last_change":"2023-11-04T01:45:35.723554+0000","last_active":"2023-11-04T01:45:35.731275+0000","last_peered":"2023-11-04T01:45:35.731275+0000","last_clean":"2023-11-04T01:45:35.731275+0000","last_became_active":"2023-11-04T01:45:35.723219+0000","last_became_peered":"2023-11-04T01:45:35.723219+0000","last_unstale":"2023-11-04T01:45:35.731275+0000","last_undegraded":"2023-11-04T01:45:35.731275+0000","last_fullsized":"2023-11-04T01:45:35.731275+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:32.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731870+0000","last_change":"2023-11-04T01:45:35.718601+0000","last_active":"2023-11-04T01:45:35.731870+0000","last_peered":"2023-11-04T01:45:35.731870+0000","last_clean":"2023-11-04T01:45:35.731870+0000","last_became_active":"2023-11-04T01:45:35.717932+0000","last_became_peered":"2023-11-04T01:45:35.717932+0000","last_unstale":"2023-11-04T01:45:35.731870+0000","last_undegraded":"2023-11-04T01:45:35.731870+0000","last_fullsized":"2023-11-04T01:45:35.731870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:54.923348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711306+0000","last_change":"2023-11-04T01:45:35.706439+0000","last_active":"2023-11-04T01:45:35.711306+0000","last_peered":"2023-11-04T01:45:35.711306+0000","last_clean":"2023-11-04T01:45:35.711306+0000","last_became_active":"2023-11-04T01:45:35.706113+0000","last_became_peered":"2023-11-04T01:45:35.706113+0000","last_unstale":"2023-11-04T01:45:35.711306+0000","last_undegraded":"2023-11-04T01:45:35.711306+0000","last_fullsized":"2023-11-04T01:45:35.711306+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:33.433637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725606+0000","last_change":"2023-11-04T01:45:35.720933+0000","last_active":"2023-11-04T01:45:35.725606+0000","last_peered":"2023-11-04T01:45:35.725606+0000","last_clean":"2023-11-04T01:45:35.725606+0000","last_became_active":"2023-11-04T01:45:35.720432+0000","last_became_peered":"2023-11-04T01:45:35.720432+0000","last_unstale":"2023-11-04T01:45:35.725606+0000","last_undegraded":"2023-11-04T01:45:35.725606+0000","last_fullsized":"2023-11-04T01:45:35.725606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:09:54.105313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729811+0000","last_change":"2023-11-04T01:45:35.727214+0000","last_active":"2023-11-04T01:45:35.729811+0000","last_peered":"2023-11-04T01:45:35.729811+0000","last_clean":"2023-11-04T01:45:35.729811+0000","last_became_active":"2023-11-04T01:45:35.726834+0000","last_became_peered":"2023-11-04T01:45:35.726834+0000","last_unstale":"2023-11-04T01:45:35.729811+0000","last_undegraded":"2023-11-04T01:45:35.729811+0000","last_fullsized":"2023-11-04T01:45:35.729811+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:53.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.726809+0000","last_change":"2023-11-04T01:45:35.721060+0000","last_active":"2023-11-04T01:45:35.726809+0000","last_peered":"2023-11-04T01:45:35.726809+0000","last_clean":"2023-11-04T01:45:35.726809+0000","last_became_active":"2023-11-04T01:45:35.720540+0000","last_became_peered":"2023-11-04T01:45:35.720540+0000","last_unstale":"2023-11-04T01:45:35.726809+0000","last_undegraded":"2023-11-04T01:45:35.726809+0000","last_fullsized":"2023-11-04T01:45:35.726809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:52.193632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714163+0000","last_change":"2023-11-04T01:45:35.706230+0000","last_active":"2023-11-04T01:45:36.714163+0000","last_peered":"2023-11-04T01:45:36.714163+0000","last_clean":"2023-11-04T01:45:36.714163+0000","last_became_active":"2023-11-04T01:45:35.705761+0000","last_became_peered":"2023-11-04T01:45:35.705761+0000","last_unstale":"2023-11-04T01:45:36.714163+0000","last_undegraded":"2023-11-04T01:45:36.714163+0000","last_fullsized":"2023-11-04T01:45:36.714163+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.101558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.721557+0000","last_change":"2023-11-04T01:45:35.714145+0000","last_active":"2023-11-04T01:45:35.721557+0000","last_peered":"2023-11-04T01:45:35.721557+0000","last_clean":"2023-11-04T01:45:35.721557+0000","last_became_active":"2023-11-04T01:45:35.713520+0000","last_became_peered":"2023-11-04T01:45:35.713520+0000","last_unstale":"2023-11-04T01:45:35.721557+0000","last_undegraded":"2023-11-04T01:45:35.721557+0000","last_fullsized":"2023-11-04T01:45:35.721557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:42.028475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.726466+0000","last_change":"2023-11-04T01:45:35.724902+0000","last_active":"2023-11-04T01:45:35.726466+0000","last_peered":"2023-11-04T01:45:35.726466+0000","last_clean":"2023-11-04T01:45:35.726466+0000","last_became_active":"2023-11-04T01:45:35.724510+0000","last_became_peered":"2023-11-04T01:45:35.724510+0000","last_unstale":"2023-11-04T01:45:35.726466+0000","last_undegraded":"2023-11-04T01:45:35.726466+0000","last_fullsized":"2023-11-04T01:45:35.726466+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:28.258054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.734057+0000","last_change":"2023-11-04T01:45:35.732858+0000","last_active":"2023-11-04T01:45:35.734057+0000","last_peered":"2023-11-04T01:45:35.734057+0000","last_clean":"2023-11-04T01:45:35.734057+0000","last_became_active":"2023-11-04T01:45:35.732554+0000","last_became_peered":"2023-11-04T01:45:35.732554+0000","last_unstale":"2023-11-04T01:45:35.734057+0000","last_undegraded":"2023-11-04T01:45:35.734057+0000","last_fullsized":"2023-11-04T01:45:35.734057+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:09.131582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725335+0000","last_change":"2023-11-04T01:45:35.711179+0000","last_active":"2023-11-04T01:45:35.725335+0000","last_peered":"2023-11-04T01:45:35.725335+0000","last_clean":"2023-11-04T01:45:35.725335+0000","last_became_active":"2023-11-04T01:45:35.710908+0000","last_became_peered":"2023-11-04T01:45:35.710908+0000","last_unstale":"2023-11-04T01:45:35.725335+0000","last_undegraded":"2023-11-04T01:45:35.725335+0000","last_fullsized":"2023-11-04T01:45:35.725335+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:05.391511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730654+0000","last_change":"2023-11-04T01:45:35.727969+0000","last_active":"2023-11-04T01:45:35.730654+0000","last_peered":"2023-11-04T01:45:35.730654+0000","last_clean":"2023-11-04T01:45:35.730654+0000","last_became_active":"2023-11-04T01:45:35.727601+0000","last_became_peered":"2023-11-04T01:45:35.727601+0000","last_unstale":"2023-11-04T01:45:35.730654+0000","last_undegraded":"2023-11-04T01:45:35.730654+0000","last_fullsized":"2023-11-04T01:45:35.730654+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:50.075826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.713747+0000","last_change":"2023-11-04T01:45:35.709984+0000","last_active":"2023-11-04T01:45:36.713747+0000","last_peered":"2023-11-04T01:45:36.713747+0000","last_clean":"2023-11-04T01:45:36.713747+0000","last_became_active":"2023-11-04T01:45:35.709512+0000","last_became_peered":"2023-11-04T01:45:35.709512+0000","last_unstale":"2023-11-04T01:45:36.713747+0000","last_undegraded":"2023-11-04T01:45:36.713747+0000","last_fullsized":"2023-11-04T01:45:36.713747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:10.642497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732644+0000","last_change":"2023-11-04T01:45:35.728373+0000","last_active":"2023-11-04T01:45:35.732644+0000","last_peered":"2023-11-04T01:45:35.732644+0000","last_clean":"2023-11-04T01:45:35.732644+0000","last_became_active":"2023-11-04T01:45:35.728100+0000","last_became_peered":"2023-11-04T01:45:35.728100+0000","last_unstale":"2023-11-04T01:45:35.732644+0000","last_undegraded":"2023-11-04T01:45:35.732644+0000","last_fullsized":"2023-11-04T01:45:35.732644+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:52.558482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731248+0000","last_change":"2023-11-04T01:45:35.725297+0000","last_active":"2023-11-04T01:45:35.731248+0000","last_peered":"2023-11-04T01:45:35.731248+0000","last_clean":"2023-11-04T01:45:35.731248+0000","last_became_active":"2023-11-04T01:45:35.724477+0000","last_became_peered":"2023-11-04T01:45:35.724477+0000","last_unstale":"2023-11-04T01:45:35.731248+0000","last_undegraded":"2023-11-04T01:45:35.731248+0000","last_fullsized":"2023-11-04T01:45:35.731248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:15.212996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714838+0000","last_change":"2023-11-04T01:45:35.707869+0000","last_active":"2023-11-04T01:45:36.714838+0000","last_peered":"2023-11-04T01:45:36.714838+0000","last_clean":"2023-11-04T01:45:36.714838+0000","last_became_active":"2023-11-04T01:45:35.705604+0000","last_became_peered":"2023-11-04T01:45:35.705604+0000","last_unstale":"2023-11-04T01:45:36.714838+0000","last_undegraded":"2023-11-04T01:45:36.714838+0000","last_fullsized":"2023-11-04T01:45:36.714838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:55.382394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732020+0000","last_change":"2023-11-04T01:45:35.721450+0000","last_active":"2023-11-04T01:45:35.732020+0000","last_peered":"2023-11-04T01:45:35.732020+0000","last_clean":"2023-11-04T01:45:35.732020+0000","last_became_active":"2023-11-04T01:45:35.719913+0000","last_became_peered":"2023-11-04T01:45:35.719913+0000","last_unstale":"2023-11-04T01:45:35.732020+0000","last_undegraded":"2023-11-04T01:45:35.732020+0000","last_fullsized":"2023-11-04T01:45:35.732020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:08.671745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732386+0000","last_change":"2023-11-04T01:45:35.720072+0000","last_active":"2023-11-04T01:45:35.732386+0000","last_peered":"2023-11-04T01:45:35.732386+0000","last_clean":"2023-11-04T01:45:35.732386+0000","last_became_active":"2023-11-04T01:45:35.719653+0000","last_became_peered":"2023-11-04T01:45:35.719653+0000","last_unstale":"2023-11-04T01:45:35.732386+0000","last_undegraded":"2023-11-04T01:45:35.732386+0000","last_fullsized":"2023-11-04T01:45:35.732386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:18.449067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732752+0000","last_change":"2023-11-04T01:45:35.730014+0000","last_active":"2023-11-04T01:45:35.732752+0000","last_peered":"2023-11-04T01:45:35.732752+0000","last_clean":"2023-11-04T01:45:35.732752+0000","last_became_active":"2023-11-04T01:45:35.729677+0000","last_became_peered":"2023-11-04T01:45:35.729677+0000","last_unstale":"2023-11-04T01:45:35.732752+0000","last_undegraded":"2023-11-04T01:45:35.732752+0000","last_fullsized":"2023-11-04T01:45:35.732752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:39.584457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738288+0000","last_change":"2023-11-04T01:45:35.725543+0000","last_active":"2023-11-04T01:45:35.738288+0000","last_peered":"2023-11-04T01:45:35.738288+0000","last_clean":"2023-11-04T01:45:35.738288+0000","last_became_active":"2023-11-04T01:45:35.725047+0000","last_became_peered":"2023-11-04T01:45:35.725047+0000","last_unstale":"2023-11-04T01:45:35.738288+0000","last_undegraded":"2023-11-04T01:45:35.738288+0000","last_fullsized":"2023-11-04T01:45:35.738288+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:08.994535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725170+0000","last_change":"2023-11-04T01:45:35.710342+0000","last_active":"2023-11-04T01:45:35.725170+0000","last_peered":"2023-11-04T01:45:35.725170+0000","last_clean":"2023-11-04T01:45:35.725170+0000","last_became_active":"2023-11-04T01:45:35.710109+0000","last_became_peered":"2023-11-04T01:45:35.710109+0000","last_unstale":"2023-11-04T01:45:35.725170+0000","last_undegraded":"2023-11-04T01:45:35.725170+0000","last_fullsized":"2023-11-04T01:45:35.725170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:07.950999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738368+0000","last_change":"2023-11-04T01:45:35.733421+0000","last_active":"2023-11-04T01:45:35.738368+0000","last_peered":"2023-11-04T01:45:35.738368+0000","last_clean":"2023-11-04T01:45:35.738368+0000","last_became_active":"2023-11-04T01:45:35.733080+0000","last_became_peered":"2023-11-04T01:45:35.733080+0000","last_unstale":"2023-11-04T01:45:35.738368+0000","last_undegraded":"2023-11-04T01:45:35.738368+0000","last_fullsized":"2023-11-04T01:45:35.738368+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:42.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.719626+0000","last_change":"2023-11-04T01:45:35.712898+0000","last_active":"2023-11-04T01:45:35.719626+0000","last_peered":"2023-11-04T01:45:35.719626+0000","last_clean":"2023-11-04T01:45:35.719626+0000","last_became_active":"2023-11-04T01:45:35.712510+0000","last_became_peered":"2023-11-04T01:45:35.712510+0000","last_unstale":"2023-11-04T01:45:35.719626+0000","last_undegraded":"2023-11-04T01:45:35.719626+0000","last_fullsized":"2023-11-04T01:45:35.719626+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:18.593633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.719592+0000","last_change":"2023-11-04T01:45:35.713287+0000","last_active":"2023-11-04T01:45:35.719592+0000","last_peered":"2023-11-04T01:45:35.719592+0000","last_clean":"2023-11-04T01:45:35.719592+0000","last_became_active":"2023-11-04T01:45:35.712638+0000","last_became_peered":"2023-11-04T01:45:35.712638+0000","last_unstale":"2023-11-04T01:45:35.719592+0000","last_undegraded":"2023-11-04T01:45:35.719592+0000","last_fullsized":"2023-11-04T01:45:35.719592+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:39.584457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730319+0000","last_change":"2023-11-04T01:45:35.719833+0000","last_active":"2023-11-04T01:45:35.730319+0000","last_peered":"2023-11-04T01:45:35.730319+0000","last_clean":"2023-11-04T01:45:35.730319+0000","last_became_active":"2023-11-04T01:45:35.719449+0000","last_became_peered":"2023-11-04T01:45:35.719449+0000","last_unstale":"2023-11-04T01:45:35.730319+0000","last_undegraded":"2023-11-04T01:45:35.730319+0000","last_fullsized":"2023-11-04T01:45:35.730319+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:42.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.720895+0000","last_change":"2023-11-04T01:45:35.717118+0000","last_active":"2023-11-04T01:45:35.720895+0000","last_peered":"2023-11-04T01:45:35.720895+0000","last_clean":"2023-11-04T01:45:35.720895+0000","last_became_active":"2023-11-04T01:45:35.716645+0000","last_became_peered":"2023-11-04T01:45:35.716645+0000","last_unstale":"2023-11-04T01:45:35.720895+0000","last_undegraded":"2023-11-04T01:45:35.720895+0000","last_fullsized":"2023-11-04T01:45:35.720895+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:13.310687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725703+0000","last_change":"2023-11-04T01:45:35.720704+0000","last_active":"2023-11-04T01:45:35.725703+0000","last_peered":"2023-11-04T01:45:35.725703+0000","last_clean":"2023-11-04T01:45:35.725703+0000","last_became_active":"2023-11-04T01:45:35.720357+0000","last_became_peered":"2023-11-04T01:45:35.720357+0000","last_unstale":"2023-11-04T01:45:35.725703+0000","last_undegraded":"2023-11-04T01:45:35.725703+0000","last_fullsized":"2023-11-04T01:45:35.725703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:50.027695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711090+0000","last_change":"2023-11-04T01:45:35.707420+0000","last_active":"2023-11-04T01:45:35.711090+0000","last_peered":"2023-11-04T01:45:35.711090+0000","last_clean":"2023-11-04T01:45:35.711090+0000","last_became_active":"2023-11-04T01:45:35.706958+0000","last_became_peered":"2023-11-04T01:45:35.706958+0000","last_unstale":"2023-11-04T01:45:35.711090+0000","last_undegraded":"2023-11-04T01:45:35.711090+0000","last_fullsized":"2023-11-04T01:45:35.711090+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:00.941423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730677+0000","last_change":"2023-11-04T01:45:35.728524+0000","last_active":"2023-11-04T01:45:35.730677+0000","last_peered":"2023-11-04T01:45:35.730677+0000","last_clean":"2023-11-04T01:45:35.730677+0000","last_became_active":"2023-11-04T01:45:35.728241+0000","last_became_peered":"2023-11-04T01:45:35.728241+0000","last_unstale":"2023-11-04T01:45:35.730677+0000","last_undegraded":"2023-11-04T01:45:35.730677+0000","last_fullsized":"2023-11-04T01:45:35.730677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:52.558482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741400+0000","last_change":"2023-11-04T01:45:35.731694+0000","last_active":"2023-11-04T01:45:35.741400+0000","last_peered":"2023-11-04T01:45:35.741400+0000","last_clean":"2023-11-04T01:45:35.741400+0000","last_became_active":"2023-11-04T01:45:35.726303+0000","last_became_peered":"2023-11-04T01:45:35.726303+0000","last_unstale":"2023-11-04T01:45:35.741400+0000","last_undegraded":"2023-11-04T01:45:35.741400+0000","last_fullsized":"2023-11-04T01:45:35.741400+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:58.659351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.721377+0000","last_change":"2023-11-04T01:45:35.719844+0000","last_active":"2023-11-04T01:45:35.721377+0000","last_peered":"2023-11-04T01:45:35.721377+0000","last_clean":"2023-11-04T01:45:35.721377+0000","last_became_active":"2023-11-04T01:45:35.719340+0000","last_became_peered":"2023-11-04T01:45:35.719340+0000","last_unstale":"2023-11-04T01:45:35.721377+0000","last_undegraded":"2023-11-04T01:45:35.721377+0000","last_fullsized":"2023-11-04T01:45:35.721377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:01.872461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738418+0000","last_change":"2023-11-04T01:45:34.690689+0000","last_active":"2023-11-04T01:45:35.738418+0000","last_peered":"2023-11-04T01:45:35.738418+0000","last_clean":"2023-11-04T01:45:35.738418+0000","last_became_active":"2023-11-04T01:45:34.690022+0000","last_became_peered":"2023-11-04T01:45:34.690022+0000","last_unstale":"2023-11-04T01:45:35.738418+0000","last_undegraded":"2023-11-04T01:45:35.738418+0000","last_fullsized":"2023-11-04T01:45:35.738418+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:53.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670461+0000","last_change":"2023-11-04T01:44:41.931890+0000","last_active":"2023-11-04T01:45:34.670461+0000","last_peered":"2023-11-04T01:45:34.670461+0000","last_clean":"2023-11-04T01:45:34.670461+0000","last_became_active":"2023-11-04T01:44:41.931428+0000","last_became_peered":"2023-11-04T01:44:41.931428+0000","last_unstale":"2023-11-04T01:45:34.670461+0000","last_undegraded":"2023-11-04T01:45:34.670461+0000","last_fullsized":"2023-11-04T01:45:34.670461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:35.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.666342+0000","last_change":"2023-11-04T01:44:43.171663+0000","last_active":"2023-11-04T01:45:34.666342+0000","last_peered":"2023-11-04T01:45:34.666342+0000","last_clean":"2023-11-04T01:45:34.666342+0000","last_became_active":"2023-11-04T01:44:40.925496+0000","last_became_peered":"2023-11-04T01:44:40.925496+0000","last_unstale":"2023-11-04T01:45:34.666342+0000","last_undegraded":"2023-11-04T01:45:34.666342+0000","last_fullsized":"2023-11-04T01:45:34.666342+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:59.630466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987024,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.652537+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:45:34.652537+0000","last_peered":"2023-11-04T01:45:34.652537+0000","last_clean":"2023-11-04T01:45:34.652537+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:45:34.652537+0000","last_undegraded":"2023-11-04T01:45:34.652537+0000","last_fullsized":"2023-11-04T01:45:34.652537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671195+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:45:34.671195+0000","last_peered":"2023-11-04T01:45:34.671195+0000","last_clean":"2023-11-04T01:45:34.671195+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:45:34.671195+0000","last_undegraded":"2023-11-04T01:45:34.671195+0000","last_fullsized":"2023-11-04T01:45:34.671195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738447+0000","last_change":"2023-11-04T01:45:35.731722+0000","last_active":"2023-11-04T01:45:35.738447+0000","last_peered":"2023-11-04T01:45:35.738447+0000","last_clean":"2023-11-04T01:45:35.738447+0000","last_became_active":"2023-11-04T01:45:35.728684+0000","last_became_peered":"2023-11-04T01:45:35.728684+0000","last_unstale":"2023-11-04T01:45:35.738447+0000","last_undegraded":"2023-11-04T01:45:35.738447+0000","last_fullsized":"2023-11-04T01:45:35.738447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:16.108301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.735239+0000","last_change":"2023-11-04T01:45:34.687817+0000","last_active":"2023-11-04T01:45:35.735239+0000","last_peered":"2023-11-04T01:45:35.735239+0000","last_clean":"2023-11-04T01:45:35.735239+0000","last_became_active":"2023-11-04T01:45:34.687083+0000","last_became_peered":"2023-11-04T01:45:34.687083+0000","last_unstale":"2023-11-04T01:45:35.735239+0000","last_undegraded":"2023-11-04T01:45:35.735239+0000","last_fullsized":"2023-11-04T01:45:35.735239+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:52.348282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657849+0000","last_change":"2023-11-04T01:44:41.934578+0000","last_active":"2023-11-04T01:45:34.657849+0000","last_peered":"2023-11-04T01:45:34.657849+0000","last_clean":"2023-11-04T01:45:34.657849+0000","last_became_active":"2023-11-04T01:44:41.932591+0000","last_became_peered":"2023-11-04T01:44:41.932591+0000","last_unstale":"2023-11-04T01:45:34.657849+0000","last_undegraded":"2023-11-04T01:45:34.657849+0000","last_fullsized":"2023-11-04T01:45:34.657849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:29.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691478+0000","last_change":"2023-11-04T01:44:42.906847+0000","last_active":"2023-11-04T01:45:35.691478+0000","last_peered":"2023-11-04T01:45:35.691478+0000","last_clean":"2023-11-04T01:45:35.691478+0000","last_became_active":"2023-11-04T01:44:40.908611+0000","last_became_peered":"2023-11-04T01:44:40.908611+0000","last_unstale":"2023-11-04T01:45:35.691478+0000","last_undegraded":"2023-11-04T01:45:35.691478+0000","last_fullsized":"2023-11-04T01:45:35.691478+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:44.272984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044006599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.669791+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:45:34.669791+0000","last_peered":"2023-11-04T01:45:34.669791+0000","last_clean":"2023-11-04T01:45:34.669791+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:45:34.669791+0000","last_undegraded":"2023-11-04T01:45:34.669791+0000","last_fullsized":"2023-11-04T01:45:34.669791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741538+0000","last_change":"2023-11-04T01:45:35.734069+0000","last_active":"2023-11-04T01:45:35.741538+0000","last_peered":"2023-11-04T01:45:35.741538+0000","last_clean":"2023-11-04T01:45:35.741538+0000","last_became_active":"2023-11-04T01:45:35.733472+0000","last_became_peered":"2023-11-04T01:45:35.733472+0000","last_unstale":"2023-11-04T01:45:35.741538+0000","last_undegraded":"2023-11-04T01:45:35.741538+0000","last_fullsized":"2023-11-04T01:45:35.741538+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:48.378587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711591+0000","last_change":"2023-11-04T01:45:34.687501+0000","last_active":"2023-11-04T01:45:35.711591+0000","last_peered":"2023-11-04T01:45:35.711591+0000","last_clean":"2023-11-04T01:45:35.711591+0000","last_became_active":"2023-11-04T01:45:34.686765+0000","last_became_peered":"2023-11-04T01:45:34.686765+0000","last_unstale":"2023-11-04T01:45:35.711591+0000","last_undegraded":"2023-11-04T01:45:35.711591+0000","last_fullsized":"2023-11-04T01:45:35.711591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:00.861508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673717+0000","last_change":"2023-11-04T01:44:41.924659+0000","last_active":"2023-11-04T01:45:34.673717+0000","last_peered":"2023-11-04T01:45:34.673717+0000","last_clean":"2023-11-04T01:45:34.673717+0000","last_became_active":"2023-11-04T01:44:41.923887+0000","last_became_peered":"2023-11-04T01:44:41.923887+0000","last_unstale":"2023-11-04T01:45:34.673717+0000","last_undegraded":"2023-11-04T01:45:34.673717+0000","last_fullsized":"2023-11-04T01:45:34.673717+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:59.201022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.690750+0000","last_change":"2023-11-04T01:44:42.906331+0000","last_active":"2023-11-04T01:45:35.690750+0000","last_peered":"2023-11-04T01:45:35.690750+0000","last_clean":"2023-11-04T01:45:35.690750+0000","last_became_active":"2023-11-04T01:44:40.923564+0000","last_became_peered":"2023-11-04T01:44:40.923564+0000","last_unstale":"2023-11-04T01:45:35.690750+0000","last_undegraded":"2023-11-04T01:45:35.690750+0000","last_fullsized":"2023-11-04T01:45:35.690750+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:58.191219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038764860000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.689177+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:45:35.689177+0000","last_peered":"2023-11-04T01:45:35.689177+0000","last_clean":"2023-11-04T01:45:35.689177+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:45:35.689177+0000","last_undegraded":"2023-11-04T01:45:35.689177+0000","last_fullsized":"2023-11-04T01:45:35.689177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741385+0000","last_change":"2023-11-04T01:45:35.731324+0000","last_active":"2023-11-04T01:45:35.741385+0000","last_peered":"2023-11-04T01:45:35.741385+0000","last_clean":"2023-11-04T01:45:35.741385+0000","last_became_active":"2023-11-04T01:45:35.730885+0000","last_became_peered":"2023-11-04T01:45:35.730885+0000","last_unstale":"2023-11-04T01:45:35.741385+0000","last_undegraded":"2023-11-04T01:45:35.741385+0000","last_fullsized":"2023-11-04T01:45:35.741385+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:04.153702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711760+0000","last_change":"2023-11-04T01:45:34.666859+0000","last_active":"2023-11-04T01:45:35.711760+0000","last_peered":"2023-11-04T01:45:35.711760+0000","last_clean":"2023-11-04T01:45:35.711760+0000","last_became_active":"2023-11-04T01:45:34.665568+0000","last_became_peered":"2023-11-04T01:45:34.665568+0000","last_unstale":"2023-11-04T01:45:35.711760+0000","last_undegraded":"2023-11-04T01:45:35.711760+0000","last_fullsized":"2023-11-04T01:45:35.711760+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:41.889295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656820+0000","last_change":"2023-11-04T01:44:41.933323+0000","last_active":"2023-11-04T01:45:34.656820+0000","last_peered":"2023-11-04T01:45:34.656820+0000","last_clean":"2023-11-04T01:45:34.656820+0000","last_became_active":"2023-11-04T01:44:41.932545+0000","last_became_peered":"2023-11-04T01:44:41.932545+0000","last_unstale":"2023-11-04T01:45:34.656820+0000","last_undegraded":"2023-11-04T01:45:34.656820+0000","last_fullsized":"2023-11-04T01:45:34.656820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:28.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658235+0000","last_change":"2023-11-04T01:44:43.112250+0000","last_active":"2023-11-04T01:45:34.658235+0000","last_peered":"2023-11-04T01:45:34.658235+0000","last_clean":"2023-11-04T01:45:34.658235+0000","last_became_active":"2023-11-04T01:44:40.940763+0000","last_became_peered":"2023-11-04T01:44:40.940763+0000","last_unstale":"2023-11-04T01:45:34.658235+0000","last_undegraded":"2023-11-04T01:45:34.658235+0000","last_fullsized":"2023-11-04T01:45:34.658235+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:13.065066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658043+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:45:34.658043+0000","last_peered":"2023-11-04T01:45:34.658043+0000","last_clean":"2023-11-04T01:45:34.658043+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:45:34.658043+0000","last_undegraded":"2023-11-04T01:45:34.658043+0000","last_fullsized":"2023-11-04T01:45:34.658043+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.740201+0000","last_change":"2023-11-04T01:45:35.736894+0000","last_active":"2023-11-04T01:45:35.740201+0000","last_peered":"2023-11-04T01:45:35.740201+0000","last_clean":"2023-11-04T01:45:35.740201+0000","last_became_active":"2023-11-04T01:45:35.736598+0000","last_became_peered":"2023-11-04T01:45:35.736598+0000","last_unstale":"2023-11-04T01:45:35.740201+0000","last_undegraded":"2023-11-04T01:45:35.740201+0000","last_fullsized":"2023-11-04T01:45:35.740201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:02.875508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.696651+0000","last_change":"2023-11-04T01:45:34.681578+0000","last_active":"2023-11-04T01:45:35.696651+0000","last_peered":"2023-11-04T01:45:35.696651+0000","last_clean":"2023-11-04T01:45:35.696651+0000","last_became_active":"2023-11-04T01:45:34.680873+0000","last_became_peered":"2023-11-04T01:45:34.680873+0000","last_unstale":"2023-11-04T01:45:35.696651+0000","last_undegraded":"2023-11-04T01:45:35.696651+0000","last_fullsized":"2023-11-04T01:45:35.696651+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:47.087950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658603+0000","last_change":"2023-11-04T01:44:41.933572+0000","last_active":"2023-11-04T01:45:34.658603+0000","last_peered":"2023-11-04T01:45:34.658603+0000","last_clean":"2023-11-04T01:45:34.658603+0000","last_became_active":"2023-11-04T01:44:41.932825+0000","last_became_peered":"2023-11-04T01:44:41.932825+0000","last_unstale":"2023-11-04T01:45:34.658603+0000","last_undegraded":"2023-11-04T01:45:34.658603+0000","last_fullsized":"2023-11-04T01:45:34.658603+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:17.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657420+0000","last_change":"2023-11-04T01:44:43.112178+0000","last_active":"2023-11-04T01:45:34.657420+0000","last_peered":"2023-11-04T01:45:34.657420+0000","last_clean":"2023-11-04T01:45:34.657420+0000","last_became_active":"2023-11-04T01:44:40.940919+0000","last_became_peered":"2023-11-04T01:44:40.940919+0000","last_unstale":"2023-11-04T01:45:34.657420+0000","last_undegraded":"2023-11-04T01:45:34.657420+0000","last_fullsized":"2023-11-04T01:45:34.657420+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:26.706337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015529090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.678616+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:45:34.678616+0000","last_peered":"2023-11-04T01:45:34.678616+0000","last_clean":"2023-11-04T01:45:34.678616+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:45:34.678616+0000","last_undegraded":"2023-11-04T01:45:34.678616+0000","last_fullsized":"2023-11-04T01:45:34.678616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.721790+0000","last_change":"2023-11-04T01:45:35.709706+0000","last_active":"2023-11-04T01:45:35.721790+0000","last_peered":"2023-11-04T01:45:35.721790+0000","last_clean":"2023-11-04T01:45:35.721790+0000","last_became_active":"2023-11-04T01:45:35.709338+0000","last_became_peered":"2023-11-04T01:45:35.709338+0000","last_unstale":"2023-11-04T01:45:35.721790+0000","last_undegraded":"2023-11-04T01:45:35.721790+0000","last_fullsized":"2023-11-04T01:45:35.721790+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:34.579953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733278+0000","last_change":"2023-11-04T01:45:34.657827+0000","last_active":"2023-11-04T01:45:35.733278+0000","last_peered":"2023-11-04T01:45:35.733278+0000","last_clean":"2023-11-04T01:45:35.733278+0000","last_became_active":"2023-11-04T01:45:34.657237+0000","last_became_peered":"2023-11-04T01:45:34.657237+0000","last_unstale":"2023-11-04T01:45:35.733278+0000","last_undegraded":"2023-11-04T01:45:35.733278+0000","last_fullsized":"2023-11-04T01:45:35.733278+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:39.504787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657637+0000","last_change":"2023-11-04T01:44:41.944543+0000","last_active":"2023-11-04T01:45:34.657637+0000","last_peered":"2023-11-04T01:45:34.657637+0000","last_clean":"2023-11-04T01:45:34.657637+0000","last_became_active":"2023-11-04T01:44:41.943902+0000","last_became_peered":"2023-11-04T01:44:41.943902+0000","last_unstale":"2023-11-04T01:45:34.657637+0000","last_undegraded":"2023-11-04T01:45:34.657637+0000","last_fullsized":"2023-11-04T01:45:34.657637+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:57.847851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673571+0000","last_change":"2023-11-04T01:44:43.177318+0000","last_active":"2023-11-04T01:45:34.673571+0000","last_peered":"2023-11-04T01:45:34.673571+0000","last_clean":"2023-11-04T01:45:34.673571+0000","last_became_active":"2023-11-04T01:44:40.940689+0000","last_became_peered":"2023-11-04T01:44:40.940689+0000","last_unstale":"2023-11-04T01:45:34.673571+0000","last_undegraded":"2023-11-04T01:45:34.673571+0000","last_fullsized":"2023-11-04T01:45:34.673571+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:28.637882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033848720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.667191+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:45:34.667191+0000","last_peered":"2023-11-04T01:45:34.667191+0000","last_clean":"2023-11-04T01:45:34.667191+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:45:34.667191+0000","last_undegraded":"2023-11-04T01:45:34.667191+0000","last_fullsized":"2023-11-04T01:45:34.667191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729420+0000","last_change":"2023-11-04T01:45:35.719072+0000","last_active":"2023-11-04T01:45:35.729420+0000","last_peered":"2023-11-04T01:45:35.729420+0000","last_clean":"2023-11-04T01:45:35.729420+0000","last_became_active":"2023-11-04T01:45:35.718691+0000","last_became_peered":"2023-11-04T01:45:35.718691+0000","last_unstale":"2023-11-04T01:45:35.729420+0000","last_undegraded":"2023-11-04T01:45:35.729420+0000","last_fullsized":"2023-11-04T01:45:35.729420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:53.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732471+0000","last_change":"2023-11-04T01:45:34.669651+0000","last_active":"2023-11-04T01:45:35.732471+0000","last_peered":"2023-11-04T01:45:35.732471+0000","last_clean":"2023-11-04T01:45:35.732471+0000","last_became_active":"2023-11-04T01:45:34.669359+0000","last_became_peered":"2023-11-04T01:45:34.669359+0000","last_unstale":"2023-11-04T01:45:35.732471+0000","last_undegraded":"2023-11-04T01:45:35.732471+0000","last_fullsized":"2023-11-04T01:45:35.732471+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:31.119732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.661095+0000","last_change":"2023-11-04T01:44:41.934066+0000","last_active":"2023-11-04T01:45:34.661095+0000","last_peered":"2023-11-04T01:45:34.661095+0000","last_clean":"2023-11-04T01:45:34.661095+0000","last_became_active":"2023-11-04T01:44:41.933308+0000","last_became_peered":"2023-11-04T01:44:41.933308+0000","last_unstale":"2023-11-04T01:45:34.661095+0000","last_undegraded":"2023-11-04T01:45:34.661095+0000","last_fullsized":"2023-11-04T01:45:34.661095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:36.172813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657281+0000","last_change":"2023-11-04T01:44:42.903075+0000","last_active":"2023-11-04T01:45:34.657281+0000","last_peered":"2023-11-04T01:45:34.657281+0000","last_clean":"2023-11-04T01:45:34.657281+0000","last_became_active":"2023-11-04T01:44:40.942840+0000","last_became_peered":"2023-11-04T01:44:40.942840+0000","last_unstale":"2023-11-04T01:45:34.657281+0000","last_undegraded":"2023-11-04T01:45:34.657281+0000","last_fullsized":"2023-11-04T01:45:34.657281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:04.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015750029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657848+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:45:34.657848+0000","last_peered":"2023-11-04T01:45:34.657848+0000","last_clean":"2023-11-04T01:45:34.657848+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:45:34.657848+0000","last_undegraded":"2023-11-04T01:45:34.657848+0000","last_fullsized":"2023-11-04T01:45:34.657848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738321+0000","last_change":"2023-11-04T01:45:35.726149+0000","last_active":"2023-11-04T01:45:35.738321+0000","last_peered":"2023-11-04T01:45:35.738321+0000","last_clean":"2023-11-04T01:45:35.738321+0000","last_became_active":"2023-11-04T01:45:35.724833+0000","last_became_peered":"2023-11-04T01:45:35.724833+0000","last_unstale":"2023-11-04T01:45:35.738321+0000","last_undegraded":"2023-11-04T01:45:35.738321+0000","last_fullsized":"2023-11-04T01:45:35.738321+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:22.924165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.708020+0000","last_change":"2023-11-04T01:45:34.664288+0000","last_active":"2023-11-04T01:45:35.708020+0000","last_peered":"2023-11-04T01:45:35.708020+0000","last_clean":"2023-11-04T01:45:35.708020+0000","last_became_active":"2023-11-04T01:45:34.663709+0000","last_became_peered":"2023-11-04T01:45:34.663709+0000","last_unstale":"2023-11-04T01:45:35.708020+0000","last_undegraded":"2023-11-04T01:45:35.708020+0000","last_fullsized":"2023-11-04T01:45:35.708020+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:35.966499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671110+0000","last_change":"2023-11-04T01:44:41.918892+0000","last_active":"2023-11-04T01:45:34.671110+0000","last_peered":"2023-11-04T01:45:34.671110+0000","last_clean":"2023-11-04T01:45:34.671110+0000","last_became_active":"2023-11-04T01:44:41.917911+0000","last_became_peered":"2023-11-04T01:44:41.917911+0000","last_unstale":"2023-11-04T01:45:34.671110+0000","last_undegraded":"2023-11-04T01:45:34.671110+0000","last_fullsized":"2023-11-04T01:45:34.671110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:53.093358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.672595+0000","last_change":"2023-11-04T01:44:43.177231+0000","last_active":"2023-11-04T01:45:34.672595+0000","last_peered":"2023-11-04T01:45:34.672595+0000","last_clean":"2023-11-04T01:45:34.672595+0000","last_became_active":"2023-11-04T01:44:40.929373+0000","last_became_peered":"2023-11-04T01:44:40.929373+0000","last_unstale":"2023-11-04T01:45:34.672595+0000","last_undegraded":"2023-11-04T01:45:34.672595+0000","last_fullsized":"2023-11-04T01:45:34.672595+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:03.457810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005564182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.692214+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:45:35.692214+0000","last_peered":"2023-11-04T01:45:35.692214+0000","last_clean":"2023-11-04T01:45:35.692214+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:45:35.692214+0000","last_undegraded":"2023-11-04T01:45:35.692214+0000","last_fullsized":"2023-11-04T01:45:35.692214+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.734948+0000","last_change":"2023-11-04T01:45:35.727896+0000","last_active":"2023-11-04T01:45:35.734948+0000","last_peered":"2023-11-04T01:45:35.734948+0000","last_clean":"2023-11-04T01:45:35.734948+0000","last_became_active":"2023-11-04T01:45:35.727425+0000","last_became_peered":"2023-11-04T01:45:35.727425+0000","last_unstale":"2023-11-04T01:45:35.734948+0000","last_undegraded":"2023-11-04T01:45:35.734948+0000","last_fullsized":"2023-11-04T01:45:35.734948+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:11.311302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.684497+0000","last_change":"2023-11-04T01:45:34.674622+0000","last_active":"2023-11-04T01:45:35.684497+0000","last_peered":"2023-11-04T01:45:35.684497+0000","last_clean":"2023-11-04T01:45:35.684497+0000","last_became_active":"2023-11-04T01:45:34.674337+0000","last_became_peered":"2023-11-04T01:45:34.674337+0000","last_unstale":"2023-11-04T01:45:35.684497+0000","last_undegraded":"2023-11-04T01:45:35.684497+0000","last_fullsized":"2023-11-04T01:45:35.684497+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:40.603543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.685940+0000","last_change":"2023-11-04T01:44:41.918887+0000","last_active":"2023-11-04T01:45:35.685940+0000","last_peered":"2023-11-04T01:45:35.685940+0000","last_clean":"2023-11-04T01:45:35.685940+0000","last_became_active":"2023-11-04T01:44:41.918464+0000","last_became_peered":"2023-11-04T01:44:41.918464+0000","last_unstale":"2023-11-04T01:45:35.685940+0000","last_undegraded":"2023-11-04T01:45:35.685940+0000","last_fullsized":"2023-11-04T01:45:35.685940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:59.577071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.655797+0000","last_change":"2023-11-04T01:44:43.174324+0000","last_active":"2023-11-04T01:45:34.655797+0000","last_peered":"2023-11-04T01:45:34.655797+0000","last_clean":"2023-11-04T01:45:34.655797+0000","last_became_active":"2023-11-04T01:44:40.924963+0000","last_became_peered":"2023-11-04T01:44:40.924963+0000","last_unstale":"2023-11-04T01:45:34.655797+0000","last_undegraded":"2023-11-04T01:45:34.655797+0000","last_fullsized":"2023-11-04T01:45:34.655797+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:49:16.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016466950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.687498+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:45:35.687498+0000","last_peered":"2023-11-04T01:45:35.687498+0000","last_clean":"2023-11-04T01:45:35.687498+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:45:35.687498+0000","last_undegraded":"2023-11-04T01:45:35.687498+0000","last_fullsized":"2023-11-04T01:45:35.687498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738433+0000","last_change":"2023-11-04T01:45:35.732709+0000","last_active":"2023-11-04T01:45:35.738433+0000","last_peered":"2023-11-04T01:45:35.738433+0000","last_clean":"2023-11-04T01:45:35.738433+0000","last_became_active":"2023-11-04T01:45:35.732315+0000","last_became_peered":"2023-11-04T01:45:35.732315+0000","last_unstale":"2023-11-04T01:45:35.738433+0000","last_undegraded":"2023-11-04T01:45:35.738433+0000","last_fullsized":"2023-11-04T01:45:35.738433+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:29.643798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712310+0000","last_change":"2023-11-04T01:45:34.685857+0000","last_active":"2023-11-04T01:45:35.712310+0000","last_peered":"2023-11-04T01:45:35.712310+0000","last_clean":"2023-11-04T01:45:35.712310+0000","last_became_active":"2023-11-04T01:45:34.685009+0000","last_became_peered":"2023-11-04T01:45:34.685009+0000","last_unstale":"2023-11-04T01:45:35.712310+0000","last_undegraded":"2023-11-04T01:45:35.712310+0000","last_fullsized":"2023-11-04T01:45:35.712310+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:08.120629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.652514+0000","last_change":"2023-11-04T01:44:41.929589+0000","last_active":"2023-11-04T01:45:34.652514+0000","last_peered":"2023-11-04T01:45:34.652514+0000","last_clean":"2023-11-04T01:45:34.652514+0000","last_became_active":"2023-11-04T01:44:41.929209+0000","last_became_peered":"2023-11-04T01:44:41.929209+0000","last_unstale":"2023-11-04T01:45:34.652514+0000","last_undegraded":"2023-11-04T01:45:34.652514+0000","last_fullsized":"2023-11-04T01:45:34.652514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:56.528258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.666987+0000","last_change":"2023-11-04T01:44:43.175322+0000","last_active":"2023-11-04T01:45:34.666987+0000","last_peered":"2023-11-04T01:45:34.666987+0000","last_clean":"2023-11-04T01:45:34.666987+0000","last_became_active":"2023-11-04T01:44:40.931389+0000","last_became_peered":"2023-11-04T01:44:40.931389+0000","last_unstale":"2023-11-04T01:45:34.666987+0000","last_undegraded":"2023-11-04T01:45:34.666987+0000","last_fullsized":"2023-11-04T01:45:34.666987+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022947649999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657643+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:45:34.657643+0000","last_peered":"2023-11-04T01:45:34.657643+0000","last_clean":"2023-11-04T01:45:34.657643+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:45:34.657643+0000","last_undegraded":"2023-11-04T01:45:34.657643+0000","last_fullsized":"2023-11-04T01:45:34.657643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725639+0000","last_change":"2023-11-04T01:45:35.722363+0000","last_active":"2023-11-04T01:45:35.725639+0000","last_peered":"2023-11-04T01:45:35.725639+0000","last_clean":"2023-11-04T01:45:35.725639+0000","last_became_active":"2023-11-04T01:45:35.717584+0000","last_became_peered":"2023-11-04T01:45:35.717584+0000","last_unstale":"2023-11-04T01:45:35.725639+0000","last_undegraded":"2023-11-04T01:45:35.725639+0000","last_fullsized":"2023-11-04T01:45:35.725639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:21.687007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.700958+0000","last_change":"2023-11-04T01:45:34.689599+0000","last_active":"2023-11-04T01:45:35.700958+0000","last_peered":"2023-11-04T01:45:35.700958+0000","last_clean":"2023-11-04T01:45:35.700958+0000","last_became_active":"2023-11-04T01:45:34.689207+0000","last_became_peered":"2023-11-04T01:45:34.689207+0000","last_unstale":"2023-11-04T01:45:35.700958+0000","last_undegraded":"2023-11-04T01:45:35.700958+0000","last_fullsized":"2023-11-04T01:45:35.700958+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:14.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640453+0000","last_change":"2023-11-04T01:44:41.935051+0000","last_active":"2023-11-04T01:45:34.640453+0000","last_peered":"2023-11-04T01:45:34.640453+0000","last_clean":"2023-11-04T01:45:34.640453+0000","last_became_active":"2023-11-04T01:44:41.934245+0000","last_became_peered":"2023-11-04T01:44:41.934245+0000","last_unstale":"2023-11-04T01:45:34.640453+0000","last_undegraded":"2023-11-04T01:45:34.640453+0000","last_fullsized":"2023-11-04T01:45:34.640453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:58.744375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654210+0000","last_change":"2023-11-04T01:44:43.174084+0000","last_active":"2023-11-04T01:45:34.654210+0000","last_peered":"2023-11-04T01:45:34.654210+0000","last_clean":"2023-11-04T01:45:34.654210+0000","last_became_active":"2023-11-04T01:44:40.923078+0000","last_became_peered":"2023-11-04T01:44:40.923078+0000","last_unstale":"2023-11-04T01:45:34.654210+0000","last_undegraded":"2023-11-04T01:45:34.654210+0000","last_fullsized":"2023-11-04T01:45:34.654210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:30.967677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015459650000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.667830+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:45:34.667830+0000","last_peered":"2023-11-04T01:45:34.667830+0000","last_clean":"2023-11-04T01:45:34.667830+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:45:34.667830+0000","last_undegraded":"2023-11-04T01:45:34.667830+0000","last_fullsized":"2023-11-04T01:45:34.667830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714552+0000","last_change":"2023-11-04T01:45:35.722942+0000","last_active":"2023-11-04T01:45:36.714552+0000","last_peered":"2023-11-04T01:45:36.714552+0000","last_clean":"2023-11-04T01:45:36.714552+0000","last_became_active":"2023-11-04T01:45:35.721796+0000","last_became_peered":"2023-11-04T01:45:35.721796+0000","last_unstale":"2023-11-04T01:45:36.714552+0000","last_undegraded":"2023-11-04T01:45:36.714552+0000","last_fullsized":"2023-11-04T01:45:36.714552+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:11.975655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712275+0000","last_change":"2023-11-04T01:45:34.682808+0000","last_active":"2023-11-04T01:45:35.712275+0000","last_peered":"2023-11-04T01:45:35.712275+0000","last_clean":"2023-11-04T01:45:35.712275+0000","last_became_active":"2023-11-04T01:45:34.682107+0000","last_became_peered":"2023-11-04T01:45:34.682107+0000","last_unstale":"2023-11-04T01:45:35.712275+0000","last_undegraded":"2023-11-04T01:45:35.712275+0000","last_fullsized":"2023-11-04T01:45:35.712275+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:49.064872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657193+0000","last_change":"2023-11-04T01:44:41.916693+0000","last_active":"2023-11-04T01:45:34.657193+0000","last_peered":"2023-11-04T01:45:34.657193+0000","last_clean":"2023-11-04T01:45:34.657193+0000","last_became_active":"2023-11-04T01:44:41.914418+0000","last_became_peered":"2023-11-04T01:44:41.914418+0000","last_unstale":"2023-11-04T01:45:34.657193+0000","last_undegraded":"2023-11-04T01:45:34.657193+0000","last_fullsized":"2023-11-04T01:45:34.657193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:02.978838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691008+0000","last_change":"2023-11-04T01:44:42.903798+0000","last_active":"2023-11-04T01:45:35.691008+0000","last_peered":"2023-11-04T01:45:35.691008+0000","last_clean":"2023-11-04T01:45:35.691008+0000","last_became_active":"2023-11-04T01:44:40.921927+0000","last_became_peered":"2023-11-04T01:44:40.921927+0000","last_unstale":"2023-11-04T01:45:35.691008+0000","last_undegraded":"2023-11-04T01:45:35.691008+0000","last_fullsized":"2023-11-04T01:45:35.691008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:41.296405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018315269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657415+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:45:34.657415+0000","last_peered":"2023-11-04T01:45:34.657415+0000","last_clean":"2023-11-04T01:45:34.657415+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:45:34.657415+0000","last_undegraded":"2023-11-04T01:45:34.657415+0000","last_fullsized":"2023-11-04T01:45:34.657415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741417+0000","last_change":"2023-11-04T01:45:35.731969+0000","last_active":"2023-11-04T01:45:35.741417+0000","last_peered":"2023-11-04T01:45:35.741417+0000","last_clean":"2023-11-04T01:45:35.741417+0000","last_became_active":"2023-11-04T01:45:35.727897+0000","last_became_peered":"2023-11-04T01:45:35.727897+0000","last_unstale":"2023-11-04T01:45:35.741417+0000","last_undegraded":"2023-11-04T01:45:35.741417+0000","last_fullsized":"2023-11-04T01:45:35.741417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:47.728509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.723337+0000","last_change":"2023-11-04T01:45:34.693361+0000","last_active":"2023-11-04T01:45:35.723337+0000","last_peered":"2023-11-04T01:45:35.723337+0000","last_clean":"2023-11-04T01:45:35.723337+0000","last_became_active":"2023-11-04T01:45:34.692714+0000","last_became_peered":"2023-11-04T01:45:34.692714+0000","last_unstale":"2023-11-04T01:45:35.723337+0000","last_undegraded":"2023-11-04T01:45:35.723337+0000","last_fullsized":"2023-11-04T01:45:35.723337+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:51.547529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641051+0000","last_change":"2023-11-04T01:44:41.944011+0000","last_active":"2023-11-04T01:45:34.641051+0000","last_peered":"2023-11-04T01:45:34.641051+0000","last_clean":"2023-11-04T01:45:34.641051+0000","last_became_active":"2023-11-04T01:44:41.943702+0000","last_became_peered":"2023-11-04T01:44:41.943702+0000","last_unstale":"2023-11-04T01:45:34.641051+0000","last_undegraded":"2023-11-04T01:45:34.641051+0000","last_fullsized":"2023-11-04T01:45:34.641051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:57.519730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671608+0000","last_change":"2023-11-04T01:44:42.902919+0000","last_active":"2023-11-04T01:45:34.671608+0000","last_peered":"2023-11-04T01:45:34.671608+0000","last_clean":"2023-11-04T01:45:34.671608+0000","last_became_active":"2023-11-04T01:44:40.918933+0000","last_became_peered":"2023-11-04T01:44:40.918933+0000","last_unstale":"2023-11-04T01:45:34.671608+0000","last_undegraded":"2023-11-04T01:45:34.671608+0000","last_fullsized":"2023-11-04T01:45:34.671608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:47.321809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002224087,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.655338+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:45:34.655338+0000","last_peered":"2023-11-04T01:45:34.655338+0000","last_clean":"2023-11-04T01:45:34.655338+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:45:34.655338+0000","last_undegraded":"2023-11-04T01:45:34.655338+0000","last_fullsized":"2023-11-04T01:45:34.655338+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730247+0000","last_change":"2023-11-04T01:45:35.726184+0000","last_active":"2023-11-04T01:45:35.730247+0000","last_peered":"2023-11-04T01:45:35.730247+0000","last_clean":"2023-11-04T01:45:35.730247+0000","last_became_active":"2023-11-04T01:45:35.725879+0000","last_became_peered":"2023-11-04T01:45:35.725879+0000","last_unstale":"2023-11-04T01:45:35.730247+0000","last_undegraded":"2023-11-04T01:45:35.730247+0000","last_fullsized":"2023-11-04T01:45:35.730247+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:47.472709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712159+0000","last_change":"2023-11-04T01:45:34.684259+0000","last_active":"2023-11-04T01:45:35.712159+0000","last_peered":"2023-11-04T01:45:35.712159+0000","last_clean":"2023-11-04T01:45:35.712159+0000","last_became_active":"2023-11-04T01:45:34.676197+0000","last_became_peered":"2023-11-04T01:45:34.676197+0000","last_unstale":"2023-11-04T01:45:35.712159+0000","last_undegraded":"2023-11-04T01:45:35.712159+0000","last_fullsized":"2023-11-04T01:45:35.712159+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:12.299734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691824+0000","last_change":"2023-11-04T01:44:41.926845+0000","last_active":"2023-11-04T01:45:35.691824+0000","last_peered":"2023-11-04T01:45:35.691824+0000","last_clean":"2023-11-04T01:45:35.691824+0000","last_became_active":"2023-11-04T01:44:41.926160+0000","last_became_peered":"2023-11-04T01:44:41.926160+0000","last_unstale":"2023-11-04T01:45:35.691824+0000","last_undegraded":"2023-11-04T01:45:35.691824+0000","last_fullsized":"2023-11-04T01:45:35.691824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:09.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.666694+0000","last_change":"2023-11-04T01:44:43.172635+0000","last_active":"2023-11-04T01:45:34.666694+0000","last_peered":"2023-11-04T01:45:34.666694+0000","last_clean":"2023-11-04T01:45:34.666694+0000","last_became_active":"2023-11-04T01:44:40.944235+0000","last_became_peered":"2023-11-04T01:44:40.944235+0000","last_unstale":"2023-11-04T01:45:34.666694+0000","last_undegraded":"2023-11-04T01:45:34.666694+0000","last_fullsized":"2023-11-04T01:45:34.666694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:23.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025398959999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.675404+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:45:34.675404+0000","last_peered":"2023-11-04T01:45:34.675404+0000","last_clean":"2023-11-04T01:45:34.675404+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:45:34.675404+0000","last_undegraded":"2023-11-04T01:45:34.675404+0000","last_fullsized":"2023-11-04T01:45:34.675404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729450+0000","last_change":"2023-11-04T01:45:35.724990+0000","last_active":"2023-11-04T01:45:35.729450+0000","last_peered":"2023-11-04T01:45:35.729450+0000","last_clean":"2023-11-04T01:45:35.729450+0000","last_became_active":"2023-11-04T01:45:35.722534+0000","last_became_peered":"2023-11-04T01:45:35.722534+0000","last_unstale":"2023-11-04T01:45:35.729450+0000","last_undegraded":"2023-11-04T01:45:35.729450+0000","last_fullsized":"2023-11-04T01:45:35.729450+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:30.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.695378+0000","last_change":"2023-11-04T01:45:34.667037+0000","last_active":"2023-11-04T01:45:35.695378+0000","last_peered":"2023-11-04T01:45:35.695378+0000","last_clean":"2023-11-04T01:45:35.695378+0000","last_became_active":"2023-11-04T01:45:34.666750+0000","last_became_peered":"2023-11-04T01:45:34.666750+0000","last_unstale":"2023-11-04T01:45:35.695378+0000","last_undegraded":"2023-11-04T01:45:35.695378+0000","last_fullsized":"2023-11-04T01:45:35.695378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:47:48.554659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.678748+0000","last_change":"2023-11-04T01:44:41.927015+0000","last_active":"2023-11-04T01:45:34.678748+0000","last_peered":"2023-11-04T01:45:34.678748+0000","last_clean":"2023-11-04T01:45:34.678748+0000","last_became_active":"2023-11-04T01:44:41.926208+0000","last_became_peered":"2023-11-04T01:44:41.926208+0000","last_unstale":"2023-11-04T01:45:34.678748+0000","last_undegraded":"2023-11-04T01:45:34.678748+0000","last_fullsized":"2023-11-04T01:45:34.678748+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:33.265407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.685527+0000","last_change":"2023-11-04T01:44:42.903587+0000","last_active":"2023-11-04T01:45:35.685527+0000","last_peered":"2023-11-04T01:45:35.685527+0000","last_clean":"2023-11-04T01:45:35.685527+0000","last_became_active":"2023-11-04T01:44:40.914477+0000","last_became_peered":"2023-11-04T01:44:40.914477+0000","last_unstale":"2023-11-04T01:45:35.685527+0000","last_undegraded":"2023-11-04T01:45:35.685527+0000","last_fullsized":"2023-11-04T01:45:35.685527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.324851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021038049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673789+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:45:34.673789+0000","last_peered":"2023-11-04T01:45:34.673789+0000","last_clean":"2023-11-04T01:45:34.673789+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:45:34.673789+0000","last_undegraded":"2023-11-04T01:45:34.673789+0000","last_fullsized":"2023-11-04T01:45:34.673789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.726724+0000","last_change":"2023-11-04T01:45:35.718612+0000","last_active":"2023-11-04T01:45:35.726724+0000","last_peered":"2023-11-04T01:45:35.726724+0000","last_clean":"2023-11-04T01:45:35.726724+0000","last_became_active":"2023-11-04T01:45:35.714080+0000","last_became_peered":"2023-11-04T01:45:35.714080+0000","last_unstale":"2023-11-04T01:45:35.726724+0000","last_undegraded":"2023-11-04T01:45:35.726724+0000","last_fullsized":"2023-11-04T01:45:35.726724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:01.872461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691493+0000","last_change":"2023-11-04T01:45:34.669503+0000","last_active":"2023-11-04T01:45:35.691493+0000","last_peered":"2023-11-04T01:45:35.691493+0000","last_clean":"2023-11-04T01:45:35.691493+0000","last_became_active":"2023-11-04T01:45:34.668742+0000","last_became_peered":"2023-11-04T01:45:34.668742+0000","last_unstale":"2023-11-04T01:45:35.691493+0000","last_undegraded":"2023-11-04T01:45:35.691493+0000","last_fullsized":"2023-11-04T01:45:35.691493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:05.727712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.660461+0000","last_change":"2023-11-04T01:44:41.932084+0000","last_active":"2023-11-04T01:45:34.660461+0000","last_peered":"2023-11-04T01:45:34.660461+0000","last_clean":"2023-11-04T01:45:34.660461+0000","last_became_active":"2023-11-04T01:44:41.931308+0000","last_became_peered":"2023-11-04T01:44:41.931308+0000","last_unstale":"2023-11-04T01:45:34.660461+0000","last_undegraded":"2023-11-04T01:45:34.660461+0000","last_fullsized":"2023-11-04T01:45:34.660461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:02.241295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.672380+0000","last_change":"2023-11-04T01:44:43.175475+0000","last_active":"2023-11-04T01:45:34.672380+0000","last_peered":"2023-11-04T01:45:34.672380+0000","last_clean":"2023-11-04T01:45:34.672380+0000","last_became_active":"2023-11-04T01:44:40.930314+0000","last_became_peered":"2023-11-04T01:44:40.930314+0000","last_unstale":"2023-11-04T01:45:34.672380+0000","last_undegraded":"2023-11-04T01:45:34.672380+0000","last_fullsized":"2023-11-04T01:45:34.672380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:59.746779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042346939999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654228+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:45:34.654228+0000","last_peered":"2023-11-04T01:45:34.654228+0000","last_clean":"2023-11-04T01:45:34.654228+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:45:34.654228+0000","last_undegraded":"2023-11-04T01:45:34.654228+0000","last_fullsized":"2023-11-04T01:45:34.654228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731901+0000","last_change":"2023-11-04T01:45:35.719746+0000","last_active":"2023-11-04T01:45:35.731901+0000","last_peered":"2023-11-04T01:45:35.731901+0000","last_clean":"2023-11-04T01:45:35.731901+0000","last_became_active":"2023-11-04T01:45:35.719442+0000","last_became_peered":"2023-11-04T01:45:35.719442+0000","last_unstale":"2023-11-04T01:45:35.731901+0000","last_undegraded":"2023-11-04T01:45:35.731901+0000","last_fullsized":"2023-11-04T01:45:35.731901+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:07.026341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733211+0000","last_change":"2023-11-04T01:45:34.667669+0000","last_active":"2023-11-04T01:45:35.733211+0000","last_peered":"2023-11-04T01:45:35.733211+0000","last_clean":"2023-11-04T01:45:35.733211+0000","last_became_active":"2023-11-04T01:45:34.663156+0000","last_became_peered":"2023-11-04T01:45:34.663156+0000","last_unstale":"2023-11-04T01:45:35.733211+0000","last_undegraded":"2023-11-04T01:45:35.733211+0000","last_fullsized":"2023-11-04T01:45:35.733211+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:11.849555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657638+0000","last_change":"2023-11-04T01:44:41.921366+0000","last_active":"2023-11-04T01:45:34.657638+0000","last_peered":"2023-11-04T01:45:34.657638+0000","last_clean":"2023-11-04T01:45:34.657638+0000","last_became_active":"2023-11-04T01:44:41.920641+0000","last_became_peered":"2023-11-04T01:44:41.920641+0000","last_unstale":"2023-11-04T01:45:34.657638+0000","last_undegraded":"2023-11-04T01:45:34.657638+0000","last_fullsized":"2023-11-04T01:45:34.657638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.316345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.660669+0000","last_change":"2023-11-04T01:44:43.113042+0000","last_active":"2023-11-04T01:45:34.660669+0000","last_peered":"2023-11-04T01:45:34.660669+0000","last_clean":"2023-11-04T01:45:34.660669+0000","last_became_active":"2023-11-04T01:44:40.944546+0000","last_became_peered":"2023-11-04T01:44:40.944546+0000","last_unstale":"2023-11-04T01:45:34.660669+0000","last_undegraded":"2023-11-04T01:45:34.660669+0000","last_fullsized":"2023-11-04T01:45:34.660669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:09.170503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00104459,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.687748+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:45:35.687748+0000","last_peered":"2023-11-04T01:45:35.687748+0000","last_clean":"2023-11-04T01:45:35.687748+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:45:35.687748+0000","last_undegraded":"2023-11-04T01:45:35.687748+0000","last_fullsized":"2023-11-04T01:45:35.687748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712720+0000","last_change":"2023-11-04T01:45:35.710316+0000","last_active":"2023-11-04T01:45:35.712720+0000","last_peered":"2023-11-04T01:45:35.712720+0000","last_clean":"2023-11-04T01:45:35.712720+0000","last_became_active":"2023-11-04T01:45:35.709549+0000","last_became_peered":"2023-11-04T01:45:35.709549+0000","last_unstale":"2023-11-04T01:45:35.712720+0000","last_undegraded":"2023-11-04T01:45:35.712720+0000","last_fullsized":"2023-11-04T01:45:35.712720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:58.580406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732525+0000","last_change":"2023-11-04T01:45:34.667042+0000","last_active":"2023-11-04T01:45:35.732525+0000","last_peered":"2023-11-04T01:45:35.732525+0000","last_clean":"2023-11-04T01:45:35.732525+0000","last_became_active":"2023-11-04T01:45:34.666264+0000","last_became_peered":"2023-11-04T01:45:34.666264+0000","last_unstale":"2023-11-04T01:45:35.732525+0000","last_undegraded":"2023-11-04T01:45:35.732525+0000","last_fullsized":"2023-11-04T01:45:35.732525+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:20.676054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657050+0000","last_change":"2023-11-04T01:44:41.944522+0000","last_active":"2023-11-04T01:45:34.657050+0000","last_peered":"2023-11-04T01:45:34.657050+0000","last_clean":"2023-11-04T01:45:34.657050+0000","last_became_active":"2023-11-04T01:44:41.943801+0000","last_became_peered":"2023-11-04T01:44:41.943801+0000","last_unstale":"2023-11-04T01:45:34.657050+0000","last_undegraded":"2023-11-04T01:45:34.657050+0000","last_fullsized":"2023-11-04T01:45:34.657050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:01.424092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670562+0000","last_change":"2023-11-04T01:44:42.907186+0000","last_active":"2023-11-04T01:45:34.670562+0000","last_peered":"2023-11-04T01:45:34.670562+0000","last_clean":"2023-11-04T01:45:34.670562+0000","last_became_active":"2023-11-04T01:44:40.918060+0000","last_became_peered":"2023-11-04T01:44:40.918060+0000","last_unstale":"2023-11-04T01:45:34.670562+0000","last_undegraded":"2023-11-04T01:45:34.670562+0000","last_fullsized":"2023-11-04T01:45:34.670562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:29.430028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016383540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658729+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:45:34.658729+0000","last_peered":"2023-11-04T01:45:34.658729+0000","last_clean":"2023-11-04T01:45:34.658729+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:45:34.658729+0000","last_undegraded":"2023-11-04T01:45:34.658729+0000","last_fullsized":"2023-11-04T01:45:34.658729+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.720720+0000","last_change":"2023-11-04T01:45:35.715492+0000","last_active":"2023-11-04T01:45:35.720720+0000","last_peered":"2023-11-04T01:45:35.720720+0000","last_clean":"2023-11-04T01:45:35.720720+0000","last_became_active":"2023-11-04T01:45:35.714979+0000","last_became_peered":"2023-11-04T01:45:35.714979+0000","last_unstale":"2023-11-04T01:45:35.720720+0000","last_undegraded":"2023-11-04T01:45:35.720720+0000","last_fullsized":"2023-11-04T01:45:35.720720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:10:44.760301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.699661+0000","last_change":"2023-11-04T01:45:34.663263+0000","last_active":"2023-11-04T01:45:35.699661+0000","last_peered":"2023-11-04T01:45:35.699661+0000","last_clean":"2023-11-04T01:45:35.699661+0000","last_became_active":"2023-11-04T01:45:34.662644+0000","last_became_peered":"2023-11-04T01:45:34.662644+0000","last_unstale":"2023-11-04T01:45:35.699661+0000","last_undegraded":"2023-11-04T01:45:35.699661+0000","last_fullsized":"2023-11-04T01:45:35.699661+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:29.648363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640370+0000","last_change":"2023-11-04T01:44:41.934242+0000","last_active":"2023-11-04T01:45:34.640370+0000","last_peered":"2023-11-04T01:45:34.640370+0000","last_clean":"2023-11-04T01:45:34.640370+0000","last_became_active":"2023-11-04T01:44:41.933915+0000","last_became_peered":"2023-11-04T01:44:41.933915+0000","last_unstale":"2023-11-04T01:45:34.640370+0000","last_undegraded":"2023-11-04T01:45:34.640370+0000","last_fullsized":"2023-11-04T01:45:34.640370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:00.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654150+0000","last_change":"2023-11-04T01:44:43.173395+0000","last_active":"2023-11-04T01:45:34.654150+0000","last_peered":"2023-11-04T01:45:34.654150+0000","last_clean":"2023-11-04T01:45:34.654150+0000","last_became_active":"2023-11-04T01:44:40.917492+0000","last_became_peered":"2023-11-04T01:44:40.917492+0000","last_unstale":"2023-11-04T01:45:34.654150+0000","last_undegraded":"2023-11-04T01:45:34.654150+0000","last_fullsized":"2023-11-04T01:45:34.654150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:09.142444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012455719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656295+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:45:34.656295+0000","last_peered":"2023-11-04T01:45:34.656295+0000","last_clean":"2023-11-04T01:45:34.656295+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:45:34.656295+0000","last_undegraded":"2023-11-04T01:45:34.656295+0000","last_fullsized":"2023-11-04T01:45:34.656295+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.740214+0000","last_change":"2023-11-04T01:45:35.737290+0000","last_active":"2023-11-04T01:45:35.740214+0000","last_peered":"2023-11-04T01:45:35.740214+0000","last_clean":"2023-11-04T01:45:35.740214+0000","last_became_active":"2023-11-04T01:45:35.736828+0000","last_became_peered":"2023-11-04T01:45:35.736828+0000","last_unstale":"2023-11-04T01:45:35.740214+0000","last_undegraded":"2023-11-04T01:45:35.740214+0000","last_fullsized":"2023-11-04T01:45:35.740214+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:21.640501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.703969+0000","last_change":"2023-11-04T01:45:34.673334+0000","last_active":"2023-11-04T01:45:35.703969+0000","last_peered":"2023-11-04T01:45:35.703969+0000","last_clean":"2023-11-04T01:45:35.703969+0000","last_became_active":"2023-11-04T01:45:34.672676+0000","last_became_peered":"2023-11-04T01:45:34.672676+0000","last_unstale":"2023-11-04T01:45:35.703969+0000","last_undegraded":"2023-11-04T01:45:35.703969+0000","last_fullsized":"2023-11-04T01:45:35.703969+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:52.055762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.688945+0000","last_change":"2023-11-04T01:44:41.914046+0000","last_active":"2023-11-04T01:45:35.688945+0000","last_peered":"2023-11-04T01:45:35.688945+0000","last_clean":"2023-11-04T01:45:35.688945+0000","last_became_active":"2023-11-04T01:44:41.913611+0000","last_became_peered":"2023-11-04T01:44:41.913611+0000","last_unstale":"2023-11-04T01:45:35.688945+0000","last_undegraded":"2023-11-04T01:45:35.688945+0000","last_fullsized":"2023-11-04T01:45:35.688945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:00.756582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641177+0000","last_change":"2023-11-04T01:44:43.177428+0000","last_active":"2023-11-04T01:45:34.641177+0000","last_peered":"2023-11-04T01:45:34.641177+0000","last_clean":"2023-11-04T01:45:34.641177+0000","last_became_active":"2023-11-04T01:44:40.909113+0000","last_became_peered":"2023-11-04T01:44:40.909113+0000","last_unstale":"2023-11-04T01:45:34.641177+0000","last_undegraded":"2023-11-04T01:45:34.641177+0000","last_fullsized":"2023-11-04T01:45:34.641177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:27.620457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001590373,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673918+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:45:34.673918+0000","last_peered":"2023-11-04T01:45:34.673918+0000","last_clean":"2023-11-04T01:45:34.673918+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:45:34.673918+0000","last_undegraded":"2023-11-04T01:45:34.673918+0000","last_fullsized":"2023-11-04T01:45:34.673918+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729220+0000","last_change":"2023-11-04T01:45:35.720344+0000","last_active":"2023-11-04T01:45:35.729220+0000","last_peered":"2023-11-04T01:45:35.729220+0000","last_clean":"2023-11-04T01:45:35.729220+0000","last_became_active":"2023-11-04T01:45:35.720021+0000","last_became_peered":"2023-11-04T01:45:35.720021+0000","last_unstale":"2023-11-04T01:45:35.729220+0000","last_undegraded":"2023-11-04T01:45:35.729220+0000","last_fullsized":"2023-11-04T01:45:35.729220+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:30.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"91'4","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.736335+0000","last_change":"2023-11-04T01:45:34.675294+0000","last_active":"2023-11-04T01:45:35.736335+0000","last_peered":"2023-11-04T01:45:35.736335+0000","last_clean":"2023-11-04T01:45:35.736335+0000","last_became_active":"2023-11-04T01:45:34.670236+0000","last_became_peered":"2023-11-04T01:45:34.670236+0000","last_unstale":"2023-11-04T01:45:35.736335+0000","last_undegraded":"2023-11-04T01:45:35.736335+0000","last_fullsized":"2023-11-04T01:45:35.736335+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:05.730512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.665345+0000","last_change":"2023-11-04T01:44:41.932864+0000","last_active":"2023-11-04T01:45:34.665345+0000","last_peered":"2023-11-04T01:45:34.665345+0000","last_clean":"2023-11-04T01:45:34.665345+0000","last_became_active":"2023-11-04T01:44:41.932047+0000","last_became_peered":"2023-11-04T01:44:41.932047+0000","last_unstale":"2023-11-04T01:45:34.665345+0000","last_undegraded":"2023-11-04T01:45:34.665345+0000","last_fullsized":"2023-11-04T01:45:34.665345+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640566+0000","last_change":"2023-11-04T01:44:43.176420+0000","last_active":"2023-11-04T01:45:34.640566+0000","last_peered":"2023-11-04T01:45:34.640566+0000","last_clean":"2023-11-04T01:45:34.640566+0000","last_became_active":"2023-11-04T01:44:40.912610+0000","last_became_peered":"2023-11-04T01:44:40.912610+0000","last_unstale":"2023-11-04T01:45:34.640566+0000","last_undegraded":"2023-11-04T01:45:34.640566+0000","last_fullsized":"2023-11-04T01:45:34.640566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:26.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010551130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.661823+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:45:34.661823+0000","last_peered":"2023-11-04T01:45:34.661823+0000","last_clean":"2023-11-04T01:45:34.661823+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:45:34.661823+0000","last_undegraded":"2023-11-04T01:45:34.661823+0000","last_fullsized":"2023-11-04T01:45:34.661823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725186+0000","last_change":"2023-11-04T01:45:35.718734+0000","last_active":"2023-11-04T01:45:35.725186+0000","last_peered":"2023-11-04T01:45:35.725186+0000","last_clean":"2023-11-04T01:45:35.725186+0000","last_became_active":"2023-11-04T01:45:35.718027+0000","last_became_peered":"2023-11-04T01:45:35.718027+0000","last_unstale":"2023-11-04T01:45:35.725186+0000","last_undegraded":"2023-11-04T01:45:35.725186+0000","last_fullsized":"2023-11-04T01:45:35.725186+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:55.161325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730269+0000","last_change":"2023-11-04T01:45:34.684633+0000","last_active":"2023-11-04T01:45:35.730269+0000","last_peered":"2023-11-04T01:45:35.730269+0000","last_clean":"2023-11-04T01:45:35.730269+0000","last_became_active":"2023-11-04T01:45:34.683874+0000","last_became_peered":"2023-11-04T01:45:34.683874+0000","last_unstale":"2023-11-04T01:45:35.730269+0000","last_undegraded":"2023-11-04T01:45:35.730269+0000","last_fullsized":"2023-11-04T01:45:35.730269+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:20.676054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673335+0000","last_change":"2023-11-04T01:44:41.924679+0000","last_active":"2023-11-04T01:45:34.673335+0000","last_peered":"2023-11-04T01:45:34.673335+0000","last_clean":"2023-11-04T01:45:34.673335+0000","last_became_active":"2023-11-04T01:44:41.923856+0000","last_became_peered":"2023-11-04T01:44:41.923856+0000","last_unstale":"2023-11-04T01:45:34.673335+0000","last_undegraded":"2023-11-04T01:45:34.673335+0000","last_fullsized":"2023-11-04T01:45:34.673335+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:09.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.669642+0000","last_change":"2023-11-04T01:44:42.903545+0000","last_active":"2023-11-04T01:45:34.669642+0000","last_peered":"2023-11-04T01:45:34.669642+0000","last_clean":"2023-11-04T01:45:34.669642+0000","last_became_active":"2023-11-04T01:44:40.920627+0000","last_became_peered":"2023-11-04T01:44:40.920627+0000","last_unstale":"2023-11-04T01:45:34.669642+0000","last_undegraded":"2023-11-04T01:45:34.669642+0000","last_fullsized":"2023-11-04T01:45:34.669642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:23.948002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032735189999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.655896+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:45:34.655896+0000","last_peered":"2023-11-04T01:45:34.655896+0000","last_clean":"2023-11-04T01:45:34.655896+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:45:34.655896+0000","last_undegraded":"2023-11-04T01:45:34.655896+0000","last_fullsized":"2023-11-04T01:45:34.655896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714050+0000","last_change":"2023-11-04T01:45:35.704705+0000","last_active":"2023-11-04T01:45:36.714050+0000","last_peered":"2023-11-04T01:45:36.714050+0000","last_clean":"2023-11-04T01:45:36.714050+0000","last_became_active":"2023-11-04T01:45:35.704257+0000","last_became_peered":"2023-11-04T01:45:35.704257+0000","last_unstale":"2023-11-04T01:45:36.714050+0000","last_undegraded":"2023-11-04T01:45:36.714050+0000","last_fullsized":"2023-11-04T01:45:36.714050+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:10.258708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"91'2","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714287+0000","last_change":"2023-11-04T01:45:34.665551+0000","last_active":"2023-11-04T01:45:36.714287+0000","last_peered":"2023-11-04T01:45:36.714287+0000","last_clean":"2023-11-04T01:45:36.714287+0000","last_became_active":"2023-11-04T01:45:34.665263+0000","last_became_peered":"2023-11-04T01:45:34.665263+0000","last_unstale":"2023-11-04T01:45:36.714287+0000","last_undegraded":"2023-11-04T01:45:36.714287+0000","last_fullsized":"2023-11-04T01:45:36.714287+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:45.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641484+0000","last_change":"2023-11-04T01:44:41.920012+0000","last_active":"2023-11-04T01:45:34.641484+0000","last_peered":"2023-11-04T01:45:34.641484+0000","last_clean":"2023-11-04T01:45:34.641484+0000","last_became_active":"2023-11-04T01:44:41.919196+0000","last_became_peered":"2023-11-04T01:44:41.919196+0000","last_unstale":"2023-11-04T01:45:34.641484+0000","last_undegraded":"2023-11-04T01:45:34.641484+0000","last_fullsized":"2023-11-04T01:45:34.641484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.168935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657088+0000","last_change":"2023-11-04T01:44:42.902675+0000","last_active":"2023-11-04T01:45:34.657088+0000","last_peered":"2023-11-04T01:45:34.657088+0000","last_clean":"2023-11-04T01:45:34.657088+0000","last_became_active":"2023-11-04T01:44:40.923318+0000","last_became_peered":"2023-11-04T01:44:40.923318+0000","last_unstale":"2023-11-04T01:45:34.657088+0000","last_undegraded":"2023-11-04T01:45:34.657088+0000","last_fullsized":"2023-11-04T01:45:34.657088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:17.305049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022310820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656491+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:45:34.656491+0000","last_peered":"2023-11-04T01:45:34.656491+0000","last_clean":"2023-11-04T01:45:34.656491+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:45:34.656491+0000","last_undegraded":"2023-11-04T01:45:34.656491+0000","last_fullsized":"2023-11-04T01:45:34.656491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725761+0000","last_change":"2023-11-04T01:45:35.723055+0000","last_active":"2023-11-04T01:45:35.725761+0000","last_peered":"2023-11-04T01:45:35.725761+0000","last_clean":"2023-11-04T01:45:35.725761+0000","last_became_active":"2023-11-04T01:45:35.722660+0000","last_became_peered":"2023-11-04T01:45:35.722660+0000","last_unstale":"2023-11-04T01:45:35.725761+0000","last_undegraded":"2023-11-04T01:45:35.725761+0000","last_fullsized":"2023-11-04T01:45:35.725761+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:45:34.216190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733791+0000","last_change":"2023-11-04T01:45:34.680235+0000","last_active":"2023-11-04T01:45:35.733791+0000","last_peered":"2023-11-04T01:45:35.733791+0000","last_clean":"2023-11-04T01:45:35.733791+0000","last_became_active":"2023-11-04T01:45:34.674891+0000","last_became_peered":"2023-11-04T01:45:34.674891+0000","last_unstale":"2023-11-04T01:45:35.733791+0000","last_undegraded":"2023-11-04T01:45:35.733791+0000","last_fullsized":"2023-11-04T01:45:35.733791+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:38.573503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671025+0000","last_change":"2023-11-04T01:44:41.925191+0000","last_active":"2023-11-04T01:45:34.671025+0000","last_peered":"2023-11-04T01:45:34.671025+0000","last_clean":"2023-11-04T01:45:34.671025+0000","last_became_active":"2023-11-04T01:44:41.924485+0000","last_became_peered":"2023-11-04T01:44:41.924485+0000","last_unstale":"2023-11-04T01:45:34.671025+0000","last_undegraded":"2023-11-04T01:45:34.671025+0000","last_fullsized":"2023-11-04T01:45:34.671025+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:58:41.435918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.672169+0000","last_change":"2023-11-04T01:44:43.174754+0000","last_active":"2023-11-04T01:45:34.672169+0000","last_peered":"2023-11-04T01:45:34.672169+0000","last_clean":"2023-11-04T01:45:34.672169+0000","last_became_active":"2023-11-04T01:44:40.921452+0000","last_became_peered":"2023-11-04T01:44:40.921452+0000","last_unstale":"2023-11-04T01:45:34.672169+0000","last_undegraded":"2023-11-04T01:45:34.672169+0000","last_fullsized":"2023-11-04T01:45:34.672169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:08.209205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039894290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.642335+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:45:34.642335+0000","last_peered":"2023-11-04T01:45:34.642335+0000","last_clean":"2023-11-04T01:45:34.642335+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:45:34.642335+0000","last_undegraded":"2023-11-04T01:45:34.642335+0000","last_fullsized":"2023-11-04T01:45:34.642335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714604+0000","last_change":"2023-11-04T01:45:35.717846+0000","last_active":"2023-11-04T01:45:36.714604+0000","last_peered":"2023-11-04T01:45:36.714604+0000","last_clean":"2023-11-04T01:45:36.714604+0000","last_became_active":"2023-11-04T01:45:35.717491+0000","last_became_peered":"2023-11-04T01:45:35.717491+0000","last_unstale":"2023-11-04T01:45:36.714604+0000","last_undegraded":"2023-11-04T01:45:36.714604+0000","last_fullsized":"2023-11-04T01:45:36.714604+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:54.444695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738528+0000","last_change":"2023-11-04T01:45:34.679841+0000","last_active":"2023-11-04T01:45:35.738528+0000","last_peered":"2023-11-04T01:45:35.738528+0000","last_clean":"2023-11-04T01:45:35.738528+0000","last_became_active":"2023-11-04T01:45:34.679085+0000","last_became_peered":"2023-11-04T01:45:34.679085+0000","last_unstale":"2023-11-04T01:45:35.738528+0000","last_undegraded":"2023-11-04T01:45:35.738528+0000","last_fullsized":"2023-11-04T01:45:35.738528+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:24:44.526862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671961+0000","last_change":"2023-11-04T01:44:41.925691+0000","last_active":"2023-11-04T01:45:34.671961+0000","last_peered":"2023-11-04T01:45:34.671961+0000","last_clean":"2023-11-04T01:45:34.671961+0000","last_became_active":"2023-11-04T01:44:41.924864+0000","last_became_peered":"2023-11-04T01:44:41.924864+0000","last_unstale":"2023-11-04T01:45:34.671961+0000","last_undegraded":"2023-11-04T01:45:34.671961+0000","last_fullsized":"2023-11-04T01:45:34.671961+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:45.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691304+0000","last_change":"2023-11-04T01:44:42.906340+0000","last_active":"2023-11-04T01:45:35.691304+0000","last_peered":"2023-11-04T01:45:35.691304+0000","last_clean":"2023-11-04T01:45:35.691304+0000","last_became_active":"2023-11-04T01:44:40.910288+0000","last_became_peered":"2023-11-04T01:44:40.910288+0000","last_unstale":"2023-11-04T01:45:35.691304+0000","last_undegraded":"2023-11-04T01:45:35.691304+0000","last_fullsized":"2023-11-04T01:45:35.691304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:47.297826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042925560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.669491+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:45:34.669491+0000","last_peered":"2023-11-04T01:45:34.669491+0000","last_clean":"2023-11-04T01:45:34.669491+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:45:34.669491+0000","last_undegraded":"2023-11-04T01:45:34.669491+0000","last_fullsized":"2023-11-04T01:45:34.669491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714571+0000","last_change":"2023-11-04T01:45:35.716929+0000","last_active":"2023-11-04T01:45:36.714571+0000","last_peered":"2023-11-04T01:45:36.714571+0000","last_clean":"2023-11-04T01:45:36.714571+0000","last_became_active":"2023-11-04T01:45:35.716547+0000","last_became_peered":"2023-11-04T01:45:35.716547+0000","last_unstale":"2023-11-04T01:45:36.714571+0000","last_undegraded":"2023-11-04T01:45:36.714571+0000","last_fullsized":"2023-11-04T01:45:36.714571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:02:55.858718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.701343+0000","last_change":"2023-11-04T01:45:34.691291+0000","last_active":"2023-11-04T01:45:35.701343+0000","last_peered":"2023-11-04T01:45:35.701343+0000","last_clean":"2023-11-04T01:45:35.701343+0000","last_became_active":"2023-11-04T01:45:34.689214+0000","last_became_peered":"2023-11-04T01:45:34.689214+0000","last_unstale":"2023-11-04T01:45:35.701343+0000","last_undegraded":"2023-11-04T01:45:35.701343+0000","last_fullsized":"2023-11-04T01:45:35.701343+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:17.582680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640312+0000","last_change":"2023-11-04T01:44:41.918620+0000","last_active":"2023-11-04T01:45:34.640312+0000","last_peered":"2023-11-04T01:45:34.640312+0000","last_clean":"2023-11-04T01:45:34.640312+0000","last_became_active":"2023-11-04T01:44:41.918291+0000","last_became_peered":"2023-11-04T01:44:41.918291+0000","last_unstale":"2023-11-04T01:45:34.640312+0000","last_undegraded":"2023-11-04T01:45:34.640312+0000","last_fullsized":"2023-11-04T01:45:34.640312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654952+0000","last_change":"2023-11-04T01:44:43.173305+0000","last_active":"2023-11-04T01:45:34.654952+0000","last_peered":"2023-11-04T01:45:34.654952+0000","last_clean":"2023-11-04T01:45:34.654952+0000","last_became_active":"2023-11-04T01:44:40.918163+0000","last_became_peered":"2023-11-04T01:44:40.918163+0000","last_unstale":"2023-11-04T01:45:34.654952+0000","last_undegraded":"2023-11-04T01:45:34.654952+0000","last_fullsized":"2023-11-04T01:45:34.654952+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:21.563078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011642689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673903+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:45:34.673903+0000","last_peered":"2023-11-04T01:45:34.673903+0000","last_clean":"2023-11-04T01:45:34.673903+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:45:34.673903+0000","last_undegraded":"2023-11-04T01:45:34.673903+0000","last_fullsized":"2023-11-04T01:45:34.673903+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741448+0000","last_change":"2023-11-04T01:45:35.732613+0000","last_active":"2023-11-04T01:45:35.741448+0000","last_peered":"2023-11-04T01:45:35.741448+0000","last_clean":"2023-11-04T01:45:35.741448+0000","last_became_active":"2023-11-04T01:45:35.731436+0000","last_became_peered":"2023-11-04T01:45:35.731436+0000","last_unstale":"2023-11-04T01:45:35.741448+0000","last_undegraded":"2023-11-04T01:45:35.741448+0000","last_fullsized":"2023-11-04T01:45:35.741448+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:51:59.776959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.694126+0000","last_change":"2023-11-04T01:45:34.677958+0000","last_active":"2023-11-04T01:45:35.694126+0000","last_peered":"2023-11-04T01:45:35.694126+0000","last_clean":"2023-11-04T01:45:35.694126+0000","last_became_active":"2023-11-04T01:45:34.676384+0000","last_became_peered":"2023-11-04T01:45:34.676384+0000","last_unstale":"2023-11-04T01:45:35.694126+0000","last_undegraded":"2023-11-04T01:45:35.694126+0000","last_fullsized":"2023-11-04T01:45:35.694126+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:03.051575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657214+0000","last_change":"2023-11-04T01:44:41.918947+0000","last_active":"2023-11-04T01:45:34.657214+0000","last_peered":"2023-11-04T01:45:34.657214+0000","last_clean":"2023-11-04T01:45:34.657214+0000","last_became_active":"2023-11-04T01:44:41.918140+0000","last_became_peered":"2023-11-04T01:44:41.918140+0000","last_unstale":"2023-11-04T01:45:34.657214+0000","last_undegraded":"2023-11-04T01:45:34.657214+0000","last_fullsized":"2023-11-04T01:45:34.657214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:58.268543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.677754+0000","last_change":"2023-11-04T01:44:43.173435+0000","last_active":"2023-11-04T01:45:34.677754+0000","last_peered":"2023-11-04T01:45:34.677754+0000","last_clean":"2023-11-04T01:45:34.677754+0000","last_became_active":"2023-11-04T01:44:40.934905+0000","last_became_peered":"2023-11-04T01:44:40.934905+0000","last_unstale":"2023-11-04T01:45:34.677754+0000","last_undegraded":"2023-11-04T01:45:34.677754+0000","last_fullsized":"2023-11-04T01:45:34.677754+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:59.915687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324778,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656465+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:45:34.656465+0000","last_peered":"2023-11-04T01:45:34.656465+0000","last_clean":"2023-11-04T01:45:34.656465+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:45:34.656465+0000","last_undegraded":"2023-11-04T01:45:34.656465+0000","last_fullsized":"2023-11-04T01:45:34.656465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731227+0000","last_change":"2023-11-04T01:45:35.724981+0000","last_active":"2023-11-04T01:45:35.731227+0000","last_peered":"2023-11-04T01:45:35.731227+0000","last_clean":"2023-11-04T01:45:35.731227+0000","last_became_active":"2023-11-04T01:45:35.723769+0000","last_became_peered":"2023-11-04T01:45:35.723769+0000","last_unstale":"2023-11-04T01:45:35.731227+0000","last_undegraded":"2023-11-04T01:45:35.731227+0000","last_fullsized":"2023-11-04T01:45:35.731227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:18.593633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"91'8","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733768+0000","last_change":"2023-11-04T01:45:34.669723+0000","last_active":"2023-11-04T01:45:35.733768+0000","last_peered":"2023-11-04T01:45:35.733768+0000","last_clean":"2023-11-04T01:45:35.733768+0000","last_became_active":"2023-11-04T01:45:34.669140+0000","last_became_peered":"2023-11-04T01:45:34.669140+0000","last_unstale":"2023-11-04T01:45:35.733768+0000","last_undegraded":"2023-11-04T01:45:35.733768+0000","last_fullsized":"2023-11-04T01:45:35.733768+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:43:33.255453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673897+0000","last_change":"2023-11-04T01:44:41.935218+0000","last_active":"2023-11-04T01:45:34.673897+0000","last_peered":"2023-11-04T01:45:34.673897+0000","last_clean":"2023-11-04T01:45:34.673897+0000","last_became_active":"2023-11-04T01:44:41.934439+0000","last_became_peered":"2023-11-04T01:44:41.934439+0000","last_unstale":"2023-11-04T01:45:34.673897+0000","last_undegraded":"2023-11-04T01:45:34.673897+0000","last_fullsized":"2023-11-04T01:45:34.673897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:16.371130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670514+0000","last_change":"2023-11-04T01:44:42.905649+0000","last_active":"2023-11-04T01:45:34.670514+0000","last_peered":"2023-11-04T01:45:34.670514+0000","last_clean":"2023-11-04T01:45:34.670514+0000","last_became_active":"2023-11-04T01:44:40.923902+0000","last_became_peered":"2023-11-04T01:44:40.923902+0000","last_unstale":"2023-11-04T01:45:34.670514+0000","last_undegraded":"2023-11-04T01:45:34.670514+0000","last_fullsized":"2023-11-04T01:45:34.670514+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:10.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015906259999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.685701+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:45:35.685701+0000","last_peered":"2023-11-04T01:45:35.685701+0000","last_clean":"2023-11-04T01:45:35.685701+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:45:35.685701+0000","last_undegraded":"2023-11-04T01:45:35.685701+0000","last_fullsized":"2023-11-04T01:45:35.685701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731183+0000","last_change":"2023-11-04T01:45:35.719054+0000","last_active":"2023-11-04T01:45:35.731183+0000","last_peered":"2023-11-04T01:45:35.731183+0000","last_clean":"2023-11-04T01:45:35.731183+0000","last_became_active":"2023-11-04T01:45:35.718481+0000","last_became_peered":"2023-11-04T01:45:35.718481+0000","last_unstale":"2023-11-04T01:45:35.731183+0000","last_undegraded":"2023-11-04T01:45:35.731183+0000","last_fullsized":"2023-11-04T01:45:35.731183+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:59.069271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.720583+0000","last_change":"2023-11-04T01:45:34.668400+0000","last_active":"2023-11-04T01:45:35.720583+0000","last_peered":"2023-11-04T01:45:35.720583+0000","last_clean":"2023-11-04T01:45:35.720583+0000","last_became_active":"2023-11-04T01:45:34.668108+0000","last_became_peered":"2023-11-04T01:45:34.668108+0000","last_unstale":"2023-11-04T01:45:35.720583+0000","last_undegraded":"2023-11-04T01:45:35.720583+0000","last_fullsized":"2023-11-04T01:45:35.720583+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:03.405072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.690721+0000","last_change":"2023-11-04T01:44:41.934607+0000","last_active":"2023-11-04T01:45:35.690721+0000","last_peered":"2023-11-04T01:45:35.690721+0000","last_clean":"2023-11-04T01:45:35.690721+0000","last_became_active":"2023-11-04T01:44:41.934198+0000","last_became_peered":"2023-11-04T01:44:41.934198+0000","last_unstale":"2023-11-04T01:45:35.690721+0000","last_undegraded":"2023-11-04T01:45:35.690721+0000","last_fullsized":"2023-11-04T01:45:35.690721+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:38.701974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.653308+0000","last_change":"2023-11-04T01:44:43.172018+0000","last_active":"2023-11-04T01:45:34.653308+0000","last_peered":"2023-11-04T01:45:34.653308+0000","last_clean":"2023-11-04T01:45:34.653308+0000","last_became_active":"2023-11-04T01:44:40.912370+0000","last_became_peered":"2023-11-04T01:44:40.912370+0000","last_unstale":"2023-11-04T01:45:34.653308+0000","last_undegraded":"2023-11-04T01:45:34.653308+0000","last_fullsized":"2023-11-04T01:45:34.653308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:13:11.680326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061865800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670850+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:45:34.670850+0000","last_peered":"2023-11-04T01:45:34.670850+0000","last_clean":"2023-11-04T01:45:34.670850+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:45:34.670850+0000","last_undegraded":"2023-11-04T01:45:34.670850+0000","last_fullsized":"2023-11-04T01:45:34.670850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730223+0000","last_change":"2023-11-04T01:45:35.713172+0000","last_active":"2023-11-04T01:45:35.730223+0000","last_peered":"2023-11-04T01:45:35.730223+0000","last_clean":"2023-11-04T01:45:35.730223+0000","last_became_active":"2023-11-04T01:45:35.712874+0000","last_became_peered":"2023-11-04T01:45:35.712874+0000","last_unstale":"2023-11-04T01:45:35.730223+0000","last_undegraded":"2023-11-04T01:45:35.730223+0000","last_fullsized":"2023-11-04T01:45:35.730223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:11:34.915045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.698685+0000","last_change":"2023-11-04T01:45:34.691212+0000","last_active":"2023-11-04T01:45:35.698685+0000","last_peered":"2023-11-04T01:45:35.698685+0000","last_clean":"2023-11-04T01:45:35.698685+0000","last_became_active":"2023-11-04T01:45:34.689149+0000","last_became_peered":"2023-11-04T01:45:34.689149+0000","last_unstale":"2023-11-04T01:45:35.698685+0000","last_undegraded":"2023-11-04T01:45:35.698685+0000","last_fullsized":"2023-11-04T01:45:35.698685+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:17.438114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654074+0000","last_change":"2023-11-04T01:44:41.926616+0000","last_active":"2023-11-04T01:45:34.654074+0000","last_peered":"2023-11-04T01:45:34.654074+0000","last_clean":"2023-11-04T01:45:34.654074+0000","last_became_active":"2023-11-04T01:44:41.926311+0000","last_became_peered":"2023-11-04T01:44:41.926311+0000","last_unstale":"2023-11-04T01:45:34.654074+0000","last_undegraded":"2023-11-04T01:45:34.654074+0000","last_fullsized":"2023-11-04T01:45:34.654074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:11.379149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640414+0000","last_change":"2023-11-04T01:44:43.178007+0000","last_active":"2023-11-04T01:45:34.640414+0000","last_peered":"2023-11-04T01:45:34.640414+0000","last_clean":"2023-11-04T01:45:34.640414+0000","last_became_active":"2023-11-04T01:44:40.918444+0000","last_became_peered":"2023-11-04T01:44:40.918444+0000","last_unstale":"2023-11-04T01:45:34.640414+0000","last_undegraded":"2023-11-04T01:45:34.640414+0000","last_fullsized":"2023-11-04T01:45:34.640414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029560530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.680909+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:45:34.680909+0000","last_peered":"2023-11-04T01:45:34.680909+0000","last_clean":"2023-11-04T01:45:34.680909+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:45:34.680909+0000","last_undegraded":"2023-11-04T01:45:34.680909+0000","last_fullsized":"2023-11-04T01:45:34.680909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.722114+0000","last_change":"2023-11-04T01:45:35.713709+0000","last_active":"2023-11-04T01:45:35.722114+0000","last_peered":"2023-11-04T01:45:35.722114+0000","last_clean":"2023-11-04T01:45:35.722114+0000","last_became_active":"2023-11-04T01:45:35.713412+0000","last_became_peered":"2023-11-04T01:45:35.713412+0000","last_unstale":"2023-11-04T01:45:35.722114+0000","last_undegraded":"2023-11-04T01:45:35.722114+0000","last_fullsized":"2023-11-04T01:45:35.722114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:04.024187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"91'3","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731649+0000","last_change":"2023-11-04T01:45:34.678518+0000","last_active":"2023-11-04T01:45:35.731649+0000","last_peered":"2023-11-04T01:45:35.731649+0000","last_clean":"2023-11-04T01:45:35.731649+0000","last_became_active":"2023-11-04T01:45:34.678224+0000","last_became_peered":"2023-11-04T01:45:34.678224+0000","last_unstale":"2023-11-04T01:45:35.731649+0000","last_undegraded":"2023-11-04T01:45:35.731649+0000","last_fullsized":"2023-11-04T01:45:35.731649+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:51.750252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641691+0000","last_change":"2023-11-04T01:44:41.910669+0000","last_active":"2023-11-04T01:45:34.641691+0000","last_peered":"2023-11-04T01:45:34.641691+0000","last_clean":"2023-11-04T01:45:34.641691+0000","last_became_active":"2023-11-04T01:44:41.910257+0000","last_became_peered":"2023-11-04T01:44:41.910257+0000","last_unstale":"2023-11-04T01:45:34.641691+0000","last_undegraded":"2023-11-04T01:45:34.641691+0000","last_fullsized":"2023-11-04T01:45:34.641691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:15.837643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656839+0000","last_change":"2023-11-04T01:44:43.112877+0000","last_active":"2023-11-04T01:45:34.656839+0000","last_peered":"2023-11-04T01:45:34.656839+0000","last_clean":"2023-11-04T01:45:34.656839+0000","last_became_active":"2023-11-04T01:44:40.940708+0000","last_became_peered":"2023-11-04T01:44:40.940708+0000","last_unstale":"2023-11-04T01:45:34.656839+0000","last_undegraded":"2023-11-04T01:45:34.656839+0000","last_fullsized":"2023-11-04T01:45:34.656839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:09.389684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022320399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670668+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:45:34.670668+0000","last_peered":"2023-11-04T01:45:34.670668+0000","last_clean":"2023-11-04T01:45:34.670668+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:45:34.670668+0000","last_undegraded":"2023-11-04T01:45:34.670668+0000","last_fullsized":"2023-11-04T01:45:34.670668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738424+0000","last_change":"2023-11-04T01:45:35.726494+0000","last_active":"2023-11-04T01:45:35.738424+0000","last_peered":"2023-11-04T01:45:35.738424+0000","last_clean":"2023-11-04T01:45:35.738424+0000","last_became_active":"2023-11-04T01:45:35.725406+0000","last_became_peered":"2023-11-04T01:45:35.725406+0000","last_unstale":"2023-11-04T01:45:35.738424+0000","last_undegraded":"2023-11-04T01:45:35.738424+0000","last_fullsized":"2023-11-04T01:45:35.738424+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:48:10.452150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"91'6","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.739812+0000","last_change":"2023-11-04T01:45:34.691663+0000","last_active":"2023-11-04T01:45:35.739812+0000","last_peered":"2023-11-04T01:45:35.739812+0000","last_clean":"2023-11-04T01:45:35.739812+0000","last_became_active":"2023-11-04T01:45:34.691350+0000","last_became_peered":"2023-11-04T01:45:34.691350+0000","last_unstale":"2023-11-04T01:45:35.739812+0000","last_undegraded":"2023-11-04T01:45:35.739812+0000","last_fullsized":"2023-11-04T01:45:35.739812+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:51.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656073+0000","last_change":"2023-11-04T01:44:41.934098+0000","last_active":"2023-11-04T01:45:34.656073+0000","last_peered":"2023-11-04T01:45:34.656073+0000","last_clean":"2023-11-04T01:45:34.656073+0000","last_became_active":"2023-11-04T01:44:41.933709+0000","last_became_peered":"2023-11-04T01:44:41.933709+0000","last_unstale":"2023-11-04T01:45:34.656073+0000","last_undegraded":"2023-11-04T01:45:34.656073+0000","last_fullsized":"2023-11-04T01:45:34.656073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:56.613949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.677317+0000","last_change":"2023-11-04T01:44:43.172536+0000","last_active":"2023-11-04T01:45:34.677317+0000","last_peered":"2023-11-04T01:45:34.677317+0000","last_clean":"2023-11-04T01:45:34.677317+0000","last_became_active":"2023-11-04T01:44:40.923754+0000","last_became_peered":"2023-11-04T01:44:40.923754+0000","last_unstale":"2023-11-04T01:45:34.677317+0000","last_undegraded":"2023-11-04T01:45:34.677317+0000","last_fullsized":"2023-11-04T01:45:34.677317+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:16.408984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026512620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673522+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:45:34.673522+0000","last_peered":"2023-11-04T01:45:34.673522+0000","last_clean":"2023-11-04T01:45:34.673522+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:45:34.673522+0000","last_undegraded":"2023-11-04T01:45:34.673522+0000","last_fullsized":"2023-11-04T01:45:34.673522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1712128,"data_stored":1110592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.626,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.69999999999999996},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71199999999999997,"15min":0.68999999999999995},"min":{"1min":0.30099999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.82199999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89200000000000002,"15min":0.879},"min":{"1min":0.53900000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2290000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.96999999999999997,"15min":0.97799999999999998},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.0109999999999999,"15min":1.008},"min":{"1min":0.58599999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.78600000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.98299999999999998,"15min":0.98699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4359999999999999,"5min":1.468,"15min":1.468},"last":0.875},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.044,"15min":1.0660000000000001},"min":{"1min":0.63900000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2,"5min":2,"15min":2},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.046,"15min":1.05},"min":{"1min":0.625,"5min":0.502,"15min":0.502},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.02,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.92100000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1114112,"data_stored":520714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.33500000000000002,"5min":0.248,"15min":0.248},"max":{"1min":1.0329999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.194},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.002,"5min":1.595,"15min":1.595},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.25,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.607,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4419999999999999,"5min":1.885,"15min":1.885},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.218,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.81399999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51500000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.3069999999999999,"5min":1.526,"15min":1.526},"last":1.246},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96799999999999997,"15min":0.96999999999999997},"min":{"1min":0.57799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4419999999999999,"5min":1.897,"15min":1.897},"last":0.91800000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3089999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.97099999999999997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.383,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1419999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.622,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.536,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.042,"15min":1.044},"min":{"1min":0.63400000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5529999999999999,"5min":1.948,"15min":1.948},"last":1.111}]},{"osd":7,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0840000000000001,"15min":1.0920000000000001},"min":{"1min":0.66500000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.518,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3779999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.615}]}]},{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1118208,"data_stored":520784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.85399999999999998,"15min":0.88600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.008,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.163},{"interface":"front","average":{"1min":0.747,"5min":0.81899999999999995,"15min":0.84099999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0409999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2230000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.127},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84399999999999997,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.165,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3220000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89500000000000002,"15min":0.90100000000000002},"min":{"1min":0.66500000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89800000000000002,"15min":0.90100000000000002},"min":{"1min":0.66200000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1499999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.98999999999999999,"15min":1.0049999999999999},"min":{"1min":0.72399999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.4350000000000001,"5min":1.514,"15min":1.514},"last":0.98999999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92600000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3819999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.21},{"interface":"front","average":{"1min":1.052,"5min":1.0609999999999999,"15min":1.0669999999999999},"min":{"1min":0.70699999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2170000000000001,"5min":2.609,"15min":2.609},"last":0.95199999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.115,"15min":1.163},"min":{"1min":0.62,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2869999999999999,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.125,"15min":2.5649999999999999},"min":{"1min":0.84199999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5109999999999999,"5min":40.195,"15min":40.195},"last":0.749}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.246,"15min":1.304},"min":{"1min":0.96999999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.268,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.129,"15min":1.1459999999999999},"min":{"1min":0.75600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3180000000000001,"5min":1.637,"15min":1.637},"last":0.92700000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":512294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.012,"15min":0.93200000000000005},"min":{"1min":0.5,"5min":0.497,"15min":0.497},"max":{"1min":12.167999999999999,"5min":12.167999999999999,"15min":12.167999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.169,"5min":0.98499999999999999,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":7.0510000000000002,"5min":7.0510000000000002,"15min":7.0510000000000002},"last":0.93200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.99399999999999999,"15min":0.97599999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":1.274},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.99199999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.0940000000000001,"15min":1.0449999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":12.343,"5min":12.343,"15min":12.343},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.0720000000000001,"15min":1.0469999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":7.1269999999999998,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":1.0629999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.109,"15min":1.0409999999999999},"min":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":12.256,"5min":12.256,"15min":12.256},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.157,"15min":1.147},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":7.2880000000000003,"5min":7.2880000000000003,"15min":7.2880000000000003},"last":1.1559999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.0529999999999999,"15min":0.99199999999999999},"min":{"1min":0.73899999999999999,"5min":0.495,"15min":0.495},"max":{"1min":10.73,"5min":10.73,"15min":10.73},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.629,"5min":1.2150000000000001,"15min":1.1559999999999999},"min":{"1min":0.73299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":12.494999999999999,"5min":12.494999999999999,"15min":12.494999999999999},"last":0.874}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.083,"15min":1.071},"min":{"1min":0.70499999999999996,"5min":0.63,"15min":0.63},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":2.0179999999999998,"5min":1.329,"15min":1.228},"min":{"1min":0.70899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":19.361999999999998,"5min":19.361999999999998,"15min":19.361999999999998},"last":1.0189999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.1970000000000001,"15min":1.1890000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":7.1980000000000004,"5min":7.1980000000000004,"15min":7.1980000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1080000000000001,"15min":1.1120000000000001},"min":{"1min":0.92900000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3280000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.099}]}]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1691648,"data_stored":1102662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.873,"15min":0.878},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.3089999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.82799999999999996,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.093}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.877,"15min":0.89300000000000002},"min":{"1min":0.60699999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2509999999999999,"5min":1.321,"15min":1.321},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.93400000000000005},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.97199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.871,"15min":0.85699999999999998},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4119999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.24}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.877,"15min":0.876},"min":{"1min":0.57399999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.94899999999999995,"15min":0.92600000000000005},"min":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.196}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1,"15min":0.98899999999999999},"min":{"1min":0.72399999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.995,"15min":1.0209999999999999},"min":{"1min":0.63500000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2290000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.115,"15min":1.155},"min":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5029999999999999,"5min":1.627,"15min":1.627},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1899999999999999,"15min":1.181},"min":{"1min":0.95499999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.28}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.113,"15min":1.1379999999999999},"min":{"1min":0.88900000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.127},{"interface":"front","average":{"1min":1.179,"5min":1.2090000000000001,"15min":1.2270000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.319}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1097728,"data_stored":512294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.82399999999999995,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.071,"5min":0.97499999999999998,"15min":0.98199999999999998},"min":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":4.8150000000000004,"5min":4.8150000000000004,"15min":4.8150000000000004},"last":0.89700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.93899999999999995,"15min":0.91900000000000004},"min":{"1min":0.67200000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.88400000000000001,"15min":0.879},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.76200000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.4620000000000002,"5min":3.4620000000000002,"15min":3.4620000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.556,"5min":4.556,"15min":4.556},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93300000000000005,"15min":0.92600000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.169,"5min":1.103,"15min":1.111},"min":{"1min":0.64800000000000002,"5min":0.627,"15min":0.627},"max":{"1min":4.3319999999999999,"5min":4.3319999999999999,"15min":4.3319999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95899999999999996,"15min":0.96399999999999997},"min":{"1min":0.71399999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.29,"5min":1.369,"15min":1.369},"last":1.02},{"interface":"front","average":{"1min":1.002,"5min":0.998,"15min":1.002},"min":{"1min":0.67700000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.502,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1200000000000001,"15min":1.1220000000000001},"min":{"1min":0.66700000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.655,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.0269999999999999,"15min":1.014},"min":{"1min":0.70499999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.226,"5min":1.554,"15min":1.554},"last":1.129}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0760000000000001,"15min":1.0620000000000001},"min":{"1min":0.86899999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2130000000000001,"15min":1.2050000000000001},"min":{"1min":0.96699999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.637,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0609999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1122304,"data_stored":521744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.28599999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.91500000000000004,"5min":1.167,"15min":1.167},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.625,"15min":0.622},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.89700000000000002,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.81699999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75600000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.71999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.96799999999999997,"5min":1.429,"15min":1.429},"last":0.72099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.04,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.751,"15min":0.74299999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.88300000000000001,"15min":0.86599999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0900000000000001,"5min":1.371,"15min":1.371},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.94999999999999996,"15min":0.96299999999999997},"min":{"1min":0.63200000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1759999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.081}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.59299999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2709999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.0329999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.2110000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.94199999999999995,"15min":0.94399999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.248,"5min":1.369,"15min":1.369},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.046,"15min":1.0620000000000001},"min":{"1min":0.61099999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3129999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0109999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.048},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0249999999999999,"15min":1.03},"min":{"1min":0.72499999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2290000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.258}]}]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1118208,"data_stored":520244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66700000000000004,"15min":0.66400000000000003},"min":{"1min":0.36399999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.077,"5min":1.274,"15min":1.274},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1539999999999999,"5min":1.181,"15min":1.181},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2330000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3080000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.82999999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.876,"15min":0.876},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.751},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.93100000000000005,"15min":0.93799999999999994},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.327,"5min":1.341,"15min":1.341},"last":1.121}]},{"osd":6,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93999999999999995,"15min":0.95999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3320000000000001,"5min":1.603,"15min":1.603},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.167}]},{"osd":7,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.99199999999999999,"15min":0.996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.306,"5min":1.411,"15min":1.411},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":1.0089999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.262,"5min":1.613,"15min":1.613},"last":0.91400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:45:39.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:45:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34f5ed2640 1 Processor -- start 2023-11-04T01:45:39.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34f5ed2640 1 -- start start 2023-11-04T01:45:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34f5ed2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f015d690 0x7f34f006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34f5ed2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f34f006f8f0 0x7f34f00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34f5ed2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f00cd400 con 0x7f34f015d2b0 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34f5ed2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f00ad450 con 0x7f34f006f8f0 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34f5ed2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00cd6e0 con 0x7f34f015d690 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34ef7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f34f015d2b0 0x7f34f00ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:37228/0 (socket says 172.21.15.2:37228) 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34ef7fe640 1 -- 172.21.15.2:0/4150234104 learned_addr learned my addr 172.21.15.2:0/4150234104 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34effff640 1 --2- 172.21.15.2:0/4150234104 >> v2:172.21.15.2:3300/0 conn(0x7f34f006f8f0 0x7f34f00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.953+0000 7f34eeffd640 1 --2- 172.21.15.2:0/4150234104 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f015d690 0x7f34f006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34ee7fc640 1 -- 172.21.15.2:0/4150234104 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408677093 0 0) 0x7f34f00cd400 con 0x7f34f015d2b0 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34ee7fc640 1 -- 172.21.15.2:0/4150234104 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d8003530 con 0x7f34f015d2b0 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34effff640 1 -- 172.21.15.2:0/4150234104 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f015d690 msgr2=0x7f34f006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34effff640 1 --2- 172.21.15.2:0/4150234104 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f015d690 0x7f34f006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34effff640 1 -- 172.21.15.2:0/4150234104 >> v1:172.21.15.2:6789/0 conn(0x7f34f015d2b0 legacy=0x7f34f00ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34effff640 1 -- 172.21.15.2:0/4150234104 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00ad070 con 0x7f34f006f8f0 2023-11-04T01:45:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34effff640 1 --2- 172.21.15.2:0/4150234104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f006f8f0 0x7f34f00b0630 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009d90 tx=0x7f34e801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c849763f80acfa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34ee7fc640 1 -- 172.21.15.2:0/4150234104 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80a5850 con 0x7f34f006f8f0 2023-11-04T01:45:39.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34ee7fc640 1 -- 172.21.15.2:0/4150234104 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e80a59b0 con 0x7f34f006f8f0 2023-11-04T01:45:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34ee7fc640 1 -- 172.21.15.2:0/4150234104 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80a5d40 con 0x7f34f006f8f0 2023-11-04T01:45:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 -- 172.21.15.2:0/4150234104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f006f8f0 msgr2=0x7f34f00b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/4150234104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f006f8f0 0x7f34f00b0630 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009d90 tx=0x7f34e801c8c0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 -- 172.21.15.2:0/4150234104 shutdown_connections 2023-11-04T01:45:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/4150234104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f006f8f0 0x7f34f00b0630 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/4150234104 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f015d690 0x7f34f006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 -- 172.21.15.2:0/4150234104 >> 172.21.15.2:0/4150234104 conn(0x7f34f00cebb0 msgr2=0x7f34f00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 -- 172.21.15.2:0/4150234104 shutdown_connections 2023-11-04T01:45:39.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.957+0000 7f34f5ed2640 1 -- 172.21.15.2:0/4150234104 wait complete. 2023-11-04T01:45:39.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 Processor -- start 2023-11-04T01:45:39.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 -- start start 2023-11-04T01:45:39.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f006f8f0 0x7f34f0158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34f015d2b0 0x7f34f00b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f015d690 0x7f34f00b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0159e20 con 0x7f34f015d690 2023-11-04T01:45:39.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0158b60 con 0x7f34f015d2b0 2023-11-04T01:45:39.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0159210 con 0x7f34f006f8f0 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f015d690 0x7f34f00b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f015d690 0x7f34f00b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50264/0 (socket says 172.21.15.2:50264) 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 -- 172.21.15.2:0/2299781202 learned_addr learned my addr 172.21.15.2:0/2299781202 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34ef7fe640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f006f8f0 0x7f34f0158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34eeffd640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34f015d2b0 0x7f34f00b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 -- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f006f8f0 msgr2=0x7f34f0158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f006f8f0 0x7f34f0158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 -- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34f015d2b0 msgr2=0x7f34f00b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34f015d2b0 0x7f34f00b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 -- 172.21.15.2:0/2299781202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8009a70 con 0x7f34f015d690 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34ef7fe640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f006f8f0 0x7f34f0158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34effff640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f015d690 0x7f34f00b3ab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f34e801d160 tx=0x7f34e8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34d7fff640 1 -- 172.21.15.2:0/2299781202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80b9650 con 0x7f34f015d690 2023-11-04T01:45:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34d7fff640 1 -- 172.21.15.2:0/2299781202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e80b97b0 con 0x7f34f015d690 2023-11-04T01:45:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f01594f0 con 0x7f34f015d690 2023-11-04T01:45:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34d7fff640 1 -- 172.21.15.2:0/2299781202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80b9b20 con 0x7f34f015d690 2023-11-04T01:45:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.961+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f0159ab0 con 0x7f34f015d690 2023-11-04T01:45:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.965+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f0159f90 con 0x7f34f015d690 2023-11-04T01:45:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.965+0000 7f34d7fff640 1 -- 172.21.15.2:0/2299781202 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f34e80b9c80 con 0x7f34f015d690 2023-11-04T01:45:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.965+0000 7f34d7fff640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34dc0664a0 0x7f34dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.965+0000 7f34d7fff640 1 -- 172.21.15.2:0/2299781202 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f34e811f540 con 0x7f34f015d690 2023-11-04T01:45:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.965+0000 7f34ef7fe640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34dc0664a0 0x7f34dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.965+0000 7f34ef7fe640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34dc0664a0 0x7f34dc068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f34e00011f0 tx=0x7f34e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:39.969+0000 7f34d7fff640 1 -- 172.21.15.2:0/2299781202 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f34e80ec590 con 0x7f34f015d690 2023-11-04T01:45:40.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.113+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 --> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34f00c8700 con 0x7f34dc0664a0 2023-11-04T01:45:40.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.153+0000 7f34d7fff640 1 -- 172.21.15.2:0/2299781202 <== mgr.4099 v2:172.21.15.90:6832/650491919 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+530273 (secure 0 0 0) 0x7f34f00c8700 con 0x7f34dc0664a0 2023-11-04T01:45:40.159 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34dc0664a0 msgr2=0x7f34dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34dc0664a0 0x7f34dc068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f34e00011f0 tx=0x7f34e0009040 comp rx=0 tx=0).stop 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f015d690 msgr2=0x7f34f00b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f015d690 0x7f34f00b3ab0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f34e801d160 tx=0x7f34e8019660 comp rx=0 tx=0).stop 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 shutdown_connections 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f34dc0664a0 0x7f34dc068960 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f34f015d690 0x7f34f00b3ab0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34f015d2b0 0x7f34f00b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 --2- 172.21.15.2:0/2299781202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f34f006f8f0 0x7f34f0158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 >> 172.21.15.2:0/2299781202 conn(0x7f34f00cebb0 msgr2=0x7f34f00cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:40.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 shutdown_connections 2023-11-04T01:45:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.161+0000 7f34f5ed2640 1 -- 172.21.15.2:0/2299781202 wait complete. 2023-11-04T01:45:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-11-04T01:45:38.844468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":252,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250992,"kb_used_data":9836,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754723728,"statfs":{"total":773094113280,"available":772837097472,"internally_reserved":0,"allocated":10072064,"data_stored":5321328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.210809"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730885+0000","last_change":"2023-11-04T01:45:35.719965+0000","last_active":"2023-11-04T01:45:35.730885+0000","last_peered":"2023-11-04T01:45:35.730885+0000","last_clean":"2023-11-04T01:45:35.730885+0000","last_became_active":"2023-11-04T01:45:35.719022+0000","last_became_peered":"2023-11-04T01:45:35.719022+0000","last_unstale":"2023-11-04T01:45:35.730885+0000","last_undegraded":"2023-11-04T01:45:35.730885+0000","last_fullsized":"2023-11-04T01:45:35.730885+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:22:57.504771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714298+0000","last_change":"2023-11-04T01:45:35.718414+0000","last_active":"2023-11-04T01:45:36.714298+0000","last_peered":"2023-11-04T01:45:36.714298+0000","last_clean":"2023-11-04T01:45:36.714298+0000","last_became_active":"2023-11-04T01:45:35.718110+0000","last_became_peered":"2023-11-04T01:45:35.718110+0000","last_unstale":"2023-11-04T01:45:36.714298+0000","last_undegraded":"2023-11-04T01:45:36.714298+0000","last_fullsized":"2023-11-04T01:45:36.714298+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:41:17.909017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731275+0000","last_change":"2023-11-04T01:45:35.723554+0000","last_active":"2023-11-04T01:45:35.731275+0000","last_peered":"2023-11-04T01:45:35.731275+0000","last_clean":"2023-11-04T01:45:35.731275+0000","last_became_active":"2023-11-04T01:45:35.723219+0000","last_became_peered":"2023-11-04T01:45:35.723219+0000","last_unstale":"2023-11-04T01:45:35.731275+0000","last_undegraded":"2023-11-04T01:45:35.731275+0000","last_fullsized":"2023-11-04T01:45:35.731275+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:32.130686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731870+0000","last_change":"2023-11-04T01:45:35.718601+0000","last_active":"2023-11-04T01:45:35.731870+0000","last_peered":"2023-11-04T01:45:35.731870+0000","last_clean":"2023-11-04T01:45:35.731870+0000","last_became_active":"2023-11-04T01:45:35.717932+0000","last_became_peered":"2023-11-04T01:45:35.717932+0000","last_unstale":"2023-11-04T01:45:35.731870+0000","last_undegraded":"2023-11-04T01:45:35.731870+0000","last_fullsized":"2023-11-04T01:45:35.731870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:48:54.923348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711306+0000","last_change":"2023-11-04T01:45:35.706439+0000","last_active":"2023-11-04T01:45:35.711306+0000","last_peered":"2023-11-04T01:45:35.711306+0000","last_clean":"2023-11-04T01:45:35.711306+0000","last_became_active":"2023-11-04T01:45:35.706113+0000","last_became_peered":"2023-11-04T01:45:35.706113+0000","last_unstale":"2023-11-04T01:45:35.711306+0000","last_undegraded":"2023-11-04T01:45:35.711306+0000","last_fullsized":"2023-11-04T01:45:35.711306+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:33.433637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725606+0000","last_change":"2023-11-04T01:45:35.720933+0000","last_active":"2023-11-04T01:45:35.725606+0000","last_peered":"2023-11-04T01:45:35.725606+0000","last_clean":"2023-11-04T01:45:35.725606+0000","last_became_active":"2023-11-04T01:45:35.720432+0000","last_became_peered":"2023-11-04T01:45:35.720432+0000","last_unstale":"2023-11-04T01:45:35.725606+0000","last_undegraded":"2023-11-04T01:45:35.725606+0000","last_fullsized":"2023-11-04T01:45:35.725606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:09:54.105313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729811+0000","last_change":"2023-11-04T01:45:35.727214+0000","last_active":"2023-11-04T01:45:35.729811+0000","last_peered":"2023-11-04T01:45:35.729811+0000","last_clean":"2023-11-04T01:45:35.729811+0000","last_became_active":"2023-11-04T01:45:35.726834+0000","last_became_peered":"2023-11-04T01:45:35.726834+0000","last_unstale":"2023-11-04T01:45:35.729811+0000","last_undegraded":"2023-11-04T01:45:35.729811+0000","last_fullsized":"2023-11-04T01:45:35.729811+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:53.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.726809+0000","last_change":"2023-11-04T01:45:35.721060+0000","last_active":"2023-11-04T01:45:35.726809+0000","last_peered":"2023-11-04T01:45:35.726809+0000","last_clean":"2023-11-04T01:45:35.726809+0000","last_became_active":"2023-11-04T01:45:35.720540+0000","last_became_peered":"2023-11-04T01:45:35.720540+0000","last_unstale":"2023-11-04T01:45:35.726809+0000","last_undegraded":"2023-11-04T01:45:35.726809+0000","last_fullsized":"2023-11-04T01:45:35.726809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:22:52.193632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714163+0000","last_change":"2023-11-04T01:45:35.706230+0000","last_active":"2023-11-04T01:45:36.714163+0000","last_peered":"2023-11-04T01:45:36.714163+0000","last_clean":"2023-11-04T01:45:36.714163+0000","last_became_active":"2023-11-04T01:45:35.705761+0000","last_became_peered":"2023-11-04T01:45:35.705761+0000","last_unstale":"2023-11-04T01:45:36.714163+0000","last_undegraded":"2023-11-04T01:45:36.714163+0000","last_fullsized":"2023-11-04T01:45:36.714163+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:03:36.101558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.721557+0000","last_change":"2023-11-04T01:45:35.714145+0000","last_active":"2023-11-04T01:45:35.721557+0000","last_peered":"2023-11-04T01:45:35.721557+0000","last_clean":"2023-11-04T01:45:35.721557+0000","last_became_active":"2023-11-04T01:45:35.713520+0000","last_became_peered":"2023-11-04T01:45:35.713520+0000","last_unstale":"2023-11-04T01:45:35.721557+0000","last_undegraded":"2023-11-04T01:45:35.721557+0000","last_fullsized":"2023-11-04T01:45:35.721557+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:42.028475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.726466+0000","last_change":"2023-11-04T01:45:35.724902+0000","last_active":"2023-11-04T01:45:35.726466+0000","last_peered":"2023-11-04T01:45:35.726466+0000","last_clean":"2023-11-04T01:45:35.726466+0000","last_became_active":"2023-11-04T01:45:35.724510+0000","last_became_peered":"2023-11-04T01:45:35.724510+0000","last_unstale":"2023-11-04T01:45:35.726466+0000","last_undegraded":"2023-11-04T01:45:35.726466+0000","last_fullsized":"2023-11-04T01:45:35.726466+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:41:28.258054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.734057+0000","last_change":"2023-11-04T01:45:35.732858+0000","last_active":"2023-11-04T01:45:35.734057+0000","last_peered":"2023-11-04T01:45:35.734057+0000","last_clean":"2023-11-04T01:45:35.734057+0000","last_became_active":"2023-11-04T01:45:35.732554+0000","last_became_peered":"2023-11-04T01:45:35.732554+0000","last_unstale":"2023-11-04T01:45:35.734057+0000","last_undegraded":"2023-11-04T01:45:35.734057+0000","last_fullsized":"2023-11-04T01:45:35.734057+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:09.131582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725335+0000","last_change":"2023-11-04T01:45:35.711179+0000","last_active":"2023-11-04T01:45:35.725335+0000","last_peered":"2023-11-04T01:45:35.725335+0000","last_clean":"2023-11-04T01:45:35.725335+0000","last_became_active":"2023-11-04T01:45:35.710908+0000","last_became_peered":"2023-11-04T01:45:35.710908+0000","last_unstale":"2023-11-04T01:45:35.725335+0000","last_undegraded":"2023-11-04T01:45:35.725335+0000","last_fullsized":"2023-11-04T01:45:35.725335+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:25:05.391511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730654+0000","last_change":"2023-11-04T01:45:35.727969+0000","last_active":"2023-11-04T01:45:35.730654+0000","last_peered":"2023-11-04T01:45:35.730654+0000","last_clean":"2023-11-04T01:45:35.730654+0000","last_became_active":"2023-11-04T01:45:35.727601+0000","last_became_peered":"2023-11-04T01:45:35.727601+0000","last_unstale":"2023-11-04T01:45:35.730654+0000","last_undegraded":"2023-11-04T01:45:35.730654+0000","last_fullsized":"2023-11-04T01:45:35.730654+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:50.075826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.713747+0000","last_change":"2023-11-04T01:45:35.709984+0000","last_active":"2023-11-04T01:45:36.713747+0000","last_peered":"2023-11-04T01:45:36.713747+0000","last_clean":"2023-11-04T01:45:36.713747+0000","last_became_active":"2023-11-04T01:45:35.709512+0000","last_became_peered":"2023-11-04T01:45:35.709512+0000","last_unstale":"2023-11-04T01:45:36.713747+0000","last_undegraded":"2023-11-04T01:45:36.713747+0000","last_fullsized":"2023-11-04T01:45:36.713747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:10.642497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732644+0000","last_change":"2023-11-04T01:45:35.728373+0000","last_active":"2023-11-04T01:45:35.732644+0000","last_peered":"2023-11-04T01:45:35.732644+0000","last_clean":"2023-11-04T01:45:35.732644+0000","last_became_active":"2023-11-04T01:45:35.728100+0000","last_became_peered":"2023-11-04T01:45:35.728100+0000","last_unstale":"2023-11-04T01:45:35.732644+0000","last_undegraded":"2023-11-04T01:45:35.732644+0000","last_fullsized":"2023-11-04T01:45:35.732644+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:52.558482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731248+0000","last_change":"2023-11-04T01:45:35.725297+0000","last_active":"2023-11-04T01:45:35.731248+0000","last_peered":"2023-11-04T01:45:35.731248+0000","last_clean":"2023-11-04T01:45:35.731248+0000","last_became_active":"2023-11-04T01:45:35.724477+0000","last_became_peered":"2023-11-04T01:45:35.724477+0000","last_unstale":"2023-11-04T01:45:35.731248+0000","last_undegraded":"2023-11-04T01:45:35.731248+0000","last_fullsized":"2023-11-04T01:45:35.731248+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:15.212996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714838+0000","last_change":"2023-11-04T01:45:35.707869+0000","last_active":"2023-11-04T01:45:36.714838+0000","last_peered":"2023-11-04T01:45:36.714838+0000","last_clean":"2023-11-04T01:45:36.714838+0000","last_became_active":"2023-11-04T01:45:35.705604+0000","last_became_peered":"2023-11-04T01:45:35.705604+0000","last_unstale":"2023-11-04T01:45:36.714838+0000","last_undegraded":"2023-11-04T01:45:36.714838+0000","last_fullsized":"2023-11-04T01:45:36.714838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:58:55.382394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732020+0000","last_change":"2023-11-04T01:45:35.721450+0000","last_active":"2023-11-04T01:45:35.732020+0000","last_peered":"2023-11-04T01:45:35.732020+0000","last_clean":"2023-11-04T01:45:35.732020+0000","last_became_active":"2023-11-04T01:45:35.719913+0000","last_became_peered":"2023-11-04T01:45:35.719913+0000","last_unstale":"2023-11-04T01:45:35.732020+0000","last_undegraded":"2023-11-04T01:45:35.732020+0000","last_fullsized":"2023-11-04T01:45:35.732020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:26:08.671745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732386+0000","last_change":"2023-11-04T01:45:35.720072+0000","last_active":"2023-11-04T01:45:35.732386+0000","last_peered":"2023-11-04T01:45:35.732386+0000","last_clean":"2023-11-04T01:45:35.732386+0000","last_became_active":"2023-11-04T01:45:35.719653+0000","last_became_peered":"2023-11-04T01:45:35.719653+0000","last_unstale":"2023-11-04T01:45:35.732386+0000","last_undegraded":"2023-11-04T01:45:35.732386+0000","last_fullsized":"2023-11-04T01:45:35.732386+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:18.449067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732752+0000","last_change":"2023-11-04T01:45:35.730014+0000","last_active":"2023-11-04T01:45:35.732752+0000","last_peered":"2023-11-04T01:45:35.732752+0000","last_clean":"2023-11-04T01:45:35.732752+0000","last_became_active":"2023-11-04T01:45:35.729677+0000","last_became_peered":"2023-11-04T01:45:35.729677+0000","last_unstale":"2023-11-04T01:45:35.732752+0000","last_undegraded":"2023-11-04T01:45:35.732752+0000","last_fullsized":"2023-11-04T01:45:35.732752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:39.584457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738288+0000","last_change":"2023-11-04T01:45:35.725543+0000","last_active":"2023-11-04T01:45:35.738288+0000","last_peered":"2023-11-04T01:45:35.738288+0000","last_clean":"2023-11-04T01:45:35.738288+0000","last_became_active":"2023-11-04T01:45:35.725047+0000","last_became_peered":"2023-11-04T01:45:35.725047+0000","last_unstale":"2023-11-04T01:45:35.738288+0000","last_undegraded":"2023-11-04T01:45:35.738288+0000","last_fullsized":"2023-11-04T01:45:35.738288+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:32:08.994535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725170+0000","last_change":"2023-11-04T01:45:35.710342+0000","last_active":"2023-11-04T01:45:35.725170+0000","last_peered":"2023-11-04T01:45:35.725170+0000","last_clean":"2023-11-04T01:45:35.725170+0000","last_became_active":"2023-11-04T01:45:35.710109+0000","last_became_peered":"2023-11-04T01:45:35.710109+0000","last_unstale":"2023-11-04T01:45:35.725170+0000","last_undegraded":"2023-11-04T01:45:35.725170+0000","last_fullsized":"2023-11-04T01:45:35.725170+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:01:07.950999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738368+0000","last_change":"2023-11-04T01:45:35.733421+0000","last_active":"2023-11-04T01:45:35.738368+0000","last_peered":"2023-11-04T01:45:35.738368+0000","last_clean":"2023-11-04T01:45:35.738368+0000","last_became_active":"2023-11-04T01:45:35.733080+0000","last_became_peered":"2023-11-04T01:45:35.733080+0000","last_unstale":"2023-11-04T01:45:35.738368+0000","last_undegraded":"2023-11-04T01:45:35.738368+0000","last_fullsized":"2023-11-04T01:45:35.738368+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:42.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.719626+0000","last_change":"2023-11-04T01:45:35.712898+0000","last_active":"2023-11-04T01:45:35.719626+0000","last_peered":"2023-11-04T01:45:35.719626+0000","last_clean":"2023-11-04T01:45:35.719626+0000","last_became_active":"2023-11-04T01:45:35.712510+0000","last_became_peered":"2023-11-04T01:45:35.712510+0000","last_unstale":"2023-11-04T01:45:35.719626+0000","last_undegraded":"2023-11-04T01:45:35.719626+0000","last_fullsized":"2023-11-04T01:45:35.719626+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:18.593633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.719592+0000","last_change":"2023-11-04T01:45:35.713287+0000","last_active":"2023-11-04T01:45:35.719592+0000","last_peered":"2023-11-04T01:45:35.719592+0000","last_clean":"2023-11-04T01:45:35.719592+0000","last_became_active":"2023-11-04T01:45:35.712638+0000","last_became_peered":"2023-11-04T01:45:35.712638+0000","last_unstale":"2023-11-04T01:45:35.719592+0000","last_undegraded":"2023-11-04T01:45:35.719592+0000","last_fullsized":"2023-11-04T01:45:35.719592+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:39.584457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730319+0000","last_change":"2023-11-04T01:45:35.719833+0000","last_active":"2023-11-04T01:45:35.730319+0000","last_peered":"2023-11-04T01:45:35.730319+0000","last_clean":"2023-11-04T01:45:35.730319+0000","last_became_active":"2023-11-04T01:45:35.719449+0000","last_became_peered":"2023-11-04T01:45:35.719449+0000","last_unstale":"2023-11-04T01:45:35.730319+0000","last_undegraded":"2023-11-04T01:45:35.730319+0000","last_fullsized":"2023-11-04T01:45:35.730319+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:53:42.581304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.720895+0000","last_change":"2023-11-04T01:45:35.717118+0000","last_active":"2023-11-04T01:45:35.720895+0000","last_peered":"2023-11-04T01:45:35.720895+0000","last_clean":"2023-11-04T01:45:35.720895+0000","last_became_active":"2023-11-04T01:45:35.716645+0000","last_became_peered":"2023-11-04T01:45:35.716645+0000","last_unstale":"2023-11-04T01:45:35.720895+0000","last_undegraded":"2023-11-04T01:45:35.720895+0000","last_fullsized":"2023-11-04T01:45:35.720895+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:13.310687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725703+0000","last_change":"2023-11-04T01:45:35.720704+0000","last_active":"2023-11-04T01:45:35.725703+0000","last_peered":"2023-11-04T01:45:35.725703+0000","last_clean":"2023-11-04T01:45:35.725703+0000","last_became_active":"2023-11-04T01:45:35.720357+0000","last_became_peered":"2023-11-04T01:45:35.720357+0000","last_unstale":"2023-11-04T01:45:35.725703+0000","last_undegraded":"2023-11-04T01:45:35.725703+0000","last_fullsized":"2023-11-04T01:45:35.725703+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:50.027695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711090+0000","last_change":"2023-11-04T01:45:35.707420+0000","last_active":"2023-11-04T01:45:35.711090+0000","last_peered":"2023-11-04T01:45:35.711090+0000","last_clean":"2023-11-04T01:45:35.711090+0000","last_became_active":"2023-11-04T01:45:35.706958+0000","last_became_peered":"2023-11-04T01:45:35.706958+0000","last_unstale":"2023-11-04T01:45:35.711090+0000","last_undegraded":"2023-11-04T01:45:35.711090+0000","last_fullsized":"2023-11-04T01:45:35.711090+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:59:00.941423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730677+0000","last_change":"2023-11-04T01:45:35.728524+0000","last_active":"2023-11-04T01:45:35.730677+0000","last_peered":"2023-11-04T01:45:35.730677+0000","last_clean":"2023-11-04T01:45:35.730677+0000","last_became_active":"2023-11-04T01:45:35.728241+0000","last_became_peered":"2023-11-04T01:45:35.728241+0000","last_unstale":"2023-11-04T01:45:35.730677+0000","last_undegraded":"2023-11-04T01:45:35.730677+0000","last_fullsized":"2023-11-04T01:45:35.730677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:52.558482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741400+0000","last_change":"2023-11-04T01:45:35.731694+0000","last_active":"2023-11-04T01:45:35.741400+0000","last_peered":"2023-11-04T01:45:35.741400+0000","last_clean":"2023-11-04T01:45:35.741400+0000","last_became_active":"2023-11-04T01:45:35.726303+0000","last_became_peered":"2023-11-04T01:45:35.726303+0000","last_unstale":"2023-11-04T01:45:35.741400+0000","last_undegraded":"2023-11-04T01:45:35.741400+0000","last_fullsized":"2023-11-04T01:45:35.741400+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:24:58.659351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.721377+0000","last_change":"2023-11-04T01:45:35.719844+0000","last_active":"2023-11-04T01:45:35.721377+0000","last_peered":"2023-11-04T01:45:35.721377+0000","last_clean":"2023-11-04T01:45:35.721377+0000","last_became_active":"2023-11-04T01:45:35.719340+0000","last_became_peered":"2023-11-04T01:45:35.719340+0000","last_unstale":"2023-11-04T01:45:35.721377+0000","last_undegraded":"2023-11-04T01:45:35.721377+0000","last_fullsized":"2023-11-04T01:45:35.721377+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:01.872461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738418+0000","last_change":"2023-11-04T01:45:34.690689+0000","last_active":"2023-11-04T01:45:35.738418+0000","last_peered":"2023-11-04T01:45:35.738418+0000","last_clean":"2023-11-04T01:45:35.738418+0000","last_became_active":"2023-11-04T01:45:34.690022+0000","last_became_peered":"2023-11-04T01:45:34.690022+0000","last_unstale":"2023-11-04T01:45:35.738418+0000","last_undegraded":"2023-11-04T01:45:35.738418+0000","last_fullsized":"2023-11-04T01:45:35.738418+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:36:53.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670461+0000","last_change":"2023-11-04T01:44:41.931890+0000","last_active":"2023-11-04T01:45:34.670461+0000","last_peered":"2023-11-04T01:45:34.670461+0000","last_clean":"2023-11-04T01:45:34.670461+0000","last_became_active":"2023-11-04T01:44:41.931428+0000","last_became_peered":"2023-11-04T01:44:41.931428+0000","last_unstale":"2023-11-04T01:45:34.670461+0000","last_undegraded":"2023-11-04T01:45:34.670461+0000","last_fullsized":"2023-11-04T01:45:34.670461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:06:35.749479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.666342+0000","last_change":"2023-11-04T01:44:43.171663+0000","last_active":"2023-11-04T01:45:34.666342+0000","last_peered":"2023-11-04T01:45:34.666342+0000","last_clean":"2023-11-04T01:45:34.666342+0000","last_became_active":"2023-11-04T01:44:40.925496+0000","last_became_peered":"2023-11-04T01:44:40.925496+0000","last_unstale":"2023-11-04T01:45:34.666342+0000","last_undegraded":"2023-11-04T01:45:34.666342+0000","last_fullsized":"2023-11-04T01:45:34.666342+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:43:59.630466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001987024,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.652537+0000","last_change":"2023-11-04T01:42:12.682442+0000","last_active":"2023-11-04T01:45:34.652537+0000","last_peered":"2023-11-04T01:45:34.652537+0000","last_clean":"2023-11-04T01:45:34.652537+0000","last_became_active":"2023-11-04T01:42:12.680067+0000","last_became_peered":"2023-11-04T01:42:12.680067+0000","last_unstale":"2023-11-04T01:45:34.652537+0000","last_undegraded":"2023-11-04T01:45:34.652537+0000","last_fullsized":"2023-11-04T01:45:34.652537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:42:11.573841+0000","last_clean_scrub_stamp":"2023-11-04T01:42:11.573841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:39:25.731619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671195+0000","last_change":"2023-11-04T01:43:40.806089+0000","last_active":"2023-11-04T01:45:34.671195+0000","last_peered":"2023-11-04T01:45:34.671195+0000","last_clean":"2023-11-04T01:45:34.671195+0000","last_became_active":"2023-11-04T01:43:38.848764+0000","last_became_peered":"2023-11-04T01:43:38.848764+0000","last_unstale":"2023-11-04T01:45:34.671195+0000","last_undegraded":"2023-11-04T01:45:34.671195+0000","last_fullsized":"2023-11-04T01:45:34.671195+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:38:37.326327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001003428,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738447+0000","last_change":"2023-11-04T01:45:35.731722+0000","last_active":"2023-11-04T01:45:35.738447+0000","last_peered":"2023-11-04T01:45:35.738447+0000","last_clean":"2023-11-04T01:45:35.738447+0000","last_became_active":"2023-11-04T01:45:35.728684+0000","last_became_peered":"2023-11-04T01:45:35.728684+0000","last_unstale":"2023-11-04T01:45:35.738447+0000","last_undegraded":"2023-11-04T01:45:35.738447+0000","last_fullsized":"2023-11-04T01:45:35.738447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:58:16.108301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.735239+0000","last_change":"2023-11-04T01:45:34.687817+0000","last_active":"2023-11-04T01:45:35.735239+0000","last_peered":"2023-11-04T01:45:35.735239+0000","last_clean":"2023-11-04T01:45:35.735239+0000","last_became_active":"2023-11-04T01:45:34.687083+0000","last_became_peered":"2023-11-04T01:45:34.687083+0000","last_unstale":"2023-11-04T01:45:35.735239+0000","last_undegraded":"2023-11-04T01:45:35.735239+0000","last_fullsized":"2023-11-04T01:45:35.735239+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:52.348282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657849+0000","last_change":"2023-11-04T01:44:41.934578+0000","last_active":"2023-11-04T01:45:34.657849+0000","last_peered":"2023-11-04T01:45:34.657849+0000","last_clean":"2023-11-04T01:45:34.657849+0000","last_became_active":"2023-11-04T01:44:41.932591+0000","last_became_peered":"2023-11-04T01:44:41.932591+0000","last_unstale":"2023-11-04T01:45:34.657849+0000","last_undegraded":"2023-11-04T01:45:34.657849+0000","last_fullsized":"2023-11-04T01:45:34.657849+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:39:29.789959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691478+0000","last_change":"2023-11-04T01:44:42.906847+0000","last_active":"2023-11-04T01:45:35.691478+0000","last_peered":"2023-11-04T01:45:35.691478+0000","last_clean":"2023-11-04T01:45:35.691478+0000","last_became_active":"2023-11-04T01:44:40.908611+0000","last_became_peered":"2023-11-04T01:44:40.908611+0000","last_unstale":"2023-11-04T01:45:35.691478+0000","last_undegraded":"2023-11-04T01:45:35.691478+0000","last_fullsized":"2023-11-04T01:45:35.691478+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:44.272984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044006599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.669791+0000","last_change":"2023-11-04T01:43:40.804315+0000","last_active":"2023-11-04T01:45:34.669791+0000","last_peered":"2023-11-04T01:45:34.669791+0000","last_clean":"2023-11-04T01:45:34.669791+0000","last_became_active":"2023-11-04T01:43:38.859292+0000","last_became_peered":"2023-11-04T01:43:38.859292+0000","last_unstale":"2023-11-04T01:45:34.669791+0000","last_undegraded":"2023-11-04T01:45:34.669791+0000","last_fullsized":"2023-11-04T01:45:34.669791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:43:58.056449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633350000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741538+0000","last_change":"2023-11-04T01:45:35.734069+0000","last_active":"2023-11-04T01:45:35.741538+0000","last_peered":"2023-11-04T01:45:35.741538+0000","last_clean":"2023-11-04T01:45:35.741538+0000","last_became_active":"2023-11-04T01:45:35.733472+0000","last_became_peered":"2023-11-04T01:45:35.733472+0000","last_unstale":"2023-11-04T01:45:35.741538+0000","last_undegraded":"2023-11-04T01:45:35.741538+0000","last_fullsized":"2023-11-04T01:45:35.741538+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:22:48.378587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711591+0000","last_change":"2023-11-04T01:45:34.687501+0000","last_active":"2023-11-04T01:45:35.711591+0000","last_peered":"2023-11-04T01:45:35.711591+0000","last_clean":"2023-11-04T01:45:35.711591+0000","last_became_active":"2023-11-04T01:45:34.686765+0000","last_became_peered":"2023-11-04T01:45:34.686765+0000","last_unstale":"2023-11-04T01:45:35.711591+0000","last_undegraded":"2023-11-04T01:45:35.711591+0000","last_fullsized":"2023-11-04T01:45:35.711591+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:00.861508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673717+0000","last_change":"2023-11-04T01:44:41.924659+0000","last_active":"2023-11-04T01:45:34.673717+0000","last_peered":"2023-11-04T01:45:34.673717+0000","last_clean":"2023-11-04T01:45:34.673717+0000","last_became_active":"2023-11-04T01:44:41.923887+0000","last_became_peered":"2023-11-04T01:44:41.923887+0000","last_unstale":"2023-11-04T01:45:34.673717+0000","last_undegraded":"2023-11-04T01:45:34.673717+0000","last_fullsized":"2023-11-04T01:45:34.673717+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:59.201022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.690750+0000","last_change":"2023-11-04T01:44:42.906331+0000","last_active":"2023-11-04T01:45:35.690750+0000","last_peered":"2023-11-04T01:45:35.690750+0000","last_clean":"2023-11-04T01:45:35.690750+0000","last_became_active":"2023-11-04T01:44:40.923564+0000","last_became_peered":"2023-11-04T01:44:40.923564+0000","last_unstale":"2023-11-04T01:45:35.690750+0000","last_undegraded":"2023-11-04T01:45:35.690750+0000","last_fullsized":"2023-11-04T01:45:35.690750+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:21:58.191219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038764860000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.689177+0000","last_change":"2023-11-04T01:43:39.860340+0000","last_active":"2023-11-04T01:45:35.689177+0000","last_peered":"2023-11-04T01:45:35.689177+0000","last_clean":"2023-11-04T01:45:35.689177+0000","last_became_active":"2023-11-04T01:43:38.849203+0000","last_became_peered":"2023-11-04T01:43:38.849203+0000","last_unstale":"2023-11-04T01:45:35.689177+0000","last_undegraded":"2023-11-04T01:45:35.689177+0000","last_fullsized":"2023-11-04T01:45:35.689177+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:28:10.395544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032289950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741385+0000","last_change":"2023-11-04T01:45:35.731324+0000","last_active":"2023-11-04T01:45:35.741385+0000","last_peered":"2023-11-04T01:45:35.741385+0000","last_clean":"2023-11-04T01:45:35.741385+0000","last_became_active":"2023-11-04T01:45:35.730885+0000","last_became_peered":"2023-11-04T01:45:35.730885+0000","last_unstale":"2023-11-04T01:45:35.741385+0000","last_undegraded":"2023-11-04T01:45:35.741385+0000","last_fullsized":"2023-11-04T01:45:35.741385+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:32:04.153702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.711760+0000","last_change":"2023-11-04T01:45:34.666859+0000","last_active":"2023-11-04T01:45:35.711760+0000","last_peered":"2023-11-04T01:45:35.711760+0000","last_clean":"2023-11-04T01:45:35.711760+0000","last_became_active":"2023-11-04T01:45:34.665568+0000","last_became_peered":"2023-11-04T01:45:34.665568+0000","last_unstale":"2023-11-04T01:45:35.711760+0000","last_undegraded":"2023-11-04T01:45:35.711760+0000","last_fullsized":"2023-11-04T01:45:35.711760+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:40:41.889295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656820+0000","last_change":"2023-11-04T01:44:41.933323+0000","last_active":"2023-11-04T01:45:34.656820+0000","last_peered":"2023-11-04T01:45:34.656820+0000","last_clean":"2023-11-04T01:45:34.656820+0000","last_became_active":"2023-11-04T01:44:41.932545+0000","last_became_peered":"2023-11-04T01:44:41.932545+0000","last_unstale":"2023-11-04T01:45:34.656820+0000","last_undegraded":"2023-11-04T01:45:34.656820+0000","last_fullsized":"2023-11-04T01:45:34.656820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:05:28.957334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658235+0000","last_change":"2023-11-04T01:44:43.112250+0000","last_active":"2023-11-04T01:45:34.658235+0000","last_peered":"2023-11-04T01:45:34.658235+0000","last_clean":"2023-11-04T01:45:34.658235+0000","last_became_active":"2023-11-04T01:44:40.940763+0000","last_became_peered":"2023-11-04T01:44:40.940763+0000","last_unstale":"2023-11-04T01:45:34.658235+0000","last_undegraded":"2023-11-04T01:45:34.658235+0000","last_fullsized":"2023-11-04T01:45:34.658235+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:13.065066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013223340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658043+0000","last_change":"2023-11-04T01:43:40.294257+0000","last_active":"2023-11-04T01:45:34.658043+0000","last_peered":"2023-11-04T01:45:34.658043+0000","last_clean":"2023-11-04T01:45:34.658043+0000","last_became_active":"2023-11-04T01:43:38.869275+0000","last_became_peered":"2023-11-04T01:43:38.869275+0000","last_unstale":"2023-11-04T01:45:34.658043+0000","last_undegraded":"2023-11-04T01:45:34.658043+0000","last_fullsized":"2023-11-04T01:45:34.658043+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:06:59.732126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074907399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.740201+0000","last_change":"2023-11-04T01:45:35.736894+0000","last_active":"2023-11-04T01:45:35.740201+0000","last_peered":"2023-11-04T01:45:35.740201+0000","last_clean":"2023-11-04T01:45:35.740201+0000","last_became_active":"2023-11-04T01:45:35.736598+0000","last_became_peered":"2023-11-04T01:45:35.736598+0000","last_unstale":"2023-11-04T01:45:35.740201+0000","last_undegraded":"2023-11-04T01:45:35.740201+0000","last_fullsized":"2023-11-04T01:45:35.740201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:46:02.875508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.696651+0000","last_change":"2023-11-04T01:45:34.681578+0000","last_active":"2023-11-04T01:45:35.696651+0000","last_peered":"2023-11-04T01:45:35.696651+0000","last_clean":"2023-11-04T01:45:35.696651+0000","last_became_active":"2023-11-04T01:45:34.680873+0000","last_became_peered":"2023-11-04T01:45:34.680873+0000","last_unstale":"2023-11-04T01:45:35.696651+0000","last_undegraded":"2023-11-04T01:45:35.696651+0000","last_fullsized":"2023-11-04T01:45:35.696651+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:13:47.087950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658603+0000","last_change":"2023-11-04T01:44:41.933572+0000","last_active":"2023-11-04T01:45:34.658603+0000","last_peered":"2023-11-04T01:45:34.658603+0000","last_clean":"2023-11-04T01:45:34.658603+0000","last_became_active":"2023-11-04T01:44:41.932825+0000","last_became_peered":"2023-11-04T01:44:41.932825+0000","last_unstale":"2023-11-04T01:45:34.658603+0000","last_undegraded":"2023-11-04T01:45:34.658603+0000","last_fullsized":"2023-11-04T01:45:34.658603+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:51:17.980311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657420+0000","last_change":"2023-11-04T01:44:43.112178+0000","last_active":"2023-11-04T01:45:34.657420+0000","last_peered":"2023-11-04T01:45:34.657420+0000","last_clean":"2023-11-04T01:45:34.657420+0000","last_became_active":"2023-11-04T01:44:40.940919+0000","last_became_peered":"2023-11-04T01:44:40.940919+0000","last_unstale":"2023-11-04T01:45:34.657420+0000","last_undegraded":"2023-11-04T01:45:34.657420+0000","last_fullsized":"2023-11-04T01:45:34.657420+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:16:26.706337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015529090000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.678616+0000","last_change":"2023-11-04T01:43:39.856451+0000","last_active":"2023-11-04T01:45:34.678616+0000","last_peered":"2023-11-04T01:45:34.678616+0000","last_clean":"2023-11-04T01:45:34.678616+0000","last_became_active":"2023-11-04T01:43:38.842152+0000","last_became_peered":"2023-11-04T01:43:38.842152+0000","last_unstale":"2023-11-04T01:45:34.678616+0000","last_undegraded":"2023-11-04T01:45:34.678616+0000","last_fullsized":"2023-11-04T01:45:34.678616+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:57:05.132491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001671297,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.721790+0000","last_change":"2023-11-04T01:45:35.709706+0000","last_active":"2023-11-04T01:45:35.721790+0000","last_peered":"2023-11-04T01:45:35.721790+0000","last_clean":"2023-11-04T01:45:35.721790+0000","last_became_active":"2023-11-04T01:45:35.709338+0000","last_became_peered":"2023-11-04T01:45:35.709338+0000","last_unstale":"2023-11-04T01:45:35.721790+0000","last_undegraded":"2023-11-04T01:45:35.721790+0000","last_fullsized":"2023-11-04T01:45:35.721790+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:47:34.579953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733278+0000","last_change":"2023-11-04T01:45:34.657827+0000","last_active":"2023-11-04T01:45:35.733278+0000","last_peered":"2023-11-04T01:45:35.733278+0000","last_clean":"2023-11-04T01:45:35.733278+0000","last_became_active":"2023-11-04T01:45:34.657237+0000","last_became_peered":"2023-11-04T01:45:34.657237+0000","last_unstale":"2023-11-04T01:45:35.733278+0000","last_undegraded":"2023-11-04T01:45:35.733278+0000","last_fullsized":"2023-11-04T01:45:35.733278+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:39.504787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657637+0000","last_change":"2023-11-04T01:44:41.944543+0000","last_active":"2023-11-04T01:45:34.657637+0000","last_peered":"2023-11-04T01:45:34.657637+0000","last_clean":"2023-11-04T01:45:34.657637+0000","last_became_active":"2023-11-04T01:44:41.943902+0000","last_became_peered":"2023-11-04T01:44:41.943902+0000","last_unstale":"2023-11-04T01:45:34.657637+0000","last_undegraded":"2023-11-04T01:45:34.657637+0000","last_fullsized":"2023-11-04T01:45:34.657637+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:57.847851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673571+0000","last_change":"2023-11-04T01:44:43.177318+0000","last_active":"2023-11-04T01:45:34.673571+0000","last_peered":"2023-11-04T01:45:34.673571+0000","last_clean":"2023-11-04T01:45:34.673571+0000","last_became_active":"2023-11-04T01:44:40.940689+0000","last_became_peered":"2023-11-04T01:44:40.940689+0000","last_unstale":"2023-11-04T01:45:34.673571+0000","last_undegraded":"2023-11-04T01:45:34.673571+0000","last_fullsized":"2023-11-04T01:45:34.673571+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:48:28.637882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033848720000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.667191+0000","last_change":"2023-11-04T01:43:39.947518+0000","last_active":"2023-11-04T01:45:34.667191+0000","last_peered":"2023-11-04T01:45:34.667191+0000","last_clean":"2023-11-04T01:45:34.667191+0000","last_became_active":"2023-11-04T01:43:38.847169+0000","last_became_peered":"2023-11-04T01:43:38.847169+0000","last_unstale":"2023-11-04T01:45:34.667191+0000","last_undegraded":"2023-11-04T01:45:34.667191+0000","last_fullsized":"2023-11-04T01:45:34.667191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:44:49.620684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117074,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729420+0000","last_change":"2023-11-04T01:45:35.719072+0000","last_active":"2023-11-04T01:45:35.729420+0000","last_peered":"2023-11-04T01:45:35.729420+0000","last_clean":"2023-11-04T01:45:35.729420+0000","last_became_active":"2023-11-04T01:45:35.718691+0000","last_became_peered":"2023-11-04T01:45:35.718691+0000","last_unstale":"2023-11-04T01:45:35.729420+0000","last_undegraded":"2023-11-04T01:45:35.729420+0000","last_fullsized":"2023-11-04T01:45:35.729420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:53.359235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732471+0000","last_change":"2023-11-04T01:45:34.669651+0000","last_active":"2023-11-04T01:45:35.732471+0000","last_peered":"2023-11-04T01:45:35.732471+0000","last_clean":"2023-11-04T01:45:35.732471+0000","last_became_active":"2023-11-04T01:45:34.669359+0000","last_became_peered":"2023-11-04T01:45:34.669359+0000","last_unstale":"2023-11-04T01:45:35.732471+0000","last_undegraded":"2023-11-04T01:45:35.732471+0000","last_fullsized":"2023-11-04T01:45:35.732471+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:01:31.119732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.661095+0000","last_change":"2023-11-04T01:44:41.934066+0000","last_active":"2023-11-04T01:45:34.661095+0000","last_peered":"2023-11-04T01:45:34.661095+0000","last_clean":"2023-11-04T01:45:34.661095+0000","last_became_active":"2023-11-04T01:44:41.933308+0000","last_became_peered":"2023-11-04T01:44:41.933308+0000","last_unstale":"2023-11-04T01:45:34.661095+0000","last_undegraded":"2023-11-04T01:45:34.661095+0000","last_fullsized":"2023-11-04T01:45:34.661095+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:42:36.172813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657281+0000","last_change":"2023-11-04T01:44:42.903075+0000","last_active":"2023-11-04T01:45:34.657281+0000","last_peered":"2023-11-04T01:45:34.657281+0000","last_clean":"2023-11-04T01:45:34.657281+0000","last_became_active":"2023-11-04T01:44:40.942840+0000","last_became_peered":"2023-11-04T01:44:40.942840+0000","last_unstale":"2023-11-04T01:45:34.657281+0000","last_undegraded":"2023-11-04T01:45:34.657281+0000","last_fullsized":"2023-11-04T01:45:34.657281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:49:04.138100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015750029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657848+0000","last_change":"2023-11-04T01:43:40.294836+0000","last_active":"2023-11-04T01:45:34.657848+0000","last_peered":"2023-11-04T01:45:34.657848+0000","last_clean":"2023-11-04T01:45:34.657848+0000","last_became_active":"2023-11-04T01:43:38.864464+0000","last_became_peered":"2023-11-04T01:43:38.864464+0000","last_unstale":"2023-11-04T01:45:34.657848+0000","last_undegraded":"2023-11-04T01:45:34.657848+0000","last_fullsized":"2023-11-04T01:45:34.657848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:07:46.593124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091462100000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738321+0000","last_change":"2023-11-04T01:45:35.726149+0000","last_active":"2023-11-04T01:45:35.738321+0000","last_peered":"2023-11-04T01:45:35.738321+0000","last_clean":"2023-11-04T01:45:35.738321+0000","last_became_active":"2023-11-04T01:45:35.724833+0000","last_became_peered":"2023-11-04T01:45:35.724833+0000","last_unstale":"2023-11-04T01:45:35.738321+0000","last_undegraded":"2023-11-04T01:45:35.738321+0000","last_fullsized":"2023-11-04T01:45:35.738321+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:22.924165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.708020+0000","last_change":"2023-11-04T01:45:34.664288+0000","last_active":"2023-11-04T01:45:35.708020+0000","last_peered":"2023-11-04T01:45:35.708020+0000","last_clean":"2023-11-04T01:45:35.708020+0000","last_became_active":"2023-11-04T01:45:34.663709+0000","last_became_peered":"2023-11-04T01:45:34.663709+0000","last_unstale":"2023-11-04T01:45:35.708020+0000","last_undegraded":"2023-11-04T01:45:35.708020+0000","last_fullsized":"2023-11-04T01:45:35.708020+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:02:35.966499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671110+0000","last_change":"2023-11-04T01:44:41.918892+0000","last_active":"2023-11-04T01:45:34.671110+0000","last_peered":"2023-11-04T01:45:34.671110+0000","last_clean":"2023-11-04T01:45:34.671110+0000","last_became_active":"2023-11-04T01:44:41.917911+0000","last_became_peered":"2023-11-04T01:44:41.917911+0000","last_unstale":"2023-11-04T01:45:34.671110+0000","last_undegraded":"2023-11-04T01:45:34.671110+0000","last_fullsized":"2023-11-04T01:45:34.671110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:30:53.093358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.672595+0000","last_change":"2023-11-04T01:44:43.177231+0000","last_active":"2023-11-04T01:45:34.672595+0000","last_peered":"2023-11-04T01:45:34.672595+0000","last_clean":"2023-11-04T01:45:34.672595+0000","last_became_active":"2023-11-04T01:44:40.929373+0000","last_became_peered":"2023-11-04T01:44:40.929373+0000","last_unstale":"2023-11-04T01:45:34.672595+0000","last_undegraded":"2023-11-04T01:45:34.672595+0000","last_fullsized":"2023-11-04T01:45:34.672595+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:07:03.457810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005564182,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.692214+0000","last_change":"2023-11-04T01:43:39.860832+0000","last_active":"2023-11-04T01:45:35.692214+0000","last_peered":"2023-11-04T01:45:35.692214+0000","last_clean":"2023-11-04T01:45:35.692214+0000","last_became_active":"2023-11-04T01:43:38.862039+0000","last_became_peered":"2023-11-04T01:43:38.862039+0000","last_unstale":"2023-11-04T01:45:35.692214+0000","last_undegraded":"2023-11-04T01:45:35.692214+0000","last_fullsized":"2023-11-04T01:45:35.692214+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:03:11.972790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025449859999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.734948+0000","last_change":"2023-11-04T01:45:35.727896+0000","last_active":"2023-11-04T01:45:35.734948+0000","last_peered":"2023-11-04T01:45:35.734948+0000","last_clean":"2023-11-04T01:45:35.734948+0000","last_became_active":"2023-11-04T01:45:35.727425+0000","last_became_peered":"2023-11-04T01:45:35.727425+0000","last_unstale":"2023-11-04T01:45:35.734948+0000","last_undegraded":"2023-11-04T01:45:35.734948+0000","last_fullsized":"2023-11-04T01:45:35.734948+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:27:11.311302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.684497+0000","last_change":"2023-11-04T01:45:34.674622+0000","last_active":"2023-11-04T01:45:35.684497+0000","last_peered":"2023-11-04T01:45:35.684497+0000","last_clean":"2023-11-04T01:45:35.684497+0000","last_became_active":"2023-11-04T01:45:34.674337+0000","last_became_peered":"2023-11-04T01:45:34.674337+0000","last_unstale":"2023-11-04T01:45:35.684497+0000","last_undegraded":"2023-11-04T01:45:35.684497+0000","last_fullsized":"2023-11-04T01:45:35.684497+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:40.603543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.685940+0000","last_change":"2023-11-04T01:44:41.918887+0000","last_active":"2023-11-04T01:45:35.685940+0000","last_peered":"2023-11-04T01:45:35.685940+0000","last_clean":"2023-11-04T01:45:35.685940+0000","last_became_active":"2023-11-04T01:44:41.918464+0000","last_became_peered":"2023-11-04T01:44:41.918464+0000","last_unstale":"2023-11-04T01:45:35.685940+0000","last_undegraded":"2023-11-04T01:45:35.685940+0000","last_fullsized":"2023-11-04T01:45:35.685940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:03:59.577071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.655797+0000","last_change":"2023-11-04T01:44:43.174324+0000","last_active":"2023-11-04T01:45:34.655797+0000","last_peered":"2023-11-04T01:45:34.655797+0000","last_clean":"2023-11-04T01:45:34.655797+0000","last_became_active":"2023-11-04T01:44:40.924963+0000","last_became_peered":"2023-11-04T01:44:40.924963+0000","last_unstale":"2023-11-04T01:45:34.655797+0000","last_undegraded":"2023-11-04T01:45:34.655797+0000","last_fullsized":"2023-11-04T01:45:34.655797+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:49:16.508948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016466950000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.687498+0000","last_change":"2023-11-04T01:43:39.859370+0000","last_active":"2023-11-04T01:45:35.687498+0000","last_peered":"2023-11-04T01:45:35.687498+0000","last_clean":"2023-11-04T01:45:35.687498+0000","last_became_active":"2023-11-04T01:43:38.860968+0000","last_became_peered":"2023-11-04T01:43:38.860968+0000","last_unstale":"2023-11-04T01:45:35.687498+0000","last_undegraded":"2023-11-04T01:45:35.687498+0000","last_fullsized":"2023-11-04T01:45:35.687498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:53:02.288318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014772520000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738433+0000","last_change":"2023-11-04T01:45:35.732709+0000","last_active":"2023-11-04T01:45:35.738433+0000","last_peered":"2023-11-04T01:45:35.738433+0000","last_clean":"2023-11-04T01:45:35.738433+0000","last_became_active":"2023-11-04T01:45:35.732315+0000","last_became_peered":"2023-11-04T01:45:35.732315+0000","last_unstale":"2023-11-04T01:45:35.738433+0000","last_undegraded":"2023-11-04T01:45:35.738433+0000","last_fullsized":"2023-11-04T01:45:35.738433+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:29.643798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712310+0000","last_change":"2023-11-04T01:45:34.685857+0000","last_active":"2023-11-04T01:45:35.712310+0000","last_peered":"2023-11-04T01:45:35.712310+0000","last_clean":"2023-11-04T01:45:35.712310+0000","last_became_active":"2023-11-04T01:45:34.685009+0000","last_became_peered":"2023-11-04T01:45:34.685009+0000","last_unstale":"2023-11-04T01:45:35.712310+0000","last_undegraded":"2023-11-04T01:45:35.712310+0000","last_fullsized":"2023-11-04T01:45:35.712310+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:42:08.120629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.652514+0000","last_change":"2023-11-04T01:44:41.929589+0000","last_active":"2023-11-04T01:45:34.652514+0000","last_peered":"2023-11-04T01:45:34.652514+0000","last_clean":"2023-11-04T01:45:34.652514+0000","last_became_active":"2023-11-04T01:44:41.929209+0000","last_became_peered":"2023-11-04T01:44:41.929209+0000","last_unstale":"2023-11-04T01:45:34.652514+0000","last_undegraded":"2023-11-04T01:45:34.652514+0000","last_fullsized":"2023-11-04T01:45:34.652514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:56.528258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.666987+0000","last_change":"2023-11-04T01:44:43.175322+0000","last_active":"2023-11-04T01:45:34.666987+0000","last_peered":"2023-11-04T01:45:34.666987+0000","last_clean":"2023-11-04T01:45:34.666987+0000","last_became_active":"2023-11-04T01:44:40.931389+0000","last_became_peered":"2023-11-04T01:44:40.931389+0000","last_unstale":"2023-11-04T01:45:34.666987+0000","last_undegraded":"2023-11-04T01:45:34.666987+0000","last_fullsized":"2023-11-04T01:45:34.666987+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022947649999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657643+0000","last_change":"2023-11-04T01:43:40.066230+0000","last_active":"2023-11-04T01:45:34.657643+0000","last_peered":"2023-11-04T01:45:34.657643+0000","last_clean":"2023-11-04T01:45:34.657643+0000","last_became_active":"2023-11-04T01:43:38.865921+0000","last_became_peered":"2023-11-04T01:43:38.865921+0000","last_unstale":"2023-11-04T01:45:34.657643+0000","last_undegraded":"2023-11-04T01:45:34.657643+0000","last_fullsized":"2023-11-04T01:45:34.657643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:29:49.559076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725639+0000","last_change":"2023-11-04T01:45:35.722363+0000","last_active":"2023-11-04T01:45:35.725639+0000","last_peered":"2023-11-04T01:45:35.725639+0000","last_clean":"2023-11-04T01:45:35.725639+0000","last_became_active":"2023-11-04T01:45:35.717584+0000","last_became_peered":"2023-11-04T01:45:35.717584+0000","last_unstale":"2023-11-04T01:45:35.725639+0000","last_undegraded":"2023-11-04T01:45:35.725639+0000","last_fullsized":"2023-11-04T01:45:35.725639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:21.687007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.700958+0000","last_change":"2023-11-04T01:45:34.689599+0000","last_active":"2023-11-04T01:45:35.700958+0000","last_peered":"2023-11-04T01:45:35.700958+0000","last_clean":"2023-11-04T01:45:35.700958+0000","last_became_active":"2023-11-04T01:45:34.689207+0000","last_became_peered":"2023-11-04T01:45:34.689207+0000","last_unstale":"2023-11-04T01:45:35.700958+0000","last_undegraded":"2023-11-04T01:45:35.700958+0000","last_fullsized":"2023-11-04T01:45:35.700958+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:14.202043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640453+0000","last_change":"2023-11-04T01:44:41.935051+0000","last_active":"2023-11-04T01:45:34.640453+0000","last_peered":"2023-11-04T01:45:34.640453+0000","last_clean":"2023-11-04T01:45:34.640453+0000","last_became_active":"2023-11-04T01:44:41.934245+0000","last_became_peered":"2023-11-04T01:44:41.934245+0000","last_unstale":"2023-11-04T01:45:34.640453+0000","last_undegraded":"2023-11-04T01:45:34.640453+0000","last_fullsized":"2023-11-04T01:45:34.640453+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:00:58.744375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654210+0000","last_change":"2023-11-04T01:44:43.174084+0000","last_active":"2023-11-04T01:45:34.654210+0000","last_peered":"2023-11-04T01:45:34.654210+0000","last_clean":"2023-11-04T01:45:34.654210+0000","last_became_active":"2023-11-04T01:44:40.923078+0000","last_became_peered":"2023-11-04T01:44:40.923078+0000","last_unstale":"2023-11-04T01:45:34.654210+0000","last_undegraded":"2023-11-04T01:45:34.654210+0000","last_fullsized":"2023-11-04T01:45:34.654210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:47:30.967677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015459650000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.667830+0000","last_change":"2023-11-04T01:43:40.803884+0000","last_active":"2023-11-04T01:45:34.667830+0000","last_peered":"2023-11-04T01:45:34.667830+0000","last_clean":"2023-11-04T01:45:34.667830+0000","last_became_active":"2023-11-04T01:43:38.839292+0000","last_became_peered":"2023-11-04T01:43:38.839292+0000","last_unstale":"2023-11-04T01:45:34.667830+0000","last_undegraded":"2023-11-04T01:45:34.667830+0000","last_fullsized":"2023-11-04T01:45:34.667830+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:23:17.920866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010215560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714552+0000","last_change":"2023-11-04T01:45:35.722942+0000","last_active":"2023-11-04T01:45:36.714552+0000","last_peered":"2023-11-04T01:45:36.714552+0000","last_clean":"2023-11-04T01:45:36.714552+0000","last_became_active":"2023-11-04T01:45:35.721796+0000","last_became_peered":"2023-11-04T01:45:35.721796+0000","last_unstale":"2023-11-04T01:45:36.714552+0000","last_undegraded":"2023-11-04T01:45:36.714552+0000","last_fullsized":"2023-11-04T01:45:36.714552+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:53:11.975655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712275+0000","last_change":"2023-11-04T01:45:34.682808+0000","last_active":"2023-11-04T01:45:35.712275+0000","last_peered":"2023-11-04T01:45:35.712275+0000","last_clean":"2023-11-04T01:45:35.712275+0000","last_became_active":"2023-11-04T01:45:34.682107+0000","last_became_peered":"2023-11-04T01:45:34.682107+0000","last_unstale":"2023-11-04T01:45:35.712275+0000","last_undegraded":"2023-11-04T01:45:35.712275+0000","last_fullsized":"2023-11-04T01:45:35.712275+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:10:49.064872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657193+0000","last_change":"2023-11-04T01:44:41.916693+0000","last_active":"2023-11-04T01:45:34.657193+0000","last_peered":"2023-11-04T01:45:34.657193+0000","last_clean":"2023-11-04T01:45:34.657193+0000","last_became_active":"2023-11-04T01:44:41.914418+0000","last_became_peered":"2023-11-04T01:44:41.914418+0000","last_unstale":"2023-11-04T01:45:34.657193+0000","last_undegraded":"2023-11-04T01:45:34.657193+0000","last_fullsized":"2023-11-04T01:45:34.657193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:27:02.978838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691008+0000","last_change":"2023-11-04T01:44:42.903798+0000","last_active":"2023-11-04T01:45:35.691008+0000","last_peered":"2023-11-04T01:45:35.691008+0000","last_clean":"2023-11-04T01:45:35.691008+0000","last_became_active":"2023-11-04T01:44:40.921927+0000","last_became_peered":"2023-11-04T01:44:40.921927+0000","last_unstale":"2023-11-04T01:45:35.691008+0000","last_undegraded":"2023-11-04T01:45:35.691008+0000","last_fullsized":"2023-11-04T01:45:35.691008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:54:41.296405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018315269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657415+0000","last_change":"2023-11-04T01:43:40.065329+0000","last_active":"2023-11-04T01:45:34.657415+0000","last_peered":"2023-11-04T01:45:34.657415+0000","last_clean":"2023-11-04T01:45:34.657415+0000","last_became_active":"2023-11-04T01:43:38.864132+0000","last_became_peered":"2023-11-04T01:43:38.864132+0000","last_unstale":"2023-11-04T01:45:34.657415+0000","last_undegraded":"2023-11-04T01:45:34.657415+0000","last_fullsized":"2023-11-04T01:45:34.657415+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:17.144707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011009920000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741417+0000","last_change":"2023-11-04T01:45:35.731969+0000","last_active":"2023-11-04T01:45:35.741417+0000","last_peered":"2023-11-04T01:45:35.741417+0000","last_clean":"2023-11-04T01:45:35.741417+0000","last_became_active":"2023-11-04T01:45:35.727897+0000","last_became_peered":"2023-11-04T01:45:35.727897+0000","last_unstale":"2023-11-04T01:45:35.741417+0000","last_undegraded":"2023-11-04T01:45:35.741417+0000","last_fullsized":"2023-11-04T01:45:35.741417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:52:47.728509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.723337+0000","last_change":"2023-11-04T01:45:34.693361+0000","last_active":"2023-11-04T01:45:35.723337+0000","last_peered":"2023-11-04T01:45:35.723337+0000","last_clean":"2023-11-04T01:45:35.723337+0000","last_became_active":"2023-11-04T01:45:34.692714+0000","last_became_peered":"2023-11-04T01:45:34.692714+0000","last_unstale":"2023-11-04T01:45:35.723337+0000","last_undegraded":"2023-11-04T01:45:35.723337+0000","last_fullsized":"2023-11-04T01:45:35.723337+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:32:51.547529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641051+0000","last_change":"2023-11-04T01:44:41.944011+0000","last_active":"2023-11-04T01:45:34.641051+0000","last_peered":"2023-11-04T01:45:34.641051+0000","last_clean":"2023-11-04T01:45:34.641051+0000","last_became_active":"2023-11-04T01:44:41.943702+0000","last_became_peered":"2023-11-04T01:44:41.943702+0000","last_unstale":"2023-11-04T01:45:34.641051+0000","last_undegraded":"2023-11-04T01:45:34.641051+0000","last_fullsized":"2023-11-04T01:45:34.641051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:57.519730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671608+0000","last_change":"2023-11-04T01:44:42.902919+0000","last_active":"2023-11-04T01:45:34.671608+0000","last_peered":"2023-11-04T01:45:34.671608+0000","last_clean":"2023-11-04T01:45:34.671608+0000","last_became_active":"2023-11-04T01:44:40.918933+0000","last_became_peered":"2023-11-04T01:44:40.918933+0000","last_unstale":"2023-11-04T01:45:34.671608+0000","last_undegraded":"2023-11-04T01:45:34.671608+0000","last_fullsized":"2023-11-04T01:45:34.671608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:36:47.321809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002224087,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.655338+0000","last_change":"2023-11-04T01:43:40.172002+0000","last_active":"2023-11-04T01:45:34.655338+0000","last_peered":"2023-11-04T01:45:34.655338+0000","last_clean":"2023-11-04T01:45:34.655338+0000","last_became_active":"2023-11-04T01:43:38.864095+0000","last_became_peered":"2023-11-04T01:43:38.864095+0000","last_unstale":"2023-11-04T01:45:34.655338+0000","last_undegraded":"2023-11-04T01:45:34.655338+0000","last_fullsized":"2023-11-04T01:45:34.655338+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:00:57.332868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014928109999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730247+0000","last_change":"2023-11-04T01:45:35.726184+0000","last_active":"2023-11-04T01:45:35.730247+0000","last_peered":"2023-11-04T01:45:35.730247+0000","last_clean":"2023-11-04T01:45:35.730247+0000","last_became_active":"2023-11-04T01:45:35.725879+0000","last_became_peered":"2023-11-04T01:45:35.725879+0000","last_unstale":"2023-11-04T01:45:35.730247+0000","last_undegraded":"2023-11-04T01:45:35.730247+0000","last_fullsized":"2023-11-04T01:45:35.730247+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:30:47.472709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712159+0000","last_change":"2023-11-04T01:45:34.684259+0000","last_active":"2023-11-04T01:45:35.712159+0000","last_peered":"2023-11-04T01:45:35.712159+0000","last_clean":"2023-11-04T01:45:35.712159+0000","last_became_active":"2023-11-04T01:45:34.676197+0000","last_became_peered":"2023-11-04T01:45:34.676197+0000","last_unstale":"2023-11-04T01:45:35.712159+0000","last_undegraded":"2023-11-04T01:45:35.712159+0000","last_fullsized":"2023-11-04T01:45:35.712159+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:12.299734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691824+0000","last_change":"2023-11-04T01:44:41.926845+0000","last_active":"2023-11-04T01:45:35.691824+0000","last_peered":"2023-11-04T01:45:35.691824+0000","last_clean":"2023-11-04T01:45:35.691824+0000","last_became_active":"2023-11-04T01:44:41.926160+0000","last_became_peered":"2023-11-04T01:44:41.926160+0000","last_unstale":"2023-11-04T01:45:35.691824+0000","last_undegraded":"2023-11-04T01:45:35.691824+0000","last_fullsized":"2023-11-04T01:45:35.691824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:09.219007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.666694+0000","last_change":"2023-11-04T01:44:43.172635+0000","last_active":"2023-11-04T01:45:34.666694+0000","last_peered":"2023-11-04T01:45:34.666694+0000","last_clean":"2023-11-04T01:45:34.666694+0000","last_became_active":"2023-11-04T01:44:40.944235+0000","last_became_peered":"2023-11-04T01:44:40.944235+0000","last_unstale":"2023-11-04T01:45:34.666694+0000","last_undegraded":"2023-11-04T01:45:34.666694+0000","last_fullsized":"2023-11-04T01:45:34.666694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:23.280045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025398959999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.675404+0000","last_change":"2023-11-04T01:43:39.947753+0000","last_active":"2023-11-04T01:45:34.675404+0000","last_peered":"2023-11-04T01:45:34.675404+0000","last_clean":"2023-11-04T01:45:34.675404+0000","last_became_active":"2023-11-04T01:43:38.866656+0000","last_became_peered":"2023-11-04T01:43:38.866656+0000","last_unstale":"2023-11-04T01:45:34.675404+0000","last_undegraded":"2023-11-04T01:45:34.675404+0000","last_fullsized":"2023-11-04T01:45:34.675404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:35:05.408258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011705789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729450+0000","last_change":"2023-11-04T01:45:35.724990+0000","last_active":"2023-11-04T01:45:35.729450+0000","last_peered":"2023-11-04T01:45:35.729450+0000","last_clean":"2023-11-04T01:45:35.729450+0000","last_became_active":"2023-11-04T01:45:35.722534+0000","last_became_peered":"2023-11-04T01:45:35.722534+0000","last_unstale":"2023-11-04T01:45:35.729450+0000","last_undegraded":"2023-11-04T01:45:35.729450+0000","last_fullsized":"2023-11-04T01:45:35.729450+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:30.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.695378+0000","last_change":"2023-11-04T01:45:34.667037+0000","last_active":"2023-11-04T01:45:35.695378+0000","last_peered":"2023-11-04T01:45:35.695378+0000","last_clean":"2023-11-04T01:45:35.695378+0000","last_became_active":"2023-11-04T01:45:34.666750+0000","last_became_peered":"2023-11-04T01:45:34.666750+0000","last_unstale":"2023-11-04T01:45:35.695378+0000","last_undegraded":"2023-11-04T01:45:35.695378+0000","last_fullsized":"2023-11-04T01:45:35.695378+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:47:48.554659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.678748+0000","last_change":"2023-11-04T01:44:41.927015+0000","last_active":"2023-11-04T01:45:34.678748+0000","last_peered":"2023-11-04T01:45:34.678748+0000","last_clean":"2023-11-04T01:45:34.678748+0000","last_became_active":"2023-11-04T01:44:41.926208+0000","last_became_peered":"2023-11-04T01:44:41.926208+0000","last_unstale":"2023-11-04T01:45:34.678748+0000","last_undegraded":"2023-11-04T01:45:34.678748+0000","last_fullsized":"2023-11-04T01:45:34.678748+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:53:33.265407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.685527+0000","last_change":"2023-11-04T01:44:42.903587+0000","last_active":"2023-11-04T01:45:35.685527+0000","last_peered":"2023-11-04T01:45:35.685527+0000","last_clean":"2023-11-04T01:45:35.685527+0000","last_became_active":"2023-11-04T01:44:40.914477+0000","last_became_peered":"2023-11-04T01:44:40.914477+0000","last_unstale":"2023-11-04T01:45:35.685527+0000","last_undegraded":"2023-11-04T01:45:35.685527+0000","last_fullsized":"2023-11-04T01:45:35.685527+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:26:06.324851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021038049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673789+0000","last_change":"2023-11-04T01:43:39.857368+0000","last_active":"2023-11-04T01:45:34.673789+0000","last_peered":"2023-11-04T01:45:34.673789+0000","last_clean":"2023-11-04T01:45:34.673789+0000","last_became_active":"2023-11-04T01:43:38.861826+0000","last_became_peered":"2023-11-04T01:43:38.861826+0000","last_unstale":"2023-11-04T01:45:34.673789+0000","last_undegraded":"2023-11-04T01:45:34.673789+0000","last_fullsized":"2023-11-04T01:45:34.673789+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:41:00.692260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001846667,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.726724+0000","last_change":"2023-11-04T01:45:35.718612+0000","last_active":"2023-11-04T01:45:35.726724+0000","last_peered":"2023-11-04T01:45:35.726724+0000","last_clean":"2023-11-04T01:45:35.726724+0000","last_became_active":"2023-11-04T01:45:35.714080+0000","last_became_peered":"2023-11-04T01:45:35.714080+0000","last_unstale":"2023-11-04T01:45:35.726724+0000","last_undegraded":"2023-11-04T01:45:35.726724+0000","last_fullsized":"2023-11-04T01:45:35.726724+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:10:01.872461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691493+0000","last_change":"2023-11-04T01:45:34.669503+0000","last_active":"2023-11-04T01:45:35.691493+0000","last_peered":"2023-11-04T01:45:35.691493+0000","last_clean":"2023-11-04T01:45:35.691493+0000","last_became_active":"2023-11-04T01:45:34.668742+0000","last_became_peered":"2023-11-04T01:45:34.668742+0000","last_unstale":"2023-11-04T01:45:35.691493+0000","last_undegraded":"2023-11-04T01:45:35.691493+0000","last_fullsized":"2023-11-04T01:45:35.691493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:11:05.727712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.660461+0000","last_change":"2023-11-04T01:44:41.932084+0000","last_active":"2023-11-04T01:45:34.660461+0000","last_peered":"2023-11-04T01:45:34.660461+0000","last_clean":"2023-11-04T01:45:34.660461+0000","last_became_active":"2023-11-04T01:44:41.931308+0000","last_became_peered":"2023-11-04T01:44:41.931308+0000","last_unstale":"2023-11-04T01:45:34.660461+0000","last_undegraded":"2023-11-04T01:45:34.660461+0000","last_fullsized":"2023-11-04T01:45:34.660461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:01:02.241295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.672380+0000","last_change":"2023-11-04T01:44:43.175475+0000","last_active":"2023-11-04T01:45:34.672380+0000","last_peered":"2023-11-04T01:45:34.672380+0000","last_clean":"2023-11-04T01:45:34.672380+0000","last_became_active":"2023-11-04T01:44:40.930314+0000","last_became_peered":"2023-11-04T01:44:40.930314+0000","last_unstale":"2023-11-04T01:45:34.672380+0000","last_undegraded":"2023-11-04T01:45:34.672380+0000","last_fullsized":"2023-11-04T01:45:34.672380+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:49:59.746779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042346939999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654228+0000","last_change":"2023-11-04T01:43:40.172011+0000","last_active":"2023-11-04T01:45:34.654228+0000","last_peered":"2023-11-04T01:45:34.654228+0000","last_clean":"2023-11-04T01:45:34.654228+0000","last_became_active":"2023-11-04T01:43:38.869094+0000","last_became_peered":"2023-11-04T01:43:38.869094+0000","last_unstale":"2023-11-04T01:45:34.654228+0000","last_undegraded":"2023-11-04T01:45:34.654228+0000","last_fullsized":"2023-11-04T01:45:34.654228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:06:36.042472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731901+0000","last_change":"2023-11-04T01:45:35.719746+0000","last_active":"2023-11-04T01:45:35.731901+0000","last_peered":"2023-11-04T01:45:35.731901+0000","last_clean":"2023-11-04T01:45:35.731901+0000","last_became_active":"2023-11-04T01:45:35.719442+0000","last_became_peered":"2023-11-04T01:45:35.719442+0000","last_unstale":"2023-11-04T01:45:35.731901+0000","last_undegraded":"2023-11-04T01:45:35.731901+0000","last_fullsized":"2023-11-04T01:45:35.731901+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:17:07.026341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733211+0000","last_change":"2023-11-04T01:45:34.667669+0000","last_active":"2023-11-04T01:45:35.733211+0000","last_peered":"2023-11-04T01:45:35.733211+0000","last_clean":"2023-11-04T01:45:35.733211+0000","last_became_active":"2023-11-04T01:45:34.663156+0000","last_became_peered":"2023-11-04T01:45:34.663156+0000","last_unstale":"2023-11-04T01:45:35.733211+0000","last_undegraded":"2023-11-04T01:45:35.733211+0000","last_fullsized":"2023-11-04T01:45:35.733211+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:31:11.849555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657638+0000","last_change":"2023-11-04T01:44:41.921366+0000","last_active":"2023-11-04T01:45:34.657638+0000","last_peered":"2023-11-04T01:45:34.657638+0000","last_clean":"2023-11-04T01:45:34.657638+0000","last_became_active":"2023-11-04T01:44:41.920641+0000","last_became_peered":"2023-11-04T01:44:41.920641+0000","last_unstale":"2023-11-04T01:45:34.657638+0000","last_undegraded":"2023-11-04T01:45:34.657638+0000","last_fullsized":"2023-11-04T01:45:34.657638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:35:02.316345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.660669+0000","last_change":"2023-11-04T01:44:43.113042+0000","last_active":"2023-11-04T01:45:34.660669+0000","last_peered":"2023-11-04T01:45:34.660669+0000","last_clean":"2023-11-04T01:45:34.660669+0000","last_became_active":"2023-11-04T01:44:40.944546+0000","last_became_peered":"2023-11-04T01:44:40.944546+0000","last_unstale":"2023-11-04T01:45:34.660669+0000","last_undegraded":"2023-11-04T01:45:34.660669+0000","last_fullsized":"2023-11-04T01:45:34.660669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:37:09.170503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00104459,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.687748+0000","last_change":"2023-11-04T01:43:39.859923+0000","last_active":"2023-11-04T01:45:35.687748+0000","last_peered":"2023-11-04T01:45:35.687748+0000","last_clean":"2023-11-04T01:45:35.687748+0000","last_became_active":"2023-11-04T01:43:38.852490+0000","last_became_peered":"2023-11-04T01:43:38.852490+0000","last_unstale":"2023-11-04T01:45:35.687748+0000","last_undegraded":"2023-11-04T01:45:35.687748+0000","last_fullsized":"2023-11-04T01:45:35.687748+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:03:00.377679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028903399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.712720+0000","last_change":"2023-11-04T01:45:35.710316+0000","last_active":"2023-11-04T01:45:35.712720+0000","last_peered":"2023-11-04T01:45:35.712720+0000","last_clean":"2023-11-04T01:45:35.712720+0000","last_became_active":"2023-11-04T01:45:35.709549+0000","last_became_peered":"2023-11-04T01:45:35.709549+0000","last_unstale":"2023-11-04T01:45:35.712720+0000","last_undegraded":"2023-11-04T01:45:35.712720+0000","last_fullsized":"2023-11-04T01:45:35.712720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:09:58.580406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.732525+0000","last_change":"2023-11-04T01:45:34.667042+0000","last_active":"2023-11-04T01:45:35.732525+0000","last_peered":"2023-11-04T01:45:35.732525+0000","last_clean":"2023-11-04T01:45:35.732525+0000","last_became_active":"2023-11-04T01:45:34.666264+0000","last_became_peered":"2023-11-04T01:45:34.666264+0000","last_unstale":"2023-11-04T01:45:35.732525+0000","last_undegraded":"2023-11-04T01:45:35.732525+0000","last_fullsized":"2023-11-04T01:45:35.732525+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:20.676054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657050+0000","last_change":"2023-11-04T01:44:41.944522+0000","last_active":"2023-11-04T01:45:34.657050+0000","last_peered":"2023-11-04T01:45:34.657050+0000","last_clean":"2023-11-04T01:45:34.657050+0000","last_became_active":"2023-11-04T01:44:41.943801+0000","last_became_peered":"2023-11-04T01:44:41.943801+0000","last_unstale":"2023-11-04T01:45:34.657050+0000","last_undegraded":"2023-11-04T01:45:34.657050+0000","last_fullsized":"2023-11-04T01:45:34.657050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:39:01.424092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670562+0000","last_change":"2023-11-04T01:44:42.907186+0000","last_active":"2023-11-04T01:45:34.670562+0000","last_peered":"2023-11-04T01:45:34.670562+0000","last_clean":"2023-11-04T01:45:34.670562+0000","last_became_active":"2023-11-04T01:44:40.918060+0000","last_became_peered":"2023-11-04T01:44:40.918060+0000","last_unstale":"2023-11-04T01:45:34.670562+0000","last_undegraded":"2023-11-04T01:45:34.670562+0000","last_fullsized":"2023-11-04T01:45:34.670562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:10:29.430028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016383540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.658729+0000","last_change":"2023-11-04T01:43:40.294301+0000","last_active":"2023-11-04T01:45:34.658729+0000","last_peered":"2023-11-04T01:45:34.658729+0000","last_clean":"2023-11-04T01:45:34.658729+0000","last_became_active":"2023-11-04T01:43:38.854003+0000","last_became_peered":"2023-11-04T01:43:38.854003+0000","last_unstale":"2023-11-04T01:45:34.658729+0000","last_undegraded":"2023-11-04T01:45:34.658729+0000","last_fullsized":"2023-11-04T01:45:34.658729+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:37:52.568645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063932300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.720720+0000","last_change":"2023-11-04T01:45:35.715492+0000","last_active":"2023-11-04T01:45:35.720720+0000","last_peered":"2023-11-04T01:45:35.720720+0000","last_clean":"2023-11-04T01:45:35.720720+0000","last_became_active":"2023-11-04T01:45:35.714979+0000","last_became_peered":"2023-11-04T01:45:35.714979+0000","last_unstale":"2023-11-04T01:45:35.720720+0000","last_undegraded":"2023-11-04T01:45:35.720720+0000","last_fullsized":"2023-11-04T01:45:35.720720+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:10:44.760301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.699661+0000","last_change":"2023-11-04T01:45:34.663263+0000","last_active":"2023-11-04T01:45:35.699661+0000","last_peered":"2023-11-04T01:45:35.699661+0000","last_clean":"2023-11-04T01:45:35.699661+0000","last_became_active":"2023-11-04T01:45:34.662644+0000","last_became_peered":"2023-11-04T01:45:34.662644+0000","last_unstale":"2023-11-04T01:45:35.699661+0000","last_undegraded":"2023-11-04T01:45:35.699661+0000","last_fullsized":"2023-11-04T01:45:35.699661+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:29.648363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640370+0000","last_change":"2023-11-04T01:44:41.934242+0000","last_active":"2023-11-04T01:45:34.640370+0000","last_peered":"2023-11-04T01:45:34.640370+0000","last_clean":"2023-11-04T01:45:34.640370+0000","last_became_active":"2023-11-04T01:44:41.933915+0000","last_became_peered":"2023-11-04T01:44:41.933915+0000","last_unstale":"2023-11-04T01:45:34.640370+0000","last_undegraded":"2023-11-04T01:45:34.640370+0000","last_fullsized":"2023-11-04T01:45:34.640370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:55:00.925490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654150+0000","last_change":"2023-11-04T01:44:43.173395+0000","last_active":"2023-11-04T01:45:34.654150+0000","last_peered":"2023-11-04T01:45:34.654150+0000","last_clean":"2023-11-04T01:45:34.654150+0000","last_became_active":"2023-11-04T01:44:40.917492+0000","last_became_peered":"2023-11-04T01:44:40.917492+0000","last_unstale":"2023-11-04T01:45:34.654150+0000","last_undegraded":"2023-11-04T01:45:34.654150+0000","last_fullsized":"2023-11-04T01:45:34.654150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:22:09.142444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012455719999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656295+0000","last_change":"2023-11-04T01:43:40.065764+0000","last_active":"2023-11-04T01:45:34.656295+0000","last_peered":"2023-11-04T01:45:34.656295+0000","last_clean":"2023-11-04T01:45:34.656295+0000","last_became_active":"2023-11-04T01:43:38.859676+0000","last_became_peered":"2023-11-04T01:43:38.859676+0000","last_unstale":"2023-11-04T01:45:34.656295+0000","last_undegraded":"2023-11-04T01:45:34.656295+0000","last_fullsized":"2023-11-04T01:45:34.656295+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:03:09.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016694290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.740214+0000","last_change":"2023-11-04T01:45:35.737290+0000","last_active":"2023-11-04T01:45:35.740214+0000","last_peered":"2023-11-04T01:45:35.740214+0000","last_clean":"2023-11-04T01:45:35.740214+0000","last_became_active":"2023-11-04T01:45:35.736828+0000","last_became_peered":"2023-11-04T01:45:35.736828+0000","last_unstale":"2023-11-04T01:45:35.740214+0000","last_undegraded":"2023-11-04T01:45:35.740214+0000","last_fullsized":"2023-11-04T01:45:35.740214+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:28:21.640501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.703969+0000","last_change":"2023-11-04T01:45:34.673334+0000","last_active":"2023-11-04T01:45:35.703969+0000","last_peered":"2023-11-04T01:45:35.703969+0000","last_clean":"2023-11-04T01:45:35.703969+0000","last_became_active":"2023-11-04T01:45:34.672676+0000","last_became_peered":"2023-11-04T01:45:34.672676+0000","last_unstale":"2023-11-04T01:45:35.703969+0000","last_undegraded":"2023-11-04T01:45:35.703969+0000","last_fullsized":"2023-11-04T01:45:35.703969+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:07:52.055762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.688945+0000","last_change":"2023-11-04T01:44:41.914046+0000","last_active":"2023-11-04T01:45:35.688945+0000","last_peered":"2023-11-04T01:45:35.688945+0000","last_clean":"2023-11-04T01:45:35.688945+0000","last_became_active":"2023-11-04T01:44:41.913611+0000","last_became_peered":"2023-11-04T01:44:41.913611+0000","last_unstale":"2023-11-04T01:45:35.688945+0000","last_undegraded":"2023-11-04T01:45:35.688945+0000","last_fullsized":"2023-11-04T01:45:35.688945+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:50:00.756582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641177+0000","last_change":"2023-11-04T01:44:43.177428+0000","last_active":"2023-11-04T01:45:34.641177+0000","last_peered":"2023-11-04T01:45:34.641177+0000","last_clean":"2023-11-04T01:45:34.641177+0000","last_became_active":"2023-11-04T01:44:40.909113+0000","last_became_peered":"2023-11-04T01:44:40.909113+0000","last_unstale":"2023-11-04T01:45:34.641177+0000","last_undegraded":"2023-11-04T01:45:34.641177+0000","last_fullsized":"2023-11-04T01:45:34.641177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:29:27.620457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001590373,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673918+0000","last_change":"2023-11-04T01:43:39.856409+0000","last_active":"2023-11-04T01:45:34.673918+0000","last_peered":"2023-11-04T01:45:34.673918+0000","last_clean":"2023-11-04T01:45:34.673918+0000","last_became_active":"2023-11-04T01:43:38.864350+0000","last_became_peered":"2023-11-04T01:43:38.864350+0000","last_unstale":"2023-11-04T01:45:34.673918+0000","last_undegraded":"2023-11-04T01:45:34.673918+0000","last_fullsized":"2023-11-04T01:45:34.673918+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:57:59.994106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016729900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.729220+0000","last_change":"2023-11-04T01:45:35.720344+0000","last_active":"2023-11-04T01:45:35.729220+0000","last_peered":"2023-11-04T01:45:35.729220+0000","last_clean":"2023-11-04T01:45:35.729220+0000","last_became_active":"2023-11-04T01:45:35.720021+0000","last_became_peered":"2023-11-04T01:45:35.720021+0000","last_unstale":"2023-11-04T01:45:35.729220+0000","last_undegraded":"2023-11-04T01:45:35.729220+0000","last_fullsized":"2023-11-04T01:45:35.729220+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:43:30.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"91'4","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.736335+0000","last_change":"2023-11-04T01:45:34.675294+0000","last_active":"2023-11-04T01:45:35.736335+0000","last_peered":"2023-11-04T01:45:35.736335+0000","last_clean":"2023-11-04T01:45:35.736335+0000","last_became_active":"2023-11-04T01:45:34.670236+0000","last_became_peered":"2023-11-04T01:45:34.670236+0000","last_unstale":"2023-11-04T01:45:35.736335+0000","last_undegraded":"2023-11-04T01:45:35.736335+0000","last_fullsized":"2023-11-04T01:45:35.736335+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:51:05.730512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.665345+0000","last_change":"2023-11-04T01:44:41.932864+0000","last_active":"2023-11-04T01:45:34.665345+0000","last_peered":"2023-11-04T01:45:34.665345+0000","last_clean":"2023-11-04T01:45:34.665345+0000","last_became_active":"2023-11-04T01:44:41.932047+0000","last_became_peered":"2023-11-04T01:44:41.932047+0000","last_unstale":"2023-11-04T01:45:34.665345+0000","last_undegraded":"2023-11-04T01:45:34.665345+0000","last_fullsized":"2023-11-04T01:45:34.665345+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640566+0000","last_change":"2023-11-04T01:44:43.176420+0000","last_active":"2023-11-04T01:45:34.640566+0000","last_peered":"2023-11-04T01:45:34.640566+0000","last_clean":"2023-11-04T01:45:34.640566+0000","last_became_active":"2023-11-04T01:44:40.912610+0000","last_became_peered":"2023-11-04T01:44:40.912610+0000","last_unstale":"2023-11-04T01:45:34.640566+0000","last_undegraded":"2023-11-04T01:45:34.640566+0000","last_fullsized":"2023-11-04T01:45:34.640566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:26.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010551130000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.661823+0000","last_change":"2023-11-04T01:43:40.067318+0000","last_active":"2023-11-04T01:45:34.661823+0000","last_peered":"2023-11-04T01:45:34.661823+0000","last_clean":"2023-11-04T01:45:34.661823+0000","last_became_active":"2023-11-04T01:43:38.865848+0000","last_became_peered":"2023-11-04T01:43:38.865848+0000","last_unstale":"2023-11-04T01:45:34.661823+0000","last_undegraded":"2023-11-04T01:45:34.661823+0000","last_fullsized":"2023-11-04T01:45:34.661823+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:53:11.482174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001599575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725186+0000","last_change":"2023-11-04T01:45:35.718734+0000","last_active":"2023-11-04T01:45:35.725186+0000","last_peered":"2023-11-04T01:45:35.725186+0000","last_clean":"2023-11-04T01:45:35.725186+0000","last_became_active":"2023-11-04T01:45:35.718027+0000","last_became_peered":"2023-11-04T01:45:35.718027+0000","last_unstale":"2023-11-04T01:45:35.725186+0000","last_undegraded":"2023-11-04T01:45:35.725186+0000","last_fullsized":"2023-11-04T01:45:35.725186+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:33:55.161325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"91'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730269+0000","last_change":"2023-11-04T01:45:34.684633+0000","last_active":"2023-11-04T01:45:35.730269+0000","last_peered":"2023-11-04T01:45:35.730269+0000","last_clean":"2023-11-04T01:45:35.730269+0000","last_became_active":"2023-11-04T01:45:34.683874+0000","last_became_peered":"2023-11-04T01:45:34.683874+0000","last_unstale":"2023-11-04T01:45:35.730269+0000","last_undegraded":"2023-11-04T01:45:35.730269+0000","last_fullsized":"2023-11-04T01:45:35.730269+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:18:20.676054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673335+0000","last_change":"2023-11-04T01:44:41.924679+0000","last_active":"2023-11-04T01:45:34.673335+0000","last_peered":"2023-11-04T01:45:34.673335+0000","last_clean":"2023-11-04T01:45:34.673335+0000","last_became_active":"2023-11-04T01:44:41.923856+0000","last_became_peered":"2023-11-04T01:44:41.923856+0000","last_unstale":"2023-11-04T01:45:34.673335+0000","last_undegraded":"2023-11-04T01:45:34.673335+0000","last_fullsized":"2023-11-04T01:45:34.673335+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:27:09.226432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.669642+0000","last_change":"2023-11-04T01:44:42.903545+0000","last_active":"2023-11-04T01:45:34.669642+0000","last_peered":"2023-11-04T01:45:34.669642+0000","last_clean":"2023-11-04T01:45:34.669642+0000","last_became_active":"2023-11-04T01:44:40.920627+0000","last_became_peered":"2023-11-04T01:44:40.920627+0000","last_unstale":"2023-11-04T01:45:34.669642+0000","last_undegraded":"2023-11-04T01:45:34.669642+0000","last_fullsized":"2023-11-04T01:45:34.669642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:35:23.948002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032735189999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.655896+0000","last_change":"2023-11-04T01:43:40.172645+0000","last_active":"2023-11-04T01:45:34.655896+0000","last_peered":"2023-11-04T01:45:34.655896+0000","last_clean":"2023-11-04T01:45:34.655896+0000","last_became_active":"2023-11-04T01:43:38.861861+0000","last_became_peered":"2023-11-04T01:43:38.861861+0000","last_unstale":"2023-11-04T01:45:34.655896+0000","last_undegraded":"2023-11-04T01:45:34.655896+0000","last_fullsized":"2023-11-04T01:45:34.655896+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:40:14.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886595,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714050+0000","last_change":"2023-11-04T01:45:35.704705+0000","last_active":"2023-11-04T01:45:36.714050+0000","last_peered":"2023-11-04T01:45:36.714050+0000","last_clean":"2023-11-04T01:45:36.714050+0000","last_became_active":"2023-11-04T01:45:35.704257+0000","last_became_peered":"2023-11-04T01:45:35.704257+0000","last_unstale":"2023-11-04T01:45:36.714050+0000","last_undegraded":"2023-11-04T01:45:36.714050+0000","last_fullsized":"2023-11-04T01:45:36.714050+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:49:10.258708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"91'2","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714287+0000","last_change":"2023-11-04T01:45:34.665551+0000","last_active":"2023-11-04T01:45:36.714287+0000","last_peered":"2023-11-04T01:45:36.714287+0000","last_clean":"2023-11-04T01:45:36.714287+0000","last_became_active":"2023-11-04T01:45:34.665263+0000","last_became_peered":"2023-11-04T01:45:34.665263+0000","last_unstale":"2023-11-04T01:45:36.714287+0000","last_undegraded":"2023-11-04T01:45:36.714287+0000","last_fullsized":"2023-11-04T01:45:36.714287+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:31:45.829485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641484+0000","last_change":"2023-11-04T01:44:41.920012+0000","last_active":"2023-11-04T01:45:34.641484+0000","last_peered":"2023-11-04T01:45:34.641484+0000","last_clean":"2023-11-04T01:45:34.641484+0000","last_became_active":"2023-11-04T01:44:41.919196+0000","last_became_peered":"2023-11-04T01:44:41.919196+0000","last_unstale":"2023-11-04T01:45:34.641484+0000","last_undegraded":"2023-11-04T01:45:34.641484+0000","last_fullsized":"2023-11-04T01:45:34.641484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:21:06.168935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657088+0000","last_change":"2023-11-04T01:44:42.902675+0000","last_active":"2023-11-04T01:45:34.657088+0000","last_peered":"2023-11-04T01:45:34.657088+0000","last_clean":"2023-11-04T01:45:34.657088+0000","last_became_active":"2023-11-04T01:44:40.923318+0000","last_became_peered":"2023-11-04T01:44:40.923318+0000","last_unstale":"2023-11-04T01:45:34.657088+0000","last_undegraded":"2023-11-04T01:45:34.657088+0000","last_fullsized":"2023-11-04T01:45:34.657088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:17:17.305049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022310820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656491+0000","last_change":"2023-11-04T01:43:40.067212+0000","last_active":"2023-11-04T01:45:34.656491+0000","last_peered":"2023-11-04T01:45:34.656491+0000","last_clean":"2023-11-04T01:45:34.656491+0000","last_became_active":"2023-11-04T01:43:38.865965+0000","last_became_peered":"2023-11-04T01:43:38.865965+0000","last_unstale":"2023-11-04T01:45:34.656491+0000","last_undegraded":"2023-11-04T01:45:34.656491+0000","last_fullsized":"2023-11-04T01:45:34.656491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:10:26.060448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001882166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.725761+0000","last_change":"2023-11-04T01:45:35.723055+0000","last_active":"2023-11-04T01:45:35.725761+0000","last_peered":"2023-11-04T01:45:35.725761+0000","last_clean":"2023-11-04T01:45:35.725761+0000","last_became_active":"2023-11-04T01:45:35.722660+0000","last_became_peered":"2023-11-04T01:45:35.722660+0000","last_unstale":"2023-11-04T01:45:35.725761+0000","last_undegraded":"2023-11-04T01:45:35.725761+0000","last_fullsized":"2023-11-04T01:45:35.725761+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:45:34.216190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733791+0000","last_change":"2023-11-04T01:45:34.680235+0000","last_active":"2023-11-04T01:45:35.733791+0000","last_peered":"2023-11-04T01:45:35.733791+0000","last_clean":"2023-11-04T01:45:35.733791+0000","last_became_active":"2023-11-04T01:45:34.674891+0000","last_became_peered":"2023-11-04T01:45:34.674891+0000","last_unstale":"2023-11-04T01:45:35.733791+0000","last_undegraded":"2023-11-04T01:45:35.733791+0000","last_fullsized":"2023-11-04T01:45:35.733791+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:21:38.573503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671025+0000","last_change":"2023-11-04T01:44:41.925191+0000","last_active":"2023-11-04T01:45:34.671025+0000","last_peered":"2023-11-04T01:45:34.671025+0000","last_clean":"2023-11-04T01:45:34.671025+0000","last_became_active":"2023-11-04T01:44:41.924485+0000","last_became_peered":"2023-11-04T01:44:41.924485+0000","last_unstale":"2023-11-04T01:45:34.671025+0000","last_undegraded":"2023-11-04T01:45:34.671025+0000","last_fullsized":"2023-11-04T01:45:34.671025+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:58:41.435918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.672169+0000","last_change":"2023-11-04T01:44:43.174754+0000","last_active":"2023-11-04T01:45:34.672169+0000","last_peered":"2023-11-04T01:45:34.672169+0000","last_clean":"2023-11-04T01:45:34.672169+0000","last_became_active":"2023-11-04T01:44:40.921452+0000","last_became_peered":"2023-11-04T01:44:40.921452+0000","last_unstale":"2023-11-04T01:45:34.672169+0000","last_undegraded":"2023-11-04T01:45:34.672169+0000","last_fullsized":"2023-11-04T01:45:34.672169+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:29:08.209205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039894290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.642335+0000","last_change":"2023-11-04T01:43:39.855327+0000","last_active":"2023-11-04T01:45:34.642335+0000","last_peered":"2023-11-04T01:45:34.642335+0000","last_clean":"2023-11-04T01:45:34.642335+0000","last_became_active":"2023-11-04T01:43:38.850183+0000","last_became_peered":"2023-11-04T01:43:38.850183+0000","last_unstale":"2023-11-04T01:45:34.642335+0000","last_undegraded":"2023-11-04T01:45:34.642335+0000","last_fullsized":"2023-11-04T01:45:34.642335+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010518179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714604+0000","last_change":"2023-11-04T01:45:35.717846+0000","last_active":"2023-11-04T01:45:36.714604+0000","last_peered":"2023-11-04T01:45:36.714604+0000","last_clean":"2023-11-04T01:45:36.714604+0000","last_became_active":"2023-11-04T01:45:35.717491+0000","last_became_peered":"2023-11-04T01:45:35.717491+0000","last_unstale":"2023-11-04T01:45:36.714604+0000","last_undegraded":"2023-11-04T01:45:36.714604+0000","last_fullsized":"2023-11-04T01:45:36.714604+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:53:54.444695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"91'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738528+0000","last_change":"2023-11-04T01:45:34.679841+0000","last_active":"2023-11-04T01:45:35.738528+0000","last_peered":"2023-11-04T01:45:35.738528+0000","last_clean":"2023-11-04T01:45:35.738528+0000","last_became_active":"2023-11-04T01:45:34.679085+0000","last_became_peered":"2023-11-04T01:45:34.679085+0000","last_unstale":"2023-11-04T01:45:35.738528+0000","last_undegraded":"2023-11-04T01:45:35.738528+0000","last_fullsized":"2023-11-04T01:45:35.738528+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:24:44.526862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.671961+0000","last_change":"2023-11-04T01:44:41.925691+0000","last_active":"2023-11-04T01:45:34.671961+0000","last_peered":"2023-11-04T01:45:34.671961+0000","last_clean":"2023-11-04T01:45:34.671961+0000","last_became_active":"2023-11-04T01:44:41.924864+0000","last_became_peered":"2023-11-04T01:44:41.924864+0000","last_unstale":"2023-11-04T01:45:34.671961+0000","last_undegraded":"2023-11-04T01:45:34.671961+0000","last_fullsized":"2023-11-04T01:45:34.671961+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:45:45.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.691304+0000","last_change":"2023-11-04T01:44:42.906340+0000","last_active":"2023-11-04T01:45:35.691304+0000","last_peered":"2023-11-04T01:45:35.691304+0000","last_clean":"2023-11-04T01:45:35.691304+0000","last_became_active":"2023-11-04T01:44:40.910288+0000","last_became_peered":"2023-11-04T01:44:40.910288+0000","last_unstale":"2023-11-04T01:45:35.691304+0000","last_undegraded":"2023-11-04T01:45:35.691304+0000","last_fullsized":"2023-11-04T01:45:35.691304+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:04:47.297826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042925560000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.669491+0000","last_change":"2023-11-04T01:43:40.804620+0000","last_active":"2023-11-04T01:45:34.669491+0000","last_peered":"2023-11-04T01:45:34.669491+0000","last_clean":"2023-11-04T01:45:34.669491+0000","last_became_active":"2023-11-04T01:43:38.850780+0000","last_became_peered":"2023-11-04T01:43:38.850780+0000","last_unstale":"2023-11-04T01:45:34.669491+0000","last_undegraded":"2023-11-04T01:45:34.669491+0000","last_fullsized":"2023-11-04T01:45:34.669491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:53:49.114712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2023-11-04T01:45:36.714571+0000","last_change":"2023-11-04T01:45:35.716929+0000","last_active":"2023-11-04T01:45:36.714571+0000","last_peered":"2023-11-04T01:45:36.714571+0000","last_clean":"2023-11-04T01:45:36.714571+0000","last_became_active":"2023-11-04T01:45:35.716547+0000","last_became_peered":"2023-11-04T01:45:35.716547+0000","last_unstale":"2023-11-04T01:45:36.714571+0000","last_undegraded":"2023-11-04T01:45:36.714571+0000","last_fullsized":"2023-11-04T01:45:36.714571+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:02:55.858718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.701343+0000","last_change":"2023-11-04T01:45:34.691291+0000","last_active":"2023-11-04T01:45:35.701343+0000","last_peered":"2023-11-04T01:45:35.701343+0000","last_clean":"2023-11-04T01:45:35.701343+0000","last_became_active":"2023-11-04T01:45:34.689214+0000","last_became_peered":"2023-11-04T01:45:34.689214+0000","last_unstale":"2023-11-04T01:45:35.701343+0000","last_undegraded":"2023-11-04T01:45:35.701343+0000","last_fullsized":"2023-11-04T01:45:35.701343+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:17.582680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640312+0000","last_change":"2023-11-04T01:44:41.918620+0000","last_active":"2023-11-04T01:45:34.640312+0000","last_peered":"2023-11-04T01:45:34.640312+0000","last_clean":"2023-11-04T01:45:34.640312+0000","last_became_active":"2023-11-04T01:44:41.918291+0000","last_became_peered":"2023-11-04T01:44:41.918291+0000","last_unstale":"2023-11-04T01:45:34.640312+0000","last_undegraded":"2023-11-04T01:45:34.640312+0000","last_fullsized":"2023-11-04T01:45:34.640312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:00:08.513158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654952+0000","last_change":"2023-11-04T01:44:43.173305+0000","last_active":"2023-11-04T01:45:34.654952+0000","last_peered":"2023-11-04T01:45:34.654952+0000","last_clean":"2023-11-04T01:45:34.654952+0000","last_became_active":"2023-11-04T01:44:40.918163+0000","last_became_peered":"2023-11-04T01:44:40.918163+0000","last_unstale":"2023-11-04T01:45:34.654952+0000","last_undegraded":"2023-11-04T01:45:34.654952+0000","last_fullsized":"2023-11-04T01:45:34.654952+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T01:46:21.563078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011642689999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673903+0000","last_change":"2023-11-04T01:43:39.857236+0000","last_active":"2023-11-04T01:45:34.673903+0000","last_peered":"2023-11-04T01:45:34.673903+0000","last_clean":"2023-11-04T01:45:34.673903+0000","last_became_active":"2023-11-04T01:43:38.847814+0000","last_became_peered":"2023-11-04T01:43:38.847814+0000","last_unstale":"2023-11-04T01:45:34.673903+0000","last_undegraded":"2023-11-04T01:45:34.673903+0000","last_fullsized":"2023-11-04T01:45:34.673903+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:09:42.926902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001861204,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.741448+0000","last_change":"2023-11-04T01:45:35.732613+0000","last_active":"2023-11-04T01:45:35.741448+0000","last_peered":"2023-11-04T01:45:35.741448+0000","last_clean":"2023-11-04T01:45:35.741448+0000","last_became_active":"2023-11-04T01:45:35.731436+0000","last_became_peered":"2023-11-04T01:45:35.731436+0000","last_unstale":"2023-11-04T01:45:35.741448+0000","last_undegraded":"2023-11-04T01:45:35.741448+0000","last_fullsized":"2023-11-04T01:45:35.741448+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:51:59.776959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.694126+0000","last_change":"2023-11-04T01:45:34.677958+0000","last_active":"2023-11-04T01:45:35.694126+0000","last_peered":"2023-11-04T01:45:35.694126+0000","last_clean":"2023-11-04T01:45:35.694126+0000","last_became_active":"2023-11-04T01:45:34.676384+0000","last_became_peered":"2023-11-04T01:45:34.676384+0000","last_unstale":"2023-11-04T01:45:35.694126+0000","last_undegraded":"2023-11-04T01:45:35.694126+0000","last_fullsized":"2023-11-04T01:45:35.694126+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:11:03.051575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.657214+0000","last_change":"2023-11-04T01:44:41.918947+0000","last_active":"2023-11-04T01:45:34.657214+0000","last_peered":"2023-11-04T01:45:34.657214+0000","last_clean":"2023-11-04T01:45:34.657214+0000","last_became_active":"2023-11-04T01:44:41.918140+0000","last_became_peered":"2023-11-04T01:44:41.918140+0000","last_unstale":"2023-11-04T01:45:34.657214+0000","last_undegraded":"2023-11-04T01:45:34.657214+0000","last_fullsized":"2023-11-04T01:45:34.657214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:58.268543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.677754+0000","last_change":"2023-11-04T01:44:43.173435+0000","last_active":"2023-11-04T01:45:34.677754+0000","last_peered":"2023-11-04T01:45:34.677754+0000","last_clean":"2023-11-04T01:45:34.677754+0000","last_became_active":"2023-11-04T01:44:40.934905+0000","last_became_peered":"2023-11-04T01:44:40.934905+0000","last_unstale":"2023-11-04T01:45:34.677754+0000","last_undegraded":"2023-11-04T01:45:34.677754+0000","last_fullsized":"2023-11-04T01:45:34.677754+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:54:59.915687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001324778,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656465+0000","last_change":"2023-11-04T01:43:40.066584+0000","last_active":"2023-11-04T01:45:34.656465+0000","last_peered":"2023-11-04T01:45:34.656465+0000","last_clean":"2023-11-04T01:45:34.656465+0000","last_became_active":"2023-11-04T01:43:38.858165+0000","last_became_peered":"2023-11-04T01:43:38.858165+0000","last_unstale":"2023-11-04T01:45:34.656465+0000","last_undegraded":"2023-11-04T01:45:34.656465+0000","last_fullsized":"2023-11-04T01:45:34.656465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T10:47:45.759599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017193589999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731227+0000","last_change":"2023-11-04T01:45:35.724981+0000","last_active":"2023-11-04T01:45:35.731227+0000","last_peered":"2023-11-04T01:45:35.731227+0000","last_clean":"2023-11-04T01:45:35.731227+0000","last_became_active":"2023-11-04T01:45:35.723769+0000","last_became_peered":"2023-11-04T01:45:35.723769+0000","last_unstale":"2023-11-04T01:45:35.731227+0000","last_undegraded":"2023-11-04T01:45:35.731227+0000","last_fullsized":"2023-11-04T01:45:35.731227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:14:18.593633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"91'8","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.733768+0000","last_change":"2023-11-04T01:45:34.669723+0000","last_active":"2023-11-04T01:45:35.733768+0000","last_peered":"2023-11-04T01:45:35.733768+0000","last_clean":"2023-11-04T01:45:35.733768+0000","last_became_active":"2023-11-04T01:45:34.669140+0000","last_became_peered":"2023-11-04T01:45:34.669140+0000","last_unstale":"2023-11-04T01:45:35.733768+0000","last_undegraded":"2023-11-04T01:45:35.733768+0000","last_fullsized":"2023-11-04T01:45:35.733768+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:43:33.255453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673897+0000","last_change":"2023-11-04T01:44:41.935218+0000","last_active":"2023-11-04T01:45:34.673897+0000","last_peered":"2023-11-04T01:45:34.673897+0000","last_clean":"2023-11-04T01:45:34.673897+0000","last_became_active":"2023-11-04T01:44:41.934439+0000","last_became_peered":"2023-11-04T01:44:41.934439+0000","last_unstale":"2023-11-04T01:45:34.673897+0000","last_undegraded":"2023-11-04T01:45:34.673897+0000","last_fullsized":"2023-11-04T01:45:34.673897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:19:16.371130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670514+0000","last_change":"2023-11-04T01:44:42.905649+0000","last_active":"2023-11-04T01:45:34.670514+0000","last_peered":"2023-11-04T01:45:34.670514+0000","last_clean":"2023-11-04T01:45:34.670514+0000","last_became_active":"2023-11-04T01:44:40.923902+0000","last_became_peered":"2023-11-04T01:44:40.923902+0000","last_unstale":"2023-11-04T01:45:34.670514+0000","last_undegraded":"2023-11-04T01:45:34.670514+0000","last_fullsized":"2023-11-04T01:45:34.670514+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:28:10.223430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015906259999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.685701+0000","last_change":"2023-11-04T01:43:39.857519+0000","last_active":"2023-11-04T01:45:35.685701+0000","last_peered":"2023-11-04T01:45:35.685701+0000","last_clean":"2023-11-04T01:45:35.685701+0000","last_became_active":"2023-11-04T01:43:38.849588+0000","last_became_peered":"2023-11-04T01:43:38.849588+0000","last_unstale":"2023-11-04T01:45:35.685701+0000","last_undegraded":"2023-11-04T01:45:35.685701+0000","last_fullsized":"2023-11-04T01:45:35.685701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T13:41:26.804649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015256410000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731183+0000","last_change":"2023-11-04T01:45:35.719054+0000","last_active":"2023-11-04T01:45:35.731183+0000","last_peered":"2023-11-04T01:45:35.731183+0000","last_clean":"2023-11-04T01:45:35.731183+0000","last_became_active":"2023-11-04T01:45:35.718481+0000","last_became_peered":"2023-11-04T01:45:35.718481+0000","last_unstale":"2023-11-04T01:45:35.731183+0000","last_undegraded":"2023-11-04T01:45:35.731183+0000","last_fullsized":"2023-11-04T01:45:35.731183+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:16:59.069271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.720583+0000","last_change":"2023-11-04T01:45:34.668400+0000","last_active":"2023-11-04T01:45:35.720583+0000","last_peered":"2023-11-04T01:45:35.720583+0000","last_clean":"2023-11-04T01:45:35.720583+0000","last_became_active":"2023-11-04T01:45:34.668108+0000","last_became_peered":"2023-11-04T01:45:34.668108+0000","last_unstale":"2023-11-04T01:45:35.720583+0000","last_undegraded":"2023-11-04T01:45:35.720583+0000","last_fullsized":"2023-11-04T01:45:35.720583+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:24:03.405072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.690721+0000","last_change":"2023-11-04T01:44:41.934607+0000","last_active":"2023-11-04T01:45:35.690721+0000","last_peered":"2023-11-04T01:45:35.690721+0000","last_clean":"2023-11-04T01:45:35.690721+0000","last_became_active":"2023-11-04T01:44:41.934198+0000","last_became_peered":"2023-11-04T01:44:41.934198+0000","last_unstale":"2023-11-04T01:45:35.690721+0000","last_undegraded":"2023-11-04T01:45:35.690721+0000","last_fullsized":"2023-11-04T01:45:35.690721+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:50:38.701974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.653308+0000","last_change":"2023-11-04T01:44:43.172018+0000","last_active":"2023-11-04T01:45:34.653308+0000","last_peered":"2023-11-04T01:45:34.653308+0000","last_clean":"2023-11-04T01:45:34.653308+0000","last_became_active":"2023-11-04T01:44:40.912370+0000","last_became_peered":"2023-11-04T01:44:40.912370+0000","last_unstale":"2023-11-04T01:45:34.653308+0000","last_undegraded":"2023-11-04T01:45:34.653308+0000","last_fullsized":"2023-11-04T01:45:34.653308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:13:11.680326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061865800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670850+0000","last_change":"2023-11-04T01:43:40.805807+0000","last_active":"2023-11-04T01:45:34.670850+0000","last_peered":"2023-11-04T01:45:34.670850+0000","last_clean":"2023-11-04T01:45:34.670850+0000","last_became_active":"2023-11-04T01:43:38.856404+0000","last_became_peered":"2023-11-04T01:43:38.856404+0000","last_unstale":"2023-11-04T01:45:34.670850+0000","last_undegraded":"2023-11-04T01:45:34.670850+0000","last_fullsized":"2023-11-04T01:45:34.670850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T06:13:54.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010267,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.730223+0000","last_change":"2023-11-04T01:45:35.713172+0000","last_active":"2023-11-04T01:45:35.730223+0000","last_peered":"2023-11-04T01:45:35.730223+0000","last_clean":"2023-11-04T01:45:35.730223+0000","last_became_active":"2023-11-04T01:45:35.712874+0000","last_became_peered":"2023-11-04T01:45:35.712874+0000","last_unstale":"2023-11-04T01:45:35.730223+0000","last_undegraded":"2023-11-04T01:45:35.730223+0000","last_fullsized":"2023-11-04T01:45:35.730223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T04:11:34.915045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.698685+0000","last_change":"2023-11-04T01:45:34.691212+0000","last_active":"2023-11-04T01:45:35.698685+0000","last_peered":"2023-11-04T01:45:35.698685+0000","last_clean":"2023-11-04T01:45:35.698685+0000","last_became_active":"2023-11-04T01:45:34.689149+0000","last_became_peered":"2023-11-04T01:45:34.689149+0000","last_unstale":"2023-11-04T01:45:35.698685+0000","last_undegraded":"2023-11-04T01:45:35.698685+0000","last_fullsized":"2023-11-04T01:45:35.698685+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T11:57:17.438114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.654074+0000","last_change":"2023-11-04T01:44:41.926616+0000","last_active":"2023-11-04T01:45:34.654074+0000","last_peered":"2023-11-04T01:45:34.654074+0000","last_clean":"2023-11-04T01:45:34.654074+0000","last_became_active":"2023-11-04T01:44:41.926311+0000","last_became_peered":"2023-11-04T01:44:41.926311+0000","last_unstale":"2023-11-04T01:45:34.654074+0000","last_undegraded":"2023-11-04T01:45:34.654074+0000","last_fullsized":"2023-11-04T01:45:34.654074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:12:11.379149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.640414+0000","last_change":"2023-11-04T01:44:43.178007+0000","last_active":"2023-11-04T01:45:34.640414+0000","last_peered":"2023-11-04T01:45:34.640414+0000","last_clean":"2023-11-04T01:45:34.640414+0000","last_became_active":"2023-11-04T01:44:40.918444+0000","last_became_peered":"2023-11-04T01:44:40.918444+0000","last_unstale":"2023-11-04T01:45:34.640414+0000","last_undegraded":"2023-11-04T01:45:34.640414+0000","last_fullsized":"2023-11-04T01:45:34.640414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:44:30.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029560530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.680909+0000","last_change":"2023-11-04T01:43:39.858186+0000","last_active":"2023-11-04T01:45:34.680909+0000","last_peered":"2023-11-04T01:45:34.680909+0000","last_clean":"2023-11-04T01:45:34.680909+0000","last_became_active":"2023-11-04T01:43:38.839525+0000","last_became_peered":"2023-11-04T01:43:38.839525+0000","last_unstale":"2023-11-04T01:45:34.680909+0000","last_undegraded":"2023-11-04T01:45:34.680909+0000","last_fullsized":"2023-11-04T01:45:34.680909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T09:13:33.769815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001762341,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.722114+0000","last_change":"2023-11-04T01:45:35.713709+0000","last_active":"2023-11-04T01:45:35.722114+0000","last_peered":"2023-11-04T01:45:35.722114+0000","last_clean":"2023-11-04T01:45:35.722114+0000","last_became_active":"2023-11-04T01:45:35.713412+0000","last_became_peered":"2023-11-04T01:45:35.713412+0000","last_unstale":"2023-11-04T01:45:35.722114+0000","last_undegraded":"2023-11-04T01:45:35.722114+0000","last_fullsized":"2023-11-04T01:45:35.722114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:23:04.024187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"91'3","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.731649+0000","last_change":"2023-11-04T01:45:34.678518+0000","last_active":"2023-11-04T01:45:35.731649+0000","last_peered":"2023-11-04T01:45:35.731649+0000","last_clean":"2023-11-04T01:45:35.731649+0000","last_became_active":"2023-11-04T01:45:34.678224+0000","last_became_peered":"2023-11-04T01:45:34.678224+0000","last_unstale":"2023-11-04T01:45:35.731649+0000","last_undegraded":"2023-11-04T01:45:35.731649+0000","last_fullsized":"2023-11-04T01:45:35.731649+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:49:51.750252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.641691+0000","last_change":"2023-11-04T01:44:41.910669+0000","last_active":"2023-11-04T01:45:34.641691+0000","last_peered":"2023-11-04T01:45:34.641691+0000","last_clean":"2023-11-04T01:45:34.641691+0000","last_became_active":"2023-11-04T01:44:41.910257+0000","last_became_peered":"2023-11-04T01:44:41.910257+0000","last_unstale":"2023-11-04T01:45:34.641691+0000","last_undegraded":"2023-11-04T01:45:34.641691+0000","last_fullsized":"2023-11-04T01:45:34.641691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:03:15.837643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656839+0000","last_change":"2023-11-04T01:44:43.112877+0000","last_active":"2023-11-04T01:45:34.656839+0000","last_peered":"2023-11-04T01:45:34.656839+0000","last_clean":"2023-11-04T01:45:34.656839+0000","last_became_active":"2023-11-04T01:44:40.940708+0000","last_became_peered":"2023-11-04T01:44:40.940708+0000","last_unstale":"2023-11-04T01:45:34.656839+0000","last_undegraded":"2023-11-04T01:45:34.656839+0000","last_fullsized":"2023-11-04T01:45:34.656839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T12:25:09.389684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022320399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":63,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.670668+0000","last_change":"2023-11-04T01:43:40.805072+0000","last_active":"2023-11-04T01:45:34.670668+0000","last_peered":"2023-11-04T01:45:34.670668+0000","last_clean":"2023-11-04T01:45:34.670668+0000","last_became_active":"2023-11-04T01:43:38.856450+0000","last_became_peered":"2023-11-04T01:43:38.856450+0000","last_unstale":"2023-11-04T01:45:34.670668+0000","last_undegraded":"2023-11-04T01:45:34.670668+0000","last_fullsized":"2023-11-04T01:45:34.670668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T02:15:47.498200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011509039999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.738424+0000","last_change":"2023-11-04T01:45:35.726494+0000","last_active":"2023-11-04T01:45:35.738424+0000","last_peered":"2023-11-04T01:45:35.738424+0000","last_clean":"2023-11-04T01:45:35.738424+0000","last_became_active":"2023-11-04T01:45:35.725406+0000","last_became_peered":"2023-11-04T01:45:35.725406+0000","last_unstale":"2023-11-04T01:45:35.738424+0000","last_undegraded":"2023-11-04T01:45:35.738424+0000","last_fullsized":"2023-11-04T01:45:35.738424+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:34.630169+0000","last_clean_scrub_stamp":"2023-11-04T01:45:34.630169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:48:10.452150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"91'6","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-11-04T01:45:35.739812+0000","last_change":"2023-11-04T01:45:34.691663+0000","last_active":"2023-11-04T01:45:35.739812+0000","last_peered":"2023-11-04T01:45:35.739812+0000","last_clean":"2023-11-04T01:45:35.739812+0000","last_became_active":"2023-11-04T01:45:34.691350+0000","last_became_peered":"2023-11-04T01:45:34.691350+0000","last_unstale":"2023-11-04T01:45:35.739812+0000","last_undegraded":"2023-11-04T01:45:35.739812+0000","last_fullsized":"2023-11-04T01:45:35.739812+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:45:33.619216+0000","last_clean_scrub_stamp":"2023-11-04T01:45:33.619216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T05:42:51.318420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.656073+0000","last_change":"2023-11-04T01:44:41.934098+0000","last_active":"2023-11-04T01:45:34.656073+0000","last_peered":"2023-11-04T01:45:34.656073+0000","last_clean":"2023-11-04T01:45:34.656073+0000","last_became_active":"2023-11-04T01:44:41.933709+0000","last_became_peered":"2023-11-04T01:44:41.933709+0000","last_unstale":"2023-11-04T01:45:34.656073+0000","last_undegraded":"2023-11-04T01:45:34.656073+0000","last_fullsized":"2023-11-04T01:45:34.656073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:40.883089+0000","last_clean_scrub_stamp":"2023-11-04T01:44:40.883089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T08:19:56.613949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.677317+0000","last_change":"2023-11-04T01:44:43.172536+0000","last_active":"2023-11-04T01:45:34.677317+0000","last_peered":"2023-11-04T01:45:34.677317+0000","last_clean":"2023-11-04T01:45:34.677317+0000","last_became_active":"2023-11-04T01:44:40.923754+0000","last_became_peered":"2023-11-04T01:44:40.923754+0000","last_unstale":"2023-11-04T01:45:34.677317+0000","last_undegraded":"2023-11-04T01:45:34.677317+0000","last_fullsized":"2023-11-04T01:45:34.677317+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:44:39.873286+0000","last_clean_scrub_stamp":"2023-11-04T01:44:39.873286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T07:57:16.408984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026512620000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":61,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-11-04T01:45:34.673522+0000","last_change":"2023-11-04T01:43:39.858053+0000","last_active":"2023-11-04T01:45:34.673522+0000","last_peered":"2023-11-04T01:45:34.673522+0000","last_clean":"2023-11-04T01:45:34.673522+0000","last_became_active":"2023-11-04T01:43:38.850608+0000","last_became_peered":"2023-11-04T01:43:38.850608+0000","last_unstale":"2023-11-04T01:45:34.673522+0000","last_undegraded":"2023-11-04T01:45:34.673522+0000","last_fullsized":"2023-11-04T01:45:34.673522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-04T01:43:37.809008+0000","last_clean_scrub_stamp":"2023-11-04T01:43:37.809008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-05T03:36:07.386362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001788984,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32860,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338980,"statfs":{"total":96636764160,"available":96603115520,"internally_reserved":0,"allocated":1712128,"data_stored":1110592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.316,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.626,"15min":0.61499999999999999},"min":{"1min":0.33500000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.70299999999999996,"15min":0.69999999999999996},"min":{"1min":0.35899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.40699999999999997}]},{"osd":3,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71199999999999997,"15min":0.68999999999999995},"min":{"1min":0.30099999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.82199999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.89200000000000002,"15min":0.879},"min":{"1min":0.53900000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.2290000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.96999999999999997,"15min":0.97799999999999998},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":0.76500000000000001}]},{"osd":5,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.02,"5min":1.0109999999999999,"15min":1.008},"min":{"1min":0.58599999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.78600000000000003}]},{"osd":6,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.98299999999999998,"15min":0.98699999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.4359999999999999,"5min":1.468,"15min":1.468},"last":0.875},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.044,"15min":1.0660000000000001},"min":{"1min":0.63900000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2,"5min":2,"15min":2},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Nov 4 01:45:22 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.046,"15min":1.05},"min":{"1min":0.625,"5min":0.502,"15min":0.502},"max":{"1min":2.1459999999999999,"5min":2.1459999999999999,"15min":2.1459999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.02,"5min":1.0680000000000001,"15min":1.073},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.92100000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1114112,"data_stored":520714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59699999999999998,"15min":0.59799999999999998},"min":{"1min":0.33500000000000002,"5min":0.248,"15min":0.248},"max":{"1min":1.0329999999999999,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.194},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.002,"5min":1.595,"15min":1.595},"last":0.65700000000000003}]},{"osd":2,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.25,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.67500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.607,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66800000000000004},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.4419999999999999,"5min":1.885,"15min":1.885},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.69499999999999995},"min":{"1min":0.42599999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.218,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.81399999999999995}]},{"osd":4,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.51500000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.3069999999999999,"5min":1.526,"15min":1.526},"last":1.246},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96799999999999997,"15min":0.96999999999999997},"min":{"1min":0.57799999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.4419999999999999,"5min":1.897,"15min":1.897},"last":0.91800000000000004}]},{"osd":5,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.96899999999999997,"15min":0.96499999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3089999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.97099999999999997,"15min":0.997},"min":{"1min":0.60299999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.383,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1419999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.0029999999999999,"15min":1.004},"min":{"1min":0.622,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.536,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.042,"15min":1.044},"min":{"1min":0.63400000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5529999999999999,"5min":1.948,"15min":1.948},"last":1.111}]},{"osd":7,"last update":"Sat Nov 4 01:45:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0840000000000001,"15min":1.0920000000000001},"min":{"1min":0.66500000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.518,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0089999999999999,"15min":1.0269999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.3779999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.615}]}]},{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1118208,"data_stored":520784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.85399999999999998,"15min":0.88600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.008,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.163},{"interface":"front","average":{"1min":0.747,"5min":0.81899999999999995,"15min":0.84099999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0409999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.85099999999999998},"min":{"1min":0.52000000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.2230000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.127},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.84399999999999997,"15min":0.86799999999999999},"min":{"1min":0.51900000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.165,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.0960000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.89400000000000002,"15min":0.86599999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3220000000000001,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.89500000000000002,"15min":0.90100000000000002},"min":{"1min":0.66500000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89800000000000002,"15min":0.90100000000000002},"min":{"1min":0.66200000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1499999999999999,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.98999999999999999,"15min":1.0049999999999999},"min":{"1min":0.72399999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.4350000000000001,"5min":1.514,"15min":1.514},"last":0.98999999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.079,"15min":1.079},"min":{"1min":0.92600000000000005,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3819999999999999,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":1.21},{"interface":"front","average":{"1min":1.052,"5min":1.0609999999999999,"15min":1.0669999999999999},"min":{"1min":0.70699999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.2170000000000001,"5min":2.609,"15min":2.609},"last":0.95199999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.115,"15min":1.163},"min":{"1min":0.62,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2869999999999999,"5min":5.1150000000000002,"15min":5.1150000000000002},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.125,"15min":2.5649999999999999},"min":{"1min":0.84199999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5109999999999999,"5min":40.195,"15min":40.195},"last":0.749}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.246,"15min":1.304},"min":{"1min":0.96999999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.268,"5min":5.5549999999999997,"15min":5.5549999999999997},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.129,"15min":1.1459999999999999},"min":{"1min":0.75600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3180000000000001,"5min":1.637,"15min":1.637},"last":0.92700000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1097728,"data_stored":512294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.401,"5min":1.012,"15min":0.93200000000000005},"min":{"1min":0.5,"5min":0.497,"15min":0.497},"max":{"1min":12.167999999999999,"5min":12.167999999999999,"15min":12.167999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.169,"5min":0.98499999999999999,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":7.0510000000000002,"5min":7.0510000000000002,"15min":7.0510000000000002},"last":0.93200000000000005}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.99399999999999999,"15min":0.97599999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.9539999999999997,"5min":6.9539999999999997,"15min":6.9539999999999997},"last":1.274},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.99199999999999999}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.0940000000000001,"15min":1.0449999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":12.343,"5min":12.343,"15min":12.343},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.0720000000000001,"15min":1.0469999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":7.1269999999999998,"5min":7.1269999999999998,"15min":7.1269999999999998},"last":1.0629999999999999}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.109,"15min":1.0409999999999999},"min":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":12.256,"5min":12.256,"15min":12.256},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.157,"15min":1.147},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":7.2880000000000003,"5min":7.2880000000000003,"15min":7.2880000000000003},"last":1.1559999999999999}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.0529999999999999,"15min":0.99199999999999999},"min":{"1min":0.73899999999999999,"5min":0.495,"15min":0.495},"max":{"1min":10.73,"5min":10.73,"15min":10.73},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.629,"5min":1.2150000000000001,"15min":1.1559999999999999},"min":{"1min":0.73299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":12.494999999999999,"5min":12.494999999999999,"15min":12.494999999999999},"last":0.874}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.083,"15min":1.071},"min":{"1min":0.70499999999999996,"5min":0.63,"15min":0.63},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":2.0179999999999998,"5min":1.329,"15min":1.228},"min":{"1min":0.70899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":19.361999999999998,"5min":19.361999999999998,"15min":19.361999999999998},"last":1.0189999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.1970000000000001,"15min":1.1890000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":7.1980000000000004,"5min":7.1980000000000004,"15min":7.1980000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1080000000000001,"15min":1.1120000000000001},"min":{"1min":0.92900000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3280000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.099}]}]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1691648,"data_stored":1102662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.873,"15min":0.878},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.3089999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.82799999999999996,"15min":0.79100000000000004},"min":{"1min":0.54300000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.093}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.877,"15min":0.89300000000000002},"min":{"1min":0.60699999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2509999999999999,"5min":1.321,"15min":1.321},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.94199999999999995,"15min":0.93400000000000005},"min":{"1min":0.47099999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.97199999999999998}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.871,"15min":0.85699999999999998},"min":{"1min":0.53200000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.96599999999999997,"15min":0.98299999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4119999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.24}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.877,"15min":0.876},"min":{"1min":0.57399999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.94899999999999995,"15min":0.92600000000000005},"min":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.196}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1,"15min":0.98899999999999999},"min":{"1min":0.72399999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.995,"15min":1.0209999999999999},"min":{"1min":0.63500000000000001,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2290000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.115,"15min":1.155},"min":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5029999999999999,"5min":1.627,"15min":1.627},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1899999999999999,"15min":1.181},"min":{"1min":0.95499999999999996,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.28}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.113,"15min":1.1379999999999999},"min":{"1min":0.88900000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.127},{"interface":"front","average":{"1min":1.179,"5min":1.2090000000000001,"15min":1.2270000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.319}]}]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1097728,"data_stored":512294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.82399999999999995,"15min":0.78400000000000003},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.071,"5min":0.97499999999999998,"15min":0.98199999999999998},"min":{"1min":0.51100000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":4.8150000000000004,"5min":4.8150000000000004,"15min":4.8150000000000004},"last":0.89700000000000002}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.079,"5min":0.93899999999999995,"15min":0.91900000000000004},"min":{"1min":0.67200000000000004,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":4.0919999999999996,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.88400000000000001,"15min":0.879},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.76200000000000001}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.98499999999999999,"15min":0.97299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":3.4620000000000002,"5min":3.4620000000000002,"15min":3.4620000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":4.556,"5min":4.556,"15min":4.556},"last":0.65600000000000003}]},{"osd":3,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.93300000000000005,"15min":0.92600000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.169,"5min":1.103,"15min":1.111},"min":{"1min":0.64800000000000002,"5min":0.627,"15min":0.627},"max":{"1min":4.3319999999999999,"5min":4.3319999999999999,"15min":4.3319999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.95899999999999996,"15min":0.96399999999999997},"min":{"1min":0.71399999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.29,"5min":1.369,"15min":1.369},"last":1.02},{"interface":"front","average":{"1min":1.002,"5min":0.998,"15min":1.002},"min":{"1min":0.67700000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.502,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1579999999999999}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1200000000000001,"15min":1.1220000000000001},"min":{"1min":0.66700000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.655,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.01,"5min":1.0269999999999999,"15min":1.014},"min":{"1min":0.70499999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.226,"5min":1.554,"15min":1.554},"last":1.129}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.0760000000000001,"15min":1.0620000000000001},"min":{"1min":0.86899999999999999,"5min":0.63,"15min":0.63},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2130000000000001,"15min":1.2050000000000001},"min":{"1min":0.96699999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.637,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.0609999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1122304,"data_stored":521744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59499999999999997,"15min":0.60499999999999998},"min":{"1min":0.28599999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.91500000000000004,"5min":1.167,"15min":1.167},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.625,"15min":0.622},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.89700000000000002,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.81699999999999995}]},{"osd":1,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.39500000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75600000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.71999999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.96799999999999997,"5min":1.429,"15min":1.429},"last":0.72099999999999997}]},{"osd":2,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.71199999999999997,"15min":0.71499999999999997},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.04,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.751,"15min":0.74299999999999999},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.88300000000000001,"15min":0.86599999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0900000000000001,"5min":1.371,"15min":1.371},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.94999999999999996,"15min":0.96299999999999997},"min":{"1min":0.63200000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1759999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.081}]},{"osd":5,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.59299999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2709999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.0329999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.2110000000000001}]},{"osd":6,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.94199999999999995,"15min":0.94399999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.248,"5min":1.369,"15min":1.369},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.046,"15min":1.0620000000000001},"min":{"1min":0.61099999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3129999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0109999999999999}]},{"osd":7,"last update":"Sat Nov 4 01:45:18 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.59599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.048},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0249999999999999,"15min":1.03},"min":{"1min":0.72499999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2290000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.258}]}]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32276,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339564,"statfs":{"total":96636764160,"available":96603713536,"internally_reserved":0,"allocated":1118208,"data_stored":520244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 4 01:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.33500000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.83499999999999996,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Nov 4 01:45:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66700000000000004,"15min":0.66400000000000003},"min":{"1min":0.36399999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.68000000000000005}]},{"osd":3,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.29699999999999999,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.077,"5min":1.274,"15min":1.274},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1539999999999999,"5min":1.181,"15min":1.181},"last":0.58099999999999996}]},{"osd":4,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.2330000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.91500000000000004,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3080000000000001,"5min":2.0649999999999999,"15min":2.0649999999999999},"last":0.82999999999999996}]},{"osd":5,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.876,"15min":0.876},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.751},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.93100000000000005,"15min":0.93799999999999994},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.327,"5min":1.341,"15min":1.341},"last":1.121}]},{"osd":6,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.93999999999999995,"15min":0.95999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3320000000000001,"5min":1.603,"15min":1.603},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":1.167}]},{"osd":7,"last update":"Sat Nov 4 01:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.99199999999999999,"15min":0.996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.306,"5min":1.411,"15min":1.411},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.99399999999999999,"15min":1.0089999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.262,"5min":1.613,"15min":1.613},"last":0.91400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-04T01:45:40.188 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-04T01:45:40.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-04T01:45:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.345+0000 7f69f9ba5640 1 Processor -- start 2023-11-04T01:45:40.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.345+0000 7f69f9ba5640 1 -- start start 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f69f4159f90 0x7f69f40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f40714c0 con 0x7f69f40ce4c0 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40711e0 con 0x7f69f4159f90 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40cd4a0 con 0x7f69f40b0bf0 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f69f4159f90 0x7f69f40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f69f4159f90 0x7f69f40cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50278/0 (socket says 172.21.15.2:50278) 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 -- 172.21.15.2:0/3689028917 learned_addr learned my addr 172.21.15.2:0/3689028917 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f3fff640 1 --2- 172.21.15.2:0/3689028917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 -- 172.21.15.2:0/3689028917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 msgr2=0x7f69f40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:40.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 --2- 172.21.15.2:0/3689028917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 -- 172.21.15.2:0/3689028917 >> v1:172.21.15.90:6789/0 conn(0x7f69f40ce4c0 legacy=0x7f69f40b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:40.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 -- 172.21.15.2:0/3689028917 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40cd780 con 0x7f69f4159f90 2023-11-04T01:45:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f37fe640 1 --2- 172.21.15.2:0/3689028917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4159f90 0x7f69f40cdf80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009870 tx=0x7f69e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ba462dc5c59f70 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f27fc640 1 -- 172.21.15.2:0/3689028917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40ab620 con 0x7f69f4159f90 2023-11-04T01:45:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f27fc640 1 -- 172.21.15.2:0/3689028917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e40ab780 con 0x7f69f4159f90 2023-11-04T01:45:40.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f27fc640 1 -- 172.21.15.2:0/3689028917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40abb10 con 0x7f69f4159f90 2023-11-04T01:45:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- 172.21.15.2:0/3689028917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4159f90 msgr2=0x7f69f40cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/3689028917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4159f90 0x7f69f40cdf80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009870 tx=0x7f69e401c440 comp rx=0 tx=0).stop 2023-11-04T01:45:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- 172.21.15.2:0/3689028917 shutdown_connections 2023-11-04T01:45:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/3689028917 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/3689028917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4159f90 0x7f69f40cdf80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- 172.21.15.2:0/3689028917 >> 172.21.15.2:0/3689028917 conn(0x7f69f40ce9e0 msgr2=0x7f69f40cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:40.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- 172.21.15.2:0/3689028917 shutdown_connections 2023-11-04T01:45:40.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.349+0000 7f69f9ba5640 1 -- 172.21.15.2:0/3689028917 wait complete. 2023-11-04T01:45:40.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 Processor -- start 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 -- start start 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40ce4c0 0x7f69f415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4145ce0 0x7f69f40af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f415c5d0 con 0x7f69f4145ce0 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f415c8b0 con 0x7f69f40ce4c0 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f415cb90 con 0x7f69f40b0bf0 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4145ce0 0x7f69f40af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4145ce0 0x7f69f40af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50280/0 (socket says 172.21.15.2:50280) 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 -- 172.21.15.2:0/2993931940 learned_addr learned my addr 172.21.15.2:0/2993931940 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 -- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 msgr2=0x7f69f40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f37fe640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f2ffd640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40ce4c0 0x7f69f415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 -- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40ce4c0 msgr2=0x7f69f415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40ce4c0 0x7f69f415bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 -- 172.21.15.2:0/2993931940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40094d0 con 0x7f69f4145ce0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f3fff640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4145ce0 0x7f69f40af830 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f69ec007e40 tx=0x7f69ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69dbfff640 1 -- 172.21.15.2:0/2993931940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec014620 con 0x7f69f4145ce0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69dbfff640 1 -- 172.21.15.2:0/2993931940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec00ee90 con 0x7f69f4145ce0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f415ce70 con 0x7f69f4145ce0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69dbfff640 1 -- 172.21.15.2:0/2993931940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0149e0 con 0x7f69f4145ce0 2023-11-04T01:45:40.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f415c2a0 con 0x7f69f4145ce0 2023-11-04T01:45:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f4159200 con 0x7f69f4145ce0 2023-11-04T01:45:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.353+0000 7f69dbfff640 1 -- 172.21.15.2:0/2993931940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69ec014b40 con 0x7f69f4145ce0 2023-11-04T01:45:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.357+0000 7f69dbfff640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.357+0000 7f69dbfff640 1 -- 172.21.15.2:0/2993931940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f69ec085a40 con 0x7f69f4145ce0 2023-11-04T01:45:40.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.357+0000 7f69f37fe640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.357+0000 7f69f37fe640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f69e40af000 tx=0x7f69e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:40.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.361+0000 7f69dbfff640 1 -- 172.21.15.2:0/2993931940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69ec052c00 con 0x7f69f4145ce0 2023-11-04T01:45:40.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.565+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f69f40744a0 con 0x7f69f4145ce0 2023-11-04T01:45:40.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.569+0000 7f69dbfff640 1 -- 172.21.15.2:0/2993931940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f69ec056220 con 0x7f69f4145ce0 2023-11-04T01:45:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-04T01:45:40.575 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHoUVldEW+ERAACDKLW9wDSWeW0nf9RoS/jQ== 2023-11-04T01:45:40.575 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-04T01:45:40.575 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-04T01:45:40.575 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-04T01:45:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-04T01:45:40.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 msgr2=0x7f69e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f69e40af000 tx=0x7f69e4008040 comp rx=0 tx=0).stop 2023-11-04T01:45:40.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4145ce0 msgr2=0x7f69f40af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4145ce0 0x7f69f40af830 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f69ec007e40 tx=0x7f69ec00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 shutdown_connections 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f4145ce0 0x7f69f40af830 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40ce4c0 0x7f69f415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 --2- 172.21.15.2:0/2993931940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f40b0bf0 0x7f69f40c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 >> 172.21.15.2:0/2993931940 conn(0x7f69f40ce9e0 msgr2=0x7f69f40cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 shutdown_connections 2023-11-04T01:45:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.573+0000 7f69f9ba5640 1 -- 172.21.15.2:0/2993931940 wait complete. 2023-11-04T01:45:40.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:40.626 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:45:40.619+0000 7f3bac0da640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:45:40.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb9433a640 1 Processor -- start 2023-11-04T01:45:40.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb9433a640 1 -- start start 2023-11-04T01:45:40.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb9433a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c15afd0 0x7feb8c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb9433a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb8c06f8f0 0x7feb8c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb9433a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8c0c2670 con 0x7feb8c0b0b70 2023-11-04T01:45:40.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb9433a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8c070140 con 0x7feb8c06f8f0 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb9433a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c15fc90 con 0x7feb8c15afd0 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb918d5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb8c06f8f0 0x7feb8c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb918d5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feb8c06f8f0 0x7feb8c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50288/0 (socket says 172.21.15.2:50288) 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb918d5640 1 -- 172.21.15.2:0/3069983727 learned_addr learned my addr 172.21.15.2:0/3069983727 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb920d6640 1 --2- 172.21.15.2:0/3069983727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c15afd0 0x7feb8c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb918d5640 1 -- 172.21.15.2:0/3069983727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c15afd0 msgr2=0x7feb8c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb918d5640 1 --2- 172.21.15.2:0/3069983727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c15afd0 0x7feb8c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb918d5640 1 -- 172.21.15.2:0/3069983727 >> v1:172.21.15.90:6789/0 conn(0x7feb8c0b0b70 legacy=0x7feb8c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:40.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.709+0000 7feb918d5640 1 -- 172.21.15.2:0/3069983727 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c06bc30 con 0x7feb8c06f8f0 2023-11-04T01:45:40.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb918d5640 1 --2- 172.21.15.2:0/3069983727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c0b0630 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009870 tx=0x7feb7c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c186ed79fdebe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:40.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb910d4640 1 -- 172.21.15.2:0/3069983727 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0ab600 con 0x7feb8c06f8f0 2023-11-04T01:45:40.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb910d4640 1 -- 172.21.15.2:0/3069983727 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0a7050 con 0x7feb8c06f8f0 2023-11-04T01:45:40.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb910d4640 1 -- 172.21.15.2:0/3069983727 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0ab980 con 0x7feb8c06f8f0 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 -- 172.21.15.2:0/3069983727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 msgr2=0x7feb8c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 --2- 172.21.15.2:0/3069983727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c0b0630 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009870 tx=0x7feb7c01c500 comp rx=0 tx=0).stop 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 -- 172.21.15.2:0/3069983727 shutdown_connections 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 --2- 172.21.15.2:0/3069983727 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c0b0630 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 --2- 172.21.15.2:0/3069983727 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c15afd0 0x7feb8c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 -- 172.21.15.2:0/3069983727 >> 172.21.15.2:0/3069983727 conn(0x7feb8c0cebb0 msgr2=0x7feb8c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 -- 172.21.15.2:0/3069983727 shutdown_connections 2023-11-04T01:45:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.713+0000 7feb9433a640 1 -- 172.21.15.2:0/3069983727 wait complete. 2023-11-04T01:45:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 Processor -- start 2023-11-04T01:45:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 -- start start 2023-11-04T01:45:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c14a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c0b0b70 0x7feb8c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb8c15afd0 0x7feb8c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0c5bf0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c158390 con 0x7feb8c15afd0 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c0b2800 con 0x7feb8c0b0b70 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c14a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c14a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50294/0 (socket says 172.21.15.2:50294) 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 -- 172.21.15.2:0/1850455273 learned_addr learned my addr 172.21.15.2:0/1850455273 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb918d5640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c0b0b70 0x7feb8c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb928d7640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb8c15afd0 0x7feb8c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 -- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c0b0b70 msgr2=0x7feb8c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c0b0b70 0x7feb8c0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 -- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb8c15afd0 msgr2=0x7feb8c0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb8c15afd0 0x7feb8c0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 -- 172.21.15.2:0/1850455273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c0094d0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb918d5640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c0b0b70 0x7feb8c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb920d6640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c14a210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7feb8800d800 tx=0x7feb8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb82ffd640 1 -- 172.21.15.2:0/1850455273 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800b6c0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb82ffd640 1 -- 172.21.15.2:0/1850455273 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8800b820 con 0x7feb8c06f8f0 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb82ffd640 1 -- 172.21.15.2:0/1850455273 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800bb90 con 0x7feb8c06f8f0 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8c0b2ae0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8c14a750 con 0x7feb8c06f8f0 2023-11-04T01:45:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.717+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8c0744a0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.721+0000 7feb82ffd640 1 -- 172.21.15.2:0/1850455273 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb8800bcf0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.721+0000 7feb82ffd640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb700664d0 0x7feb70068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.721+0000 7feb82ffd640 1 -- 172.21.15.2:0/1850455273 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7feb88085300 con 0x7feb8c06f8f0 2023-11-04T01:45:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.721+0000 7feb918d5640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb700664d0 0x7feb70068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:40.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.721+0000 7feb918d5640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb700664d0 0x7feb70068990 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0ad000 tx=0x7feb7c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:40.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.725+0000 7feb82ffd640 1 -- 172.21.15.2:0/1850455273 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feb880523a0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb8c06cba0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb82ffd640 1 -- 172.21.15.2:0/1850455273 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4906 (secure 0 0 0) 0x7feb880559c0 con 0x7feb8c06f8f0 2023-11-04T01:45:40.916 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":45,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7128,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:38.085913+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7137},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:40.916 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 45 2023-11-04T01:45:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb700664d0 msgr2=0x7feb70068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb700664d0 0x7feb70068990 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0ad000 tx=0x7feb7c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:45:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 msgr2=0x7feb8c14a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:40.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c14a210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7feb8800d800 tx=0x7feb8800dcc0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 shutdown_connections 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feb700664d0 0x7feb70068990 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb8c15afd0 0x7feb8c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feb8c0b0b70 0x7feb8c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 --2- 172.21.15.2:0/1850455273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feb8c06f8f0 0x7feb8c14a210 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 >> 172.21.15.2:0/1850455273 conn(0x7feb8c0cebb0 msgr2=0x7feb8c0c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 shutdown_connections 2023-11-04T01:45:40.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:40.913+0000 7feb9433a640 1 -- 172.21.15.2:0/1850455273 wait complete. 2023-11-04T01:45:41.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-04T01:45:35.008340+0000', 'modified': '2023-11-04T01:45:38.085913+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7137}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7137': {'gid': 7137, 'name': 'd', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6837/1345296201', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1345296201}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 1345296201}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:41.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-04T01:45:41.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:45:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa57b444640 1 Processor -- start 2023-11-04T01:45:41.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa57b444640 1 -- start start 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa57b444640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740c9960 0x7fa5740cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa57b444640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa5740b0c70 0x7fa5740ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa57b444640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740ce320 con 0x7fa5740b0890 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa57b444640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57406d2f0 con 0x7fa5740b0c70 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa57b444640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740ce110 con 0x7fa5740c9960 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5799e1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa5740b0c70 0x7fa5740ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5799e1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa5740b0c70 0x7fa5740ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33274/0 (socket says 172.21.15.2:33274) 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5799e1640 1 -- 172.21.15.2:0/3813834645 learned_addr learned my addr 172.21.15.2:0/3813834645 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5789df640 1 --2- 172.21.15.2:0/3813834645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740c9960 0x7fa5740cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5799e1640 1 -- 172.21.15.2:0/3813834645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740c9960 msgr2=0x7fa5740cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5799e1640 1 --2- 172.21.15.2:0/3813834645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740c9960 0x7fa5740cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5799e1640 1 -- 172.21.15.2:0/3813834645 >> v1:172.21.15.90:6789/0 conn(0x7fa5740b0890 legacy=0x7fa5740704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.465+0000 7fa5799e1640 1 -- 172.21.15.2:0/3813834645 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740ce600 con 0x7fa5740b0c70 2023-11-04T01:45:41.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa5799e1640 1 --2- 172.21.15.2:0/3813834645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740b0c70 0x7fa5740ccf90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009870 tx=0x7fa56c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e085f71b742ff73e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa56bfff640 1 -- 172.21.15.2:0/3813834645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0aa5f0 con 0x7fa5740b0c70 2023-11-04T01:45:41.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa56bfff640 1 -- 172.21.15.2:0/3813834645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c0aa750 con 0x7fa5740b0c70 2023-11-04T01:45:41.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa56bfff640 1 -- 172.21.15.2:0/3813834645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0aaae0 con 0x7fa5740b0c70 2023-11-04T01:45:41.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 -- 172.21.15.2:0/3813834645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740b0c70 msgr2=0x7fa5740ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 --2- 172.21.15.2:0/3813834645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740b0c70 0x7fa5740ccf90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009870 tx=0x7fa56c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 -- 172.21.15.2:0/3813834645 shutdown_connections 2023-11-04T01:45:41.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 --2- 172.21.15.2:0/3813834645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740b0c70 0x7fa5740ccf90 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 --2- 172.21.15.2:0/3813834645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740c9960 0x7fa5740cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 -- 172.21.15.2:0/3813834645 >> 172.21.15.2:0/3813834645 conn(0x7fa5740cebb0 msgr2=0x7fa5740cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 -- 172.21.15.2:0/3813834645 shutdown_connections 2023-11-04T01:45:41.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.469+0000 7fa57b444640 1 -- 172.21.15.2:0/3813834645 wait complete. 2023-11-04T01:45:41.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 Processor -- start 2023-11-04T01:45:41.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 -- start start 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5740b0890 0x7fa57415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740b0c70 0x7fa574145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740c9960 0x7fa574158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b17b0 con 0x7fa5740c9960 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b1a90 con 0x7fa5740b0890 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b1d70 con 0x7fa5740b0c70 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740c9960 0x7fa574158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740c9960 0x7fa574158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33288/0 (socket says 172.21.15.2:33288) 2023-11-04T01:45:41.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 -- 172.21.15.2:0/1002851682 learned_addr learned my addr 172.21.15.2:0/1002851682 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5789df640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740b0c70 0x7fa574145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 -- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740b0c70 msgr2=0x7fa574145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740b0c70 0x7fa574145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 -- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5740b0890 msgr2=0x7fa57415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5740b0890 0x7fa57415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 -- 172.21.15.2:0/1002851682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0094d0 con 0x7fa5740c9960 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa5799e1640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740c9960 0x7fa574158ba0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0ac040 tx=0x7fa56c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa569ffb640 1 -- 172.21.15.2:0/1002851682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0b3800 con 0x7fa5740c9960 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa569ffb640 1 -- 172.21.15.2:0/1002851682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c0b3960 con 0x7fa5740c9960 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5740b2050 con 0x7fa5740c9960 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa569ffb640 1 -- 172.21.15.2:0/1002851682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0b3d10 con 0x7fa5740c9960 2023-11-04T01:45:41.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.473+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5741510a0 con 0x7fa5740c9960 2023-11-04T01:45:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa569ffb640 1 -- 172.21.15.2:0/1002851682 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa56c0bd3f0 con 0x7fa5740c9960 2023-11-04T01:45:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa569ffb640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5580664a0 0x7fa558068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa569ffb640 1 -- 172.21.15.2:0/1002851682 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa56c0a7070 con 0x7fa5740c9960 2023-11-04T01:45:41.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5580664a0 0x7fa558068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 Processor -- start 2023-11-04T01:45:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 -- start start 2023-11-04T01:45:41.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5580664a0 0x7fa558068960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa570007fd0 tx=0x7fa570007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0f3e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a0dbc460 con 0x5585a0f3dfa0 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a0d4d690 con 0x5585a0f3e8c0 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585a0d4abc0 con 0x5585a0ef1b40 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0f3e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0f3e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33296/0 (socket says 172.21.15.2:33296) 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 -- 172.21.15.2:0/4269371073 learned_addr learned my addr 172.21.15.2:0/4269371073 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5799e1640 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5789df640 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 -- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 msgr2=0x5585a0ef1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 -- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 msgr2=0x5585a0ef1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 -- 172.21.15.2:0/4269371073 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585a0a3e890 con 0x5585a0f3dfa0 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5789df640 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa5791e0640 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0f3e380 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa570004050 tx=0x7fa57000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66b3327162c8694 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa55effd640 1 -- 172.21.15.2:0/4269371073 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570005520 con 0x5585a0f3dfa0 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa55effd640 1 -- 172.21.15.2:0/4269371073 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa570005680 con 0x5585a0f3dfa0 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.477+0000 7fa55effd640 1 -- 172.21.15.2:0/4269371073 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57001e620 con 0x5585a0f3dfa0 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/4269371073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 msgr2=0x5585a0f3e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0f3e380 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa570004050 tx=0x7fa57000f000 comp rx=0 tx=0).stop 2023-11-04T01:45:41.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/4269371073 shutdown_connections 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- 172.21.15.2:0/4269371073 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0f3e380 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/4269371073 >> 172.21.15.2:0/4269371073 conn(0x5585a0f1ed40 msgr2=0x5585a0f21130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/4269371073 shutdown_connections 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/4269371073 wait complete. 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- start start 2023-11-04T01:45:41.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 Processor -- start 2023-11-04T01:45:41.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a0d464b0 con 0x5585a0f3dfa0 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a0cfeaa0 con 0x5585a0f3e8c0 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585a0d04940 con 0x5585a0ef1b40 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 10 client.0 _ll_register_callbacks cb 0x5585a0edf460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33310/0 (socket says 172.21.15.2:33310) 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 -- 172.21.15.2:0/251375555 learned_addr learned my addr 172.21.15.2:0/251375555 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5791e0640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5799e1640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 -- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 msgr2=0x5585a0ef79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 -- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 msgr2=0x5585a0ef8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 -- 172.21.15.2:0/251375555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa570004b70 con 0x5585a0f3dfa0 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5791e0640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5789df640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef7f20 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa56400de50 tx=0x7fa56400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf9daf91b480c88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa553fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa553fff640 1 -- 172.21.15.2:0/251375555 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564014680 con 0x5585a0f3dfa0 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa553fff640 1 -- 172.21.15.2:0/251375555 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa5640147e0 con 0x5585a0f3dfa0 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585a0d03e10 con 0x5585a0f3dfa0 2023-11-04T01:45:41.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa553fff640 1 -- 172.21.15.2:0/251375555 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5640149a0 con 0x5585a0f3dfa0 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 10 client.7278 fetch_fsmap learned FSMap version 45 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5585a0d071a0 con 0x5585a0f3dfa0 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa553fff640 1 -- 172.21.15.2:0/251375555 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5585a0d03e10 con 0x5585a0f3dfa0 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa553fff640 1 -- 172.21.15.2:0/251375555 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa564014b00 con 0x5585a0f3dfa0 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 10 client.7278 fetch_fsmap finished waiting for FSMap version 45 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 10 client.7278 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 20 client.7278 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0ef8d00 0x5585a0f4f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 4 client.7278 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 --> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585a0d44e00 con 0x5585a0ef8d00 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.481+0000 7fa5791e0640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0ef8d00 0x5585a0f4f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa5791e0640 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0ef8d00 0x5585a0f4f720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d26d69d2d24ca8 server_cookie=523a1c0781254b9c in_seq=0 out_seq=0 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa553fff640 10 client.7278 ms_handle_connect on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa553fff640 1 -- 172.21.15.2:0/251375555 <== mds.0 v2:172.21.15.90:6834/1345296201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585a0d44e00 con 0x5585a0ef8d00 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa553fff640 10 client.7278 handle_command_reply: tid=0 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 client.7278 shutdown 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 msgr2=0x5585a0ef7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef7f20 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa56400de50 tx=0x7fa56400f5b0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 shutdown_connections 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0ef8d00 0x5585a0f4f720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0ef8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef7f20 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa553fff640 0 client.7278 ms_handle_reset on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 --2- 172.21.15.2:0/251375555 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 >> 172.21.15.2:0/251375555 conn(0x5585a0f1ed40 msgr2=0x5585a0f21130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 shutdown_connections 2023-11-04T01:45:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 1 -- 172.21.15.2:0/251375555 wait complete. 2023-11-04T01:45:41.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.485+0000 7fa57e571000 20 client.7278 trim_cache size 0 max 16384 2023-11-04T01:45:41.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 Processor -- start 2023-11-04T01:45:41.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 -- start start 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0f3c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a09ff940 con 0x5585a0f3dfa0 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a0ce1750 con 0x5585a0f3e8c0 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585a0eeba70 con 0x5585a0ef1b40 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33316/0 (socket says 172.21.15.2:33316) 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 -- 172.21.15.2:0/1394266187 learned_addr learned my addr 172.21.15.2:0/1394266187 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:41.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 -- 172.21.15.2:0/1394266187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 msgr2=0x5585a0ef9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 --2- 172.21.15.2:0/1394266187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 -- 172.21.15.2:0/1394266187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 msgr2=0x5585a0f3c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 --2- 172.21.15.2:0/1394266187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0f3c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 -- 172.21.15.2:0/1394266187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585a0ced4a0 con 0x5585a0f3dfa0 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa5789df640 1 --2- 172.21.15.2:0/1394266187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef9d80 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa56400f5f0 tx=0x7fa564014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce699940b3f5b25c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa55f7fe640 1 -- 172.21.15.2:0/1394266187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400f9f0 con 0x5585a0f3dfa0 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa55f7fe640 1 -- 172.21.15.2:0/1394266187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56400c030 con 0x5585a0f3dfa0 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.501+0000 7fa55f7fe640 1 -- 172.21.15.2:0/1394266187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564004270 con 0x5585a0f3dfa0 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1394266187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 msgr2=0x5585a0ef9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- 172.21.15.2:0/1394266187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef9d80 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa56400f5f0 tx=0x7fa564014000 comp rx=0 tx=0).stop 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1394266187 shutdown_connections 2023-11-04T01:45:41.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- 172.21.15.2:0/1394266187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0f3c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- 172.21.15.2:0/1394266187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0f3dfa0 0x5585a0ef9d80 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- 172.21.15.2:0/1394266187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0ef1b40 0x5585a0ef9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1394266187 >> 172.21.15.2:0/1394266187 conn(0x5585a0f1ed40 msgr2=0x5585a0ef9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1394266187 shutdown_connections 2023-11-04T01:45:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1394266187 wait complete. 2023-11-04T01:45:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- start start 2023-11-04T01:45:41.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 Processor -- start 2023-11-04T01:45:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0ef1b40 0x5585a0f50770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0f3dfa0 0x5585a0f50cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0f9b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a0f21360 con 0x5585a0ef1b40 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585a0cc9460 con 0x5585a0f3e8c0 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585a0ef4160 con 0x5585a0f3dfa0 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 10 client.0 _ll_register_callbacks cb 0x7fa570004960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0ef1b40 0x5585a0f50770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0ef1b40 0x5585a0f50770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33320/0 (socket says 172.21.15.2:33320) 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 -- 172.21.15.2:0/1975993162 learned_addr learned my addr 172.21.15.2:0/1975993162 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 -- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0f3dfa0 msgr2=0x5585a0f50cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5789df640 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0f3dfa0 0x5585a0f50cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5799e1640 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0f9b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0f3dfa0 0x5585a0f50cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 -- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 msgr2=0x5585a0f9b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:41.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0f9b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 -- 172.21.15.2:0/1975993162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585a0d071a0 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5791e0640 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0ef1b40 0x5585a0f50770 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c4b0 tx=0x7fa570003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86d6c2fee0133f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa553fff640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa553fff640 1 -- 172.21.15.2:0/1975993162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570033610 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa553fff640 1 -- 172.21.15.2:0/1975993162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa570033770 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585a0d10d10 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa553fff640 1 -- 172.21.15.2:0/1975993162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa570033930 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 10 client.7284 fetch_fsmap learned FSMap version 45 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x5585a0a3ecc0 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa553fff640 1 -- 172.21.15.2:0/1975993162 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5585a0d10d10 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa553fff640 1 -- 172.21.15.2:0/1975993162 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 45) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa570033a90 con 0x5585a0ef1b40 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 10 client.7284 fetch_fsmap finished waiting for FSMap version 45 2023-11-04T01:45:41.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 10 client.7284 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 20 client.7284 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0fa5790 0x5585a0fa7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 4 client.7284 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 --> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5585a0d3f490 con 0x5585a0fa5790 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.505+0000 7fa5789df640 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0fa5790 0x5585a0fa7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa5789df640 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0fa5790 0x5585a0fa7b80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672382907c15614f server_cookie=9704392dd07d77bf in_seq=0 out_seq=0 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa553fff640 10 client.7284 ms_handle_connect on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa553fff640 1 -- 172.21.15.2:0/1975993162 <== mds.0 v2:172.21.15.90:6834/1345296201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5585a0d3f490 con 0x5585a0fa5790 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa553fff640 10 client.7284 handle_command_reply: tid=0 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 client.7284 shutdown 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0ef1b40 msgr2=0x5585a0f50770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0ef1b40 0x5585a0f50770 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa57000c4b0 tx=0x7fa570003b60 comp rx=0 tx=0).stop 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 shutdown_connections 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x5585a0fa5790 0x5585a0fa7b80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5585a0f3e8c0 0x5585a0f9b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5585a0f3dfa0 0x5585a0f50cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 --2- 172.21.15.2:0/1975993162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5585a0ef1b40 0x5585a0f50770 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa553fff640 0 client.7284 ms_handle_reset on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 >> 172.21.15.2:0/1975993162 conn(0x5585a0f1ed40 msgr2=0x5585a0ef9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 shutdown_connections 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 1 -- 172.21.15.2:0/1975993162 wait complete. 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57e571000 20 client.7284 trim_cache size 0 max 16384 2023-11-04T01:45:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7137, 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 5.8143732720000001, 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 45, 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 92, 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 92, 2023-11-04T01:45:41.518 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 11.910355403000001 2023-11-04T01:45:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:45:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5580664a0 msgr2=0x7fa558068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5580664a0 0x7fa558068960 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa570007fd0 tx=0x7fa570007d40 comp rx=0 tx=0).stop 2023-11-04T01:45:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740c9960 msgr2=0x7fa574158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740c9960 0x7fa574158ba0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0ac040 tx=0x7fa56c01ad10 comp rx=0 tx=0).stop 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 shutdown_connections 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5580664a0 0x7fa558068960 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5740c9960 0x7fa574158ba0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa5740b0c70 0x7fa574145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 --2- 172.21.15.2:0/1002851682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5740b0890 0x7fa57415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 >> 172.21.15.2:0/1002851682 conn(0x7fa5740cebb0 msgr2=0x7fa574164340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 shutdown_connections 2023-11-04T01:45:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.509+0000 7fa57b444640 1 -- 172.21.15.2:0/1002851682 wait complete. 2023-11-04T01:45:41.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:45:41.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.641+0000 7fa5482e1640 1 Processor -- start 2023-11-04T01:45:41.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.641+0000 7fa5482e1640 1 -- start start 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa5482e1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa5482e1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54006cfd0 con 0x7fa5400b0d40 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa5482e1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54015e830 con 0x7fa5400ca990 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa5482e1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400ca030 con 0x7fa540159fc0 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54687e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa5400b0d40 0x7fa54015dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50048/0 (socket says 172.21.15.2:50048) 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54687e640 1 -- 172.21.15.2:0/1698734215 learned_addr learned my addr 172.21.15.2:0/1698734215 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54607d640 1 --2- 172.21.15.2:0/1698734215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54507b640 1 -- 172.21.15.2:0/1698734215 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234926608 0 0) 0x7fa54006cfd0 con 0x7fa5400b0d40 2023-11-04T01:45:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54507b640 1 -- 172.21.15.2:0/1698734215 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa52c003530 con 0x7fa5400b0d40 2023-11-04T01:45:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54607d640 1 -- 172.21.15.2:0/1698734215 >> v1:172.21.15.90:6789/0 conn(0x7fa5400ca990 legacy=0x7fa5400b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54507b640 1 -- 172.21.15.2:0/1698734215 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 492887168 0 0) 0x7fa52c003530 con 0x7fa5400b0d40 2023-11-04T01:45:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54607d640 1 -- 172.21.15.2:0/1698734215 >> v1:172.21.15.2:6789/0 conn(0x7fa5400b0d40 legacy=0x7fa54015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54607d640 1 -- 172.21.15.2:0/1698734215 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54015eb10 con 0x7fa540159fc0 2023-11-04T01:45:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54607d640 1 --2- 172.21.15.2:0/1698734215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400ca450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0097f0 tx=0x7fa53c01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac4b9925fd3b74e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54507b640 1 -- 172.21.15.2:0/1698734215 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538001a00 con 0x7fa540159fc0 2023-11-04T01:45:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54507b640 1 -- 172.21.15.2:0/1698734215 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c0a7050 con 0x7fa540159fc0 2023-11-04T01:45:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.645+0000 7fa54507b640 1 -- 172.21.15.2:0/1698734215 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0ab600 con 0x7fa540159fc0 2023-11-04T01:45:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- 172.21.15.2:0/1698734215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 msgr2=0x7fa5400ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 --2- 172.21.15.2:0/1698734215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400ca450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0097f0 tx=0x7fa53c01c3b0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- 172.21.15.2:0/1698734215 shutdown_connections 2023-11-04T01:45:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 --2- 172.21.15.2:0/1698734215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400ca450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- 172.21.15.2:0/1698734215 >> 172.21.15.2:0/1698734215 conn(0x7fa5400cebb0 msgr2=0x7fa5400cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- 172.21.15.2:0/1698734215 shutdown_connections 2023-11-04T01:45:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- 172.21.15.2:0/1698734215 wait complete. 2023-11-04T01:45:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 Processor -- start 2023-11-04T01:45:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- start start 2023-11-04T01:45:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5400b0d40 0x7fa5401656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400ca990 0x7fa540151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401652a0 con 0x7fa5400ca990 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401643d0 con 0x7fa5400b0d40 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa5482e1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa540164620 con 0x7fa540159fc0 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400ca990 0x7fa540151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400ca990 0x7fa540151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33334/0 (socket says 172.21.15.2:33334) 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 -- 172.21.15.2:0/3300990116 learned_addr learned my addr 172.21.15.2:0/3300990116 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54687e640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54607d640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5400b0d40 0x7fa5401656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 -- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 msgr2=0x7fa5400c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 -- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5400b0d40 msgr2=0x7fa5401656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5400b0d40 0x7fa5401656c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 -- 172.21.15.2:0/3300990116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009420 con 0x7fa5400ca990 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54687e640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.649+0000 7fa54587c640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400ca990 0x7fa540151e40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa53000c3c0 tx=0x7fa53000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa536ffd640 1 -- 172.21.15.2:0/3300990116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300052d0 con 0x7fa5400ca990 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa536ffd640 1 -- 172.21.15.2:0/3300990116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530005430 con 0x7fa5400ca990 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa536ffd640 1 -- 172.21.15.2:0/3300990116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530003840 con 0x7fa5400ca990 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa540164900 con 0x7fa5400ca990 2023-11-04T01:45:41.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa540164ec0 con 0x7fa5400ca990 2023-11-04T01:45:41.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5401653e0 con 0x7fa5400ca990 2023-11-04T01:45:41.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa536ffd640 1 -- 172.21.15.2:0/3300990116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5300039a0 con 0x7fa5400ca990 2023-11-04T01:45:41.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa536ffd640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5240664a0 0x7fa524068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa536ffd640 1 -- 172.21.15.2:0/3300990116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fa530083770 con 0x7fa5400ca990 2023-11-04T01:45:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa54607d640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5240664a0 0x7fa524068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:41.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.653+0000 7fa54607d640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5240664a0 0x7fa524068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0ad000 tx=0x7fa53c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:41.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.657+0000 7fa536ffd640 1 -- 172.21.15.2:0/3300990116 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa5401653e0 con 0x7fa5400ca990 2023-11-04T01:45:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.845+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5401653e0 con 0x7fa5400ca990 2023-11-04T01:45:41.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.845+0000 7fa536ffd640 1 -- 172.21.15.2:0/3300990116 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5401653e0 con 0x7fa5400ca990 2023-11-04T01:45:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:45:41.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5240664a0 msgr2=0x7fa524068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5240664a0 0x7fa524068960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0ad000 tx=0x7fa53c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:45:41.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400ca990 msgr2=0x7fa540151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:41.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400ca990 0x7fa540151e40 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa53000c3c0 tx=0x7fa53000c880 comp rx=0 tx=0).stop 2023-11-04T01:45:41.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 shutdown_connections 2023-11-04T01:45:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa5240664a0 0x7fa524068960 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa540159fc0 0x7fa5400c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5400ca990 0x7fa540151e40 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 --2- 172.21.15.2:0/3300990116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5400b0d40 0x7fa5401656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 >> 172.21.15.2:0/3300990116 conn(0x7fa5400cebb0 msgr2=0x7fa540159190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 shutdown_connections 2023-11-04T01:45:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:41.849+0000 7fa5482e1640 1 -- 172.21.15.2:0/3300990116 wait complete. 2023-11-04T01:45:41.869 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:45:41.869 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:45:41.869 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:45:41.870 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:45:41.870 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:41.870 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:45:41.870 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:45:41.870 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:45:41.870 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:41.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:41.870 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:45:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:45:41.876 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:45:41.876 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:45:41.876 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:45:41.877 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42003sec preferred_lft 42003sec 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:45:41.878 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:45:41.879 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:45:41.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:41.880 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:45:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:45:41.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:41.931 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:45:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:45:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:45:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:45:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:45:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:45:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:45:41.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:41.982 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:45:41.982 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:45:41.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:45:41.983 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:45:41.983 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:45:41.983 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:45:42.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:42.059 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:45:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:45:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:45:42.109 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:42.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:42.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:45:42.165 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:45:42.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:45:42.165 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:45:42.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:45:42.213 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:42.259 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:45:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:45:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:45:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:45:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:45:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:42.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:42.313 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:45:42.360 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:45:42.360 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:45:42.404 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:45:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:45:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:45:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:45:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:45:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:45:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:45:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:45:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:45:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:42.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:42.415 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:45:42.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:45:42.489+0000 7fe3d8e55580 -1 init, newargv = 0x55c0273ea9a0 newargc=15 2023-11-04T01:45:42.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[54963]: starting ceph client 2023-11-04T01:45:42.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[54963]: starting fuse 2023-11-04T01:45:43.565 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:45:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:45:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:45:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:45:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:43.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:43.576 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:45:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:45:43.624 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:43.625 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:45:43.626 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:45:43.627 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:45:43.627 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:45:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.54963.asok 2023-11-04T01:45:43.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:43.757 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54963.asok 2023-11-04T01:45:43.757 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:45:43.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.54963.asok status 2023-11-04T01:45:43.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "54963", 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:45:43.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7296, 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 7296 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2023608941 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:45:43.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2023608941 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.7296 192.168.0.1:0/2023608941", 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/2023608941", 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 45, 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 92, 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:45:43.964 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:45:43.965 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:45:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:45:43.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:43.982 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:45:43.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:45:43.982 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:44.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:45:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:45:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:44.044 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:44.044 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:45:44.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:45:44.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:45:44.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:45:44.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config get mds_max_snaps_per_dir 2023-11-04T01:45:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_max_snaps_per_dir":"100"} 2023-11-04T01:45:44.277 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_max_snaps_per_dir": "100" } 2023-11-04T01:45:44.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-11-04T01:45:44.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.405+0000 7f321a88a640 1 Processor -- start 2023-11-04T01:45:44.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.405+0000 7f321a88a640 1 -- start start 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.405+0000 7f321a88a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f32140d19b0 0x7f32140cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.405+0000 7f321a88a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f32140b12e0 0x7f32140cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.405+0000 7f321a88a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32140afb40 con 0x7f321415d3a0 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.405+0000 7f321a88a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140d1ff0 con 0x7f32140d19b0 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.405+0000 7f321a88a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321415d780 con 0x7f32140b12e0 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f3213fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f321415d3a0 0x7f32140d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50062/0 (socket says 172.21.15.2:50062) 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f32137fe640 1 --2- 172.21.15.2:0/754398206 >> v2:172.21.15.2:3300/0 conn(0x7f32140d19b0 0x7f32140cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:44.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f3213fff640 1 -- 172.21.15.2:0/754398206 learned_addr learned my addr 172.21.15.2:0/754398206 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f3218e27640 1 --2- 172.21.15.2:0/754398206 >> v2:172.21.15.90:3300/0 conn(0x7f32140b12e0 0x7f32140cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f3212ffd640 1 -- 172.21.15.2:0/754398206 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295068915 0 0) 0x7f32140afb40 con 0x7f321415d3a0 2023-11-04T01:45:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f32137fe640 1 -- 172.21.15.2:0/754398206 >> v2:172.21.15.90:3300/0 conn(0x7f32140b12e0 msgr2=0x7f32140cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f32137fe640 1 --2- 172.21.15.2:0/754398206 >> v2:172.21.15.90:3300/0 conn(0x7f32140b12e0 0x7f32140cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:44.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f32137fe640 1 -- 172.21.15.2:0/754398206 >> v1:172.21.15.2:6789/0 conn(0x7f321415d3a0 legacy=0x7f32140d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:44.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f32137fe640 1 -- 172.21.15.2:0/754398206 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140d3ce0 con 0x7f32140d19b0 2023-11-04T01:45:44.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f32137fe640 1 --2- 172.21.15.2:0/754398206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f32140cda80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f321406a7a0 tx=0x7f320801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36ac71160bfbe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:44.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f3212ffd640 1 -- 172.21.15.2:0/754398206 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080ac640 con 0x7f32140d19b0 2023-11-04T01:45:44.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f3212ffd640 1 -- 172.21.15.2:0/754398206 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32080ac7a0 con 0x7f32140d19b0 2023-11-04T01:45:44.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f3212ffd640 1 -- 172.21.15.2:0/754398206 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080acb30 con 0x7f32140d19b0 2023-11-04T01:45:44.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f321a88a640 1 -- 172.21.15.2:0/754398206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 msgr2=0x7f32140cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:44.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.409+0000 7f321a88a640 1 --2- 172.21.15.2:0/754398206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f32140cda80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f321406a7a0 tx=0x7f320801c310 comp rx=0 tx=0).stop 2023-11-04T01:45:44.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- 172.21.15.2:0/754398206 shutdown_connections 2023-11-04T01:45:44.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 --2- 172.21.15.2:0/754398206 >> v2:172.21.15.90:3300/0 conn(0x7f32140b12e0 0x7f32140cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:44.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 --2- 172.21.15.2:0/754398206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f32140cda80 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:44.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- 172.21.15.2:0/754398206 >> 172.21.15.2:0/754398206 conn(0x7f32140d2e70 msgr2=0x7f32140d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:44.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- 172.21.15.2:0/754398206 shutdown_connections 2023-11-04T01:45:44.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- 172.21.15.2:0/754398206 wait complete. 2023-11-04T01:45:44.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 Processor -- start 2023-11-04T01:45:44.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- start start 2023-11-04T01:45:44.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32140b12e0 0x7f3214159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:44.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f3214158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:44.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f321415d3a0 0x7f321415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:44.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141599e0 con 0x7f32140d19b0 2023-11-04T01:45:44.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141607c0 con 0x7f32140b12e0 2023-11-04T01:45:44.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3214159040 con 0x7f321415d3a0 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f3214158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f3214158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33360/0 (socket says 172.21.15.2:33360) 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 -- 172.21.15.2:0/2044258046 learned_addr learned my addr 172.21.15.2:0/2044258046 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f3213fff640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32140b12e0 0x7f3214159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f3218e27640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f321415d3a0 0x7f321415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 -- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f321415d3a0 msgr2=0x7f321415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f321415d3a0 0x7f321415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 -- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32140b12e0 msgr2=0x7f3214159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32140b12e0 0x7f3214159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 -- 172.21.15.2:0/2044258046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208009420 con 0x7f32140d19b0 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f3213fff640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32140b12e0 0x7f3214159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f3218e27640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f321415d3a0 0x7f321415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:44.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f32137fe640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f3214158700 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f32080af040 tx=0x7f32080190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f3210ff9640 1 -- 172.21.15.2:0/2044258046 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080b5610 con 0x7f32140d19b0 2023-11-04T01:45:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f3210ff9640 1 -- 172.21.15.2:0/2044258046 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32080b5770 con 0x7f32140d19b0 2023-11-04T01:45:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3214159320 con 0x7f32140d19b0 2023-11-04T01:45:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f3210ff9640 1 -- 172.21.15.2:0/2044258046 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080b5b00 con 0x7f32140d19b0 2023-11-04T01:45:44.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.413+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3214158c40 con 0x7f32140d19b0 2023-11-04T01:45:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.417+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32140744a0 con 0x7f32140d19b0 2023-11-04T01:45:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.417+0000 7f3210ff9640 1 -- 172.21.15.2:0/2044258046 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f32080b3040 con 0x7f32140d19b0 2023-11-04T01:45:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.417+0000 7f3210ff9640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32000664d0 0x7f3200068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.417+0000 7f3210ff9640 1 -- 172.21.15.2:0/2044258046 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f320811e5e0 con 0x7f32140d19b0 2023-11-04T01:45:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.417+0000 7f3213fff640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32000664d0 0x7f3200068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:44.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.417+0000 7f3213fff640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32000664d0 0x7f3200068990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3204000f70 tx=0x7f3204009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:44.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.421+0000 7f3210ff9640 1 -- 172.21.15.2:0/2044258046 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f32080eb6c0 con 0x7f32140d19b0 2023-11-04T01:45:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:44.613+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3214159180 con 0x7f32140d19b0 2023-11-04T01:45:45.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.565+0000 7f3210ff9640 1 -- 172.21.15.2:0/2044258046 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v46) v1 ==== 167+0+0 (secure 0 0 0) 0x7f3214159180 con 0x7f32140d19b0 2023-11-04T01:45:45.571 INFO:teuthology.orchestra.run.smithi002.stderr:enabled new snapshots 2023-11-04T01:45:45.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32000664d0 msgr2=0x7f3200068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32000664d0 0x7f3200068990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3204000f70 tx=0x7f3204009040 comp rx=0 tx=0).stop 2023-11-04T01:45:45.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 msgr2=0x7f3214158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f3214158700 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f32080af040 tx=0x7f32080190b0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 shutdown_connections 2023-11-04T01:45:45.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32000664d0 0x7f3200068990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f321415d3a0 0x7f321415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32140d19b0 0x7f3214158700 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 --2- 172.21.15.2:0/2044258046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32140b12e0 0x7f3214159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 >> 172.21.15.2:0/2044258046 conn(0x7f32140d2e70 msgr2=0x7f321415e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:45.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 shutdown_connections 2023-11-04T01:45:45.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.569+0000 7f321a88a640 1 -- 172.21.15.2:0/2044258046 wait complete. 2023-11-04T01:45:45.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0fc95640 1 Processor -- start 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0fc95640 1 -- start start 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0fc95640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea080b32f0 0x7fea080cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0fc95640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fea080cf4c0 0x7fea080d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0fc95640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080cd830 con 0x7fea0815af50 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0fc95640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080b3780 con 0x7fea080b32f0 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0fc95640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080cdad0 con 0x7fea080cf4c0 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0d230640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea080b32f0 0x7fea080cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0da31640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fea0815af50 0x7fea080ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50074/0 (socket says 172.21.15.2:50074) 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0da31640 1 -- 172.21.15.2:0/3398006185 learned_addr learned my addr 172.21.15.2:0/3398006185 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0d230640 1 -- 172.21.15.2:0/3398006185 >> v2:172.21.15.90:3300/0 conn(0x7fea080cf4c0 msgr2=0x7fea080d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0e232640 1 --2- 172.21.15.2:0/3398006185 >> v2:172.21.15.90:3300/0 conn(0x7fea080cf4c0 0x7fea080d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0d230640 1 --2- 172.21.15.2:0/3398006185 >> v2:172.21.15.90:3300/0 conn(0x7fea080cf4c0 0x7fea080d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0ca2f640 1 -- 172.21.15.2:0/3398006185 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163121153 0 0) 0x7fea080cd830 con 0x7fea0815af50 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0d230640 1 -- 172.21.15.2:0/3398006185 >> v1:172.21.15.2:6789/0 conn(0x7fea0815af50 legacy=0x7fea080ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0d230640 1 -- 172.21.15.2:0/3398006185 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080cddb0 con 0x7fea080b32f0 2023-11-04T01:45:45.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.729+0000 7fea0e232640 1 --2- 172.21.15.2:0/3398006185 >> v2:172.21.15.90:3300/0 conn(0x7fea080cf4c0 0x7fea080d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:45.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0d230640 1 --2- 172.21.15.2:0/3398006185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080b32f0 0x7fea080cb330 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fea08066a00 tx=0x7fe9f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3918c4d82e18fff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:45.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0ca2f640 1 -- 172.21.15.2:0/3398006185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80ab5f0 con 0x7fea080b32f0 2023-11-04T01:45:45.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0ca2f640 1 -- 172.21.15.2:0/3398006185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80ab750 con 0x7fea080b32f0 2023-11-04T01:45:45.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0ca2f640 1 -- 172.21.15.2:0/3398006185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80abae0 con 0x7fea080b32f0 2023-11-04T01:45:45.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- 172.21.15.2:0/3398006185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080b32f0 msgr2=0x7fea080cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 --2- 172.21.15.2:0/3398006185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080b32f0 0x7fea080cb330 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fea08066a00 tx=0x7fe9f801c3d0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- 172.21.15.2:0/3398006185 shutdown_connections 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 --2- 172.21.15.2:0/3398006185 >> v2:172.21.15.90:3300/0 conn(0x7fea080cf4c0 0x7fea080d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 --2- 172.21.15.2:0/3398006185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080b32f0 0x7fea080cb330 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- 172.21.15.2:0/3398006185 >> 172.21.15.2:0/3398006185 conn(0x7fea08065dc0 msgr2=0x7fea080661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- 172.21.15.2:0/3398006185 shutdown_connections 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- 172.21.15.2:0/3398006185 wait complete. 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 Processor -- start 2023-11-04T01:45:45.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- start start 2023-11-04T01:45:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080cf4c0 0x7fea0815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea0815af50 0x7fea08163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0815d9f0 0x7fea08164450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080b1050 con 0x7fea080cf4c0 2023-11-04T01:45:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080b12a0 con 0x7fea0815af50 2023-11-04T01:45:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0815c9d0 con 0x7fea0815d9f0 2023-11-04T01:45:45.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080cf4c0 0x7fea0815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080cf4c0 0x7fea0815d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33378/0 (socket says 172.21.15.2:33378) 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 -- 172.21.15.2:0/1493168977 learned_addr learned my addr 172.21.15.2:0/1493168977 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 -- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0815d9f0 msgr2=0x7fea08164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0815d9f0 0x7fea08164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 -- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea0815af50 msgr2=0x7fea08163f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0d230640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea0815af50 0x7fea08163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea0815af50 0x7fea08163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 -- 172.21.15.2:0/1493168977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009420 con 0x7fea080cf4c0 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0da31640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080cf4c0 0x7fea0815d4b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fea0400c430 tx=0x7fea0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fe9fe7fc640 1 -- 172.21.15.2:0/1493168977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040074e0 con 0x7fea080cf4c0 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fe9fe7fc640 1 -- 172.21.15.2:0/1493168977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea04007640 con 0x7fea080cf4c0 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0815ccb0 con 0x7fea080cf4c0 2023-11-04T01:45:45.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fe9fe7fc640 1 -- 172.21.15.2:0/1493168977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040059d0 con 0x7fea080cf4c0 2023-11-04T01:45:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.733+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea080b1be0 con 0x7fea080cf4c0 2023-11-04T01:45:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.737+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0815c830 con 0x7fea080cf4c0 2023-11-04T01:45:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.737+0000 7fe9fe7fc640 1 -- 172.21.15.2:0/1493168977 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fea04005b30 con 0x7fea080cf4c0 2023-11-04T01:45:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.737+0000 7fe9fe7fc640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9ec0664a0 0x7fe9ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:45.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.737+0000 7fe9fe7fc640 1 -- 172.21.15.2:0/1493168977 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fea04083860 con 0x7fea080cf4c0 2023-11-04T01:45:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.737+0000 7fea0d230640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9ec0664a0 0x7fe9ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:45.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.737+0000 7fea0d230640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9ec0664a0 0x7fe9ec068960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80af000 tx=0x7fe9f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:45.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.741+0000 7fe9fe7fc640 1 -- 172.21.15.2:0/1493168977 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea0815c830 con 0x7fea080cf4c0 2023-11-04T01:45:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:45.941+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fea0815c830 con 0x7fea080cf4c0 2023-11-04T01:45:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.805+0000 7fe9fe7fc640 1 -- 172.21.15.2:0/1493168977 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v47) v1 ==== 105+0+0 (secure 0 0 0) 0x7fea0815c830 con 0x7fea080cf4c0 2023-11-04T01:45:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9ec0664a0 msgr2=0x7fe9ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9ec0664a0 0x7fe9ec068960 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80af000 tx=0x7fe9f8008040 comp rx=0 tx=0).stop 2023-11-04T01:45:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080cf4c0 msgr2=0x7fea0815d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080cf4c0 0x7fea0815d4b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fea0400c430 tx=0x7fea0400c8f0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 shutdown_connections 2023-11-04T01:45:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9ec0664a0 0x7fe9ec068960 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0815d9f0 0x7fea08164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea0815af50 0x7fea08163f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 --2- 172.21.15.2:0/1493168977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea080cf4c0 0x7fea0815d4b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 >> 172.21.15.2:0/1493168977 conn(0x7fea08065dc0 msgr2=0x7fea080cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 shutdown_connections 2023-11-04T01:45:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.809+0000 7fea0fc95640 1 -- 172.21.15.2:0/1493168977 wait complete. 2023-11-04T01:45:46.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5daf7a640 1 Processor -- start 2023-11-04T01:45:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5daf7a640 1 -- start start 2023-11-04T01:45:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5daf7a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff5d415b090 0x7ff5d415f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5daf7a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5d406a870 0x7ff5d40b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5daf7a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40cbe40 con 0x7ff5d415b470 2023-11-04T01:45:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5daf7a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d415fca0 con 0x7ff5d406a870 2023-11-04T01:45:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5daf7a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d40cc120 con 0x7ff5d415b090 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d9517640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5d406a870 0x7ff5d40b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d9517640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5d406a870 0x7ff5d40b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33384/0 (socket says 172.21.15.2:33384) 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d9517640 1 -- 172.21.15.2:0/2300728286 learned_addr learned my addr 172.21.15.2:0/2300728286 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d8d16640 1 --2- 172.21.15.2:0/2300728286 >> v2:172.21.15.90:3300/0 conn(0x7ff5d415b090 0x7ff5d415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d9517640 1 -- 172.21.15.2:0/2300728286 >> v2:172.21.15.90:3300/0 conn(0x7ff5d415b090 msgr2=0x7ff5d415f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d9517640 1 --2- 172.21.15.2:0/2300728286 >> v2:172.21.15.90:3300/0 conn(0x7ff5d415b090 0x7ff5d415f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d9517640 1 -- 172.21.15.2:0/2300728286 >> v1:172.21.15.90:6789/0 conn(0x7ff5d415b470 legacy=0x7ff5d406a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.957+0000 7ff5d9517640 1 -- 172.21.15.2:0/2300728286 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40cc400 con 0x7ff5d406a870 2023-11-04T01:45:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5d9517640 1 --2- 172.21.15.2:0/2300728286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d406a870 0x7ff5d40b4160 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4072760 tx=0x7ff5c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5845ea3f4b159600 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5d37fe640 1 -- 172.21.15.2:0/2300728286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40aa430 con 0x7ff5d406a870 2023-11-04T01:45:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5d37fe640 1 -- 172.21.15.2:0/2300728286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c40aa590 con 0x7ff5d406a870 2023-11-04T01:45:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5d37fe640 1 -- 172.21.15.2:0/2300728286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40aa920 con 0x7ff5d406a870 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 -- 172.21.15.2:0/2300728286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d406a870 msgr2=0x7ff5d40b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/2300728286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d406a870 0x7ff5d40b4160 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4072760 tx=0x7ff5c401c4d0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 -- 172.21.15.2:0/2300728286 shutdown_connections 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/2300728286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d406a870 0x7ff5d40b4160 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/2300728286 >> v2:172.21.15.90:3300/0 conn(0x7ff5d415b090 0x7ff5d415f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 -- 172.21.15.2:0/2300728286 >> 172.21.15.2:0/2300728286 conn(0x7ff5d40716a0 msgr2=0x7ff5d4071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 -- 172.21.15.2:0/2300728286 shutdown_connections 2023-11-04T01:45:46.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.961+0000 7ff5daf7a640 1 -- 172.21.15.2:0/2300728286 wait complete. 2023-11-04T01:45:46.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 Processor -- start 2023-11-04T01:45:46.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 -- start start 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d406a870 0x7ff5d4155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d415b090 0x7ff5d40cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d415b470 0x7ff5d40ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c44a0 con 0x7ff5d415b090 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40ceb20 con 0x7ff5d406a870 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40cefb0 con 0x7ff5d415b470 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d415b090 0x7ff5d40cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d415b090 0x7ff5d40cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33392/0 (socket says 172.21.15.2:33392) 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 -- 172.21.15.2:0/1201389529 learned_addr learned my addr 172.21.15.2:0/1201389529 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d8d16640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d406a870 0x7ff5d4155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d9517640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d415b470 0x7ff5d40ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 -- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d415b470 msgr2=0x7ff5d40ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d415b470 0x7ff5d40ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 -- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d406a870 msgr2=0x7ff5d4155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d406a870 0x7ff5d4155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 -- 172.21.15.2:0/1201389529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40094d0 con 0x7ff5d415b090 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d9517640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d415b470 0x7ff5d40ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d3fff640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d415b090 0x7ff5d40cd490 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00c500 tx=0x7ff5bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d17fa640 1 -- 172.21.15.2:0/1201389529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc005220 con 0x7ff5d415b090 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d17fa640 1 -- 172.21.15.2:0/1201389529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc005380 con 0x7ff5d415b090 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d4155f50 con 0x7ff5d415b090 2023-11-04T01:45:46.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d17fa640 1 -- 172.21.15.2:0/1201389529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc007270 con 0x7ff5d415b090 2023-11-04T01:45:46.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40ce1f0 con 0x7ff5d415b090 2023-11-04T01:45:46.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d40675f0 con 0x7ff5d415b090 2023-11-04T01:45:46.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d17fa640 1 -- 172.21.15.2:0/1201389529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5bc0073d0 con 0x7ff5d415b090 2023-11-04T01:45:46.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.965+0000 7ff5d17fa640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:46.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.969+0000 7ff5d17fa640 1 -- 172.21.15.2:0/1201389529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7ff5bc083c10 con 0x7ff5d415b090 2023-11-04T01:45:46.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.969+0000 7ff5d8d16640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:46.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.969+0000 7ff5d8d16640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5b80664a0 0x7ff5b8068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0074a0 tx=0x7ff5cc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:46.973+0000 7ff5d17fa640 1 -- 172.21.15.2:0/1201389529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff5bc050c70 con 0x7ff5d415b090 2023-11-04T01:45:47.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.161+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d4072400 con 0x7ff5d415b090 2023-11-04T01:45:47.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5d17fa640 1 -- 172.21.15.2:0/1201389529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4922 (secure 0 0 0) 0x7ff5bc054290 con 0x7ff5d415b090 2023-11-04T01:45:47.167 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:47.167 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:46.814168+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:creating","state_seq":1,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:47.167 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 48 2023-11-04T01:45:47.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5b80664a0 msgr2=0x7ff5b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:47.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5b80664a0 0x7ff5b8068960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0074a0 tx=0x7ff5cc00b040 comp rx=0 tx=0).stop 2023-11-04T01:45:47.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d415b090 msgr2=0x7ff5d40cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:47.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d415b090 0x7ff5d40cd490 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00c500 tx=0x7ff5bc00c9c0 comp rx=0 tx=0).stop 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 shutdown_connections 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff5d415b470 0x7ff5d40ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5d415b090 0x7ff5d40cd490 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 --2- 172.21.15.2:0/1201389529 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5d406a870 0x7ff5d4155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 >> 172.21.15.2:0/1201389529 conn(0x7ff5d40716a0 msgr2=0x7ff5d41574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 shutdown_connections 2023-11-04T01:45:47.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:47.165+0000 7ff5daf7a640 1 -- 172.21.15.2:0/1201389529 wait complete. 2023-11-04T01:45:47.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:45:35.008340+0000', 'modified': '2023-11-04T01:45:46.814168+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7137, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 48, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.2:6835/3725992406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 3725992406}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3725992406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7137': {'gid': 7137, 'name': 'd', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6837/1345296201', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1345296201}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 1345296201}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:47.588 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7128:up:creating 2023-11-04T01:45:48.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:48.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7483885640 1 Processor -- start 2023-11-04T01:45:48.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7483885640 1 -- start start 2023-11-04T01:45:48.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7483885640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f747c0b0890 0x7f747c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7483885640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0c70 0x7f747c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7483885640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0ce320 con 0x7f747c0c9960 2023-11-04T01:45:48.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7483885640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f747c06d2f0 con 0x7f747c0b0890 2023-11-04T01:45:48.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7483885640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0ce110 con 0x7f747c0b0c70 2023-11-04T01:45:48.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481e22640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0c70 0x7f747c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481621640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f747c0b0890 0x7f747c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481e22640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0c70 0x7f747c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:46376/0 (socket says 172.21.15.2:46376) 2023-11-04T01:45:48.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481e22640 1 -- 172.21.15.2:0/4125024972 learned_addr learned my addr 172.21.15.2:0/4125024972 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:48.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481e22640 1 -- 172.21.15.2:0/4125024972 >> v2:172.21.15.90:3300/0 conn(0x7f747c0b0890 msgr2=0x7f747c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:48.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481e22640 1 --2- 172.21.15.2:0/4125024972 >> v2:172.21.15.90:3300/0 conn(0x7f747c0b0890 0x7f747c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481e22640 1 -- 172.21.15.2:0/4125024972 >> v1:172.21.15.90:6789/0 conn(0x7f747c0c9960 legacy=0x7f747c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.721+0000 7f7481e22640 1 -- 172.21.15.2:0/4125024972 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0ce600 con 0x7f747c0b0c70 2023-11-04T01:45:48.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7481e22640 1 --2- 172.21.15.2:0/4125024972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0c70 0x7f747c0ccf90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7474009e50 tx=0x7f747401ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8249fd858620ea47 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7473fff640 1 -- 172.21.15.2:0/4125024972 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740a7ac0 con 0x7f747c0b0c70 2023-11-04T01:45:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7473fff640 1 -- 172.21.15.2:0/4125024972 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74740a7c20 con 0x7f747c0b0c70 2023-11-04T01:45:48.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7473fff640 1 -- 172.21.15.2:0/4125024972 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740af3f0 con 0x7f747c0b0c70 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- 172.21.15.2:0/4125024972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0c70 msgr2=0x7f747c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 --2- 172.21.15.2:0/4125024972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0c70 0x7f747c0ccf90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7474009e50 tx=0x7f747401ebf0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- 172.21.15.2:0/4125024972 shutdown_connections 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 --2- 172.21.15.2:0/4125024972 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0c70 0x7f747c0ccf90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 --2- 172.21.15.2:0/4125024972 >> v2:172.21.15.90:3300/0 conn(0x7f747c0b0890 0x7f747c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- 172.21.15.2:0/4125024972 >> 172.21.15.2:0/4125024972 conn(0x7f747c0cebb0 msgr2=0x7f747c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- 172.21.15.2:0/4125024972 shutdown_connections 2023-11-04T01:45:48.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- 172.21.15.2:0/4125024972 wait complete. 2023-11-04T01:45:48.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 Processor -- start 2023-11-04T01:45:48.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- start start 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0890 0x7f747c155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747c0b0c70 0x7f747c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f747c0c9960 0x7f747c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c13bef0 con 0x7f747c0c9960 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c13c1d0 con 0x7f747c0b0c70 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7483885640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c13c4b0 con 0x7f747c0b0890 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7481e22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f747c0c9960 0x7f747c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7481e22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f747c0c9960 0x7f747c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33396/0 (socket says 172.21.15.2:33396) 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.725+0000 7f7481e22640 1 -- 172.21.15.2:0/3643287793 learned_addr learned my addr 172.21.15.2:0/3643287793 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481621640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0890 0x7f747c155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7480e20640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747c0b0c70 0x7f747c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481e22640 1 -- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0890 msgr2=0x7f747c155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481e22640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0890 0x7f747c155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481e22640 1 -- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747c0b0c70 msgr2=0x7f747c0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481e22640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747c0b0c70 0x7f747c0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481e22640 1 -- 172.21.15.2:0/3643287793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009b30 con 0x7f747c0c9960 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481e22640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f747c0c9960 0x7f747c06c300 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f747401c820 tx=0x7f747401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7471ffb640 1 -- 172.21.15.2:0/3643287793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740a7ac0 con 0x7f747c0c9960 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7471ffb640 1 -- 172.21.15.2:0/3643287793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474009510 con 0x7f747c0c9960 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c13c790 con 0x7f747c0c9960 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7471ffb640 1 -- 172.21.15.2:0/3643287793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474007000 con 0x7f747c0c9960 2023-11-04T01:45:48.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c0b22d0 con 0x7f747c0c9960 2023-11-04T01:45:48.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0744a0 con 0x7f747c0c9960 2023-11-04T01:45:48.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7471ffb640 1 -- 172.21.15.2:0/3643287793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74740ba470 con 0x7f747c0c9960 2023-11-04T01:45:48.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7471ffb640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74600664d0 0x7f7460068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:48.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7471ffb640 1 -- 172.21.15.2:0/3643287793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f7474121990 con 0x7f747c0c9960 2023-11-04T01:45:48.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481621640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74600664d0 0x7f7460068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:48.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.729+0000 7f7481621640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74600664d0 0x7f7460068990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f746c009af0 tx=0x7f746c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:48.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.733+0000 7f7471ffb640 1 -- 172.21.15.2:0/3643287793 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74740ee9f0 con 0x7f747c0c9960 2023-11-04T01:45:48.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.925+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f747c0b4b30 con 0x7f747c0c9960 2023-11-04T01:45:48.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.925+0000 7f7471ffb640 1 -- 172.21.15.2:0/3643287793 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f74740f2010 con 0x7f747c0c9960 2023-11-04T01:45:48.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:48.930 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:46.836951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:48.931 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 49 2023-11-04T01:45:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74600664d0 msgr2=0x7f7460068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74600664d0 0x7f7460068990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f746c009af0 tx=0x7f746c008040 comp rx=0 tx=0).stop 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f747c0c9960 msgr2=0x7f747c06c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f747c0c9960 0x7f747c06c300 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f747401c820 tx=0x7f747401b990 comp rx=0 tx=0).stop 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 shutdown_connections 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f74600664d0 0x7f7460068990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f747c0c9960 0x7f747c06c300 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f747c0b0c70 0x7f747c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 --2- 172.21.15.2:0/3643287793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f747c0b0890 0x7f747c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 >> 172.21.15.2:0/3643287793 conn(0x7f747c0cebb0 msgr2=0x7f747c0b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 shutdown_connections 2023-11-04T01:45:48.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:48.929+0000 7f7483885640 1 -- 172.21.15.2:0/3643287793 wait complete. 2023-11-04T01:45:49.351 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:45:35.008340+0000', 'modified': '2023-11-04T01:45:46.836951+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7137, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 48, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.2:6835/3725992406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 3725992406}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3725992406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7137': {'gid': 7137, 'name': 'd', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6837/1345296201', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1345296201}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 1345296201}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:45:49.351 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:45:49.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:45:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc93bf0f640 1 Processor -- start 2023-11-04T01:45:49.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc93bf0f640 1 -- start start 2023-11-04T01:45:49.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc93bf0f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 0x7fc9340704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc93bf0f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9340ccee0 con 0x7fc9340cdea0 2023-11-04T01:45:49.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc93bf0f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93415a5d0 con 0x7fc93415a1f0 2023-11-04T01:45:49.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc93bf0f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340ca900 con 0x7fc9340b0d40 2023-11-04T01:45:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc9394aa640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc9340cdea0 0x7fc9340b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50080/0 (socket says 172.21.15.2:50080) 2023-11-04T01:45:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc9394aa640 1 -- 172.21.15.2:0/1525095845 learned_addr learned my addr 172.21.15.2:0/1525095845 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:49.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 0x7fc9340704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960026247 0 0) 0x7fc9340ccee0 con 0x7fc9340cdea0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.481+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc91c003530 con 0x7fc9340cdea0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60467211 0 0) 0x7fc93415a5d0 con 0x7fc93415a1f0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9340ccee0 con 0x7fc93415a1f0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866689089 0 0) 0x7fc91c003530 con 0x7fc9340cdea0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 msgr2=0x7fc9340704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 0x7fc9340704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 >> v1:172.21.15.90:6789/0 conn(0x7fc93415a1f0 legacy=0x7fc9340cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9340cabe0 con 0x7fc9340cdea0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc928001a00 con 0x7fc9340cdea0 2023-11-04T01:45:49.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 >> v1:172.21.15.2:6789/0 conn(0x7fc9340cdea0 legacy=0x7fc9340b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 0x7fc91c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c0040a0 0x7fc91c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc91c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340ca900 con 0x7fc91c004d10 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c00ba70 con 0x7fc91c0040a0 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c00bc30 con 0x7fc9340b0d40 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc91c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc939cab640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 0x7fc91c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc9394aa640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c0040a0 0x7fc91c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 msgr2=0x7fc91c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9340b0d40 0x7fc91c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c0040a0 msgr2=0x7fc91c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc91c0040a0 0x7fc91c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1525095845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c003530 con 0x7fc91c004d10 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc91c005190 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc924009ab0 tx=0x7fc92401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b88f6410bd0684 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240a5620 con 0x7fc91c004d10 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9240a5780 con 0x7fc91c004d10 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc938ca9640 1 -- 172.21.15.2:0/1525095845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240a5b30 con 0x7fc91c004d10 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93bf0f640 1 -- 172.21.15.2:0/1525095845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 msgr2=0x7fc91c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93bf0f640 1 --2- 172.21.15.2:0/1525095845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc91c005190 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fc924009ab0 tx=0x7fc92401ca30 comp rx=0 tx=0).stop 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1525095845 reap_dead start 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93bf0f640 1 -- 172.21.15.2:0/1525095845 shutdown_connections 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93bf0f640 1 -- 172.21.15.2:0/1525095845 >> 172.21.15.2:0/1525095845 conn(0x7fc9340cebb0 msgr2=0x7fc9340cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93bf0f640 1 -- 172.21.15.2:0/1525095845 shutdown_connections 2023-11-04T01:45:49.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.485+0000 7fc93bf0f640 1 -- 172.21.15.2:0/1525095845 wait complete. 2023-11-04T01:45:49.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 Processor -- start 2023-11-04T01:45:49.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 -- start start 2023-11-04T01:45:49.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc9341552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9341e5880 0x7fc9341e2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9340704e0 0x7fc934070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9341e3f10 con 0x7fc91c004d10 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc934155800 con 0x7fc9340704e0 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc934070ea0 con 0x7fc9341e5880 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc9341552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc9341552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33408/0 (socket says 172.21.15.2:33408) 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 -- 172.21.15.2:0/108005984 learned_addr learned my addr 172.21.15.2:0/108005984 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc9394aa640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9341e5880 0x7fc9341e2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9340704e0 0x7fc934070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 -- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9341e5880 msgr2=0x7fc9341e2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9341e5880 0x7fc9341e2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 -- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9340704e0 msgr2=0x7fc934070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9340704e0 0x7fc934070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 -- 172.21.15.2:0/108005984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9341e3290 con 0x7fc91c004d10 2023-11-04T01:45:49.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc939cab640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc9341552c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00e7e0 tx=0x7fc92c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc9327fc640 1 -- 172.21.15.2:0/108005984 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00ee90 con 0x7fc91c004d10 2023-11-04T01:45:49.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc9327fc640 1 -- 172.21.15.2:0/108005984 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c0052e0 con 0x7fc91c004d10 2023-11-04T01:45:49.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9341e3570 con 0x7fc91c004d10 2023-11-04T01:45:49.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc9327fc640 1 -- 172.21.15.2:0/108005984 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00c660 con 0x7fc91c004d10 2023-11-04T01:45:49.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.489+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9341e3b30 con 0x7fc91c004d10 2023-11-04T01:45:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc9327fc640 1 -- 172.21.15.2:0/108005984 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc92c00c7c0 con 0x7fc91c004d10 2023-11-04T01:45:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc9327fc640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9200664d0 0x7fc920068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc9327fc640 1 -- 172.21.15.2:0/108005984 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc92c083de0 con 0x7fc91c004d10 2023-11-04T01:45:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc9394aa640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9200664d0 0x7fc920068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 Processor -- start 2023-11-04T01:45:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc9394aa640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9200664d0 0x7fc920068990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc93406cdb0 tx=0x7fc928009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 -- start start 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965cfa0 0x5629a965d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a965d8c0 0x5629a9610600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a9610b40 0x5629a9610f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a94db460 con 0x5629a965cfa0 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a946c690 con 0x5629a965d8c0 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629a9469bc0 con 0x5629a9610b40 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965cfa0 0x5629a965d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965cfa0 0x5629a965d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33414/0 (socket says 172.21.15.2:33414) 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 -- 172.21.15.2:0/1287616649 learned_addr learned my addr 172.21.15.2:0/1287616649 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a9610b40 0x5629a9610f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc9394aa640 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a965d8c0 0x5629a9610600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 -- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a9610b40 msgr2=0x5629a9610f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a9610b40 0x5629a9610f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 -- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a965d8c0 msgr2=0x5629a9610600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a965d8c0 0x5629a9610600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 -- 172.21.15.2:0/1287616649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a915d890 con 0x5629a965cfa0 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc9394aa640 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a965d8c0 0x5629a9610600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc939cab640 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965cfa0 0x5629a965d380 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0050a0 tx=0x7fc92c054c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11146a62628b483 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc91b7fe640 1 -- 172.21.15.2:0/1287616649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c052fd0 con 0x5629a965cfa0 2023-11-04T01:45:49.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc91b7fe640 1 -- 172.21.15.2:0/1287616649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c07be90 con 0x5629a965cfa0 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.493+0000 7fc91b7fe640 1 -- 172.21.15.2:0/1287616649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c05c9f0 con 0x5629a965cfa0 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1287616649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965cfa0 msgr2=0x5629a965d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965cfa0 0x5629a965d380 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0050a0 tx=0x7fc92c054c30 comp rx=0 tx=0).stop 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1287616649 shutdown_connections 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a9610b40 0x5629a9610f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a965d8c0 0x5629a9610600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1287616649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965cfa0 0x5629a965d380 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1287616649 >> 172.21.15.2:0/1287616649 conn(0x5629a963dd40 msgr2=0x5629a9640130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1287616649 shutdown_connections 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1287616649 wait complete. 2023-11-04T01:45:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- start start 2023-11-04T01:45:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 Processor -- start 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a9610b40 0x5629a96190c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a9615ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965d8c0 0x5629a9616020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a94654b0 con 0x5629a965d8c0 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a941daa0 con 0x5629a9610b40 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629a9423940 con 0x5629a965cfa0 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 10 client.0 _ll_register_callbacks cb 0x5629a95fe460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965d8c0 0x5629a9616020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965d8c0 0x5629a9616020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33430/0 (socket says 172.21.15.2:33430) 2023-11-04T01:45:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1282593581 learned_addr learned my addr 172.21.15.2:0/1282593581 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc939cab640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a9610b40 0x5629a96190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc9394aa640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a9615ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 msgr2=0x5629a9615ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a9615ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a9610b40 msgr2=0x5629a96190c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a9610b40 0x5629a96190c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 -- 172.21.15.2:0/1282593581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9341e3b30 con 0x5629a965d8c0 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc9394aa640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a9615ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965d8c0 0x5629a9616020 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc924009ab0 tx=0x7fc9240197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af75401437b182f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc918ff9640 1 -- 172.21.15.2:0/1282593581 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9240bf070 con 0x5629a965d8c0 2023-11-04T01:45:49.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629a9422e10 con 0x5629a965d8c0 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc918ff9640 1 -- 172.21.15.2:0/1282593581 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc924004440 con 0x5629a965d8c0 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc918ff9640 1 -- 172.21.15.2:0/1282593581 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9240a5620 con 0x5629a965d8c0 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 10 client.7335 fetch_fsmap learned FSMap version 49 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5629a94261a0 con 0x5629a965d8c0 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc918ff9640 1 -- 172.21.15.2:0/1282593581 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629a9422e10 con 0x5629a965d8c0 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc918ff9640 1 -- 172.21.15.2:0/1282593581 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 49) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fc9240c2030 con 0x5629a965d8c0 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 10 client.7335 fetch_fsmap finished waiting for FSMap version 49 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 10 client.7335 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 20 client.7335 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a9616d90 0x5629a966e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 4 client.7335 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629a9463e00 con 0x5629a9616d90 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc939cab640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a9616d90 0x5629a966e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc939cab640 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a9616d90 0x5629a966e250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=393ecb5c2e37dc42 server_cookie=179444252fbb3d2e in_seq=0 out_seq=0 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.497+0000 7fc918ff9640 10 client.7335 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc918ff9640 1 -- 172.21.15.2:0/1282593581 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629a9463e00 con 0x5629a9616d90 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc918ff9640 10 client.7335 handle_command_reply: tid=0 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 client.7335 shutdown 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965d8c0 msgr2=0x5629a9616020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965d8c0 0x5629a9616020 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc924009ab0 tx=0x7fc9240197d0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 shutdown_connections 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a9616d90 0x5629a966e250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a965d8c0 0x5629a9616020 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a9615ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 --2- 172.21.15.2:0/1282593581 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a9610b40 0x5629a96190c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc918ff9640 0 client.7335 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:45:49.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 >> 172.21.15.2:0/1282593581 conn(0x5629a963dd40 msgr2=0x5629a9640130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 shutdown_connections 2023-11-04T01:45:49.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 1 -- 172.21.15.2:0/1282593581 wait complete. 2023-11-04T01:45:49.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.501+0000 7fc93f03c000 20 client.7335 trim_cache size 0 max 16384 2023-11-04T01:45:49.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 Processor -- start 2023-11-04T01:45:49.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- start start 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9615a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a9615f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a965b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a911e940 con 0x5629a9610b40 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a96107d0 con 0x5629a963dd40 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629a9464340 con 0x5629a965cfa0 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a9615f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a9615f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33436/0 (socket says 172.21.15.2:33436) 2023-11-04T01:45:49.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 -- 172.21.15.2:0/3597782160 learned_addr learned my addr 172.21.15.2:0/3597782160 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a965b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc939cab640 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9615a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 -- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 msgr2=0x5629a965b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a965b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 -- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 msgr2=0x5629a9615a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9615a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 -- 172.21.15.2:0/3597782160 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629a940c4a0 con 0x5629a9610b40 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc9394aa640 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a9615f70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc928013bd0 tx=0x7fc928016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb1be51ffc5bb42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc91bfff640 1 -- 172.21.15.2:0/3597782160 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92801b040 con 0x5629a9610b40 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc91bfff640 1 -- 172.21.15.2:0/3597782160 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc928016a70 con 0x5629a9610b40 2023-11-04T01:45:49.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc91bfff640 1 -- 172.21.15.2:0/3597782160 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc928016de0 con 0x5629a9610b40 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- 172.21.15.2:0/3597782160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 msgr2=0x5629a9615f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a9615f70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc928013bd0 tx=0x7fc928016000 comp rx=0 tx=0).stop 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- 172.21.15.2:0/3597782160 shutdown_connections 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a965b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a9615f70 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 --2- 172.21.15.2:0/3597782160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9615a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- 172.21.15.2:0/3597782160 >> 172.21.15.2:0/3597782160 conn(0x5629a96132a0 msgr2=0x5629a9615320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- 172.21.15.2:0/3597782160 shutdown_connections 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- 172.21.15.2:0/3597782160 wait complete. 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 -- start start 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.517+0000 7fc93f03c000 1 Processor -- start 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a966f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9679ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a967a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a9400750 con 0x5629a9610b40 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629a9468010 con 0x5629a963dd40 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629a946f7d0 con 0x5629a965cfa0 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 10 client.0 _ll_register_callbacks cb 0x7fc92c050f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:49.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a966f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a966f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33438/0 (socket says 172.21.15.2:33438) 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 -- 172.21.15.2:0/321048827 learned_addr learned my addr 172.21.15.2:0/321048827 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc9394aa640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9679ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a967a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 -- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 msgr2=0x5629a967a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a967a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 -- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 msgr2=0x5629a9679ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9679ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 -- 172.21.15.2:0/321048827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92800f030 con 0x5629a9610b40 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc9394aa640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9679ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93a4ac640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a967a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:49.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc939cab640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a966f690 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fc92c081fc0 tx=0x7fc92c0012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf42fb44900ef11 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 1 -- 172.21.15.2:0/321048827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c05c9f0 con 0x5629a9610b40 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 1 -- 172.21.15.2:0/321048827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fc92c05cb50 con 0x5629a9610b40 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629a942fd10 con 0x5629a9610b40 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 1 -- 172.21.15.2:0/321048827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc92c06c1c0 con 0x5629a9610b40 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 10 client.7341 fetch_fsmap learned FSMap version 49 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5629a915dcc0 con 0x5629a9610b40 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 1 -- 172.21.15.2:0/321048827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629a942fd10 con 0x5629a9610b40 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 1 -- 172.21.15.2:0/321048827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 49) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fc92c06c320 con 0x5629a9610b40 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 10 client.7341 fetch_fsmap finished waiting for FSMap version 49 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 10 client.7341 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:45:49.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 20 client.7341 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a965d8c0 0x5629a96bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 4 client.7341 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5629a945e490 con 0x5629a965d8c0 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc9394aa640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a965d8c0 0x5629a96bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 10 client.7341 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc9394aa640 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a965d8c0 0x5629a96bd940 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b88fb4f4e3313d9 server_cookie=a372551e409da984 in_seq=0 out_seq=0 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 1 -- 172.21.15.2:0/321048827 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5629a945e490 con 0x5629a965d8c0 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 10 client.7341 handle_command_reply: tid=0 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 client.7341 shutdown 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 msgr2=0x5629a966f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a966f690 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fc92c081fc0 tx=0x7fc92c0012e0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 shutdown_connections 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x5629a965d8c0 0x5629a96bd940 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5629a965cfa0 0x5629a967a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5629a963dd40 0x5629a9679ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc918ff9640 0 client.7341 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 --2- 172.21.15.2:0/321048827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5629a9610b40 0x5629a966f690 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 >> 172.21.15.2:0/321048827 conn(0x5629a96132a0 msgr2=0x5629a9617170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 shutdown_connections 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 1 -- 172.21.15.2:0/321048827 wait complete. 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93f03c000 20 client.7341 trim_cache size 0 max 16384 2023-11-04T01:45:49.532 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7128, 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 2.7082143400000001, 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 49, 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 92, 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 92, 2023-11-04T01:45:49.533 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 19.935176257999998 2023-11-04T01:45:49.534 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:45:49.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9200664d0 msgr2=0x7fc920068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9200664d0 0x7fc920068990 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc93406cdb0 tx=0x7fc928009040 comp rx=0 tx=0).stop 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 msgr2=0x7fc9341552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc9341552c0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00e7e0 tx=0x7fc92c00eca0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 shutdown_connections 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc9200664d0 0x7fc920068990 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9340704e0 0x7fc934070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc9341e5880 0x7fc9341e2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 --2- 172.21.15.2:0/108005984 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc91c004d10 0x7fc9341552c0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 >> 172.21.15.2:0/108005984 conn(0x7fc9340cebb0 msgr2=0x7fc9341594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 shutdown_connections 2023-11-04T01:45:49.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.521+0000 7fc93bf0f640 1 -- 172.21.15.2:0/108005984 wait complete. 2023-11-04T01:45:49.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:45:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f0410741640 1 Processor -- start 2023-11-04T01:45:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f0410741640 1 -- start start 2023-11-04T01:45:49.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f0410741640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f0410741640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f040806cd30 0x7f04080ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f0410741640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0408070d90 con 0x7f04080caf10 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f0410741640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040806dd90 con 0x7f040806cd30 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f0410741640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04080cefe0 con 0x7f0408159e70 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040dcdc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f040806cd30 0x7f04080ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040dcdc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f040806cd30 0x7f04080ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33448/0 (socket says 172.21.15.2:33448) 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040dcdc640 1 -- 172.21.15.2:0/3253079487 learned_addr learned my addr 172.21.15.2:0/3253079487 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040e4dd640 1 --2- 172.21.15.2:0/3253079487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040dcdc640 1 -- 172.21.15.2:0/3253079487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 msgr2=0x7f04080ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040dcdc640 1 --2- 172.21.15.2:0/3253079487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040dcdc640 1 -- 172.21.15.2:0/3253079487 >> v1:172.21.15.90:6789/0 conn(0x7f04080caf10 legacy=0x7f04080b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.657+0000 7f040dcdc640 1 -- 172.21.15.2:0/3253079487 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040806d4f0 con 0x7f040806cd30 2023-11-04T01:45:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f040dcdc640 1 --2- 172.21.15.2:0/3253079487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806cd30 0x7f04080ca9d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f03f800bb10 tx=0x7f03f801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d735a6c0a9f0f52 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f040d4db640 1 -- 172.21.15.2:0/3253079487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80a7cb0 con 0x7f040806cd30 2023-11-04T01:45:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f040d4db640 1 -- 172.21.15.2:0/3253079487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f80a7e10 con 0x7f040806cd30 2023-11-04T01:45:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f040d4db640 1 -- 172.21.15.2:0/3253079487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80af660 con 0x7f040806cd30 2023-11-04T01:45:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 -- 172.21.15.2:0/3253079487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806cd30 msgr2=0x7f04080ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 --2- 172.21.15.2:0/3253079487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806cd30 0x7f04080ca9d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f03f800bb10 tx=0x7f03f801ebe0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 -- 172.21.15.2:0/3253079487 shutdown_connections 2023-11-04T01:45:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 --2- 172.21.15.2:0/3253079487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f040806cd30 0x7f04080ca9d0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 --2- 172.21.15.2:0/3253079487 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 -- 172.21.15.2:0/3253079487 >> 172.21.15.2:0/3253079487 conn(0x7f040806e760 msgr2=0x7f040806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 -- 172.21.15.2:0/3253079487 shutdown_connections 2023-11-04T01:45:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 -- 172.21.15.2:0/3253079487 wait complete. 2023-11-04T01:45:49.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 Processor -- start 2023-11-04T01:45:49.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.661+0000 7f0410741640 1 -- start start 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f040806cd30 0x7f0408156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080caf10 0x7f04080b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04080b2970 con 0x7f04080caf10 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04080b2c50 con 0x7f040806cd30 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04080b2f30 con 0x7f0408159e70 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080caf10 0x7f04080b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080caf10 0x7f04080b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33462/0 (socket says 172.21.15.2:33462) 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 -- 172.21.15.2:0/788247775 learned_addr learned my addr 172.21.15.2:0/788247775 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040e4dd640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f040806cd30 0x7f0408156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040ecde640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 -- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 msgr2=0x7f04080a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080a9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 -- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f040806cd30 msgr2=0x7f0408156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f040806cd30 0x7f0408156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 -- 172.21.15.2:0/788247775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f800b770 con 0x7f04080caf10 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040dcdc640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080caf10 0x7f04080b3a10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f03f800b2c0 tx=0x7f03f801b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f03feffd640 1 -- 172.21.15.2:0/788247775 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80afe60 con 0x7f04080caf10 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f03feffd640 1 -- 172.21.15.2:0/788247775 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f80ba440 con 0x7f04080caf10 2023-11-04T01:45:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04080b3210 con 0x7f04080caf10 2023-11-04T01:45:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f03feffd640 1 -- 172.21.15.2:0/788247775 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80ba7f0 con 0x7f04080caf10 2023-11-04T01:45:49.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0408156a50 con 0x7f04080caf10 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f03feffd640 1 -- 172.21.15.2:0/788247775 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03f80b93e0 con 0x7f04080caf10 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f03feffd640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f03ec0664a0 0x7f03ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f03feffd640 1 -- 172.21.15.2:0/788247775 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f03f811ed00 con 0x7f04080caf10 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.665+0000 7f040e4dd640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f03ec0664a0 0x7f03ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 Processor -- start 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- start start 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f03ec0664a0 0x7f03ec068960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0408164330 tx=0x7f0404008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd759380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd70c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd5d7460 con 0x55f5fd758fa0 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd568690 con 0x55f5fd7598c0 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd565bc0 con 0x55f5fd70cb40 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd759380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd759380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33470/0 (socket says 172.21.15.2:33470) 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 -- 172.21.15.2:0/556915312 learned_addr learned my addr 172.21.15.2:0/556915312 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040ecde640 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040dcdc640 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd70c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 -- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 msgr2=0x55f5fd70cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 -- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 msgr2=0x55f5fd70c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd70c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 -- 172.21.15.2:0/556915312 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5fd259890 con 0x55f5fd758fa0 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040ecde640 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040dcdc640 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd70c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f040e4dd640 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd759380 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f040400fa50 tx=0x7f0404012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692d7c58adc8ef36 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f03ebfff640 1 -- 172.21.15.2:0/556915312 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404014be0 con 0x55f5fd758fa0 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f03ebfff640 1 -- 172.21.15.2:0/556915312 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0404019070 con 0x55f5fd758fa0 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f03ebfff640 1 -- 172.21.15.2:0/556915312 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404020440 con 0x55f5fd758fa0 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- 172.21.15.2:0/556915312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 msgr2=0x55f5fd759380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd759380 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f040400fa50 tx=0x7f0404012000 comp rx=0 tx=0).stop 2023-11-04T01:45:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- 172.21.15.2:0/556915312 shutdown_connections 2023-11-04T01:45:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd70c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 --2- 172.21.15.2:0/556915312 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd759380 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- 172.21.15.2:0/556915312 >> 172.21.15.2:0/556915312 conn(0x55f5fd739d40 msgr2=0x55f5fd73c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- 172.21.15.2:0/556915312 shutdown_connections 2023-11-04T01:45:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- 172.21.15.2:0/556915312 wait complete. 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 -- start start 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.669+0000 7f041386e000 1 Processor -- start 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd70cb40 0x55f5fd7129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd758fa0 0x55f5fd712f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd713460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd5614b0 con 0x55f5fd70cb40 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd519aa0 con 0x55f5fd7598c0 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd51f940 con 0x55f5fd758fa0 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 10 client.0 _ll_register_callbacks cb 0x55f5fd6fa460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd70cb40 0x55f5fd7129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd70cb40 0x55f5fd7129e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33478/0 (socket says 172.21.15.2:33478) 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 -- 172.21.15.2:0/4206189379 learned_addr learned my addr 172.21.15.2:0/4206189379 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040dcdc640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd758fa0 0x55f5fd712f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040ecde640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd713460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 -- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd758fa0 msgr2=0x55f5fd712f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd758fa0 0x55f5fd712f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 -- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 msgr2=0x55f5fd713460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd713460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 -- 172.21.15.2:0/4206189379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040400e040 con 0x55f5fd70cb40 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040ecde640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd713460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040e4dd640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd70cb40 0x55f5fd7129e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f040400f5b0 tx=0x7f0404004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c983a2ea9c94ac2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f03e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f03e97fa640 1 -- 172.21.15.2:0/4206189379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404020b80 con 0x55f5fd70cb40 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f03e97fa640 1 -- 172.21.15.2:0/4206189379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f0404020ce0 con 0x55f5fd70cb40 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5fd51ee10 con 0x55f5fd70cb40 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f03e97fa640 1 -- 172.21.15.2:0/4206189379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0404020ea0 con 0x55f5fd70cb40 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 10 client.7353 fetch_fsmap learned FSMap version 49 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55f5fd5221a0 con 0x55f5fd70cb40 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f03e97fa640 1 -- 172.21.15.2:0/4206189379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f5fd51ee10 con 0x55f5fd70cb40 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f03e97fa640 1 -- 172.21.15.2:0/4206189379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 49) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f04040059a0 con 0x55f5fd70cb40 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 10 client.7353 fetch_fsmap finished waiting for FSMap version 49 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 10 client.7353 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 20 client.7353 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd713d00 0x55f5fd76a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 4 client.7353 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:45:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 --> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5fd55fe00 con 0x55f5fd713d00 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040dcdc640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd713d00 0x55f5fd76a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f040dcdc640 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd713d00 0x55f5fd76a720 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62dfc3ed15f2d8e server_cookie=97054e34de9020c6 in_seq=0 out_seq=0 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.673+0000 7f03e97fa640 10 client.7353 ms_handle_connect on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f03e97fa640 1 -- 172.21.15.2:0/4206189379 <== mds.0 v2:172.21.15.90:6834/1345296201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f5fd55fe00 con 0x55f5fd713d00 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f03e97fa640 10 client.7353 handle_command_reply: tid=0 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 client.7353 shutdown 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd70cb40 msgr2=0x55f5fd7129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd70cb40 0x55f5fd7129e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f040400f5b0 tx=0x7f0404004740 comp rx=0 tx=0).stop 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 shutdown_connections 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd713d00 0x55f5fd76a720 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd713460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd758fa0 0x55f5fd712f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f03e97fa640 0 client.7353 ms_handle_reset on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:49.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 --2- 172.21.15.2:0/4206189379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd70cb40 0x55f5fd7129e0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 >> 172.21.15.2:0/4206189379 conn(0x55f5fd739d40 msgr2=0x55f5fd73c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 shutdown_connections 2023-11-04T01:45:49.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 1 -- 172.21.15.2:0/4206189379 wait complete. 2023-11-04T01:45:49.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.677+0000 7f041386e000 20 client.7353 trim_cache size 0 max 16384 2023-11-04T01:45:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 Processor -- start 2023-11-04T01:45:49.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- start start 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd70b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd757050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd21a940 con 0x55f5fd758fa0 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd55e8b0 con 0x55f5fd7598c0 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd4fc750 con 0x55f5fd70cb40 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd70b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd70b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33488/0 (socket says 172.21.15.2:33488) 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 -- 172.21.15.2:0/3432842592 learned_addr learned my addr 172.21.15.2:0/3432842592 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040ecde640 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd757050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 -- 172.21.15.2:0/3432842592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 msgr2=0x55f5fd70b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 -- 172.21.15.2:0/3432842592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 msgr2=0x55f5fd757050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd757050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 -- 172.21.15.2:0/3432842592 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5fd5084a0 con 0x55f5fd758fa0 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd70b9b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000c10 tx=0x7f03f811ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f1b1d123dfae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f03fcff9640 1 -- 172.21.15.2:0/3432842592 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80f3b50 con 0x55f5fd758fa0 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f03fcff9640 1 -- 172.21.15.2:0/3432842592 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f80f7d00 con 0x55f5fd758fa0 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f03fcff9640 1 -- 172.21.15.2:0/3432842592 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80edda0 con 0x55f5fd758fa0 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- 172.21.15.2:0/3432842592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 msgr2=0x55f5fd70b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd70b9b0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000c10 tx=0x7f03f811ccc0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- 172.21.15.2:0/3432842592 shutdown_connections 2023-11-04T01:45:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd7598c0 0x55f5fd757050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd70b9b0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- 172.21.15.2:0/3432842592 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd70cb40 0x55f5fd70b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- 172.21.15.2:0/3432842592 >> 172.21.15.2:0/3432842592 conn(0x55f5fd739d40 msgr2=0x55f5fd70ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- 172.21.15.2:0/3432842592 shutdown_connections 2023-11-04T01:45:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- 172.21.15.2:0/3432842592 wait complete. 2023-11-04T01:45:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- start start 2023-11-04T01:45:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 Processor -- start 2023-11-04T01:45:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd70cb40 0x55f5fd76bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd7761b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd7598c0 0x55f5fd7766f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd7124b0 con 0x55f5fd758fa0 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd25a1b0 con 0x55f5fd70cb40 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5fd5a1830 con 0x55f5fd7598c0 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f041386e000 10 client.0 _ll_register_callbacks cb 0x7f040400b200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.693+0000 7f040dcdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd7761b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd7761b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33498/0 (socket says 172.21.15.2:33498) 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 -- 172.21.15.2:0/1467392421 learned_addr learned my addr 172.21.15.2:0/1467392421 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040e4dd640 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd70cb40 0x55f5fd76bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040ecde640 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd7598c0 0x55f5fd7766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 -- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd7598c0 msgr2=0x55f5fd7766f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd7598c0 0x55f5fd7766f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 -- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd70cb40 msgr2=0x55f5fd76bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd70cb40 0x55f5fd76bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 -- 172.21.15.2:0/1467392421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0408156a50 con 0x55f5fd758fa0 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040dcdc640 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd7761b0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f03f80251d0 tx=0x7f0404014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22d45e52bdd2726 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 1 -- 172.21.15.2:0/1467392421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f80ec110 con 0x55f5fd758fa0 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 1 -- 172.21.15.2:0/1467392421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f03f80ec270 con 0x55f5fd758fa0 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5fd52bd10 con 0x55f5fd758fa0 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 1 -- 172.21.15.2:0/1467392421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03f80eeef0 con 0x55f5fd758fa0 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 10 client.7359 fetch_fsmap learned FSMap version 49 2023-11-04T01:45:49.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55f5fd259cc0 con 0x55f5fd758fa0 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 1 -- 172.21.15.2:0/1467392421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8111080 con 0x55f5fd758fa0 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 1 -- 172.21.15.2:0/1467392421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 49) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f03f810dbd0 con 0x55f5fd758fa0 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 10 client.7359 fetch_fsmap finished waiting for FSMap version 49 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 10 client.7359 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 20 client.7359 populate_metadata read hostname 'smithi002' 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd7b9940 0x55f5fd7b9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 4 client.7359 mds_command: new command op to 7137 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 --> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f5fd55a490 con 0x55f5fd7b9940 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040e4dd640 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd7b9940 0x55f5fd7b9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 10 client.7359 ms_handle_connect on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f040e4dd640 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd7b9940 0x55f5fd7b9d20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48fa38e52373760 server_cookie=a08d740fcb4a2cdb in_seq=0 out_seq=0 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 1 -- 172.21.15.2:0/1467392421 <== mds.0 v2:172.21.15.90:6834/1345296201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55f5fd55a490 con 0x55f5fd7b9940 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 10 client.7359 handle_command_reply: tid=0 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 client.7359 shutdown 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 msgr2=0x55f5fd7761b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd7761b0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f03f80251d0 tx=0x7f0404014000 comp rx=0 tx=0).stop 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 shutdown_connections 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:6834/1345296201,v1:172.21.15.90:6837/1345296201] conn(0x55f5fd7b9940 0x55f5fd7b9d20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f5fd7598c0 0x55f5fd7766f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f5fd758fa0 0x55f5fd7761b0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f03e97fa640 0 client.7359 ms_handle_reset on v2:172.21.15.90:6834/1345296201 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 --2- 172.21.15.2:0/1467392421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f5fd70cb40 0x55f5fd76bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 >> 172.21.15.2:0/1467392421 conn(0x55f5fd739d40 msgr2=0x55f5fd70b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 shutdown_connections 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 1 -- 172.21.15.2:0/1467392421 wait complete. 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f041386e000 20 client.7359 trim_cache size 0 max 16384 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7137, 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:45:49.708 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:45:49.709 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:45:49.709 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 14.004478443, 2023-11-04T01:45:49.709 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 49, 2023-11-04T01:45:49.709 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 92, 2023-11-04T01:45:49.709 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 92, 2023-11-04T01:45:49.709 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 20.100464317 2023-11-04T01:45:49.709 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:45:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f03ec0664a0 msgr2=0x7f03ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f03ec0664a0 0x7f03ec068960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0408164330 tx=0x7f0404008040 comp rx=0 tx=0).stop 2023-11-04T01:45:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080caf10 msgr2=0x7f04080b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080caf10 0x7f04080b3a10 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f03f800b2c0 tx=0x7f03f801b980 comp rx=0 tx=0).stop 2023-11-04T01:45:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 shutdown_connections 2023-11-04T01:45:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f03ec0664a0 0x7f03ec068960 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0408159e70 0x7f04080a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04080caf10 0x7f04080b3a10 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 --2- 172.21.15.2:0/788247775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f040806cd30 0x7f0408156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 >> 172.21.15.2:0/788247775 conn(0x7f040806e760 msgr2=0x7f040806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 shutdown_connections 2023-11-04T01:45:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.697+0000 7f0410741640 1 -- 172.21.15.2:0/788247775 wait complete. 2023-11-04T01:45:49.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:49.719 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/dir) 2023-11-04T01:45:49.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:45:49.737 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1) 2023-11-04T01:45:49.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8c006fd640 1 Processor -- start 2023-11-04T01:45:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8c006fd640 1 -- start start 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8c006fd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8bf80cdea0 0x7f8bf80b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8c006fd640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80ccee0 con 0x7f8bf815a1f0 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8c006fd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf815a5d0 con 0x7f8bf80ca400 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8c006fd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80ca900 con 0x7f8bf80cdea0 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8bfe499640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8bf815a1f0 0x7f8bf80cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50084/0 (socket says 172.21.15.2:50084) 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8bfe499640 1 -- 172.21.15.2:0/2081676133 learned_addr learned my addr 172.21.15.2:0/2081676133 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495086352 0 0) 0x7f8bf80ccee0 con 0x7f8bf815a1f0 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8bfdc98640 1 --2- 172.21.15.2:0/2081676133 >> v2:172.21.15.90:3300/0 conn(0x7f8bf80cdea0 0x7f8bf80b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.973+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be0003530 con 0x7f8bf815a1f0 2023-11-04T01:45:49.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649161288 0 0) 0x7f8be0003530 con 0x7f8bf815a1f0 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 >> v2:172.21.15.90:3300/0 conn(0x7f8bf80cdea0 msgr2=0x7f8bf80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 --2- 172.21.15.2:0/2081676133 >> v2:172.21.15.90:3300/0 conn(0x7f8bf80cdea0 0x7f8bf80b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 >> v1:172.21.15.90:6789/0 conn(0x7f8bf80ca400 legacy=0x7f8bf80704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80cabe0 con 0x7f8bf815a1f0 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f8bf0001a00 con 0x7f8bf815a1f0 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 >> v1:172.21.15.2:6789/0 conn(0x7f8bf815a1f0 legacy=0x7f8bf80cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8be0003980 0x7f8be0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be00047d0 0x7f8be0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be0005190 0x7f8be000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80ca900 con 0x7f8be00047d0 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be000c030 con 0x7f8be0003980 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be000c1f0 con 0x7f8be0005190 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfdc98640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be00047d0 0x7f8be0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfe499640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8be0003980 0x7f8be0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfec9a640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be0005190 0x7f8be000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfdc98640 1 -- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be0005190 msgr2=0x7f8be000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfdc98640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be0005190 0x7f8be000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfdc98640 1 -- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8be0003980 msgr2=0x7f8be0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfdc98640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8be0003980 0x7f8be0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfdc98640 1 -- 172.21.15.2:0/2081676133 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be0003530 con 0x7f8be00047d0 2023-11-04T01:45:49.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfec9a640 1 -- 172.21.15.2:0/2081676133 reap_dead start 2023-11-04T01:45:49.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfe499640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8be0003980 0x7f8be0003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:45:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfdc98640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be00047d0 0x7f8be0004c50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009ab0 tx=0x7f8bec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3a8257c59f81a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0a5510 con 0x7f8be00047d0 2023-11-04T01:45:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec0a5670 con 0x7f8be00047d0 2023-11-04T01:45:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8bfd497640 1 -- 172.21.15.2:0/2081676133 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0a5a20 con 0x7f8be00047d0 2023-11-04T01:45:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8c006fd640 1 -- 172.21.15.2:0/2081676133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be00047d0 msgr2=0x7f8be0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8c006fd640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be00047d0 0x7f8be0004c50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009ab0 tx=0x7f8bec01ca30 comp rx=0 tx=0).stop 2023-11-04T01:45:49.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8c006fd640 1 -- 172.21.15.2:0/2081676133 shutdown_connections 2023-11-04T01:45:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8c006fd640 1 --2- 172.21.15.2:0/2081676133 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8be00047d0 0x7f8be0004c50 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8c006fd640 1 -- 172.21.15.2:0/2081676133 >> 172.21.15.2:0/2081676133 conn(0x7f8bf80cebb0 msgr2=0x7f8bf80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.977+0000 7f8c006fd640 1 -- 172.21.15.2:0/2081676133 shutdown_connections 2023-11-04T01:45:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 -- 172.21.15.2:0/2081676133 wait complete. 2023-11-04T01:45:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 Processor -- start 2023-11-04T01:45:49.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 -- start start 2023-11-04T01:45:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be00047d0 0x7f8bf8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bf81e52f0 0x7f8bf81e5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf80c7c00 0x7f8bf80c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80c5a90 con 0x7f8bf80c7c00 2023-11-04T01:45:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80c85c0 con 0x7f8bf81e52f0 2023-11-04T01:45:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81e3da0 con 0x7f8be00047d0 2023-11-04T01:45:49.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf80c7c00 0x7f8bf80c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf80c7c00 0x7f8bf80c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33516/0 (socket says 172.21.15.2:33516) 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 -- 172.21.15.2:0/1342440613 learned_addr learned my addr 172.21.15.2:0/1342440613 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfe499640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be00047d0 0x7f8bf8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfdc98640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bf81e52f0 0x7f8bf81e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 -- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be00047d0 msgr2=0x7f8bf8158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be00047d0 0x7f8bf8158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 -- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bf81e52f0 msgr2=0x7f8bf81e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bf81e52f0 0x7f8bf81e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 -- 172.21.15.2:0/1342440613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf81e4080 con 0x7f8bf80c7c00 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bfec9a640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf80c7c00 0x7f8bf80c8080 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f8bf806dae0 tx=0x7f8be800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bf6ffd640 1 -- 172.21.15.2:0/1342440613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8007ea0 con 0x7f8bf80c7c00 2023-11-04T01:45:49.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bf6ffd640 1 -- 172.21.15.2:0/1342440613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be80052e0 con 0x7f8bf80c7c00 2023-11-04T01:45:49.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf81e4360 con 0x7f8bf80c7c00 2023-11-04T01:45:49.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8bf6ffd640 1 -- 172.21.15.2:0/1342440613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8003600 con 0x7f8bf80c7c00 2023-11-04T01:45:49.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.981+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf81e4920 con 0x7f8bf80c7c00 2023-11-04T01:45:49.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.985+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf80744a0 con 0x7f8bf80c7c00 2023-11-04T01:45:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.985+0000 7f8bf6ffd640 1 -- 172.21.15.2:0/1342440613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8be8003760 con 0x7f8bf80c7c00 2023-11-04T01:45:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.985+0000 7f8bf6ffd640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8be40664a0 0x7f8be4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.985+0000 7f8bf6ffd640 1 -- 172.21.15.2:0/1342440613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f8be80838e0 con 0x7f8bf80c7c00 2023-11-04T01:45:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.985+0000 7f8bfe499640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8be40664a0 0x7f8be4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:49.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.985+0000 7f8bfe499640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8be40664a0 0x7f8be4068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0001340 tx=0x7f8bf0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:49.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:49.989+0000 7f8bf6ffd640 1 -- 172.21.15.2:0/1342440613 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8be80508b0 con 0x7f8bf80c7c00 2023-11-04T01:45:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.177+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bf806cfb0 con 0x7f8bf80c7c00 2023-11-04T01:45:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8bf6ffd640 1 -- 172.21.15.2:0/1342440613 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f8be8053ed0 con 0x7f8bf80c7c00 2023-11-04T01:45:50.183 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:50.184 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:46.836951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 49 2023-11-04T01:45:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8be40664a0 msgr2=0x7f8be4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8be40664a0 0x7f8be4068960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0001340 tx=0x7f8bf0009040 comp rx=0 tx=0).stop 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf80c7c00 msgr2=0x7f8bf80c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf80c7c00 0x7f8bf80c8080 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f8bf806dae0 tx=0x7f8be800e8a0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 shutdown_connections 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8be40664a0 0x7f8be4068960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bf80c7c00 0x7f8bf80c8080 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bf81e52f0 0x7f8bf81e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 --2- 172.21.15.2:0/1342440613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8be00047d0 0x7f8bf8158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 >> 172.21.15.2:0/1342440613 conn(0x7f8bf80cebb0 msgr2=0x7f8bf815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 shutdown_connections 2023-11-04T01:45:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:50.181+0000 7f8c006fd640 1 -- 172.21.15.2:0/1342440613 wait complete. 2023-11-04T01:45:50.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:45:50.340 INFO:teuthology.orchestra.run.smithi002.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:45:50.340 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:45:50.340 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:45:50.629 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:45:50.623+0000 7f3bac0da640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:45:52.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:52.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff96a4640 1 Processor -- start 2023-11-04T01:45:52.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff96a4640 1 -- start start 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff96a4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbff415afd0 0x7fbff40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff96a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff96a4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40c2670 con 0x7fbff40b0b70 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff96a4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff4070140 con 0x7fbff415afd0 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff96a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff415fc90 con 0x7fbff406f8f0 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff2ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbff415afd0 0x7fbff40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbff40b0b70 0x7fbff40c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36636/0 (socket says 172.21.15.2:36636) 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff37fe640 1 -- 172.21.15.2:0/2408964319 learned_addr learned my addr 172.21.15.2:0/2408964319 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff2ffd640 1 --2- 172.21.15.2:0/2408964319 >> v2:172.21.15.2:3300/0 conn(0x7fbff415afd0 0x7fbff40715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38482/0 (socket says 172.21.15.2:38482) 2023-11-04T01:45:52.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff27fc640 1 --2- 172.21.15.2:0/2408964319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:52.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff2ffd640 1 -- 172.21.15.2:0/2408964319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 msgr2=0x7fbff40b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:52.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff2ffd640 1 --2- 172.21.15.2:0/2408964319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff2ffd640 1 -- 172.21.15.2:0/2408964319 >> v1:172.21.15.2:6789/0 conn(0x7fbff40b0b70 legacy=0x7fbff40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:52.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff2ffd640 1 -- 172.21.15.2:0/2408964319 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff406bc30 con 0x7fbff415afd0 2023-11-04T01:45:52.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff1ffb640 1 -- 172.21.15.2:0/2408964319 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156103063 0 0) 0x7fbff40c2670 con 0x7fbff40b0b70 2023-11-04T01:45:52.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff27fc640 1 --2- 172.21.15.2:0/2408964319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:52.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.473+0000 7fbff2ffd640 1 --2- 172.21.15.2:0/2408964319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff415afd0 0x7fbff40715d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009d90 tx=0x7fbfe401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198697e9c0a5037a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:52.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff1ffb640 1 -- 172.21.15.2:0/2408964319 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40a5730 con 0x7fbff415afd0 2023-11-04T01:45:52.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff1ffb640 1 -- 172.21.15.2:0/2408964319 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40a5890 con 0x7fbff415afd0 2023-11-04T01:45:52.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff1ffb640 1 -- 172.21.15.2:0/2408964319 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40a5c20 con 0x7fbff415afd0 2023-11-04T01:45:52.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- 172.21.15.2:0/2408964319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff415afd0 msgr2=0x7fbff40715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:52.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2408964319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff415afd0 0x7fbff40715d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009d90 tx=0x7fbfe401c950 comp rx=0 tx=0).stop 2023-11-04T01:45:52.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- 172.21.15.2:0/2408964319 shutdown_connections 2023-11-04T01:45:52.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2408964319 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2408964319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff415afd0 0x7fbff40715d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- 172.21.15.2:0/2408964319 >> 172.21.15.2:0/2408964319 conn(0x7fbff40cebb0 msgr2=0x7fbff40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:52.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- 172.21.15.2:0/2408964319 shutdown_connections 2023-11-04T01:45:52.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- 172.21.15.2:0/2408964319 wait complete. 2023-11-04T01:45:52.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 Processor -- start 2023-11-04T01:45:52.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- start start 2023-11-04T01:45:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff40b0b70 0x7fbff40b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbff415afd0 0x7fbff4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40b46a0 con 0x7fbff40b0b70 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff414c490 con 0x7fbff415afd0 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4153910 con 0x7fbff406f8f0 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff40b0b70 0x7fbff40b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff40b0b70 0x7fbff40b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38492/0 (socket says 172.21.15.2:38492) 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 -- 172.21.15.2:0/2416126448 learned_addr learned my addr 172.21.15.2:0/2416126448 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff2ffd640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 -- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 msgr2=0x7fbff40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 -- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbff415afd0 msgr2=0x7fbff4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff37fe640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbff415afd0 0x7fbff4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbff415afd0 0x7fbff4154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 -- 172.21.15.2:0/2416126448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4009a70 con 0x7fbff40b0b70 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff2ffd640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff27fc640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff40b0b70 0x7fbff40b4160 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c7f0 tx=0x7fbfdc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbfeb7fe640 1 -- 172.21.15.2:0/2416126448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc007820 con 0x7fbff40b0b70 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbfeb7fe640 1 -- 172.21.15.2:0/2416126448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc007980 con 0x7fbff40b0b70 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff4153bb0 con 0x7fbff40b0b70 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbfeb7fe640 1 -- 172.21.15.2:0/2416126448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc007d30 con 0x7fbff40b0b70 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.477+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff4154170 con 0x7fbff40b0b70 2023-11-04T01:45:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.481+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff40744a0 con 0x7fbff40b0b70 2023-11-04T01:45:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.481+0000 7fbfeb7fe640 1 -- 172.21.15.2:0/2416126448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbfdc0113f0 con 0x7fbff40b0b70 2023-11-04T01:45:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.481+0000 7fbfeb7fe640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbfd40664d0 0x7fbfd4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.481+0000 7fbfeb7fe640 1 -- 172.21.15.2:0/2416126448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fbfdc084620 con 0x7fbff40b0b70 2023-11-04T01:45:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.481+0000 7fbff2ffd640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbfd40664d0 0x7fbfd4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.481+0000 7fbff2ffd640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbfd40664d0 0x7fbfd4068990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40af000 tx=0x7fbfe40a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:52.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.485+0000 7fbfeb7fe640 1 -- 172.21.15.2:0/2416126448 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbfdc0515d0 con 0x7fbff40b0b70 2023-11-04T01:45:52.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.673+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbff406cba0 con 0x7fbff40b0b70 2023-11-04T01:45:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbfeb7fe640 1 -- 172.21.15.2:0/2416126448 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fbfdc054bf0 con 0x7fbff40b0b70 2023-11-04T01:45:52.679 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:52.679 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:46.836951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 49 2023-11-04T01:45:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbfd40664d0 msgr2=0x7fbfd4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbfd40664d0 0x7fbfd4068990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40af000 tx=0x7fbfe40a7070 comp rx=0 tx=0).stop 2023-11-04T01:45:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff40b0b70 msgr2=0x7fbff40b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff40b0b70 0x7fbff40b4160 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00c7f0 tx=0x7fbfdc00ccb0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 shutdown_connections 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbfd40664d0 0x7fbfd4068990 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbff415afd0 0x7fbff4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbff40b0b70 0x7fbff40b4160 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 --2- 172.21.15.2:0/2416126448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbff406f8f0 0x7fbff40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 >> 172.21.15.2:0/2416126448 conn(0x7fbff40cebb0 msgr2=0x7fbff40cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 shutdown_connections 2023-11-04T01:45:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:52.677+0000 7fbff96a4640 1 -- 172.21.15.2:0/2416126448 wait complete. 2023-11-04T01:45:52.697 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:45:52.820 INFO:teuthology.orchestra.run.smithi002.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:45:52.821 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:45:52.821 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:45:54.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:54.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:54.891 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:45:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.949+0000 7f43f2feb640 1 Processor -- start 2023-11-04T01:45:54.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f2feb640 1 -- start start 2023-11-04T01:45:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f2feb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f43ec15d690 0x7f43ec06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f2feb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f2feb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0cd400 con 0x7f43ec15d2b0 2023-11-04T01:45:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f2feb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0ad450 con 0x7f43ec15d690 2023-11-04T01:45:54.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f2feb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0cd6e0 con 0x7f43ec06f8f0 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f1588640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43ebfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f43ec15d690 0x7f43ec06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f1588640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:33030/0 (socket says 172.21.15.2:33030) 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f0d87640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f43ec15d2b0 0x7f43ec0ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:54434/0 (socket says 172.21.15.2:54434) 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f1588640 1 -- 172.21.15.2:0/3834097108 learned_addr learned my addr 172.21.15.2:0/3834097108 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f1588640 1 -- 172.21.15.2:0/3834097108 >> v2:172.21.15.90:3300/0 conn(0x7f43ec15d690 msgr2=0x7f43ec06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f1588640 1 --2- 172.21.15.2:0/3834097108 >> v2:172.21.15.90:3300/0 conn(0x7f43ec15d690 0x7f43ec06c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f1588640 1 -- 172.21.15.2:0/3834097108 >> v1:172.21.15.90:6789/0 conn(0x7f43ec15d2b0 legacy=0x7f43ec0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.953+0000 7f43f1588640 1 -- 172.21.15.2:0/3834097108 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0ad070 con 0x7f43ec06f8f0 2023-11-04T01:45:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f1588640 1 --2- 172.21.15.2:0/3834097108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec0b0630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009870 tx=0x7f43dc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2410f127984d9436 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43eb7fe640 1 -- 172.21.15.2:0/3834097108 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0ad680 con 0x7f43ec06f8f0 2023-11-04T01:45:54.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43eb7fe640 1 -- 172.21.15.2:0/3834097108 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc0ad7e0 con 0x7f43ec06f8f0 2023-11-04T01:45:54.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43eb7fe640 1 -- 172.21.15.2:0/3834097108 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0adb70 con 0x7f43ec06f8f0 2023-11-04T01:45:54.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- 172.21.15.2:0/3834097108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 msgr2=0x7f43ec0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3834097108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec0b0630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009870 tx=0x7f43dc01c4b0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- 172.21.15.2:0/3834097108 shutdown_connections 2023-11-04T01:45:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3834097108 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec0b0630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3834097108 >> v2:172.21.15.90:3300/0 conn(0x7f43ec15d690 0x7f43ec06c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- 172.21.15.2:0/3834097108 >> 172.21.15.2:0/3834097108 conn(0x7f43ec0cebb0 msgr2=0x7f43ec0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- 172.21.15.2:0/3834097108 shutdown_connections 2023-11-04T01:45:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- 172.21.15.2:0/3834097108 wait complete. 2023-11-04T01:45:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 Processor -- start 2023-11-04T01:45:54.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- start start 2023-11-04T01:45:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43ec15d2b0 0x7f43ec1f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43ec15d690 0x7f43ec158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec151cd0 con 0x7f43ec15d690 2023-11-04T01:45:54.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec1546d0 con 0x7f43ec15d2b0 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f2feb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec1510c0 con 0x7f43ec06f8f0 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f1588640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43ec15d690 0x7f43ec158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f1588640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43ec15d690 0x7f43ec158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38508/0 (socket says 172.21.15.2:38508) 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f1588640 1 -- 172.21.15.2:0/3028801853 learned_addr learned my addr 172.21.15.2:0/3028801853 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43f0d87640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.957+0000 7f43ebfff640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43ec15d2b0 0x7f43ec1f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f1588640 1 -- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 msgr2=0x7f43ec1509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f1588640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec1509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f1588640 1 -- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43ec15d2b0 msgr2=0x7f43ec1f6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f1588640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43ec15d2b0 0x7f43ec1f6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f1588640 1 -- 172.21.15.2:0/3028801853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0094d0 con 0x7f43ec15d690 2023-11-04T01:45:54.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f1588640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43ec15d690 0x7f43ec158650 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f43dc01cd50 tx=0x7f43dc019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43e97fa640 1 -- 172.21.15.2:0/3028801853 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0add60 con 0x7f43ec15d690 2023-11-04T01:45:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43e97fa640 1 -- 172.21.15.2:0/3028801853 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc0b6410 con 0x7f43ec15d690 2023-11-04T01:45:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec1513a0 con 0x7f43ec15d690 2023-11-04T01:45:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43e97fa640 1 -- 172.21.15.2:0/3028801853 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0b67c0 con 0x7f43ec15d690 2023-11-04T01:45:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec151960 con 0x7f43ec15d690 2023-11-04T01:45:54.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec151e40 con 0x7f43ec15d690 2023-11-04T01:45:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43e97fa640 1 -- 172.21.15.2:0/3028801853 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f43dc0b4040 con 0x7f43ec15d690 2023-11-04T01:45:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43e97fa640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43cc0664d0 0x7f43cc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43e97fa640 1 -- 172.21.15.2:0/3028801853 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f43dc11e2d0 con 0x7f43ec15d690 2023-11-04T01:45:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f0d87640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43cc0664d0 0x7f43cc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:54.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.961+0000 7f43f0d87640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43cc0664d0 0x7f43cc068990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f43e40012f0 tx=0x7f43e4001620 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:54.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:54.965+0000 7f43e97fa640 1 -- 172.21.15.2:0/3028801853 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f43dc0eb2b0 con 0x7f43ec15d690 2023-11-04T01:45:55.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43ec0744a0 con 0x7f43ec15d690 2023-11-04T01:45:55.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43e97fa640 1 -- 172.21.15.2:0/3028801853 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f43dc0ee8d0 con 0x7f43ec15d690 2023-11-04T01:45:55.153 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:55.153 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:46.836951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:55.153 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 49 2023-11-04T01:45:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43cc0664d0 msgr2=0x7f43cc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43cc0664d0 0x7f43cc068990 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f43e40012f0 tx=0x7f43e4001620 comp rx=0 tx=0).stop 2023-11-04T01:45:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43ec15d690 msgr2=0x7f43ec158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43ec15d690 0x7f43ec158650 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f43dc01cd50 tx=0x7f43dc019250 comp rx=0 tx=0).stop 2023-11-04T01:45:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 shutdown_connections 2023-11-04T01:45:55.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f43cc0664d0 0x7f43cc068990 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f43ec15d690 0x7f43ec158650 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.149+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43ec15d2b0 0x7f43ec1f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.153+0000 7f43f2feb640 1 --2- 172.21.15.2:0/3028801853 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f43ec06f8f0 0x7f43ec1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:55.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.153+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 >> 172.21.15.2:0/3028801853 conn(0x7f43ec0cebb0 msgr2=0x7f43ec0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:55.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.153+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 shutdown_connections 2023-11-04T01:45:55.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:55.153+0000 7f43f2feb640 1 -- 172.21.15.2:0/3028801853 wait complete. 2023-11-04T01:45:55.171 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:45:55.356 INFO:teuthology.orchestra.run.smithi002.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:45:55.356 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:45:55.356 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:45:57.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.489+0000 7f75b37bc640 1 Processor -- start 2023-11-04T01:45:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b37bc640 1 -- start start 2023-11-04T01:45:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b37bc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0b4990 0x7f75ac0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b37bc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75ac0b74f0 0x7f75ac0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b37bc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0b6070 con 0x7f75ac0d0690 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b37bc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0b8ed0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b37bc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0b52b0 con 0x7f75ac0b4990 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75ac0b74f0 0x7f75ac0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75ac0b74f0 0x7f75ac0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38524/0 (socket says 172.21.15.2:38524) 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 -- 172.21.15.2:0/131819173 learned_addr learned my addr 172.21.15.2:0/131819173 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1558640 1 --2- 172.21.15.2:0/131819173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0b4990 0x7f75ac0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 -- 172.21.15.2:0/131819173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0b4990 msgr2=0x7f75ac0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 --2- 172.21.15.2:0/131819173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0b4990 0x7f75ac0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 -- 172.21.15.2:0/131819173 >> v1:172.21.15.90:6789/0 conn(0x7f75ac0d0690 legacy=0x7f75ac0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 -- 172.21.15.2:0/131819173 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0d1ce0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75b1d59640 1 --2- 172.21.15.2:0/131819173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cde80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009870 tx=0x7f75a401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3d4b98656a590f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.493+0000 7f75abfff640 1 -- 172.21.15.2:0/131819173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40a89b0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75abfff640 1 -- 172.21.15.2:0/131819173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a40a8b10 con 0x7f75ac0b74f0 2023-11-04T01:45:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75abfff640 1 -- 172.21.15.2:0/131819173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40a8ea0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- 172.21.15.2:0/131819173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 msgr2=0x7f75ac0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 --2- 172.21.15.2:0/131819173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cde80 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009870 tx=0x7f75a401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- 172.21.15.2:0/131819173 shutdown_connections 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 --2- 172.21.15.2:0/131819173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cde80 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 --2- 172.21.15.2:0/131819173 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0b4990 0x7f75ac0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- 172.21.15.2:0/131819173 >> 172.21.15.2:0/131819173 conn(0x7f75ac0cf990 msgr2=0x7f75ac0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- 172.21.15.2:0/131819173 shutdown_connections 2023-11-04T01:45:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- 172.21.15.2:0/131819173 wait complete. 2023-11-04T01:45:57.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 Processor -- start 2023-11-04T01:45:57.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- start start 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0b4990 0x7f75ac15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0d0690 0x7f75ac0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac152ad0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac153940 con 0x7f75ac0b4990 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac1524a0 con 0x7f75ac0d0690 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38532/0 (socket says 172.21.15.2:38532) 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 -- 172.21.15.2:0/1902026112 learned_addr learned my addr 172.21.15.2:0/1902026112 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b1558640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0b4990 0x7f75ac15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b1d59640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0d0690 0x7f75ac0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 -- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0d0690 msgr2=0x7f75ac0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0d0690 0x7f75ac0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 -- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0b4990 msgr2=0x7f75ac15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0b4990 0x7f75ac15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 -- 172.21.15.2:0/1902026112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40094d0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b0d57640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cb3b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c410 tx=0x7f75a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75a9ffb640 1 -- 172.21.15.2:0/1902026112 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011790 con 0x7f75ac0b74f0 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75a9ffb640 1 -- 172.21.15.2:0/1902026112 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a00118f0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac0cbe30 con 0x7f75ac0b74f0 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75a9ffb640 1 -- 172.21.15.2:0/1902026112 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0011ce0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.497+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac1521c0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.501+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac0744a0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.501+0000 7f75a9ffb640 1 -- 172.21.15.2:0/1902026112 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75a001c460 con 0x7f75ac0b74f0 2023-11-04T01:45:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.501+0000 7f75a9ffb640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75980664a0 0x7f7598068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.501+0000 7f75a9ffb640 1 -- 172.21.15.2:0/1902026112 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f75a00841f0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.501+0000 7f75b1558640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75980664a0 0x7f7598068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:57.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.501+0000 7f75b1558640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75980664a0 0x7f7598068960 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f759c003fd0 tx=0x7f759c0039c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:57.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.505+0000 7f75a9ffb640 1 -- 172.21.15.2:0/1902026112 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f75a00512d0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.693+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75ac0cb110 con 0x7f75ac0b74f0 2023-11-04T01:45:57.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75a9ffb640 1 -- 172.21.15.2:0/1902026112 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4920 (secure 0 0 0) 0x7f75a00548f0 con 0x7f75ac0b74f0 2023-11-04T01:45:57.700 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:45:57.700 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:46.836951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:45:57.700 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 49 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75980664a0 msgr2=0x7f7598068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75980664a0 0x7f7598068960 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f759c003fd0 tx=0x7f759c0039c0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 msgr2=0x7f75ac0cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cb3b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c410 tx=0x7f75a000c8d0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 shutdown_connections 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f75980664a0 0x7f7598068960 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f75ac0d0690 0x7f75ac0cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75ac0b74f0 0x7f75ac0cb3b0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 --2- 172.21.15.2:0/1902026112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f75ac0b4990 0x7f75ac15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 >> 172.21.15.2:0/1902026112 conn(0x7f75ac0cf990 msgr2=0x7f75ac0b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:57.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 shutdown_connections 2023-11-04T01:45:57.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:57.697+0000 7f75b37bc640 1 -- 172.21.15.2:0/1902026112 wait complete. 2023-11-04T01:45:57.717 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:45:57.843 INFO:teuthology.orchestra.run.smithi002.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:45:57.843 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:45:57.843 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:45:59.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:45:59.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.973+0000 7fb71c053640 1 Processor -- start 2023-11-04T01:45:59.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb71c053640 1 -- start start 2023-11-04T01:45:59.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb71c053640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb7140b0630 0x7fb7140b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:59.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb71c053640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71406cfd0 con 0x7fb714159fc0 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb71c053640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71415e830 con 0x7fb71415dc50 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb71c053640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7140ca030 con 0x7fb7140b0630 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb7195ee640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb7140b0630 0x7fb7140b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb719def640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb714159fc0 0x7fb7140ca450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36646/0 (socket says 172.21.15.2:36646) 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb719def640 1 -- 172.21.15.2:0/2293344904 learned_addr learned my addr 172.21.15.2:0/2293344904 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb7195ee640 1 -- 172.21.15.2:0/2293344904 >> v1:172.21.15.90:6789/0 conn(0x7fb71415dc50 legacy=0x7fb71415e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb7195ee640 1 -- 172.21.15.2:0/2293344904 >> v1:172.21.15.2:6789/0 conn(0x7fb714159fc0 legacy=0x7fb7140ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb7195ee640 1 -- 172.21.15.2:0/2293344904 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71415eb10 con 0x7fb7140b0630 2023-11-04T01:45:59.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb718ded640 1 -- 172.21.15.2:0/2293344904 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349316455 0 0) 0x7fb71406cfd0 con 0x7fb714159fc0 2023-11-04T01:45:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb7195ee640 1 --2- 172.21.15.2:0/2293344904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7140b0630 0x7fb7140b0ac0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb7040097c0 tx=0x7fb70401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e881f007b5b02c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.977+0000 7fb718ded640 1 -- 172.21.15.2:0/2293344904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7040ab600 con 0x7fb7140b0630 2023-11-04T01:45:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb718ded640 1 -- 172.21.15.2:0/2293344904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7040a7050 con 0x7fb7140b0630 2023-11-04T01:45:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb718ded640 1 -- 172.21.15.2:0/2293344904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7040ab980 con 0x7fb7140b0630 2023-11-04T01:45:59.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- 172.21.15.2:0/2293344904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7140b0630 msgr2=0x7fb7140b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:59.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 --2- 172.21.15.2:0/2293344904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7140b0630 0x7fb7140b0ac0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fb7040097c0 tx=0x7fb70401c440 comp rx=0 tx=0).stop 2023-11-04T01:45:59.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- 172.21.15.2:0/2293344904 shutdown_connections 2023-11-04T01:45:59.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 --2- 172.21.15.2:0/2293344904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7140b0630 0x7fb7140b0ac0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:59.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- 172.21.15.2:0/2293344904 >> 172.21.15.2:0/2293344904 conn(0x7fb7140cebb0 msgr2=0x7fb7140cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:45:59.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- 172.21.15.2:0/2293344904 shutdown_connections 2023-11-04T01:45:59.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- 172.21.15.2:0/2293344904 wait complete. 2023-11-04T01:45:59.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 Processor -- start 2023-11-04T01:45:59.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- start start 2023-11-04T01:45:59.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7140b0630 0x7fb7140c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb714159fc0 0x7fb7140b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb71415dc50 0x7fb7141641b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140b2a80 con 0x7fb71415dc50 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140b1bf0 con 0x7fb7140b0630 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140b1e70 con 0x7fb714159fc0 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb71415dc50 0x7fb7141641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb71415dc50 0x7fb7141641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38552/0 (socket says 172.21.15.2:38552) 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 -- 172.21.15.2:0/3296826187 learned_addr learned my addr 172.21.15.2:0/3296826187 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb719def640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7140b0630 0x7fb7140c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb7195ee640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb714159fc0 0x7fb7140b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:59.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 -- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb714159fc0 msgr2=0x7fb7140b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb714159fc0 0x7fb7140b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 -- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7140b0630 msgr2=0x7fb7140c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7140b0630 0x7fb7140c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 -- 172.21.15.2:0/3296826187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb704009420 con 0x7fb71415dc50 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71a5f0640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb71415dc50 0x7fb7141641b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c780 tx=0x7fb70c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb70a7fc640 1 -- 172.21.15.2:0/3296826187 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c004b70 con 0x7fb71415dc50 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb70a7fc640 1 -- 172.21.15.2:0/3296826187 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c00ce90 con 0x7fb71415dc50 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb70a7fc640 1 -- 172.21.15.2:0/3296826187 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00a850 con 0x7fb71415dc50 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7140b2150 con 0x7fb71415dc50 2023-11-04T01:45:59.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.981+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7140b2710 con 0x7fb71415dc50 2023-11-04T01:45:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.985+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7140b2bf0 con 0x7fb71415dc50 2023-11-04T01:45:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.985+0000 7fb70a7fc640 1 -- 172.21.15.2:0/3296826187 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb70c00a9b0 con 0x7fb71415dc50 2023-11-04T01:45:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.985+0000 7fb70a7fc640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6f80664a0 0x7fb6f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:45:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.985+0000 7fb70a7fc640 1 -- 172.21.15.2:0/3296826187 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7fb70c084580 con 0x7fb71415dc50 2023-11-04T01:45:59.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.985+0000 7fb719def640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6f80664a0 0x7fb6f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:45:59.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.985+0000 7fb719def640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6f80664a0 0x7fb6f8068960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb710000f70 tx=0x7fb710007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:45:59.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:45:59.989+0000 7fb70a7fc640 1 -- 172.21.15.2:0/3296826187 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb70c051530 con 0x7fb71415dc50 2023-11-04T01:46:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.181+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7140744a0 con 0x7fb71415dc50 2023-11-04T01:46:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.181+0000 7fb70a7fc640 1 -- 172.21.15.2:0/3296826187 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4920 (secure 0 0 0) 0x7fb70c054b50 con 0x7fb71415dc50 2023-11-04T01:46:00.186 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:00.186 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:46.836951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 49 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6f80664a0 msgr2=0x7fb6f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6f80664a0 0x7fb6f8068960 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb710000f70 tx=0x7fb710007c10 comp rx=0 tx=0).stop 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb71415dc50 msgr2=0x7fb7141641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb71415dc50 0x7fb7141641b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c780 tx=0x7fb70c00cc40 comp rx=0 tx=0).stop 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 shutdown_connections 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb6f80664a0 0x7fb6f8068960 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb71415dc50 0x7fb7141641b0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb714159fc0 0x7fb7140b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 --2- 172.21.15.2:0/3296826187 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7140b0630 0x7fb7140c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:00.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 >> 172.21.15.2:0/3296826187 conn(0x7fb7140cebb0 msgr2=0x7fb71415a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:00.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 shutdown_connections 2023-11-04T01:46:00.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:00.185+0000 7fb71c053640 1 -- 172.21.15.2:0/3296826187 wait complete. 2023-11-04T01:46:00.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:46:00.336 INFO:teuthology.orchestra.run.smithi002.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2023-11-04T01:46:00.337 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:46:00.337 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1', 1)] 2023-11-04T01:46:02.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99dd292640 1 Processor -- start 2023-11-04T01:46:02.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99dd292640 1 -- start start 2023-11-04T01:46:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99dd292640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d815afd0 0x7f99d80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99dd292640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99d80b0d40 0x7f99d815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99dd292640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d80c2670 con 0x7f99d806f8f0 2023-11-04T01:46:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99dd292640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d8070140 con 0x7f99d80b0d40 2023-11-04T01:46:02.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99dd292640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d806c9f0 con 0x7f99d815afd0 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99d77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99d80b0d40 0x7f99d815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99d77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f99d80b0d40 0x7f99d815ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49570/0 (socket says 172.21.15.2:49570) 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.469+0000 7f99d77fe640 1 -- 172.21.15.2:0/815708353 learned_addr learned my addr 172.21.15.2:0/815708353 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d6ffd640 1 --2- 172.21.15.2:0/815708353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d815afd0 0x7f99d80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d77fe640 1 -- 172.21.15.2:0/815708353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d815afd0 msgr2=0x7f99d80715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d77fe640 1 --2- 172.21.15.2:0/815708353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d815afd0 0x7f99d80715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d77fe640 1 -- 172.21.15.2:0/815708353 >> v1:172.21.15.90:6789/0 conn(0x7f99d806f8f0 legacy=0x7f99d80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d77fe640 1 -- 172.21.15.2:0/815708353 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d806bc30 con 0x7f99d80b0d40 2023-11-04T01:46:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d77fe640 1 --2- 172.21.15.2:0/815708353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d80b0d40 0x7f99d815ec80 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009e80 tx=0x7f99d001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2092e70c96b2d3d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d5ffb640 1 -- 172.21.15.2:0/815708353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00a5880 con 0x7f99d80b0d40 2023-11-04T01:46:02.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d5ffb640 1 -- 172.21.15.2:0/815708353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d00a59e0 con 0x7f99d80b0d40 2023-11-04T01:46:02.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99d5ffb640 1 -- 172.21.15.2:0/815708353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00a5d70 con 0x7f99d80b0d40 2023-11-04T01:46:02.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 -- 172.21.15.2:0/815708353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d80b0d40 msgr2=0x7f99d815ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 --2- 172.21.15.2:0/815708353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d80b0d40 0x7f99d815ec80 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009e80 tx=0x7f99d001c9c0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 -- 172.21.15.2:0/815708353 shutdown_connections 2023-11-04T01:46:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 --2- 172.21.15.2:0/815708353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d80b0d40 0x7f99d815ec80 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 --2- 172.21.15.2:0/815708353 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d815afd0 0x7f99d80715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 -- 172.21.15.2:0/815708353 >> 172.21.15.2:0/815708353 conn(0x7f99d80cebb0 msgr2=0x7f99d80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 -- 172.21.15.2:0/815708353 shutdown_connections 2023-11-04T01:46:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.473+0000 7f99dd292640 1 -- 172.21.15.2:0/815708353 wait complete. 2023-11-04T01:46:02.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 Processor -- start 2023-11-04T01:46:02.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 -- start start 2023-11-04T01:46:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d806f8f0 0x7f99d8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d80b0d40 0x7f99d80c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d815afd0 0x7f99d8153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80c62d0 con 0x7f99d815afd0 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80c65b0 con 0x7f99d806f8f0 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80c6890 con 0x7f99d80b0d40 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d815afd0 0x7f99d8153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d815afd0 0x7f99d8153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49578/0 (socket says 172.21.15.2:49578) 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 -- 172.21.15.2:0/804306196 learned_addr learned my addr 172.21.15.2:0/804306196 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d67fc640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d80b0d40 0x7f99d80c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d6ffd640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d806f8f0 0x7f99d8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 -- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d80b0d40 msgr2=0x7f99d80c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d80b0d40 0x7f99d80c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 -- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d806f8f0 msgr2=0x7f99d8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d806f8f0 0x7f99d8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 -- 172.21.15.2:0/804306196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0009b30 con 0x7f99d815afd0 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99d77fe640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d815afd0 0x7f99d8153d40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f99d00af040 tx=0x7f99d0019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99bf7fe640 1 -- 172.21.15.2:0/804306196 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00bd070 con 0x7f99d815afd0 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99bf7fe640 1 -- 172.21.15.2:0/804306196 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d00b8470 con 0x7f99d815afd0 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99bf7fe640 1 -- 172.21.15.2:0/804306196 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00b8820 con 0x7f99d815afd0 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d80c6b70 con 0x7f99d815afd0 2023-11-04T01:46:02.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d8154280 con 0x7f99d815afd0 2023-11-04T01:46:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.477+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d8154470 con 0x7f99d815afd0 2023-11-04T01:46:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.481+0000 7f99bf7fe640 1 -- 172.21.15.2:0/804306196 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99d00039a0 con 0x7f99d815afd0 2023-11-04T01:46:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.481+0000 7f99bf7fe640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f99c40664d0 0x7f99c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.481+0000 7f99bf7fe640 1 -- 172.21.15.2:0/804306196 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f99d011f000 con 0x7f99d815afd0 2023-11-04T01:46:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.481+0000 7f99d6ffd640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f99c40664d0 0x7f99c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:02.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.481+0000 7f99d6ffd640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f99c40664d0 0x7f99c4068990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f99c800b930 tx=0x7f99c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.485+0000 7f99bf7fe640 1 -- 172.21.15.2:0/804306196 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f99d8154470 con 0x7f99d815afd0 2023-11-04T01:46:02.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.669+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99d8154470 con 0x7f99d815afd0 2023-11-04T01:46:02.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99bf7fe640 1 -- 172.21.15.2:0/804306196 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f99d8154470 con 0x7f99d815afd0 2023-11-04T01:46:02.675 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:02.675 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:59.604530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 50 2023-11-04T01:46:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f99c40664d0 msgr2=0x7f99c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f99c40664d0 0x7f99c4068990 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f99c800b930 tx=0x7f99c8008040 comp rx=0 tx=0).stop 2023-11-04T01:46:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d815afd0 msgr2=0x7f99d8153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d815afd0 0x7f99d8153d40 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f99d00af040 tx=0x7f99d0019760 comp rx=0 tx=0).stop 2023-11-04T01:46:02.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 shutdown_connections 2023-11-04T01:46:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f99c40664d0 0x7f99c4068990 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99d815afd0 0x7f99d8153d40 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f99d80b0d40 0x7f99d80c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 --2- 172.21.15.2:0/804306196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99d806f8f0 0x7f99d8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 >> 172.21.15.2:0/804306196 conn(0x7f99d80cebb0 msgr2=0x7f99d81578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 shutdown_connections 2023-11-04T01:46:02.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:02.673+0000 7f99dd292640 1 -- 172.21.15.2:0/804306196 wait complete. 2023-11-04T01:46:02.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2023-11-04T01:46:02.832 INFO:teuthology.orchestra.run.smithi002.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"8","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1","dirfrag":"0x10000000000","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2023-11-04T01:46:02.832 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "8" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000000", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "3", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2023-11-04T01:46:02.832 INFO:tasks.cephfs.cephfs_test_case:[('/d1', 1)] =?= [('/d1', 1)] 2023-11-04T01:46:02.833 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:46:02.977 INFO:teuthology.orchestra.run.smithi090.stdout:{"last_snap":1,"last_created":1,"last_destroyed":1,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:02.978 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 1, "last_destroyed": 1, "last_snap": 1, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:46:02.978 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=1 2023-11-04T01:46:02.978 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa9b2b640 1 Processor -- start 2023-11-04T01:46:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa9b2b640 1 -- start start 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa9b2b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 0x7effa40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa9b2b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa40b6070 con 0x7effa40d0690 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa9b2b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa40b8ed0 con 0x7effa40b74f0 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa9b2b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa40ce590 con 0x7effa40b4990 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa2ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7effa40d0690 0x7effa40cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35002/0 (socket says 172.21.15.2:35002) 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa2ffd640 1 -- 172.21.15.2:0/1345735081 learned_addr learned my addr 172.21.15.2:0/1345735081 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa37fe640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 0x7effa40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703141222 0 0) 0x7effa40b6070 con 0x7effa40d0690 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff90003530 con 0x7effa40d0690 2023-11-04T01:46:03.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612749203 0 0) 0x7eff90003530 con 0x7effa40d0690 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 msgr2=0x7effa40b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 0x7effa40b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 >> v1:172.21.15.90:6789/0 conn(0x7effa40b74f0 legacy=0x7effa40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40b52b0 con 0x7effa40d0690 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7eff94001a00 con 0x7effa40d0690 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 >> v1:172.21.15.2:6789/0 conn(0x7effa40d0690 legacy=0x7effa40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff900039b0 0x7eff90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff900047d0 0x7eff90004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 0x7eff90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa40ce590 con 0x7eff900039b0 2023-11-04T01:46:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9000bad0 con 0x7eff900047d0 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9000bc90 con 0x7effa40b4990 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa37fe640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff900039b0 0x7eff90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa3fff640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 0x7eff90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff900047d0 0x7eff90004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa37fe640 1 -- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 msgr2=0x7eff90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa37fe640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7effa40b4990 0x7eff90005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa37fe640 1 -- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff900047d0 msgr2=0x7eff90004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa37fe640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff900047d0 0x7eff90004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa37fe640 1 -- 172.21.15.2:0/1345735081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90003530 con 0x7eff900039b0 2023-11-04T01:46:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.105+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff900047d0 0x7eff90004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa37fe640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff900039b0 0x7eff90003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009ab0 tx=0x7eff8c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b0708cce9a70b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0a5600 con 0x7eff900039b0 2023-11-04T01:46:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94002100 con 0x7eff900039b0 2023-11-04T01:46:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa27fc640 1 -- 172.21.15.2:0/1345735081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0a59a0 con 0x7eff900039b0 2023-11-04T01:46:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa9b2b640 1 -- 172.21.15.2:0/1345735081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff900039b0 msgr2=0x7eff90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa9b2b640 1 --2- 172.21.15.2:0/1345735081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7eff900039b0 0x7eff90003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009ab0 tx=0x7eff8c01ca10 comp rx=0 tx=0).stop 2023-11-04T01:46:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa3fff640 1 -- 172.21.15.2:0/1345735081 reap_dead start 2023-11-04T01:46:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa9b2b640 1 -- 172.21.15.2:0/1345735081 shutdown_connections 2023-11-04T01:46:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa9b2b640 1 -- 172.21.15.2:0/1345735081 >> 172.21.15.2:0/1345735081 conn(0x7effa40cf990 msgr2=0x7effa40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa9b2b640 1 -- 172.21.15.2:0/1345735081 shutdown_connections 2023-11-04T01:46:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.109+0000 7effa9b2b640 1 -- 172.21.15.2:0/1345735081 wait complete. 2023-11-04T01:46:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 Processor -- start 2023-11-04T01:46:03.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 -- start start 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff900039b0 0x7effa415fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa415e520 0x7effa415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415eee0 0x7effa41f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa40cab80 con 0x7effa415e520 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa40cd2d0 con 0x7effa415eee0 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa415f390 con 0x7eff900039b0 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa415e520 0x7effa415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa415e520 0x7effa415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49608/0 (socket says 172.21.15.2:49608) 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 -- 172.21.15.2:0/1910593935 learned_addr learned my addr 172.21.15.2:0/1910593935 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa37fe640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff900039b0 0x7effa415fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa3fff640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415eee0 0x7effa41f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 -- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff900039b0 msgr2=0x7effa415fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff900039b0 0x7effa415fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 -- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415eee0 msgr2=0x7effa41f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415eee0 0x7effa41f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 -- 172.21.15.2:0/1910593935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40ccff0 con 0x7effa415e520 2023-11-04T01:46:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa2ffd640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa415e520 0x7effa415e9a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7eff94010be0 tx=0x7eff9400e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7eff9bfff640 1 -- 172.21.15.2:0/1910593935 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400ed60 con 0x7effa415e520 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7eff9bfff640 1 -- 172.21.15.2:0/1910593935 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff940143a0 con 0x7effa415e520 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa40ca4c0 con 0x7effa415e520 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7eff9bfff640 1 -- 172.21.15.2:0/1910593935 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94014730 con 0x7effa415e520 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa4160020 con 0x7effa415e520 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa40cadf0 con 0x7effa415e520 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7eff9bfff640 1 -- 172.21.15.2:0/1910593935 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff94014890 con 0x7effa415e520 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7eff9bfff640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7eff840664d0 0x7eff84068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.113+0000 7eff9bfff640 1 -- 172.21.15.2:0/1910593935 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7eff94087170 con 0x7effa415e520 2023-11-04T01:46:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.117+0000 7effa37fe640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7eff840664d0 0x7eff84068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.117+0000 7effa37fe640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7eff840664d0 0x7eff84068990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0af000 tx=0x7eff8c0046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.121+0000 7eff9bfff640 1 -- 172.21.15.2:0/1910593935 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7eff94054250 con 0x7effa415e520 2023-11-04T01:46:03.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.309+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effa40744a0 con 0x7effa415e520 2023-11-04T01:46:03.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.309+0000 7eff9bfff640 1 -- 172.21.15.2:0/1910593935 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4921 (secure 0 0 0) 0x7eff94057870 con 0x7effa415e520 2023-11-04T01:46:03.315 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:03.315 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:45:59.604530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:03.315 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 50 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7eff840664d0 msgr2=0x7eff84068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7eff840664d0 0x7eff84068990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0af000 tx=0x7eff8c0046d0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa415e520 msgr2=0x7effa415e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa415e520 0x7effa415e9a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7eff94010be0 tx=0x7eff9400e4d0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 shutdown_connections 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7eff840664d0 0x7eff84068990 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7effa415eee0 0x7effa41f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa415e520 0x7effa415e9a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 --2- 172.21.15.2:0/1910593935 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7eff900039b0 0x7effa415fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 >> 172.21.15.2:0/1910593935 conn(0x7effa40cf990 msgr2=0x7effa415c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 shutdown_connections 2023-11-04T01:46:03.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.313+0000 7effa9b2b640 1 -- 172.21.15.2:0/1910593935 wait complete. 2023-11-04T01:46:03.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:46:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6278a5e640 1 Processor -- start 2023-11-04T01:46:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6278a5e640 1 -- start start 2023-11-04T01:46:03.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6278a5e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f62740b26c0 0x7f62740b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6278a5e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f627415d420 0x7f627415d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6278a5e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6274160cb0 con 0x7f627406b580 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6278a5e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62740b2fe0 con 0x7f627415d420 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6278a5e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627406c390 con 0x7f62740b26c0 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6271d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f627406b580 0x7f627406bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35014/0 (socket says 172.21.15.2:35014) 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6271d9b640 1 -- 172.21.15.2:0/3927409620 learned_addr learned my addr 172.21.15.2:0/3927409620 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.453+0000 7f6272d9d640 1 --2- 172.21.15.2:0/3927409620 >> v2:172.21.15.2:3300/0 conn(0x7f627415d420 0x7f627415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f627259c640 1 --2- 172.21.15.2:0/3927409620 >> v2:172.21.15.90:3300/0 conn(0x7f62740b26c0 0x7f62740b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f627159a640 1 -- 172.21.15.2:0/3927409620 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863342628 0 0) 0x7f6274160cb0 con 0x7f627406b580 2023-11-04T01:46:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f627159a640 1 -- 172.21.15.2:0/3927409620 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6260003530 con 0x7f627406b580 2023-11-04T01:46:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6272d9d640 1 -- 172.21.15.2:0/3927409620 >> v2:172.21.15.90:3300/0 conn(0x7f62740b26c0 msgr2=0x7f62740b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6272d9d640 1 --2- 172.21.15.2:0/3927409620 >> v2:172.21.15.90:3300/0 conn(0x7f62740b26c0 0x7f62740b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6272d9d640 1 -- 172.21.15.2:0/3927409620 >> v1:172.21.15.2:6789/0 conn(0x7f627406b580 legacy=0x7f627406bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6272d9d640 1 -- 172.21.15.2:0/3927409620 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274160f50 con 0x7f627415d420 2023-11-04T01:46:03.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6272d9d640 1 --2- 172.21.15.2:0/3927409620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f627415d830 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f6274071040 tx=0x7f626401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5f213e9f83ef94 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f627159a640 1 -- 172.21.15.2:0/3927409620 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640a7070 con 0x7f627415d420 2023-11-04T01:46:03.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f627159a640 1 -- 172.21.15.2:0/3927409620 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640ab430 con 0x7f627415d420 2023-11-04T01:46:03.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f627159a640 1 -- 172.21.15.2:0/3927409620 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640ab7c0 con 0x7f627415d420 2023-11-04T01:46:03.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 -- 172.21.15.2:0/3927409620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 msgr2=0x7f627415d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3927409620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f627415d830 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f6274071040 tx=0x7f626401c430 comp rx=0 tx=0).stop 2023-11-04T01:46:03.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 -- 172.21.15.2:0/3927409620 shutdown_connections 2023-11-04T01:46:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3927409620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f627415d830 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3927409620 >> v2:172.21.15.90:3300/0 conn(0x7f62740b26c0 0x7f62740b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 -- 172.21.15.2:0/3927409620 >> 172.21.15.2:0/3927409620 conn(0x7f627409a030 msgr2=0x7f62740d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 -- 172.21.15.2:0/3927409620 shutdown_connections 2023-11-04T01:46:03.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.457+0000 7f6278a5e640 1 -- 172.21.15.2:0/3927409620 wait complete. 2023-11-04T01:46:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 Processor -- start 2023-11-04T01:46:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 -- start start 2023-11-04T01:46:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f627406b580 0x7f627415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62740b26c0 0x7f62740c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f62741533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274155240 con 0x7f627415d420 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627415aac0 con 0x7f627406b580 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627415ada0 con 0x7f62740b26c0 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f62741533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f62741533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49628/0 (socket says 172.21.15.2:49628) 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 -- 172.21.15.2:0/3818958389 learned_addr learned my addr 172.21.15.2:0/3818958389 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f627259c640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f627406b580 0x7f627415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6271d9b640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62740b26c0 0x7f62740c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 -- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62740b26c0 msgr2=0x7f62740c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62740b26c0 0x7f62740c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 -- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f627406b580 msgr2=0x7f627415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f627406b580 0x7f627415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 -- 172.21.15.2:0/3818958389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009420 con 0x7f627415d420 2023-11-04T01:46:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6272d9d640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f62741533f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f62640ad040 tx=0x7f626401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f626affd640 1 -- 172.21.15.2:0/3818958389 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640bf610 con 0x7f627415d420 2023-11-04T01:46:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f626affd640 1 -- 172.21.15.2:0/3818958389 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640bf790 con 0x7f627415d420 2023-11-04T01:46:03.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627415b080 con 0x7f627415d420 2023-11-04T01:46:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f626affd640 1 -- 172.21.15.2:0/3818958389 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640bfb40 con 0x7f627415d420 2023-11-04T01:46:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627415c8a0 con 0x7f627415d420 2023-11-04T01:46:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627415ca90 con 0x7f627415d420 2023-11-04T01:46:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f626affd640 1 -- 172.21.15.2:0/3818958389 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f62640b5400 con 0x7f627415d420 2023-11-04T01:46:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.461+0000 7f626affd640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f62540664a0 0x7f6254068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.465+0000 7f626affd640 1 -- 172.21.15.2:0/3818958389 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f626411ebf0 con 0x7f627415d420 2023-11-04T01:46:03.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.465+0000 7f627259c640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f62540664a0 0x7f6254068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:03.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.465+0000 7f627259c640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f62540664a0 0x7f6254068960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6274167f70 tx=0x7f626c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:03.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.469+0000 7f626affd640 1 -- 172.21.15.2:0/3818958389 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62640ebc40 con 0x7f627415d420 2023-11-04T01:46:03.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.681+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f62740744a0 con 0x7f627415d420 2023-11-04T01:46:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.725+0000 7f626affd640 1 -- 172.21.15.2:0/3818958389 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7137 v51) v1 ==== 112+0+0 (secure 0 0 0) 0x7f62640ef260 con 0x7f627415d420 2023-11-04T01:46:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.7137 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f62540664a0 msgr2=0x7f6254068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f62540664a0 0x7f6254068960 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6274167f70 tx=0x7f626c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 msgr2=0x7f62741533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f62741533f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f62640ad040 tx=0x7f626401ac70 comp rx=0 tx=0).stop 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 shutdown_connections 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f62540664a0 0x7f6254068960 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f627415d420 0x7f62741533f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f62740b26c0 0x7f62740c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 --2- 172.21.15.2:0/3818958389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f627406b580 0x7f627415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 >> 172.21.15.2:0/3818958389 conn(0x7f627409a030 msgr2=0x7f62740d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 shutdown_connections 2023-11-04T01:46:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:03.729+0000 7f6278a5e640 1 -- 172.21.15.2:0/3818958389 wait complete. 2023-11-04T01:46:03.750 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 1 2023-11-04T01:46:03.892 INFO:teuthology.orchestra.run.smithi090.stdout:{"success":"mds_kill_mdstable_at = '1' (not observed, change may require restart) "} 2023-11-04T01:46:03.892 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '1' (not observed, change may require restart) " } 2023-11-04T01:46:03.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:03.893 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s11) 2023-11-04T01:46:03.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:46:03.907 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3bae8df640 time 2023-11-04T01:46:03.908355+0000 2023-11-04T01:46:03.907 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:46:03.908 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.908 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3bb4a0bfae] 2023-11-04T01:46:03.908 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.908 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7f3bae8df640 thread_name:ms_dispatch 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:46:03.903+0000 7f3bae8df640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3bae8df640 time 2023-11-04T01:46:03.908355+0000 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:46:03.909 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3bb4a0bfae] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.910 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.911 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.911 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.911 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.911 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3bb4346520] 2023-11-04T01:46:03.911 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:03.911 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:03.911 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3bb4a0c008] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.912 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:46:03.903+0000 7f3bae8df640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7f3bae8df640 thread_name:ms_dispatch 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3bb4346520] 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3bb4a0c008] 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.913 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:03.914 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.915 INFO:tasks.ceph.mds.d.smithi090.stderr: -2794> 2023-11-04T01:45:40.619+0000 7f3bac0da640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:03.917 INFO:tasks.ceph.mds.d.smithi090.stderr: -1292> 2023-11-04T01:45:50.623+0000 7f3bac0da640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr: -1> 2023-11-04T01:46:03.903+0000 7f3bae8df640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3bae8df640 time 2023-11-04T01:46:03.908355+0000 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3bb4a0bfae] 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.919 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 0> 2023-11-04T01:46:03.903+0000 7f3bae8df640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7f3bae8df640 thread_name:ms_dispatch 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.920 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3bb4346520] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3bb4a0c008] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.921 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.922 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.922 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.922 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.922 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:03.922 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.922 INFO:tasks.ceph.mds.d.smithi090.stderr: -2794> 2023-11-04T01:45:40.619+0000 7f3bac0da640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:03.924 INFO:tasks.ceph.mds.d.smithi090.stderr: -1292> 2023-11-04T01:45:50.623+0000 7f3bac0da640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:03.925 INFO:tasks.ceph.mds.d.smithi090.stderr: -1> 2023-11-04T01:46:03.903+0000 7f3bae8df640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_prepare(ceph::cref_t&)' thread 7f3bae8df640 time 2023-11-04T01:46:03.908355+0000 2023-11-04T01:46:03.925 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 61: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 1) 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3bb4a0bfae] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.926 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 0> 2023-11-04T01:46:03.903+0000 7f3bae8df640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7f3bae8df640 thread_name:ms_dispatch 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3bb4346520] 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3bb4a0c008] 2023-11-04T01:46:03.927 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f3bb4a0c162] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x341) [0x559a94616c01] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x559a943af969] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x559a943b19eb] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559a943b1ebc] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x559a9439c7f5] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f3bb4bf7f2a] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f3bb4c8a7f1] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f3bb4398b43] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f3bb442aa00] 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:03.928 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:04.070 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:46:04.070 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:46:04.071 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:04.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.181+0000 7f2bb6320640 1 Processor -- start 2023-11-04T01:46:04.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.181+0000 7f2bb6320640 1 -- start start 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2bb6320640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2bb006c1a0 0x7f2bb0164800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2bb6320640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb0159e30 con 0x7f2bb0159a50 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2bb6320640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb00ccfd0 con 0x7f2bb00ce720 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2bb6320640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb0070b80 con 0x7f2bb006c1a0 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2bb0159a50 0x7f2bb00cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35030/0 (socket says 172.21.15.2:35030) 2023-11-04T01:46:04.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 -- 172.21.15.2:0/546453685 learned_addr learned my addr 172.21.15.2:0/546453685 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2bb48bd640 1 --2- 172.21.15.2:0/546453685 >> v2:172.21.15.90:3300/0 conn(0x7f2bb006c1a0 0x7f2bb0164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577374824 0 0) 0x7f2b98001120 con 0x7f2bb0159a50 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b9c003530 con 0x7f2bb0159a50 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1498242617 0 0) 0x7f2b9c003530 con 0x7f2bb0159a50 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 >> v2:172.21.15.90:3300/0 conn(0x7f2bb006c1a0 msgr2=0x7f2bb0164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 --2- 172.21.15.2:0/546453685 >> v2:172.21.15.90:3300/0 conn(0x7f2bb006c1a0 0x7f2bb0164800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 >> v1:172.21.15.90:6789/0 conn(0x7f2bb00ce720 legacy=0x7f2bb006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb00cd2b0 con 0x7f2bb0159a50 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2b98001810 con 0x7f2bb0159a50 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 >> v1:172.21.15.2:6789/0 conn(0x7f2bb0159a50 legacy=0x7f2bb00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c003980 0x7f2b9c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9c0047d0 0x7f2b9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c005190 0x7f2b9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0070b80 con 0x7f2b9c003980 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c00c040 con 0x7f2b9c0047d0 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c00c200 con 0x7f2b9c005190 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c003980 0x7f2b9c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 -- 172.21.15.2:0/546453685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c005190 msgr2=0x7f2b9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c005190 0x7f2b9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 -- 172.21.15.2:0/546453685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9c0047d0 msgr2=0x7f2b9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:04.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b9c0047d0 0x7f2b9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2baffff640 1 -- 172.21.15.2:0/546453685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c003530 con 0x7f2b9c003980 2023-11-04T01:46:04.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.185+0000 7f2bb48bd640 1 -- 172.21.15.2:0/546453685 reap_dead start 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2baffff640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c003980 0x7f2b9c003da0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800c240 tx=0x7f2b9801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c936dae13be0cd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98005ae0 con 0x7f2b9c003980 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980ab070 con 0x7f2b9c003980 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2baf7fe640 1 -- 172.21.15.2:0/546453685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98007070 con 0x7f2b9c003980 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- 172.21.15.2:0/546453685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c003980 msgr2=0x7f2b9c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c003980 0x7f2b9c003da0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800c240 tx=0x7f2b9801f370 comp rx=0 tx=0).stop 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- 172.21.15.2:0/546453685 shutdown_connections 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 --2- 172.21.15.2:0/546453685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b9c003980 0x7f2b9c003da0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- 172.21.15.2:0/546453685 >> 172.21.15.2:0/546453685 conn(0x7f2bb00cebb0 msgr2=0x7f2bb00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:04.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- 172.21.15.2:0/546453685 shutdown_connections 2023-11-04T01:46:04.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- 172.21.15.2:0/546453685 wait complete. 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 Processor -- start 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- start start 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c003980 0x7f2bb01e6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bb0154b50 0x7f2bb01544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bb01e4ae0 0x7f2bb00b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb01e3d60 con 0x7f2bb0154b50 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb01e4000 con 0x7f2bb01e4ae0 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb6320640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb01e42e0 con 0x7f2b9c003980 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bb0154b50 0x7f2bb01544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bb0154b50 0x7f2bb01544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49632/0 (socket says 172.21.15.2:49632) 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 -- 172.21.15.2:0/299877149 learned_addr learned my addr 172.21.15.2:0/299877149 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2baffff640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c003980 0x7f2bb01e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb48bd640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bb01e4ae0 0x7f2bb00b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 -- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c003980 msgr2=0x7f2bb01e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c003980 0x7f2bb01e6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 -- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bb01e4ae0 msgr2=0x7f2bb00b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bb01e4ae0 0x7f2bb00b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 -- 172.21.15.2:0/299877149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb01e45c0 con 0x7f2bb0154b50 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2bb48bd640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bb01e4ae0 0x7f2bb00b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.189+0000 7f2ba77fe640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bb0154b50 0x7f2bb01544b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c490 tx=0x7f2ba000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:04.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bad7fa640 1 -- 172.21.15.2:0/299877149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00052d0 con 0x7f2bb0154b50 2023-11-04T01:46:04.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bad7fa640 1 -- 172.21.15.2:0/299877149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba0005450 con 0x7f2bb0154b50 2023-11-04T01:46:04.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb01e5f10 con 0x7f2bb0154b50 2023-11-04T01:46:04.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bad7fa640 1 -- 172.21.15.2:0/299877149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0012870 con 0x7f2bb0154b50 2023-11-04T01:46:04.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb01e5b30 con 0x7f2bb0154b50 2023-11-04T01:46:04.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb0068310 con 0x7f2bb0154b50 2023-11-04T01:46:04.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bad7fa640 1 -- 172.21.15.2:0/299877149 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ba00129d0 con 0x7f2bb0154b50 2023-11-04T01:46:04.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bad7fa640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b900664a0 0x7f2b90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:04.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2bad7fa640 1 -- 172.21.15.2:0/299877149 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6772+0+0 (secure 0 0 0) 0x7f2ba0084880 con 0x7f2bb0154b50 2023-11-04T01:46:04.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2baffff640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b900664a0 0x7f2b90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:04.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.193+0000 7f2baffff640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b900664a0 0x7f2b90068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b980af000 tx=0x7f2b980aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:04.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.197+0000 7f2bad7fa640 1 -- 172.21.15.2:0/299877149 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ba00519b0 con 0x7f2bb0154b50 2023-11-04T01:46:04.225 INFO:tasks.ceph.mds.d.smithi090.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:46:04.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.385+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bb00744a0 con 0x7f2bb0154b50 2023-11-04T01:46:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.385+0000 7f2bad7fa640 1 -- 172.21.15.2:0/299877149 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f2ba0019300 con 0x7f2bb0154b50 2023-11-04T01:46:04.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:04.391 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:03.686865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:04.391 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 51 2023-11-04T01:46:04.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b900664a0 msgr2=0x7f2b90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b900664a0 0x7f2b90068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b980af000 tx=0x7f2b980aa000 comp rx=0 tx=0).stop 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bb0154b50 msgr2=0x7f2bb01544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bb0154b50 0x7f2bb01544b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000c490 tx=0x7f2ba000c950 comp rx=0 tx=0).stop 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 shutdown_connections 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b900664a0 0x7f2b90068960 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bb01e4ae0 0x7f2bb00b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bb0154b50 0x7f2bb01544b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 --2- 172.21.15.2:0/299877149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b9c003980 0x7f2bb01e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 >> 172.21.15.2:0/299877149 conn(0x7f2bb00cebb0 msgr2=0x7f2bb00c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 shutdown_connections 2023-11-04T01:46:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:04.389+0000 7f2bb6320640 1 -- 172.21.15.2:0/299877149 wait complete. 2023-11-04T01:46:04.408 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:09.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:46:09.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f7664a5b640 1 Processor -- start 2023-11-04T01:46:09.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f7664a5b640 1 -- start start 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f7664a5b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f766015a1f0 0x7f76600cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f7664a5b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600b0d40 0x7f76600704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f7664a5b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600ccee0 con 0x7f76600cdea0 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f7664a5b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766015a5d0 con 0x7f766015a1f0 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f7664a5b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600ca900 con 0x7f76600b0d40 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765ed9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600b0d40 0x7f76600704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765e59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f766015a1f0 0x7f76600cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765e59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f766015a1f0 0x7f76600cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:38216/0 (socket says 172.21.15.2:38216) 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765dd9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f76600cdea0 0x7f76600b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:58742/0 (socket says 172.21.15.2:58742) 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765ed9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600b0d40 0x7f76600704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:37152/0 (socket says 172.21.15.2:37152) 2023-11-04T01:46:09.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765e59c640 1 -- 172.21.15.2:0/2456880892 learned_addr learned my addr 172.21.15.2:0/2456880892 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765e59c640 1 -- 172.21.15.2:0/2456880892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600b0d40 msgr2=0x7f76600704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765e59c640 1 --2- 172.21.15.2:0/2456880892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600b0d40 0x7f76600704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765e59c640 1 -- 172.21.15.2:0/2456880892 >> v1:172.21.15.90:6789/0 conn(0x7f76600cdea0 legacy=0x7f76600b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.541+0000 7f765e59c640 1 -- 172.21.15.2:0/2456880892 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600cabe0 con 0x7f766015a1f0 2023-11-04T01:46:09.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f765e59c640 1 --2- 172.21.15.2:0/2456880892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76600cd370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7650009870 tx=0x7f765001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8168ea9c1863f561 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f765d59a640 1 -- 172.21.15.2:0/2456880892 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500aa670 con 0x7f766015a1f0 2023-11-04T01:46:09.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f765d59a640 1 -- 172.21.15.2:0/2456880892 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500aa7d0 con 0x7f766015a1f0 2023-11-04T01:46:09.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f765d59a640 1 -- 172.21.15.2:0/2456880892 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500aab60 con 0x7f766015a1f0 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- 172.21.15.2:0/2456880892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 msgr2=0x7f76600cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 --2- 172.21.15.2:0/2456880892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76600cd370 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7650009870 tx=0x7f765001c510 comp rx=0 tx=0).stop 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- 172.21.15.2:0/2456880892 shutdown_connections 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 --2- 172.21.15.2:0/2456880892 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600b0d40 0x7f76600704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 --2- 172.21.15.2:0/2456880892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76600cd370 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- 172.21.15.2:0/2456880892 >> 172.21.15.2:0/2456880892 conn(0x7f76600cebb0 msgr2=0x7f76600cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- 172.21.15.2:0/2456880892 shutdown_connections 2023-11-04T01:46:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- 172.21.15.2:0/2456880892 wait complete. 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 Processor -- start 2023-11-04T01:46:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- start start 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76600b0d40 0x7f7660152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600cdea0 0x7f76600b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76601531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c3860 con 0x7f76600b0d40 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c4b40 con 0x7f766015a1f0 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f7664a5b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c4e20 con 0x7f76600cdea0 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.545+0000 7f765e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76600b0d40 0x7f7660152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76600b0d40 0x7f7660152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49646/0 (socket says 172.21.15.2:49646) 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 -- 172.21.15.2:0/3088999354 learned_addr learned my addr 172.21.15.2:0/3088999354 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765dd9b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600cdea0 0x7f76600b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765ed9d640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76601531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 -- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600cdea0 msgr2=0x7f76600b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600cdea0 0x7f76600b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 -- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 msgr2=0x7f76601531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76601531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 -- 172.21.15.2:0/3088999354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094d0 con 0x7f76600b0d40 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765ed9d640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76601531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765e59c640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76600b0d40 0x7f7660152a00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f76500ac040 tx=0x7f765001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f764effd640 1 -- 172.21.15.2:0/3088999354 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500b3800 con 0x7f76600b0d40 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f764effd640 1 -- 172.21.15.2:0/3088999354 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500b3980 con 0x7f76600b0d40 2023-11-04T01:46:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600b1970 con 0x7f76600b0d40 2023-11-04T01:46:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f764effd640 1 -- 172.21.15.2:0/3088999354 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500b3d30 con 0x7f76600b0d40 2023-11-04T01:46:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7660152f40 con 0x7f76600b0d40 2023-11-04T01:46:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76600b17d0 con 0x7f76600b0d40 2023-11-04T01:46:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f764effd640 1 -- 172.21.15.2:0/3088999354 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76500c8430 con 0x7f76600b0d40 2023-11-04T01:46:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f764effd640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76400664d0 0x7f7640068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f764effd640 1 -- 172.21.15.2:0/3088999354 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6888+0+0 (secure 0 0 0) 0x7f765011ebe0 con 0x7f76600b0d40 2023-11-04T01:46:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.549+0000 7f765dd9b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76400664d0 0x7f7640068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.553+0000 7f765dd9b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76400664d0 0x7f7640068990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f76600b4940 tx=0x7f7654007e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.553+0000 7f764effd640 1 -- 172.21.15.2:0/3088999354 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f76500ebd50 con 0x7f76600b0d40 2023-11-04T01:46:09.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.745+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76600b17d0 con 0x7f76600b0d40 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.745+0000 7f764effd640 1 -- 172.21.15.2:0/3088999354 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4921 (secure 0 0 0) 0x7f76600b17d0 con 0x7f76600b0d40 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:03.686865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 51 2023-11-04T01:46:09.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76400664d0 msgr2=0x7f7640068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76400664d0 0x7f7640068990 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f76600b4940 tx=0x7f7654007e50 comp rx=0 tx=0).stop 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76600b0d40 msgr2=0x7f7660152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76600b0d40 0x7f7660152a00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f76500ac040 tx=0x7f765001ad50 comp rx=0 tx=0).stop 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 shutdown_connections 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f76400664d0 0x7f7640068990 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f766015a1f0 0x7f76601531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f76600cdea0 0x7f76600b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 --2- 172.21.15.2:0/3088999354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76600b0d40 0x7f7660152a00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 >> 172.21.15.2:0/3088999354 conn(0x7f76600cebb0 msgr2=0x7f7660155c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 shutdown_connections 2023-11-04T01:46:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:09.749+0000 7f7664a5b640 1 -- 172.21.15.2:0/3088999354 wait complete. 2023-11-04T01:46:09.768 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:14.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea0792f640 1 Processor -- start 2023-11-04T01:46:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea0792f640 1 -- start start 2023-11-04T01:46:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea0792f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea000cb400 0x7fea000cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea0792f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea000cd6d0 0x7fea000cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea0792f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea000d0a60 con 0x7fea0015afb0 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea0792f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0015b390 con 0x7fea000cd6d0 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea0792f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000d04a0 con 0x7fea000cb400 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea05ecc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea000cd6d0 0x7fea000cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea05ecc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fea000cd6d0 0x7fea000cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35460/0 (socket says 172.21.15.2:35460) 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea05ecc640 1 -- 172.21.15.2:0/2216443754 learned_addr learned my addr 172.21.15.2:0/2216443754 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea04eca640 1 --2- 172.21.15.2:0/2216443754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea000cb400 0x7fea000cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea05ecc640 1 -- 172.21.15.2:0/2216443754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea000cb400 msgr2=0x7fea000cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea05ecc640 1 --2- 172.21.15.2:0/2216443754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea000cb400 0x7fea000cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea05ecc640 1 -- 172.21.15.2:0/2216443754 >> v1:172.21.15.90:6789/0 conn(0x7fea0015afb0 legacy=0x7fea000b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.905+0000 7fea05ecc640 1 -- 172.21.15.2:0/2216443754 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000d0780 con 0x7fea000cd6d0 2023-11-04T01:46:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea05ecc640 1 --2- 172.21.15.2:0/2216443754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea000cdae0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009e50 tx=0x7fe9f801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf56a55525a95cac server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fe9f7fff640 1 -- 172.21.15.2:0/2216443754 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80a5730 con 0x7fea000cd6d0 2023-11-04T01:46:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fe9f7fff640 1 -- 172.21.15.2:0/2216443754 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80a5890 con 0x7fea000cd6d0 2023-11-04T01:46:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fe9f7fff640 1 -- 172.21.15.2:0/2216443754 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80a5c20 con 0x7fea000cd6d0 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- 172.21.15.2:0/2216443754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 msgr2=0x7fea000cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 --2- 172.21.15.2:0/2216443754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea000cdae0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009e50 tx=0x7fe9f801c980 comp rx=0 tx=0).stop 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- 172.21.15.2:0/2216443754 shutdown_connections 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 --2- 172.21.15.2:0/2216443754 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea000cdae0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 --2- 172.21.15.2:0/2216443754 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea000cb400 0x7fea000cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- 172.21.15.2:0/2216443754 >> 172.21.15.2:0/2216443754 conn(0x7fea00065dc0 msgr2=0x7fea000661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- 172.21.15.2:0/2216443754 shutdown_connections 2023-11-04T01:46:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- 172.21.15.2:0/2216443754 wait complete. 2023-11-04T01:46:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 Processor -- start 2023-11-04T01:46:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- start start 2023-11-04T01:46:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea000cb400 0x7fea00154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea001524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0015afb0 0x7fea0015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0015f710 con 0x7fea000cd6d0 2023-11-04T01:46:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea000cb0f0 con 0x7fea000cb400 2023-11-04T01:46:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea0792f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea00152a20 con 0x7fea0015afb0 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea001524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea001524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35472/0 (socket says 172.21.15.2:35472) 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 -- 172.21.15.2:0/1014933827 learned_addr learned my addr 172.21.15.2:0/1014933827 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea05ecc640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0015afb0 0x7fea0015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea056cb640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea000cb400 0x7fea00154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 -- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0015afb0 msgr2=0x7fea0015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0015afb0 0x7fea0015a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 -- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea000cb400 msgr2=0x7fea00154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea000cb400 0x7fea00154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 -- 172.21.15.2:0/1014933827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009b30 con 0x7fea000cd6d0 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea056cb640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea000cb400 0x7fea00154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.909+0000 7fea04eca640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea001524e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000d800 tx=0x7fe9f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fe9f5ffb640 1 -- 172.21.15.2:0/1014933827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000b6c0 con 0x7fea000cd6d0 2023-11-04T01:46:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fe9f5ffb640 1 -- 172.21.15.2:0/1014933827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f000b820 con 0x7fea000cd6d0 2023-11-04T01:46:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea000cab70 con 0x7fea000cd6d0 2023-11-04T01:46:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fe9f5ffb640 1 -- 172.21.15.2:0/1014933827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f000bbb0 con 0x7fea000cd6d0 2023-11-04T01:46:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea000cae10 con 0x7fea000cd6d0 2023-11-04T01:46:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0015f850 con 0x7fea000cd6d0 2023-11-04T01:46:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fe9f5ffb640 1 -- 172.21.15.2:0/1014933827 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9f000bd10 con 0x7fea000cd6d0 2023-11-04T01:46:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fe9f5ffb640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9e40664a0 0x7fe9e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fe9f5ffb640 1 -- 172.21.15.2:0/1014933827 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6888+0+0 (secure 0 0 0) 0x7fe9f0084710 con 0x7fea000cd6d0 2023-11-04T01:46:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fea056cb640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9e40664a0 0x7fe9e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.913+0000 7fea056cb640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9e40664a0 0x7fe9e4068960 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fea00066610 tx=0x7fe9fc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:14.917+0000 7fe9f5ffb640 1 -- 172.21.15.2:0/1014933827 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fea0015f850 con 0x7fea000cd6d0 2023-11-04T01:46:15.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.109+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea0015f850 con 0x7fea000cd6d0 2023-11-04T01:46:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.109+0000 7fe9f5ffb640 1 -- 172.21.15.2:0/1014933827 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4921 (secure 0 0 0) 0x7fea0015f850 con 0x7fea000cd6d0 2023-11-04T01:46:15.114 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:15.114 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:03.686865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:15.114 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 51 2023-11-04T01:46:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9e40664a0 msgr2=0x7fe9e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9e40664a0 0x7fe9e4068960 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fea00066610 tx=0x7fe9fc009040 comp rx=0 tx=0).stop 2023-11-04T01:46:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 msgr2=0x7fea001524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea001524e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000d800 tx=0x7fe9f000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 shutdown_connections 2023-11-04T01:46:15.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9e40664a0 0x7fe9e4068960 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fea0015afb0 0x7fea0015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fea000cd6d0 0x7fea001524e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 --2- 172.21.15.2:0/1014933827 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fea000cb400 0x7fea00154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 >> 172.21.15.2:0/1014933827 conn(0x7fea00065dc0 msgr2=0x7fea000b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 shutdown_connections 2023-11-04T01:46:15.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:15.113+0000 7fea0792f640 1 -- 172.21.15.2:0/1014933827 wait complete. 2023-11-04T01:46:15.133 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:15.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:46:20.134 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1af4b2640 1 Processor -- start 2023-11-04T01:46:20.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1af4b2640 1 -- start start 2023-11-04T01:46:20.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1af4b2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80c3ec0 0x7fd1a80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1af4b2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1a80d12d0 0x7fd1a80d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1af4b2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a80ceeb0 con 0x7fd1a8161640 2023-11-04T01:46:20.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1af4b2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a806d300 con 0x7fd1a80d12d0 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1af4b2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a81660e0 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1ad24e640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd1a8161640 0x7fd1a806b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41062/0 (socket says 172.21.15.2:41062) 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1ad24e640 1 -- 172.21.15.2:0/61035521 learned_addr learned my addr 172.21.15.2:0/61035521 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1ada4f640 1 --2- 172.21.15.2:0/61035521 >> v2:172.21.15.2:3300/0 conn(0x7fd1a80d12d0 0x7fd1a80d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1aca4d640 1 --2- 172.21.15.2:0/61035521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80c3ec0 0x7fd1a80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1a7fff640 1 -- 172.21.15.2:0/61035521 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205833528 0 0) 0x7fd1a80ceeb0 con 0x7fd1a8161640 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1a7fff640 1 -- 172.21.15.2:0/61035521 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd190003530 con 0x7fd1a8161640 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1ada4f640 1 -- 172.21.15.2:0/61035521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80c3ec0 msgr2=0x7fd1a80b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1ada4f640 1 --2- 172.21.15.2:0/61035521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80c3ec0 0x7fd1a80b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1ada4f640 1 -- 172.21.15.2:0/61035521 >> v1:172.21.15.2:6789/0 conn(0x7fd1a8161640 legacy=0x7fd1a806b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.265+0000 7fd1ada4f640 1 -- 172.21.15.2:0/61035521 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8165b60 con 0x7fd1a80d12d0 2023-11-04T01:46:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1ada4f640 1 --2- 172.21.15.2:0/61035521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80d12d0 0x7fd1a80d1760 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00097c0 tx=0x7fd1a001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8808c86ed11cd285 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1a7fff640 1 -- 172.21.15.2:0/61035521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00ac620 con 0x7fd1a80d12d0 2023-11-04T01:46:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1a7fff640 1 -- 172.21.15.2:0/61035521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a00ac780 con 0x7fd1a80d12d0 2023-11-04T01:46:20.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1a7fff640 1 -- 172.21.15.2:0/61035521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00acb10 con 0x7fd1a80d12d0 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 -- 172.21.15.2:0/61035521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80d12d0 msgr2=0x7fd1a80d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/61035521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80d12d0 0x7fd1a80d1760 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00097c0 tx=0x7fd1a001c3c0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 -- 172.21.15.2:0/61035521 shutdown_connections 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/61035521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80d12d0 0x7fd1a80d1760 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/61035521 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80c3ec0 0x7fd1a80b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 -- 172.21.15.2:0/61035521 >> 172.21.15.2:0/61035521 conn(0x7fd1a8065dc0 msgr2=0x7fd1a80661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 -- 172.21.15.2:0/61035521 shutdown_connections 2023-11-04T01:46:20.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 -- 172.21.15.2:0/61035521 wait complete. 2023-11-04T01:46:20.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 Processor -- start 2023-11-04T01:46:20.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.269+0000 7fd1af4b2640 1 -- start start 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80c3ec0 0x7fd1a81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80d12d0 0x7fd1a80c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1a8161640 0x7fd1a8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8156320 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a81542d0 con 0x7fd1a8161640 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8154b10 con 0x7fd1a80d12d0 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80c3ec0 0x7fd1a81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80c3ec0 0x7fd1a81544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35486/0 (socket says 172.21.15.2:35486) 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 -- 172.21.15.2:0/3954908896 learned_addr learned my addr 172.21.15.2:0/3954908896 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1aca4d640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80d12d0 0x7fd1a80c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ada4f640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1a8161640 0x7fd1a8153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 -- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80d12d0 msgr2=0x7fd1a80c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80d12d0 0x7fd1a80c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 -- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1a8161640 msgr2=0x7fd1a8153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1a8161640 0x7fd1a8153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 -- 172.21.15.2:0/3954908896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0009420 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ada4f640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1a8161640 0x7fd1a8153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1ad24e640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80c3ec0 0x7fd1a81544c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fd19800cb70 tx=0x7fd19800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1a5ffb640 1 -- 172.21.15.2:0/3954908896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800ad40 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1a5ffb640 1 -- 172.21.15.2:0/3954908896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198012400 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1a5ffb640 1 -- 172.21.15.2:0/3954908896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800aea0 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a8154df0 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a81553b0 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a80675f0 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1a5ffb640 1 -- 172.21.15.2:0/3954908896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd198007070 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1a5ffb640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1940664a0 0x7fd194068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1a5ffb640 1 -- 172.21.15.2:0/3954908896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6888+0+0 (secure 0 0 0) 0x7fd1980842d0 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.273+0000 7fd1aca4d640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1940664a0 0x7fd194068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.277+0000 7fd1aca4d640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1940664a0 0x7fd194068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80b3710 tx=0x7fd19c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.277+0000 7fd1a5ffb640 1 -- 172.21.15.2:0/3954908896 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd198051340 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.465+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1a80b2c00 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.465+0000 7fd1a5ffb640 1 -- 172.21.15.2:0/3954908896 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4969 (secure 0 0 0) 0x7fd198054960 con 0x7fd1a80c3ec0 2023-11-04T01:46:20.470 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:20.470 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7125,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:19.575115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7137,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7137":{"gid":7137,"name":"d","rank":0,"incarnation":41,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/1345296201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1345296201},{"type":"v1","addr":"172.21.15.90:6837","nonce":1345296201}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:46:19.575115+0000","export_targets":[1],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:20.470 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 52 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1940664a0 msgr2=0x7fd194068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1940664a0 0x7fd194068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80b3710 tx=0x7fd19c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80c3ec0 msgr2=0x7fd1a81544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80c3ec0 0x7fd1a81544c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fd19800cb70 tx=0x7fd19800a430 comp rx=0 tx=0).stop 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 shutdown_connections 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1940664a0 0x7fd194068960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1a8161640 0x7fd1a8153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1a80d12d0 0x7fd1a80c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 --2- 172.21.15.2:0/3954908896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1a80c3ec0 0x7fd1a81544c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 >> 172.21.15.2:0/3954908896 conn(0x7fd1a8065dc0 msgr2=0x7fd1a815e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 shutdown_connections 2023-11-04T01:46:20.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.469+0000 7fd1af4b2640 1 -- 172.21.15.2:0/3954908896 wait complete. 2023-11-04T01:46:20.487 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:46:20.487 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:46:20.500 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:46:20.501 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:46:20.502 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:46:20.572 INFO:teuthology.orchestra.run.smithi090.stdout:1699062363.44042.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:46:20.574 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062363.44042.core'] 2023-11-04T01:46:20.574 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062363.44042.core, deleting it 2023-11-04T01:46:20.575 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062363.44042.core 2023-11-04T01:46:20.635 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:46:20.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 Processor -- start 2023-11-04T01:46:20.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 -- start start 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7a7415afd0 0x7f7a740715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7a7406f8f0 0x7f7a740b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a74070140 con 0x7f7a7415afd0 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740b1000 con 0x7f7a7406f8f0 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a79767640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7406c9f0 con 0x7f7a740b0b70 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a72ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7a7415afd0 0x7f7a740715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a72ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7a7415afd0 0x7f7a740715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35488/0 (socket says 172.21.15.2:35488) 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a72ffd640 1 -- 172.21.15.2:0/269104928 learned_addr learned my addr 172.21.15.2:0/269104928 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:20.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a737fe640 1 --2- 172.21.15.2:0/269104928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.757+0000 7f7a6bfff640 1 --2- 172.21.15.2:0/269104928 >> v2:172.21.15.90:3300/0 conn(0x7f7a7406f8f0 0x7f7a740b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.761+0000 7f7a72ffd640 1 -- 172.21.15.2:0/269104928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 msgr2=0x7f7a740c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.761+0000 7f7a72ffd640 1 --2- 172.21.15.2:0/269104928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.761+0000 7f7a72ffd640 1 -- 172.21.15.2:0/269104928 >> v2:172.21.15.90:3300/0 conn(0x7f7a7406f8f0 msgr2=0x7f7a740b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.761+0000 7f7a72ffd640 1 --2- 172.21.15.2:0/269104928 >> v2:172.21.15.90:3300/0 conn(0x7f7a7406f8f0 0x7f7a740b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.761+0000 7f7a72ffd640 1 -- 172.21.15.2:0/269104928 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740c2670 con 0x7f7a7415afd0 2023-11-04T01:46:20.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.761+0000 7f7a72ffd640 1 --2- 172.21.15.2:0/269104928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415afd0 0x7f7a740715d0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7a740ce900 tx=0x7f7a6401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c800a2d0238b95d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a727fc640 1 -- 172.21.15.2:0/269104928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640ab600 con 0x7f7a7415afd0 2023-11-04T01:46:20.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a727fc640 1 -- 172.21.15.2:0/269104928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640a7050 con 0x7f7a7415afd0 2023-11-04T01:46:20.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a727fc640 1 -- 172.21.15.2:0/269104928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640ab980 con 0x7f7a7415afd0 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- 172.21.15.2:0/269104928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415afd0 msgr2=0x7f7a740715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 --2- 172.21.15.2:0/269104928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415afd0 0x7f7a740715d0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7a740ce900 tx=0x7f7a6401c210 comp rx=0 tx=0).stop 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- 172.21.15.2:0/269104928 shutdown_connections 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 --2- 172.21.15.2:0/269104928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 --2- 172.21.15.2:0/269104928 >> v2:172.21.15.90:3300/0 conn(0x7f7a7406f8f0 0x7f7a740b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 --2- 172.21.15.2:0/269104928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7415afd0 0x7f7a740715d0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- 172.21.15.2:0/269104928 >> 172.21.15.2:0/269104928 conn(0x7f7a740cebb0 msgr2=0x7f7a740cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- 172.21.15.2:0/269104928 shutdown_connections 2023-11-04T01:46:20.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- 172.21.15.2:0/269104928 wait complete. 2023-11-04T01:46:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 Processor -- start 2023-11-04T01:46:20.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- start start 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7406f8f0 0x7f7a74150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a7415afd0 0x7f7a740af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a741510f0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7415ea30 con 0x7f7a7415afd0 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740c6920 con 0x7f7a740b0b70 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7406f8f0 0x7f7a74150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7406f8f0 0x7f7a74150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35500/0 (socket says 172.21.15.2:35500) 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 -- 172.21.15.2:0/3448470871 learned_addr learned my addr 172.21.15.2:0/3448470871 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a6bfff640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a737fe640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a7415afd0 0x7f7a740af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 -- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 msgr2=0x7f7a740aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 -- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a7415afd0 msgr2=0x7f7a740af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a7415afd0 0x7f7a740af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 -- 172.21.15.2:0/3448470871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a640094d0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a72ffd640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7406f8f0 0x7f7a74150bb0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7a640ae040 tx=0x7f7a6401aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a6b7fe640 1 -- 172.21.15.2:0/3448470871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640b6420 con 0x7f7a7406f8f0 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a6b7fe640 1 -- 172.21.15.2:0/3448470871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a640b65a0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a740c6c00 con 0x7f7a7406f8f0 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a6b7fe640 1 -- 172.21.15.2:0/3448470871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a640b6950 con 0x7f7a7406f8f0 2023-11-04T01:46:20.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.765+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a740c71c0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.769+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a740c73b0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.769+0000 7f7a6b7fe640 1 -- 172.21.15.2:0/3448470871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a640b2040 con 0x7f7a7406f8f0 2023-11-04T01:46:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.769+0000 7f7a6b7fe640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.769+0000 7f7a6b7fe640 1 -- 172.21.15.2:0/3448470871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6888+0+0 (secure 0 0 0) 0x7f7a6411e3f0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.769+0000 7f7a6bfff640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:20.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.769+0000 7f7a6bfff640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7a740af8a0 tx=0x7f7a5c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:20.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.773+0000 7f7a6b7fe640 1 -- 172.21.15.2:0/3448470871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7a640eb3d0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.981+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f7a740744a0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a6b7fe640 1 -- 172.21.15.2:0/3448470871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7137 v53) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7a640ee9f0 con 0x7f7a7406f8f0 2023-11-04T01:46:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 7137 2023-11-04T01:46:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 msgr2=0x7f7a54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7a740af8a0 tx=0x7f7a5c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7406f8f0 msgr2=0x7f7a74150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:20.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7406f8f0 0x7f7a74150bb0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7a640ae040 tx=0x7f7a6401aa50 comp rx=0 tx=0).stop 2023-11-04T01:46:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 shutdown_connections 2023-11-04T01:46:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7a540664a0 0x7f7a54068960 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a7415afd0 0x7f7a740af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7a740b0b70 0x7f7a740aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 --2- 172.21.15.2:0/3448470871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a7406f8f0 0x7f7a74150bb0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 >> 172.21.15.2:0/3448470871 conn(0x7f7a740cebb0 msgr2=0x7f7a740cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:20.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.985+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 shutdown_connections 2023-11-04T01:46:20.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:20.989+0000 7f7a79767640 1 -- 172.21.15.2:0/3448470871 wait complete. 2023-11-04T01:46:21.011 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:46:21.011 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:46:21.011 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:46:21.011 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:21.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:21.012 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi090 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:46:21.012 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:46:21.012 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:46:21.015 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:46:21.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:21.090 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:46:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f8ead640 1 Processor -- start 2023-11-04T01:46:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f8ead640 1 -- start start 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f8ead640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0f415afd0 0x7ff0f40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f8ead640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff0f406f8f0 0x7ff0f40b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f8ead640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40c2670 con 0x7ff0f40b0b70 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f8ead640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f4070140 con 0x7ff0f406f8f0 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f8ead640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f415fc90 con 0x7ff0f415afd0 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f1d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff0f406f8f0 0x7ff0f40b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f2d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff0f40b0b70 0x7ff0f40c9170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41072/0 (socket says 172.21.15.2:41072) 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f1d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff0f406f8f0 0x7ff0f40b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35506/0 (socket says 172.21.15.2:35506) 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f2d9d640 1 -- 172.21.15.2:0/551172062 learned_addr learned my addr 172.21.15.2:0/551172062 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f259c640 1 --2- 172.21.15.2:0/551172062 >> v2:172.21.15.90:3300/0 conn(0x7ff0f415afd0 0x7ff0f40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:21.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f1d9b640 1 -- 172.21.15.2:0/551172062 >> v2:172.21.15.90:3300/0 conn(0x7ff0f415afd0 msgr2=0x7ff0f40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f1d9b640 1 --2- 172.21.15.2:0/551172062 >> v2:172.21.15.90:3300/0 conn(0x7ff0f415afd0 0x7ff0f40715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f1d9b640 1 -- 172.21.15.2:0/551172062 >> v1:172.21.15.2:6789/0 conn(0x7ff0f40b0b70 legacy=0x7ff0f40c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f1d9b640 1 -- 172.21.15.2:0/551172062 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f406bc30 con 0x7ff0f406f8f0 2023-11-04T01:46:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.125+0000 7ff0f1d9b640 1 --2- 172.21.15.2:0/551172062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f406f8f0 0x7ff0f40b0630 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40ce980 tx=0x7ff0e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89c2710c524cf10 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f159a640 1 -- 172.21.15.2:0/551172062 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80ab600 con 0x7ff0f406f8f0 2023-11-04T01:46:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f159a640 1 -- 172.21.15.2:0/551172062 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80a7050 con 0x7ff0f406f8f0 2023-11-04T01:46:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f159a640 1 -- 172.21.15.2:0/551172062 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80ab980 con 0x7ff0f406f8f0 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- 172.21.15.2:0/551172062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f406f8f0 msgr2=0x7ff0f40b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/551172062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f406f8f0 0x7ff0f40b0630 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff0f40ce980 tx=0x7ff0e801c460 comp rx=0 tx=0).stop 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- 172.21.15.2:0/551172062 shutdown_connections 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/551172062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f406f8f0 0x7ff0f40b0630 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/551172062 >> v2:172.21.15.90:3300/0 conn(0x7ff0f415afd0 0x7ff0f40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- 172.21.15.2:0/551172062 >> 172.21.15.2:0/551172062 conn(0x7ff0f40cebb0 msgr2=0x7ff0f40cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- 172.21.15.2:0/551172062 shutdown_connections 2023-11-04T01:46:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- 172.21.15.2:0/551172062 wait complete. 2023-11-04T01:46:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 Processor -- start 2023-11-04T01:46:21.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- start start 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0f406f8f0 0x7ff0f4159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f40b0b70 0x7ff0f4151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0f415afd0 0x7ff0f40b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4158060 con 0x7ff0f40b0b70 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f41531b0 con 0x7ff0f415afd0 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f41582b0 con 0x7ff0f406f8f0 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f40b0b70 0x7ff0f4151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f40b0b70 0x7ff0f4151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35510/0 (socket says 172.21.15.2:35510) 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 -- 172.21.15.2:0/2058962012 learned_addr learned my addr 172.21.15.2:0/2058962012 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:21.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f259c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0f406f8f0 0x7ff0f4159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f2d9d640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0f415afd0 0x7ff0f40b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 -- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0f406f8f0 msgr2=0x7ff0f4159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0f406f8f0 0x7ff0f4159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 -- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0f415afd0 msgr2=0x7ff0f40b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0f415afd0 0x7ff0f40b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 -- 172.21.15.2:0/2058962012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e8009420 con 0x7ff0f40b0b70 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f1d9b640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f40b0b70 0x7ff0f4151b80 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80ae040 tx=0x7ff0e8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0e2ffd640 1 -- 172.21.15.2:0/2058962012 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80b4840 con 0x7ff0f40b0b70 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0e2ffd640 1 -- 172.21.15.2:0/2058962012 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80b49c0 con 0x7ff0f40b0b70 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4158590 con 0x7ff0f40b0b70 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0e2ffd640 1 -- 172.21.15.2:0/2058962012 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80b4d70 con 0x7ff0f40b0b70 2023-11-04T01:46:21.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.129+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f4158b50 con 0x7ff0f40b0b70 2023-11-04T01:46:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.133+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f40744a0 con 0x7ff0f40b0b70 2023-11-04T01:46:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.133+0000 7ff0e2ffd640 1 -- 172.21.15.2:0/2058962012 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0e80b2040 con 0x7ff0f40b0b70 2023-11-04T01:46:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.133+0000 7ff0e2ffd640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0d40664d0 0x7ff0d4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.133+0000 7ff0e2ffd640 1 -- 172.21.15.2:0/2058962012 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7ff0e811e500 con 0x7ff0f40b0b70 2023-11-04T01:46:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.133+0000 7ff0f259c640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0d40664d0 0x7ff0d4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.133+0000 7ff0f259c640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0d40664d0 0x7ff0d4068990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4007a60 tx=0x7ff0e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:21.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.137+0000 7ff0e2ffd640 1 -- 172.21.15.2:0/2058962012 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0e80eb4a0 con 0x7ff0f40b0b70 2023-11-04T01:46:21.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.325+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0f406cba0 con 0x7ff0f40b0b70 2023-11-04T01:46:21.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.325+0000 7ff0e2ffd640 1 -- 172.21.15.2:0/2058962012 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4130 (secure 0 0 0) 0x7ff0e80eeac0 con 0x7ff0f40b0b70 2023-11-04T01:46:21.330 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:21.330 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:20.990930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:21.331 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 54 2023-11-04T01:46:21.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0d40664d0 msgr2=0x7ff0d4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0d40664d0 0x7ff0d4068990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4007a60 tx=0x7ff0e4008040 comp rx=0 tx=0).stop 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f40b0b70 msgr2=0x7ff0f4151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f40b0b70 0x7ff0f4151b80 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80ae040 tx=0x7ff0e8019200 comp rx=0 tx=0).stop 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 shutdown_connections 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff0d40664d0 0x7ff0d4068990 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0f415afd0 0x7ff0f40b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff0f40b0b70 0x7ff0f4151b80 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 --2- 172.21.15.2:0/2058962012 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff0f406f8f0 0x7ff0f4159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 >> 172.21.15.2:0/2058962012 conn(0x7ff0f40cebb0 msgr2=0x7ff0f40c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 shutdown_connections 2023-11-04T01:46:21.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:21.329+0000 7ff0f8ead640 1 -- 172.21.15.2:0/2058962012 wait complete. 2023-11-04T01:46:21.347 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:22.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:46:24.949 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:24.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:26.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8393ede640 1 Processor -- start 2023-11-04T01:46:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8393ede640 1 -- start start 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8393ede640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 0x7f838c15f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8393ede640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f838c06a870 0x7f838c0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8393ede640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c0cbe40 con 0x7f838c15b470 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8393ede640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c15fca0 con 0x7f838c06a870 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8393ede640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0cc120 con 0x7f838c15b090 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8391479640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f838c15b470 0x7f838c06a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41674/0 (socket says 172.21.15.2:41674) 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8391479640 1 -- 172.21.15.2:0/4074173366 learned_addr learned my addr 172.21.15.2:0/4074173366 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f839247b640 1 --2- 172.21.15.2:0/4074173366 >> v2:172.21.15.90:3300/0 conn(0x7f838c06a870 0x7f838c0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8391c7a640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 0x7f838c15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636610865 0 0) 0x7f838c0cbe40 con 0x7f838c15b470 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8378003530 con 0x7f838c15b470 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4077248498 0 0) 0x7f8378003530 con 0x7f838c15b470 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 msgr2=0x7f838c15f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 0x7f838c15f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 >> v2:172.21.15.90:3300/0 conn(0x7f838c06a870 msgr2=0x7f838c0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 --2- 172.21.15.2:0/4074173366 >> v2:172.21.15.90:3300/0 conn(0x7f838c06a870 0x7f838c0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0cc400 con 0x7f838c15b470 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f837c001680 con 0x7f838c15b470 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 >> v1:172.21.15.2:6789/0 conn(0x7f838c15b470 legacy=0x7f838c06a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 0x7f8378003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8378003f00 0x7f83780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8378004d10 0x7f8378005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c15fca0 con 0x7f8378004d10 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0cc120 con 0x7f8378003f00 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837800b990 con 0x7f838c15b090 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f839247b640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8378004d10 0x7f8378005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8391c7a640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 0x7f8378003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f8391479640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8378003f00 0x7f83780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f839247b640 1 -- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 msgr2=0x7f8378003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f839247b640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c15b090 0x7f8378003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f839247b640 1 -- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8378003f00 msgr2=0x7f83780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f839247b640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8378003f00 0x7f83780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.481+0000 7f839247b640 1 -- 172.21.15.2:0/4074173366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8378003530 con 0x7f8378004d10 2023-11-04T01:46:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f839247b640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8378004d10 0x7f8378005190 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f838c070260 tx=0x7f838401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d6f1c5f9db711 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840a5c50 con 0x7f8378004d10 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400f040 con 0x7f8378004d10 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8390c78640 1 -- 172.21.15.2:0/4074173366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840ad440 con 0x7f8378004d10 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8393ede640 1 -- 172.21.15.2:0/4074173366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8378004d10 msgr2=0x7f8378005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8393ede640 1 --2- 172.21.15.2:0/4074173366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8378004d10 0x7f8378005190 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f838c070260 tx=0x7f838401cbe0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f839247b640 1 -- 172.21.15.2:0/4074173366 reap_dead start 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8393ede640 1 -- 172.21.15.2:0/4074173366 shutdown_connections 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8393ede640 1 -- 172.21.15.2:0/4074173366 >> 172.21.15.2:0/4074173366 conn(0x7f838c0716a0 msgr2=0x7f838c071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8393ede640 1 -- 172.21.15.2:0/4074173366 shutdown_connections 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.485+0000 7f8393ede640 1 -- 172.21.15.2:0/4074173366 wait complete. 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 Processor -- start 2023-11-04T01:46:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 -- start start 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f838c1540f0 0x7f838c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c154990 0x7f838c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f838c0ce040 0x7f838c0ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0cea30 con 0x7f838c0ce040 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c15daf0 con 0x7f838c1540f0 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c15dd90 con 0x7f838c154990 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f838c0ce040 0x7f838c0ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f838c0ce040 0x7f838c0ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55888/0 (socket says 172.21.15.2:55888) 2023-11-04T01:46:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 -- 172.21.15.2:0/3399884276 learned_addr learned my addr 172.21.15.2:0/3399884276 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8391c7a640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f838c1540f0 0x7f838c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8391479640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c154990 0x7f838c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 -- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c154990 msgr2=0x7f838c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c154990 0x7f838c15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 -- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f838c1540f0 msgr2=0x7f838c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f838c1540f0 0x7f838c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 -- 172.21.15.2:0/3399884276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c15e070 con 0x7f838c0ce040 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f839247b640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f838c0ce040 0x7f838c0ce4f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f83840b0040 tx=0x7f8384009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f83827fc640 1 -- 172.21.15.2:0/3399884276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840ae890 con 0x7f838c0ce040 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f83827fc640 1 -- 172.21.15.2:0/3399884276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83840ae9f0 con 0x7f838c0ce040 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c15e350 con 0x7f838c0ce040 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f83827fc640 1 -- 172.21.15.2:0/3399884276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840aeda0 con 0x7f838c0ce040 2023-11-04T01:46:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c15d570 con 0x7f838c0ce040 2023-11-04T01:46:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c15d820 con 0x7f838c0ce040 2023-11-04T01:46:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f83827fc640 1 -- 172.21.15.2:0/3399884276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83840b4040 con 0x7f838c0ce040 2023-11-04T01:46:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f83827fc640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83700664a0 0x7f8370068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.489+0000 7f83827fc640 1 -- 172.21.15.2:0/3399884276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f838411ec20 con 0x7f838c0ce040 2023-11-04T01:46:26.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.493+0000 7f8391c7a640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83700664a0 0x7f8370068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.493+0000 7f8391c7a640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83700664a0 0x7f8370068960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f838c15cf80 tx=0x7f8388008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.497+0000 7f83827fc640 1 -- 172.21.15.2:0/3399884276 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f838c15d820 con 0x7f838c0ce040 2023-11-04T01:46:26.629 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:46:26.625+0000 7f48514a6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:26.629 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:46:26.625+0000 7f48514a6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:26.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.685+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f838c15e800 con 0x7f838c0ce040 2023-11-04T01:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f83827fc640 1 -- 172.21.15.2:0/3399884276 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f838c15e800 con 0x7f838c0ce040 2023-11-04T01:46:26.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:26.691 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:24.034051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 58 2023-11-04T01:46:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83700664a0 msgr2=0x7f8370068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83700664a0 0x7f8370068960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f838c15cf80 tx=0x7f8388008040 comp rx=0 tx=0).stop 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f838c0ce040 msgr2=0x7f838c0ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f838c0ce040 0x7f838c0ce4f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f83840b0040 tx=0x7f8384009750 comp rx=0 tx=0).stop 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 shutdown_connections 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f83700664a0 0x7f8370068960 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f838c0ce040 0x7f838c0ce4f0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f838c154990 0x7f838c15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 --2- 172.21.15.2:0/3399884276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f838c1540f0 0x7f838c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 >> 172.21.15.2:0/3399884276 conn(0x7f838c0716a0 msgr2=0x7f838c06d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 shutdown_connections 2023-11-04T01:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.689+0000 7f8393ede640 1 -- 172.21.15.2:0/3399884276 wait complete. 2023-11-04T01:46:26.711 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:26.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:26.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.833+0000 7f88955ee640 1 Processor -- start 2023-11-04T01:46:26.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.833+0000 7f88955ee640 1 -- start start 2023-11-04T01:46:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f88955ee640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f88900c9960 0x7f88900cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f88955ee640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900b0c70 0x7f88900ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f88955ee640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88900ce320 con 0x7f88900b0890 2023-11-04T01:46:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f88955ee640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889006d2f0 con 0x7f88900c9960 2023-11-04T01:46:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f88955ee640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88900ce110 con 0x7f88900b0c70 2023-11-04T01:46:26.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888e7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f88900c9960 0x7f88900cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888f7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900b0c70 0x7f88900ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888e7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f88900c9960 0x7f88900cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:58094/0 (socket says 172.21.15.2:58094) 2023-11-04T01:46:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888e7fc640 1 -- 172.21.15.2:0/1732323208 learned_addr learned my addr 172.21.15.2:0/1732323208 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888e7fc640 1 -- 172.21.15.2:0/1732323208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900b0c70 msgr2=0x7f88900ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888e7fc640 1 --2- 172.21.15.2:0/1732323208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900b0c70 0x7f88900ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888e7fc640 1 -- 172.21.15.2:0/1732323208 >> v1:172.21.15.90:6789/0 conn(0x7f88900b0890 legacy=0x7f88900704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.837+0000 7f888e7fc640 1 -- 172.21.15.2:0/1732323208 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88900ce600 con 0x7f88900c9960 2023-11-04T01:46:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f888e7fc640 1 --2- 172.21.15.2:0/1732323208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900c9960 0x7f88900cdbd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f888401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c4c51d1bc08204 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f888dffb640 1 -- 172.21.15.2:0/1732323208 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840aa670 con 0x7f88900c9960 2023-11-04T01:46:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f888dffb640 1 -- 172.21.15.2:0/1732323208 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88840aa7d0 con 0x7f88900c9960 2023-11-04T01:46:26.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f888dffb640 1 -- 172.21.15.2:0/1732323208 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840aab60 con 0x7f88900c9960 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 -- 172.21.15.2:0/1732323208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900c9960 msgr2=0x7f88900cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 --2- 172.21.15.2:0/1732323208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900c9960 0x7f88900cdbd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8884009870 tx=0x7f888401c510 comp rx=0 tx=0).stop 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 -- 172.21.15.2:0/1732323208 shutdown_connections 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 --2- 172.21.15.2:0/1732323208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900b0c70 0x7f88900ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 --2- 172.21.15.2:0/1732323208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900c9960 0x7f88900cdbd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 -- 172.21.15.2:0/1732323208 >> 172.21.15.2:0/1732323208 conn(0x7f88900cebb0 msgr2=0x7f88900cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 -- 172.21.15.2:0/1732323208 shutdown_connections 2023-11-04T01:46:26.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 -- 172.21.15.2:0/1732323208 wait complete. 2023-11-04T01:46:26.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 Processor -- start 2023-11-04T01:46:26.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.841+0000 7f88955ee640 1 -- start start 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900b0890 0x7f88900b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88900b0c70 0x7f889014d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900c9960 0x7f88900b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8890152d20 con 0x7f88900b0c70 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88900b2700 con 0x7f88900b0890 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8890152110 con 0x7f88900c9960 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88900b0c70 0x7f889014d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88900b0c70 0x7f889014d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55896/0 (socket says 172.21.15.2:55896) 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 -- 172.21.15.2:0/3038936373 learned_addr learned my addr 172.21.15.2:0/3038936373 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888f7fe640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900c9960 0x7f88900b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888effd640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900b0890 0x7f88900b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 -- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900c9960 msgr2=0x7f88900b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900c9960 0x7f88900b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 -- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900b0890 msgr2=0x7f88900b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900b0890 0x7f88900b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 -- 172.21.15.2:0/3038936373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840094d0 con 0x7f88900b0c70 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888effd640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900b0890 0x7f88900b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888e7fc640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88900b0c70 0x7f889014d790 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f888401a140 tx=0x7f888401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88777fe640 1 -- 172.21.15.2:0/3038936373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840b3800 con 0x7f88900b0c70 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88777fe640 1 -- 172.21.15.2:0/3038936373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88840b3980 con 0x7f88900b0c70 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88901523f0 con 0x7f88900b0c70 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88777fe640 1 -- 172.21.15.2:0/3038936373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840b3d30 con 0x7f88900b0c70 2023-11-04T01:46:26.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88901529b0 con 0x7f88900b0c70 2023-11-04T01:46:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8890152e90 con 0x7f88900b0c70 2023-11-04T01:46:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88777fe640 1 -- 172.21.15.2:0/3038936373 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88840b2380 con 0x7f88900b0c70 2023-11-04T01:46:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88777fe640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f887c0664d0 0x7f887c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:26.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f88777fe640 1 -- 172.21.15.2:0/3038936373 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f888411ea70 con 0x7f88900b0c70 2023-11-04T01:46:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.845+0000 7f888effd640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f887c0664d0 0x7f887c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:26.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.849+0000 7f888effd640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f887c0664d0 0x7f887c068990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8890164fe0 tx=0x7f8880009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:26.853+0000 7f88777fe640 1 -- 172.21.15.2:0/3038936373 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f88840ebb40 con 0x7f88900b0c70 2023-11-04T01:46:27.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.041+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88900744a0 con 0x7f88900b0c70 2023-11-04T01:46:27.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.041+0000 7f88777fe640 1 -- 172.21.15.2:0/3038936373 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f88840aa630 con 0x7f88900b0c70 2023-11-04T01:46:27.046 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:27.046 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:24.034051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:27.046 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 58 2023-11-04T01:46:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f887c0664d0 msgr2=0x7f887c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f887c0664d0 0x7f887c068990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8890164fe0 tx=0x7f8880009040 comp rx=0 tx=0).stop 2023-11-04T01:46:27.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88900b0c70 msgr2=0x7f889014d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88900b0c70 0x7f889014d790 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f888401a140 tx=0x7f888401ad50 comp rx=0 tx=0).stop 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 shutdown_connections 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f887c0664d0 0x7f887c068990 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f88900c9960 0x7f88900b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88900b0c70 0x7f889014d790 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 --2- 172.21.15.2:0/3038936373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88900b0890 0x7f88900b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 >> 172.21.15.2:0/3038936373 conn(0x7f88900cebb0 msgr2=0x7f889015c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 shutdown_connections 2023-11-04T01:46:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.045+0000 7f88955ee640 1 -- 172.21.15.2:0/3038936373 wait complete. 2023-11-04T01:46:27.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:45:35.008340+0000', 'modified': '2023-11-04T01:46:24.034051+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 95, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7125, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7125': {'gid': 7125, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.2:6833/792110972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 792110972}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 792110972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 48, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.2:6835/3725992406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 3725992406}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3725992406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:46:27.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:46:27.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:46:27.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.601+0000 7f2f4d5d0640 1 Processor -- start 2023-11-04T01:46:27.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.601+0000 7f2f4d5d0640 1 -- start start 2023-11-04T01:46:27.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f480cdea0 0x7f2f480b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480ccee0 con 0x7f2f4815a1f0 2023-11-04T01:46:27.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4815a5d0 con 0x7f2f480ca400 2023-11-04T01:46:27.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480ca900 con 0x7f2f480cdea0 2023-11-04T01:46:27.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f467fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f480cdea0 0x7f2f480b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f46ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2f4815a1f0 0x7f2f480cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41688/0 (socket says 172.21.15.2:41688) 2023-11-04T01:46:27.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f46ffd640 1 -- 172.21.15.2:0/2831567777 learned_addr learned my addr 172.21.15.2:0/2831567777 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:27.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f45ffb640 1 -- 172.21.15.2:0/2831567777 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124755960 0 0) 0x7f2f480ccee0 con 0x7f2f4815a1f0 2023-11-04T01:46:27.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f45ffb640 1 -- 172.21.15.2:0/2831567777 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f30003530 con 0x7f2f4815a1f0 2023-11-04T01:46:27.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f467fc640 1 -- 172.21.15.2:0/2831567777 >> v1:172.21.15.90:6789/0 conn(0x7f2f480ca400 legacy=0x7f2f480704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f467fc640 1 -- 172.21.15.2:0/2831567777 >> v1:172.21.15.2:6789/0 conn(0x7f2f4815a1f0 legacy=0x7f2f480cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f467fc640 1 -- 172.21.15.2:0/2831567777 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480cabe0 con 0x7f2f480cdea0 2023-11-04T01:46:27.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2831567777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480b0630 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0097c0 tx=0x7f2f3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fec88f1047e312 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f45ffb640 1 -- 172.21.15.2:0/2831567777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0ab600 con 0x7f2f480cdea0 2023-11-04T01:46:27.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f45ffb640 1 -- 172.21.15.2:0/2831567777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0a7050 con 0x7f2f480cdea0 2023-11-04T01:46:27.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f45ffb640 1 -- 172.21.15.2:0/2831567777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0ab980 con 0x7f2f480cdea0 2023-11-04T01:46:27.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2831567777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 msgr2=0x7f2f480b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2831567777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480b0630 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0097c0 tx=0x7f2f3c01c480 comp rx=0 tx=0).stop 2023-11-04T01:46:27.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2831567777 shutdown_connections 2023-11-04T01:46:27.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2831567777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480b0630 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.605+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2831567777 >> 172.21.15.2:0/2831567777 conn(0x7f2f480cebb0 msgr2=0x7f2f480cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2831567777 shutdown_connections 2023-11-04T01:46:27.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2831567777 wait complete. 2023-11-04T01:46:27.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 Processor -- start 2023-11-04T01:46:27.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- start start 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f480ca400 0x7f2f480b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f4815a1f0 0x7f2f480ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480afe10 con 0x7f2f480cdea0 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480ad6e0 con 0x7f2f4815a1f0 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480af200 con 0x7f2f480ca400 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55914/0 (socket says 172.21.15.2:55914) 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 -- 172.21.15.2:0/2556242191 learned_addr learned my addr 172.21.15.2:0/2556242191 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f480ca400 0x7f2f480b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f477fe640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f4815a1f0 0x7f2f480ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 -- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f480ca400 msgr2=0x7f2f480b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f480ca400 0x7f2f480b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 -- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f4815a1f0 msgr2=0x7f2f480ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f4815a1f0 0x7f2f480ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 -- 172.21.15.2:0/2556242191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c009420 con 0x7f2f480cdea0 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f480ca400 0x7f2f480b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480aeb20 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ae040 tx=0x7f2f3c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f2f7fe640 1 -- 172.21.15.2:0/2556242191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0b4430 con 0x7f2f480cdea0 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f2f7fe640 1 -- 172.21.15.2:0/2556242191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0b4590 con 0x7f2f480cdea0 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f480af4e0 con 0x7f2f480cdea0 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f2f7fe640 1 -- 172.21.15.2:0/2556242191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0b4940 con 0x7f2f480cdea0 2023-11-04T01:46:27.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.609+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f480afaa0 con 0x7f2f480cdea0 2023-11-04T01:46:27.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f2f7fe640 1 -- 172.21.15.2:0/2556242191 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2f3c0b2040 con 0x7f2f480cdea0 2023-11-04T01:46:27.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f2f7fe640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2f340664a0 0x7f2f34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f2f7fe640 1 -- 172.21.15.2:0/2556242191 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f2f3c11e370 con 0x7f2f480cdea0 2023-11-04T01:46:27.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2f340664a0 0x7f2f34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 Processor -- start 2023-11-04T01:46:27.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 -- start start 2023-11-04T01:46:27.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2f340664a0 0x7f2f34068960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2f380011f0 tx=0x7f2f38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d9835380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d98358c0 0x55d9d97e8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d96b3460 con 0x55d9d97e8b40 2023-11-04T01:46:27.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d9644690 con 0x55d9d98358c0 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9d9641bc0 con 0x55d9d9834fa0 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97e8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55918/0 (socket says 172.21.15.2:55918) 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 -- 172.21.15.2:0/2656320208 learned_addr learned my addr 172.21.15.2:0/2656320208 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d9835380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d98358c0 0x55d9d97e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 -- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 msgr2=0x55d9d9835380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d9835380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 -- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d98358c0 msgr2=0x55d9d97e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d98358c0 0x55d9d97e8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 -- 172.21.15.2:0/2656320208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9d9335890 con 0x55d9d97e8b40 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f477fe640 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97e8f20 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001ca0 tx=0x7f2f40002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d099c748fd7dabb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f2cff9640 1 -- 172.21.15.2:0/2656320208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f40003b90 con 0x55d9d97e8b40 2023-11-04T01:46:27.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f2cff9640 1 -- 172.21.15.2:0/2656320208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f40003cf0 con 0x55d9d97e8b40 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.613+0000 7f2f2cff9640 1 -- 172.21.15.2:0/2656320208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4000ea80 con 0x55d9d97e8b40 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/2656320208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 msgr2=0x55d9d97e8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97e8f20 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001ca0 tx=0x7f2f40002160 comp rx=0 tx=0).stop 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/2656320208 shutdown_connections 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97e8f20 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d98358c0 0x55d9d97e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2656320208 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d9835380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/2656320208 >> 172.21.15.2:0/2656320208 conn(0x55d9d9815d40 msgr2=0x55d9d9818130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/2656320208 shutdown_connections 2023-11-04T01:46:27.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/2656320208 wait complete. 2023-11-04T01:46:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- start start 2023-11-04T01:46:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 Processor -- start 2023-11-04T01:46:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97eef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d98358c0 0x55d9d97ef460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d963d4b0 con 0x55d9d97e8b40 2023-11-04T01:46:27.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d95f5aa0 con 0x55d9d9834fa0 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9d95fb940 con 0x55d9d98358c0 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 10 client.0 _ll_register_callbacks cb 0x55d9d97d6460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97ee9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55920/0 (socket says 172.21.15.2:55920) 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 -- 172.21.15.2:0/660048717 learned_addr learned my addr 172.21.15.2:0/660048717 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f467fc640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f477fe640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d98358c0 0x55d9d97ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 -- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d98358c0 msgr2=0x55d9d97ef460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d98358c0 0x55d9d97ef460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 -- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 msgr2=0x55d9d97eef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97eef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 -- 172.21.15.2:0/660048717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4000f040 con 0x55d9d97e8b40 2023-11-04T01:46:27.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f467fc640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97eef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97ee9e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2f380073b0 tx=0x7f2f38000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0c4005764fac43 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f25ffb640 1 -- 172.21.15.2:0/660048717 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38012410 con 0x55d9d97e8b40 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f25ffb640 1 -- 172.21.15.2:0/660048717 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f2f38012570 con 0x55d9d97e8b40 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9d95fae10 con 0x55d9d97e8b40 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f25ffb640 1 -- 172.21.15.2:0/660048717 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f38012770 con 0x55d9d97e8b40 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 10 client.7479 fetch_fsmap learned FSMap version 58 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d9d95fe1a0 con 0x55d9d97e8b40 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f25ffb640 1 -- 172.21.15.2:0/660048717 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d9d95fae10 con 0x55d9d97e8b40 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f25ffb640 1 -- 172.21.15.2:0/660048717 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2f380128d0 con 0x55d9d97e8b40 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 10 client.7479 fetch_fsmap finished waiting for FSMap version 58 2023-11-04T01:46:27.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 10 client.7479 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 20 client.7479 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d97efd30 0x55d9d9846720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 4 client.7479 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 --> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9d963be00 con 0x55d9d97efd30 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f467fc640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d97efd30 0x55d9d9846720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f467fc640 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d97efd30 0x55d9d9846720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=757a0c02e96ec29d server_cookie=1962d15de7b3fadd in_seq=0 out_seq=0 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.617+0000 7f2f25ffb640 10 client.7479 ms_handle_connect on v2:172.21.15.2:6832/792110972 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f25ffb640 1 -- 172.21.15.2:0/660048717 <== mds.0 v2:172.21.15.2:6832/792110972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d9d963be00 con 0x55d9d97efd30 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f25ffb640 10 client.7479 handle_command_reply: tid=0 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 client.7479 shutdown 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 msgr2=0x55d9d97ee9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97ee9e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2f380073b0 tx=0x7f2f38000ee0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 shutdown_connections 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d97efd30 0x55d9d9846720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d98358c0 0x55d9d97ef460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97eef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 --2- 172.21.15.2:0/660048717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d97ee9e0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f25ffb640 0 client.7479 ms_handle_reset on v2:172.21.15.2:6832/792110972 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 >> 172.21.15.2:0/660048717 conn(0x55d9d9815d40 msgr2=0x55d9d9818130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 shutdown_connections 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 1 -- 172.21.15.2:0/660048717 wait complete. 2023-11-04T01:46:27.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.621+0000 7f2f506fd000 20 client.7479 trim_cache size 0 max 16384 2023-11-04T01:46:27.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 Processor -- start 2023-11-04T01:46:27.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- start start 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9815d40 0x55d9d9834480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d98349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97f0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d92f6940 con 0x55d9d97e8b40 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d963acc0 con 0x55d9d9834fa0 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9d97ee4b0 con 0x55d9d9815d40 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d98349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d98349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55928/0 (socket says 172.21.15.2:55928) 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 -- 172.21.15.2:0/2065863522 learned_addr learned my addr 172.21.15.2:0/2065863522 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9815d40 0x55d9d9834480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f477fe640 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 -- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9815d40 msgr2=0x55d9d9834480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9815d40 0x55d9d9834480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 -- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 msgr2=0x55d9d97f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97f0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 -- 172.21.15.2:0/2065863522 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9d95e44a0 con 0x55d9d97e8b40 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f467fc640 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d98349c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0eb420 tx=0x7f2f3c11c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f170106a22cec66e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f2d7fa640 1 -- 172.21.15.2:0/2065863522 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0f7220 con 0x55d9d97e8b40 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f2d7fa640 1 -- 172.21.15.2:0/2065863522 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c11c420 con 0x55d9d97e8b40 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f2d7fa640 1 -- 172.21.15.2:0/2065863522 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0f50b0 con 0x55d9d97e8b40 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- 172.21.15.2:0/2065863522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 msgr2=0x55d9d98349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d98349c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0eb420 tx=0x7f2f3c11c1e0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- 172.21.15.2:0/2065863522 shutdown_connections 2023-11-04T01:46:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d9834fa0 0x55d9d97f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d97e8b40 0x55d9d98349c0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 --2- 172.21.15.2:0/2065863522 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9815d40 0x55d9d9834480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- 172.21.15.2:0/2065863522 >> 172.21.15.2:0/2065863522 conn(0x55d9d97eeb70 msgr2=0x55d9d97f0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- 172.21.15.2:0/2065863522 shutdown_connections 2023-11-04T01:46:27.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- 172.21.15.2:0/2065863522 wait complete. 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 -- start start 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.637+0000 7f2f506fd000 1 Processor -- start 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d97e8b40 0x55d9d9895180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d9815d40 0x55d9d9847c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d98481c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d9818360 con 0x55d9d9815d40 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9d96414b0 con 0x55d9d97e8b40 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9d9640010 con 0x55d9d9834fa0 2023-11-04T01:46:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 10 client.0 _ll_register_callbacks cb 0x7f2f40001710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d9815d40 0x55d9d9847c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d9815d40 0x55d9d9847c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55930/0 (socket says 172.21.15.2:55930) 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 -- 172.21.15.2:0/59641524 learned_addr learned my addr 172.21.15.2:0/59641524 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d97e8b40 0x55d9d9895180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f477fe640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d98481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 -- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 msgr2=0x55d9d98481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d98481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 -- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d97e8b40 msgr2=0x55d9d9895180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d97e8b40 0x55d9d9895180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 -- 172.21.15.2:0/59641524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f480afaa0 con 0x55d9d9815d40 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d97e8b40 0x55d9d9895180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f467fc640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d9815d40 0x55d9d9847c80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0eec20 tx=0x7f2f3c11e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a690a7f42be5f3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:27.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 1 -- 172.21.15.2:0/59641524 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0fb070 con 0x55d9d9815d40 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9d97ec8a0 con 0x55d9d9815d40 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 1 -- 172.21.15.2:0/59641524 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f2f3c0f50b0 con 0x55d9d9815d40 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 1 -- 172.21.15.2:0/59641524 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f3c0ed2c0 con 0x55d9d9815d40 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 10 client.7485 fetch_fsmap learned FSMap version 58 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d9d9335cc0 con 0x55d9d9815d40 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 1 -- 172.21.15.2:0/59641524 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d9d97ec8a0 con 0x55d9d9815d40 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 1 -- 172.21.15.2:0/59641524 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2f3c0eb630 con 0x55d9d9815d40 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 10 client.7485 fetch_fsmap finished waiting for FSMap version 58 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 10 client.7485 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 20 client.7485 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d98358c0 0x55d9d98525d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 4 client.7485 mds_command: new command op to 7125 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:46:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 --> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d9d9607d10 con 0x55d9d98358c0 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d98358c0 0x55d9d98525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f46ffd640 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d98358c0 0x55d9d98525d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e80aed46ac2255 server_cookie=275baf074b11d8c in_seq=0 out_seq=0 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 10 client.7485 ms_handle_connect on v2:172.21.15.2:6832/792110972 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 1 -- 172.21.15.2:0/59641524 <== mds.0 v2:172.21.15.2:6832/792110972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d9d9607d10 con 0x55d9d98358c0 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 10 client.7485 handle_command_reply: tid=0 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 client.7485 shutdown 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d9815d40 msgr2=0x55d9d9847c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d9815d40 0x55d9d9847c80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0eec20 tx=0x7f2f3c11e040 comp rx=0 tx=0).stop 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 shutdown_connections 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:6832/792110972,v1:172.21.15.2:6833/792110972] conn(0x55d9d98358c0 0x55d9d98525d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d9d9834fa0 0x55d9d98481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d9d9815d40 0x55d9d9847c80 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f25ffb640 0 client.7485 ms_handle_reset on v2:172.21.15.2:6832/792110972 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 --2- 172.21.15.2:0/59641524 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d9d97e8b40 0x55d9d9895180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 >> 172.21.15.2:0/59641524 conn(0x55d9d97eeb70 msgr2=0x55d9d9833050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 shutdown_connections 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 1 -- 172.21.15.2:0/59641524 wait complete. 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f506fd000 20 client.7485 trim_cache size 0 max 16384 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:46:27.651 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7125, 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.6466727849999998, 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 58, 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 95, 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 95, 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 58.060075328000003 2023-11-04T01:46:27.652 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2f340664a0 msgr2=0x7f2f34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2f340664a0 0x7f2f34068960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2f380011f0 tx=0x7f2f38009040 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 msgr2=0x7f2f480aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480aeb20 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ae040 tx=0x7f2f3c019220 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 shutdown_connections 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2f340664a0 0x7f2f34068960 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f4815a1f0 0x7f2f480ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f480cdea0 0x7f2f480aeb20 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 --2- 172.21.15.2:0/2556242191 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f480ca400 0x7f2f480b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 >> 172.21.15.2:0/2556242191 conn(0x7f2f480cebb0 msgr2=0x7f2f480c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 shutdown_connections 2023-11-04T01:46:27.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.641+0000 7f2f4d5d0640 1 -- 172.21.15.2:0/2556242191 wait complete. 2023-11-04T01:46:27.664 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:46:27.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5fec2640 1 Processor -- start 2023-11-04T01:46:27.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5fec2640 1 -- start start 2023-11-04T01:46:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5fec2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d580b0630 0x7f6d580b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5fec2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580b0fd0 con 0x7f6d5815ed00 2023-11-04T01:46:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5fec2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5806bb30 con 0x7f6d5815b320 2023-11-04T01:46:27.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5fec2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5806c7b0 con 0x7f6d580b0630 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6d5815ed00 0x7f6d5815f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41694/0 (socket says 172.21.15.2:41694) 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 -- 172.21.15.2:0/2573924767 learned_addr learned my addr 172.21.15.2:0/2573924767 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/2573924767 >> v2:172.21.15.90:3300/0 conn(0x7f6d580b0630 0x7f6d580b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149492607 0 0) 0x7f6d580b0fd0 con 0x7f6d5815ed00 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d44003530 con 0x7f6d5815ed00 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765660523 0 0) 0x7f6d44003530 con 0x7f6d5815ed00 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 >> v2:172.21.15.90:3300/0 conn(0x7f6d580b0630 msgr2=0x7f6d580b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 --2- 172.21.15.2:0/2573924767 >> v2:172.21.15.90:3300/0 conn(0x7f6d580b0630 0x7f6d580b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 >> v1:172.21.15.90:6789/0 conn(0x7f6d5815b320 legacy=0x7f6d5806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5806be10 con 0x7f6d5815ed00 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f6d50001a00 con 0x7f6d5815ed00 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 >> v1:172.21.15.2:6789/0 conn(0x7f6d5815ed00 legacy=0x7f6d5815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d44003980 0x7f6d44003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d440047d0 0x7f6d44004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44005190 0x7f6d4400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5806c7b0 con 0x7f6d44005190 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4400c130 con 0x7f6d44003980 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4400c2f0 con 0x7f6d440047d0 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44005190 0x7f6d4400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d44003980 0x7f6d44003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 -- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d440047d0 msgr2=0x7f6d44004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d440047d0 0x7f6d44004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d440047d0 0x7f6d44004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 -- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d44003980 msgr2=0x7f6d44003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d44003980 0x7f6d44003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.777+0000 7f6d5e45f640 1 -- 172.21.15.2:0/2573924767 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44003530 con 0x7f6d44005190 2023-11-04T01:46:27.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5e45f640 1 -- 172.21.15.2:0/2573924767 reap_dead start 2023-11-04T01:46:27.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44005190 0x7f6d4400b990 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000a820 tx=0x7f6d5001fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaf8815db63fde2 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500aa6b0 con 0x7f6d44005190 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500aa850 con 0x7f6d44005190 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5cc5c640 1 -- 172.21.15.2:0/2573924767 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500aac00 con 0x7f6d44005190 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 -- 172.21.15.2:0/2573924767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44005190 msgr2=0x7f6d4400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44005190 0x7f6d4400b990 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000a820 tx=0x7f6d5001fa80 comp rx=0 tx=0).stop 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 -- 172.21.15.2:0/2573924767 shutdown_connections 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/2573924767 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d44005190 0x7f6d4400b990 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 -- 172.21.15.2:0/2573924767 >> 172.21.15.2:0/2573924767 conn(0x7f6d580cebb0 msgr2=0x7f6d580cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 -- 172.21.15.2:0/2573924767 shutdown_connections 2023-11-04T01:46:27.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 -- 172.21.15.2:0/2573924767 wait complete. 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 Processor -- start 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.781+0000 7f6d5fec2640 1 -- start start 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d44005190 0x7f6d580c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815c6f0 0x7f6d5815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d581f3f10 0x7f6d581f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580ae100 con 0x7f6d5815c6f0 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581f0920 con 0x7f6d581f3f10 2023-11-04T01:46:27.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5815d0b0 con 0x7f6d44005190 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815c6f0 0x7f6d5815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815c6f0 0x7f6d5815cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55960/0 (socket says 172.21.15.2:55960) 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 -- 172.21.15.2:0/684526748 learned_addr learned my addr 172.21.15.2:0/684526748 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d44005190 0x7f6d580c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d581f3f10 0x7f6d581f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 -- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d44005190 msgr2=0x7f6d580c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d44005190 0x7f6d580c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 -- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d581f3f10 msgr2=0x7f6d581f43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d581f3f10 0x7f6d581f43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 -- 172.21.15.2:0/684526748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d581f4900 con 0x7f6d5815c6f0 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815c6f0 0x7f6d5815cb70 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f6d48010890 tx=0x7f6d48010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d4e7fc640 1 -- 172.21.15.2:0/684526748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480094b0 con 0x7f6d5815c6f0 2023-11-04T01:46:27.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d4e7fc640 1 -- 172.21.15.2:0/684526748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800eb60 con 0x7f6d5815c6f0 2023-11-04T01:46:27.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d581f4bd0 con 0x7f6d5815c6f0 2023-11-04T01:46:27.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d4e7fc640 1 -- 172.21.15.2:0/684526748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48009e70 con 0x7f6d5815c6f0 2023-11-04T01:46:27.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d581f0df0 con 0x7f6d5815c6f0 2023-11-04T01:46:27.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d4e7fc640 1 -- 172.21.15.2:0/684526748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6d4801c400 con 0x7f6d5815c6f0 2023-11-04T01:46:27.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d4e7fc640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d3c0664d0 0x7f6d3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d4e7fc640 1 -- 172.21.15.2:0/684526748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f6d48084770 con 0x7f6d5815c6f0 2023-11-04T01:46:27.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d3c0664d0 0x7f6d3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.785+0000 7f6d62fef000 1 Processor -- start 2023-11-04T01:46:27.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- start start 2023-11-04T01:46:27.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d3c0664d0 0x7f6d3c068990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6d54000c10 tx=0x7f6d54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c41f0 0x55d4df4c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df477a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df477f50 0x55d4df478330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4df33e460 con 0x55d4df477f50 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4df2cf690 con 0x55d4df4c4b10 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4df2ccbc0 con 0x55d4df4c41f0 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df477f50 0x55d4df478330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df477f50 0x55d4df478330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55964/0 (socket says 172.21.15.2:55964) 2023-11-04T01:46:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 -- 172.21.15.2:0/134559107 learned_addr learned my addr 172.21.15.2:0/134559107 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df477a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c41f0 0x55d4df4c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 -- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c41f0 msgr2=0x55d4df4c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c41f0 0x55d4df4c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 -- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 msgr2=0x55d4df477a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df477a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 -- 172.21.15.2:0/134559107 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4defc0890 con 0x55d4df477f50 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df477a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df477f50 0x55d4df478330 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f6d50007040 tx=0x7f6d50009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24d811a738bf49 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d3b7fe640 1 -- 172.21.15.2:0/134559107 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500aa4b0 con 0x55d4df477f50 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d3b7fe640 1 -- 172.21.15.2:0/134559107 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500aa610 con 0x55d4df477f50 2023-11-04T01:46:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d3b7fe640 1 -- 172.21.15.2:0/134559107 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d50001940 con 0x55d4df477f50 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- 172.21.15.2:0/134559107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df477f50 msgr2=0x55d4df478330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df477f50 0x55d4df478330 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f6d50007040 tx=0x7f6d50009050 comp rx=0 tx=0).stop 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- 172.21.15.2:0/134559107 shutdown_connections 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df477f50 0x55d4df478330 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df477a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- 172.21.15.2:0/134559107 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c41f0 0x55d4df4c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- 172.21.15.2:0/134559107 >> 172.21.15.2:0/134559107 conn(0x55d4df4a0d40 msgr2=0x55d4df4a3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- 172.21.15.2:0/134559107 shutdown_connections 2023-11-04T01:46:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- 172.21.15.2:0/134559107 wait complete. 2023-11-04T01:46:27.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- start start 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 Processor -- start 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4df2c84b0 con 0x55d4df4c41f0 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4df280aa0 con 0x55d4df4c4b10 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4df286940 con 0x55d4df477f50 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d62fef000 10 client.0 _ll_register_callbacks cb 0x55d4df461460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.789+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55974/0 (socket says 172.21.15.2:55974) 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 -- 172.21.15.2:0/3909572248 learned_addr learned my addr 172.21.15.2:0/3909572248 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 -- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 msgr2=0x55d4df4a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 -- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 msgr2=0x55d4df4a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 -- 172.21.15.2:0/3909572248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d500b9040 con 0x55d4df4c41f0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4a5900 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6d4805d190 tx=0x7f6d480595d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c52e8449cefcbf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 1 -- 172.21.15.2:0/3909572248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48059350 con 0x55d4df4c41f0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 1 -- 172.21.15.2:0/3909572248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f6d48053820 con 0x55d4df4c41f0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4df285e10 con 0x55d4df4c41f0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 1 -- 172.21.15.2:0/3909572248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d48054ab0 con 0x55d4df4c41f0 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 10 client.7497 fetch_fsmap learned FSMap version 58 2023-11-04T01:46:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d4df2891a0 con 0x55d4df4c41f0 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 1 -- 172.21.15.2:0/3909572248 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4df285e10 con 0x55d4df4c41f0 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 1 -- 172.21.15.2:0/3909572248 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6d48024070 con 0x55d4df4c41f0 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 10 client.7497 fetch_fsmap finished waiting for FSMap version 58 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 10 client.7497 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 20 client.7497 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df4a6710 0x55d4df4d5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 4 client.7497 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4df2c6e00 con 0x55d4df4a6710 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df4a6710 0x55d4df4d5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df4a6710 0x55d4df4d5970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5099f62e957c4e37 server_cookie=a23d0bb1a2a3e96a in_seq=0 out_seq=0 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 10 client.7497 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 1 -- 172.21.15.2:0/3909572248 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d4df2c6e00 con 0x55d4df4a6710 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 10 client.7497 handle_command_reply: tid=0 2023-11-04T01:46:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 client.7497 shutdown 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 msgr2=0x55d4df4a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4a5900 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6d4805d190 tx=0x7f6d480595d0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 shutdown_connections 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df4a6710 0x55d4df4d5970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4a5900 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d38ff9640 0 client.7497 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 --2- 172.21.15.2:0/3909572248 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 >> 172.21.15.2:0/3909572248 conn(0x55d4df4a0d40 msgr2=0x55d4df472cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 shutdown_connections 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 1 -- 172.21.15.2:0/3909572248 wait complete. 2023-11-04T01:46:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.793+0000 7f6d62fef000 20 client.7497 trim_cache size 0 max 16384 2023-11-04T01:46:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 Processor -- start 2023-11-04T01:46:27.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 -- start start 2023-11-04T01:46:27.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4c3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4d5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4def81940 con 0x55d4df4c41f0 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4df28dd20 con 0x55d4df4c4b10 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4df24b460 con 0x55d4df477f50 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4c3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55978/0 (socket says 172.21.15.2:55978) 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 -- 172.21.15.2:0/1108801302 learned_addr learned my addr 172.21.15.2:0/1108801302 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4d5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 -- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 msgr2=0x55d4df4c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4c32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 -- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 msgr2=0x55d4df4d5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4d5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 -- 172.21.15.2:0/1108801302 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4df26f4a0 con 0x55d4df4c41f0 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4d5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4c3820 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6d48055350 tx=0x7f6d48058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc34532a6de1ae server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d3bfff640 1 -- 172.21.15.2:0/1108801302 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48059350 con 0x55d4df4c41f0 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d3bfff640 1 -- 172.21.15.2:0/1108801302 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4805b2c0 con 0x55d4df4c41f0 2023-11-04T01:46:27.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.809+0000 7f6d3bfff640 1 -- 172.21.15.2:0/1108801302 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48073310 con 0x55d4df4c41f0 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/1108801302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 msgr2=0x55d4df4c3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4c3820 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f6d48055350 tx=0x7f6d48058000 comp rx=0 tx=0).stop 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/1108801302 shutdown_connections 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df4c4b10 0x55d4df4d5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df4c3820 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- 172.21.15.2:0/1108801302 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df477f50 0x55d4df4c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/1108801302 >> 172.21.15.2:0/1108801302 conn(0x55d4df4a0d40 msgr2=0x55d4df4c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/1108801302 shutdown_connections 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/1108801302 wait complete. 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- start start 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 Processor -- start 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df477f50 0x55d4df526250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df5287a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c4b10 0x55d4df52acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4df4da660 con 0x55d4df4c41f0 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4defc11b0 con 0x55d4df477f50 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4df46f080 con 0x55d4df4c4b10 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 10 client.0 _ll_register_callbacks cb 0x7f6d440036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df5287a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df5287a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55988/0 (socket says 172.21.15.2:55988) 2023-11-04T01:46:27.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 -- 172.21.15.2:0/2679059824 learned_addr learned my addr 172.21.15.2:0/2679059824 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df477f50 0x55d4df526250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c4b10 0x55d4df52acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 -- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c4b10 msgr2=0x55d4df52acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c4b10 0x55d4df52acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 -- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df477f50 msgr2=0x55d4df526250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df477f50 0x55d4df526250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 -- 172.21.15.2:0/2679059824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4df2891a0 con 0x55d4df4c41f0 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5e45f640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c4b10 0x55d4df52acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5d45d640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df5287a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f6d48051de0 tx=0x7f6d48082680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0d85b4db571575 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 1 -- 172.21.15.2:0/2679059824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48073310 con 0x55d4df4c41f0 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 1 -- 172.21.15.2:0/2679059824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f6d48053820 con 0x55d4df4c41f0 2023-11-04T01:46:27.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4df292d10 con 0x55d4df4c41f0 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 1 -- 172.21.15.2:0/2679059824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d48059350 con 0x55d4df4c41f0 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 10 client.7503 fetch_fsmap learned FSMap version 58 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55d4defc0cc0 con 0x55d4df4c41f0 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 1 -- 172.21.15.2:0/2679059824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4df292d10 con 0x55d4df4c41f0 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 1 -- 172.21.15.2:0/2679059824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 58) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6d48024070 con 0x55d4df4c41f0 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 10 client.7503 fetch_fsmap finished waiting for FSMap version 58 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 10 client.7503 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 20 client.7503 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df52b440 0x55d4df52d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 4 client.7503 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4df2c1490 con 0x55d4df52b440 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df52b440 0x55d4df52d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d5dc5e640 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df52b440 0x55d4df52d830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8b6a1b2d98d27ff server_cookie=32f1f5fd0ad249b0 in_seq=0 out_seq=0 2023-11-04T01:46:27.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 10 client.7503 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.813+0000 7f6d38ff9640 1 -- 172.21.15.2:0/2679059824 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d4df2c1490 con 0x55d4df52b440 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d38ff9640 10 client.7503 handle_command_reply: tid=0 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 client.7503 shutdown 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 msgr2=0x55d4df5287a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df5287a0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f6d48051de0 tx=0x7f6d48082680 comp rx=0 tx=0).stop 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 shutdown_connections 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55d4df52b440 0x55d4df52d830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55d4df4c4b10 0x55d4df52acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d4df4c41f0 0x55d4df5287a0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 --2- 172.21.15.2:0/2679059824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55d4df477f50 0x55d4df526250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d38ff9640 0 client.7503 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 >> 172.21.15.2:0/2679059824 conn(0x55d4df4a0d40 msgr2=0x55d4df4a5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 shutdown_connections 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 1 -- 172.21.15.2:0/2679059824 wait complete. 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d62fef000 20 client.7503 trim_cache size 0 max 16384 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7128, 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 41.002073752000001, 2023-11-04T01:46:27.825 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 58, 2023-11-04T01:46:27.826 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 95, 2023-11-04T01:46:27.826 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 95, 2023-11-04T01:46:27.826 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 58.229035656000001 2023-11-04T01:46:27.826 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:46:27.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d3c0664d0 msgr2=0x7f6d3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d3c0664d0 0x7f6d3c068990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6d54000c10 tx=0x7f6d54009040 comp rx=0 tx=0).stop 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815c6f0 msgr2=0x7f6d5815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815c6f0 0x7f6d5815cb70 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f6d48010890 tx=0x7f6d48010d50 comp rx=0 tx=0).stop 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 shutdown_connections 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6d3c0664d0 0x7f6d3c068990 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d581f3f10 0x7f6d581f43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d5815c6f0 0x7f6d5815cb70 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 --2- 172.21.15.2:0/684526748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6d44005190 0x7f6d580c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 >> 172.21.15.2:0/684526748 conn(0x7f6d580cebb0 msgr2=0x7f6d580ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 shutdown_connections 2023-11-04T01:46:27.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.817+0000 7f6d5fec2640 1 -- 172.21.15.2:0/684526748 wait complete. 2023-11-04T01:46:27.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:27.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5894756640 1 Processor -- start 2023-11-04T01:46:27.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5894756640 1 -- start start 2023-11-04T01:46:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5894756640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f588c0b4990 0x7f588c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5894756640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f588c0b74f0 0x7f588c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5894756640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588c0b6070 con 0x7f588c0d0690 2023-11-04T01:46:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5894756640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588c0b8ed0 con 0x7f588c0b74f0 2023-11-04T01:46:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5894756640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588c0b52b0 con 0x7f588c0b4990 2023-11-04T01:46:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5892cf3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f588c0b74f0 0x7f588c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5892cf3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f588c0b74f0 0x7f588c0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55996/0 (socket says 172.21.15.2:55996) 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5892cf3640 1 -- 172.21.15.2:0/2645157159 learned_addr learned my addr 172.21.15.2:0/2645157159 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f58924f2640 1 --2- 172.21.15.2:0/2645157159 >> v2:172.21.15.90:3300/0 conn(0x7f588c0b4990 0x7f588c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5892cf3640 1 -- 172.21.15.2:0/2645157159 >> v2:172.21.15.90:3300/0 conn(0x7f588c0b4990 msgr2=0x7f588c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5892cf3640 1 --2- 172.21.15.2:0/2645157159 >> v2:172.21.15.90:3300/0 conn(0x7f588c0b4990 0x7f588c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5892cf3640 1 -- 172.21.15.2:0/2645157159 >> v1:172.21.15.90:6789/0 conn(0x7f588c0d0690 legacy=0x7f588c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f5892cf3640 1 -- 172.21.15.2:0/2645157159 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0d1ce0 con 0x7f588c0b74f0 2023-11-04T01:46:27.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.949+0000 7f58924f2640 1 --2- 172.21.15.2:0/2645157159 >> v2:172.21.15.90:3300/0 conn(0x7f588c0b4990 0x7f588c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5892cf3640 1 --2- 172.21.15.2:0/2645157159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b74f0 0x7f588c0cde80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f588c160ce0 tx=0x7f588401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52785b966da9d832 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f58914f0640 1 -- 172.21.15.2:0/2645157159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840af400 con 0x7f588c0b74f0 2023-11-04T01:46:27.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f58914f0640 1 -- 172.21.15.2:0/2645157159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58840ab050 con 0x7f588c0b74f0 2023-11-04T01:46:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f58914f0640 1 -- 172.21.15.2:0/2645157159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840af780 con 0x7f588c0b74f0 2023-11-04T01:46:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 -- 172.21.15.2:0/2645157159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b74f0 msgr2=0x7f588c0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 --2- 172.21.15.2:0/2645157159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b74f0 0x7f588c0cde80 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f588c160ce0 tx=0x7f588401f180 comp rx=0 tx=0).stop 2023-11-04T01:46:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 -- 172.21.15.2:0/2645157159 shutdown_connections 2023-11-04T01:46:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 --2- 172.21.15.2:0/2645157159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b74f0 0x7f588c0cde80 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 --2- 172.21.15.2:0/2645157159 >> v2:172.21.15.90:3300/0 conn(0x7f588c0b4990 0x7f588c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 -- 172.21.15.2:0/2645157159 >> 172.21.15.2:0/2645157159 conn(0x7f588c0cf990 msgr2=0x7f588c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 -- 172.21.15.2:0/2645157159 shutdown_connections 2023-11-04T01:46:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 -- 172.21.15.2:0/2645157159 wait complete. 2023-11-04T01:46:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 Processor -- start 2023-11-04T01:46:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.953+0000 7f5894756640 1 -- start start 2023-11-04T01:46:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b4990 0x7f588c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f588c0b74f0 0x7f588c1f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f588c0d0690 0x7f588c0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c1f30d0 con 0x7f588c0b4990 2023-11-04T01:46:27.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588c1f33b0 con 0x7f588c0b74f0 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588c0cb1b0 con 0x7f588c0d0690 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b4990 0x7f588c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b4990 0x7f588c0cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56008/0 (socket says 172.21.15.2:56008) 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 -- 172.21.15.2:0/2348179916 learned_addr learned my addr 172.21.15.2:0/2348179916 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 -- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f588c0d0690 msgr2=0x7f588c0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f588c0d0690 0x7f588c0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 -- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f588c0b74f0 msgr2=0x7f588c1f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5891cf1640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f588c0b74f0 0x7f588c1f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f588c0b74f0 0x7f588c1f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 -- 172.21.15.2:0/2348179916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5884009b30 con 0x7f588c0b4990 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5891cf1640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f588c0b74f0 0x7f588c1f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f58924f2640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b4990 0x7f588c0cb9b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f588800c7f0 tx=0x7f588800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5882ffd640 1 -- 172.21.15.2:0/2348179916 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888007820 con 0x7f588c0b4990 2023-11-04T01:46:27.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5882ffd640 1 -- 172.21.15.2:0/2348179916 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888007980 con 0x7f588c0b4990 2023-11-04T01:46:27.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c0cb490 con 0x7f588c0b4990 2023-11-04T01:46:27.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5882ffd640 1 -- 172.21.15.2:0/2348179916 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888007d30 con 0x7f588c0b4990 2023-11-04T01:46:27.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588c0cca70 con 0x7f588c0b4990 2023-11-04T01:46:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588c1f35d0 con 0x7f588c0b4990 2023-11-04T01:46:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5882ffd640 1 -- 172.21.15.2:0/2348179916 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5888024480 con 0x7f588c0b4990 2023-11-04T01:46:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5882ffd640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58700664a0 0x7f5870068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5882ffd640 1 -- 172.21.15.2:0/2348179916 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f58880849b0 con 0x7f588c0b4990 2023-11-04T01:46:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.957+0000 7f5891cf1640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58700664a0 0x7f5870068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.961+0000 7f5891cf1640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58700664a0 0x7f5870068960 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f588c0ce630 tx=0x7f587c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:27.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:27.961+0000 7f5882ffd640 1 -- 172.21.15.2:0/2348179916 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5888051ab0 con 0x7f588c0b4990 2023-11-04T01:46:28.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.149+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f588c0744a0 con 0x7f588c0b4990 2023-11-04T01:46:28.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5882ffd640 1 -- 172.21.15.2:0/2348179916 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f58880550d0 con 0x7f588c0b4990 2023-11-04T01:46:28.155 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:28.155 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:24.034051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:28.156 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 58 2023-11-04T01:46:28.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58700664a0 msgr2=0x7f5870068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58700664a0 0x7f5870068960 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f588c0ce630 tx=0x7f587c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b4990 msgr2=0x7f588c0cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b4990 0x7f588c0cb9b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f588800c7f0 tx=0x7f588800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 shutdown_connections 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f58700664a0 0x7f5870068960 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f588c0d0690 0x7f588c0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f588c0b74f0 0x7f588c1f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 --2- 172.21.15.2:0/2348179916 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f588c0b4990 0x7f588c0cb9b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 >> 172.21.15.2:0/2348179916 conn(0x7f588c0cf990 msgr2=0x7f588c0d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 shutdown_connections 2023-11-04T01:46:28.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.153+0000 7f5894756640 1 -- 172.21.15.2:0/2348179916 wait complete. 2023-11-04T01:46:28.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:46:28.294 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":2,"last_created":2,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:46:03.907395+0000","name":"s11","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:28.294 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 2, "last_destroyed": 1, "last_snap": 2, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:46:03.907395+0000" } ] } 2023-11-04T01:46:28.294 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:46:28.294 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2 2023-11-04T01:46:28.294 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:28.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.413+0000 7fcde4a26640 1 Processor -- start 2023-11-04T01:46:28.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.413+0000 7fcde4a26640 1 -- start start 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcde00d0690 0x7fcde00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcde00d0ae0 0x7fcde00b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde00b6070 con 0x7fcde00b4990 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde00b8ed0 con 0x7fcde00d0690 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde00d1ce0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdddd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcde00d0690 0x7fcde00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdde59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcde00b4990 0x7fcde00b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41710/0 (socket says 172.21.15.2:41710) 2023-11-04T01:46:28.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdde59c640 1 -- 172.21.15.2:0/2182627824 learned_addr learned my addr 172.21.15.2:0/2182627824 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:28.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdded9d640 1 --2- 172.21.15.2:0/2182627824 >> v2:172.21.15.90:3300/0 conn(0x7fcde00d0ae0 0x7fcde00b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdddd9b640 1 -- 172.21.15.2:0/2182627824 >> v2:172.21.15.90:3300/0 conn(0x7fcde00d0ae0 msgr2=0x7fcde00b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:28.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdddd9b640 1 --2- 172.21.15.2:0/2182627824 >> v2:172.21.15.90:3300/0 conn(0x7fcde00d0ae0 0x7fcde00b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdddd9b640 1 -- 172.21.15.2:0/2182627824 >> v1:172.21.15.2:6789/0 conn(0x7fcde00b4990 legacy=0x7fcde00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdddd9b640 1 -- 172.21.15.2:0/2182627824 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00d1fc0 con 0x7fcde00d0690 2023-11-04T01:46:28.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcddd59a640 1 -- 172.21.15.2:0/2182627824 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805910182 0 0) 0x7fcde00b6070 con 0x7fcde00b4990 2023-11-04T01:46:28.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcdddd9b640 1 --2- 172.21.15.2:0/2182627824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0690 0x7fcde00b64e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fcde0067730 tx=0x7fcdd001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afee0711286e7f90 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:28.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcddd59a640 1 -- 172.21.15.2:0/2182627824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00a8950 con 0x7fcde00d0690 2023-11-04T01:46:28.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcddd59a640 1 -- 172.21.15.2:0/2182627824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd00a8ab0 con 0x7fcde00d0690 2023-11-04T01:46:28.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcddd59a640 1 -- 172.21.15.2:0/2182627824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00a8e40 con 0x7fcde00d0690 2023-11-04T01:46:28.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- 172.21.15.2:0/2182627824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0690 msgr2=0x7fcde00b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 --2- 172.21.15.2:0/2182627824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0690 0x7fcde00b64e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fcde0067730 tx=0x7fcdd001ec50 comp rx=0 tx=0).stop 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- 172.21.15.2:0/2182627824 shutdown_connections 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 --2- 172.21.15.2:0/2182627824 >> v2:172.21.15.90:3300/0 conn(0x7fcde00d0ae0 0x7fcde00b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 --2- 172.21.15.2:0/2182627824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0690 0x7fcde00b64e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- 172.21.15.2:0/2182627824 >> 172.21.15.2:0/2182627824 conn(0x7fcde00cf990 msgr2=0x7fcde00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- 172.21.15.2:0/2182627824 shutdown_connections 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.417+0000 7fcde4a26640 1 -- 172.21.15.2:0/2182627824 wait complete. 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 Processor -- start 2023-11-04T01:46:28.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 -- start start 2023-11-04T01:46:28.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcde00b4990 0x7fcde01589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcde00d0690 0x7fcde01f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0ae0 0x7fcde00cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0149930 con 0x7fcde00d0ae0 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde01f6e60 con 0x7fcde00d0690 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0159010 con 0x7fcde00b4990 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0ae0 0x7fcde00cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0ae0 0x7fcde00cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56030/0 (socket says 172.21.15.2:56030) 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 -- 172.21.15.2:0/3787606944 learned_addr learned my addr 172.21.15.2:0/3787606944 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdddd9b640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcde00d0690 0x7fcde01f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdde59c640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcde00b4990 0x7fcde01589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 -- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcde00b4990 msgr2=0x7fcde01589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcde00b4990 0x7fcde01589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 -- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcde00d0690 msgr2=0x7fcde01f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcde00d0690 0x7fcde01f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 -- 172.21.15.2:0/3787606944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0009420 con 0x7fcde00d0ae0 2023-11-04T01:46:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdddd9b640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcde00d0690 0x7fcde01f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdded9d640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0ae0 0x7fcde00cc8d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007e30 tx=0x7fcdd800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdceffd640 1 -- 172.21.15.2:0/3787606944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8014620 con 0x7fcde00d0ae0 2023-11-04T01:46:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdceffd640 1 -- 172.21.15.2:0/3787606944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd800ee90 con 0x7fcde00d0ae0 2023-11-04T01:46:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcdceffd640 1 -- 172.21.15.2:0/3787606944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80149c0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde01592f0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde01598b0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.421+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde00744a0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.425+0000 7fcdceffd640 1 -- 172.21.15.2:0/3787606944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcdd8014b20 con 0x7fcde00d0ae0 2023-11-04T01:46:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.425+0000 7fcdceffd640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcdc00664a0 0x7fcdc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.425+0000 7fcdceffd640 1 -- 172.21.15.2:0/3787606944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7fcdd80856c0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.425+0000 7fcdde59c640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcdc00664a0 0x7fcdc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.425+0000 7fcdde59c640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcdc00664a0 0x7fcdc0068960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4000f70 tx=0x7fcdd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:28.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.425+0000 7fcdceffd640 1 -- 172.21.15.2:0/3787606944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcdd80527c0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.617+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcde00b63e0 con 0x7fcde00d0ae0 2023-11-04T01:46:28.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.617+0000 7fcdceffd640 1 -- 172.21.15.2:0/3787606944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fcdd801b310 con 0x7fcde00d0ae0 2023-11-04T01:46:28.621 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:28.621 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:24.034051+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:28.622 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 58 2023-11-04T01:46:28.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcdc00664a0 msgr2=0x7fcdc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcdc00664a0 0x7fcdc0068960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4000f70 tx=0x7fcdd4009040 comp rx=0 tx=0).stop 2023-11-04T01:46:28.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0ae0 msgr2=0x7fcde00cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0ae0 0x7fcde00cc8d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007e30 tx=0x7fcdd800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 shutdown_connections 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcdc00664a0 0x7fcdc0068960 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcde00d0ae0 0x7fcde00cc8d0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcde00d0690 0x7fcde01f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 --2- 172.21.15.2:0/3787606944 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcde00b4990 0x7fcde01589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 >> 172.21.15.2:0/3787606944 conn(0x7fcde00cf990 msgr2=0x7fcde00b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 shutdown_connections 2023-11-04T01:46:28.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.621+0000 7fcde4a26640 1 -- 172.21.15.2:0/3787606944 wait complete. 2023-11-04T01:46:28.641 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:46:28.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.753+0000 7ffbd140d640 1 Processor -- start 2023-11-04T01:46:28.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbd140d640 1 -- start start 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbd140d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbcc0cf4c0 0x7ffbcc0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbd140d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0cd830 con 0x7ffbcc0b32f0 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbd140d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0cdad0 con 0x7ffbcc15af50 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbd140d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0b3780 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbcb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbcc0cf4c0 0x7ffbcc0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbcb7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbcc0cf4c0 0x7ffbcc0cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56042/0 (socket says 172.21.15.2:56042) 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbcb7fe640 1 -- 172.21.15.2:0/3153310321 learned_addr learned my addr 172.21.15.2:0/3153310321 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:28.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbc27fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffbcc0b32f0 0x7ffbcc0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41726/0 (socket says 172.21.15.2:41726) 2023-11-04T01:46:28.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbcb7fe640 1 -- 172.21.15.2:0/3153310321 >> v1:172.21.15.90:6789/0 conn(0x7ffbcc15af50 legacy=0x7ffbcc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:28.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbcb7fe640 1 -- 172.21.15.2:0/3153310321 >> v1:172.21.15.2:6789/0 conn(0x7ffbcc0b32f0 legacy=0x7ffbcc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbcb7fe640 1 -- 172.21.15.2:0/3153310321 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0cddb0 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbcb7fe640 1 --2- 172.21.15.2:0/3153310321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc0cb330 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009e50 tx=0x7ffbc401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58b26f08f290a04 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:28.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbca7fc640 1 -- 172.21.15.2:0/3153310321 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc40a5820 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbca7fc640 1 -- 172.21.15.2:0/3153310321 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc40a5980 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.757+0000 7ffbca7fc640 1 -- 172.21.15.2:0/3153310321 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc40a5d10 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/3153310321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 msgr2=0x7ffbcc0cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 --2- 172.21.15.2:0/3153310321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc0cb330 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009e50 tx=0x7ffbc401c940 comp rx=0 tx=0).stop 2023-11-04T01:46:28.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/3153310321 shutdown_connections 2023-11-04T01:46:28.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 --2- 172.21.15.2:0/3153310321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc0cb330 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/3153310321 >> 172.21.15.2:0/3153310321 conn(0x7ffbcc065dc0 msgr2=0x7ffbcc0661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:28.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/3153310321 shutdown_connections 2023-11-04T01:46:28.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/3153310321 wait complete. 2023-11-04T01:46:28.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 Processor -- start 2023-11-04T01:46:28.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- start start 2023-11-04T01:46:28.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc15af50 0x7ffbcc1510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc151620 0x7ffbcc0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1573d0 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0c4810 con 0x7ffbcc151620 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0c8470 con 0x7ffbcc15af50 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56048/0 (socket says 172.21.15.2:56048) 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 -- 172.21.15.2:0/1221742117 learned_addr learned my addr 172.21.15.2:0/1221742117 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 -- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc15af50 msgr2=0x7ffbcc1510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc15af50 0x7ffbcc1510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 -- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc151620 msgr2=0x7ffbcc0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:28.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcb7fe640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc151620 0x7ffbcc0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc151620 0x7ffbcc0b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 -- 172.21.15.2:0/1221742117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4009b30 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbcaffd640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc150940 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00b3f0 tx=0x7ffbbc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbc3fff640 1 -- 172.21.15.2:0/1221742117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011830 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbc3fff640 1 -- 172.21.15.2:0/1221742117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc0119b0 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbc3fff640 1 -- 172.21.15.2:0/1221742117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011d60 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0c8190 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc156ff0 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.761+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc0675f0 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.765+0000 7ffbc3fff640 1 -- 172.21.15.2:0/1221742117 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffbbc01a410 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.765+0000 7ffbc3fff640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbac0664a0 0x7ffbac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.765+0000 7ffbc3fff640 1 -- 172.21.15.2:0/1221742117 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7ffbbc084200 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.765+0000 7ffbc27fc640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbac0664a0 0x7ffbac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:28.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.765+0000 7ffbc27fc640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbac0664a0 0x7ffbac068960 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0c3f00 tx=0x7ffbb40079d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:28.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.769+0000 7ffbc3fff640 1 -- 172.21.15.2:0/1221742117 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffbbc051180 con 0x7ffbcc0cf4c0 2023-11-04T01:46:28.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:28.977+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7ffbcc150e80 con 0x7ffbcc0cf4c0 2023-11-04T01:46:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbc3fff640 1 -- 172.21.15.2:0/1221742117 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7125 v59) v1 ==== 112+0+0 (secure 0 0 0) 0x7ffbbc0547a0 con 0x7ffbcc0cf4c0 2023-11-04T01:46:29.067 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.7125 2023-11-04T01:46:29.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbac0664a0 msgr2=0x7ffbac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbac0664a0 0x7ffbac068960 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0c3f00 tx=0x7ffbb40079d0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 msgr2=0x7ffbcc150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc150940 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00b3f0 tx=0x7ffbbc00b8b0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 shutdown_connections 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbac0664a0 0x7ffbac068960 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbcc151620 0x7ffbcc0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbcc15af50 0x7ffbcc1510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 --2- 172.21.15.2:0/1221742117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbcc0cf4c0 0x7ffbcc150940 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 >> 172.21.15.2:0/1221742117 conn(0x7ffbcc065dc0 msgr2=0x7ffbcc0d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 shutdown_connections 2023-11-04T01:46:29.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.065+0000 7ffbd140d640 1 -- 172.21.15.2:0/1221742117 wait complete. 2023-11-04T01:46:29.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:46:29.217 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:46:29.218 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:46:29.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:29.218 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s12) 2023-11-04T01:46:29.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:46:29.231 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f484dc9f640 time 2023-11-04T01:46:29.231415+0000 2023-11-04T01:46:29.231 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:46:29.232 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.232 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4859dd7fae] 2023-11-04T01:46:29.232 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f484dc9f640 thread_name:MR_Finisher 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:46:29.229+0000 7f484dc9f640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f484dc9f640 time 2023-11-04T01:46:29.231415+0000 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.233 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4859dd7fae] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4859712520] 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:46:29.234 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4859dd8008] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:46:29.229+0000 7f484dc9f640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f484dc9f640 thread_name:MR_Finisher 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.235 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4859712520] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4859dd8008] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.236 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:29.237 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.241 INFO:tasks.ceph.mds.c.smithi002.stderr: -209> 2023-11-04T01:46:26.625+0000 7f48514a6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:29.241 INFO:tasks.ceph.mds.c.smithi002.stderr: -207> 2023-11-04T01:46:26.625+0000 7f48514a6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: -1> 2023-11-04T01:46:29.229+0000 7f484dc9f640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f484dc9f640 time 2023-11-04T01:46:29.231415+0000 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4859dd7fae] 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.242 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 0> 2023-11-04T01:46:29.229+0000 7f484dc9f640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f484dc9f640 thread_name:MR_Finisher 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4859712520] 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4859dd8008] 2023-11-04T01:46:29.243 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:29.244 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.246 INFO:tasks.ceph.mds.c.smithi002.stderr: -209> 2023-11-04T01:46:26.625+0000 7f48514a6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:29.246 INFO:tasks.ceph.mds.c.smithi002.stderr: -207> 2023-11-04T01:46:26.625+0000 7f48514a6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:29.246 INFO:tasks.ceph.mds.c.smithi002.stderr: -1> 2023-11-04T01:46:29.229+0000 7f484dc9f640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7f484dc9f640 time 2023-11-04T01:46:29.231415+0000 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4859dd7fae] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.247 INFO:tasks.ceph.mds.c.smithi002.stderr: 0> 2023-11-04T01:46:29.229+0000 7f484dc9f640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f484dc9f640 thread_name:MR_Finisher 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4859712520] 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4859dd8008] 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f4859dd8162] 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x563da2e174c5] 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x563da2e4c08c] 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x563da2e4c4bc] 2023-11-04T01:46:29.248 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x563da2e4c5f3] 2023-11-04T01:46:29.249 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f4859e7e305] 2023-11-04T01:46:29.249 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f4859764b43] 2023-11-04T01:46:29.249 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f48597f6a00] 2023-11-04T01:46:29.249 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:29.249 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:46:29.357 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:46:29.357 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:46:29.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:29.448 INFO:tasks.ceph.mds.c.smithi002.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:46:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.521+0000 7f873dce9640 1 Processor -- start 2023-11-04T01:46:29.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f873dce9640 1 -- start start 2023-11-04T01:46:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f873dce9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87380d0690 0x7f87380b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f873dce9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87380b6070 con 0x7f87380d0ae0 2023-11-04T01:46:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f873dce9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87380b8ed0 con 0x7f87380b4990 2023-11-04T01:46:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f873dce9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380d1ce0 con 0x7f87380d0690 2023-11-04T01:46:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f8736ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f87380d0690 0x7f87380b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f8737fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f87380d0ae0 0x7f87380b6a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41742/0 (socket says 172.21.15.2:41742) 2023-11-04T01:46:29.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f8737fff640 1 -- 172.21.15.2:0/4165968483 learned_addr learned my addr 172.21.15.2:0/4165968483 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f8736ffd640 1 -- 172.21.15.2:0/4165968483 >> v1:172.21.15.90:6789/0 conn(0x7f87380b4990 legacy=0x7f87380b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f87367fc640 1 -- 172.21.15.2:0/4165968483 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289459460 0 0) 0x7f87380b6070 con 0x7f87380d0ae0 2023-11-04T01:46:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f8736ffd640 1 -- 172.21.15.2:0/4165968483 >> v1:172.21.15.2:6789/0 conn(0x7f87380d0ae0 legacy=0x7f87380b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f8736ffd640 1 -- 172.21.15.2:0/4165968483 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380d1fc0 con 0x7f87380d0690 2023-11-04T01:46:29.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.525+0000 7f8736ffd640 1 --2- 172.21.15.2:0/4165968483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f87380b64e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34219c8744d14e71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f87367fc640 1 -- 172.21.15.2:0/4165968483 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0a8970 con 0x7f87380d0690 2023-11-04T01:46:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f87367fc640 1 -- 172.21.15.2:0/4165968483 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c0a8ad0 con 0x7f87380d0690 2023-11-04T01:46:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f87367fc640 1 -- 172.21.15.2:0/4165968483 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0a8e60 con 0x7f87380d0690 2023-11-04T01:46:29.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- 172.21.15.2:0/4165968483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 msgr2=0x7f87380b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 --2- 172.21.15.2:0/4165968483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f87380b64e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01ec70 comp rx=0 tx=0).stop 2023-11-04T01:46:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- 172.21.15.2:0/4165968483 shutdown_connections 2023-11-04T01:46:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 --2- 172.21.15.2:0/4165968483 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f87380b64e0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- 172.21.15.2:0/4165968483 >> 172.21.15.2:0/4165968483 conn(0x7f87380cf990 msgr2=0x7f87380cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- 172.21.15.2:0/4165968483 shutdown_connections 2023-11-04T01:46:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- 172.21.15.2:0/4165968483 wait complete. 2023-11-04T01:46:29.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 Processor -- start 2023-11-04T01:46:29.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- start start 2023-11-04T01:46:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87380b4990 0x7f873814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f8738159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:29.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87380d0ae0 0x7f87380cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380cc190 con 0x7f87380d0690 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380cb2c0 con 0x7f87380b4990 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873814d810 con 0x7f87380d0ae0 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f8738159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f8738159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56060/0 (socket says 172.21.15.2:56060) 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 -- 172.21.15.2:0/730913586 learned_addr learned my addr 172.21.15.2:0/730913586 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8737fff640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87380d0ae0 0x7f87380cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 -- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87380d0ae0 msgr2=0x7f87380cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f87377fe640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87380b4990 0x7f873814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87380d0ae0 0x7f87380cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 -- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87380b4990 msgr2=0x7f873814d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87380b4990 0x7f873814d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 -- 172.21.15.2:0/730913586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009420 con 0x7f87380d0690 2023-11-04T01:46:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f8736ffd640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f8738159bf0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f872c01b880 tx=0x7f872c01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f871ffff640 1 -- 172.21.15.2:0/730913586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0a8970 con 0x7f87380d0690 2023-11-04T01:46:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f871ffff640 1 -- 172.21.15.2:0/730913586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c0b9410 con 0x7f87380d0690 2023-11-04T01:46:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87380cb510 con 0x7f87380d0690 2023-11-04T01:46:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f871ffff640 1 -- 172.21.15.2:0/730913586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0b97a0 con 0x7f87380d0690 2023-11-04T01:46:29.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.529+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87380cbad0 con 0x7f87380d0690 2023-11-04T01:46:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.533+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87380cc2d0 con 0x7f87380d0690 2023-11-04T01:46:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.533+0000 7f871ffff640 1 -- 172.21.15.2:0/730913586 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f872c0b7040 con 0x7f87380d0690 2023-11-04T01:46:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.533+0000 7f871ffff640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87240664a0 0x7f8724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.533+0000 7f871ffff640 1 -- 172.21.15.2:0/730913586 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f872c122070 con 0x7f87380d0690 2023-11-04T01:46:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.533+0000 7f87377fe640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87240664a0 0x7f8724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:29.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.533+0000 7f87377fe640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87240664a0 0x7f8724068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8728000f70 tx=0x7f8728009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:29.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.537+0000 7f871ffff640 1 -- 172.21.15.2:0/730913586 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f87380cc2d0 con 0x7f87380d0690 2023-11-04T01:46:29.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.729+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87380cc2d0 con 0x7f87380d0690 2023-11-04T01:46:29.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.729+0000 7f871ffff640 1 -- 172.21.15.2:0/730913586 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f87380cc2d0 con 0x7f87380d0690 2023-11-04T01:46:29.734 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:29.735 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:28.982593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 59 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87240664a0 msgr2=0x7f8724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87240664a0 0x7f8724068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8728000f70 tx=0x7f8728009040 comp rx=0 tx=0).stop 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 msgr2=0x7f8738159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f8738159bf0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f872c01b880 tx=0x7f872c01ba10 comp rx=0 tx=0).stop 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 shutdown_connections 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f87240664a0 0x7f8724068960 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f87380d0ae0 0x7f87380cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f87380d0690 0x7f8738159bf0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 --2- 172.21.15.2:0/730913586 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87380b4990 0x7f873814d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 >> 172.21.15.2:0/730913586 conn(0x7f87380cf990 msgr2=0x7f87380b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 shutdown_connections 2023-11-04T01:46:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:29.733+0000 7f873dce9640 1 -- 172.21.15.2:0/730913586 wait complete. 2023-11-04T01:46:29.754 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:34.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.884+0000 7f4834386640 1 Processor -- start 2023-11-04T01:46:34.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.884+0000 7f4834386640 1 -- start start 2023-11-04T01:46:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4834386640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f482c1618d0 0x7f482c0d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4834386640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c0cdfa0 0x7f482c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4834386640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0d1e00 con 0x7f482c0b8bf0 2023-11-04T01:46:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4834386640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c0b8a70 con 0x7f482c1618d0 2023-11-04T01:46:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4834386640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0d1b20 con 0x7f482c0cdfa0 2023-11-04T01:46:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832122640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f482c1618d0 0x7f482c0d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832923640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f482c0b8bf0 0x7f482c0b5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53540/0 (socket says 172.21.15.2:53540) 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832923640 1 -- 172.21.15.2:0/1753576945 learned_addr learned my addr 172.21.15.2:0/1753576945 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832122640 1 -- 172.21.15.2:0/1753576945 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c0cdfa0 msgr2=0x7f482c0b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4831921640 1 --2- 172.21.15.2:0/1753576945 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c0cdfa0 0x7f482c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832122640 1 --2- 172.21.15.2:0/1753576945 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c0cdfa0 0x7f482c0b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832122640 1 -- 172.21.15.2:0/1753576945 >> v1:172.21.15.2:6789/0 conn(0x7f482c0b8bf0 legacy=0x7f482c0b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832122640 1 -- 172.21.15.2:0/1753576945 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c161cb0 con 0x7f482c1618d0 2023-11-04T01:46:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4831120640 1 -- 172.21.15.2:0/1753576945 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351583370 0 0) 0x7f482c0d1e00 con 0x7f482c0b8bf0 2023-11-04T01:46:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4832122640 1 --2- 172.21.15.2:0/1753576945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c1618d0 0x7f482c0d2290 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f48280097c0 tx=0x7f482801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56bd4ce1f13b4d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4831120640 1 -- 172.21.15.2:0/1753576945 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280ab600 con 0x7f482c1618d0 2023-11-04T01:46:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4831120640 1 -- 172.21.15.2:0/1753576945 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48280a7050 con 0x7f482c1618d0 2023-11-04T01:46:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.888+0000 7f4831120640 1 -- 172.21.15.2:0/1753576945 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280ab980 con 0x7f482c1618d0 2023-11-04T01:46:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- 172.21.15.2:0/1753576945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c1618d0 msgr2=0x7f482c0d2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 --2- 172.21.15.2:0/1753576945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c1618d0 0x7f482c0d2290 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f48280097c0 tx=0x7f482801c360 comp rx=0 tx=0).stop 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- 172.21.15.2:0/1753576945 shutdown_connections 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 --2- 172.21.15.2:0/1753576945 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c0cdfa0 0x7f482c0b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 --2- 172.21.15.2:0/1753576945 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c1618d0 0x7f482c0d2290 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- 172.21.15.2:0/1753576945 >> 172.21.15.2:0/1753576945 conn(0x7f482c0cf9c0 msgr2=0x7f482c0cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- 172.21.15.2:0/1753576945 shutdown_connections 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- 172.21.15.2:0/1753576945 wait complete. 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 Processor -- start 2023-11-04T01:46:34.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- start start 2023-11-04T01:46:34.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c0b8bf0 0x7f482c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f482c0cdfa0 0x7f482c0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c1618d0 0x7f482c15d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c15d5a0 con 0x7f482c0b8bf0 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c15cc10 con 0x7f482c0cdfa0 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b8080 con 0x7f482c1618d0 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c0b8bf0 0x7f482c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c0b8bf0 0x7f482c156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40444/0 (socket says 172.21.15.2:40444) 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 -- 172.21.15.2:0/2167447559 learned_addr learned my addr 172.21.15.2:0/2167447559 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832923640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c1618d0 0x7f482c15d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4831921640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f482c0cdfa0 0x7f482c0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 -- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c1618d0 msgr2=0x7f482c15d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c1618d0 0x7f482c15d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:34.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 -- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f482c0cdfa0 msgr2=0x7f482c0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f482c0cdfa0 0x7f482c0ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 -- 172.21.15.2:0/2167447559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4828009420 con 0x7f482c0b8bf0 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4832122640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c0b8bf0 0x7f482c156910 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f482801aa10 tx=0x7f482801aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4822ffd640 1 -- 172.21.15.2:0/2167447559 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48280abe60 con 0x7f482c0b8bf0 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4822ffd640 1 -- 172.21.15.2:0/2167447559 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4828004020 con 0x7f482c0b8bf0 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f482c15cee0 con 0x7f482c0b8bf0 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4822ffd640 1 -- 172.21.15.2:0/2167447559 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828004390 con 0x7f482c0b8bf0 2023-11-04T01:46:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.892+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c0b7ca0 con 0x7f482c0b8bf0 2023-11-04T01:46:34.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.896+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c0675f0 con 0x7f482c0b8bf0 2023-11-04T01:46:34.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.896+0000 7f4822ffd640 1 -- 172.21.15.2:0/2167447559 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4828003620 con 0x7f482c0b8bf0 2023-11-04T01:46:34.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.896+0000 7f4822ffd640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48100664a0 0x7f4810068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:34.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.896+0000 7f4822ffd640 1 -- 172.21.15.2:0/2167447559 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f482811ead0 con 0x7f482c0b8bf0 2023-11-04T01:46:34.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.896+0000 7f4831921640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48100664a0 0x7f4810068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:34.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.896+0000 7f4831921640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48100664a0 0x7f4810068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f482c160b40 tx=0x7f481c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:34.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:34.900+0000 7f4822ffd640 1 -- 172.21.15.2:0/2167447559 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48280ebad0 con 0x7f482c0b8bf0 2023-11-04T01:46:35.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.088+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f482c157920 con 0x7f482c0b8bf0 2023-11-04T01:46:35.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4822ffd640 1 -- 172.21.15.2:0/2167447559 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f48280c3090 con 0x7f482c0b8bf0 2023-11-04T01:46:35.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:35.096 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:28.982593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 59 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48100664a0 msgr2=0x7f4810068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48100664a0 0x7f4810068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f482c160b40 tx=0x7f481c008040 comp rx=0 tx=0).stop 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c0b8bf0 msgr2=0x7f482c156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c0b8bf0 0x7f482c156910 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f482801aa10 tx=0x7f482801aba0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 shutdown_connections 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48100664a0 0x7f4810068960 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f482c1618d0 0x7f482c15d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f482c0cdfa0 0x7f482c0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 --2- 172.21.15.2:0/2167447559 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f482c0b8bf0 0x7f482c156910 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 >> 172.21.15.2:0/2167447559 conn(0x7f482c0cf9c0 msgr2=0x7f482c0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 shutdown_connections 2023-11-04T01:46:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:35.092+0000 7f4834386640 1 -- 172.21.15.2:0/2167447559 wait complete. 2023-11-04T01:46:35.115 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:35.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:46:40.116 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c649b1640 1 Processor -- start 2023-11-04T01:46:40.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c649b1640 1 -- start start 2023-11-04T01:46:40.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c649b1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 0x7f5c600ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c649b1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600cda70 con 0x7f5c600cdf00 2023-11-04T01:46:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c649b1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600cce60 con 0x7f5c6006c1a0 2023-11-04T01:46:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c649b1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600cd140 con 0x7f5c6015ccb0 2023-11-04T01:46:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5dd9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5c600cdf00 0x7f5c6006ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53548/0 (socket says 172.21.15.2:53548) 2023-11-04T01:46:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5dd9b640 1 -- 172.21.15.2:0/80809030 learned_addr learned my addr 172.21.15.2:0/80809030 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5e59c640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 0x7f5c600ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263320587 0 0) 0x7f5c600cda70 con 0x7f5c600cdf00 2023-11-04T01:46:40.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c48003530 con 0x7f5c600cdf00 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103264147 0 0) 0x7f5c48003530 con 0x7f5c600cdf00 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 msgr2=0x7f5c600ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 0x7f5c600ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 >> v1:172.21.15.90:6789/0 conn(0x7f5c6006c1a0 legacy=0x7f5c6006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600cd420 con 0x7f5c600cdf00 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f5c54001680 con 0x7f5c600cdf00 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 >> v1:172.21.15.2:6789/0 conn(0x7f5c600cdf00 legacy=0x7f5c6006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 0x7f5c480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c48003f30 0x7f5c480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c48004d10 0x7f5c48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600cd140 con 0x7f5c48004d10 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4800dd10 con 0x7f5c48003f30 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4800ded0 con 0x7f5c6015ccb0 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5ed9d640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c48004d10 0x7f5c48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5e59c640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 0x7f5c480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5dd9b640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c48003f30 0x7f5c480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 msgr2=0x7f5c480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5ed9d640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c6015ccb0 0x7f5c480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c48003f30 msgr2=0x7f5c480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5ed9d640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c48003f30 0x7f5c480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/80809030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48003530 con 0x7f5c48004d10 2023-11-04T01:46:40.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.248+0000 7f5c5dd9b640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c48003f30 0x7f5c480047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:40.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c5ed9d640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c48004d10 0x7f5c48005190 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5c600b4b00 tx=0x7f5c5801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eee1cc86990a57d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:40.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58003b80 con 0x7f5c48004d10 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58003ce0 con 0x7f5c48004d10 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c5d59a640 1 -- 172.21.15.2:0/80809030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58005310 con 0x7f5c48004d10 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c649b1640 1 -- 172.21.15.2:0/80809030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c48004d10 msgr2=0x7f5c48005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c649b1640 1 --2- 172.21.15.2:0/80809030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c48004d10 0x7f5c48005190 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f5c600b4b00 tx=0x7f5c5801c700 comp rx=0 tx=0).stop 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/80809030 reap_dead start 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c649b1640 1 -- 172.21.15.2:0/80809030 shutdown_connections 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c649b1640 1 -- 172.21.15.2:0/80809030 >> 172.21.15.2:0/80809030 conn(0x7f5c600cebb0 msgr2=0x7f5c600cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c649b1640 1 -- 172.21.15.2:0/80809030 shutdown_connections 2023-11-04T01:46:40.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.252+0000 7f5c649b1640 1 -- 172.21.15.2:0/80809030 wait complete. 2023-11-04T01:46:40.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 Processor -- start 2023-11-04T01:46:40.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 -- start start 2023-11-04T01:46:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c48004d10 0x7f5c600b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c600b41a0 0x7f5c60157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c600b4620 0x7f5c601582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600b2b50 con 0x7f5c600b4620 2023-11-04T01:46:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601f7120 con 0x7f5c600b41a0 2023-11-04T01:46:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601f65a0 con 0x7f5c48004d10 2023-11-04T01:46:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c600b4620 0x7f5c601582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c600b4620 0x7f5c601582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40464/0 (socket says 172.21.15.2:40464) 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/701258475 learned_addr learned my addr 172.21.15.2:0/701258475 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5dd9b640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c600b41a0 0x7f5c60157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5e59c640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c48004d10 0x7f5c600b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c48004d10 msgr2=0x7f5c600b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c48004d10 0x7f5c600b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c600b41a0 msgr2=0x7f5c60157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c600b41a0 0x7f5c60157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 -- 172.21.15.2:0/701258475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c601f6880 con 0x7f5c600b4620 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c5ed9d640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c600b4620 0x7f5c601582c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f5c58098110 tx=0x7f5c48005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c4effd640 1 -- 172.21.15.2:0/701258475 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580b5070 con 0x7f5c600b4620 2023-11-04T01:46:40.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c4effd640 1 -- 172.21.15.2:0/701258475 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c580050d0 con 0x7f5c600b4620 2023-11-04T01:46:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c4effd640 1 -- 172.21.15.2:0/701258475 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58005440 con 0x7f5c600b4620 2023-11-04T01:46:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c601f6b60 con 0x7f5c600b4620 2023-11-04T01:46:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c601f61c0 con 0x7f5c600b4620 2023-11-04T01:46:40.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c600744a0 con 0x7f5c600b4620 2023-11-04T01:46:40.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.256+0000 7f5c4effd640 1 -- 172.21.15.2:0/701258475 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c580055a0 con 0x7f5c600b4620 2023-11-04T01:46:40.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.260+0000 7f5c4effd640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c400664d0 0x7f5c40068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:40.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.260+0000 7f5c4effd640 1 -- 172.21.15.2:0/701258475 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7f5c5811dff0 con 0x7f5c600b4620 2023-11-04T01:46:40.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.260+0000 7f5c5e59c640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c400664d0 0x7f5c40068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:40.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.260+0000 7f5c5e59c640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c400664d0 0x7f5c40068990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000acd0 tx=0x7f5c5000a2a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:40.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.264+0000 7f5c4effd640 1 -- 172.21.15.2:0/701258475 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c580eaf00 con 0x7f5c600b4620 2023-11-04T01:46:40.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.452+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c600c3460 con 0x7f5c600b4620 2023-11-04T01:46:40.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c4effd640 1 -- 172.21.15.2:0/701258475 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f5c580ee520 con 0x7f5c600b4620 2023-11-04T01:46:40.460 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:28.982593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:40.460 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 59 2023-11-04T01:46:40.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c400664d0 msgr2=0x7f5c40068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c400664d0 0x7f5c40068990 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000acd0 tx=0x7f5c5000a2a0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c600b4620 msgr2=0x7f5c601582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:40.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c600b4620 0x7f5c601582c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f5c58098110 tx=0x7f5c48005800 comp rx=0 tx=0).stop 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 shutdown_connections 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c400664d0 0x7f5c40068990 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c600b4620 0x7f5c601582c0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5c600b41a0 0x7f5c60157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 --2- 172.21.15.2:0/701258475 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5c48004d10 0x7f5c600b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 >> 172.21.15.2:0/701258475 conn(0x7f5c600cebb0 msgr2=0x7f5c600710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 shutdown_connections 2023-11-04T01:46:40.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:40.456+0000 7f5c649b1640 1 -- 172.21.15.2:0/701258475 wait complete. 2023-11-04T01:46:40.479 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:42.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:46:45.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb831e640 1 Processor -- start 2023-11-04T01:46:45.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb831e640 1 -- start start 2023-11-04T01:46:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb831e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fabb015a1f0 0x7fabb00cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb831e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb00cdea0 0x7fabb00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb831e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb00ccee0 con 0x7fabb00ca400 2023-11-04T01:46:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb831e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb015a5d0 con 0x7fabb015a1f0 2023-11-04T01:46:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb831e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00ca900 con 0x7fabb00cdea0 2023-11-04T01:46:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb60ba640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fabb015a1f0 0x7fabb00cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb60ba640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fabb015a1f0 0x7fabb00cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36966/0 (socket says 172.21.15.2:36966) 2023-11-04T01:46:45.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb60ba640 1 -- 172.21.15.2:0/1270605179 learned_addr learned my addr 172.21.15.2:0/1270605179 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:45.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb58b9640 1 --2- 172.21.15.2:0/1270605179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb00cdea0 0x7fabb00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb60ba640 1 -- 172.21.15.2:0/1270605179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb00cdea0 msgr2=0x7fabb00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:45.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb60ba640 1 --2- 172.21.15.2:0/1270605179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb00cdea0 0x7fabb00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb60ba640 1 -- 172.21.15.2:0/1270605179 >> v1:172.21.15.90:6789/0 conn(0x7fabb00ca400 legacy=0x7fabb00704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.612+0000 7fabb60ba640 1 -- 172.21.15.2:0/1270605179 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb00cabe0 con 0x7fabb015a1f0 2023-11-04T01:46:45.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb60ba640 1 --2- 172.21.15.2:0/1270605179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb015a1f0 0x7fabb00cd370 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fabac00bb10 tx=0x7fabac01ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac63d0a3e8a0f96d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb50b8640 1 -- 172.21.15.2:0/1270605179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0a7bb0 con 0x7fabb015a1f0 2023-11-04T01:46:45.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb50b8640 1 -- 172.21.15.2:0/1270605179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac0a7d10 con 0x7fabb015a1f0 2023-11-04T01:46:45.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb50b8640 1 -- 172.21.15.2:0/1270605179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0af660 con 0x7fabb015a1f0 2023-11-04T01:46:45.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 -- 172.21.15.2:0/1270605179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb015a1f0 msgr2=0x7fabb00cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 --2- 172.21.15.2:0/1270605179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb015a1f0 0x7fabb00cd370 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fabac00bb10 tx=0x7fabac01ebe0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 -- 172.21.15.2:0/1270605179 shutdown_connections 2023-11-04T01:46:45.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 --2- 172.21.15.2:0/1270605179 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb00cdea0 0x7fabb00b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 --2- 172.21.15.2:0/1270605179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb015a1f0 0x7fabb00cd370 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 -- 172.21.15.2:0/1270605179 >> 172.21.15.2:0/1270605179 conn(0x7fabb00cebb0 msgr2=0x7fabb00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:45.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 -- 172.21.15.2:0/1270605179 shutdown_connections 2023-11-04T01:46:45.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 -- 172.21.15.2:0/1270605179 wait complete. 2023-11-04T01:46:45.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 Processor -- start 2023-11-04T01:46:45.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.616+0000 7fabb831e640 1 -- start start 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00ca400 0x7fabb014ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb00cdea0 0x7fabb0158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb015a1f0 0x7fabb01593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0148810 con 0x7fabb00cdea0 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0150820 con 0x7fabb00ca400 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb01481c0 con 0x7fabb015a1f0 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb00cdea0 0x7fabb0158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb00cdea0 0x7fabb0158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36968/0 (socket says 172.21.15.2:36968) 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 -- 172.21.15.2:0/2849481098 learned_addr learned my addr 172.21.15.2:0/2849481098 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb60ba640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00ca400 0x7fabb014ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb68bb640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb015a1f0 0x7fabb01593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 -- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb015a1f0 msgr2=0x7fabb01593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb015a1f0 0x7fabb01593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 -- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00ca400 msgr2=0x7fabb014ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00ca400 0x7fabb014ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 -- 172.21.15.2:0/2849481098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac00b770 con 0x7fabb00cdea0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb58b9640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb00cdea0 0x7fabb0158e90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7faba000d800 tx=0x7faba000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7faba6ffd640 1 -- 172.21.15.2:0/2849481098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000b6c0 con 0x7fabb00cdea0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7faba6ffd640 1 -- 172.21.15.2:0/2849481098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba000b820 con 0x7fabb00cdea0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb01484a0 con 0x7fabb00cdea0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7faba6ffd640 1 -- 172.21.15.2:0/2849481098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000bb90 con 0x7fabb00cdea0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb01530f0 con 0x7fabb00cdea0 2023-11-04T01:46:45.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb0148020 con 0x7fabb00cdea0 2023-11-04T01:46:45.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7faba6ffd640 1 -- 172.21.15.2:0/2849481098 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faba000bcf0 con 0x7fabb00cdea0 2023-11-04T01:46:45.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7faba6ffd640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab940664d0 0x7fab94068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:45.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7faba6ffd640 1 -- 172.21.15.2:0/2849481098 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7faba0084800 con 0x7fabb00cdea0 2023-11-04T01:46:45.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.620+0000 7fabb60ba640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab940664d0 0x7fab94068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:45.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.624+0000 7fabb60ba640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab940664d0 0x7fab94068990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fabac0b1000 tx=0x7fabac0a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:45.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.624+0000 7faba6ffd640 1 -- 172.21.15.2:0/2849481098 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fabb0148020 con 0x7fabb00cdea0 2023-11-04T01:46:45.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.812+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabb0148020 con 0x7fabb00cdea0 2023-11-04T01:46:45.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.812+0000 7faba6ffd640 1 -- 172.21.15.2:0/2849481098 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4970 (secure 0 0 0) 0x7fabb0148020 con 0x7fabb00cdea0 2023-11-04T01:46:45.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:45.818 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6406,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:44.585338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":95,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7125,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7125":{"gid":7125,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":17,"addr":"172.21.15.2:6833/792110972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":792110972},{"type":"v1","addr":"172.21.15.2:6833","nonce":792110972}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:46:44.585337+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:45.819 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 60 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab940664d0 msgr2=0x7fab94068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab940664d0 0x7fab94068990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fabac0b1000 tx=0x7fabac0a9070 comp rx=0 tx=0).stop 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb00cdea0 msgr2=0x7fabb0158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb00cdea0 0x7fabb0158e90 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7faba000d800 tx=0x7faba000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 shutdown_connections 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fab940664d0 0x7fab94068990 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fabb015a1f0 0x7fabb01593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fabb00cdea0 0x7fabb0158e90 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 --2- 172.21.15.2:0/2849481098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00ca400 0x7fabb014ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 >> 172.21.15.2:0/2849481098 conn(0x7fabb00cebb0 msgr2=0x7fabb0156d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 shutdown_connections 2023-11-04T01:46:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:45.816+0000 7fabb831e640 1 -- 172.21.15.2:0/2849481098 wait complete. 2023-11-04T01:46:45.836 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:46:45.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:46:45.846 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:46:45.847 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:46:45.847 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:46:45.914 INFO:teuthology.orchestra.run.smithi002.stdout:1699062389.54269.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:46:45.916 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062389.54269.core'] 2023-11-04T01:46:45.916 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062389.54269.core, deleting it 2023-11-04T01:46:45.916 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062389.54269.core 2023-11-04T01:46:45.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:46:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 Processor -- start 2023-11-04T01:46:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 -- start start 2023-11-04T01:46:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff45415afb0 0x7ff4540b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff4540cd6d0 0x7ff4540cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45415b390 con 0x7ff4540cd6d0 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4540d0a60 con 0x7ff45415afb0 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff45b644640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540d04a0 con 0x7ff4540cb400 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff4540cd6d0 0x7ff4540cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff4540cd6d0 0x7ff4540cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36970/0 (socket says 172.21.15.2:36970) 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 -- 172.21.15.2:0/1787796929 learned_addr learned my addr 172.21.15.2:0/1787796929 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff4593e0640 1 --2- 172.21.15.2:0/1787796929 >> v2:172.21.15.90:3300/0 conn(0x7ff45415afb0 0x7ff4540b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff458bdf640 1 --2- 172.21.15.2:0/1787796929 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 -- 172.21.15.2:0/1787796929 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 msgr2=0x7ff4540cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 --2- 172.21.15.2:0/1787796929 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 -- 172.21.15.2:0/1787796929 >> v2:172.21.15.90:3300/0 conn(0x7ff45415afb0 msgr2=0x7ff4540b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 --2- 172.21.15.2:0/1787796929 >> v2:172.21.15.90:3300/0 conn(0x7ff45415afb0 0x7ff4540b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.128+0000 7ff459be1640 1 -- 172.21.15.2:0/1787796929 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4540d0780 con 0x7ff4540cd6d0 2023-11-04T01:46:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff459be1640 1 --2- 172.21.15.2:0/1787796929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff4540cdae0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff454066da0 tx=0x7ff44c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d31ed4a5cf62e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff453fff640 1 -- 172.21.15.2:0/1787796929 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0ab600 con 0x7ff4540cd6d0 2023-11-04T01:46:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff453fff640 1 -- 172.21.15.2:0/1787796929 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c0ab760 con 0x7ff4540cd6d0 2023-11-04T01:46:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff453fff640 1 -- 172.21.15.2:0/1787796929 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0abaf0 con 0x7ff4540cd6d0 2023-11-04T01:46:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 -- 172.21.15.2:0/1787796929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 msgr2=0x7ff4540cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 --2- 172.21.15.2:0/1787796929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff4540cdae0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7ff454066da0 tx=0x7ff44c01c440 comp rx=0 tx=0).stop 2023-11-04T01:46:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 -- 172.21.15.2:0/1787796929 shutdown_connections 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 --2- 172.21.15.2:0/1787796929 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff4540cdae0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 --2- 172.21.15.2:0/1787796929 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 --2- 172.21.15.2:0/1787796929 >> v2:172.21.15.90:3300/0 conn(0x7ff45415afb0 0x7ff4540b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 -- 172.21.15.2:0/1787796929 >> 172.21.15.2:0/1787796929 conn(0x7ff454065dc0 msgr2=0x7ff4540661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 -- 172.21.15.2:0/1787796929 shutdown_connections 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.132+0000 7ff45b644640 1 -- 172.21.15.2:0/1787796929 wait complete. 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 Processor -- start 2023-11-04T01:46:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 -- start start 2023-11-04T01:46:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff45415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff45415afb0 0x7ff454154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454153cf0 con 0x7ff4540cd6d0 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45415d7a0 con 0x7ff45415afb0 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff454153f90 con 0x7ff4540cb400 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff45415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff45415cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36980/0 (socket says 172.21.15.2:36980) 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 -- 172.21.15.2:0/2099941448 learned_addr learned my addr 172.21.15.2:0/2099941448 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff4593e0640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff459be1640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff45415afb0 0x7ff454154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 -- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 msgr2=0x7ff4540b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 -- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff45415afb0 msgr2=0x7ff454154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff45415afb0 0x7ff454154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 -- 172.21.15.2:0/2099941448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0094d0 con 0x7ff4540cd6d0 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff459be1640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff45415afb0 0x7ff454154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff458bdf640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff45415cd40 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff44800cd70 tx=0x7ff44800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff451ffb640 1 -- 172.21.15.2:0/2099941448 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448003ba0 con 0x7ff4540cd6d0 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff451ffb640 1 -- 172.21.15.2:0/2099941448 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448003d00 con 0x7ff4540cd6d0 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff454154270 con 0x7ff4540cd6d0 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff451ffb640 1 -- 172.21.15.2:0/2099941448 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448004260 con 0x7ff4540cd6d0 2023-11-04T01:46:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45414f910 con 0x7ff4540cd6d0 2023-11-04T01:46:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4540675f0 con 0x7ff4540cd6d0 2023-11-04T01:46:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.136+0000 7ff451ffb640 1 -- 172.21.15.2:0/2099941448 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4480043c0 con 0x7ff4540cd6d0 2023-11-04T01:46:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.140+0000 7ff451ffb640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4400664a0 0x7ff440068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.140+0000 7ff451ffb640 1 -- 172.21.15.2:0/2099941448 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6974+0+0 (secure 0 0 0) 0x7ff448012070 con 0x7ff4540cd6d0 2023-11-04T01:46:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.140+0000 7ff4593e0640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4400664a0 0x7ff440068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.140+0000 7ff4593e0640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4400664a0 0x7ff440068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff4440096f0 tx=0x7ff444008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.144+0000 7ff451ffb640 1 -- 172.21.15.2:0/2099941448 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff44808b080 con 0x7ff4540cd6d0 2023-11-04T01:46:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.348+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7ff4540b2c00 con 0x7ff4540cd6d0 2023-11-04T01:46:46.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.352+0000 7ff451ffb640 1 -- 172.21.15.2:0/2099941448 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7125 v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff448051ce0 con 0x7ff4540cd6d0 2023-11-04T01:46:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 7125 2023-11-04T01:46:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4400664a0 msgr2=0x7ff440068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4400664a0 0x7ff440068960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff4440096f0 tx=0x7ff444008040 comp rx=0 tx=0).stop 2023-11-04T01:46:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 msgr2=0x7ff45415cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff45415cd40 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff44800cd70 tx=0x7ff44800a660 comp rx=0 tx=0).stop 2023-11-04T01:46:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 shutdown_connections 2023-11-04T01:46:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4400664a0 0x7ff440068960 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff45415afb0 0x7ff454154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4540cd6d0 0x7ff45415cd40 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 --2- 172.21.15.2:0/2099941448 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4540cb400 0x7ff4540b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 >> 172.21.15.2:0/2099941448 conn(0x7ff454065dc0 msgr2=0x7ff4540d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 shutdown_connections 2023-11-04T01:46:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.356+0000 7ff45b644640 1 -- 172.21.15.2:0/2099941448 wait complete. 2023-11-04T01:46:46.380 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:46:46.380 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:46:46.380 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:46:46.380 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:46:46.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:46:46.381 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:46:46.381 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:46:46.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:46:46.383 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:46:46.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:46.450 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:46:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e89855640 1 Processor -- start 2023-11-04T01:46:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e89855640 1 -- start start 2023-11-04T01:46:46.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e89855640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 0x7f0e840ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e89855640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8415b360 con 0x7f0e8406ace0 2023-11-04T01:46:46.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e89855640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e84071880 con 0x7f0e8415af80 2023-11-04T01:46:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e89855640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84071b60 con 0x7f0e840b1e10 2023-11-04T01:46:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e837fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0e8406ace0 0x7f0e8415eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38086/0 (socket says 172.21.15.2:38086) 2023-11-04T01:46:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e837fe640 1 -- 172.21.15.2:0/1982974918 learned_addr learned my addr 172.21.15.2:0/1982974918 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 0x7f0e840ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383769163 0 0) 0x7f0e8415b360 con 0x7f0e8406ace0 2023-11-04T01:46:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6c003530 con 0x7f0e8406ace0 2023-11-04T01:46:46.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849961399 0 0) 0x7f0e6c003530 con 0x7f0e8406ace0 2023-11-04T01:46:46.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 msgr2=0x7f0e840ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 0x7f0e840ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 >> v1:172.21.15.90:6789/0 conn(0x7f0e8415af80 legacy=0x7f0e840b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8406a200 con 0x7f0e8406ace0 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f0e7c001680 con 0x7f0e8406ace0 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 >> v1:172.21.15.2:6789/0 conn(0x7f0e8406ace0 legacy=0x7f0e8415eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 0x7f0e6c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e6c004d10 0x7f0e6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84071b60 con 0x7f0e6c003ef0 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c00baa0 con 0x7f0e6c004d10 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c00bc60 con 0x7f0e840b1e10 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e82ffd640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 0x7f0e6c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e837fe640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e6c004d10 0x7f0e6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e827fc640 1 -- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 msgr2=0x7f0e6c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840b1e10 0x7f0e6c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e827fc640 1 -- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e6c004d10 msgr2=0x7f0e6c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e6c004d10 0x7f0e6c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.484+0000 7f0e827fc640 1 -- 172.21.15.2:0/1982974918 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c003530 con 0x7f0e6c003ef0 2023-11-04T01:46:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e6c0047d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009ae0 tx=0x7f0e7801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c86acb3e94fd002 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780a55f0 con 0x7f0e6c003ef0 2023-11-04T01:46:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e780a5750 con 0x7f0e6c003ef0 2023-11-04T01:46:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e81ffb640 1 -- 172.21.15.2:0/1982974918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780a5b00 con 0x7f0e6c003ef0 2023-11-04T01:46:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 -- 172.21.15.2:0/1982974918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 msgr2=0x7f0e6c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 --2- 172.21.15.2:0/1982974918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e6c0047d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009ae0 tx=0x7f0e7801ca20 comp rx=0 tx=0).stop 2023-11-04T01:46:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e837fe640 1 -- 172.21.15.2:0/1982974918 reap_dead start 2023-11-04T01:46:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 -- 172.21.15.2:0/1982974918 shutdown_connections 2023-11-04T01:46:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 -- 172.21.15.2:0/1982974918 >> 172.21.15.2:0/1982974918 conn(0x7f0e8406e760 msgr2=0x7f0e8406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 -- 172.21.15.2:0/1982974918 shutdown_connections 2023-11-04T01:46:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 -- 172.21.15.2:0/1982974918 wait complete. 2023-11-04T01:46:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 Processor -- start 2023-11-04T01:46:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.488+0000 7f0e89855640 1 -- start start 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e84149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e8415caa0 0x7f0e8415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840c76c0 0x7f0e840c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84147830 con 0x7f0e6c003ef0 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8415b580 con 0x7f0e8415caa0 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840c8430 con 0x7f0e840c76c0 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e84149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e84149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37020/0 (socket says 172.21.15.2:37020) 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 -- 172.21.15.2:0/1139932305 learned_addr learned my addr 172.21.15.2:0/1139932305 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e837fe640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840c76c0 0x7f0e840c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e8415caa0 0x7f0e8415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 -- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840c76c0 msgr2=0x7f0e840c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840c76c0 0x7f0e840c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 -- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e8415caa0 msgr2=0x7f0e8415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e8415caa0 0x7f0e8415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 -- 172.21.15.2:0/1139932305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84147a80 con 0x7f0e6c003ef0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e82ffd640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e84149b20 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400e950 tx=0x7f0e7400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e6bfff640 1 -- 172.21.15.2:0/1139932305 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74003b90 con 0x7f0e6c003ef0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e6bfff640 1 -- 172.21.15.2:0/1139932305 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e74003d10 con 0x7f0e6c003ef0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e84147d60 con 0x7f0e6c003ef0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e6bfff640 1 -- 172.21.15.2:0/1139932305 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400c9c0 con 0x7f0e6c003ef0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8415d440 con 0x7f0e6c003ef0 2023-11-04T01:46:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e840675f0 con 0x7f0e6c003ef0 2023-11-04T01:46:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e6bfff640 1 -- 172.21.15.2:0/1139932305 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e7400cb20 con 0x7f0e6c003ef0 2023-11-04T01:46:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e6bfff640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e700664d0 0x7f0e70068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e6bfff640 1 -- 172.21.15.2:0/1139932305 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f0e74084540 con 0x7f0e6c003ef0 2023-11-04T01:46:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.492+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e700664d0 0x7f0e70068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.496+0000 7f0e827fc640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e700664d0 0x7f0e70068990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0e780af000 tx=0x7f0e780046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.496+0000 7f0e6bfff640 1 -- 172.21.15.2:0/1139932305 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0e74051500 con 0x7f0e6c003ef0 2023-11-04T01:46:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.688+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e84148210 con 0x7f0e6c003ef0 2023-11-04T01:46:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.688+0000 7f0e6bfff640 1 -- 172.21.15.2:0/1139932305 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4136 (secure 0 0 0) 0x7f0e7401a310 con 0x7f0e6c003ef0 2023-11-04T01:46:46.694 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:46.694 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":62,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:46.366186+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 62 2023-11-04T01:46:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e700664d0 msgr2=0x7f0e70068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e700664d0 0x7f0e70068990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0e780af000 tx=0x7f0e780046d0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 msgr2=0x7f0e84149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e84149b20 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400e950 tx=0x7f0e7400ee10 comp rx=0 tx=0).stop 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 shutdown_connections 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0e700664d0 0x7f0e70068990 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0e840c76c0 0x7f0e840c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e8415caa0 0x7f0e8415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 --2- 172.21.15.2:0/1139932305 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c003ef0 0x7f0e84149b20 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 >> 172.21.15.2:0/1139932305 conn(0x7f0e8406e760 msgr2=0x7f0e8406d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 shutdown_connections 2023-11-04T01:46:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:46.692+0000 7f0e89855640 1 -- 172.21.15.2:0/1139932305 wait complete. 2023-11-04T01:46:46.713 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:46:49.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:46:51.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:51.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.844+0000 7f1a59648640 1 Processor -- start 2023-11-04T01:46:51.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.844+0000 7f1a59648640 1 -- start start 2023-11-04T01:46:51.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a59648640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a540715d0 0x7f1a540b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a59648640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540c2670 con 0x7f1a540b0b70 2023-11-04T01:46:51.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a59648640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5406bc30 con 0x7f1a5415afd0 2023-11-04T01:46:51.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a59648640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a54070140 con 0x7f1a540715d0 2023-11-04T01:46:51.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a537fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1a540b0b70 0x7f1a5415ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53140/0 (socket says 172.21.15.2:53140) 2023-11-04T01:46:51.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a537fe640 1 -- 172.21.15.2:0/103134565 learned_addr learned my addr 172.21.15.2:0/103134565 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:51.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a527fc640 1 --2- 172.21.15.2:0/103134565 >> v2:172.21.15.2:3300/0 conn(0x7f1a540715d0 0x7f1a540b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a51ffb640 1 -- 172.21.15.2:0/103134565 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270649886 0 0) 0x7f1a540c2670 con 0x7f1a540b0b70 2023-11-04T01:46:51.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a51ffb640 1 -- 172.21.15.2:0/103134565 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a40003530 con 0x7f1a540b0b70 2023-11-04T01:46:51.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a527fc640 1 -- 172.21.15.2:0/103134565 >> v1:172.21.15.90:6789/0 conn(0x7f1a5415afd0 legacy=0x7f1a5406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a527fc640 1 -- 172.21.15.2:0/103134565 >> v1:172.21.15.2:6789/0 conn(0x7f1a540b0b70 legacy=0x7f1a5415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a527fc640 1 -- 172.21.15.2:0/103134565 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5406bf10 con 0x7f1a540715d0 2023-11-04T01:46:51.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a527fc640 1 --2- 172.21.15.2:0/103134565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a540715d0 0x7f1a540b0630 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097c0 tx=0x7f1a3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a034bcc14bd98e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a51ffb640 1 -- 172.21.15.2:0/103134565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0ab600 con 0x7f1a540715d0 2023-11-04T01:46:51.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a51ffb640 1 -- 172.21.15.2:0/103134565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0a7050 con 0x7f1a540715d0 2023-11-04T01:46:51.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.848+0000 7f1a51ffb640 1 -- 172.21.15.2:0/103134565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0ab980 con 0x7f1a540715d0 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- 172.21.15.2:0/103134565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a540715d0 msgr2=0x7f1a540b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 --2- 172.21.15.2:0/103134565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a540715d0 0x7f1a540b0630 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0097c0 tx=0x7f1a3c01c480 comp rx=0 tx=0).stop 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- 172.21.15.2:0/103134565 shutdown_connections 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 --2- 172.21.15.2:0/103134565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a540715d0 0x7f1a540b0630 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- 172.21.15.2:0/103134565 >> 172.21.15.2:0/103134565 conn(0x7f1a540cebb0 msgr2=0x7f1a540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- 172.21.15.2:0/103134565 shutdown_connections 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- 172.21.15.2:0/103134565 wait complete. 2023-11-04T01:46:51.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 Processor -- start 2023-11-04T01:46:51.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- start start 2023-11-04T01:46:51.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a540715d0 0x7f1a541519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a540b0b70 0x7f1a540c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a5415afd0 0x7f1a5415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5415b6b0 con 0x7f1a5415afd0 2023-11-04T01:46:51.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54152330 con 0x7f1a540715d0 2023-11-04T01:46:51.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a59648640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5415b8c0 con 0x7f1a540b0b70 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a5415afd0 0x7f1a5415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a5415afd0 0x7f1a5415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43346/0 (socket says 172.21.15.2:43346) 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 -- 172.21.15.2:0/1465953234 learned_addr learned my addr 172.21.15.2:0/1465953234 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a52ffd640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a540715d0 0x7f1a541519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a527fc640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a540b0b70 0x7f1a540c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 -- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a540b0b70 msgr2=0x7f1a540c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a540b0b70 0x7f1a540c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 -- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a540715d0 msgr2=0x7f1a541519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a540715d0 0x7f1a541519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 -- 172.21.15.2:0/1465953234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c009420 con 0x7f1a5415afd0 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a537fe640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a5415afd0 0x7f1a5415cce0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400caa0 tx=0x7f1a4400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a4b7fe640 1 -- 172.21.15.2:0/1465953234 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400ac00 con 0x7f1a5415afd0 2023-11-04T01:46:51.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a4b7fe640 1 -- 172.21.15.2:0/1465953234 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4400ad60 con 0x7f1a5415afd0 2023-11-04T01:46:51.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.852+0000 7f1a4b7fe640 1 -- 172.21.15.2:0/1465953234 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44012620 con 0x7f1a5415afd0 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5415bba0 con 0x7f1a5415afd0 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5415c160 con 0x7f1a5415afd0 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a540744a0 con 0x7f1a5415afd0 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a4b7fe640 1 -- 172.21.15.2:0/1465953234 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a44007070 con 0x7f1a5415afd0 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a4b7fe640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a4b7fe640 1 -- 172.21.15.2:0/1465953234 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f1a44084460 con 0x7f1a5415afd0 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a52ffd640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:51.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.856+0000 7f1a52ffd640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000f70 tx=0x7f1a4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:51.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:51.860+0000 7f1a4b7fe640 1 -- 172.21.15.2:0/1465953234 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a440512f0 con 0x7f1a5415afd0 2023-11-04T01:46:52.015 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:46:52.011+0000 7ff8af22e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:52.015 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:46:52.011+0000 7ff8af22e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a5406cba0 con 0x7f1a5415afd0 2023-11-04T01:46:52.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a4b7fe640 1 -- 172.21.15.2:0/1465953234 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f1a44054910 con 0x7f1a5415afd0 2023-11-04T01:46:52.052 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:52.053 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:49.397478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:52.053 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 msgr2=0x7f1a34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c000f70 tx=0x7f1a4c009040 comp rx=0 tx=0).stop 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a5415afd0 msgr2=0x7f1a5415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a5415afd0 0x7f1a5415cce0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400caa0 tx=0x7f1a4400cf60 comp rx=0 tx=0).stop 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 shutdown_connections 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1a340664a0 0x7f1a34068960 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a5415afd0 0x7f1a5415cce0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a540b0b70 0x7f1a540c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 --2- 172.21.15.2:0/1465953234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a540715d0 0x7f1a541519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 >> 172.21.15.2:0/1465953234 conn(0x7f1a540cebb0 msgr2=0x7f1a540cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.048+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 shutdown_connections 2023-11-04T01:46:52.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.052+0000 7f1a59648640 1 -- 172.21.15.2:0/1465953234 wait complete. 2023-11-04T01:46:52.072 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:46:52.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.188+0000 7f3057aa5640 1 Processor -- start 2023-11-04T01:46:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.188+0000 7f3057aa5640 1 -- start start 2023-11-04T01:46:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3057aa5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500b4990 0x7f30500b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3057aa5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30500d0690 0x7f30500cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3057aa5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500b6070 con 0x7f30500d0ae0 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3057aa5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500b8ed0 con 0x7f30500d0690 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3057aa5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500b52b0 con 0x7f30500b4990 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055040640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30500d0690 0x7f30500cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055040640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30500d0690 0x7f30500cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43350/0 (socket says 172.21.15.2:43350) 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055040640 1 -- 172.21.15.2:0/2849687682 learned_addr learned my addr 172.21.15.2:0/2849687682 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055841640 1 --2- 172.21.15.2:0/2849687682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500b4990 0x7f30500b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055040640 1 -- 172.21.15.2:0/2849687682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500b4990 msgr2=0x7f30500b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055040640 1 --2- 172.21.15.2:0/2849687682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500b4990 0x7f30500b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055040640 1 -- 172.21.15.2:0/2849687682 >> v1:172.21.15.90:6789/0 conn(0x7f30500d0ae0 legacy=0x7f30500cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.192+0000 7f3055040640 1 -- 172.21.15.2:0/2849687682 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500d1ce0 con 0x7f30500d0690 2023-11-04T01:46:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3055040640 1 --2- 172.21.15.2:0/2849687682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500d0690 0x7f30500cd770 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f304c009870 tx=0x7f304c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18ce2664a975cfa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f305483f640 1 -- 172.21.15.2:0/2849687682 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0a8a30 con 0x7f30500d0690 2023-11-04T01:46:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f305483f640 1 -- 172.21.15.2:0/2849687682 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0a8b90 con 0x7f30500d0690 2023-11-04T01:46:52.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f305483f640 1 -- 172.21.15.2:0/2849687682 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0b0440 con 0x7f30500d0690 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 -- 172.21.15.2:0/2849687682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500d0690 msgr2=0x7f30500cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 --2- 172.21.15.2:0/2849687682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500d0690 0x7f30500cd770 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f304c009870 tx=0x7f304c01ed30 comp rx=0 tx=0).stop 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 -- 172.21.15.2:0/2849687682 shutdown_connections 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 --2- 172.21.15.2:0/2849687682 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500d0690 0x7f30500cd770 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 --2- 172.21.15.2:0/2849687682 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500b4990 0x7f30500b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 -- 172.21.15.2:0/2849687682 >> 172.21.15.2:0/2849687682 conn(0x7f30500cf990 msgr2=0x7f30500cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 -- 172.21.15.2:0/2849687682 shutdown_connections 2023-11-04T01:46:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 -- 172.21.15.2:0/2849687682 wait complete. 2023-11-04T01:46:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 Processor -- start 2023-11-04T01:46:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.196+0000 7f3057aa5640 1 -- start start 2023-11-04T01:46:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500b4990 0x7f30501f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500d0690 0x7f30500cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30500d0ae0 0x7f3050158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050157d30 con 0x7f30500b4990 2023-11-04T01:46:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30500c9fe0 con 0x7f30500d0ae0 2023-11-04T01:46:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500ca2c0 con 0x7f30500d0690 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500b4990 0x7f30501f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500b4990 0x7f30501f3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43358/0 (socket says 172.21.15.2:43358) 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 -- 172.21.15.2:0/1291962136 learned_addr learned my addr 172.21.15.2:0/1291962136 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3056042640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30500d0ae0 0x7f3050158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055040640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500d0690 0x7f30500cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 -- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500d0690 msgr2=0x7f30500cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500d0690 0x7f30500cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 -- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30500d0ae0 msgr2=0x7f3050158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30500d0ae0 0x7f3050158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 -- 172.21.15.2:0/1291962136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0094d0 con 0x7f30500b4990 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055040640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500d0690 0x7f30500cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055841640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500b4990 0x7f30501f3830 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f304400d5f0 tx=0x7f304400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f30427fc640 1 -- 172.21.15.2:0/1291962136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440125f0 con 0x7f30500b4990 2023-11-04T01:46:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f30427fc640 1 -- 172.21.15.2:0/1291962136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044012750 con 0x7f30500b4990 2023-11-04T01:46:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f30427fc640 1 -- 172.21.15.2:0/1291962136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044012ae0 con 0x7f30500b4990 2023-11-04T01:46:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500ca5a0 con 0x7f30500b4990 2023-11-04T01:46:52.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500cab60 con 0x7f30500b4990 2023-11-04T01:46:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30500cacf0 con 0x7f30500b4990 2023-11-04T01:46:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f30427fc640 1 -- 172.21.15.2:0/1291962136 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3044012c40 con 0x7f30500b4990 2023-11-04T01:46:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f30427fc640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30340664a0 0x7f3034068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f30427fc640 1 -- 172.21.15.2:0/1291962136 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f30440848f0 con 0x7f30500b4990 2023-11-04T01:46:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.200+0000 7f3055040640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30340664a0 0x7f3034068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.204+0000 7f3055040640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30340664a0 0x7f3034068960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f304c0b2000 tx=0x7f304c0aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.204+0000 7f30427fc640 1 -- 172.21.15.2:0/1291962136 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3044051800 con 0x7f30500b4990 2023-11-04T01:46:52.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30500744a0 con 0x7f30500b4990 2023-11-04T01:46:52.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f30427fc640 1 -- 172.21.15.2:0/1291962136 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3044054e20 con 0x7f30500b4990 2023-11-04T01:46:52.401 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:52.401 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:49.397478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:52.401 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30340664a0 msgr2=0x7f3034068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30340664a0 0x7f3034068960 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f304c0b2000 tx=0x7f304c0aa070 comp rx=0 tx=0).stop 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500b4990 msgr2=0x7f30501f3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500b4990 0x7f30501f3830 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f304400d5f0 tx=0x7f304400dab0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 shutdown_connections 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30340664a0 0x7f3034068960 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30500d0ae0 0x7f3050158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30500d0690 0x7f30500cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 --2- 172.21.15.2:0/1291962136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30500b4990 0x7f30501f3830 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 >> 172.21.15.2:0/1291962136 conn(0x7f30500cf990 msgr2=0x7f30500d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 shutdown_connections 2023-11-04T01:46:52.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.396+0000 7f3057aa5640 1 -- 172.21.15.2:0/1291962136 wait complete. 2023-11-04T01:46:52.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:45:35.008340+0000', 'modified': '2023-11-04T01:46:49.397478+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 96, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 6406, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6406': {'gid': 6406, 'name': 'd', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.90:6837/3941825889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 3941825889}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 3941825889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 48, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.2:6835/3725992406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 3725992406}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3725992406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:46:52.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:46:52.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:46:52.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9fcf3640 1 Processor -- start 2023-11-04T01:46:52.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9fcf3640 1 -- start start 2023-11-04T01:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9fcf3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ccac0 0x7ffa980d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9fcf3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffa980ccea0 0x7ffa981617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9fcf3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9806ccf0 con 0x7ffa980ce960 2023-11-04T01:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9fcf3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98161d30 con 0x7ffa980ccea0 2023-11-04T01:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9fcf3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9806d220 con 0x7ffa980ccac0 2023-11-04T01:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9e290640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa980ce960 0x7ffa980cd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53154/0 (socket says 172.21.15.2:53154) 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9e290640 1 -- 172.21.15.2:0/1443331415 learned_addr learned my addr 172.21.15.2:0/1443331415 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/1443331415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ccac0 0x7ffa980d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.952+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/1443331415 >> v2:172.21.15.90:3300/0 conn(0x7ffa980ccea0 0x7ffa981617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9ca8d640 1 -- 172.21.15.2:0/1443331415 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339110256 0 0) 0x7ffa9806ccf0 con 0x7ffa980ce960 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9ca8d640 1 -- 172.21.15.2:0/1443331415 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa84003530 con 0x7ffa980ce960 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9da8f640 1 -- 172.21.15.2:0/1443331415 >> v2:172.21.15.90:3300/0 conn(0x7ffa980ccea0 msgr2=0x7ffa981617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/1443331415 >> v2:172.21.15.90:3300/0 conn(0x7ffa980ccea0 0x7ffa981617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9da8f640 1 -- 172.21.15.2:0/1443331415 >> v1:172.21.15.2:6789/0 conn(0x7ffa980ce960 legacy=0x7ffa980cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9da8f640 1 -- 172.21.15.2:0/1443331415 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9806c630 con 0x7ffa980ccac0 2023-11-04T01:46:52.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/1443331415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ccac0 0x7ffa980d06a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a46a46c9e91663e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9ca8d640 1 -- 172.21.15.2:0/1443331415 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940ab650 con 0x7ffa980ccac0 2023-11-04T01:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9ca8d640 1 -- 172.21.15.2:0/1443331415 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa940ab7b0 con 0x7ffa980ccac0 2023-11-04T01:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9ca8d640 1 -- 172.21.15.2:0/1443331415 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940abb20 con 0x7ffa980ccac0 2023-11-04T01:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/1443331415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ccac0 msgr2=0x7ffa980d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/1443331415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ccac0 0x7ffa980d06a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c450 comp rx=0 tx=0).stop 2023-11-04T01:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/1443331415 shutdown_connections 2023-11-04T01:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/1443331415 >> v2:172.21.15.90:3300/0 conn(0x7ffa980ccea0 0x7ffa981617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/1443331415 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ccac0 0x7ffa980d06a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/1443331415 >> 172.21.15.2:0/1443331415 conn(0x7ffa98065dc0 msgr2=0x7ffa980661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/1443331415 shutdown_connections 2023-11-04T01:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.956+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/1443331415 wait complete. 2023-11-04T01:46:52.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 Processor -- start 2023-11-04T01:46:52.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 -- start start 2023-11-04T01:46:52.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa980ccac0 0x7ffa980aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa980ccea0 0x7ffa980c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ce960 0x7ffa980c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980c51e0 con 0x7ffa980ccea0 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980c7670 con 0x7ffa980ccac0 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980c4840 con 0x7ffa980ce960 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa980ccea0 0x7ffa980c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa980ccea0 0x7ffa980c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43362/0 (socket says 172.21.15.2:43362) 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 -- 172.21.15.2:0/2288325629 learned_addr learned my addr 172.21.15.2:0/2288325629 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa980ccac0 0x7ffa980aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9e290640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ce960 0x7ffa980c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 -- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ce960 msgr2=0x7ffa980c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ce960 0x7ffa980c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 -- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa980ccac0 msgr2=0x7ffa980aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa980ccac0 0x7ffa980aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 -- 172.21.15.2:0/2288325629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa94009420 con 0x7ffa980ccea0 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa980ccea0 0x7ffa980c5600 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800e930 tx=0x7ffa8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa8e7fc640 1 -- 172.21.15.2:0/2288325629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88009690 con 0x7ffa980ccea0 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa8e7fc640 1 -- 172.21.15.2:0/2288325629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8800ca00 con 0x7ffa980ccea0 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa980c4b20 con 0x7ffa980ccea0 2023-11-04T01:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa8e7fc640 1 -- 172.21.15.2:0/2288325629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8800cd70 con 0x7ffa980ccea0 2023-11-04T01:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa981556d0 con 0x7ffa980ccea0 2023-11-04T01:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.960+0000 7ffa8e7fc640 1 -- 172.21.15.2:0/2288325629 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffa88013470 con 0x7ffa980ccea0 2023-11-04T01:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa8e7fc640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa7c0664a0 0x7ffa7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa8e7fc640 1 -- 172.21.15.2:0/2288325629 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7ffa88084640 con 0x7ffa980ccea0 2023-11-04T01:46:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa7c0664a0 0x7ffa7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 Processor -- start 2023-11-04T01:46:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- start start 2023-11-04T01:46:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa7c0664a0 0x7ffa7c068960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffa940af000 tx=0x7ffa940a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06bff380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bff8c0 0x563d06bb2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d06a7d460 con 0x563d06bfefa0 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d06a0e690 con 0x563d06bb2b40 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d06a0bbc0 con 0x563d06bff8c0 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06bff380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06bff380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43372/0 (socket says 172.21.15.2:43372) 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3701891476 learned_addr learned my addr 172.21.15.2:0/3701891476 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bff8c0 0x563d06bb2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9e290640 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bff8c0 msgr2=0x563d06bb2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bff8c0 0x563d06bb2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 msgr2=0x563d06bb2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3701891476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d066ff890 con 0x563d06bfefa0 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06bff380 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ffa9401ccf0 tx=0x7ffa94004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46117b94334bc340 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa7b7fe640 1 -- 172.21.15.2:0/3701891476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940abbe0 con 0x563d06bfefa0 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa7b7fe640 1 -- 172.21.15.2:0/3701891476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa940c4070 con 0x563d06bfefa0 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffa7b7fe640 1 -- 172.21.15.2:0/3701891476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94003620 con 0x563d06bfefa0 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3701891476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 msgr2=0x563d06bff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06bff380 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ffa9401ccf0 tx=0x7ffa94004740 comp rx=0 tx=0).stop 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3701891476 shutdown_connections 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bff8c0 0x563d06bb2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3701891476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06bff380 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3701891476 >> 172.21.15.2:0/3701891476 conn(0x563d06bdfd40 msgr2=0x563d06be2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3701891476 shutdown_connections 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.964+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3701891476 wait complete. 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 -- start start 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 Processor -- start 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bb8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bff8c0 0x563d06bb94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d06a074b0 con 0x563d06bff8c0 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d069bfaa0 con 0x563d06bb2b40 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d069c5940 con 0x563d06bfefa0 2023-11-04T01:46:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 10 client.0 _ll_register_callbacks cb 0x563d06ba0460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bff8c0 0x563d06bb94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bff8c0 0x563d06bb94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43378/0 (socket says 172.21.15.2:43378) 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 -- 172.21.15.2:0/830567749 learned_addr learned my addr 172.21.15.2:0/830567749 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bb8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 -- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 msgr2=0x563d06bb8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bb8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 -- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 msgr2=0x563d06bb8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 -- 172.21.15.2:0/830567749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa940ba070 con 0x563d06bff8c0 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bb8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9e290640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bff8c0 0x563d06bb94f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ffa90007540 tx=0x7ffa90007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6642594502ddce15 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa78ff9640 1 -- 172.21.15.2:0/830567749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa900109d0 con 0x563d06bff8c0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa78ff9640 1 -- 172.21.15.2:0/830567749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7ffa90010b30 con 0x563d06bff8c0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d069c4e10 con 0x563d06bff8c0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa78ff9640 1 -- 172.21.15.2:0/830567749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa90010cf0 con 0x563d06bff8c0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 10 client.7602 fetch_fsmap learned FSMap version 66 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x563d069c81a0 con 0x563d06bff8c0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa78ff9640 1 -- 172.21.15.2:0/830567749 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d069c4e10 con 0x563d06bff8c0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa78ff9640 1 -- 172.21.15.2:0/830567749 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 66) v1 ==== 3306+0+0 (secure 0 0 0) 0x7ffa9001c3a0 con 0x563d06bff8c0 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 10 client.7602 fetch_fsmap finished waiting for FSMap version 66 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 10 client.7602 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:46:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 20 client.7602 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bb9d90 0x563d06c10720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 4 client.7602 mds_command: new command op to 6406 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 --> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d06a05e00 con 0x563d06bb9d90 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bb9d90 0x563d06c10720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa78ff9640 10 client.7602 ms_handle_connect on v2:172.21.15.90:6834/3941825889 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.968+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bb9d90 0x563d06c10720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b106326e579be237 server_cookie=ca3305b60eaf2881 in_seq=0 out_seq=0 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffa78ff9640 1 -- 172.21.15.2:0/830567749 <== mds.0 v2:172.21.15.90:6834/3941825889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563d06a05e00 con 0x563d06bb9d90 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffa78ff9640 10 client.7602 handle_command_reply: tid=0 2023-11-04T01:46:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 client.7602 shutdown 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bff8c0 msgr2=0x563d06bb94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bff8c0 0x563d06bb94f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ffa90007540 tx=0x7ffa90007a00 comp rx=0 tx=0).stop 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 shutdown_connections 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bb9d90 0x563d06c10720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bff8c0 0x563d06bb94f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bb8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/830567749 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bb8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 >> 172.21.15.2:0/830567749 conn(0x563d06bdfd40 msgr2=0x563d06be2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffa78ff9640 0 client.7602 ms_handle_reset on v2:172.21.15.90:6834/3941825889 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 shutdown_connections 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 1 -- 172.21.15.2:0/830567749 wait complete. 2023-11-04T01:46:52.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.972+0000 7ffaa2e20000 20 client.7602 trim_cache size 0 max 16384 2023-11-04T01:46:52.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 Processor -- start 2023-11-04T01:46:52.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- start start 2023-11-04T01:46:52.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bdfd40 0x563d06bfe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bfe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d066c0940 con 0x563d06bdfd40 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d06bb2a00 con 0x563d06bb2b40 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d06a04cc0 con 0x563d06bfefa0 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bdfd40 0x563d06bfe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bdfd40 0x563d06bfe480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43390/0 (socket says 172.21.15.2:43390) 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3405064549 learned_addr learned my addr 172.21.15.2:0/3405064549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9e290640 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 msgr2=0x563d06bba8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bfe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bba8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 msgr2=0x563d06bfe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:52.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bfe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 -- 172.21.15.2:0/3405064549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d069ae4a0 con 0x563d06bdfd40 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bfe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bdfd40 0x563d06bfe480 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ffa9401c930 tx=0x7ffa94009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8580e7658e695c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa7bfff640 1 -- 172.21.15.2:0/3405064549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940ab9e0 con 0x563d06bdfd40 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa7bfff640 1 -- 172.21.15.2:0/3405064549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa940c4040 con 0x563d06bdfd40 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffa7bfff640 1 -- 172.21.15.2:0/3405064549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940d3470 con 0x563d06bdfd40 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3405064549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bdfd40 msgr2=0x563d06bfe480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bdfd40 0x563d06bfe480 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ffa9401c930 tx=0x7ffa94009190 comp rx=0 tx=0).stop 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3405064549 shutdown_connections 2023-11-04T01:46:52.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bfefa0 0x563d06bba8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bb2b40 0x563d06bfe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/3405064549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bdfd40 0x563d06bfe480 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3405064549 >> 172.21.15.2:0/3405064549 conn(0x563d06bb8c00 msgr2=0x563d06bba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3405064549 shutdown_connections 2023-11-04T01:46:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- 172.21.15.2:0/3405064549 wait complete. 2023-11-04T01:46:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 -- start start 2023-11-04T01:46:52.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.988+0000 7ffaa2e20000 1 Processor -- start 2023-11-04T01:46:53.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bb2b40 0x563d06c12070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bdfd40 0x563d06c5bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06c5c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d069ccd20 con 0x563d06bfefa0 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d06a017b0 con 0x563d06bdfd40 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x563d06a117d0 con 0x563d06bb2b40 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 10 client.0 _ll_register_callbacks cb 0x7ffa840036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06c5c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06c5c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43392/0 (socket says 172.21.15.2:43392) 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 -- 172.21.15.2:0/2332118469 learned_addr learned my addr 172.21.15.2:0/2332118469 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9d28e640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bdfd40 0x563d06c5bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bb2b40 0x563d06c12070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 -- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bb2b40 msgr2=0x563d06c12070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bb2b40 0x563d06c12070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 -- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bdfd40 msgr2=0x563d06c5bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bdfd40 0x563d06c5bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 -- 172.21.15.2:0/2332118469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa940cd040 con 0x563d06bfefa0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bb2b40 0x563d06c12070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9e290640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06c5c410 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001b60 tx=0x7ffa90013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3259271bacc91764 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 1 -- 172.21.15.2:0/2332118469 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa900105b0 con 0x563d06bfefa0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 1 -- 172.21.15.2:0/2332118469 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7ffa9001c980 con 0x563d06bfefa0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d069d1d10 con 0x563d06bfefa0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 1 -- 172.21.15.2:0/2332118469 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa900070b0 con 0x563d06bfefa0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 10 client.7608 fetch_fsmap learned FSMap version 66 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x563d066ffcc0 con 0x563d06bfefa0 2023-11-04T01:46:53.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 1 -- 172.21.15.2:0/2332118469 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563d069d1d10 con 0x563d06bfefa0 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 1 -- 172.21.15.2:0/2332118469 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 66) v1 ==== 3306+0+0 (secure 0 0 0) 0x7ffa90010be0 con 0x563d06bfefa0 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 10 client.7608 fetch_fsmap finished waiting for FSMap version 66 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 10 client.7608 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 20 client.7608 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bff8c0 0x563d06c68f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 4 client.7608 mds_command: new command op to 6406 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 --> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563d06a00490 con 0x563d06bff8c0 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bff8c0 0x563d06c68f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 10 client.7608 ms_handle_connect on v2:172.21.15.90:6834/3941825889 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa9da8f640 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bff8c0 0x563d06c68f60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddc8f65df22f55b server_cookie=57863a69fcb28104 in_seq=0 out_seq=0 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 1 -- 172.21.15.2:0/2332118469 <== mds.0 v2:172.21.15.90:6834/3941825889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563d06a00490 con 0x563d06bff8c0 2023-11-04T01:46:53.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 10 client.7608 handle_command_reply: tid=0 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 client.7608 shutdown 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 msgr2=0x563d06c5c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06c5c410 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001b60 tx=0x7ffa90013000 comp rx=0 tx=0).stop 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 shutdown_connections 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:6834/3941825889,v1:172.21.15.90:6837/3941825889] conn(0x563d06bff8c0 0x563d06c68f60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d06bfefa0 0x563d06c5c410 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x563d06bdfd40 0x563d06c5bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffa78ff9640 0 client.7608 ms_handle_reset on v2:172.21.15.90:6834/3941825889 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 --2- 172.21.15.2:0/2332118469 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x563d06bb2b40 0x563d06c12070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 >> 172.21.15.2:0/2332118469 conn(0x563d06bb8c00 msgr2=0x563d06bfd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 shutdown_connections 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 1 -- 172.21.15.2:0/2332118469 wait complete. 2023-11-04T01:46:53.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.992+0000 7ffaa2e20000 20 client.7608 trim_cache size 0 max 16384 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 6406, 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.627163404, 2023-11-04T01:46:53.005 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 66, 2023-11-04T01:46:53.006 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 96, 2023-11-04T01:46:53.006 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:46:53.006 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 31.906320519000001 2023-11-04T01:46:53.006 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa7c0664a0 msgr2=0x7ffa7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa7c0664a0 0x7ffa7c068960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ffa940af000 tx=0x7ffa940a7000 comp rx=0 tx=0).stop 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa980ccea0 msgr2=0x7ffa980c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa980ccea0 0x7ffa980c5600 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800e930 tx=0x7ffa8800edf0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 shutdown_connections 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffa7c0664a0 0x7ffa7c068960 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffa980ce960 0x7ffa980c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa980ccea0 0x7ffa980c5600 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 --2- 172.21.15.2:0/2288325629 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa980ccac0 0x7ffa980aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 >> 172.21.15.2:0/2288325629 conn(0x7ffa98065dc0 msgr2=0x7ffa98160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 shutdown_connections 2023-11-04T01:46:53.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:52.996+0000 7ffa9fcf3640 1 -- 172.21.15.2:0/2288325629 wait complete. 2023-11-04T01:46:53.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:46:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f3d268640 1 Processor -- start 2023-11-04T01:46:53.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f3d268640 1 -- start start 2023-11-04T01:46:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f3d268640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f380b1960 0x7f0f380cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f3d268640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f380b1d40 0x7f0f380ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f3d268640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f380cdc80 con 0x7f0f3815cd60 2023-11-04T01:46:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f3d268640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f38071e40 con 0x7f0f380b1d40 2023-11-04T01:46:53.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f3d268640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f380ca700 con 0x7f0f380b1960 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f367fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f380b1d40 0x7f0f380ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f367fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0f380b1d40 0x7f0f380ca1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43408/0 (socket says 172.21.15.2:43408) 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f367fc640 1 -- 172.21.15.2:0/4176588405 learned_addr learned my addr 172.21.15.2:0/4176588405 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/4176588405 >> v2:172.21.15.90:3300/0 conn(0x7f0f380b1960 0x7f0f380cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f367fc640 1 -- 172.21.15.2:0/4176588405 >> v2:172.21.15.90:3300/0 conn(0x7f0f380b1960 msgr2=0x7f0f380cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f367fc640 1 --2- 172.21.15.2:0/4176588405 >> v2:172.21.15.90:3300/0 conn(0x7f0f380b1960 0x7f0f380cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f367fc640 1 -- 172.21.15.2:0/4176588405 >> v1:172.21.15.2:6789/0 conn(0x7f0f3815cd60 legacy=0x7f0f3815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f367fc640 1 -- 172.21.15.2:0/4176588405 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380cf5a0 con 0x7f0f380b1d40 2023-11-04T01:46:53.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.120+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/4176588405 >> v2:172.21.15.90:3300/0 conn(0x7f0f380b1960 0x7f0f380cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:53.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f367fc640 1 --2- 172.21.15.2:0/4176588405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f380b1d40 0x7f0f380ca1c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0f38066f90 tx=0x7f0f2c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f54eda1844a9dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f35ffb640 1 -- 172.21.15.2:0/4176588405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0aa430 con 0x7f0f380b1d40 2023-11-04T01:46:53.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f35ffb640 1 -- 172.21.15.2:0/4176588405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c0aa590 con 0x7f0f380b1d40 2023-11-04T01:46:53.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f35ffb640 1 -- 172.21.15.2:0/4176588405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0aa920 con 0x7f0f380b1d40 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- 172.21.15.2:0/4176588405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f380b1d40 msgr2=0x7f0f380ca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 --2- 172.21.15.2:0/4176588405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f380b1d40 0x7f0f380ca1c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0f38066f90 tx=0x7f0f2c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- 172.21.15.2:0/4176588405 shutdown_connections 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 --2- 172.21.15.2:0/4176588405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f380b1d40 0x7f0f380ca1c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 --2- 172.21.15.2:0/4176588405 >> v2:172.21.15.90:3300/0 conn(0x7f0f380b1960 0x7f0f380cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- 172.21.15.2:0/4176588405 >> 172.21.15.2:0/4176588405 conn(0x7f0f3806e760 msgr2=0x7f0f3806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- 172.21.15.2:0/4176588405 shutdown_connections 2023-11-04T01:46:53.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- 172.21.15.2:0/4176588405 wait complete. 2023-11-04T01:46:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 Processor -- start 2023-11-04T01:46:53.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- start start 2023-11-04T01:46:53.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f380b1960 0x7f0f38154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f380b1d40 0x7f0f380cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3815cd60 0x7f0f3815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3815e5f0 con 0x7f0f3815cd60 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f38154560 con 0x7f0f380b1d40 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f3d268640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380cb880 con 0x7f0f380b1960 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3815cd60 0x7f0f3815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3815cd60 0x7f0f3815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43418/0 (socket says 172.21.15.2:43418) 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.124+0000 7f0f377fe640 1 -- 172.21.15.2:0/1591814662 learned_addr learned my addr 172.21.15.2:0/1591814662 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f367fc640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f380b1d40 0x7f0f380cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f380b1960 0x7f0f38154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f377fe640 1 -- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f380b1960 msgr2=0x7f0f38154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f377fe640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f380b1960 0x7f0f38154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f377fe640 1 -- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f380b1d40 msgr2=0x7f0f380cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f377fe640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f380b1d40 0x7f0f380cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f377fe640 1 -- 172.21.15.2:0/1591814662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c0094d0 con 0x7f0f3815cd60 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f380b1960 0x7f0f38154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f377fe640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3815cd60 0x7f0f3815f060 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c730 tx=0x7f0f3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f1f7fe640 1 -- 172.21.15.2:0/1591814662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30003ba0 con 0x7f0f3815cd60 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f1f7fe640 1 -- 172.21.15.2:0/1591814662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f30003d00 con 0x7f0f3815cd60 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f38160350 con 0x7f0f3815cd60 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f1f7fe640 1 -- 172.21.15.2:0/1591814662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30005310 con 0x7f0f3815cd60 2023-11-04T01:46:53.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3815eb40 con 0x7f0f3815cd60 2023-11-04T01:46:53.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f1f7fe640 1 -- 172.21.15.2:0/1591814662 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0f30005680 con 0x7f0f3815cd60 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f1f7fe640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f240664a0 0x7f0f24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f1f7fe640 1 -- 172.21.15.2:0/1591814662 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f0f30084370 con 0x7f0f3815cd60 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f240664a0 0x7f0f24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f40395000 1 Processor -- start 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f40395000 1 -- start start 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.128+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f240664a0 0x7f0f24068960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0f38072200 tx=0x7f0f28008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c97380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c4a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c4af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952b15460 con 0x561952c978c0 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952aa6690 con 0x561952c96fa0 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561952aa3bc0 con 0x561952c4ab40 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c4a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c4a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43432/0 (socket says 172.21.15.2:43432) 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 -- 172.21.15.2:0/3828776124 learned_addr learned my addr 172.21.15.2:0/3828776124 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c97380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c4af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 -- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 msgr2=0x561952c4af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c4af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 -- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 msgr2=0x561952c97380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c97380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 -- 172.21.15.2:0/3828776124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561952797890 con 0x561952c978c0 2023-11-04T01:46:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c4af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c4a600 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c01c510 tx=0x7f0f2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c73daea8284acb7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f1cff9640 1 -- 172.21.15.2:0/3828776124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0aac70 con 0x561952c978c0 2023-11-04T01:46:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f1cff9640 1 -- 172.21.15.2:0/3828776124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c0aadd0 con 0x561952c978c0 2023-11-04T01:46:53.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f1cff9640 1 -- 172.21.15.2:0/3828776124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c0be650 con 0x561952c978c0 2023-11-04T01:46:53.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- 172.21.15.2:0/3828776124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 msgr2=0x561952c4a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c4a600 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c01c510 tx=0x7f0f2c004740 comp rx=0 tx=0).stop 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- 172.21.15.2:0/3828776124 shutdown_connections 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c4af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c4a600 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- 172.21.15.2:0/3828776124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c97380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- 172.21.15.2:0/3828776124 >> 172.21.15.2:0/3828776124 conn(0x561952c77d40 msgr2=0x561952c7a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- 172.21.15.2:0/3828776124 shutdown_connections 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- 172.21.15.2:0/3828776124 wait complete. 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- start start 2023-11-04T01:46:53.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 Processor -- start 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c53050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c4fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c50020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952a9f4b0 con 0x561952c978c0 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952a57aa0 con 0x561952c96fa0 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561952a5d940 con 0x561952c4ab40 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 10 client.0 _ll_register_callbacks cb 0x561952c38460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c50020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c50020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43434/0 (socket says 172.21.15.2:43434) 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 -- 172.21.15.2:0/3790843804 learned_addr learned my addr 172.21.15.2:0/3790843804 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f367fc640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c4fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c53050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 -- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 msgr2=0x561952c53050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c53050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 -- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 msgr2=0x561952c4fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c4fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 -- 172.21.15.2:0/3790843804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f380cf5a0 con 0x561952c978c0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c53050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f377fe640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c50020 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0f30051440 tx=0x7f0f30055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6664a8f51b8fe718 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f15ffb640 1 -- 172.21.15.2:0/3790843804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300840c0 con 0x561952c978c0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f15ffb640 1 -- 172.21.15.2:0/3790843804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f0f30051650 con 0x561952c978c0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561952a5ce10 con 0x561952c978c0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f15ffb640 1 -- 172.21.15.2:0/3790843804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f30051810 con 0x561952c978c0 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 10 client.7623 fetch_fsmap learned FSMap version 66 2023-11-04T01:46:53.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.132+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x561952a601a0 con 0x561952c978c0 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f15ffb640 1 -- 172.21.15.2:0/3790843804 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561952a5ce10 con 0x561952c978c0 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f15ffb640 1 -- 172.21.15.2:0/3790843804 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 66) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f0f30019020 con 0x561952c978c0 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 10 client.7623 fetch_fsmap finished waiting for FSMap version 66 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 10 client.7623 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 20 client.7623 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c50d90 0x561952ca8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 4 client.7623 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561952a9de00 con 0x561952c50d90 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c50d90 0x561952ca8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f15ffb640 10 client.7623 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c50d90 0x561952ca8250 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7fab76b9a5534af8 server_cookie=7f70bf820898ee31 in_seq=0 out_seq=0 2023-11-04T01:46:53.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f15ffb640 1 -- 172.21.15.2:0/3790843804 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561952a9de00 con 0x561952c50d90 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f15ffb640 10 client.7623 handle_command_reply: tid=0 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 client.7623 shutdown 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 msgr2=0x561952c50020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c50020 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f0f30051440 tx=0x7f0f30055000 comp rx=0 tx=0).stop 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 shutdown_connections 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c50d90 0x561952ca8250 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c978c0 0x561952c50020 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952c4fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 --2- 172.21.15.2:0/3790843804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c53050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f15ffb640 0 client.7623 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 >> 172.21.15.2:0/3790843804 conn(0x561952c77d40 msgr2=0x561952c7a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 shutdown_connections 2023-11-04T01:46:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 1 -- 172.21.15.2:0/3790843804 wait complete. 2023-11-04T01:46:53.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.136+0000 7f0f40395000 20 client.7623 trim_cache size 0 max 16384 2023-11-04T01:46:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 Processor -- start 2023-11-04T01:46:53.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- start start 2023-11-04T01:46:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c52390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c50d90 0x561952c95050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c96fa0 0x561952c95590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952758940 con 0x561952c96fa0 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952aa97d0 con 0x561952c50d90 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561952a3a750 con 0x561952c4ab40 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c96fa0 0x561952c95590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c96fa0 0x561952c95590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43446/0 (socket says 172.21.15.2:43446) 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 -- 172.21.15.2:0/1863205814 learned_addr learned my addr 172.21.15.2:0/1863205814 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f367fc640 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c50d90 0x561952c95050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c52390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 -- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 msgr2=0x561952c52390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c52390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 -- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c50d90 msgr2=0x561952c95050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c50d90 0x561952c95050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 -- 172.21.15.2:0/1863205814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561952a464a0 con 0x561952c96fa0 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f377fe640 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c96fa0 0x561952c95590 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0f30054c40 tx=0x7f0f3001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ad79ef118bde42 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f1d7fa640 1 -- 172.21.15.2:0/1863205814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f300548a0 con 0x561952c96fa0 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f1d7fa640 1 -- 172.21.15.2:0/1863205814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f300840c0 con 0x561952c96fa0 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f1d7fa640 1 -- 172.21.15.2:0/1863205814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30054520 con 0x561952c96fa0 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- 172.21.15.2:0/1863205814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c96fa0 msgr2=0x561952c95590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c96fa0 0x561952c95590 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0f30054c40 tx=0x7f0f3001d000 comp rx=0 tx=0).stop 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- 172.21.15.2:0/1863205814 shutdown_connections 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c96fa0 0x561952c95590 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c50d90 0x561952c95050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- 172.21.15.2:0/1863205814 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c4ab40 0x561952c52390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- 172.21.15.2:0/1863205814 >> 172.21.15.2:0/1863205814 conn(0x561952c77d40 msgr2=0x561952c4f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- 172.21.15.2:0/1863205814 shutdown_connections 2023-11-04T01:46:53.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- 172.21.15.2:0/1863205814 wait complete. 2023-11-04T01:46:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- start start 2023-11-04T01:46:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 Processor -- start 2023-11-04T01:46:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c4ab40 0x561952c4fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c50d90 0x561952cf6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952cf73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952adf830 con 0x561952c4ab40 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952aa34b0 con 0x561952c96fa0 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x561952a9c8b0 con 0x561952c50d90 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.152+0000 7f0f40395000 10 client.0 _ll_register_callbacks cb 0x7f0f2c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c4ab40 0x561952c4fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c4ab40 0x561952c4fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43458/0 (socket says 172.21.15.2:43458) 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 -- 172.21.15.2:0/148282286 learned_addr learned my addr 172.21.15.2:0/148282286 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f367fc640 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c50d90 0x561952cf6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f377fe640 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952cf73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 -- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c50d90 msgr2=0x561952cf6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c50d90 0x561952cf6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 -- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 msgr2=0x561952cf73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952cf73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 -- 172.21.15.2:0/148282286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561952a601a0 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f36ffd640 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c4ab40 0x561952c4fc10 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800de20 tx=0x7f0f28004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53969605384d8a6e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 1 -- 172.21.15.2:0/148282286 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2800b050 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 1 -- 172.21.15.2:0/148282286 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f0f2801b040 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561952a69d10 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 1 -- 172.21.15.2:0/148282286 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f280250b0 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 10 client.7629 fetch_fsmap learned FSMap version 66 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x561952797cc0 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 1 -- 172.21.15.2:0/148282286 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561952a69d10 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 1 -- 172.21.15.2:0/148282286 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 66) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f0f28025210 con 0x561952c4ab40 2023-11-04T01:46:53.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 10 client.7629 fetch_fsmap finished waiting for FSMap version 66 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 10 client.7629 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 20 client.7629 populate_metadata read hostname 'smithi002' 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c978c0 0x561952d00b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 4 client.7629 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561952a98490 con 0x561952c978c0 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f367fc640 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c978c0 0x561952d00b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 10 client.7629 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f367fc640 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c978c0 0x561952d00b00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa3687209aeb6cae server_cookie=77f65793bc07d014 in_seq=0 out_seq=0 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 1 -- 172.21.15.2:0/148282286 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561952a98490 con 0x561952c978c0 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 10 client.7629 handle_command_reply: tid=0 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 client.7629 shutdown 2023-11-04T01:46:53.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c4ab40 msgr2=0x561952c4fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c4ab40 0x561952c4fc10 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800de20 tx=0x7f0f28004740 comp rx=0 tx=0).stop 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 shutdown_connections 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x561952c978c0 0x561952d00b00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x561952c96fa0 0x561952cf73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x561952c50d90 0x561952cf6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f15ffb640 0 client.7629 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 --2- 172.21.15.2:0/148282286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561952c4ab40 0x561952c4fc10 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 >> 172.21.15.2:0/148282286 conn(0x561952c77d40 msgr2=0x561952c4f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 shutdown_connections 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 1 -- 172.21.15.2:0/148282286 wait complete. 2023-11-04T01:46:53.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f40395000 20 client.7629 trim_cache size 0 max 16384 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7128, 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 66.343831989999998, 2023-11-04T01:46:53.168 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 66, 2023-11-04T01:46:53.169 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 96, 2023-11-04T01:46:53.169 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 96, 2023-11-04T01:46:53.169 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 83.570793528999999 2023-11-04T01:46:53.169 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:46:53.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f240664a0 msgr2=0x7f0f24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f240664a0 0x7f0f24068960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f0f38072200 tx=0x7f0f28008040 comp rx=0 tx=0).stop 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3815cd60 msgr2=0x7f0f3815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3815cd60 0x7f0f3815f060 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000c730 tx=0x7f0f3000cbf0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 shutdown_connections 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0f240664a0 0x7f0f24068960 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3815cd60 0x7f0f3815f060 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f380b1d40 0x7f0f380cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 --2- 172.21.15.2:0/1591814662 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0f380b1960 0x7f0f38154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 >> 172.21.15.2:0/1591814662 conn(0x7f0f3806e760 msgr2=0x7f0f380af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 shutdown_connections 2023-11-04T01:46:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.156+0000 7f0f3d268640 1 -- 172.21.15.2:0/1591814662 wait complete. 2023-11-04T01:46:53.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:53.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.280+0000 7f1a10255640 1 Processor -- start 2023-11-04T01:46:53.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.280+0000 7f1a10255640 1 -- start start 2023-11-04T01:46:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a10255640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1a080d0690 0x7f1a080b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a10255640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a10255640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a080b6070 con 0x7f1a080b4990 2023-11-04T01:46:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a10255640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a080b8ed0 con 0x7f1a080d0690 2023-11-04T01:46:53.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a10255640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080d1ce0 con 0x7f1a080d0ae0 2023-11-04T01:46:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0dff1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1a080b4990 0x7f1a080b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53160/0 (socket says 172.21.15.2:53160) 2023-11-04T01:46:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0dff1640 1 -- 172.21.15.2:0/3710983671 learned_addr learned my addr 172.21.15.2:0/3710983671 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0d7f0640 1 --2- 172.21.15.2:0/3710983671 >> v2:172.21.15.90:3300/0 conn(0x7f1a080d0690 0x7f1a080b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0e7f2640 1 --2- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0cfef640 1 -- 172.21.15.2:0/3710983671 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909265254 0 0) 0x7f1a080b6070 con 0x7f1a080b4990 2023-11-04T01:46:53.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0cfef640 1 -- 172.21.15.2:0/3710983671 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f4003530 con 0x7f1a080b4990 2023-11-04T01:46:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0cfef640 1 -- 172.21.15.2:0/3710983671 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2244952856 0 0) 0x7f19f4003530 con 0x7f1a080b4990 2023-11-04T01:46:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0d7f0640 1 -- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 msgr2=0x7f1a080b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0d7f0640 1 --2- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0d7f0640 1 -- 172.21.15.2:0/3710983671 >> v1:172.21.15.2:6789/0 conn(0x7f1a080b4990 legacy=0x7f1a080b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0d7f0640 1 -- 172.21.15.2:0/3710983671 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080d1fc0 con 0x7f1a080d0690 2023-11-04T01:46:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0d7f0640 1 --2- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a080b64e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0097c0 tx=0x7f19fc01eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749613ca7f85a1d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0cfef640 1 -- 172.21.15.2:0/3710983671 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04001680 con 0x7f1a080d0690 2023-11-04T01:46:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0cfef640 1 -- 172.21.15.2:0/3710983671 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0a85d0 con 0x7f1a080d0690 2023-11-04T01:46:53.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.284+0000 7f1a0cfef640 1 -- 172.21.15.2:0/3710983671 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0a8940 con 0x7f1a080d0690 2023-11-04T01:46:53.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 msgr2=0x7f1a080b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 --2- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a080b64e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0097c0 tx=0x7f19fc01eb90 comp rx=0 tx=0).stop 2023-11-04T01:46:53.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/3710983671 shutdown_connections 2023-11-04T01:46:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 --2- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a080b64e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 --2- 172.21.15.2:0/3710983671 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/3710983671 >> 172.21.15.2:0/3710983671 conn(0x7f1a080cf990 msgr2=0x7f1a080cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/3710983671 shutdown_connections 2023-11-04T01:46:53.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/3710983671 wait complete. 2023-11-04T01:46:53.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 Processor -- start 2023-11-04T01:46:53.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- start start 2023-11-04T01:46:53.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a080b4990 0x7f1a0815d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a08156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0815e850 con 0x7f1a080b4990 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a081579c0 con 0x7f1a080d0690 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0815dbd0 con 0x7f1a080d0ae0 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a080b4990 0x7f1a0815d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a080b4990 0x7f1a0815d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43468/0 (socket says 172.21.15.2:43468) 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 -- 172.21.15.2:0/2308123254 learned_addr learned my addr 172.21.15.2:0/2308123254 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0d7f0640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a08156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0e7f2640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 -- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 msgr2=0x7f1a080cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 -- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 msgr2=0x7f1a08156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a08156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 -- 172.21.15.2:0/2308123254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc009420 con 0x7f1a080b4990 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0d7f0640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a08156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a0dff1640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a080b4990 0x7f1a0815d4d0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c750 tx=0x7f1a0400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f19fa7fc640 1 -- 172.21.15.2:0/2308123254 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04005ae0 con 0x7f1a080b4990 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f19fa7fc640 1 -- 172.21.15.2:0/2308123254 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04005c40 con 0x7f1a080b4990 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0815deb0 con 0x7f1a080b4990 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f19fa7fc640 1 -- 172.21.15.2:0/2308123254 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04007070 con 0x7f1a080b4990 2023-11-04T01:46:53.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0815e470 con 0x7f1a080b4990 2023-11-04T01:46:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.288+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0815e990 con 0x7f1a080b4990 2023-11-04T01:46:53.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.292+0000 7f19fa7fc640 1 -- 172.21.15.2:0/2308123254 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1a040071d0 con 0x7f1a080b4990 2023-11-04T01:46:53.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.292+0000 7f19fa7fc640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19ec0664a0 0x7f19ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.292+0000 7f19fa7fc640 1 -- 172.21.15.2:0/2308123254 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f1a04084060 con 0x7f1a080b4990 2023-11-04T01:46:53.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.292+0000 7f1a0d7f0640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19ec0664a0 0x7f19ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.292+0000 7f1a0d7f0640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19ec0664a0 0x7f19ec068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0b2000 tx=0x7f19fc0aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.296+0000 7f19fa7fc640 1 -- 172.21.15.2:0/2308123254 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a04051020 con 0x7f1a080b4990 2023-11-04T01:46:53.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.484+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a080744a0 con 0x7f1a080b4990 2023-11-04T01:46:53.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.484+0000 7f19fa7fc640 1 -- 172.21.15.2:0/2308123254 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f1a04054640 con 0x7f1a080b4990 2023-11-04T01:46:53.490 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:53.490 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:49.397478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:53.491 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2023-11-04T01:46:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19ec0664a0 msgr2=0x7f19ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19ec0664a0 0x7f19ec068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0b2000 tx=0x7f19fc0aa070 comp rx=0 tx=0).stop 2023-11-04T01:46:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a080b4990 msgr2=0x7f1a0815d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a080b4990 0x7f1a0815d4d0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c750 tx=0x7f1a0400cc10 comp rx=0 tx=0).stop 2023-11-04T01:46:53.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 shutdown_connections 2023-11-04T01:46:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19ec0664a0 0x7f19ec068960 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1a080d0ae0 0x7f1a080cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a080d0690 0x7f1a08156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 --2- 172.21.15.2:0/2308123254 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a080b4990 0x7f1a0815d4d0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 >> 172.21.15.2:0/2308123254 conn(0x7f1a080cf990 msgr2=0x7f1a080b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 shutdown_connections 2023-11-04T01:46:53.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.488+0000 7f1a10255640 1 -- 172.21.15.2:0/2308123254 wait complete. 2023-11-04T01:46:53.508 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:46:53.651 INFO:teuthology.orchestra.run.smithi090.stdout:{"last_snap":3,"last_created":3,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:46:03.907395+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:46:29.227900+0000","name":"s12","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:46:53.652 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 3, "last_destroyed": 1, "last_snap": 3, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:46:03.907395+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:46:29.227900+0000" } ] } 2023-11-04T01:46:53.652 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:46:53.652 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5 2023-11-04T01:46:53.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a5576c640 1 Processor -- start 2023-11-04T01:46:53.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a5576c640 1 -- start start 2023-11-04T01:46:53.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a5576c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a500b4990 0x7f3a500b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a5576c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3a500d0690 0x7f3a500cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a5576c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a500b6070 con 0x7f3a500d0ae0 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a5576c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500b8ed0 con 0x7f3a500b4990 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a5576c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a500b52b0 con 0x7f3a500d0690 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a500b4990 0x7f3a500b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3a500b4990 0x7f3a500b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43472/0 (socket says 172.21.15.2:43472) 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4effd640 1 -- 172.21.15.2:0/1429311143 learned_addr learned my addr 172.21.15.2:0/1429311143 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4e7fc640 1 --2- 172.21.15.2:0/1429311143 >> v2:172.21.15.90:3300/0 conn(0x7f3a500d0690 0x7f3a500cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4effd640 1 -- 172.21.15.2:0/1429311143 >> v2:172.21.15.90:3300/0 conn(0x7f3a500d0690 msgr2=0x7f3a500cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4effd640 1 --2- 172.21.15.2:0/1429311143 >> v2:172.21.15.90:3300/0 conn(0x7f3a500d0690 0x7f3a500cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4effd640 1 -- 172.21.15.2:0/1429311143 >> v1:172.21.15.90:6789/0 conn(0x7f3a500d0ae0 legacy=0x7f3a500cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:53.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.776+0000 7f3a4effd640 1 -- 172.21.15.2:0/1429311143 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500d1ce0 con 0x7f3a500b4990 2023-11-04T01:46:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 --2- 172.21.15.2:0/1429311143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500b4d70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3a5008c090 tx=0x7f3a4001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d75977d70c150c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4dffb640 1 -- 172.21.15.2:0/1429311143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400a89b0 con 0x7f3a500b4990 2023-11-04T01:46:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4dffb640 1 -- 172.21.15.2:0/1429311143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a400a8b10 con 0x7f3a500b4990 2023-11-04T01:46:53.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4dffb640 1 -- 172.21.15.2:0/1429311143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400a8ea0 con 0x7f3a500b4990 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- 172.21.15.2:0/1429311143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 msgr2=0x7f3a500b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 --2- 172.21.15.2:0/1429311143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500b4d70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3a5008c090 tx=0x7f3a4001ecb0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- 172.21.15.2:0/1429311143 shutdown_connections 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 --2- 172.21.15.2:0/1429311143 >> v2:172.21.15.90:3300/0 conn(0x7f3a500d0690 0x7f3a500cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 --2- 172.21.15.2:0/1429311143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500b4d70 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- 172.21.15.2:0/1429311143 >> 172.21.15.2:0/1429311143 conn(0x7f3a500cf990 msgr2=0x7f3a500cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- 172.21.15.2:0/1429311143 shutdown_connections 2023-11-04T01:46:53.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- 172.21.15.2:0/1429311143 wait complete. 2023-11-04T01:46:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 Processor -- start 2023-11-04T01:46:53.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- start start 2023-11-04T01:46:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a500d0690 0x7f3a50157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a500d0ae0 0x7f3a501f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a501581d0 con 0x7f3a500b4990 2023-11-04T01:46:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500cbee0 con 0x7f3a500d0ae0 2023-11-04T01:46:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a5576c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a500cc1c0 con 0x7f3a500d0690 2023-11-04T01:46:53.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43484/0 (socket says 172.21.15.2:43484) 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 -- 172.21.15.2:0/311367315 learned_addr learned my addr 172.21.15.2:0/311367315 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4e7fc640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a500d0690 0x7f3a50157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4f7fe640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a500d0ae0 0x7f3a501f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 -- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a500d0690 msgr2=0x7f3a50157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a500d0690 0x7f3a50157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 -- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a500d0ae0 msgr2=0x7f3a501f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a500d0ae0 0x7f3a501f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 -- 172.21.15.2:0/311367315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400094d0 con 0x7f3a500b4990 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a4effd640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500cb850 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3a400b3040 tx=0x7f3a4001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.780+0000 7f3a477fe640 1 -- 172.21.15.2:0/311367315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400b0e80 con 0x7f3a500b4990 2023-11-04T01:46:53.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a477fe640 1 -- 172.21.15.2:0/311367315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a400bb480 con 0x7f3a500b4990 2023-11-04T01:46:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a500cc4a0 con 0x7f3a500b4990 2023-11-04T01:46:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a477fe640 1 -- 172.21.15.2:0/311367315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400bb810 con 0x7f3a500b4990 2023-11-04T01:46:53.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a500cca60 con 0x7f3a500b4990 2023-11-04T01:46:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a500ccc50 con 0x7f3a500b4990 2023-11-04T01:46:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a477fe640 1 -- 172.21.15.2:0/311367315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a400bb970 con 0x7f3a500b4990 2023-11-04T01:46:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a477fe640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a300664a0 0x7f3a30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a477fe640 1 -- 172.21.15.2:0/311367315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f3a401229f0 con 0x7f3a500b4990 2023-11-04T01:46:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a4e7fc640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a300664a0 0x7f3a30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:53.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.784+0000 7f3a4e7fc640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a300664a0 0x7f3a30068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3a500d39c0 tx=0x7f3a38008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:53.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.788+0000 7f3a477fe640 1 -- 172.21.15.2:0/311367315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3a400ef880 con 0x7f3a500b4990 2023-11-04T01:46:53.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.976+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a500ccc50 con 0x7f3a500b4990 2023-11-04T01:46:53.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.976+0000 7f3a477fe640 1 -- 172.21.15.2:0/311367315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3a400f2ea0 con 0x7f3a500b4990 2023-11-04T01:46:53.982 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:53.982 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:49.397478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:53.982 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 66 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a300664a0 msgr2=0x7f3a30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a300664a0 0x7f3a30068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3a500d39c0 tx=0x7f3a38008040 comp rx=0 tx=0).stop 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 msgr2=0x7f3a500cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500cb850 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3a400b3040 tx=0x7f3a4001ba50 comp rx=0 tx=0).stop 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 shutdown_connections 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3a300664a0 0x7f3a30068960 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3a500d0ae0 0x7f3a501f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3a500d0690 0x7f3a50157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 --2- 172.21.15.2:0/311367315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3a500b4990 0x7f3a500cb850 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 >> 172.21.15.2:0/311367315 conn(0x7f3a500cf990 msgr2=0x7f3a500d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 shutdown_connections 2023-11-04T01:46:53.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:53.980+0000 7f3a5576c640 1 -- 172.21.15.2:0/311367315 wait complete. 2023-11-04T01:46:53.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:46:54.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6c3fe640 1 Processor -- start 2023-11-04T01:46:54.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6c3fe640 1 -- start start 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6c3fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2b640b5090 0x7f2b640d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6c3fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b640d0ad0 0x7f2b640b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6c3fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b640d08e0 con 0x7f2b6415d6c0 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6c3fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640d2080 con 0x7f2b640d0ad0 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6c3fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b640d2360 con 0x7f2b640b5090 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6a19a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2b6415d6c0 0x7f2b640b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53172/0 (socket says 172.21.15.2:53172) 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6a19a640 1 -- 172.21.15.2:0/615940233 learned_addr learned my addr 172.21.15.2:0/615940233 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6a99b640 1 --2- 172.21.15.2:0/615940233 >> v2:172.21.15.2:3300/0 conn(0x7f2b640d0ad0 0x7f2b640b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b69999640 1 --2- 172.21.15.2:0/615940233 >> v2:172.21.15.90:3300/0 conn(0x7f2b640b5090 0x7f2b640d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b69198640 1 -- 172.21.15.2:0/615940233 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885612867 0 0) 0x7f2b640d08e0 con 0x7f2b6415d6c0 2023-11-04T01:46:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b69198640 1 -- 172.21.15.2:0/615940233 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b50003530 con 0x7f2b6415d6c0 2023-11-04T01:46:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6a99b640 1 -- 172.21.15.2:0/615940233 >> v2:172.21.15.90:3300/0 conn(0x7f2b640b5090 msgr2=0x7f2b640d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6a99b640 1 --2- 172.21.15.2:0/615940233 >> v2:172.21.15.90:3300/0 conn(0x7f2b640b5090 0x7f2b640d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6a99b640 1 -- 172.21.15.2:0/615940233 >> v1:172.21.15.2:6789/0 conn(0x7f2b6415d6c0 legacy=0x7f2b640b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b6a99b640 1 -- 172.21.15.2:0/615940233 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640d2640 con 0x7f2b640d0ad0 2023-11-04T01:46:54.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.116+0000 7f2b69999640 1 --2- 172.21.15.2:0/615940233 >> v2:172.21.15.90:3300/0 conn(0x7f2b640b5090 0x7f2b640d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:46:54.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6a99b640 1 --2- 172.21.15.2:0/615940233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b640b6a30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2b6408c0d0 tx=0x7f2b5c01f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b436a1698c666b0a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b69198640 1 -- 172.21.15.2:0/615940233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c0b0440 con 0x7f2b640d0ad0 2023-11-04T01:46:54.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b69198640 1 -- 172.21.15.2:0/615940233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c0b05a0 con 0x7f2b640d0ad0 2023-11-04T01:46:54.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b69198640 1 -- 172.21.15.2:0/615940233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c0b0930 con 0x7f2b640d0ad0 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/615940233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 msgr2=0x7f2b640b6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/615940233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b640b6a30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f2b6408c0d0 tx=0x7f2b5c01f0f0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/615940233 shutdown_connections 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/615940233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b640b6a30 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/615940233 >> v2:172.21.15.90:3300/0 conn(0x7f2b640b5090 0x7f2b640d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/615940233 >> 172.21.15.2:0/615940233 conn(0x7f2b640cf980 msgr2=0x7f2b640cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/615940233 shutdown_connections 2023-11-04T01:46:54.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/615940233 wait complete. 2023-11-04T01:46:54.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 Processor -- start 2023-11-04T01:46:54.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- start start 2023-11-04T01:46:54.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b640b5090 0x7f2b640b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b641f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b6415d6c0 0x7f2b6415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640a9eb0 con 0x7f2b640d0ad0 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64156eb0 con 0x7f2b640b5090 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b6c3fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b640b47b0 con 0x7f2b6415d6c0 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.120+0000 7f2b69999640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b641f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b641f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43496/0 (socket says 172.21.15.2:43496) 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 -- 172.21.15.2:0/3024517993 learned_addr learned my addr 172.21.15.2:0/3024517993 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:54.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b6a19a640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b640b5090 0x7f2b640b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b6a99b640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b6415d6c0 0x7f2b6415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 -- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b6415d6c0 msgr2=0x7f2b6415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b6415d6c0 0x7f2b6415ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 -- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b640b5090 msgr2=0x7f2b640b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b640b5090 0x7f2b640b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 -- 172.21.15.2:0/3024517993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c009a70 con 0x7f2b640d0ad0 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b69999640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b641f2360 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400e810 tx=0x7f2b5400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b5affd640 1 -- 172.21.15.2:0/3024517993 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400c8d0 con 0x7f2b640d0ad0 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b5affd640 1 -- 172.21.15.2:0/3024517993 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5400ca30 con 0x7f2b640d0ad0 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b5affd640 1 -- 172.21.15.2:0/3024517993 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5400cdc0 con 0x7f2b640d0ad0 2023-11-04T01:46:54.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b640a9960 con 0x7f2b640d0ad0 2023-11-04T01:46:54.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b641571c0 con 0x7f2b640d0ad0 2023-11-04T01:46:54.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b64157020 con 0x7f2b640d0ad0 2023-11-04T01:46:54.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b5affd640 1 -- 172.21.15.2:0/3024517993 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b54013410 con 0x7f2b640d0ad0 2023-11-04T01:46:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b5affd640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b480664a0 0x7f2b48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b5affd640 1 -- 172.21.15.2:0/3024517993 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f2b54084250 con 0x7f2b640d0ad0 2023-11-04T01:46:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b6a19a640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b480664a0 0x7f2b48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.124+0000 7f2b6a19a640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b480664a0 0x7f2b48068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2b600011f0 tx=0x7f2b60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.128+0000 7f2b5affd640 1 -- 172.21.15.2:0/3024517993 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b64157020 con 0x7f2b640d0ad0 2023-11-04T01:46:54.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.340+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f2b64157020 con 0x7f2b640d0ad0 2023-11-04T01:46:54.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.428+0000 7f2b5affd640 1 -- 172.21.15.2:0/3024517993 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.6406 v67) v1 ==== 112+0+0 (secure 0 0 0) 0x7f2b64157020 con 0x7f2b640d0ad0 2023-11-04T01:46:54.434 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.6406 2023-11-04T01:46:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b480664a0 msgr2=0x7f2b48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b480664a0 0x7f2b48068960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2b600011f0 tx=0x7f2b60009040 comp rx=0 tx=0).stop 2023-11-04T01:46:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 msgr2=0x7f2b641f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b641f2360 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400e810 tx=0x7f2b5400ecd0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 shutdown_connections 2023-11-04T01:46:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2b480664a0 0x7f2b48068960 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2b6415d6c0 0x7f2b6415ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b640d0ad0 0x7f2b641f2360 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 --2- 172.21.15.2:0/3024517993 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b640b5090 0x7f2b640b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 >> 172.21.15.2:0/3024517993 conn(0x7f2b640cf980 msgr2=0x7f2b640b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 shutdown_connections 2023-11-04T01:46:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.432+0000 7f2b6c3fe640 1 -- 172.21.15.2:0/3024517993 wait complete. 2023-11-04T01:46:54.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run.smithi090.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:46:54.599 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:46:54.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:46:54.599 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s15) 2023-11-04T01:46:54.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:46:54.617 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7ff8b1a33640 time 2023-11-04T01:46:54.618498+0000 2023-11-04T01:46:54.617 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:54.619 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.619 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff8b7b5ffae] 2023-11-04T01:46:54.619 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.619 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7ff8b1a33640 thread_name:ms_dispatch 2023-11-04T01:46:54.620 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:46:54.615+0000 7ff8b1a33640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7ff8b1a33640 time 2023-11-04T01:46:54.618498+0000 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff8b7b5ffae] 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.621 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.622 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.622 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.622 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.622 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.623 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.623 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff8b749a520] 2023-11-04T01:46:54.623 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:54.623 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:54.623 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:54.623 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff8b7b60008] 2023-11-04T01:46:54.623 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:46:54.615+0000 7ff8b1a33640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:54.624 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7ff8b1a33640 thread_name:ms_dispatch 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff8b749a520] 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff8b7b60008] 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.625 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.626 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.626 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.626 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.626 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.626 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.626 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:54.626 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.631 INFO:tasks.ceph.mds.d.smithi090.stderr: -320> 2023-11-04T01:46:52.011+0000 7ff8af22e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:54.631 INFO:tasks.ceph.mds.d.smithi090.stderr: -318> 2023-11-04T01:46:52.011+0000 7ff8af22e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:54.632 INFO:tasks.ceph.mds.d.smithi090.stderr: -1> 2023-11-04T01:46:54.615+0000 7ff8b1a33640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7ff8b1a33640 time 2023-11-04T01:46:54.618498+0000 2023-11-04T01:46:54.632 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:54.632 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff8b7b5ffae] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.633 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 0> 2023-11-04T01:46:54.615+0000 7ff8b1a33640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7ff8b1a33640 thread_name:ms_dispatch 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff8b749a520] 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff8b7b60008] 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.634 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:54.635 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.641 INFO:tasks.ceph.mds.d.smithi090.stderr: -320> 2023-11-04T01:46:52.011+0000 7ff8af22e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:46:54.641 INFO:tasks.ceph.mds.d.smithi090.stderr: -318> 2023-11-04T01:46:52.011+0000 7ff8af22e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: -1> 2023-11-04T01:46:54.615+0000 7ff8b1a33640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7ff8b1a33640 time 2023-11-04T01:46:54.618498+0000 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff8b7b5ffae] 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.642 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 0> 2023-11-04T01:46:54.615+0000 7ff8b1a33640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7ff8b1a33640 thread_name:ms_dispatch 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.643 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff8b749a520] 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff8b7b60008] 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7ff8b7b60162] 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55d49a70f16d] 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55d49a4a1969] 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55d49a4a39eb] 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d49a4a3ebc] 2023-11-04T01:46:54.644 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55d49a48e7f5] 2023-11-04T01:46:54.645 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7ff8b7d4bf2a] 2023-11-04T01:46:54.645 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7ff8b7dde7f1] 2023-11-04T01:46:54.645 INFO:tasks.ceph.mds.d.smithi090.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7ff8b74ecb43] 2023-11-04T01:46:54.645 INFO:tasks.ceph.mds.d.smithi090.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7ff8b757ea00] 2023-11-04T01:46:54.645 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:46:54.645 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:46:54.749 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:46:54.749 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:46:54.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:46:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f303ad54640 1 Processor -- start 2023-11-04T01:46:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f303ad54640 1 -- start start 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f303ad54640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f303ad54640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30340b0d40 0x7f303415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f303ad54640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340c2670 con 0x7f303406f8f0 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f303ad54640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3034070140 con 0x7f30340b0d40 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f303ad54640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303406c9f0 con 0x7f303415afd0 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f30392f1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30340b0d40 0x7f303415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f30392f1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f30340b0d40 0x7f303415ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43512/0 (socket says 172.21.15.2:43512) 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f30392f1640 1 -- 172.21.15.2:0/2808915743 learned_addr learned my addr 172.21.15.2:0/2808915743 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f3038af0640 1 --2- 172.21.15.2:0/2808915743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f30392f1640 1 -- 172.21.15.2:0/2808915743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 msgr2=0x7f30340715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f30392f1640 1 --2- 172.21.15.2:0/2808915743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f30392f1640 1 -- 172.21.15.2:0/2808915743 >> v1:172.21.15.90:6789/0 conn(0x7f303406f8f0 legacy=0x7f30340b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:46:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f30392f1640 1 -- 172.21.15.2:0/2808915743 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303406bc30 con 0x7f30340b0d40 2023-11-04T01:46:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.872+0000 7f3038af0640 1 --2- 172.21.15.2:0/2808915743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:54.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f30392f1640 1 --2- 172.21.15.2:0/2808915743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30340b0d40 0x7f303415ec80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f302c009e80 tx=0x7f302c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7974de81e9d9a48 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f30337fe640 1 -- 172.21.15.2:0/2808915743 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0a5800 con 0x7f30340b0d40 2023-11-04T01:46:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f30337fe640 1 -- 172.21.15.2:0/2808915743 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c0a5960 con 0x7f30340b0d40 2023-11-04T01:46:54.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f30337fe640 1 -- 172.21.15.2:0/2808915743 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0a5cf0 con 0x7f30340b0d40 2023-11-04T01:46:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 -- 172.21.15.2:0/2808915743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30340b0d40 msgr2=0x7f303415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 --2- 172.21.15.2:0/2808915743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30340b0d40 0x7f303415ec80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f302c009e80 tx=0x7f302c01c980 comp rx=0 tx=0).stop 2023-11-04T01:46:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 -- 172.21.15.2:0/2808915743 shutdown_connections 2023-11-04T01:46:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 --2- 172.21.15.2:0/2808915743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f30340b0d40 0x7f303415ec80 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 --2- 172.21.15.2:0/2808915743 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 -- 172.21.15.2:0/2808915743 >> 172.21.15.2:0/2808915743 conn(0x7f30340cebb0 msgr2=0x7f30340cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 -- 172.21.15.2:0/2808915743 shutdown_connections 2023-11-04T01:46:54.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 -- 172.21.15.2:0/2808915743 wait complete. 2023-11-04T01:46:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 Processor -- start 2023-11-04T01:46:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.876+0000 7f303ad54640 1 -- start start 2023-11-04T01:46:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f303406f8f0 0x7f30341520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30340b0d40 0x7f30341561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340c7e70 con 0x7f303406f8f0 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034152620 con 0x7f30340b0d40 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340c7260 con 0x7f303415afd0 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f303406f8f0 0x7f30341520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f303406f8f0 0x7f30341520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43524/0 (socket says 172.21.15.2:43524) 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 -- 172.21.15.2:0/1543995425 learned_addr learned my addr 172.21.15.2:0/1543995425 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30392f1640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3033fff640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30340b0d40 0x7f30341561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 -- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 msgr2=0x7f30340b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 -- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30340b0d40 msgr2=0x7f30341561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30340b0d40 0x7f30341561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 -- 172.21.15.2:0/1543995425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c009b30 con 0x7f303406f8f0 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30392f1640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f3038af0640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f303406f8f0 0x7f30341520e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f302400c7f0 tx=0x7f302400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30317fa640 1 -- 172.21.15.2:0/1543995425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024007820 con 0x7f303406f8f0 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30317fa640 1 -- 172.21.15.2:0/1543995425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024007980 con 0x7f303406f8f0 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340c7540 con 0x7f303406f8f0 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30317fa640 1 -- 172.21.15.2:0/1543995425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024007d30 con 0x7f303406f8f0 2023-11-04T01:46:54.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340c7b00 con 0x7f303406f8f0 2023-11-04T01:46:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30340744a0 con 0x7f303406f8f0 2023-11-04T01:46:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30317fa640 1 -- 172.21.15.2:0/1543995425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30240113f0 con 0x7f303406f8f0 2023-11-04T01:46:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30317fa640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30200664d0 0x7f3020068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:46:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.880+0000 7f30317fa640 1 -- 172.21.15.2:0/1543995425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f3024084650 con 0x7f303406f8f0 2023-11-04T01:46:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.884+0000 7f3033fff640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30200664d0 0x7f3020068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:46:54.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.884+0000 7f3033fff640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30200664d0 0x7f3020068990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f30340c5700 tx=0x7f3028009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:46:54.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:54.888+0000 7f30317fa640 1 -- 172.21.15.2:0/1543995425 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3024051610 con 0x7f303406f8f0 2023-11-04T01:46:54.914 INFO:tasks.ceph.mds.d.smithi090.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:46:55.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:55.003 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:46:55.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.076+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f303406cba0 con 0x7f303406f8f0 2023-11-04T01:46:55.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.076+0000 7f30317fa640 1 -- 172.21.15.2:0/1543995425 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3024054c30 con 0x7f303406f8f0 2023-11-04T01:46:55.083 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:46:55.083 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:54.344138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:46:55.083 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 67 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30200664d0 msgr2=0x7f3020068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30200664d0 0x7f3020068990 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f30340c5700 tx=0x7f3028009040 comp rx=0 tx=0).stop 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f303406f8f0 msgr2=0x7f30341520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f303406f8f0 0x7f30341520e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f302400c7f0 tx=0x7f302400ccb0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 shutdown_connections 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30200664d0 0x7f3020068990 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f303415afd0 0x7f30340b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30340b0d40 0x7f30341561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 --2- 172.21.15.2:0/1543995425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f303406f8f0 0x7f30341520e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:46:55.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 >> 172.21.15.2:0/1543995425 conn(0x7f30340cebb0 msgr2=0x7f30340ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:46:55.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 shutdown_connections 2023-11-04T01:46:55.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:46:55.080+0000 7f303ad54640 1 -- 172.21.15.2:0/1543995425 wait complete. 2023-11-04T01:46:55.102 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:46:55.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:47:00.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:00.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48c4ed640 1 Processor -- start 2023-11-04T01:47:00.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48c4ed640 1 -- start start 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48c4ed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ccac0 0x7fb4840d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48c4ed640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4840ccea0 0x7fb4841617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48c4ed640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48406ccf0 con 0x7fb4840ce960 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48c4ed640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb484161d30 con 0x7fb4840ccea0 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48c4ed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48406d220 con 0x7fb4840ccac0 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb489a88640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4840ccea0 0x7fb4841617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb489a88640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb4840ccea0 0x7fb4841617f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43528/0 (socket says 172.21.15.2:43528) 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb489a88640 1 -- 172.21.15.2:0/2355921186 learned_addr learned my addr 172.21.15.2:0/2355921186 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb48a289640 1 --2- 172.21.15.2:0/2355921186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ccac0 0x7fb4840d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb489a88640 1 -- 172.21.15.2:0/2355921186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ccac0 msgr2=0x7fb4840d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:00.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb489a88640 1 --2- 172.21.15.2:0/2355921186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ccac0 0x7fb4840d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb489a88640 1 -- 172.21.15.2:0/2355921186 >> v1:172.21.15.2:6789/0 conn(0x7fb4840ce960 legacy=0x7fb4840cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.232+0000 7fb489a88640 1 -- 172.21.15.2:0/2355921186 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48406c630 con 0x7fb4840ccea0 2023-11-04T01:47:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb489a88640 1 --2- 172.21.15.2:0/2355921186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccea0 0x7fb4841617f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fb478009870 tx=0x7fb47801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447ddc88343fb80 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb489287640 1 -- 172.21.15.2:0/2355921186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780aa670 con 0x7fb4840ccea0 2023-11-04T01:47:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb489287640 1 -- 172.21.15.2:0/2355921186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780aa7d0 con 0x7fb4840ccea0 2023-11-04T01:47:00.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb489287640 1 -- 172.21.15.2:0/2355921186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780aab60 con 0x7fb4840ccea0 2023-11-04T01:47:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- 172.21.15.2:0/2355921186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccea0 msgr2=0x7fb4841617f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/2355921186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccea0 0x7fb4841617f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fb478009870 tx=0x7fb47801c510 comp rx=0 tx=0).stop 2023-11-04T01:47:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- 172.21.15.2:0/2355921186 shutdown_connections 2023-11-04T01:47:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/2355921186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccea0 0x7fb4841617f0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/2355921186 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ccac0 0x7fb4840d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- 172.21.15.2:0/2355921186 >> 172.21.15.2:0/2355921186 conn(0x7fb484065dc0 msgr2=0x7fb4840661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- 172.21.15.2:0/2355921186 shutdown_connections 2023-11-04T01:47:00.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- 172.21.15.2:0/2355921186 wait complete. 2023-11-04T01:47:00.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 Processor -- start 2023-11-04T01:47:00.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- start start 2023-11-04T01:47:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccac0 0x7fb4841f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840ccea0 0x7fb4840ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ce960 0x7fb4840ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c4a50 con 0x7fb4840ccac0 2023-11-04T01:47:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c74a0 con 0x7fb4840ccea0 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48c4ed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c6890 con 0x7fb4840ce960 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccac0 0x7fb4841f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccac0 0x7fb4841f83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43542/0 (socket says 172.21.15.2:43542) 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 -- 172.21.15.2:0/1126135166 learned_addr learned my addr 172.21.15.2:0/1126135166 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb489a88640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840ccea0 0x7fb4840ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48aa8a640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ce960 0x7fb4840ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 -- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ce960 msgr2=0x7fb4840ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ce960 0x7fb4840ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 -- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840ccea0 msgr2=0x7fb4840ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840ccea0 0x7fb4840ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 -- 172.21.15.2:0/1126135166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780094d0 con 0x7fb4840ccac0 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.236+0000 7fb48a289640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccac0 0x7fb4841f83f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d800 tx=0x7fb48000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb476ffd640 1 -- 172.21.15.2:0/1126135166 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000b6c0 con 0x7fb4840ccac0 2023-11-04T01:47:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb476ffd640 1 -- 172.21.15.2:0/1126135166 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48000b820 con 0x7fb4840ccac0 2023-11-04T01:47:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4840c6b70 con 0x7fb4840ccac0 2023-11-04T01:47:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb476ffd640 1 -- 172.21.15.2:0/1126135166 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000bb90 con 0x7fb4840ccac0 2023-11-04T01:47:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4840c7130 con 0x7fb4840ccac0 2023-11-04T01:47:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4840675f0 con 0x7fb4840ccac0 2023-11-04T01:47:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb476ffd640 1 -- 172.21.15.2:0/1126135166 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb48000bcf0 con 0x7fb4840ccac0 2023-11-04T01:47:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb476ffd640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4680664d0 0x7fb468068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb476ffd640 1 -- 172.21.15.2:0/1126135166 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7fb480084880 con 0x7fb4840ccac0 2023-11-04T01:47:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb489a88640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4680664d0 0x7fb468068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.240+0000 7fb489a88640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4680664d0 0x7fb468068990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb4780ae000 tx=0x7fb4780b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.244+0000 7fb476ffd640 1 -- 172.21.15.2:0/1126135166 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4800517b0 con 0x7fb4840ccac0 2023-11-04T01:47:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.432+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4840b2c00 con 0x7fb4840ccac0 2023-11-04T01:47:00.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.432+0000 7fb476ffd640 1 -- 172.21.15.2:0/1126135166 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fb480054dd0 con 0x7fb4840ccac0 2023-11-04T01:47:00.437 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:00.437 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:54.344138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:00.438 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 67 2023-11-04T01:47:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4680664d0 msgr2=0x7fb468068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4680664d0 0x7fb468068990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb4780ae000 tx=0x7fb4780b5040 comp rx=0 tx=0).stop 2023-11-04T01:47:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccac0 msgr2=0x7fb4841f83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:00.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccac0 0x7fb4841f83f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fb48000d800 tx=0x7fb48000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 shutdown_connections 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb4680664d0 0x7fb468068990 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4840ce960 0x7fb4840ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840ccea0 0x7fb4840ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 --2- 172.21.15.2:0/1126135166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4840ccac0 0x7fb4841f83f0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 >> 172.21.15.2:0/1126135166 conn(0x7fb484065dc0 msgr2=0x7fb4840661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 shutdown_connections 2023-11-04T01:47:00.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:00.436+0000 7fb48c4ed640 1 -- 172.21.15.2:0/1126135166 wait complete. 2023-11-04T01:47:00.454 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:02.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:47:05.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:05.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf48cb4640 1 Processor -- start 2023-11-04T01:47:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf48cb4640 1 -- start start 2023-11-04T01:47:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf48cb4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf440715d0 0x7faf440b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf48cb4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf440b0b70 0x7faf4415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf48cb4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440c2670 con 0x7faf4415afd0 2023-11-04T01:47:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf48cb4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf44070140 con 0x7faf440715d0 2023-11-04T01:47:05.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf48cb4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf44071a60 con 0x7faf440b0b70 2023-11-04T01:47:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf3bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf440715d0 0x7faf440b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf3bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faf440715d0 0x7faf440b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36024/0 (socket says 172.21.15.2:36024) 2023-11-04T01:47:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf3bfff640 1 -- 172.21.15.2:0/3745089271 learned_addr learned my addr 172.21.15.2:0/3745089271 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf4259c640 1 --1- 172.21.15.2:0/3745089271 >> v1:172.21.15.2:6789/0 conn(0x7faf4415afd0 0x7faf4406f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38378/0 (socket says 172.21.15.2:38378) 2023-11-04T01:47:05.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf42d9d640 1 --2- 172.21.15.2:0/3745089271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf440b0b70 0x7faf4415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf3bfff640 1 -- 172.21.15.2:0/3745089271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf440b0b70 msgr2=0x7faf4415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf3bfff640 1 --2- 172.21.15.2:0/3745089271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf440b0b70 0x7faf4415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf3bfff640 1 -- 172.21.15.2:0/3745089271 >> v1:172.21.15.2:6789/0 conn(0x7faf4415afd0 legacy=0x7faf4406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.588+0000 7faf3bfff640 1 -- 172.21.15.2:0/3745089271 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4406bc30 con 0x7faf440715d0 2023-11-04T01:47:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf3bfff640 1 --2- 172.21.15.2:0/3745089271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440715d0 0x7faf440b0630 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009870 tx=0x7faf2c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ced5946517821b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf41d9b640 1 -- 172.21.15.2:0/3745089271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0ab600 con 0x7faf440715d0 2023-11-04T01:47:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf41d9b640 1 -- 172.21.15.2:0/3745089271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0a7050 con 0x7faf440715d0 2023-11-04T01:47:05.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf41d9b640 1 -- 172.21.15.2:0/3745089271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0ab980 con 0x7faf440715d0 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 -- 172.21.15.2:0/3745089271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440715d0 msgr2=0x7faf440b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 --2- 172.21.15.2:0/3745089271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440715d0 0x7faf440b0630 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009870 tx=0x7faf2c01c540 comp rx=0 tx=0).stop 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 -- 172.21.15.2:0/3745089271 shutdown_connections 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 --2- 172.21.15.2:0/3745089271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440715d0 0x7faf440b0630 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 --2- 172.21.15.2:0/3745089271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf440b0b70 0x7faf4415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 -- 172.21.15.2:0/3745089271 >> 172.21.15.2:0/3745089271 conn(0x7faf440cebb0 msgr2=0x7faf440cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 -- 172.21.15.2:0/3745089271 shutdown_connections 2023-11-04T01:47:05.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 -- 172.21.15.2:0/3745089271 wait complete. 2023-11-04T01:47:05.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 Processor -- start 2023-11-04T01:47:05.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.592+0000 7faf48cb4640 1 -- start start 2023-11-04T01:47:05.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf440715d0 0x7faf440c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:05.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b0b70 0x7faf440b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4415afd0 0x7faf44153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440cc790 con 0x7faf440b0b70 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440c6130 con 0x7faf440715d0 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf440c6400 con 0x7faf4415afd0 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b0b70 0x7faf440b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b0b70 0x7faf440b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36034/0 (socket says 172.21.15.2:36034) 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 -- 172.21.15.2:0/468740997 learned_addr learned my addr 172.21.15.2:0/468740997 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf4259c640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf440715d0 0x7faf440c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf42d9d640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4415afd0 0x7faf44153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 -- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4415afd0 msgr2=0x7faf44153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4415afd0 0x7faf44153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 -- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf440715d0 msgr2=0x7faf440c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf440715d0 0x7faf440c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 -- 172.21.15.2:0/468740997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0094d0 con 0x7faf440b0b70 2023-11-04T01:47:05.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3bfff640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b0b70 0x7faf440b17d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7faf2c01a170 tx=0x7faf2c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:05.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3affd640 1 -- 172.21.15.2:0/468740997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0b4620 con 0x7faf440b0b70 2023-11-04T01:47:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3affd640 1 -- 172.21.15.2:0/468740997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0b4780 con 0x7faf440b0b70 2023-11-04T01:47:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf440c66e0 con 0x7faf440b0b70 2023-11-04T01:47:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf3affd640 1 -- 172.21.15.2:0/468740997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0b4af0 con 0x7faf440b0b70 2023-11-04T01:47:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf440b1d10 con 0x7faf440b0b70 2023-11-04T01:47:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.596+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf440744a0 con 0x7faf440b0b70 2023-11-04T01:47:05.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.600+0000 7faf3affd640 1 -- 172.21.15.2:0/468740997 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf2c0b2070 con 0x7faf440b0b70 2023-11-04T01:47:05.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.600+0000 7faf3affd640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf240664d0 0x7faf24068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:05.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.600+0000 7faf3affd640 1 -- 172.21.15.2:0/468740997 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7faf2c11d890 con 0x7faf440b0b70 2023-11-04T01:47:05.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.600+0000 7faf4259c640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf240664d0 0x7faf24068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:05.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.600+0000 7faf4259c640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf240664d0 0x7faf24068990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf34005fd0 tx=0x7faf34005ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:05.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.604+0000 7faf3affd640 1 -- 172.21.15.2:0/468740997 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faf2c0ea7c0 con 0x7faf440b0b70 2023-11-04T01:47:05.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.792+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf440cbe10 con 0x7faf440b0b70 2023-11-04T01:47:05.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.792+0000 7faf3affd640 1 -- 172.21.15.2:0/468740997 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4925 (secure 0 0 0) 0x7faf2c0b0090 con 0x7faf440b0b70 2023-11-04T01:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:05.797 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:46:54.344138+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:05.797 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 67 2023-11-04T01:47:05.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.792+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf240664d0 msgr2=0x7faf24068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.792+0000 7faf48cb4640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf240664d0 0x7faf24068990 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf34005fd0 tx=0x7faf34005ba0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b0b70 msgr2=0x7faf440b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:05.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b0b70 0x7faf440b17d0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7faf2c01a170 tx=0x7faf2c0192e0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 shutdown_connections 2023-11-04T01:47:05.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf240664d0 0x7faf24068990 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf4415afd0 0x7faf44153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf440b0b70 0x7faf440b17d0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 --2- 172.21.15.2:0/468740997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf440715d0 0x7faf440c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:05.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 >> 172.21.15.2:0/468740997 conn(0x7faf440cebb0 msgr2=0x7faf44157380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:05.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 shutdown_connections 2023-11-04T01:47:05.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:05.796+0000 7faf48cb4640 1 -- 172.21.15.2:0/468740997 wait complete. 2023-11-04T01:47:05.815 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:08.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-11-04T01:47:10.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:10.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.952+0000 7f57f3623640 1 Processor -- start 2023-11-04T01:47:10.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.952+0000 7f57f3623640 1 -- start start 2023-11-04T01:47:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f3623640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57ec0b4990 0x7f57ec0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f3623640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ec0b6070 con 0x7f57ec0d0690 2023-11-04T01:47:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f3623640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ec0b8ed0 con 0x7f57ec0b74f0 2023-11-04T01:47:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f3623640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ec0ce590 con 0x7f57ec0b4990 2023-11-04T01:47:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f13bf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57ec0b4990 0x7f57ec0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:10.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f0bbe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f57ec0d0690 0x7f57ec0cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38384/0 (socket says 172.21.15.2:38384) 2023-11-04T01:47:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f13bf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f57ec0b4990 0x7f57ec0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36050/0 (socket says 172.21.15.2:36050) 2023-11-04T01:47:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f0bbe640 1 -- 172.21.15.2:0/1693382280 learned_addr learned my addr 172.21.15.2:0/1693382280 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f13bf640 1 -- 172.21.15.2:0/1693382280 >> v1:172.21.15.90:6789/0 conn(0x7f57ec0b74f0 legacy=0x7f57ec0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f13bf640 1 -- 172.21.15.2:0/1693382280 >> v1:172.21.15.2:6789/0 conn(0x7f57ec0d0690 legacy=0x7f57ec0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57f13bf640 1 -- 172.21.15.2:0/1693382280 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec0b52b0 con 0x7f57ec0b4990 2023-11-04T01:47:10.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.956+0000 7f57ebfff640 1 -- 172.21.15.2:0/1693382280 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132300796 0 0) 0x7f57ec0b6070 con 0x7f57ec0d0690 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f13bf640 1 --2- 172.21.15.2:0/1693382280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0b4990 0x7f57ec0b4d70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0097c0 tx=0x7f57dc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605d258b0524a645 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57ebfff640 1 -- 172.21.15.2:0/1693382280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0a8970 con 0x7f57ec0b4990 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57ebfff640 1 -- 172.21.15.2:0/1693382280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc0a8ad0 con 0x7f57ec0b4990 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57ebfff640 1 -- 172.21.15.2:0/1693382280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0a8e60 con 0x7f57ec0b4990 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- 172.21.15.2:0/1693382280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0b4990 msgr2=0x7f57ec0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 --2- 172.21.15.2:0/1693382280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0b4990 0x7f57ec0b4d70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0097c0 tx=0x7f57dc01ec70 comp rx=0 tx=0).stop 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- 172.21.15.2:0/1693382280 shutdown_connections 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 --2- 172.21.15.2:0/1693382280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0b4990 0x7f57ec0b4d70 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- 172.21.15.2:0/1693382280 >> 172.21.15.2:0/1693382280 conn(0x7f57ec0cf990 msgr2=0x7f57ec0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- 172.21.15.2:0/1693382280 shutdown_connections 2023-11-04T01:47:10.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- 172.21.15.2:0/1693382280 wait complete. 2023-11-04T01:47:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 Processor -- start 2023-11-04T01:47:10.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- start start 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57ec0b4990 0x7f57ec0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57ec0b74f0 0x7f57ec151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0d0690 0x7f57ec0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec159800 con 0x7f57ec0d0690 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec0cd0e0 con 0x7f57ec0b74f0 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f3623640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec158bf0 con 0x7f57ec0b4990 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0d0690 0x7f57ec0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0d0690 0x7f57ec0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36056/0 (socket says 172.21.15.2:36056) 2023-11-04T01:47:10.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 -- 172.21.15.2:0/2173133203 learned_addr learned my addr 172.21.15.2:0/2173133203 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f13bf640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57ec0b4990 0x7f57ec0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f0bbe640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57ec0b74f0 0x7f57ec151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 -- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57ec0b4990 msgr2=0x7f57ec0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57ec0b4990 0x7f57ec0ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 -- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57ec0b74f0 msgr2=0x7f57ec151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57ec0b74f0 0x7f57ec151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f1bc0640 1 -- 172.21.15.2:0/2173133203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc009420 con 0x7f57ec0d0690 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f13bf640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57ec0b4990 0x7f57ec0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.960+0000 7f57f0bbe640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57ec0b74f0 0x7f57ec151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57f1bc0640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0d0690 0x7f57ec0ca360 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c400 tx=0x7f57e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57e9ffb640 1 -- 172.21.15.2:0/2173133203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e40052d0 con 0x7f57ec0d0690 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57e9ffb640 1 -- 172.21.15.2:0/2173133203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e4005430 con 0x7f57ec0d0690 2023-11-04T01:47:10.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57e9ffb640 1 -- 172.21.15.2:0/2173133203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4003800 con 0x7f57ec0d0690 2023-11-04T01:47:10.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ec158ed0 con 0x7f57ec0d0690 2023-11-04T01:47:10.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ec159490 con 0x7f57ec0d0690 2023-11-04T01:47:10.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ec159620 con 0x7f57ec0d0690 2023-11-04T01:47:10.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57e9ffb640 1 -- 172.21.15.2:0/2173133203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57e4003960 con 0x7f57ec0d0690 2023-11-04T01:47:10.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57e9ffb640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57d80664a0 0x7f57d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:10.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57e9ffb640 1 -- 172.21.15.2:0/2173133203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f57e4083830 con 0x7f57ec0d0690 2023-11-04T01:47:10.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57f13bf640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57d80664a0 0x7f57d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:10.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.964+0000 7f57f13bf640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57d80664a0 0x7f57d8068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0b2000 tx=0x7f57dc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:10.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:10.968+0000 7f57e9ffb640 1 -- 172.21.15.2:0/2173133203 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57e4050810 con 0x7f57ec0d0690 2023-11-04T01:47:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.160+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57ec0744a0 con 0x7f57ec0d0690 2023-11-04T01:47:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.160+0000 7f57e9ffb640 1 -- 172.21.15.2:0/2173133203 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4973 (secure 0 0 0) 0x7f57e4053e30 con 0x7f57ec0d0690 2023-11-04T01:47:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:11.165 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7569,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:09.595217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6406,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6406":{"gid":6406,"name":"d","rank":0,"incarnation":62,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/3941825889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3941825889},{"type":"v1","addr":"172.21.15.90:6837","nonce":3941825889}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:47:09.595216+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:11.165 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 68 2023-11-04T01:47:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57d80664a0 msgr2=0x7f57d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57d80664a0 0x7f57d8068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0b2000 tx=0x7f57dc008040 comp rx=0 tx=0).stop 2023-11-04T01:47:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0d0690 msgr2=0x7f57ec0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0d0690 0x7f57ec0ca360 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c400 tx=0x7f57e400c8c0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 shutdown_connections 2023-11-04T01:47:11.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f57d80664a0 0x7f57d8068960 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f57ec0d0690 0x7f57ec0ca360 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f57ec0b74f0 0x7f57ec151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 --2- 172.21.15.2:0/2173133203 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57ec0b4990 0x7f57ec0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 >> 172.21.15.2:0/2173133203 conn(0x7f57ec0cf990 msgr2=0x7f57ec0d14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 shutdown_connections 2023-11-04T01:47:11.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.164+0000 7f57f3623640 1 -- 172.21.15.2:0/2173133203 wait complete. 2023-11-04T01:47:11.184 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:47:11.184 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:47:11.197 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:47:11.199 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:47:11.199 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:47:11.259 INFO:teuthology.orchestra.run.smithi090.stdout:1699062414.44117.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:47:11.261 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062414.44117.core'] 2023-11-04T01:47:11.261 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062414.44117.core, deleting it 2023-11-04T01:47:11.261 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062414.44117.core 2023-11-04T01:47:11.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:47:11.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ef28c640 1 Processor -- start 2023-11-04T01:47:11.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ef28c640 1 -- start start 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ef28c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f26e815b290 0x7f26e806f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ef28c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f26e80b0d40 0x7f26e815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ef28c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e806c740 con 0x7f26e80c2670 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ef28c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e815b670 con 0x7f26e80b0d40 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ef28c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e806bb30 con 0x7f26e815b290 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ed829640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f26e80b0d40 0x7f26e815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ec827640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f26e80c2670 0x7f26e80b0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35298/0 (socket says 172.21.15.2:35298) 2023-11-04T01:47:11.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ec827640 1 -- 172.21.15.2:0/3151117818 learned_addr learned my addr 172.21.15.2:0/3151117818 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ed028640 1 --2- 172.21.15.2:0/3151117818 >> v2:172.21.15.90:3300/0 conn(0x7f26e815b290 0x7f26e806f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ed829640 1 -- 172.21.15.2:0/3151117818 >> v2:172.21.15.90:3300/0 conn(0x7f26e815b290 msgr2=0x7f26e806f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ed829640 1 --2- 172.21.15.2:0/3151117818 >> v2:172.21.15.90:3300/0 conn(0x7f26e815b290 0x7f26e806f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ed829640 1 -- 172.21.15.2:0/3151117818 >> v1:172.21.15.2:6789/0 conn(0x7f26e80c2670 legacy=0x7f26e80b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26ed829640 1 -- 172.21.15.2:0/3151117818 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e806be10 con 0x7f26e80b0d40 2023-11-04T01:47:11.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.444+0000 7f26e7fff640 1 -- 172.21.15.2:0/3151117818 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100846063 0 0) 0x7f26e806c740 con 0x7f26e80c2670 2023-11-04T01:47:11.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ed829640 1 --2- 172.21.15.2:0/3151117818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e815eee0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f26e80ce930 tx=0x7f26e001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1722bea977c6414 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26e7fff640 1 -- 172.21.15.2:0/3151117818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00ab600 con 0x7f26e80b0d40 2023-11-04T01:47:11.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26e7fff640 1 -- 172.21.15.2:0/3151117818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e00a7050 con 0x7f26e80b0d40 2023-11-04T01:47:11.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26e7fff640 1 -- 172.21.15.2:0/3151117818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00ab980 con 0x7f26e80b0d40 2023-11-04T01:47:11.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 -- 172.21.15.2:0/3151117818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 msgr2=0x7f26e815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 --2- 172.21.15.2:0/3151117818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e815eee0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f26e80ce930 tx=0x7f26e001c3a0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 -- 172.21.15.2:0/3151117818 shutdown_connections 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 --2- 172.21.15.2:0/3151117818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e815eee0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 --2- 172.21.15.2:0/3151117818 >> v2:172.21.15.90:3300/0 conn(0x7f26e815b290 0x7f26e806f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 -- 172.21.15.2:0/3151117818 >> 172.21.15.2:0/3151117818 conn(0x7f26e80cebb0 msgr2=0x7f26e80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 -- 172.21.15.2:0/3151117818 shutdown_connections 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.448+0000 7f26ef28c640 1 -- 172.21.15.2:0/3151117818 wait complete. 2023-11-04T01:47:11.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 Processor -- start 2023-11-04T01:47:11.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 -- start start 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e8150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26e80c2670 0x7f26e8159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26e815b290 0x7f26e815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e81581e0 con 0x7f26e80b0d40 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e81583f0 con 0x7f26e815b290 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e81586d0 con 0x7f26e80c2670 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e8150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e8150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33948/0 (socket says 172.21.15.2:33948) 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 -- 172.21.15.2:0/2571356813 learned_addr learned my addr 172.21.15.2:0/2571356813 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ec827640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26e80c2670 0x7f26e8159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed829640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26e815b290 0x7f26e815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 -- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26e80c2670 msgr2=0x7f26e8159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26e80c2670 0x7f26e8159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 -- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26e815b290 msgr2=0x7f26e815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26e815b290 0x7f26e815a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 -- 172.21.15.2:0/2571356813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0009420 con 0x7f26e80b0d40 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ec827640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26e80c2670 0x7f26e8159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed829640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26e815b290 0x7f26e815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ed028640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e8150aa0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f26d800efc0 tx=0x7f26d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26e5ffb640 1 -- 172.21.15.2:0/2571356813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8009ba0 con 0x7f26e80b0d40 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26e5ffb640 1 -- 172.21.15.2:0/2571356813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800f040 con 0x7f26e80b0d40 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e81589b0 con 0x7f26e80b0d40 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26e5ffb640 1 -- 172.21.15.2:0/2571356813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80146c0 con 0x7f26e80b0d40 2023-11-04T01:47:11.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e814b3b0 con 0x7f26e80b0d40 2023-11-04T01:47:11.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e80744a0 con 0x7f26e80b0d40 2023-11-04T01:47:11.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26e5ffb640 1 -- 172.21.15.2:0/2571356813 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26d8014820 con 0x7f26e80b0d40 2023-11-04T01:47:11.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.452+0000 7f26e5ffb640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26d40664a0 0x7f26d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.456+0000 7f26e5ffb640 1 -- 172.21.15.2:0/2571356813 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 7060+0+0 (secure 0 0 0) 0x7f26d8085710 con 0x7f26e80b0d40 2023-11-04T01:47:11.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.456+0000 7f26ec827640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26d40664a0 0x7f26d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.456+0000 7f26ec827640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26d40664a0 0x7f26d4068960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f26e8154950 tx=0x7f26dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.456+0000 7f26e5ffb640 1 -- 172.21.15.2:0/2571356813 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f26d8052620 con 0x7f26e80b0d40 2023-11-04T01:47:11.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.672+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f26e80c2430 con 0x7f26e80b0d40 2023-11-04T01:47:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.676+0000 7f26e5ffb640 1 -- 172.21.15.2:0/2571356813 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 6406 v69) v1 ==== 97+0+0 (secure 0 0 0) 0x7f26d8018070 con 0x7f26e80b0d40 2023-11-04T01:47:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 6406 2023-11-04T01:47:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26d40664a0 msgr2=0x7f26d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26d40664a0 0x7f26d4068960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f26e8154950 tx=0x7f26dc009040 comp rx=0 tx=0).stop 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 msgr2=0x7f26e8150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e8150aa0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f26d800efc0 tx=0x7f26d800c490 comp rx=0 tx=0).stop 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 shutdown_connections 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f26d40664a0 0x7f26d4068960 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f26e815b290 0x7f26e815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f26e80c2670 0x7f26e8159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 --2- 172.21.15.2:0/2571356813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26e80b0d40 0x7f26e8150aa0 secure :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f26d800efc0 tx=0x7f26d800c490 comp rx=0 tx=0).stop 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 >> 172.21.15.2:0/2571356813 conn(0x7f26e80cebb0 msgr2=0x7f26e8157940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 shutdown_connections 2023-11-04T01:47:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.680+0000 7f26ef28c640 1 -- 172.21.15.2:0/2571356813 wait complete. 2023-11-04T01:47:11.703 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:47:11.703 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:47:11.703 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:47:11.703 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:47:11.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:47:11.703 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi090 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:47:11.704 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:47:11.704 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:47:11.706 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:47:11.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:11.780 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:47:11.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.816+0000 7fd1932f3640 1 Processor -- start 2023-11-04T01:47:11.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.816+0000 7fd1932f3640 1 -- start start 2023-11-04T01:47:11.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c0715d0 0x7fd18c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd18c0b0b70 0x7fd18c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0c2670 con 0x7fd18c15afd0 2023-11-04T01:47:11.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c070140 con 0x7fd18c0b0b70 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b1000 con 0x7fd18c0715d0 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd19108f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd18c15afd0 0x7fd18c06f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35314/0 (socket says 172.21.15.2:35314) 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd19108f640 1 -- 172.21.15.2:0/4292041298 learned_addr learned my addr 172.21.15.2:0/4292041298 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd191890640 1 --2- 172.21.15.2:0/4292041298 >> v2:172.21.15.2:3300/0 conn(0x7fd18c0b0b70 0x7fd18c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd19088e640 1 --2- 172.21.15.2:0/4292041298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c0715d0 0x7fd18c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd183fff640 1 -- 172.21.15.2:0/4292041298 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158418730 0 0) 0x7fd18c0c2670 con 0x7fd18c15afd0 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd183fff640 1 -- 172.21.15.2:0/4292041298 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd178003530 con 0x7fd18c15afd0 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd191890640 1 -- 172.21.15.2:0/4292041298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c0715d0 msgr2=0x7fd18c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd191890640 1 --2- 172.21.15.2:0/4292041298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c0715d0 0x7fd18c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd191890640 1 -- 172.21.15.2:0/4292041298 >> v1:172.21.15.2:6789/0 conn(0x7fd18c15afd0 legacy=0x7fd18c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd183fff640 1 -- 172.21.15.2:0/4292041298 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2270972705 0 0) 0x7fd178003530 con 0x7fd18c15afd0 2023-11-04T01:47:11.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd191890640 1 -- 172.21.15.2:0/4292041298 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c06bc30 con 0x7fd18c0b0b70 2023-11-04T01:47:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd191890640 1 --2- 172.21.15.2:0/4292041298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c15ec80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fd184009d90 tx=0x7fd18401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262308a7f38f22fb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd183fff640 1 -- 172.21.15.2:0/4292041298 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188001680 con 0x7fd18c0b0b70 2023-11-04T01:47:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd183fff640 1 -- 172.21.15.2:0/4292041298 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1840a6480 con 0x7fd18c0b0b70 2023-11-04T01:47:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd183fff640 1 -- 172.21.15.2:0/4292041298 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1840a6810 con 0x7fd18c0b0b70 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- 172.21.15.2:0/4292041298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 msgr2=0x7fd18c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 --2- 172.21.15.2:0/4292041298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c15ec80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fd184009d90 tx=0x7fd18401c870 comp rx=0 tx=0).stop 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- 172.21.15.2:0/4292041298 shutdown_connections 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 --2- 172.21.15.2:0/4292041298 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c15ec80 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 --2- 172.21.15.2:0/4292041298 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c0715d0 0x7fd18c0b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- 172.21.15.2:0/4292041298 >> 172.21.15.2:0/4292041298 conn(0x7fd18c0cebb0 msgr2=0x7fd18c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- 172.21.15.2:0/4292041298 shutdown_connections 2023-11-04T01:47:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.820+0000 7fd1932f3640 1 -- 172.21.15.2:0/4292041298 wait complete. 2023-11-04T01:47:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 Processor -- start 2023-11-04T01:47:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 -- start start 2023-11-04T01:47:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0715d0 0x7fd18c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c15afd0 0x7fd18c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c1596a0 con 0x7fd18c0b0b70 2023-11-04T01:47:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c15bc60 con 0x7fd18c0715d0 2023-11-04T01:47:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c158f90 con 0x7fd18c15afd0 2023-11-04T01:47:11.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c0b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33966/0 (socket says 172.21.15.2:33966) 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 -- 172.21.15.2:0/1680222902 learned_addr learned my addr 172.21.15.2:0/1680222902 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19108f640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0715d0 0x7fd18c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd191890640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c15afd0 0x7fd18c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 -- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c15afd0 msgr2=0x7fd18c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c15afd0 0x7fd18c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 -- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0715d0 msgr2=0x7fd18c15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0715d0 0x7fd18c15b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 -- 172.21.15.2:0/1680222902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd184009a70 con 0x7fd18c0b0b70 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19108f640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0715d0 0x7fd18c15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd19088e640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c0b2a70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00e870 tx=0x7fd17c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd181ffb640 1 -- 172.21.15.2:0/1680222902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c009510 con 0x7fd18c0b0b70 2023-11-04T01:47:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd181ffb640 1 -- 172.21.15.2:0/1680222902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c00eec0 con 0x7fd18c0b0b70 2023-11-04T01:47:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c1589d0 con 0x7fd18c0b0b70 2023-11-04T01:47:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd181ffb640 1 -- 172.21.15.2:0/1680222902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c00cb40 con 0x7fd18c0b0b70 2023-11-04T01:47:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c152d80 con 0x7fd18c0b0b70 2023-11-04T01:47:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.824+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c158dc0 con 0x7fd18c0b0b70 2023-11-04T01:47:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.828+0000 7fd181ffb640 1 -- 172.21.15.2:0/1680222902 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd17c00cca0 con 0x7fd18c0b0b70 2023-11-04T01:47:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.828+0000 7fd181ffb640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1700664a0 0x7fd170068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.828+0000 7fd181ffb640 1 -- 172.21.15.2:0/1680222902 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7fd17c084510 con 0x7fd18c0b0b70 2023-11-04T01:47:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.828+0000 7fd19108f640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1700664a0 0x7fd170068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.828+0000 7fd19108f640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1700664a0 0x7fd170068960 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd188005890 tx=0x7fd188009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:11.832+0000 7fd181ffb640 1 -- 172.21.15.2:0/1680222902 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd17c051480 con 0x7fd18c0b0b70 2023-11-04T01:47:12.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.012+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd18c159120 con 0x7fd18c0b0b70 2023-11-04T01:47:12.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.012+0000 7fd181ffb640 1 -- 172.21.15.2:0/1680222902 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4133 (secure 0 0 0) 0x7fd18c159120 con 0x7fd18c0b0b70 2023-11-04T01:47:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:12.019 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:11.688718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:12.019 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 70 2023-11-04T01:47:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1700664a0 msgr2=0x7fd170068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:12.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1700664a0 0x7fd170068960 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd188005890 tx=0x7fd188009040 comp rx=0 tx=0).stop 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 msgr2=0x7fd18c0b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c0b2a70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00e870 tx=0x7fd17c00ec70 comp rx=0 tx=0).stop 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 shutdown_connections 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1700664a0 0x7fd170068960 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd18c15afd0 0x7fd18c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd18c0b0b70 0x7fd18c0b2a70 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 --2- 172.21.15.2:0/1680222902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd18c0715d0 0x7fd18c15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 >> 172.21.15.2:0/1680222902 conn(0x7fd18c0cebb0 msgr2=0x7fd18c0cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 shutdown_connections 2023-11-04T01:47:12.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:12.016+0000 7fd1932f3640 1 -- 172.21.15.2:0/1680222902 wait complete. 2023-11-04T01:47:12.035 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:47:15.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:47:17.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb4a0583640 1 Processor -- start 2023-11-04T01:47:17.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb4a0583640 1 -- start start 2023-11-04T01:47:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb4a0583640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb49815d470 0x7fb4980cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb4a0583640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980cdc80 con 0x7fb4980b1960 2023-11-04T01:47:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb4a0583640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980cf5a0 con 0x7fb4980b1d40 2023-11-04T01:47:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb4a0583640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb498071e40 con 0x7fb49815d470 2023-11-04T01:47:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49e31f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb4980b1960 0x7fb4980ca1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35322/0 (socket says 172.21.15.2:35322) 2023-11-04T01:47:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49e31f640 1 -- 172.21.15.2:0/37922273 learned_addr learned my addr 172.21.15.2:0/37922273 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:17.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49eb20640 1 --2- 172.21.15.2:0/37922273 >> v2:172.21.15.90:3300/0 conn(0x7fb49815d470 0x7fb4980cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49d31d640 1 -- 172.21.15.2:0/37922273 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452777717 0 0) 0x7fb4980cdc80 con 0x7fb4980b1960 2023-11-04T01:47:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49d31d640 1 -- 172.21.15.2:0/37922273 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb484003530 con 0x7fb4980b1960 2023-11-04T01:47:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49eb20640 1 -- 172.21.15.2:0/37922273 >> v1:172.21.15.90:6789/0 conn(0x7fb4980b1d40 legacy=0x7fb49815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49eb20640 1 -- 172.21.15.2:0/37922273 >> v1:172.21.15.2:6789/0 conn(0x7fb4980b1960 legacy=0x7fb4980ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.168+0000 7fb49eb20640 1 -- 172.21.15.2:0/37922273 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980cf880 con 0x7fb49815d470 2023-11-04T01:47:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb49eb20640 1 --2- 172.21.15.2:0/37922273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 0x7fb4980cd740 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb4940097c0 tx=0x7fb49401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3edcf47dbcfbea34 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:17.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb49d31d640 1 -- 172.21.15.2:0/37922273 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940ab650 con 0x7fb49815d470 2023-11-04T01:47:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb49d31d640 1 -- 172.21.15.2:0/37922273 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4940ab7b0 con 0x7fb49815d470 2023-11-04T01:47:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb49d31d640 1 -- 172.21.15.2:0/37922273 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4940abb20 con 0x7fb49815d470 2023-11-04T01:47:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb4a0583640 1 -- 172.21.15.2:0/37922273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 msgr2=0x7fb4980cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb4a0583640 1 --2- 172.21.15.2:0/37922273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 0x7fb4980cd740 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb4940097c0 tx=0x7fb49401c450 comp rx=0 tx=0).stop 2023-11-04T01:47:17.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb4a0583640 1 -- 172.21.15.2:0/37922273 shutdown_connections 2023-11-04T01:47:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb4a0583640 1 --2- 172.21.15.2:0/37922273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 0x7fb4980cd740 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb4a0583640 1 -- 172.21.15.2:0/37922273 >> 172.21.15.2:0/37922273 conn(0x7fb49806e760 msgr2=0x7fb49806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb4a0583640 1 -- 172.21.15.2:0/37922273 shutdown_connections 2023-11-04T01:47:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.172+0000 7fb4a0583640 1 -- 172.21.15.2:0/37922273 wait complete. 2023-11-04T01:47:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 Processor -- start 2023-11-04T01:47:17.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 -- start start 2023-11-04T01:47:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4980b1960 0x7fb49815f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980b1d40 0x7fb49815e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 0x7fb4980c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb498153be0 con 0x7fb4980b1960 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815e7d0 con 0x7fb49815d470 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb498153900 con 0x7fb4980b1d40 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4980b1960 0x7fb49815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4980b1960 0x7fb49815f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33976/0 (socket says 172.21.15.2:33976) 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 -- 172.21.15.2:0/3334886819 learned_addr learned my addr 172.21.15.2:0/3334886819 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49eb20640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 0x7fb4980c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49db1e640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980b1d40 0x7fb49815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 -- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980b1d40 msgr2=0x7fb49815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980b1d40 0x7fb49815e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 -- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 msgr2=0x7fb4980c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 0x7fb4980c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 -- 172.21.15.2:0/3334886819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494009420 con 0x7fb4980b1960 2023-11-04T01:47:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb49e31f640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4980b1960 0x7fb49815f840 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cbb0 tx=0x7fb49000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb48effd640 1 -- 172.21.15.2:0/3334886819 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000ad40 con 0x7fb4980b1960 2023-11-04T01:47:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb48effd640 1 -- 172.21.15.2:0/3334886819 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490012400 con 0x7fb4980b1960 2023-11-04T01:47:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49815ed60 con 0x7fb4980b1960 2023-11-04T01:47:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb48effd640 1 -- 172.21.15.2:0/3334886819 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000aea0 con 0x7fb4980b1960 2023-11-04T01:47:17.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49815f320 con 0x7fb4980b1960 2023-11-04T01:47:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49815ebc0 con 0x7fb4980b1960 2023-11-04T01:47:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb48effd640 1 -- 172.21.15.2:0/3334886819 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb490007070 con 0x7fb4980b1960 2023-11-04T01:47:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.176+0000 7fb48effd640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb47c0664a0 0x7fb47c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.180+0000 7fb48effd640 1 -- 172.21.15.2:0/3334886819 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7fb4900843b0 con 0x7fb4980b1960 2023-11-04T01:47:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.180+0000 7fb49db1e640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb47c0664a0 0x7fb47c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.180+0000 7fb49db1e640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb47c0664a0 0x7fb47c068960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb488007fd0 tx=0x7fb488009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:17.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.184+0000 7fb48effd640 1 -- 172.21.15.2:0/3334886819 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb49815ebc0 con 0x7fb4980b1960 2023-11-04T01:47:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb49815ebc0 con 0x7fb4980b1960 2023-11-04T01:47:17.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb48effd640 1 -- 172.21.15.2:0/3334886819 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fb49815ebc0 con 0x7fb4980b1960 2023-11-04T01:47:17.380 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:17.380 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:14.723539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:17.380 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 74 2023-11-04T01:47:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb47c0664a0 msgr2=0x7fb47c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb47c0664a0 0x7fb47c068960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb488007fd0 tx=0x7fb488009040 comp rx=0 tx=0).stop 2023-11-04T01:47:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4980b1960 msgr2=0x7fb49815f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4980b1960 0x7fb49815f840 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cbb0 tx=0x7fb49000a430 comp rx=0 tx=0).stop 2023-11-04T01:47:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 shutdown_connections 2023-11-04T01:47:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb47c0664a0 0x7fb47c068960 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815d470 0x7fb4980c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb4980b1d40 0x7fb49815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 --2- 172.21.15.2:0/3334886819 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4980b1960 0x7fb49815f840 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 >> 172.21.15.2:0/3334886819 conn(0x7fb49806e760 msgr2=0x7fb498157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 shutdown_connections 2023-11-04T01:47:17.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.376+0000 7fb4a0583640 1 -- 172.21.15.2:0/3334886819 wait complete. 2023-11-04T01:47:17.386 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:47:17.384+0000 7f35baf6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:17.386 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:47:17.384+0000 7f35baf6e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:17.399 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:47:17.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2067ea1640 1 Processor -- start 2023-11-04T01:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2067ea1640 1 -- start start 2023-11-04T01:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2067ea1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2060159950 0x7f20600cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2067ea1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f206006c1a0 0x7f206006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2067ea1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20600cd020 con 0x7f206006cf10 2023-11-04T01:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2067ea1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600cd300 con 0x7f206006c1a0 2023-11-04T01:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2067ea1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600cd5e0 con 0x7f2060159950 2023-11-04T01:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f206643e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f206006c1a0 0x7f206006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f206643e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f206006c1a0 0x7f206006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33980/0 (socket says 172.21.15.2:33980) 2023-11-04T01:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f206643e640 1 -- 172.21.15.2:0/670588265 learned_addr learned my addr 172.21.15.2:0/670588265 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f2065c3d640 1 --2- 172.21.15.2:0/670588265 >> v2:172.21.15.90:3300/0 conn(0x7f2060159950 0x7f20600cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f206643e640 1 -- 172.21.15.2:0/670588265 >> v2:172.21.15.90:3300/0 conn(0x7f2060159950 msgr2=0x7f20600cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f206643e640 1 --2- 172.21.15.2:0/670588265 >> v2:172.21.15.90:3300/0 conn(0x7f2060159950 0x7f20600cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f206643e640 1 -- 172.21.15.2:0/670588265 >> v1:172.21.15.90:6789/0 conn(0x7f206006cf10 legacy=0x7f206006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.520+0000 7f206643e640 1 -- 172.21.15.2:0/670588265 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600cd8c0 con 0x7f206006c1a0 2023-11-04T01:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f206643e640 1 --2- 172.21.15.2:0/670588265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f206006fb70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f20600cfaf0 tx=0x7f205c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97accbfec458dbd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2064c3b640 1 -- 172.21.15.2:0/670588265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c0a89b0 con 0x7f206006c1a0 2023-11-04T01:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2064c3b640 1 -- 172.21.15.2:0/670588265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c0a8b10 con 0x7f206006c1a0 2023-11-04T01:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2064c3b640 1 -- 172.21.15.2:0/670588265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c0a8ea0 con 0x7f206006c1a0 2023-11-04T01:47:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 -- 172.21.15.2:0/670588265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 msgr2=0x7f206006fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 --2- 172.21.15.2:0/670588265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f206006fb70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f20600cfaf0 tx=0x7f205c01ecb0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 -- 172.21.15.2:0/670588265 shutdown_connections 2023-11-04T01:47:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 --2- 172.21.15.2:0/670588265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f206006fb70 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 --2- 172.21.15.2:0/670588265 >> v2:172.21.15.90:3300/0 conn(0x7f2060159950 0x7f20600cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 -- 172.21.15.2:0/670588265 >> 172.21.15.2:0/670588265 conn(0x7f20600cebb0 msgr2=0x7f20600cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 -- 172.21.15.2:0/670588265 shutdown_connections 2023-11-04T01:47:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 -- 172.21.15.2:0/670588265 wait complete. 2023-11-04T01:47:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 Processor -- start 2023-11-04T01:47:17.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.524+0000 7f2067ea1640 1 -- start start 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f2060152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f206006cf10 0x7f20601e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2060159950 0x7f20600af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206015cfe0 con 0x7f206006c1a0 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20600af7b0 con 0x7f206006cf10 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20601e49f0 con 0x7f2060159950 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f2060152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f2060152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33984/0 (socket says 172.21.15.2:33984) 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 -- 172.21.15.2:0/981526332 learned_addr learned my addr 172.21.15.2:0/981526332 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f206543c640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f206006cf10 0x7f20601e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f206643e640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2060159950 0x7f20600af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 -- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2060159950 msgr2=0x7f20600af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2060159950 0x7f20600af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 -- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f206006cf10 msgr2=0x7f20601e42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f206006cf10 0x7f20601e42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 -- 172.21.15.2:0/981526332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0094d0 con 0x7f206006c1a0 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f206543c640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f206006cf10 0x7f20601e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2065c3d640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f2060152de0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f205800d830 tx=0x7f205800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f20567fc640 1 -- 172.21.15.2:0/981526332 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205800b6c0 con 0x7f206006c1a0 2023-11-04T01:47:17.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f20567fc640 1 -- 172.21.15.2:0/981526332 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205800b820 con 0x7f206006c1a0 2023-11-04T01:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20601e4cd0 con 0x7f206006c1a0 2023-11-04T01:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f20567fc640 1 -- 172.21.15.2:0/981526332 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205800bb90 con 0x7f206006c1a0 2023-11-04T01:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20601e5290 con 0x7f206006c1a0 2023-11-04T01:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20600744a0 con 0x7f206006c1a0 2023-11-04T01:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f20567fc640 1 -- 172.21.15.2:0/981526332 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f205801e460 con 0x7f206006c1a0 2023-11-04T01:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f20567fc640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f204c0664a0 0x7f204c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f20567fc640 1 -- 172.21.15.2:0/981526332 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f2058084c10 con 0x7f206006c1a0 2023-11-04T01:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.528+0000 7f206543c640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f204c0664a0 0x7f204c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.532+0000 7f206543c640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f204c0664a0 0x7f204c068960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2050007fd0 tx=0x7f2050009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.532+0000 7f20567fc640 1 -- 172.21.15.2:0/981526332 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2058051ae0 con 0x7f206006c1a0 2023-11-04T01:47:17.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.724+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2060156850 con 0x7f206006c1a0 2023-11-04T01:47:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.724+0000 7f20567fc640 1 -- 172.21.15.2:0/981526332 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f2058055100 con 0x7f206006c1a0 2023-11-04T01:47:17.730 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:17.730 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:14.723539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:17.730 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 74 2023-11-04T01:47:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f204c0664a0 msgr2=0x7f204c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f204c0664a0 0x7f204c068960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2050007fd0 tx=0x7f2050009040 comp rx=0 tx=0).stop 2023-11-04T01:47:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 msgr2=0x7f2060152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:17.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f2060152de0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f205800d830 tx=0x7f205800dcf0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 shutdown_connections 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f204c0664a0 0x7f204c068960 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2060159950 0x7f20600af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f206006cf10 0x7f20601e42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 --2- 172.21.15.2:0/981526332 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f206006c1a0 0x7f2060152de0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 >> 172.21.15.2:0/981526332 conn(0x7f20600cebb0 msgr2=0x7f20600b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 shutdown_connections 2023-11-04T01:47:17.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:17.728+0000 7f2067ea1640 1 -- 172.21.15.2:0/981526332 wait complete. 2023-11-04T01:47:18.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:45:35.008340+0000', 'modified': '2023-11-04T01:47:14.723539+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 7569, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 48, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.2:6835/3725992406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 3725992406}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3725992406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7569': {'gid': 7569, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.2:6833/2515781456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6832', 'nonce': 2515781456}, {'type': 'v1', 'addr': '172.21.15.2:6833', 'nonce': 2515781456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:47:18.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:47:18.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:47:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.284+0000 7f9a2547e640 1 Processor -- start 2023-11-04T01:47:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a2547e640 1 -- start start 2023-11-04T01:47:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a2547e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a2015a1f0 0x7f9a200cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a2547e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9a200b0d40 0x7f9a200704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a2547e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200ccee0 con 0x7f9a200cdea0 2023-11-04T01:47:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a2547e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2015a5d0 con 0x7f9a200b0d40 2023-11-04T01:47:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a2547e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200ca900 con 0x7f9a2015a1f0 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9a200b0d40 0x7f9a200704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9a200b0d40 0x7f9a200704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:60234/0 (socket says 172.21.15.2:60234) 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a2015a1f0 0x7f9a200cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1f7fe640 1 -- 172.21.15.2:0/197778881 learned_addr learned my addr 172.21.15.2:0/197778881 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1f7fe640 1 -- 172.21.15.2:0/197778881 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a2015a1f0 msgr2=0x7f9a200cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1f7fe640 1 --2- 172.21.15.2:0/197778881 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a2015a1f0 0x7f9a200cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1f7fe640 1 -- 172.21.15.2:0/197778881 >> v1:172.21.15.90:6789/0 conn(0x7f9a200cdea0 legacy=0x7f9a200b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.288+0000 7f9a1f7fe640 1 -- 172.21.15.2:0/197778881 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200cabe0 con 0x7f9a200b0d40 2023-11-04T01:47:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a1f7fe640 1 --2- 172.21.15.2:0/197778881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a200b0d40 0x7f9a200704e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800d150 tx=0x7f9a1801ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2224210e5b9445c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a1dffb640 1 -- 172.21.15.2:0/197778881 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800b2d0 con 0x7f9a200b0d40 2023-11-04T01:47:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a1dffb640 1 -- 172.21.15.2:0/197778881 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800b430 con 0x7f9a200b0d40 2023-11-04T01:47:18.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a1dffb640 1 -- 172.21.15.2:0/197778881 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180a7cd0 con 0x7f9a200b0d40 2023-11-04T01:47:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- 172.21.15.2:0/197778881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a200b0d40 msgr2=0x7f9a200704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 --2- 172.21.15.2:0/197778881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a200b0d40 0x7f9a200704e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800d150 tx=0x7f9a1801ebe0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- 172.21.15.2:0/197778881 shutdown_connections 2023-11-04T01:47:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 --2- 172.21.15.2:0/197778881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a200b0d40 0x7f9a200704e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 --2- 172.21.15.2:0/197778881 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a2015a1f0 0x7f9a200cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- 172.21.15.2:0/197778881 >> 172.21.15.2:0/197778881 conn(0x7f9a200cebb0 msgr2=0x7f9a200cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- 172.21.15.2:0/197778881 shutdown_connections 2023-11-04T01:47:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- 172.21.15.2:0/197778881 wait complete. 2023-11-04T01:47:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 Processor -- start 2023-11-04T01:47:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- start start 2023-11-04T01:47:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a200b0d40 0x7f9a20162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a200cdea0 0x7f9a200c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a2015a1f0 0x7f9a20150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20163e10 con 0x7f9a200b0d40 2023-11-04T01:47:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201634e0 con 0x7f9a2015a1f0 2023-11-04T01:47:18.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.292+0000 7f9a2547e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201637c0 con 0x7f9a200cdea0 2023-11-04T01:47:18.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a200b0d40 0x7f9a20162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a200b0d40 0x7f9a20162de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34000/0 (socket says 172.21.15.2:34000) 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 -- 172.21.15.2:0/694392124 learned_addr learned my addr 172.21.15.2:0/694392124 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a200cdea0 0x7f9a200c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1f7fe640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a2015a1f0 0x7f9a20150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 -- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a200cdea0 msgr2=0x7f9a200c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a200cdea0 0x7f9a200c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 -- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a2015a1f0 msgr2=0x7f9a20150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a2015a1f0 0x7f9a20150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 -- 172.21.15.2:0/694392124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1800bd40 con 0x7f9a200b0d40 2023-11-04T01:47:18.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1effd640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a200b0d40 0x7f9a20162de0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000e870 tx=0x7f9a1000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a077fe640 1 -- 172.21.15.2:0/694392124 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10009510 con 0x7f9a200b0d40 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a077fe640 1 -- 172.21.15.2:0/694392124 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000eec0 con 0x7f9a200b0d40 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20163aa0 con 0x7f9a200b0d40 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a077fe640 1 -- 172.21.15.2:0/694392124 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000cb40 con 0x7f9a200b0d40 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a201513e0 con 0x7f9a200b0d40 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a077fe640 1 -- 172.21.15.2:0/694392124 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a1000cca0 con 0x7f9a200b0d40 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a077fe640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a0c0664d0 0x7f9a0c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a077fe640 1 -- 172.21.15.2:0/694392124 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f9a100844b0 con 0x7f9a200b0d40 2023-11-04T01:47:18.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a0c0664d0 0x7f9a0c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a285ab000 1 Processor -- start 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a285ab000 1 -- start start 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.296+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a0c0664d0 0x7f9a0c068990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9a200b0d10 tx=0x7f9a14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96d32380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d328c0 0x559e96ce5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96ce5b40 0x559e96ce5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e96bb0460 con 0x559e96d31fa0 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e96b41690 con 0x559e96ce5b40 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e96b3ebc0 con 0x559e96d328c0 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96d32380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96d32380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34006/0 (socket says 172.21.15.2:34006) 2023-11-04T01:47:18.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 -- 172.21.15.2:0/1289620780 learned_addr learned my addr 172.21.15.2:0/1289620780 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1f7fe640 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96ce5b40 0x559e96ce5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d328c0 0x559e96ce5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 -- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d328c0 msgr2=0x559e96ce5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d328c0 0x559e96ce5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 -- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96ce5b40 msgr2=0x559e96ce5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96ce5b40 0x559e96ce5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 -- 172.21.15.2:0/1289620780 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e96832890 con 0x559e96d31fa0 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d328c0 0x559e96ce5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96d32380 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000cfd0 tx=0x7f9a10055040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8520f607596f071f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a04ff9640 1 -- 172.21.15.2:0/1289620780 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1005d340 con 0x559e96d31fa0 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a04ff9640 1 -- 172.21.15.2:0/1289620780 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a100533e0 con 0x559e96d31fa0 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a04ff9640 1 -- 172.21.15.2:0/1289620780 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100840e0 con 0x559e96d31fa0 2023-11-04T01:47:18.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- 172.21.15.2:0/1289620780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 msgr2=0x559e96d32380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96d32380 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000cfd0 tx=0x7f9a10055040 comp rx=0 tx=0).stop 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- 172.21.15.2:0/1289620780 shutdown_connections 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96ce5b40 0x559e96ce5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d328c0 0x559e96ce5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1289620780 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96d32380 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- 172.21.15.2:0/1289620780 >> 172.21.15.2:0/1289620780 conn(0x559e96d12d40 msgr2=0x559e96d15130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- 172.21.15.2:0/1289620780 shutdown_connections 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- 172.21.15.2:0/1289620780 wait complete. 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- start start 2023-11-04T01:47:18.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 Processor -- start 2023-11-04T01:47:18.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 0x559e96ceba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96cebf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d328c0 0x559e96cec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e96b3a4b0 con 0x559e96d31fa0 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e96af2aa0 con 0x559e96d328c0 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e96af8940 con 0x559e96ce5b40 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a285ab000 10 client.0 _ll_register_callbacks cb 0x559e96cd3460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96cebf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96cebf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34010/0 (socket says 172.21.15.2:34010) 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3108865120 learned_addr learned my addr 172.21.15.2:0/3108865120 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1f7fe640 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d328c0 0x559e96cec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1effd640 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 0x559e96ceba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 msgr2=0x559e96ceba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 0x559e96ceba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d328c0 msgr2=0x559e96cec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d328c0 0x559e96cec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.300+0000 7f9a1e7fc640 1 -- 172.21.15.2:0/3108865120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a201513e0 con 0x559e96d31fa0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96cebf80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400e780 tx=0x7f9a14000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30ba55816fd8e77 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 1 -- 172.21.15.2:0/3108865120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003b10 con 0x559e96d31fa0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 1 -- 172.21.15.2:0/3108865120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f9a14003c70 con 0x559e96d31fa0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e96af7e10 con 0x559e96d31fa0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 1 -- 172.21.15.2:0/3108865120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a14003e30 con 0x559e96d31fa0 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 10 client.7731 fetch_fsmap learned FSMap version 74 2023-11-04T01:47:18.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559e96afb1a0 con 0x559e96d31fa0 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 1 -- 172.21.15.2:0/3108865120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e96af7e10 con 0x559e96d31fa0 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 1 -- 172.21.15.2:0/3108865120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 74) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9a14022430 con 0x559e96d31fa0 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 10 client.7731 fetch_fsmap finished waiting for FSMap version 74 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 10 client.7731 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 20 client.7731 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96cecd90 0x559e96d43720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 4 client.7731 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e96b38e00 con 0x559e96cecd90 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a1effd640 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96cecd90 0x559e96d43720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 10 client.7731 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a1effd640 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96cecd90 0x559e96d43720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f458de4d9b75b7ad server_cookie=d9e3c26d08576a7f in_seq=0 out_seq=0 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 1 -- 172.21.15.2:0/3108865120 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559e96b38e00 con 0x559e96cecd90 2023-11-04T01:47:18.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 10 client.7731 handle_command_reply: tid=0 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 client.7731 shutdown 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 msgr2=0x559e96cebf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96cebf80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400e780 tx=0x7f9a14000ee0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 shutdown_connections 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96cecd90 0x559e96d43720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d328c0 0x559e96cec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f99fdffb640 0 client.7731 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d31fa0 0x559e96cebf80 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 --2- 172.21.15.2:0/3108865120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 0x559e96ceba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 >> 172.21.15.2:0/3108865120 conn(0x559e96d12d40 msgr2=0x559e96d15130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 shutdown_connections 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 1 -- 172.21.15.2:0/3108865120 wait complete. 2023-11-04T01:47:18.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.304+0000 7f9a285ab000 20 client.7731 trim_cache size 0 max 16384 2023-11-04T01:47:18.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 Processor -- start 2023-11-04T01:47:18.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 -- start start 2023-11-04T01:47:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d12d40 0x559e96ced880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 0x559e96ceddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d31fa0 0x559e96d31270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e967f3940 con 0x559e96d12d40 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e96af8460 con 0x559e96d31fa0 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e96ceb510 con 0x559e96ce5b40 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d12d40 0x559e96ced880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d12d40 0x559e96ced880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34012/0 (socket says 172.21.15.2:34012) 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 -- 172.21.15.2:0/2892321377 learned_addr learned my addr 172.21.15.2:0/2892321377 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 -- 172.21.15.2:0/2892321377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 msgr2=0x559e96ceddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 --2- 172.21.15.2:0/2892321377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 0x559e96ceddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 -- 172.21.15.2:0/2892321377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d31fa0 msgr2=0x559e96d31270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 --2- 172.21.15.2:0/2892321377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d31fa0 0x559e96d31270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 -- 172.21.15.2:0/2892321377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e96ae14a0 con 0x559e96d12d40 2023-11-04T01:47:18.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a1effd640 1 --2- 172.21.15.2:0/2892321377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d12d40 0x559e96ced880 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c520 tx=0x7f9a10021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381d70ca493af6e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a057fa640 1 -- 172.21.15.2:0/2892321377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100533e0 con 0x559e96d12d40 2023-11-04T01:47:18.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a057fa640 1 -- 172.21.15.2:0/2892321377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10051750 con 0x559e96d12d40 2023-11-04T01:47:18.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.320+0000 7f9a057fa640 1 -- 172.21.15.2:0/2892321377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100518c0 con 0x559e96d12d40 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/2892321377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d12d40 msgr2=0x559e96ced880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/2892321377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d12d40 0x559e96ced880 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c520 tx=0x7f9a10021000 comp rx=0 tx=0).stop 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/2892321377 shutdown_connections 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/2892321377 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d31fa0 0x559e96d31270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/2892321377 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96ce5b40 0x559e96ceddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/2892321377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96d12d40 0x559e96ced880 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/2892321377 >> 172.21.15.2:0/2892321377 conn(0x559e96cebbd0 msgr2=0x559e96ced170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/2892321377 shutdown_connections 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/2892321377 wait complete. 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- start start 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 Processor -- start 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96ce5b40 0x559e96d44b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d12d40 0x559e96d4f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d31fa0 0x559e96d4f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e96abd460 con 0x559e96ce5b40 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e96cdfa70 con 0x559e96d12d40 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e96b35e20 con 0x559e96d31fa0 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 10 client.0 _ll_register_callbacks cb 0x7f9a10054e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96ce5b40 0x559e96d44b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96ce5b40 0x559e96d44b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34016/0 (socket says 172.21.15.2:34016) 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 -- 172.21.15.2:0/1439737276 learned_addr learned my addr 172.21.15.2:0/1439737276 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1f7fe640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d31fa0 0x559e96d4f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d12d40 0x559e96d4f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 -- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d31fa0 msgr2=0x559e96d4f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d31fa0 0x559e96d4f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 -- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d12d40 msgr2=0x559e96d4f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d12d40 0x559e96d4f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 -- 172.21.15.2:0/1439737276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e96832890 con 0x559e96ce5b40 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d12d40 0x559e96d4f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1effd640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96ce5b40 0x559e96d44b60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9a10016000 tx=0x7f9a10000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1bdbf0e19b4bbe server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 1 -- 172.21.15.2:0/1439737276 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100518c0 con 0x559e96ce5b40 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 1 -- 172.21.15.2:0/1439737276 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f9a10070030 con 0x559e96ce5b40 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e96b04d10 con 0x559e96ce5b40 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 1 -- 172.21.15.2:0/1439737276 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a100840e0 con 0x559e96ce5b40 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 10 client.7737 fetch_fsmap learned FSMap version 74 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559e96832cc0 con 0x559e96ce5b40 2023-11-04T01:47:18.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 1 -- 172.21.15.2:0/1439737276 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e96b04d10 con 0x559e96ce5b40 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 1 -- 172.21.15.2:0/1439737276 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 74) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f9a10011070 con 0x559e96ce5b40 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 10 client.7737 fetch_fsmap finished waiting for FSMap version 74 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 10 client.7737 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 20 client.7737 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96d328c0 0x559e96d92ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 4 client.7737 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559e96b33490 con 0x559e96d328c0 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96d328c0 0x559e96d92ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a1e7fc640 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96d328c0 0x559e96d92ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=795f07843652be8b server_cookie=1cd5e6534ab1adde in_seq=0 out_seq=0 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 10 client.7737 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 1 -- 172.21.15.2:0/1439737276 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x559e96b33490 con 0x559e96d328c0 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 10 client.7737 handle_command_reply: tid=0 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 client.7737 shutdown 2023-11-04T01:47:18.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96ce5b40 msgr2=0x559e96d44b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96ce5b40 0x559e96d44b60 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9a10016000 tx=0x7f9a10000bd0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 shutdown_connections 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x559e96d328c0 0x559e96d92ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559e96d31fa0 0x559e96d4f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559e96d12d40 0x559e96d4f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 --2- 172.21.15.2:0/1439737276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559e96ce5b40 0x559e96d44b60 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 >> 172.21.15.2:0/1439737276 conn(0x559e96cebbd0 msgr2=0x559e96ceda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f99fdffb640 0 client.7737 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.324+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 shutdown_connections 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a285ab000 1 -- 172.21.15.2:0/1439737276 wait complete. 2023-11-04T01:47:18.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a285ab000 20 client.7737 trim_cache size 0 max 16384 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7128, 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 91.513716763000005, 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 74, 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 97, 2023-11-04T01:47:18.337 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2023-11-04T01:47:18.338 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 108.740679782 2023-11-04T01:47:18.338 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:47:18.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a0c0664d0 msgr2=0x7f9a0c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a0c0664d0 0x7f9a0c068990 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9a200b0d10 tx=0x7f9a14009040 comp rx=0 tx=0).stop 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a200b0d40 msgr2=0x7f9a20162de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a200b0d40 0x7f9a20162de0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000e870 tx=0x7f9a1000ec70 comp rx=0 tx=0).stop 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 shutdown_connections 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a0c0664d0 0x7f9a0c068990 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a2015a1f0 0x7f9a20150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a200cdea0 0x7f9a200c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 --2- 172.21.15.2:0/694392124 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a200b0d40 0x7f9a20162de0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 >> 172.21.15.2:0/694392124 conn(0x7f9a200cebb0 msgr2=0x7f9a200b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 shutdown_connections 2023-11-04T01:47:18.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.328+0000 7f9a2547e640 1 -- 172.21.15.2:0/694392124 wait complete. 2023-11-04T01:47:18.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-04T01:47:18.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c29710640 1 Processor -- start 2023-11-04T01:47:18.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c29710640 1 -- start start 2023-11-04T01:47:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c29710640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 0x7f3c240d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c29710640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2406f480 con 0x7f3c240b2ee0 2023-11-04T01:47:18.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c29710640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2406c280 con 0x7f3c2406d040 2023-11-04T01:47:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c29710640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ce7c0 con 0x7f3c2406cc60 2023-11-04T01:47:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c240b2ee0 0x7f3c2415c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35332/0 (socket says 172.21.15.2:35332) 2023-11-04T01:47:18.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 -- 172.21.15.2:0/3906710527 learned_addr learned my addr 172.21.15.2:0/3906710527 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:18.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 0x7f3c240d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369690384 0 0) 0x7f3c2406f480 con 0x7f3c240b2ee0 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c0c003530 con 0x7f3c240b2ee0 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110034842 0 0) 0x7f3c0c003530 con 0x7f3c240b2ee0 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 msgr2=0x7f3c240d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 0x7f3c240d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 >> v1:172.21.15.90:6789/0 conn(0x7f3c2406d040 legacy=0x7f3c240b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2406f6d0 con 0x7f3c240b2ee0 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3c1c001680 con 0x7f3c240b2ee0 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 >> v1:172.21.15.2:6789/0 conn(0x7f3c240b2ee0 legacy=0x7f3c2415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 0x7f3c0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 0x7f3c0c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c004d10 0x7f3c0c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ce7c0 con 0x7f3c0c004d10 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c00ba40 con 0x7f3c0c0039b0 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c00bc00 con 0x7f3c2406cc60 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c004d10 0x7f3c0c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 0x7f3c0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c227fc640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 0x7f3c0c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 -- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 msgr2=0x7f3c0c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c2406cc60 0x7f3c0c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 -- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 msgr2=0x7f3c0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 0x7f3c0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.460+0000 7f3c237fe640 1 -- 172.21.15.2:0/3906710527 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c003530 con 0x7f3c0c004d10 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c237fe640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c004d10 0x7f3c0c005190 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406d840 tx=0x7f3c1c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646f370af1523972 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c005ae0 con 0x7f3c0c004d10 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c005c60 con 0x7f3c0c004d10 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c21ffb640 1 -- 172.21.15.2:0/3906710527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a58c0 con 0x7f3c0c004d10 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 -- 172.21.15.2:0/3906710527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c004d10 msgr2=0x7f3c0c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 --2- 172.21.15.2:0/3906710527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c004d10 0x7f3c0c005190 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f3c2406d840 tx=0x7f3c1c01cbc0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c237fe640 1 -- 172.21.15.2:0/3906710527 reap_dead start 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 -- 172.21.15.2:0/3906710527 shutdown_connections 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 -- 172.21.15.2:0/3906710527 >> 172.21.15.2:0/3906710527 conn(0x7f3c240cd7d0 msgr2=0x7f3c240cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 -- 172.21.15.2:0/3906710527 shutdown_connections 2023-11-04T01:47:18.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 -- 172.21.15.2:0/3906710527 wait complete. 2023-11-04T01:47:18.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 Processor -- start 2023-11-04T01:47:18.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.464+0000 7f3c29710640 1 -- start start 2023-11-04T01:47:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24155900 0x7f3c240ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24157ea0 0x7f3c24158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c24158860 0x7f3c240aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240adb20 con 0x7f3c24157ea0 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ad2f0 con 0x7f3c24158860 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24158ce0 con 0x7f3c24155900 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24157ea0 0x7f3c24158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24157ea0 0x7f3c24158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34038/0 (socket says 172.21.15.2:34038) 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 -- 172.21.15.2:0/927112680 learned_addr learned my addr 172.21.15.2:0/927112680 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c237fe640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c24158860 0x7f3c240aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24155900 0x7f3c240ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 -- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24155900 msgr2=0x7f3c240ac950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24155900 0x7f3c240ac950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 -- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c24158860 msgr2=0x7f3c240aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c24158860 0x7f3c240aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 -- 172.21.15.2:0/927112680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240ad560 con 0x7f3c24157ea0 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c227fc640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24157ea0 0x7f3c24158320 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800e500 tx=0x7f3c1800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/927112680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180053a0 con 0x7f3c24157ea0 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/927112680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18003600 con 0x7f3c24157ea0 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c240ad840 con 0x7f3c24157ea0 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/927112680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18003990 con 0x7f3c24157ea0 2023-11-04T01:47:18.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240b0150 con 0x7f3c24157ea0 2023-11-04T01:47:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/927112680 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c18003af0 con 0x7f3c24157ea0 2023-11-04T01:47:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c0b7fe640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c0b7fe640 1 -- 172.21.15.2:0/927112680 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f3c18084170 con 0x7f3c24157ea0 2023-11-04T01:47:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.468+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 Processor -- start 2023-11-04T01:47:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- start start 2023-11-04T01:47:18.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3c14007520 tx=0x7f3c1400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd88fa0 0x559d5dd89380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd3cb40 0x559d5dd3cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5dc07460 con 0x559d5dd898c0 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5db98690 con 0x559d5dd3cb40 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d5db95bc0 con 0x559d5dd88fa0 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd3c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34052/0 (socket says 172.21.15.2:34052) 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 -- 172.21.15.2:0/2924812425 learned_addr learned my addr 172.21.15.2:0/2924812425 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd88fa0 0x559d5dd89380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c237fe640 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd3cb40 0x559d5dd3cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 -- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd88fa0 msgr2=0x559d5dd89380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd88fa0 0x559d5dd89380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 -- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd3cb40 msgr2=0x559d5dd3cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd3cb40 0x559d5dd3cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 -- 172.21.15.2:0/2924812425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d5d889890 con 0x559d5dd898c0 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c237fe640 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd3cb40 0x559d5dd3cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c227fc640 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd3c600 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3c1805caf0 tx=0x7f3c18054680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a237690b3ec7b1c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c08ff9640 1 -- 172.21.15.2:0/2924812425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18054d20 con 0x559d5dd898c0 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c08ff9640 1 -- 172.21.15.2:0/2924812425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18058e70 con 0x559d5dd898c0 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c08ff9640 1 -- 172.21.15.2:0/2924812425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1805d020 con 0x559d5dd898c0 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2924812425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 msgr2=0x559d5dd3c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd3c600 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3c1805caf0 tx=0x7f3c18054680 comp rx=0 tx=0).stop 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2924812425 shutdown_connections 2023-11-04T01:47:18.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd3cb40 0x559d5dd3cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd3c600 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2924812425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd88fa0 0x559d5dd89380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2924812425 >> 172.21.15.2:0/2924812425 conn(0x559d5dd69d40 msgr2=0x559d5dd6c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2924812425 shutdown_connections 2023-11-04T01:47:18.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2924812425 wait complete. 2023-11-04T01:47:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 -- start start 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.472+0000 7f3c2c83d000 1 Processor -- start 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd3cb40 0x559d5dd69120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd69660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd898c0 0x559d5dd428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5db914b0 con 0x559d5dd3cb40 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5db49aa0 con 0x559d5dd88fa0 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d5db4f940 con 0x559d5dd898c0 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 10 client.0 _ll_register_callbacks cb 0x559d5dd2a460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd3cb40 0x559d5dd69120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd3cb40 0x559d5dd69120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34058/0 (socket says 172.21.15.2:34058) 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 -- 172.21.15.2:0/945972810 learned_addr learned my addr 172.21.15.2:0/945972810 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c237fe640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd898c0 0x559d5dd428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c227fc640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd69660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 -- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd898c0 msgr2=0x559d5dd428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd898c0 0x559d5dd428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 -- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 msgr2=0x559d5dd69660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd69660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 -- 172.21.15.2:0/945972810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240b0150 con 0x559d5dd3cb40 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c227fc640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd69660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd3cb40 0x559d5dd69120 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f3c140045e0 tx=0x7f3c14004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b0fd4344c3c752 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 1 -- 172.21.15.2:0/945972810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400e040 con 0x559d5dd3cb40 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 1 -- 172.21.15.2:0/945972810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f3c14019da0 con 0x559d5dd3cb40 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d5db4ee10 con 0x559d5dd3cb40 2023-11-04T01:47:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 1 -- 172.21.15.2:0/945972810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c14016460 con 0x559d5dd3cb40 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 10 client.7749 fetch_fsmap learned FSMap version 74 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559d5db521a0 con 0x559d5dd3cb40 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 1 -- 172.21.15.2:0/945972810 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d5db4ee10 con 0x559d5dd3cb40 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 1 -- 172.21.15.2:0/945972810 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 74) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f3c14014040 con 0x559d5dd3cb40 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 10 client.7749 fetch_fsmap finished waiting for FSMap version 74 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 10 client.7749 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 20 client.7749 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5dd43660 0x559d5dd43a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 4 client.7749 mds_command: new command op to 7569 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 --> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d5db8fe00 con 0x559d5dd43660 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c227fc640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5dd43660 0x559d5dd43a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c227fc640 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5dd43660 0x559d5dd43a40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afd976c39ca52094 server_cookie=e0b3be086e36beef in_seq=0 out_seq=0 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 10 client.7749 ms_handle_connect on v2:172.21.15.2:6832/2515781456 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 1 -- 172.21.15.2:0/945972810 <== mds.0 v2:172.21.15.2:6832/2515781456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559d5db8fe00 con 0x559d5dd43660 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 10 client.7749 handle_command_reply: tid=0 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 client.7749 shutdown 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd3cb40 msgr2=0x559d5dd69120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd3cb40 0x559d5dd69120 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f3c140045e0 tx=0x7f3c14004ac0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 shutdown_connections 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5dd43660 0x559d5dd43a40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd898c0 0x559d5dd428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd69660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/945972810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd3cb40 0x559d5dd69120 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c01ffb640 0 client.7749 ms_handle_reset on v2:172.21.15.2:6832/2515781456 2023-11-04T01:47:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 >> 172.21.15.2:0/945972810 conn(0x559d5dd69d40 msgr2=0x559d5dd6c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 shutdown_connections 2023-11-04T01:47:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 1 -- 172.21.15.2:0/945972810 wait complete. 2023-11-04T01:47:18.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.476+0000 7f3c2c83d000 20 client.7749 trim_cache size 0 max 16384 2023-11-04T01:47:18.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 Processor -- start 2023-11-04T01:47:18.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 -- start start 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd9f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd88060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd885a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5dd698c0 con 0x559d5dd898c0 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5d84a940 con 0x559d5dd88fa0 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d5db90340 con 0x559d5dd3cb40 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd885a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd885a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34066/0 (socket says 172.21.15.2:34066) 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 -- 172.21.15.2:0/2859884996 learned_addr learned my addr 172.21.15.2:0/2859884996 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c227fc640 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd88060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd9f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 -- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 msgr2=0x559d5dd9f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd9f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 -- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 msgr2=0x559d5dd88060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd88060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 -- 172.21.15.2:0/2859884996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d5db384a0 con 0x559d5dd898c0 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c227fc640 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd88060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c237fe640 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd885a0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01d460 tx=0x7f3c1c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46133675966d2cf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c097fa640 1 -- 172.21.15.2:0/2859884996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0b4040 con 0x559d5dd898c0 2023-11-04T01:47:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c097fa640 1 -- 172.21.15.2:0/2859884996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c001440 con 0x559d5dd898c0 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.492+0000 7f3c097fa640 1 -- 172.21.15.2:0/2859884996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a58c0 con 0x559d5dd898c0 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2859884996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 msgr2=0x559d5dd885a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd885a0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01d460 tx=0x7f3c1c001a10 comp rx=0 tx=0).stop 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2859884996 shutdown_connections 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd885a0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd88060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/2859884996 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd9f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2859884996 >> 172.21.15.2:0/2859884996 conn(0x559d5dd69d40 msgr2=0x559d5dd96590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2859884996 shutdown_connections 2023-11-04T01:47:18.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/2859884996 wait complete. 2023-11-04T01:47:18.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- start start 2023-11-04T01:47:18.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 Processor -- start 2023-11-04T01:47:18.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd44970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd9b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd9b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5db4f460 con 0x559d5dd898c0 2023-11-04T01:47:18.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d5dd3fef0 con 0x559d5dd88fa0 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d5dd3ca00 con 0x559d5dd3cb40 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 10 client.0 _ll_register_callbacks cb 0x7f3c18001240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd9b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd9b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34068/0 (socket says 172.21.15.2:34068) 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 -- 172.21.15.2:0/3385519459 learned_addr learned my addr 172.21.15.2:0/3385519459 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c227fc640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd9b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd44970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 -- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 msgr2=0x559d5dd44970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd44970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 -- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 msgr2=0x559d5dd9b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd9b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 -- 172.21.15.2:0/3385519459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c003530 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c227fc640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd9b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c237fe640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd9b9b0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001ec0 tx=0x7f3c1c019960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838944eec3f64ae8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 1 -- 172.21.15.2:0/3385519459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a5cd0 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d5dd40ab0 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 1 -- 172.21.15.2:0/3385519459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f3c1c0a5e30 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 1 -- 172.21.15.2:0/3385519459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c1c000f10 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 10 client.7755 fetch_fsmap learned FSMap version 74 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x559d5d889cc0 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 1 -- 172.21.15.2:0/3385519459 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d5dd40ab0 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 1 -- 172.21.15.2:0/3385519459 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 74) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f3c1c0048b0 con 0x559d5dd898c0 2023-11-04T01:47:18.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 10 client.7755 fetch_fsmap finished waiting for FSMap version 74 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 10 client.7755 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 20 client.7755 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5ddefe00 0x559d5ddf21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 4 client.7755 mds_command: new command op to 7569 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 --> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559d5db5bd10 con 0x559d5ddefe00 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5ddefe00 0x559d5ddf21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 10 client.7755 ms_handle_connect on v2:172.21.15.2:6832/2515781456 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c22ffd640 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5ddefe00 0x559d5ddf21f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d659dd3ff2481ae server_cookie=517cea627a0d8228 in_seq=0 out_seq=0 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 1 -- 172.21.15.2:0/3385519459 <== mds.0 v2:172.21.15.2:6832/2515781456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559d5db5bd10 con 0x559d5ddefe00 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c01ffb640 10 client.7755 handle_command_reply: tid=0 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.496+0000 7f3c2c83d000 1 client.7755 shutdown 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 msgr2=0x559d5dd9b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd9b9b0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001ec0 tx=0x7f3c1c019960 comp rx=0 tx=0).stop 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 shutdown_connections 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:6832/2515781456,v1:172.21.15.2:6833/2515781456] conn(0x559d5ddefe00 0x559d5ddf21f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d5dd898c0 0x559d5dd9b9b0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c01ffb640 0 client.7755 ms_handle_reset on v2:172.21.15.2:6832/2515781456 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x559d5dd88fa0 0x559d5dd9b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 --2- 172.21.15.2:0/3385519459 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x559d5dd3cb40 0x559d5dd44970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 >> 172.21.15.2:0/3385519459 conn(0x559d5dd69d40 msgr2=0x559d5dd96590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 shutdown_connections 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 1 -- 172.21.15.2:0/3385519459 wait complete. 2023-11-04T01:47:18.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c2c83d000 20 client.7755 trim_cache size 0 max 16384 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7569, 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.8105802000000004, 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 74, 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 97, 2023-11-04T01:47:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 97, 2023-11-04T01:47:18.511 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 32.051702198999998 2023-11-04T01:47:18.511 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:47:18.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 msgr2=0x7f3c10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3c14007520 tx=0x7f3c1400b040 comp rx=0 tx=0).stop 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24157ea0 msgr2=0x7f3c24158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24157ea0 0x7f3c24158320 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800e500 tx=0x7f3c1800e9c0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 shutdown_connections 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c24158860 0x7f3c240aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24157ea0 0x7f3c24158320 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 --2- 172.21.15.2:0/927112680 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24155900 0x7f3c240ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 >> 172.21.15.2:0/927112680 conn(0x7f3c240cd7d0 msgr2=0x7f3c240b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 shutdown_connections 2023-11-04T01:47:18.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.500+0000 7f3c29710640 1 -- 172.21.15.2:0/927112680 wait complete. 2023-11-04T01:47:18.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:18.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc595599640 1 Processor -- start 2023-11-04T01:47:18.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc595599640 1 -- start start 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc595599640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc5900b0c80 0x7fc59006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc595599640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5900b1060 0x7fc59015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc595599640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59006dbb0 con 0x7fc5900ce6b0 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc595599640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5900cdaf0 con 0x7fc5900b1060 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc595599640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5900cec70 con 0x7fc5900b0c80 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc5867fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5900b1060 0x7fc59015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc5867fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5900b1060 0x7fc59015cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34076/0 (socket says 172.21.15.2:34076) 2023-11-04T01:47:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc5867fc640 1 -- 172.21.15.2:0/1527147303 learned_addr learned my addr 172.21.15.2:0/1527147303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc58effd640 1 --2- 172.21.15.2:0/1527147303 >> v2:172.21.15.90:3300/0 conn(0x7fc5900b0c80 0x7fc59006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc5867fc640 1 -- 172.21.15.2:0/1527147303 >> v2:172.21.15.90:3300/0 conn(0x7fc5900b0c80 msgr2=0x7fc59006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc5867fc640 1 --2- 172.21.15.2:0/1527147303 >> v2:172.21.15.90:3300/0 conn(0x7fc5900b0c80 0x7fc59006d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc5867fc640 1 -- 172.21.15.2:0/1527147303 >> v1:172.21.15.90:6789/0 conn(0x7fc5900ce6b0 legacy=0x7fc590070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc5867fc640 1 -- 172.21.15.2:0/1527147303 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59006bc50 con 0x7fc5900b1060 2023-11-04T01:47:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.624+0000 7fc58effd640 1 --2- 172.21.15.2:0/1527147303 >> v2:172.21.15.90:3300/0 conn(0x7fc5900b0c80 0x7fc59006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc5867fc640 1 --2- 172.21.15.2:0/1527147303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b1060 0x7fc59015cc30 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fc5900b1800 tx=0x7fc57801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee0dc52fdc15c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58e7fc640 1 -- 172.21.15.2:0/1527147303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a89b0 con 0x7fc5900b1060 2023-11-04T01:47:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58e7fc640 1 -- 172.21.15.2:0/1527147303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5780a8b10 con 0x7fc5900b1060 2023-11-04T01:47:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58e7fc640 1 -- 172.21.15.2:0/1527147303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5780a8ea0 con 0x7fc5900b1060 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- 172.21.15.2:0/1527147303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b1060 msgr2=0x7fc59015cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 --2- 172.21.15.2:0/1527147303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b1060 0x7fc59015cc30 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fc5900b1800 tx=0x7fc57801ecb0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- 172.21.15.2:0/1527147303 shutdown_connections 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 --2- 172.21.15.2:0/1527147303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b1060 0x7fc59015cc30 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 --2- 172.21.15.2:0/1527147303 >> v2:172.21.15.90:3300/0 conn(0x7fc5900b0c80 0x7fc59006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- 172.21.15.2:0/1527147303 >> 172.21.15.2:0/1527147303 conn(0x7fc5900cefa0 msgr2=0x7fc5900cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- 172.21.15.2:0/1527147303 shutdown_connections 2023-11-04T01:47:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- 172.21.15.2:0/1527147303 wait complete. 2023-11-04T01:47:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 Processor -- start 2023-11-04T01:47:18.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- start start 2023-11-04T01:47:18.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b0c80 0x7fc59015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5900b1060 0x7fc590159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5900ce6b0 0x7fc59015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59015bf60 con 0x7fc5900b0c80 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc590159f60 con 0x7fc5900b1060 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59015b350 con 0x7fc5900ce6b0 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b0c80 0x7fc59015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b0c80 0x7fc59015a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34092/0 (socket says 172.21.15.2:34092) 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 -- 172.21.15.2:0/1360116883 learned_addr learned my addr 172.21.15.2:0/1360116883 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc5867fc640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5900b1060 0x7fc590159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 -- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5900ce6b0 msgr2=0x7fc59015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5900ce6b0 0x7fc59015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 -- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5900b1060 msgr2=0x7fc590159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5900b1060 0x7fc590159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 -- 172.21.15.2:0/1360116883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780094d0 con 0x7fc5900b0c80 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc58effd640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b0c80 0x7fc59015a1a0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fc58000c7c0 tx=0x7fc58000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc587fff640 1 -- 172.21.15.2:0/1360116883 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580007a30 con 0x7fc5900b0c80 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc587fff640 1 -- 172.21.15.2:0/1360116883 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580007b90 con 0x7fc5900b0c80 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59015b630 con 0x7fc5900b0c80 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.628+0000 7fc587fff640 1 -- 172.21.15.2:0/1360116883 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000ce70 con 0x7fc5900b0c80 2023-11-04T01:47:18.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.632+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59015bbf0 con 0x7fc5900b0c80 2023-11-04T01:47:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.632+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5900744a0 con 0x7fc5900b0c80 2023-11-04T01:47:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.632+0000 7fc587fff640 1 -- 172.21.15.2:0/1360116883 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5800113f0 con 0x7fc5900b0c80 2023-11-04T01:47:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.632+0000 7fc587fff640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5700664d0 0x7fc570068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.632+0000 7fc587fff640 1 -- 172.21.15.2:0/1360116883 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7fc580084870 con 0x7fc5900b0c80 2023-11-04T01:47:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.632+0000 7fc5867fc640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5700664d0 0x7fc570068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:18.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.632+0000 7fc5867fc640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5700664d0 0x7fc570068990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc5780b2000 tx=0x7fc5780aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:18.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.636+0000 7fc587fff640 1 -- 172.21.15.2:0/1360116883 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc580051750 con 0x7fc5900b0c80 2023-11-04T01:47:18.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.824+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc59006d220 con 0x7fc5900b0c80 2023-11-04T01:47:18.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.824+0000 7fc587fff640 1 -- 172.21.15.2:0/1360116883 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fc580054d70 con 0x7fc5900b0c80 2023-11-04T01:47:18.829 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:18.829 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:14.723539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:18.829 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 74 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.824+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5700664d0 msgr2=0x7fc570068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.824+0000 7fc595599640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5700664d0 0x7fc570068990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc5780b2000 tx=0x7fc5780aa070 comp rx=0 tx=0).stop 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b0c80 msgr2=0x7fc59015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b0c80 0x7fc59015a1a0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fc58000c7c0 tx=0x7fc58000cc80 comp rx=0 tx=0).stop 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 shutdown_connections 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc5700664d0 0x7fc570068990 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc5900ce6b0 0x7fc59015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc5900b1060 0x7fc590159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 --2- 172.21.15.2:0/1360116883 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5900b0c80 0x7fc59015a1a0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 >> 172.21.15.2:0/1360116883 conn(0x7fc5900cefa0 msgr2=0x7fc59006fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 shutdown_connections 2023-11-04T01:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:18.828+0000 7fc595599640 1 -- 172.21.15.2:0/1360116883 wait complete. 2023-11-04T01:47:18.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:47:18.967 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":4,"last_created":4,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:46:03.907395+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:46:29.227900+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:46:54.611108+0000","name":"s15","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:18.968 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 4, "last_destroyed": 1, "last_snap": 4, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:46:03.907395+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:46:29.227900+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:46:54.611108+0000" } ] } 2023-11-04T01:47:18.968 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:47:18.968 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6 2023-11-04T01:47:18.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:19.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.072+0000 7f412d44f640 1 Processor -- start 2023-11-04T01:47:19.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.072+0000 7f412d44f640 1 -- start start 2023-11-04T01:47:19.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f412d44f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f412815a1f0 0x7f41280cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f412d44f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f412d44f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280ccee0 con 0x7f41280ca400 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f412d44f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412815a5d0 con 0x7f412815a1f0 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f412d44f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280ca900 con 0x7f41280cdea0 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f4126ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f412815a1f0 0x7f41280cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f41267fc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f4126ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f412815a1f0 0x7f41280cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:60364/0 (socket says 172.21.15.2:60364) 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f41277fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f41280ca400 0x7f41280704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:36522/0 (socket says 172.21.15.2:36522) 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f41267fc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:43448/0 (socket says 172.21.15.2:43448) 2023-11-04T01:47:19.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f4126ffd640 1 -- 172.21.15.2:0/2121952354 learned_addr learned my addr 172.21.15.2:0/2121952354 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f4126ffd640 1 -- 172.21.15.2:0/2121952354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 msgr2=0x7f41280b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f4126ffd640 1 --2- 172.21.15.2:0/2121952354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f4126ffd640 1 -- 172.21.15.2:0/2121952354 >> v1:172.21.15.90:6789/0 conn(0x7f41280ca400 legacy=0x7f41280704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.076+0000 7f4126ffd640 1 -- 172.21.15.2:0/2121952354 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280cabe0 con 0x7f412815a1f0 2023-11-04T01:47:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f4126ffd640 1 --2- 172.21.15.2:0/2121952354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f41280cd370 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f411c009870 tx=0x7f411c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92797e3382b5372d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:19.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f4125ffb640 1 -- 172.21.15.2:0/2121952354 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0aa670 con 0x7f412815a1f0 2023-11-04T01:47:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f4125ffb640 1 -- 172.21.15.2:0/2121952354 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0aa7d0 con 0x7f412815a1f0 2023-11-04T01:47:19.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f4125ffb640 1 -- 172.21.15.2:0/2121952354 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0aab60 con 0x7f412815a1f0 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 -- 172.21.15.2:0/2121952354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 msgr2=0x7f41280cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 --2- 172.21.15.2:0/2121952354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f41280cd370 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f411c009870 tx=0x7f411c01c510 comp rx=0 tx=0).stop 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 -- 172.21.15.2:0/2121952354 shutdown_connections 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 --2- 172.21.15.2:0/2121952354 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 --2- 172.21.15.2:0/2121952354 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f41280cd370 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 -- 172.21.15.2:0/2121952354 >> 172.21.15.2:0/2121952354 conn(0x7f41280cebb0 msgr2=0x7f41280cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 -- 172.21.15.2:0/2121952354 shutdown_connections 2023-11-04T01:47:19.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 -- 172.21.15.2:0/2121952354 wait complete. 2023-11-04T01:47:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 Processor -- start 2023-11-04T01:47:19.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 -- start start 2023-11-04T01:47:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.080+0000 7f412d44f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41280ca400 0x7f41280c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f4128152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4128152740 con 0x7f41280ca400 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c1c30 con 0x7f412815a1f0 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41281530a0 con 0x7f41280cdea0 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41280ca400 0x7f41280c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41280ca400 0x7f41280c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34108/0 (socket says 172.21.15.2:34108) 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 -- 172.21.15.2:0/1750243553 learned_addr learned my addr 172.21.15.2:0/1750243553 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f41277fe640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f4128152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f41267fc640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 -- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 msgr2=0x7f41280c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 -- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 msgr2=0x7f4128152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f4128152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 -- 172.21.15.2:0/1750243553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0094d0 con 0x7f41280ca400 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f41267fc640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f41277fe640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f4128152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f4126ffd640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41280ca400 0x7f41280c5bf0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f411c0ac040 tx=0x7f411c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f410f7fe640 1 -- 172.21.15.2:0/1750243553 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0b3800 con 0x7f41280ca400 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f410f7fe640 1 -- 172.21.15.2:0/1750243553 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c0b3980 con 0x7f41280ca400 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4128150ed0 con 0x7f41280ca400 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f410f7fe640 1 -- 172.21.15.2:0/1750243553 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0b3d30 con 0x7f41280ca400 2023-11-04T01:47:19.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4128152080 con 0x7f41280ca400 2023-11-04T01:47:19.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41280cd890 con 0x7f41280ca400 2023-11-04T01:47:19.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f410f7fe640 1 -- 172.21.15.2:0/1750243553 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f411c0c6440 con 0x7f41280ca400 2023-11-04T01:47:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f410f7fe640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f41140664a0 0x7f4114068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f410f7fe640 1 -- 172.21.15.2:0/1750243553 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f411c11f0d0 con 0x7f41280ca400 2023-11-04T01:47:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.084+0000 7f41267fc640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f41140664a0 0x7f4114068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.088+0000 7f41267fc640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f41140664a0 0x7f4114068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f412806fbd0 tx=0x7f4118008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:19.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.088+0000 7f410f7fe640 1 -- 172.21.15.2:0/1750243553 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f41280cd890 con 0x7f41280ca400 2023-11-04T01:47:19.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41280cd890 con 0x7f41280ca400 2023-11-04T01:47:19.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f410f7fe640 1 -- 172.21.15.2:0/1750243553 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f41280cd890 con 0x7f41280ca400 2023-11-04T01:47:19.280 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:19.280 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":74,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:14.723539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:19.281 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 74 2023-11-04T01:47:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f41140664a0 msgr2=0x7f4114068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f41140664a0 0x7f4114068960 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f412806fbd0 tx=0x7f4118008040 comp rx=0 tx=0).stop 2023-11-04T01:47:19.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41280ca400 msgr2=0x7f41280c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41280ca400 0x7f41280c5bf0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f411c0ac040 tx=0x7f411c01ad50 comp rx=0 tx=0).stop 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 shutdown_connections 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f41140664a0 0x7f4114068960 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f412815a1f0 0x7f4128152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f41280cdea0 0x7f41280c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 --2- 172.21.15.2:0/1750243553 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41280ca400 0x7f41280c5bf0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 >> 172.21.15.2:0/1750243553 conn(0x7f41280cebb0 msgr2=0x7f412806ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.276+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 shutdown_connections 2023-11-04T01:47:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.280+0000 7f412d44f640 1 -- 172.21.15.2:0/1750243553 wait complete. 2023-11-04T01:47:19.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5e792640 1 Processor -- start 2023-11-04T01:47:19.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5e792640 1 -- start start 2023-11-04T01:47:19.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5e792640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 0x7f8b58160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5e792640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b580b5e00 con 0x7f8b580cff20 2023-11-04T01:47:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5e792640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5815d490 con 0x7f8b581610f0 2023-11-04T01:47:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5e792640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580d1520 con 0x7f8b5815d0b0 2023-11-04T01:47:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5cd2f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8b580cff20 0x7f8b580d1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35348/0 (socket says 172.21.15.2:35348) 2023-11-04T01:47:19.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5cd2f640 1 -- 172.21.15.2:0/3421931121 learned_addr learned my addr 172.21.15.2:0/3421931121 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b57fff640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 0x7f8b58160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827761920 0 0) 0x7f8b580b5e00 con 0x7f8b580cff20 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b40003530 con 0x7f8b580cff20 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2619611135 0 0) 0x7f8b40003530 con 0x7f8b580cff20 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 msgr2=0x7f8b58160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 0x7f8b58160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 >> v1:172.21.15.90:6789/0 conn(0x7f8b581610f0 legacy=0x7f8b580cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b580b8930 con 0x7f8b580cff20 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f8b50001a00 con 0x7f8b580cff20 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 >> v1:172.21.15.2:6789/0 conn(0x7f8b580cff20 legacy=0x7f8b580d1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b40004360 0x7f8b40004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 0x7f8b40005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580d1520 con 0x7f8b400039b0 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4000b990 con 0x7f8b40004360 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4000bb50 con 0x7f8b5815d0b0 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b57fff640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b577fe640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b40004360 0x7f8b40004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b57fff640 1 -- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 msgr2=0x7f8b40005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5cd2f640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 0x7f8b40005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b57fff640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 0x7f8b40005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b57fff640 1 -- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b40004360 msgr2=0x7f8b40004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b57fff640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b40004360 0x7f8b40004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b57fff640 1 -- 172.21.15.2:0/3421931121 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40003530 con 0x7f8b400039b0 2023-11-04T01:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b577fe640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b40004360 0x7f8b40004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.420+0000 7f8b5cd2f640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b5815d0b0 0x7f8b40005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:19.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b57fff640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b40003d90 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009ae0 tx=0x7f8b4801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eb0ca09b68752a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:19.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480a5640 con 0x7f8b400039b0 2023-11-04T01:47:19.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b480a57a0 con 0x7f8b400039b0 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b56ffd640 1 -- 172.21.15.2:0/3421931121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480a5b50 con 0x7f8b400039b0 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 -- 172.21.15.2:0/3421931121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 msgr2=0x7f8b40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 --2- 172.21.15.2:0/3421931121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b40003d90 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009ae0 tx=0x7f8b4801ca50 comp rx=0 tx=0).stop 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5cd2f640 1 -- 172.21.15.2:0/3421931121 reap_dead start 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 -- 172.21.15.2:0/3421931121 shutdown_connections 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 -- 172.21.15.2:0/3421931121 >> 172.21.15.2:0/3421931121 conn(0x7f8b5806a890 msgr2=0x7f8b5806aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 -- 172.21.15.2:0/3421931121 shutdown_connections 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 -- 172.21.15.2:0/3421931121 wait complete. 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 Processor -- start 2023-11-04T01:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.424+0000 7f8b5e792640 1 -- start start 2023-11-04T01:47:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b5814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b581f6d00 0x7f8b58155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580cd8e0 0x7f8b580cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b580ce2a0 con 0x7f8b400039b0 2023-11-04T01:47:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b581558b0 con 0x7f8b580cd8e0 2023-11-04T01:47:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58155b90 con 0x7f8b581f6d00 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b5814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b5814de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34126/0 (socket says 172.21.15.2:34126) 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 -- 172.21.15.2:0/1505827535 learned_addr learned my addr 172.21.15.2:0/1505827535 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5cd2f640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580cd8e0 0x7f8b580cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b577fe640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b581f6d00 0x7f8b58155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 -- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b581f6d00 msgr2=0x7f8b58155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b581f6d00 0x7f8b58155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 -- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580cd8e0 msgr2=0x7f8b580cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580cd8e0 0x7f8b580cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 -- 172.21.15.2:0/1505827535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58155e70 con 0x7f8b400039b0 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b577fe640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b581f6d00 0x7f8b58155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b57fff640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b5814de30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b0040 tx=0x7f8b40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b54ff9640 1 -- 172.21.15.2:0/1505827535 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48004220 con 0x7f8b400039b0 2023-11-04T01:47:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b54ff9640 1 -- 172.21.15.2:0/1505827535 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48004380 con 0x7f8b400039b0 2023-11-04T01:47:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b54ff9640 1 -- 172.21.15.2:0/1505827535 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b480ad890 con 0x7f8b400039b0 2023-11-04T01:47:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b58156150 con 0x7f8b400039b0 2023-11-04T01:47:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b581555a0 con 0x7f8b400039b0 2023-11-04T01:47:19.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b580744a0 con 0x7f8b400039b0 2023-11-04T01:47:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b54ff9640 1 -- 172.21.15.2:0/1505827535 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8b480b4040 con 0x7f8b400039b0 2023-11-04T01:47:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b54ff9640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b440664d0 0x7f8b44068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b54ff9640 1 -- 172.21.15.2:0/1505827535 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f8b4811e890 con 0x7f8b400039b0 2023-11-04T01:47:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.428+0000 7f8b577fe640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b440664d0 0x7f8b44068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:19.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.432+0000 7f8b577fe640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b440664d0 0x7f8b44068990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8b581f7240 tx=0x7f8b4c00a300 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:19.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.432+0000 7f8b54ff9640 1 -- 172.21.15.2:0/1505827535 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b480eb9d0 con 0x7f8b400039b0 2023-11-04T01:47:19.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:19.644+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f8b580d0a10 con 0x7f8b400039b0 2023-11-04T01:47:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.600+0000 7f8b54ff9640 1 -- 172.21.15.2:0/1505827535 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7569 v75) v1 ==== 112+0+0 (secure 0 0 0) 0x7f8b480044f0 con 0x7f8b400039b0 2023-11-04T01:47:20.606 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.7569 2023-11-04T01:47:20.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b440664d0 msgr2=0x7f8b44068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b440664d0 0x7f8b44068990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8b581f7240 tx=0x7f8b4c00a300 comp rx=0 tx=0).stop 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 msgr2=0x7f8b5814de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b5814de30 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f8b480b0040 tx=0x7f8b40005800 comp rx=0 tx=0).stop 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 shutdown_connections 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8b440664d0 0x7f8b44068990 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b580cd8e0 0x7f8b580cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8b581f6d00 0x7f8b58155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 --2- 172.21.15.2:0/1505827535 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b400039b0 0x7f8b5814de30 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 >> 172.21.15.2:0/1505827535 conn(0x7f8b5806a890 msgr2=0x7f8b5815d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 shutdown_connections 2023-11-04T01:47:20.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:20.604+0000 7f8b5e792640 1 -- 172.21.15.2:0/1505827535 wait complete. 2023-11-04T01:47:20.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:47:20.770 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:47:20.770 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:47:20.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:20.771 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s16) 2023-11-04T01:47:20.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:47:20.916 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:47:20.916 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:47:20.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925cfa4640 1 Processor -- start 2023-11-04T01:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925cfa4640 1 -- start start 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925cfa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f925815d690 0x7f925806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925cfa4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f925806f8f0 0x7f92580b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925cfa4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92580cd400 con 0x7f925815d2b0 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925cfa4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92580ad450 con 0x7f925806f8f0 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925cfa4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92580cd6e0 con 0x7f925815d690 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f925815d2b0 0x7f92580ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35360/0 (socket says 172.21.15.2:35360) 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f925659c640 1 -- 172.21.15.2:0/3651197505 learned_addr learned my addr 172.21.15.2:0/3651197505 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f9256d9d640 1 --2- 172.21.15.2:0/3651197505 >> v2:172.21.15.2:3300/0 conn(0x7f925806f8f0 0x7f92580b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f924ffff640 1 --2- 172.21.15.2:0/3651197505 >> v2:172.21.15.90:3300/0 conn(0x7f925815d690 0x7f925806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f9255d9b640 1 -- 172.21.15.2:0/3651197505 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198016668 0 0) 0x7f92580cd400 con 0x7f925815d2b0 2023-11-04T01:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f9255d9b640 1 -- 172.21.15.2:0/3651197505 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9244003530 con 0x7f925815d2b0 2023-11-04T01:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f9256d9d640 1 -- 172.21.15.2:0/3651197505 >> v2:172.21.15.90:3300/0 conn(0x7f925815d690 msgr2=0x7f925806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f9256d9d640 1 --2- 172.21.15.2:0/3651197505 >> v2:172.21.15.90:3300/0 conn(0x7f925815d690 0x7f925806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f9256d9d640 1 -- 172.21.15.2:0/3651197505 >> v1:172.21.15.2:6789/0 conn(0x7f925815d2b0 legacy=0x7f92580ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f9256d9d640 1 -- 172.21.15.2:0/3651197505 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580ad070 con 0x7f925806f8f0 2023-11-04T01:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.040+0000 7f924ffff640 1 --2- 172.21.15.2:0/3651197505 >> v2:172.21.15.90:3300/0 conn(0x7f925815d690 0x7f925806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f9256d9d640 1 --2- 172.21.15.2:0/3651197505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925806f8f0 0x7f92580b0630 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f925806b120 tx=0x7f925001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9437f6ef7d5c7b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f9255d9b640 1 -- 172.21.15.2:0/3651197505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500a5850 con 0x7f925806f8f0 2023-11-04T01:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f9255d9b640 1 -- 172.21.15.2:0/3651197505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500a59b0 con 0x7f925806f8f0 2023-11-04T01:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f9255d9b640 1 -- 172.21.15.2:0/3651197505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500a5d40 con 0x7f925806f8f0 2023-11-04T01:47:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- 172.21.15.2:0/3651197505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925806f8f0 msgr2=0x7f92580b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 --2- 172.21.15.2:0/3651197505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925806f8f0 0x7f92580b0630 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f925806b120 tx=0x7f925001c880 comp rx=0 tx=0).stop 2023-11-04T01:47:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- 172.21.15.2:0/3651197505 shutdown_connections 2023-11-04T01:47:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 --2- 172.21.15.2:0/3651197505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925806f8f0 0x7f92580b0630 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 --2- 172.21.15.2:0/3651197505 >> v2:172.21.15.90:3300/0 conn(0x7f925815d690 0x7f925806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- 172.21.15.2:0/3651197505 >> 172.21.15.2:0/3651197505 conn(0x7f92580cebb0 msgr2=0x7f92580cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- 172.21.15.2:0/3651197505 shutdown_connections 2023-11-04T01:47:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- 172.21.15.2:0/3651197505 wait complete. 2023-11-04T01:47:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 Processor -- start 2023-11-04T01:47:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- start start 2023-11-04T01:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925806f8f0 0x7f9258153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925815d2b0 0x7f92581602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925815d690 0x7f92580706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580c2360 con 0x7f925815d690 2023-11-04T01:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580c3180 con 0x7f925815d2b0 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925cfa4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92580c2570 con 0x7f925806f8f0 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f9256d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925815d690 0x7f92580706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f9256d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925815d690 0x7f92580706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:34146/0 (socket says 172.21.15.2:34146) 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f9256d9d640 1 -- 172.21.15.2:0/4072510501 learned_addr learned my addr 172.21.15.2:0/4072510501 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f924ffff640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925815d2b0 0x7f92581602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.044+0000 7f925659c640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925806f8f0 0x7f9258153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f9256d9d640 1 -- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925806f8f0 msgr2=0x7f9258153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f9256d9d640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925806f8f0 0x7f9258153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f9256d9d640 1 -- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925815d2b0 msgr2=0x7f92581602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f9256d9d640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925815d2b0 0x7f92581602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f9256d9d640 1 -- 172.21.15.2:0/4072510501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250009a70 con 0x7f925815d690 2023-11-04T01:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f9256d9d640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925815d690 0x7f92580706d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f925001a4b0 tx=0x7f9250019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f924effd640 1 -- 172.21.15.2:0/4072510501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500b9650 con 0x7f925815d690 2023-11-04T01:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f924effd640 1 -- 172.21.15.2:0/4072510501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500b97b0 con 0x7f925815d690 2023-11-04T01:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92580c2850 con 0x7f925815d690 2023-11-04T01:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f924effd640 1 -- 172.21.15.2:0/4072510501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500b9b60 con 0x7f925815d690 2023-11-04T01:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92580c2e10 con 0x7f925815d690 2023-11-04T01:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92580c3330 con 0x7f925815d690 2023-11-04T01:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f924effd640 1 -- 172.21.15.2:0/4072510501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92500b9cc0 con 0x7f925815d690 2023-11-04T01:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f924effd640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92380664a0 0x7f9238068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f924effd640 1 -- 172.21.15.2:0/4072510501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f925011f6f0 con 0x7f925815d690 2023-11-04T01:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f925659c640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92380664a0 0x7f9238068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.048+0000 7f925659c640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92380664a0 0x7f9238068960 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f92480011f0 tx=0x7f9248009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:21.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.052+0000 7f924effd640 1 -- 172.21.15.2:0/4072510501 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92580c3330 con 0x7f925815d690 2023-11-04T01:47:21.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.240+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92580c3330 con 0x7f925815d690 2023-11-04T01:47:21.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f924effd640 1 -- 172.21.15.2:0/4072510501 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f92580c3330 con 0x7f925815d690 2023-11-04T01:47:21.247 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:21.248 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:19.648043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:21.248 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 75 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92380664a0 msgr2=0x7f9238068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92380664a0 0x7f9238068960 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f92480011f0 tx=0x7f9248009040 comp rx=0 tx=0).stop 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925815d690 msgr2=0x7f92580706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925815d690 0x7f92580706d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f925001a4b0 tx=0x7f9250019620 comp rx=0 tx=0).stop 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 shutdown_connections 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f92380664a0 0x7f9238068960 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f925815d690 0x7f92580706d0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925815d2b0 0x7f92581602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 --2- 172.21.15.2:0/4072510501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f925806f8f0 0x7f9258153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 >> 172.21.15.2:0/4072510501 conn(0x7f92580cebb0 msgr2=0x7f92580aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 shutdown_connections 2023-11-04T01:47:21.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:21.244+0000 7f925cfa4640 1 -- 172.21.15.2:0/4072510501 wait complete. 2023-11-04T01:47:21.267 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:21.458 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f35b7767640 time 2023-11-04T01:47:21.458932+0000 2023-11-04T01:47:21.458 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35c389ffae] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:47:21.460 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f35b7767640 thread_name:MR_Finisher 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:47:21.456+0000 7f35b7767640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f35b7767640 time 2023-11-04T01:47:21.458932+0000 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35c389ffae] 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.461 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.462 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.462 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.462 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.462 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35c31da520] 2023-11-04T01:47:21.462 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:47:21.462 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35c38a0008] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:47:21.456+0000 7f35b7767640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f35b7767640 thread_name:MR_Finisher 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.463 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35c31da520] 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35c38a0008] 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.464 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.465 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.465 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.465 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.465 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:21.465 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.473 INFO:tasks.ceph.mds.c.smithi002.stderr: -643> 2023-11-04T01:47:17.384+0000 7f35baf6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:21.473 INFO:tasks.ceph.mds.c.smithi002.stderr: -641> 2023-11-04T01:47:17.384+0000 7f35baf6e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:21.475 INFO:tasks.ceph.mds.c.smithi002.stderr: -1> 2023-11-04T01:47:21.456+0000 7f35b7767640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f35b7767640 time 2023-11-04T01:47:21.458932+0000 2023-11-04T01:47:21.475 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:21.475 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35c389ffae] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.476 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 0> 2023-11-04T01:47:21.456+0000 7f35b7767640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f35b7767640 thread_name:MR_Finisher 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35c31da520] 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35c38a0008] 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.477 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.478 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.478 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.478 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.478 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:21.478 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.484 INFO:tasks.ceph.mds.c.smithi002.stderr: -643> 2023-11-04T01:47:17.384+0000 7f35baf6e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:21.484 INFO:tasks.ceph.mds.c.smithi002.stderr: -641> 2023-11-04T01:47:17.384+0000 7f35baf6e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:21.486 INFO:tasks.ceph.mds.c.smithi002.stderr: -1> 2023-11-04T01:47:21.456+0000 7f35b7767640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7f35b7767640 time 2023-11-04T01:47:21.458932+0000 2023-11-04T01:47:21.486 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:47:21.486 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.486 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35c389ffae] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: 0> 2023-11-04T01:47:21.456+0000 7f35b7767640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:21.487 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f35b7767640 thread_name:MR_Finisher 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35c31da520] 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35c38a0008] 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f35c38a0162] 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x56043ec8fda5] 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x56043ecc008c] 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x56043ecc04bc] 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x56043ecc05f3] 2023-11-04T01:47:21.488 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7f35c3946305] 2023-11-04T01:47:21.489 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f35c322cb43] 2023-11-04T01:47:21.489 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f35c32bea00] 2023-11-04T01:47:21.489 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:21.489 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:47:21.675 INFO:tasks.ceph.mds.c.smithi002.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:47:22.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:47:25.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:25.056 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:26.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:26.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.396+0000 7f9fa5bba640 1 Processor -- start 2023-11-04T01:47:26.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.396+0000 7f9fa5bba640 1 -- start start 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9fa5bba640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9fa00b4990 0x7f9fa00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9fa5bba640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9fa00d0690 0x7f9fa00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9fa5bba640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0ae0 0x7f9fa00cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9fa5bba640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa00b6070 con 0x7f9fa00d0690 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9fa5bba640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa00b8ed0 con 0x7f9fa00b4990 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9fa5bba640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa00b52b0 con 0x7f9fa00d0ae0 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9fa00d0690 0x7f9fa00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:26.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9fa00d0690 0x7f9fa00cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45096/0 (socket says 172.21.15.2:45096) 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 -- 172.21.15.2:0/1530221261 learned_addr learned my addr 172.21.15.2:0/1530221261 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9ffff640 1 --2- 172.21.15.2:0/1530221261 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0ae0 0x7f9fa00cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9f7fe640 1 --2- 172.21.15.2:0/1530221261 >> v2:172.21.15.90:3300/0 conn(0x7f9fa00b4990 0x7f9fa00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 -- 172.21.15.2:0/1530221261 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0ae0 msgr2=0x7f9fa00cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 --2- 172.21.15.2:0/1530221261 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0ae0 0x7f9fa00cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 -- 172.21.15.2:0/1530221261 >> v2:172.21.15.90:3300/0 conn(0x7f9fa00b4990 msgr2=0x7f9fa00b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 --2- 172.21.15.2:0/1530221261 >> v2:172.21.15.90:3300/0 conn(0x7f9fa00b4990 0x7f9fa00b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 -- 172.21.15.2:0/1530221261 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00d1ce0 con 0x7f9fa00d0690 2023-11-04T01:47:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9effd640 1 --2- 172.21.15.2:0/1530221261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00d0690 0x7f9fa00cd770 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0160ce0 tx=0x7f9f9401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef09484458adb8a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.400+0000 7f9f9e7fc640 1 -- 172.21.15.2:0/1530221261 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940a89b0 con 0x7f9fa00d0690 2023-11-04T01:47:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9f9e7fc640 1 -- 172.21.15.2:0/1530221261 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f940a8b10 con 0x7f9fa00d0690 2023-11-04T01:47:26.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9f9e7fc640 1 -- 172.21.15.2:0/1530221261 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f940a8ea0 con 0x7f9fa00d0690 2023-11-04T01:47:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- 172.21.15.2:0/1530221261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00d0690 msgr2=0x7f9fa00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/1530221261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00d0690 0x7f9fa00cd770 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0160ce0 tx=0x7f9f9401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- 172.21.15.2:0/1530221261 shutdown_connections 2023-11-04T01:47:26.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/1530221261 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0ae0 0x7f9fa00cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/1530221261 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00d0690 0x7f9fa00cd770 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/1530221261 >> v2:172.21.15.90:3300/0 conn(0x7f9fa00b4990 0x7f9fa00b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- 172.21.15.2:0/1530221261 >> 172.21.15.2:0/1530221261 conn(0x7f9fa00cf990 msgr2=0x7f9fa00cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- 172.21.15.2:0/1530221261 shutdown_connections 2023-11-04T01:47:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- 172.21.15.2:0/1530221261 wait complete. 2023-11-04T01:47:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 Processor -- start 2023-11-04T01:47:26.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- start start 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00b4990 0x7f9fa0160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0690 0x7f9fa0150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fa00d0ae0 0x7f9fa015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa015fcc0 con 0x7f9fa00b4990 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa015f0b0 con 0x7f9fa00d0ae0 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9fa5bba640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa015f390 con 0x7f9fa00d0690 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9f9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00b4990 0x7f9fa0160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:26.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9f9f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00b4990 0x7f9fa0160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45104/0 (socket says 172.21.15.2:45104) 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9f9f7fe640 1 -- 172.21.15.2:0/3036462645 learned_addr learned my addr 172.21.15.2:0/3036462645 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9f9ffff640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fa00d0ae0 0x7f9fa015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.404+0000 7f9f9effd640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0690 0x7f9fa0150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9f7fe640 1 -- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0690 msgr2=0x7f9fa0150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9f7fe640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0690 0x7f9fa0150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9f7fe640 1 -- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fa00d0ae0 msgr2=0x7f9fa015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9f7fe640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fa00d0ae0 0x7f9fa015ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9f7fe640 1 -- 172.21.15.2:0/3036462645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940094d0 con 0x7f9fa00b4990 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9ffff640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fa00d0ae0 0x7f9fa015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9effd640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0690 0x7f9fa0150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9f7fe640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00b4990 0x7f9fa0160150 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000d800 tx=0x7f9f9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:26.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f87fff640 1 -- 172.21.15.2:0/3036462645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900096a0 con 0x7f9fa00b4990 2023-11-04T01:47:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f87fff640 1 -- 172.21.15.2:0/3036462645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90009800 con 0x7f9fa00b4990 2023-11-04T01:47:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f87fff640 1 -- 172.21.15.2:0/3036462645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90009990 con 0x7f9fa00b4990 2023-11-04T01:47:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa015f670 con 0x7f9fa00b4990 2023-11-04T01:47:26.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa0150780 con 0x7f9fa00b4990 2023-11-04T01:47:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa00744a0 con 0x7f9fa00b4990 2023-11-04T01:47:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f87fff640 1 -- 172.21.15.2:0/3036462645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9f90009af0 con 0x7f9fa00b4990 2023-11-04T01:47:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f87fff640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f8c0664a0 0x7f9f8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f87fff640 1 -- 172.21.15.2:0/3036462645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f9f90084880 con 0x7f9fa00b4990 2023-11-04T01:47:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9effd640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f8c0664a0 0x7f9f8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:26.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.408+0000 7f9f9effd640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f8c0664a0 0x7f9f8c068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9f940b2000 tx=0x7f9f94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:26.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.412+0000 7f9f87fff640 1 -- 172.21.15.2:0/3036462645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f90051760 con 0x7f9fa00b4990 2023-11-04T01:47:26.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.604+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fa00b7070 con 0x7f9fa00b4990 2023-11-04T01:47:26.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.604+0000 7f9f87fff640 1 -- 172.21.15.2:0/3036462645 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f9f90054d80 con 0x7f9fa00b4990 2023-11-04T01:47:26.609 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:26.609 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:19.648043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:26.609 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 75 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f8c0664a0 msgr2=0x7f9f8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f8c0664a0 0x7f9f8c068960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9f940b2000 tx=0x7f9f94008040 comp rx=0 tx=0).stop 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00b4990 msgr2=0x7f9fa0160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00b4990 0x7f9fa0160150 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000d800 tx=0x7f9f9000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 shutdown_connections 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9f8c0664a0 0x7f9f8c068960 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9fa00d0ae0 0x7f9fa015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9fa00d0690 0x7f9fa0150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 --2- 172.21.15.2:0/3036462645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fa00b4990 0x7f9fa0160150 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 >> 172.21.15.2:0/3036462645 conn(0x7f9fa00cf990 msgr2=0x7f9fa00b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:26.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 shutdown_connections 2023-11-04T01:47:26.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:26.608+0000 7f9fa5bba640 1 -- 172.21.15.2:0/3036462645 wait complete. 2023-11-04T01:47:26.630 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:28.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:47:31.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:31.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77fa9d640 1 Processor -- start 2023-11-04T01:47:31.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77fa9d640 1 -- start start 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77fa9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb7780b4990 0x7fb7780b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77fa9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb7780d0690 0x7fb7780cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77fa9d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780b6070 con 0x7fb7780d0ae0 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77fa9d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780b8ed0 con 0x7fb7780b4990 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77fa9d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780b52b0 con 0x7fb7780d0690 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77e03a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb7780d0ae0 0x7fb7780cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55550/0 (socket says 172.21.15.2:55550) 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77e03a640 1 -- 172.21.15.2:0/2961076253 learned_addr learned my addr 172.21.15.2:0/2961076253 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77d839640 1 --2- 172.21.15.2:0/2961076253 >> v2:172.21.15.2:3300/0 conn(0x7fb7780b4990 0x7fb7780b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77d038640 1 --2- 172.21.15.2:0/2961076253 >> v2:172.21.15.90:3300/0 conn(0x7fb7780d0690 0x7fb7780cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77c837640 1 -- 172.21.15.2:0/2961076253 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816657997 0 0) 0x7fb7780b6070 con 0x7fb7780d0ae0 2023-11-04T01:47:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77d839640 1 -- 172.21.15.2:0/2961076253 >> v2:172.21.15.90:3300/0 conn(0x7fb7780d0690 msgr2=0x7fb7780cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:31.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77d839640 1 --2- 172.21.15.2:0/2961076253 >> v2:172.21.15.90:3300/0 conn(0x7fb7780d0690 0x7fb7780cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77d839640 1 -- 172.21.15.2:0/2961076253 >> v1:172.21.15.2:6789/0 conn(0x7fb7780d0ae0 legacy=0x7fb7780cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77d839640 1 -- 172.21.15.2:0/2961076253 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780d1ce0 con 0x7fb7780b4990 2023-11-04T01:47:31.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.764+0000 7fb77d038640 1 --2- 172.21.15.2:0/2961076253 >> v2:172.21.15.90:3300/0 conn(0x7fb7780d0690 0x7fb7780cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:31.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77d839640 1 --2- 172.21.15.2:0/2961076253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780b4990 0x7fb7780b4d70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fb77808c090 tx=0x7fb77401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3080b7bde379145 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:31.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77c837640 1 -- 172.21.15.2:0/2961076253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740a8950 con 0x7fb7780b4990 2023-11-04T01:47:31.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77c837640 1 -- 172.21.15.2:0/2961076253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7740a8ab0 con 0x7fb7780b4990 2023-11-04T01:47:31.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77c837640 1 -- 172.21.15.2:0/2961076253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740a8e40 con 0x7fb7780b4990 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- 172.21.15.2:0/2961076253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780b4990 msgr2=0x7fb7780b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/2961076253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780b4990 0x7fb7780b4d70 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fb77808c090 tx=0x7fb77401ec50 comp rx=0 tx=0).stop 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- 172.21.15.2:0/2961076253 shutdown_connections 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/2961076253 >> v2:172.21.15.90:3300/0 conn(0x7fb7780d0690 0x7fb7780cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/2961076253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780b4990 0x7fb7780b4d70 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- 172.21.15.2:0/2961076253 >> 172.21.15.2:0/2961076253 conn(0x7fb7780cf990 msgr2=0x7fb7780cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- 172.21.15.2:0/2961076253 shutdown_connections 2023-11-04T01:47:31.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- 172.21.15.2:0/2961076253 wait complete. 2023-11-04T01:47:31.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 Processor -- start 2023-11-04T01:47:31.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- start start 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7780b4990 0x7fb77815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7780d0690 0x7fb7780cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780d0ae0 0x7fb778153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815ee40 con 0x7fb7780d0ae0 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778154920 con 0x7fb7780b4990 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77fa9d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815dee0 con 0x7fb7780d0690 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780d0ae0 0x7fb778153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780d0ae0 0x7fb778153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38410/0 (socket says 172.21.15.2:38410) 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 -- 172.21.15.2:0/3617179812 learned_addr learned my addr 172.21.15.2:0/3617179812 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77d839640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7780b4990 0x7fb77815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77d038640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7780d0690 0x7fb7780cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 -- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7780d0690 msgr2=0x7fb7780cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7780d0690 0x7fb7780cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 -- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7780b4990 msgr2=0x7fb77815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7780b4990 0x7fb77815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77e03a640 1 -- 172.21.15.2:0/3617179812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009420 con 0x7fb7780d0ae0 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.768+0000 7fb77d038640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7780d0690 0x7fb7780cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb77e03a640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780d0ae0 0x7fb778153ab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c750 tx=0x7fb77000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb76e7fc640 1 -- 172.21.15.2:0/3617179812 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000ce60 con 0x7fb7780d0ae0 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb76e7fc640 1 -- 172.21.15.2:0/3617179812 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77000a640 con 0x7fb7780d0ae0 2023-11-04T01:47:31.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77815e1c0 con 0x7fb7780d0ae0 2023-11-04T01:47:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb76e7fc640 1 -- 172.21.15.2:0/3617179812 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77000a9b0 con 0x7fb7780d0ae0 2023-11-04T01:47:31.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77815e780 con 0x7fb7780d0ae0 2023-11-04T01:47:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7780744a0 con 0x7fb7780d0ae0 2023-11-04T01:47:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb76e7fc640 1 -- 172.21.15.2:0/3617179812 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb77000ab10 con 0x7fb7780d0ae0 2023-11-04T01:47:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb76e7fc640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb75c0664a0 0x7fb75c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb76e7fc640 1 -- 172.21.15.2:0/3617179812 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7fb770083cb0 con 0x7fb7780d0ae0 2023-11-04T01:47:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb77d839640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb75c0664a0 0x7fb75c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:31.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.772+0000 7fb77d839640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb75c0664a0 0x7fb75c068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b2000 tx=0x7fb774008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:31.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.776+0000 7fb76e7fc640 1 -- 172.21.15.2:0/3617179812 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb770050b90 con 0x7fb7780d0ae0 2023-11-04T01:47:31.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb77815c9b0 con 0x7fb7780d0ae0 2023-11-04T01:47:31.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb76e7fc640 1 -- 172.21.15.2:0/3617179812 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fb770018070 con 0x7fb7780d0ae0 2023-11-04T01:47:31.972 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:31.972 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:19.648043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:31.973 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 75 2023-11-04T01:47:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb75c0664a0 msgr2=0x7fb75c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb75c0664a0 0x7fb75c068960 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b2000 tx=0x7fb774008040 comp rx=0 tx=0).stop 2023-11-04T01:47:31.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780d0ae0 msgr2=0x7fb778153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780d0ae0 0x7fb778153ab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fb77000c750 tx=0x7fb77000cc10 comp rx=0 tx=0).stop 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 shutdown_connections 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb75c0664a0 0x7fb75c068960 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb7780d0ae0 0x7fb778153ab0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb7780d0690 0x7fb7780cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 --2- 172.21.15.2:0/3617179812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7780b4990 0x7fb77815fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 >> 172.21.15.2:0/3617179812 conn(0x7fb7780cf990 msgr2=0x7fb7780b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 shutdown_connections 2023-11-04T01:47:31.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:31.968+0000 7fb77fa9d640 1 -- 172.21.15.2:0/3617179812 wait complete. 2023-11-04T01:47:31.991 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:35.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:47:36.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.120+0000 7f2612e42640 1 Processor -- start 2023-11-04T01:47:37.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.120+0000 7f2612e42640 1 -- start start 2023-11-04T01:47:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2612e42640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f260c15a1f0 0x7f260c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2612e42640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 0x7f260c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2612e42640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0ccee0 con 0x7f260c0ca400 2023-11-04T01:47:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2612e42640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c15a5d0 con 0x7f260c15a1f0 2023-11-04T01:47:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2612e42640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0ca900 con 0x7f260c0cdea0 2023-11-04T01:47:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f26113df640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f260c0ca400 0x7f260c0704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55556/0 (socket says 172.21.15.2:55556) 2023-11-04T01:47:37.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f26113df640 1 -- 172.21.15.2:0/1279491338 learned_addr learned my addr 172.21.15.2:0/1279491338 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2610bde640 1 --2- 172.21.15.2:0/1279491338 >> v2:172.21.15.90:3300/0 conn(0x7f260c15a1f0 0x7f260c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260bfff640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 0x7f260c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555480432 0 0) 0x7f260c0ccee0 con 0x7f260c0ca400 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f8003530 con 0x7f260c0ca400 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410219975 0 0) 0x7f25f8003530 con 0x7f260c0ca400 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 msgr2=0x7f260c0b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 0x7f260c0b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 >> v2:172.21.15.90:3300/0 conn(0x7f260c15a1f0 msgr2=0x7f260c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 --2- 172.21.15.2:0/1279491338 >> v2:172.21.15.90:3300/0 conn(0x7f260c15a1f0 0x7f260c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0cabe0 con 0x7f260c0ca400 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f25fc001a00 con 0x7f260c0ca400 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 >> v1:172.21.15.2:6789/0 conn(0x7f260c0ca400 legacy=0x7f260c0704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25f8003980 0x7f25f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f80047d0 0x7f25f8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 0x7f25f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c15a5d0 con 0x7f25f8003980 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0ca900 con 0x7f25f80047d0 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f800b990 con 0x7f260c0cdea0 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2610bde640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25f8003980 0x7f25f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f260bfff640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f80047d0 0x7f25f8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f26113df640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 0x7f25f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2610bde640 1 -- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 msgr2=0x7f25f8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2610bde640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c0cdea0 0x7f25f8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2610bde640 1 -- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f80047d0 msgr2=0x7f25f8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2610bde640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f80047d0 0x7f25f8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.124+0000 7f2610bde640 1 -- 172.21.15.2:0/1279491338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f8003530 con 0x7f25f8003980 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2610bde640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25f8003980 0x7f25f8003da0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f2604009ae0 tx=0x7f260401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149b397ce349ebec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040a5550 con 0x7f25f8003980 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26040a56b0 con 0x7f25f8003980 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f260b7fe640 1 -- 172.21.15.2:0/1279491338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040a5a60 con 0x7f25f8003980 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- 172.21.15.2:0/1279491338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25f8003980 msgr2=0x7f25f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 --2- 172.21.15.2:0/1279491338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25f8003980 0x7f25f8003da0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f2604009ae0 tx=0x7f260401ca00 comp rx=0 tx=0).stop 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f26113df640 1 -- 172.21.15.2:0/1279491338 reap_dead start 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- 172.21.15.2:0/1279491338 shutdown_connections 2023-11-04T01:47:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- 172.21.15.2:0/1279491338 >> 172.21.15.2:0/1279491338 conn(0x7f260c0cebb0 msgr2=0x7f260c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- 172.21.15.2:0/1279491338 shutdown_connections 2023-11-04T01:47:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- 172.21.15.2:0/1279491338 wait complete. 2023-11-04T01:47:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 Processor -- start 2023-11-04T01:47:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- start start 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0c52e0 0x7f260c15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c1513b0 0x7f260c15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c15c1e0 0x7f260c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c1540e0 con 0x7f260c1513b0 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c1543c0 con 0x7f260c0c52e0 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f2612e42640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c14ea10 con 0x7f260c15c1e0 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f260bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c1513b0 0x7f260c15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f260bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c1513b0 0x7f260c15bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38430/0 (socket says 172.21.15.2:38430) 2023-11-04T01:47:37.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.128+0000 7f260bfff640 1 -- 172.21.15.2:0/395208969 learned_addr learned my addr 172.21.15.2:0/395208969 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f26113df640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c15c1e0 0x7f260c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f2610bde640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0c52e0 0x7f260c15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f260bfff640 1 -- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c15c1e0 msgr2=0x7f260c152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f260bfff640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c15c1e0 0x7f260c152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f260bfff640 1 -- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0c52e0 msgr2=0x7f260c15b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f260bfff640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0c52e0 0x7f260c15b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f260bfff640 1 -- 172.21.15.2:0/395208969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c14ecf0 con 0x7f260c1513b0 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f2610bde640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0c52e0 0x7f260c15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f260bfff640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c1513b0 0x7f260c15bca0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f25f40115e0 tx=0x7f25f4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f26097fa640 1 -- 172.21.15.2:0/395208969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f400f8f0 con 0x7f260c1513b0 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f26097fa640 1 -- 172.21.15.2:0/395208969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f400fa50 con 0x7f260c1513b0 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c1546a0 con 0x7f260c1513b0 2023-11-04T01:47:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f26097fa640 1 -- 172.21.15.2:0/395208969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f400fdc0 con 0x7f260c1513b0 2023-11-04T01:47:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c14e600 con 0x7f260c1513b0 2023-11-04T01:47:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c0744a0 con 0x7f260c1513b0 2023-11-04T01:47:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f26097fa640 1 -- 172.21.15.2:0/395208969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25f4015460 con 0x7f260c1513b0 2023-11-04T01:47:37.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f26097fa640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25ec0664d0 0x7f25ec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f26097fa640 1 -- 172.21.15.2:0/395208969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f25f4084c00 con 0x7f260c1513b0 2023-11-04T01:47:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f2610bde640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25ec0664d0 0x7f25ec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.132+0000 7f2610bde640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25ec0664d0 0x7f25ec068990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f26040af000 tx=0x7f2604008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.136+0000 7f26097fa640 1 -- 172.21.15.2:0/395208969 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25f408b080 con 0x7f260c1513b0 2023-11-04T01:47:37.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.324+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f260c0b4100 con 0x7f260c1513b0 2023-11-04T01:47:37.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.324+0000 7f26097fa640 1 -- 172.21.15.2:0/395208969 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4970 (secure 0 0 0) 0x7f25f4051b70 con 0x7f260c1513b0 2023-11-04T01:47:37.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:34.605295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7569,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7569":{"gid":7569,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":11,"addr":"172.21.15.2:6833/2515781456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2515781456},{"type":"v1","addr":"172.21.15.2:6833","nonce":2515781456}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:47:34.605295+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:37.330 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 76 2023-11-04T01:47:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25ec0664d0 msgr2=0x7f25ec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25ec0664d0 0x7f25ec068990 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f26040af000 tx=0x7f2604008040 comp rx=0 tx=0).stop 2023-11-04T01:47:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c1513b0 msgr2=0x7f260c15bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c1513b0 0x7f260c15bca0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f25f40115e0 tx=0x7f25f4011aa0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 shutdown_connections 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25ec0664d0 0x7f25ec068990 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f260c15c1e0 0x7f260c152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260c1513b0 0x7f260c15bca0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 --2- 172.21.15.2:0/395208969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f260c0c52e0 0x7f260c15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 >> 172.21.15.2:0/395208969 conn(0x7f260c0cebb0 msgr2=0x7f260c160680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 shutdown_connections 2023-11-04T01:47:37.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.328+0000 7f2612e42640 1 -- 172.21.15.2:0/395208969 wait complete. 2023-11-04T01:47:37.347 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:47:37.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:47:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:47:37.359 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:47:37.360 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:47:37.421 INFO:teuthology.orchestra.run.smithi002.stdout:1699062441.56044.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:47:37.422 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062441.56044.core'] 2023-11-04T01:47:37.422 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062441.56044.core, deleting it 2023-11-04T01:47:37.422 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062441.56044.core 2023-11-04T01:47:37.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:47:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4af50f9640 1 Processor -- start 2023-11-04T01:47:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4af50f9640 1 -- start start 2023-11-04T01:47:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4af50f9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af015afb0 0x7f4af00b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4af50f9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af00cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4af50f9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00ce040 con 0x7f4af00cb400 2023-11-04T01:47:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4af50f9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af015b390 con 0x7f4af015afb0 2023-11-04T01:47:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4af50f9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00cf8a0 con 0x7f4af00cd6d0 2023-11-04T01:47:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aeed9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af015afb0 0x7f4af00b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aeed9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4af015afb0 0x7f4af00b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38442/0 (socket says 172.21.15.2:38442) 2023-11-04T01:47:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aeed9d640 1 -- 172.21.15.2:0/3405495429 learned_addr learned my addr 172.21.15.2:0/3405495429 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aef59e640 1 --2- 172.21.15.2:0/3405495429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af00cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aeed9d640 1 -- 172.21.15.2:0/3405495429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 msgr2=0x7f4af00cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aeed9d640 1 --2- 172.21.15.2:0/3405495429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af00cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aeed9d640 1 -- 172.21.15.2:0/3405495429 >> v1:172.21.15.90:6789/0 conn(0x7f4af00cb400 legacy=0x7f4af00cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.644+0000 7f4aeed9d640 1 -- 172.21.15.2:0/3405495429 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00d0a60 con 0x7f4af015afb0 2023-11-04T01:47:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4aeed9d640 1 --2- 172.21.15.2:0/3405495429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af00b3050 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4af0066da0 tx=0x7f4ad801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18865d105876b314 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4aedd9b640 1 -- 172.21.15.2:0/3405495429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80ac640 con 0x7f4af015afb0 2023-11-04T01:47:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4aedd9b640 1 -- 172.21.15.2:0/3405495429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad80ac7a0 con 0x7f4af015afb0 2023-11-04T01:47:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4aedd9b640 1 -- 172.21.15.2:0/3405495429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80acb30 con 0x7f4af015afb0 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 -- 172.21.15.2:0/3405495429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 msgr2=0x7f4af00b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 --2- 172.21.15.2:0/3405495429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af00b3050 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f4af0066da0 tx=0x7f4ad801c420 comp rx=0 tx=0).stop 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 -- 172.21.15.2:0/3405495429 shutdown_connections 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 --2- 172.21.15.2:0/3405495429 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af00cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 --2- 172.21.15.2:0/3405495429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af00b3050 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 -- 172.21.15.2:0/3405495429 >> 172.21.15.2:0/3405495429 conn(0x7f4af0065dc0 msgr2=0x7f4af00661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 -- 172.21.15.2:0/3405495429 shutdown_connections 2023-11-04T01:47:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 -- 172.21.15.2:0/3405495429 wait complete. 2023-11-04T01:47:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 Processor -- start 2023-11-04T01:47:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.648+0000 7f4af50f9640 1 -- start start 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4af00cb400 0x7f4af01528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af0152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af0154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af015cb10 con 0x7f4af015afb0 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0152de0 con 0x7f4af00cb400 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01538b0 con 0x7f4af00cd6d0 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af0154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af0154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38448/0 (socket says 172.21.15.2:38448) 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 -- 172.21.15.2:0/2807200685 learned_addr learned my addr 172.21.15.2:0/2807200685 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aee59c640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af0152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aeed9d640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4af00cb400 0x7f4af01528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 -- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 msgr2=0x7f4af0152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af0152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 -- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4af00cb400 msgr2=0x7f4af01528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4af00cb400 0x7f4af01528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 -- 172.21.15.2:0/2807200685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80094d0 con 0x7f4af015afb0 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aef59e640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af0154a80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007e40 tx=0x7f4ae800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4ae77fe640 1 -- 172.21.15.2:0/2807200685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8014620 con 0x7f4af015afb0 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4ae77fe640 1 -- 172.21.15.2:0/2807200685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae800ee90 con 0x7f4af015afb0 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af0153b90 con 0x7f4af015afb0 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4ae77fe640 1 -- 172.21.15.2:0/2807200685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80149e0 con 0x7f4af015afb0 2023-11-04T01:47:37.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af0154150 con 0x7f4af015afb0 2023-11-04T01:47:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af015cc50 con 0x7f4af015afb0 2023-11-04T01:47:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4ae77fe640 1 -- 172.21.15.2:0/2807200685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ae8014b40 con 0x7f4af015afb0 2023-11-04T01:47:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4ae77fe640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ad00664a0 0x7f4ad0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4ae77fe640 1 -- 172.21.15.2:0/2807200685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7146+0+0 (secure 0 0 0) 0x7f4ae8084d30 con 0x7f4af015afb0 2023-11-04T01:47:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.652+0000 7f4aeed9d640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ad00664a0 0x7f4ad0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.656+0000 7f4aeed9d640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ad00664a0 0x7f4ad0068960 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80ae000 tx=0x7f4ad8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:37.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.656+0000 7f4ae77fe640 1 -- 172.21.15.2:0/2807200685 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4af015cc50 con 0x7f4af015afb0 2023-11-04T01:47:37.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.872+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f4af015cc50 con 0x7f4af015afb0 2023-11-04T01:47:37.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.876+0000 7f4ae77fe640 1 -- 172.21.15.2:0/2807200685 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7569 v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4af015cc50 con 0x7f4af015afb0 2023-11-04T01:47:37.882 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 7569 2023-11-04T01:47:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ad00664a0 msgr2=0x7f4ad0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ad00664a0 0x7f4ad0068960 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80ae000 tx=0x7f4ad8008040 comp rx=0 tx=0).stop 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 msgr2=0x7f4af0154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af0154a80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8007e40 tx=0x7f4ae800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 shutdown_connections 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ad00664a0 0x7f4ad0068960 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4af015afb0 0x7f4af0154a80 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4af00cd6d0 0x7f4af0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 --2- 172.21.15.2:0/2807200685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4af00cb400 0x7f4af01528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 >> 172.21.15.2:0/2807200685 conn(0x7f4af0065dc0 msgr2=0x7f4af00b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 shutdown_connections 2023-11-04T01:47:37.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:37.880+0000 7f4af50f9640 1 -- 172.21.15.2:0/2807200685 wait complete. 2023-11-04T01:47:37.908 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:47:37.908 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:47:37.908 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:47:37.908 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:47:37.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:47:37.908 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:47:37.908 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:47:37.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:47:37.910 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:47:37.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:37.979 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:47:38.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461b080640 1 Processor -- start 2023-11-04T01:47:38.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461b080640 1 -- start start 2023-11-04T01:47:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461b080640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f46140d0ae0 0x7f46140b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461b080640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46140b6070 con 0x7f46140b4990 2023-11-04T01:47:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461b080640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46140b8ed0 con 0x7f46140d0690 2023-11-04T01:47:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461b080640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46140d1ce0 con 0x7f46140d0ae0 2023-11-04T01:47:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f46140b4990 0x7f46140b4d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55578/0 (socket says 172.21.15.2:55578) 2023-11-04T01:47:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 -- 172.21.15.2:0/3748373731 learned_addr learned my addr 172.21.15.2:0/3748373731 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:38.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461961d640 1 --2- 172.21.15.2:0/3748373731 >> v2:172.21.15.90:3300/0 conn(0x7f46140d0ae0 0x7f46140b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343639686 0 0) 0x7f46140b6070 con 0x7f46140b4990 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45fc003530 con 0x7f46140b4990 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2881041002 0 0) 0x7f45fc003530 con 0x7f46140b4990 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 >> v2:172.21.15.90:3300/0 conn(0x7f46140d0ae0 msgr2=0x7f46140b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 --2- 172.21.15.2:0/3748373731 >> v2:172.21.15.90:3300/0 conn(0x7f46140d0ae0 0x7f46140b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 >> v1:172.21.15.90:6789/0 conn(0x7f46140d0690 legacy=0x7f46140b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46140d1fc0 con 0x7f46140b4990 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f4604001680 con 0x7f46140b4990 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 >> v1:172.21.15.2:6789/0 conn(0x7f46140b4990 legacy=0x7f46140b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45fc003980 0x7f45fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45fc0047d0 0x7f45fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc005190 0x7f45fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46140d1ce0 con 0x7f45fc003980 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc00c040 con 0x7f45fc0047d0 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc00c200 con 0x7f45fc005190 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45fc003980 0x7f45fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4613fff640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45fc0047d0 0x7f45fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 -- 172.21.15.2:0/3748373731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc005190 msgr2=0x7f45fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc005190 0x7f45fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 -- 172.21.15.2:0/3748373731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45fc0047d0 msgr2=0x7f45fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45fc0047d0 0x7f45fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f4618e1c640 1 -- 172.21.15.2:0/3748373731 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc003530 con 0x7f45fc003980 2023-11-04T01:47:38.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.020+0000 7f461961d640 1 -- 172.21.15.2:0/3748373731 reap_dead start 2023-11-04T01:47:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f4618e1c640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45fc003980 0x7f45fc003da0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f460400c240 tx=0x7f460401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af2983c6e096178 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604005ae0 con 0x7f45fc003980 2023-11-04T01:47:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46040ab070 con 0x7f45fc003980 2023-11-04T01:47:38.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f46137fe640 1 -- 172.21.15.2:0/3748373731 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4604007070 con 0x7f45fc003980 2023-11-04T01:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- 172.21.15.2:0/3748373731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45fc003980 msgr2=0x7f45fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45fc003980 0x7f45fc003da0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f460400c240 tx=0x7f460401f370 comp rx=0 tx=0).stop 2023-11-04T01:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- 172.21.15.2:0/3748373731 shutdown_connections 2023-11-04T01:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 --2- 172.21.15.2:0/3748373731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45fc003980 0x7f45fc003da0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- 172.21.15.2:0/3748373731 >> 172.21.15.2:0/3748373731 conn(0x7f46140cf990 msgr2=0x7f46140cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- 172.21.15.2:0/3748373731 shutdown_connections 2023-11-04T01:47:38.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- 172.21.15.2:0/3748373731 wait complete. 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 Processor -- start 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- start start 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc003980 0x7f4614155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461415fb80 0x7f46141f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46141f5e10 0x7f46141530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461415f760 con 0x7f461415fb80 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4614156120 con 0x7f46141f5e10 2023-11-04T01:47:38.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f461b080640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461415eae0 con 0x7f45fc003980 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f4613fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461415fb80 0x7f46141f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f4613fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461415fb80 0x7f46141f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38476/0 (socket says 172.21.15.2:38476) 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.024+0000 7f4613fff640 1 -- 172.21.15.2:0/1449146091 learned_addr learned my addr 172.21.15.2:0/1449146091 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4618e1c640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc003980 0x7f4614155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f461961d640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46141f5e10 0x7f46141530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4613fff640 1 -- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc003980 msgr2=0x7f4614155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4613fff640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc003980 0x7f4614155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4613fff640 1 -- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46141f5e10 msgr2=0x7f46141530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4613fff640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46141f5e10 0x7f46141530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4613fff640 1 -- 172.21.15.2:0/1449146091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461415edc0 con 0x7f461415fb80 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4618e1c640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc003980 0x7f4614155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f461961d640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46141f5e10 0x7f46141530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:38.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4613fff640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461415fb80 0x7f46141f58d0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f460800e410 tx=0x7f460800e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f46117fa640 1 -- 172.21.15.2:0/1449146091 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080052e0 con 0x7f461415fb80 2023-11-04T01:47:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f46117fa640 1 -- 172.21.15.2:0/1449146091 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4608005440 con 0x7f461415fb80 2023-11-04T01:47:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461415f0a0 con 0x7f461415fb80 2023-11-04T01:47:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f46117fa640 1 -- 172.21.15.2:0/1449146091 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608003820 con 0x7f461415fb80 2023-11-04T01:47:38.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461415e520 con 0x7f461415fb80 2023-11-04T01:47:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46140744a0 con 0x7f461415fb80 2023-11-04T01:47:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f46117fa640 1 -- 172.21.15.2:0/1449146091 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4608003980 con 0x7f461415fb80 2023-11-04T01:47:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f46117fa640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46000664d0 0x7f4600068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f46117fa640 1 -- 172.21.15.2:0/1449146091 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f4608084390 con 0x7f461415fb80 2023-11-04T01:47:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4618e1c640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46000664d0 0x7f4600068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:38.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.028+0000 7f4618e1c640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46000664d0 0x7f4600068990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f46040af000 tx=0x7f46040aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:38.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.032+0000 7f46117fa640 1 -- 172.21.15.2:0/1449146091 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4608051360 con 0x7f461415fb80 2023-11-04T01:47:38.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.224+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46141563e0 con 0x7f461415fb80 2023-11-04T01:47:38.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.224+0000 7f46117fa640 1 -- 172.21.15.2:0/1449146091 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4133 (secure 0 0 0) 0x7f4608023090 con 0x7f461415fb80 2023-11-04T01:47:38.228 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:38.228 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:37.887330+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:38.228 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 78 2023-11-04T01:47:38.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46000664d0 msgr2=0x7f4600068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:38.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46000664d0 0x7f4600068990 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f46040af000 tx=0x7f46040aa000 comp rx=0 tx=0).stop 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461415fb80 msgr2=0x7f46141f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461415fb80 0x7f46141f58d0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f460800e410 tx=0x7f460800e8d0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 shutdown_connections 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f46000664d0 0x7f4600068990 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f46141f5e10 0x7f46141530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461415fb80 0x7f46141f58d0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 --2- 172.21.15.2:0/1449146091 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45fc003980 0x7f4614155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 >> 172.21.15.2:0/1449146091 conn(0x7f46140cf990 msgr2=0x7f46140d37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 shutdown_connections 2023-11-04T01:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:38.228+0000 7f461b080640 1 -- 172.21.15.2:0/1449146091 wait complete. 2023-11-04T01:47:38.247 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:47:42.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:47:42.709 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:47:42.706+0000 7fcd1e95e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:42.709 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:47:42.706+0000 7fcd1e95e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:43.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a8714640 1 Processor -- start 2023-11-04T01:47:43.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a8714640 1 -- start start 2023-11-04T01:47:43.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a8714640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f19a015a1f0 0x7f19a00cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a8714640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 0x7f19a00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a8714640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00ccee0 con 0x7f19a00ca400 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a8714640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a015a5d0 con 0x7f19a015a1f0 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a8714640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00ca900 con 0x7f19a00cdea0 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f19a00ca400 0x7f19a00704e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38832/0 (socket says 172.21.15.2:38832) 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 -- 172.21.15.2:0/1817707563 learned_addr learned my addr 172.21.15.2:0/1817707563 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a5caf640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 0x7f19a00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a64b0640 1 --2- 172.21.15.2:0/1817707563 >> v2:172.21.15.90:3300/0 conn(0x7f19a015a1f0 0x7f19a00cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374293879 0 0) 0x7f19a00ccee0 con 0x7f19a00ca400 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f198c003530 con 0x7f19a00ca400 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 566033983 0 0) 0x7f198c003530 con 0x7f19a00ca400 2023-11-04T01:47:43.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 msgr2=0x7f19a00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 0x7f19a00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 >> v2:172.21.15.90:3300/0 conn(0x7f19a015a1f0 msgr2=0x7f19a00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 --2- 172.21.15.2:0/1817707563 >> v2:172.21.15.90:3300/0 conn(0x7f19a015a1f0 0x7f19a00cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00cabe0 con 0x7f19a00ca400 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f199c001680 con 0x7f19a00ca400 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 >> v1:172.21.15.2:6789/0 conn(0x7f19a00ca400 legacy=0x7f19a00704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 0x7f198c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f198c003f00 0x7f198c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f198c004d10 0x7f198c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a015a5d0 con 0x7f198c004d10 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00ca900 con 0x7f198c003f00 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c00b990 con 0x7f19a00cdea0 2023-11-04T01:47:43.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f198c004d10 0x7f198c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a64b0640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 0x7f198c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a5caf640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f198c003f00 0x7f198c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 -- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 msgr2=0x7f198c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f19a00cdea0 0x7f198c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 -- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f198c003f00 msgr2=0x7f198c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f198c003f00 0x7f198c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a6cb1640 1 -- 172.21.15.2:0/1817707563 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c003530 con 0x7f198c004d10 2023-11-04T01:47:43.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.380+0000 7f19a5caf640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f198c003f00 0x7f198c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a6cb1640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f198c004d10 0x7f198c005190 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c290 tx=0x7f199c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1f0d0570a70451 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0a5950 con 0x7f198c004d10 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0a5ab0 con 0x7f198c004d10 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a54ae640 1 -- 172.21.15.2:0/1817707563 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0a5e60 con 0x7f198c004d10 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 -- 172.21.15.2:0/1817707563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f198c004d10 msgr2=0x7f198c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 --2- 172.21.15.2:0/1817707563 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f198c004d10 0x7f198c005190 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c290 tx=0x7f199c01cc80 comp rx=0 tx=0).stop 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a6cb1640 1 -- 172.21.15.2:0/1817707563 reap_dead start 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 -- 172.21.15.2:0/1817707563 shutdown_connections 2023-11-04T01:47:43.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 -- 172.21.15.2:0/1817707563 >> 172.21.15.2:0/1817707563 conn(0x7f19a00cebb0 msgr2=0x7f19a00cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 -- 172.21.15.2:0/1817707563 shutdown_connections 2023-11-04T01:47:43.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 -- 172.21.15.2:0/1817707563 wait complete. 2023-11-04T01:47:43.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 Processor -- start 2023-11-04T01:47:43.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.384+0000 7f19a8714640 1 -- start start 2023-11-04T01:47:43.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f198c004d10 0x7f19a00c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a015a710 0x7f19a006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19a006c220 0x7f19a0151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a006c6a0 con 0x7f19a015a710 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c3690 con 0x7f19a006c220 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c3950 con 0x7f198c004d10 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a015a710 0x7f19a006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a015a710 0x7f19a006bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55868/0 (socket says 172.21.15.2:55868) 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 -- 172.21.15.2:0/613649925 learned_addr learned my addr 172.21.15.2:0/613649925 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a64b0640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f198c004d10 0x7f19a00c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a6cb1640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19a006c220 0x7f19a0151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 -- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f198c004d10 msgr2=0x7f19a00c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f198c004d10 0x7f19a00c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 -- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19a006c220 msgr2=0x7f19a0151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19a006c220 0x7f19a0151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 -- 172.21.15.2:0/613649925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00c3c30 con 0x7f19a015a710 2023-11-04T01:47:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a64b0640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f198c004d10 0x7f19a00c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a5caf640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a015a710 0x7f19a006bce0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f19900115f0 tx=0x7f1990011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f1996ffd640 1 -- 172.21.15.2:0/613649925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990004220 con 0x7f19a015a710 2023-11-04T01:47:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f1996ffd640 1 -- 172.21.15.2:0/613649925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990004380 con 0x7f19a015a710 2023-11-04T01:47:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a00c3f10 con 0x7f19a015a710 2023-11-04T01:47:43.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f1996ffd640 1 -- 172.21.15.2:0/613649925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000f8f0 con 0x7f19a015a710 2023-11-04T01:47:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a00c6e10 con 0x7f19a015a710 2023-11-04T01:47:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a00744a0 con 0x7f19a015a710 2023-11-04T01:47:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f1996ffd640 1 -- 172.21.15.2:0/613649925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f199000fa50 con 0x7f19a015a710 2023-11-04T01:47:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f1996ffd640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19840664a0 0x7f1984068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f1996ffd640 1 -- 172.21.15.2:0/613649925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f19900846c0 con 0x7f19a015a710 2023-11-04T01:47:43.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.388+0000 7f19a64b0640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19840664a0 0x7f1984068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.392+0000 7f19a64b0640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19840664a0 0x7f1984068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f19980074d0 tx=0x7f199800b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.396+0000 7f1996ffd640 1 -- 172.21.15.2:0/613649925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1990051550 con 0x7f19a015a710 2023-11-04T01:47:43.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.584+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19a006cfb0 con 0x7f19a015a710 2023-11-04T01:47:43.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.584+0000 7f1996ffd640 1 -- 172.21.15.2:0/613649925 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f1990054b70 con 0x7f19a015a710 2023-11-04T01:47:43.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:40.926106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:43.589 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 82 2023-11-04T01:47:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19840664a0 msgr2=0x7f1984068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19840664a0 0x7f1984068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f19980074d0 tx=0x7f199800b040 comp rx=0 tx=0).stop 2023-11-04T01:47:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a015a710 msgr2=0x7f19a006bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a015a710 0x7f19a006bce0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f19900115f0 tx=0x7f1990011ab0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 shutdown_connections 2023-11-04T01:47:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f19840664a0 0x7f1984068960 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19a006c220 0x7f19a0151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19a015a710 0x7f19a006bce0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 --2- 172.21.15.2:0/613649925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f198c004d10 0x7f19a00c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 >> 172.21.15.2:0/613649925 conn(0x7f19a00cebb0 msgr2=0x7f19a00b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 shutdown_connections 2023-11-04T01:47:43.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.588+0000 7f19a8714640 1 -- 172.21.15.2:0/613649925 wait complete. 2023-11-04T01:47:43.609 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:47:43.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.732+0000 7f5ee15cf640 1 Processor -- start 2023-11-04T01:47:43.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.732+0000 7f5ee15cf640 1 -- start start 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ee15cf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 0x7f5edc0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ee15cf640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc070d90 con 0x7f5edc0b1700 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ee15cf640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06d4f0 con 0x7f5edc06cd30 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ee15cf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc06dd90 con 0x7f5edc159e70 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5edb7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5edc0b1700 0x7f5edc071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38834/0 (socket says 172.21.15.2:38834) 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5edb7fe640 1 -- 172.21.15.2:0/1102464609 learned_addr learned my addr 172.21.15.2:0/1102464609 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5edaffd640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 0x7f5edc0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989835003 0 0) 0x7f5edc070d90 con 0x7f5edc0b1700 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec4003530 con 0x7f5edc0b1700 2023-11-04T01:47:43.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250893184 0 0) 0x7f5ec4003530 con 0x7f5edc0b1700 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 msgr2=0x7f5edc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 0x7f5edc0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 >> v1:172.21.15.90:6789/0 conn(0x7f5edc06cd30 legacy=0x7f5edc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc06d7d0 con 0x7f5edc0b1700 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f5ed4001680 con 0x7f5edc0b1700 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 >> v1:172.21.15.2:6789/0 conn(0x7f5edc0b1700 legacy=0x7f5edc071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 0x7f5ec40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5ec40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec4004d10 0x7f5ec4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc06dd90 con 0x7f5ec4003f30 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec400ba70 con 0x7f5ec4004d10 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec400de40 con 0x7f5edc159e70 2023-11-04T01:47:43.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5eda7fc640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5ec40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5edaffd640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 0x7f5ec40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5edb7fe640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec4004d10 0x7f5ec4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5eda7fc640 1 -- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 msgr2=0x7f5ec40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5eda7fc640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 0x7f5ec40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5eda7fc640 1 -- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec4004d10 msgr2=0x7f5ec4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5eda7fc640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ec4004d10 0x7f5ec4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5eda7fc640 1 -- 172.21.15.2:0/1102464609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4003530 con 0x7f5ec4003f30 2023-11-04T01:47:43.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.736+0000 7f5edaffd640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc159e70 0x7f5ec40039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5eda7fc640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5ec40047d0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001780 tx=0x7f5ed001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ca1474c0e542f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00052d0 con 0x7f5ec4003f30 2023-11-04T01:47:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed00a7050 con 0x7f5ec4003f30 2023-11-04T01:47:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ed9ffb640 1 -- 172.21.15.2:0/1102464609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0003600 con 0x7f5ec4003f30 2023-11-04T01:47:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1102464609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 msgr2=0x7f5ec40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 --2- 172.21.15.2:0/1102464609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5ec40047d0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001780 tx=0x7f5ed001c400 comp rx=0 tx=0).stop 2023-11-04T01:47:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5edb7fe640 1 -- 172.21.15.2:0/1102464609 reap_dead start 2023-11-04T01:47:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1102464609 shutdown_connections 2023-11-04T01:47:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1102464609 >> 172.21.15.2:0/1102464609 conn(0x7f5edc06e760 msgr2=0x7f5edc06eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1102464609 shutdown_connections 2023-11-04T01:47:43.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1102464609 wait complete. 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 Processor -- start 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- start start 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5edc1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc155ba0 0x7f5edc1ee930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc155500 0x7f5edc0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0cefe0 con 0x7f5ec4003f30 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc1559b0 con 0x7f5edc155ba0 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5ee15cf640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0c7f30 con 0x7f5edc155500 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5edaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5edc1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5edaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5edc1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55878/0 (socket says 172.21.15.2:55878) 2023-11-04T01:47:43.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5edaffd640 1 -- 172.21.15.2:0/1772211660 learned_addr learned my addr 172.21.15.2:0/1772211660 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.740+0000 7f5eda7fc640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc155ba0 0x7f5edc1ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edb7fe640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc155500 0x7f5edc0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edaffd640 1 -- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc155500 msgr2=0x7f5edc0c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edaffd640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc155500 0x7f5edc0c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edaffd640 1 -- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc155ba0 msgr2=0x7f5edc1ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edaffd640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc155ba0 0x7f5edc1ee930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edaffd640 1 -- 172.21.15.2:0/1772211660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0c8210 con 0x7f5ec4003f30 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edb7fe640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc155500 0x7f5edc0c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5edaffd640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5edc1560d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0101c0 tx=0x7f5ecc010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ec37fe640 1 -- 172.21.15.2:0/1772211660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00e050 con 0x7f5ec4003f30 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ec37fe640 1 -- 172.21.15.2:0/1772211660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc00f040 con 0x7f5ec4003f30 2023-11-04T01:47:43.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc0c84f0 con 0x7f5ec4003f30 2023-11-04T01:47:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ec37fe640 1 -- 172.21.15.2:0/1772211660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc003bc0 con 0x7f5ec4003f30 2023-11-04T01:47:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc0a8520 con 0x7f5ec4003f30 2023-11-04T01:47:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc0675f0 con 0x7f5ec4003f30 2023-11-04T01:47:43.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ec37fe640 1 -- 172.21.15.2:0/1772211660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ecc003d20 con 0x7f5ec4003f30 2023-11-04T01:47:43.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ec37fe640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ec80664d0 0x7f5ec8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:43.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5ec37fe640 1 -- 172.21.15.2:0/1772211660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f5ecc085270 con 0x7f5ec4003f30 2023-11-04T01:47:43.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5eda7fc640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ec80664d0 0x7f5ec8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:43.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.744+0000 7f5eda7fc640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ec80664d0 0x7f5ec8068990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001750 tx=0x7f5ed00011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:43.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.748+0000 7f5ec37fe640 1 -- 172.21.15.2:0/1772211660 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5ecc052100 con 0x7f5ec4003f30 2023-11-04T01:47:43.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.936+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5edc0c3300 con 0x7f5ec4003f30 2023-11-04T01:47:43.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.936+0000 7f5ec37fe640 1 -- 172.21.15.2:0/1772211660 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f5ecc055720 con 0x7f5ec4003f30 2023-11-04T01:47:43.942 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:40.926106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:43.942 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 82 2023-11-04T01:47:43.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ec80664d0 msgr2=0x7f5ec8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ec80664d0 0x7f5ec8068990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001750 tx=0x7f5ed00011a0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 msgr2=0x7f5edc1560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:43.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5edc1560d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0101c0 tx=0x7f5ecc010680 comp rx=0 tx=0).stop 2023-11-04T01:47:43.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 shutdown_connections 2023-11-04T01:47:43.944 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5ec80664d0 0x7f5ec8068990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5edc155500 0x7f5edc0c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5edc155ba0 0x7f5edc1ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 --2- 172.21.15.2:0/1772211660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ec4003f30 0x7f5edc1560d0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:43.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 >> 172.21.15.2:0/1772211660 conn(0x7f5edc06e760 msgr2=0x7f5edc0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:43.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 shutdown_connections 2023-11-04T01:47:43.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:43.940+0000 7f5ee15cf640 1 -- 172.21.15.2:0/1772211660 wait complete. 2023-11-04T01:47:44.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 2, 'explicitly_allowed_features': 2, 'created': '2023-11-04T01:45:35.008340+0000', 'modified': '2023-11-04T01:47:40.926106+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 98, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 5807, 'mds_1': 7128}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5807': {'gid': 5807, 'name': 'd', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.90:6837/433120793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 433120793}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 433120793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_7128': {'gid': 7128, 'name': 'a', 'rank': 1, 'incarnation': 48, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.2:6835/3725992406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 3725992406}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 3725992406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-04T01:47:44.363 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2023-11-04T01:47:44.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-04T01:47:44.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8c2a3640 1 Processor -- start 2023-11-04T01:47:44.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8c2a3640 1 -- start start 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8c2a3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb8406c1a0 0x7fdb840ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8c2a3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdb840cdf00 0x7fdb840cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8c2a3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb840ccc30 con 0x7fdb8415ccb0 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8c2a3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb840cda70 con 0x7fdb8406c1a0 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8c2a3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb840cce60 con 0x7fdb840cdf00 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8983e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb8406c1a0 0x7fdb840ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8983e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb8406c1a0 0x7fdb840ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55894/0 (socket says 172.21.15.2:55894) 2023-11-04T01:47:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8983e640 1 -- 172.21.15.2:0/3850250964 learned_addr learned my addr 172.21.15.2:0/3850250964 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8a840640 1 --2- 172.21.15.2:0/3850250964 >> v2:172.21.15.90:3300/0 conn(0x7fdb840cdf00 0x7fdb840cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8983e640 1 -- 172.21.15.2:0/3850250964 >> v2:172.21.15.90:3300/0 conn(0x7fdb840cdf00 msgr2=0x7fdb840cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8983e640 1 --2- 172.21.15.2:0/3850250964 >> v2:172.21.15.90:3300/0 conn(0x7fdb840cdf00 0x7fdb840cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8983e640 1 -- 172.21.15.2:0/3850250964 >> v1:172.21.15.90:6789/0 conn(0x7fdb8415ccb0 legacy=0x7fdb8406ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.496+0000 7fdb8983e640 1 -- 172.21.15.2:0/3850250964 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb840cd140 con 0x7fdb8406c1a0 2023-11-04T01:47:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8983e640 1 --2- 172.21.15.2:0/3850250964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8406c1a0 0x7fdb840ce580 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fdb8406c9f0 tx=0x7fdb7401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9a1de86ddbf1d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8903d640 1 -- 172.21.15.2:0/3850250964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740a89f0 con 0x7fdb8406c1a0 2023-11-04T01:47:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8903d640 1 -- 172.21.15.2:0/3850250964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb740a8b50 con 0x7fdb8406c1a0 2023-11-04T01:47:44.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8903d640 1 -- 172.21.15.2:0/3850250964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740b0440 con 0x7fdb8406c1a0 2023-11-04T01:47:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/3850250964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8406c1a0 msgr2=0x7fdb840ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/3850250964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8406c1a0 0x7fdb840ce580 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fdb8406c9f0 tx=0x7fdb7401ecf0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/3850250964 shutdown_connections 2023-11-04T01:47:44.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/3850250964 >> v2:172.21.15.90:3300/0 conn(0x7fdb840cdf00 0x7fdb840cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/3850250964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8406c1a0 0x7fdb840ce580 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/3850250964 >> 172.21.15.2:0/3850250964 conn(0x7fdb840cebb0 msgr2=0x7fdb840cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/3850250964 shutdown_connections 2023-11-04T01:47:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.500+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/3850250964 wait complete. 2023-11-04T01:47:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 Processor -- start 2023-11-04T01:47:44.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 -- start start 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb8406c1a0 0x7fdb840c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb840cdf00 0x7fdb841e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8415ccb0 0x7fdb841e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb840c2b90 con 0x7fdb8415ccb0 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb840c71b0 con 0x7fdb840cdf00 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb840c7490 con 0x7fdb8406c1a0 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8415ccb0 0x7fdb841e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8415ccb0 0x7fdb841e41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55902/0 (socket says 172.21.15.2:55902) 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 -- 172.21.15.2:0/2797639612 learned_addr learned my addr 172.21.15.2:0/2797639612 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8983e640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb840cdf00 0x7fdb841e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb8406c1a0 0x7fdb840c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 -- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb8406c1a0 msgr2=0x7fdb840c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb8406c1a0 0x7fdb840c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 -- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb840cdf00 msgr2=0x7fdb841e5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb840cdf00 0x7fdb841e5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 -- 172.21.15.2:0/2797639612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740094d0 con 0x7fdb8415ccb0 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8a840640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8415ccb0 0x7fdb841e41e0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00efc0 tx=0x7fdb7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb7affd640 1 -- 172.21.15.2:0/2797639612 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c014480 con 0x7fdb8415ccb0 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb7affd640 1 -- 172.21.15.2:0/2797639612 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c00f040 con 0x7fdb8415ccb0 2023-11-04T01:47:44.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb840c7770 con 0x7fdb8415ccb0 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb7affd640 1 -- 172.21.15.2:0/2797639612 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c014820 con 0x7fdb8415ccb0 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.504+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb841e5f70 con 0x7fdb8415ccb0 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb7affd640 1 -- 172.21.15.2:0/2797639612 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb7c014980 con 0x7fdb8415ccb0 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb7affd640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdb680664a0 0x7fdb68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb7affd640 1 -- 172.21.15.2:0/2797639612 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7fdb7c084f20 con 0x7fdb8415ccb0 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdb680664a0 0x7fdb68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 Processor -- start 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- start start 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdb680664a0 0x7fdb68068960 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007fd0 tx=0x7fdb80009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a469380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a41c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a41cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56001a2e7460 con 0x56001a4698c0 2023-11-04T01:47:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56001a278690 con 0x56001a468fa0 2023-11-04T01:47:44.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x56001a275bc0 con 0x56001a41cb40 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a41c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a41c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55918/0 (socket says 172.21.15.2:55918) 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 -- 172.21.15.2:0/2618198309 learned_addr learned my addr 172.21.15.2:0/2618198309 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8a840640 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a41cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a469380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 -- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 msgr2=0x56001a41cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a41cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 -- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 msgr2=0x56001a469380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a469380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 -- 172.21.15.2:0/2618198309 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560019f69890 con 0x56001a4698c0 2023-11-04T01:47:44.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8983e640 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a41c600 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fdb740b3040 tx=0x7fdb740aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e882a1c00e8e110 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb67fff640 1 -- 172.21.15.2:0/2618198309 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740b0640 con 0x56001a4698c0 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb67fff640 1 -- 172.21.15.2:0/2618198309 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb740b07a0 con 0x56001a4698c0 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb67fff640 1 -- 172.21.15.2:0/2618198309 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740b0b10 con 0x56001a4698c0 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2618198309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 msgr2=0x56001a41c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a41c600 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fdb740b3040 tx=0x7fdb740aa070 comp rx=0 tx=0).stop 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2618198309 shutdown_connections 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a41cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a41c600 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2618198309 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a469380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2618198309 >> 172.21.15.2:0/2618198309 conn(0x56001a449d40 msgr2=0x56001a44c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2618198309 shutdown_connections 2023-11-04T01:47:44.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.508+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2618198309 wait complete. 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 -- start start 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 Processor -- start 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a41cb40 0x56001a421de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a422320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a4698c0 0x56001a422860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56001a2714b0 con 0x56001a468fa0 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56001a229aa0 con 0x56001a41cb40 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x56001a22f940 con 0x56001a4698c0 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 10 client.0 _ll_register_callbacks cb 0x56001a40a460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a422320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a422320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55924/0 (socket says 172.21.15.2:55924) 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 -- 172.21.15.2:0/1236134962 learned_addr learned my addr 172.21.15.2:0/1236134962 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8a840640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a4698c0 0x56001a422860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a41cb40 0x56001a421de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 -- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a4698c0 msgr2=0x56001a422860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a4698c0 0x56001a422860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 -- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a41cb40 msgr2=0x56001a421de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a41cb40 0x56001a421de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 -- 172.21.15.2:0/1236134962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb840cd140 con 0x56001a468fa0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8a840640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a4698c0 0x56001a422860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8983e640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a422320 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fdb7401b900 tx=0x7fdb740046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f97970a541cbca7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb657fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb657fa640 1 -- 172.21.15.2:0/1236134962 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740038e0 con 0x56001a468fa0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb657fa640 1 -- 172.21.15.2:0/1236134962 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7fdb74003a40 con 0x56001a468fa0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56001a22ee10 con 0x56001a468fa0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb657fa640 1 -- 172.21.15.2:0/1236134962 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb74003c40 con 0x56001a468fa0 2023-11-04T01:47:44.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 10 client.7845 fetch_fsmap learned FSMap version 82 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x56001a2321a0 con 0x56001a468fa0 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb657fa640 1 -- 172.21.15.2:0/1236134962 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56001a22ee10 con 0x56001a468fa0 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb657fa640 1 -- 172.21.15.2:0/1236134962 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 82) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdb740c6480 con 0x56001a468fa0 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 10 client.7845 fetch_fsmap finished waiting for FSMap version 82 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 10 client.7845 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 20 client.7845 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a423270 0x56001a47a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 4 client.7845 mds_command: new command op to 5807 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 --> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56001a26fe00 con 0x56001a423270 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a423270 0x56001a47a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb657fa640 10 client.7845 ms_handle_connect on v2:172.21.15.90:6834/433120793 2023-11-04T01:47:44.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.512+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a423270 0x56001a47a040 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12759e77861749a1 server_cookie=d530b7818dffbb1a in_seq=0 out_seq=0 2023-11-04T01:47:44.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb657fa640 1 -- 172.21.15.2:0/1236134962 <== mds.0 v2:172.21.15.90:6834/433120793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56001a26fe00 con 0x56001a423270 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb657fa640 10 client.7845 handle_command_reply: tid=0 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 client.7845 shutdown 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 msgr2=0x56001a422320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a422320 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fdb7401b900 tx=0x7fdb740046d0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 shutdown_connections 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a423270 0x56001a47a040 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a4698c0 0x56001a422860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb657fa640 0 client.7845 ms_handle_reset on v2:172.21.15.90:6834/433120793 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a422320 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/1236134962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a41cb40 0x56001a421de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 >> 172.21.15.2:0/1236134962 conn(0x56001a449d40 msgr2=0x56001a44c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 shutdown_connections 2023-11-04T01:47:44.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/1236134962 wait complete. 2023-11-04T01:47:44.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.516+0000 7fdb8f3d0000 20 client.7845 trim_cache size 0 max 16384 2023-11-04T01:47:44.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 Processor -- start 2023-11-04T01:47:44.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 -- start start 2023-11-04T01:47:44.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a424660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a424ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a47a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560019f2a940 con 0x56001a4698c0 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x56001a1f4460 con 0x56001a468fa0 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x56001a41ca00 con 0x56001a41cb40 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a47a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a47a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55926/0 (socket says 172.21.15.2:55926) 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 -- 172.21.15.2:0/3709444100 learned_addr learned my addr 172.21.15.2:0/3709444100 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8983e640 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a424ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a424660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 -- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 msgr2=0x56001a424660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a424660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 -- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 msgr2=0x56001a424ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a424ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 -- 172.21.15.2:0/3709444100 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56001a2184a0 con 0x56001a4698c0 2023-11-04T01:47:44.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8a840640 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a47a040 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c055a30 tx=0x7fdb7c055b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a095bb3e0a1b8bd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb78ff9640 1 -- 172.21.15.2:0/3709444100 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c053be0 con 0x56001a4698c0 2023-11-04T01:47:44.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb78ff9640 1 -- 172.21.15.2:0/3709444100 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c053e40 con 0x56001a4698c0 2023-11-04T01:47:44.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb78ff9640 1 -- 172.21.15.2:0/3709444100 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c0521b0 con 0x56001a4698c0 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/3709444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 msgr2=0x56001a47a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a47a040 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c055a30 tx=0x7fdb7c055b60 comp rx=0 tx=0).stop 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/3709444100 shutdown_connections 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a4698c0 0x56001a47a040 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.532+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a468fa0 0x56001a424ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/3709444100 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a424660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/3709444100 >> 172.21.15.2:0/3709444100 conn(0x56001a449d40 msgr2=0x56001a467f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/3709444100 shutdown_connections 2023-11-04T01:47:44.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/3709444100 wait complete. 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- start start 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 Processor -- start 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a4c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a4c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a4698c0 0x56001a484b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x56001a41b840 con 0x56001a468fa0 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x560019f6a1b0 con 0x56001a4698c0 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x56001a26fff0 con 0x56001a41cb40 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 10 client.0 _ll_register_callbacks cb 0x7fdb7c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a4c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a4c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55934/0 (socket says 172.21.15.2:55934) 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 -- 172.21.15.2:0/2219008835 learned_addr learned my addr 172.21.15.2:0/2219008835 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 -- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 msgr2=0x56001a4c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a4c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 -- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a4698c0 msgr2=0x56001a484b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8a840640 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a4698c0 0x56001a484b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a4698c0 0x56001a484b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 -- 172.21.15.2:0/2219008835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb841e5f70 con 0x56001a468fa0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8983e640 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a4c9f50 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fdb740cc040 tx=0x7fdb7401d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbe81778152f7bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb657fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb657fa640 1 -- 172.21.15.2:0/2219008835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740c6480 con 0x56001a468fa0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb657fa640 1 -- 172.21.15.2:0/2219008835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7fdb740c8ce0 con 0x56001a468fa0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56001a23bd10 con 0x56001a468fa0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb657fa640 1 -- 172.21.15.2:0/2219008835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb740c65e0 con 0x56001a468fa0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 10 client.7851 fetch_fsmap learned FSMap version 82 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x560019f69cc0 con 0x56001a468fa0 2023-11-04T01:47:44.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb657fa640 1 -- 172.21.15.2:0/2219008835 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56001a23bd10 con 0x56001a468fa0 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb657fa640 1 -- 172.21.15.2:0/2219008835 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 82) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fdb740036e0 con 0x56001a468fa0 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 10 client.7851 fetch_fsmap finished waiting for FSMap version 82 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 10 client.7851 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 20 client.7851 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a4854a0 0x56001a485880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 4 client.7851 mds_command: new command op to 5807 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 --> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56001a26a490 con 0x56001a4854a0 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a4854a0 0x56001a485880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb657fa640 10 client.7851 ms_handle_connect on v2:172.21.15.90:6834/433120793 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.536+0000 7fdb8a03f640 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a4854a0 0x56001a485880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e6a7a794777085 server_cookie=f3d5e42a6f998009 in_seq=0 out_seq=0 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb657fa640 1 -- 172.21.15.2:0/2219008835 <== mds.0 v2:172.21.15.90:6834/433120793 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56001a26a490 con 0x56001a4854a0 2023-11-04T01:47:44.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb657fa640 10 client.7851 handle_command_reply: tid=0 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 client.7851 shutdown 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 msgr2=0x56001a4c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a4c9f50 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fdb740cc040 tx=0x7fdb7401d530 comp rx=0 tx=0).stop 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 shutdown_connections 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:6834/433120793,v1:172.21.15.90:6837/433120793] conn(0x56001a4854a0 0x56001a485880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x56001a4698c0 0x56001a484b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56001a468fa0 0x56001a4c9f50 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb657fa640 0 client.7851 ms_handle_reset on v2:172.21.15.90:6834/433120793 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 --2- 172.21.15.2:0/2219008835 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x56001a41cb40 0x56001a4c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 >> 172.21.15.2:0/2219008835 conn(0x56001a449d40 msgr2=0x56001a423ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 shutdown_connections 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 1 -- 172.21.15.2:0/2219008835 wait complete. 2023-11-04T01:47:44.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8f3d0000 20 client.7851 trim_cache size 0 max 16384 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5807, 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.6478620880000001, 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 82, 2023-11-04T01:47:44.548 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 98, 2023-11-04T01:47:44.549 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2023-11-04T01:47:44.549 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 32.760641043 2023-11-04T01:47:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:47:44.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdb680664a0 msgr2=0x7fdb68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdb680664a0 0x7fdb68068960 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007fd0 tx=0x7fdb80009040 comp rx=0 tx=0).stop 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8415ccb0 msgr2=0x7fdb841e41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8415ccb0 0x7fdb841e41e0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00efc0 tx=0x7fdb7c00c490 comp rx=0 tx=0).stop 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 shutdown_connections 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdb680664a0 0x7fdb68068960 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb8415ccb0 0x7fdb841e41e0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb840cdf00 0x7fdb841e5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 --2- 172.21.15.2:0/2797639612 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdb8406c1a0 0x7fdb840c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 >> 172.21.15.2:0/2797639612 conn(0x7fdb840cebb0 msgr2=0x7fdb84071600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 shutdown_connections 2023-11-04T01:47:44.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.540+0000 7fdb8c2a3640 1 -- 172.21.15.2:0/2797639612 wait complete. 2023-11-04T01:47:44.560 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-04T01:47:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f6050019640 1 Processor -- start 2023-11-04T01:47:44.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f6050019640 1 -- start start 2023-11-04T01:47:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f6050019640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 0x7f60480ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f6050019640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60480cc6b0 con 0x7f60480ae650 2023-11-04T01:47:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f6050019640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60480cf4c0 con 0x7f6048072350 2023-11-04T01:47:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f6050019640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60480cd700 con 0x7f60480aea30 2023-11-04T01:47:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604ddb5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f60480ae650 0x7f60480ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38846/0 (socket says 172.21.15.2:38846) 2023-11-04T01:47:44.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604ddb5640 1 -- 172.21.15.2:0/1888218667 learned_addr learned my addr 172.21.15.2:0/1888218667 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:44.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 0x7f60480ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205205697 0 0) 0x7f60480cc6b0 con 0x7f60480ae650 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6034003530 con 0x7f60480ae650 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2282041012 0 0) 0x7f6034003530 con 0x7f60480ae650 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 msgr2=0x7f60480ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 0x7f60480ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 >> v1:172.21.15.90:6789/0 conn(0x7f6048072350 legacy=0x7f60480cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480cc900 con 0x7f60480ae650 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f6038001a00 con 0x7f60480ae650 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 >> v1:172.21.15.2:6789/0 conn(0x7f60480ae650 legacy=0x7f60480ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60340039b0 0x7f6034003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 0x7f60340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6034004d10 0x7f6034005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60480cd700 con 0x7f6034004d10 2023-11-04T01:47:44.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603400bb50 con 0x7f60340039b0 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603400bd10 con 0x7f60480aea30 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6034004d10 0x7f6034005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604ddb5640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60340039b0 0x7f6034003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604d5b4640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 0x7f60340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604e5b6640 1 -- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 msgr2=0x7f60340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 0x7f60340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604e5b6640 1 -- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60340039b0 msgr2=0x7f6034003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60340039b0 0x7f6034003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604e5b6640 1 -- 172.21.15.2:0/1888218667 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034003530 con 0x7f6034004d10 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604ddb5640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60340039b0 0x7f6034003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.672+0000 7f604d5b4640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f60480aea30 0x7f60340047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6034004d10 0x7f6034005190 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f604806fe20 tx=0x7f604001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccb8b063afb450a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400a64d0 con 0x7f6034004d10 2023-11-04T01:47:44.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60400a6630 con 0x7f6034004d10 2023-11-04T01:47:44.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f604cdb3640 1 -- 172.21.15.2:0/1888218667 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400a69e0 con 0x7f6034004d10 2023-11-04T01:47:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 -- 172.21.15.2:0/1888218667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6034004d10 msgr2=0x7f6034005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 --2- 172.21.15.2:0/1888218667 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6034004d10 0x7f6034005190 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f604806fe20 tx=0x7f604001c9c0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f604e5b6640 1 -- 172.21.15.2:0/1888218667 reap_dead start 2023-11-04T01:47:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 -- 172.21.15.2:0/1888218667 shutdown_connections 2023-11-04T01:47:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 -- 172.21.15.2:0/1888218667 >> 172.21.15.2:0/1888218667 conn(0x7f60480716a0 msgr2=0x7f6048071ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 -- 172.21.15.2:0/1888218667 shutdown_connections 2023-11-04T01:47:44.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 -- 172.21.15.2:0/1888218667 wait complete. 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 Processor -- start 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.676+0000 7f6050019640 1 -- start start 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6034004d10 0x7f60480c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6048153480 0x7f60481599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f604814b5c0 0x7f604814ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f604814bf80 con 0x7f604814b5c0 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6048159ef0 con 0x7f6034004d10 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60480c35e0 con 0x7f6048153480 2023-11-04T01:47:44.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f604814b5c0 0x7f604814ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f604814b5c0 0x7f604814ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55956/0 (socket says 172.21.15.2:55956) 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 -- 172.21.15.2:0/1973819489 learned_addr learned my addr 172.21.15.2:0/1973819489 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604ddb5640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6034004d10 0x7f60480c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604d5b4640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6048153480 0x7f60481599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 -- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6048153480 msgr2=0x7f60481599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6048153480 0x7f60481599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 -- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6034004d10 msgr2=0x7f60480c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6034004d10 0x7f60480c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 -- 172.21.15.2:0/1973819489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480c38c0 con 0x7f604814b5c0 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604e5b6640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f604814b5c0 0x7f604814ba40 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f60400b0040 tx=0x7f6034005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f60467fc640 1 -- 172.21.15.2:0/1973819489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400bc070 con 0x7f604814b5c0 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f60467fc640 1 -- 172.21.15.2:0/1973819489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040005e10 con 0x7f604814b5c0 2023-11-04T01:47:44.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60480c3ba0 con 0x7f604814b5c0 2023-11-04T01:47:44.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f60467fc640 1 -- 172.21.15.2:0/1973819489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400a64d0 con 0x7f604814b5c0 2023-11-04T01:47:44.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60480c4160 con 0x7f604814b5c0 2023-11-04T01:47:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f60467fc640 1 -- 172.21.15.2:0/1973819489 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f60400a67a0 con 0x7f604814b5c0 2023-11-04T01:47:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f60467fc640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60280664a0 0x7f6028068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f60467fc640 1 -- 172.21.15.2:0/1973819489 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f60400aa070 con 0x7f604814b5c0 2023-11-04T01:47:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.680+0000 7f604ddb5640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60280664a0 0x7f6028068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 Processor -- start 2023-11-04T01:47:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- start start 2023-11-04T01:47:44.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604ddb5640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60280664a0 0x7f6028068960 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6038002240 tx=0x7f6038009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1e9e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1e51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e51f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee1d1c460 con 0x55fee1e9e8c0 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee1cad690 con 0x55fee1e51b40 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee1caabc0 con 0x55fee1e9dfa0 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1e51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1e51600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55960/0 (socket says 172.21.15.2:55960) 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 -- 172.21.15.2:0/3256851144 learned_addr learned my addr 172.21.15.2:0/3256851144 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604ddb5640 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1e9e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604e5b6640 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e51f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 -- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 msgr2=0x55fee1e9e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1e9e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 -- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 msgr2=0x55fee1e51f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e51f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 -- 172.21.15.2:0/3256851144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee199e890 con 0x55fee1e9e8c0 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604e5b6640 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e51f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f604d5b4640 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1e51600 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6030001680 tx=0x7f6030001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e9b30daa3108fa server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f603f7fe640 1 -- 172.21.15.2:0/3256851144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030001d90 con 0x55fee1e9e8c0 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f603f7fe640 1 -- 172.21.15.2:0/3256851144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000d050 con 0x55fee1e9e8c0 2023-11-04T01:47:44.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f603f7fe640 1 -- 172.21.15.2:0/3256851144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000f750 con 0x55fee1e9e8c0 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- 172.21.15.2:0/3256851144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 msgr2=0x55fee1e51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1e51600 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f6030001680 tx=0x7f6030001b40 comp rx=0 tx=0).stop 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- 172.21.15.2:0/3256851144 shutdown_connections 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e51f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1e51600 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 --2- 172.21.15.2:0/3256851144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1e9e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- 172.21.15.2:0/3256851144 >> 172.21.15.2:0/3256851144 conn(0x55fee1e7ed40 msgr2=0x55fee1e81130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- 172.21.15.2:0/3256851144 shutdown_connections 2023-11-04T01:47:44.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- 172.21.15.2:0/3256851144 wait complete. 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 -- start start 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.684+0000 7f6053146000 1 Processor -- start 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e51b40 0x55fee1ea5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee1ca64b0 con 0x55fee1e51b40 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee1c5eaa0 con 0x55fee1e9e8c0 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee1c64940 con 0x55fee1e9dfa0 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 10 client.0 _ll_register_callbacks cb 0x55fee1e3f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e51b40 0x55fee1ea5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e51b40 0x55fee1ea5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55972/0 (socket says 172.21.15.2:55972) 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 -- 172.21.15.2:0/2058448942 learned_addr learned my addr 172.21.15.2:0/2058448942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604d5b4640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 -- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 msgr2=0x55fee1ea5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604e5b6640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 -- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 msgr2=0x55fee1e576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 -- 172.21.15.2:0/2058448942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60480cf4c0 con 0x55fee1e51b40 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604d5b4640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604ddb5640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e51b40 0x55fee1ea5300 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6038013ae0 tx=0x7f6038001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f8a9e5f8d52a0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 1 -- 172.21.15.2:0/2058448942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380057e0 con 0x55fee1e51b40 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 1 -- 172.21.15.2:0/2058448942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f603801b070 con 0x55fee1e51b40 2023-11-04T01:47:44.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fee1c63e10 con 0x55fee1e51b40 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 1 -- 172.21.15.2:0/2058448942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6038005940 con 0x55fee1e51b40 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 10 client.7863 fetch_fsmap learned FSMap version 82 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x55fee1c671a0 con 0x55fee1e51b40 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 1 -- 172.21.15.2:0/2058448942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fee1c63e10 con 0x55fee1e51b40 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 1 -- 172.21.15.2:0/2058448942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 82) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6038012070 con 0x55fee1e51b40 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 10 client.7863 fetch_fsmap finished waiting for FSMap version 82 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 10 client.7863 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 20 client.7863 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1e58450 0x55fee1e58830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 4 client.7863 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fee1ca4e00 con 0x55fee1e58450 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604d5b4640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1e58450 0x55fee1e58830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 10 client.7863 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:44.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f604d5b4640 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1e58450 0x55fee1e58830 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c724c69362471d4 server_cookie=e3e67aabd168f3fa in_seq=0 out_seq=0 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 1 -- 172.21.15.2:0/2058448942 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fee1ca4e00 con 0x55fee1e58450 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 10 client.7863 handle_command_reply: tid=0 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 client.7863 shutdown 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e51b40 msgr2=0x55fee1ea5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e51b40 0x55fee1ea5300 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f6038013ae0 tx=0x7f6038001d90 comp rx=0 tx=0).stop 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 shutdown_connections 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1e58450 0x55fee1e58830 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f603cff9640 0 client.7863 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 --2- 172.21.15.2:0/2058448942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e51b40 0x55fee1ea5300 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 >> 172.21.15.2:0/2058448942 conn(0x55fee1e7ed40 msgr2=0x55fee1e81130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 shutdown_connections 2023-11-04T01:47:44.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 1 -- 172.21.15.2:0/2058448942 wait complete. 2023-11-04T01:47:44.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.688+0000 7f6053146000 20 client.7863 trim_cache size 0 max 16384 2023-11-04T01:47:44.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 Processor -- start 2023-11-04T01:47:44.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 -- start start 2023-11-04T01:47:44.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e51b40 0x55fee1e575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9dfa0 0x55fee1e59840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e59d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee195f940 con 0x55fee1e9dfa0 2023-11-04T01:47:44.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee1c79ba0 con 0x55fee1e9e8c0 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.704+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee1cb07d0 con 0x55fee1e51b40 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9dfa0 0x55fee1e59840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9dfa0 0x55fee1e59840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55986/0 (socket says 172.21.15.2:55986) 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 -- 172.21.15.2:0/693428793 learned_addr learned my addr 172.21.15.2:0/693428793 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e59d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604ddb5640 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e51b40 0x55fee1e575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 -- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e51b40 msgr2=0x55fee1e575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e51b40 0x55fee1e575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 -- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 msgr2=0x55fee1e59d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e59d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 -- 172.21.15.2:0/693428793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee1c4d4a0 con 0x55fee1e9dfa0 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e59d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9dfa0 0x55fee1e59840 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x55fee1e26aa0 tx=0x7f603000b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88393d342adfa44e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f603ffff640 1 -- 172.21.15.2:0/693428793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030000f60 con 0x55fee1e9dfa0 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f603ffff640 1 -- 172.21.15.2:0/693428793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000d070 con 0x55fee1e9dfa0 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f603ffff640 1 -- 172.21.15.2:0/693428793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030025d70 con 0x55fee1e9dfa0 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- 172.21.15.2:0/693428793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9dfa0 msgr2=0x55fee1e59840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9dfa0 0x55fee1e59840 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x55fee1e26aa0 tx=0x7f603000b000 comp rx=0 tx=0).stop 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- 172.21.15.2:0/693428793 shutdown_connections 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e9e8c0 0x55fee1e59d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9dfa0 0x55fee1e59840 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 --2- 172.21.15.2:0/693428793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e51b40 0x55fee1e575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- 172.21.15.2:0/693428793 >> 172.21.15.2:0/693428793 conn(0x55fee1e7ed40 msgr2=0x55fee1e56690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- 172.21.15.2:0/693428793 shutdown_connections 2023-11-04T01:47:44.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- 172.21.15.2:0/693428793 wait complete. 2023-11-04T01:47:44.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- start start 2023-11-04T01:47:44.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 Processor -- start 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e9d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1ea2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee1e81360 con 0x55fee1e9e8c0 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee1ca1e20 con 0x55fee1e51b40 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fee1ca38b0 con 0x55fee1e9dfa0 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 10 client.0 _ll_register_callbacks cb 0x7f6030007de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1ea2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1ea2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56002/0 (socket says 172.21.15.2:56002) 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 -- 172.21.15.2:0/993621065 learned_addr learned my addr 172.21.15.2:0/993621065 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604d5b4640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604ddb5640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e9d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 -- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 msgr2=0x55fee1ea1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 -- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 msgr2=0x55fee1e9d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e9d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 -- 172.21.15.2:0/993621065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fee199e890 con 0x55fee1e9e8c0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604ddb5640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e9d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f604e5b6640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1ea2240 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f604001cf30 tx=0x7f60400ef110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3685bb42320bc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f603cff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f603cff9640 1 -- 172.21.15.2:0/993621065 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400f6d10 con 0x55fee1e9e8c0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f603cff9640 1 -- 172.21.15.2:0/993621065 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f604011d040 con 0x55fee1e9e8c0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fee1eb4780 con 0x55fee1e9e8c0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f603cff9640 1 -- 172.21.15.2:0/993621065 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60400edf00 con 0x55fee1e9e8c0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 10 client.7869 fetch_fsmap learned FSMap version 82 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.708+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x55fee199ecc0 con 0x55fee1e9e8c0 2023-11-04T01:47:44.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f603cff9640 1 -- 172.21.15.2:0/993621065 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fee1eb4780 con 0x55fee1e9e8c0 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f603cff9640 1 -- 172.21.15.2:0/993621065 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 82) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f6040115d20 con 0x55fee1e9e8c0 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 10 client.7869 fetch_fsmap finished waiting for FSMap version 82 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 10 client.7869 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 20 client.7869 populate_metadata read hostname 'smithi002' 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1efede0 0x55fee1eff1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 4 client.7869 mds_command: new command op to 7128 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 --> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fee1c70d10 con 0x55fee1efede0 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f604ddb5640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1efede0 0x55fee1eff1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f603cff9640 10 client.7869 ms_handle_connect on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f604ddb5640 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1efede0 0x55fee1eff1c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e85807c83572a09 server_cookie=987cf5240592f21 in_seq=0 out_seq=0 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f603cff9640 1 -- 172.21.15.2:0/993621065 <== mds.1 v2:172.21.15.2:6834/3725992406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55fee1c70d10 con 0x55fee1efede0 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f603cff9640 10 client.7869 handle_command_reply: tid=0 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 client.7869 shutdown 2023-11-04T01:47:44.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 msgr2=0x55fee1ea2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1ea2240 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f604001cf30 tx=0x7f60400ef110 comp rx=0 tx=0).stop 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 shutdown_connections 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:6834/3725992406,v1:172.21.15.2:6835/3725992406] conn(0x55fee1efede0 0x55fee1eff1c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee1e9e8c0 0x55fee1ea2240 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55fee1e9dfa0 0x55fee1ea1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 --2- 172.21.15.2:0/993621065 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55fee1e51b40 0x55fee1e9d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f603cff9640 0 client.7869 ms_handle_reset on v2:172.21.15.2:6834/3725992406 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 >> 172.21.15.2:0/993621065 conn(0x55fee1e7ed40 msgr2=0x55fee1e58830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 shutdown_connections 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 1 -- 172.21.15.2:0/993621065 wait complete. 2023-11-04T01:47:44.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6053146000 20 client.7869 trim_cache size 0 max 16384 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "5d11bb68-eb80-4957-a295-0326089fcc10", 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 7128, 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 117.898939094, 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 82, 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 98, 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 135.125902814 2023-11-04T01:47:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:47:44.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60280664a0 msgr2=0x7f6028068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60280664a0 0x7f6028068960 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6038002240 tx=0x7f6038009040 comp rx=0 tx=0).stop 2023-11-04T01:47:44.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f604814b5c0 msgr2=0x7f604814ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f604814b5c0 0x7f604814ba40 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f60400b0040 tx=0x7f6034005800 comp rx=0 tx=0).stop 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 shutdown_connections 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f60280664a0 0x7f6028068960 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f604814b5c0 0x7f604814ba40 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6048153480 0x7f60481599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 --2- 172.21.15.2:0/1973819489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6034004d10 0x7f60480c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 >> 172.21.15.2:0/1973819489 conn(0x7f60480716a0 msgr2=0x7f60480af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 shutdown_connections 2023-11-04T01:47:44.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.712+0000 7f6050019640 1 -- 172.21.15.2:0/1973819489 wait complete. 2023-11-04T01:47:44.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.844+0000 7f3e4e1e8640 1 Processor -- start 2023-11-04T01:47:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.844+0000 7f3e4e1e8640 1 -- start start 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e4e1e8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e4815d2b0 0x7f3e4806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e4e1e8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4815d690 0x7f3e480ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e4e1e8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e480cd160 con 0x7f3e4806f8f0 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e4e1e8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e480ad450 con 0x7f3e4815d2b0 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e4e1e8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e480cd400 con 0x7f3e4815d690 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e477fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e4815d2b0 0x7f3e4806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e477fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e4815d2b0 0x7f3e4806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56010/0 (socket says 172.21.15.2:56010) 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e477fe640 1 -- 172.21.15.2:0/563194295 learned_addr learned my addr 172.21.15.2:0/563194295 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e46ffd640 1 --2- 172.21.15.2:0/563194295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4815d690 0x7f3e480ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e477fe640 1 -- 172.21.15.2:0/563194295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4815d690 msgr2=0x7f3e480ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e477fe640 1 --2- 172.21.15.2:0/563194295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4815d690 0x7f3e480ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e477fe640 1 -- 172.21.15.2:0/563194295 >> v1:172.21.15.90:6789/0 conn(0x7f3e4806f8f0 legacy=0x7f3e480b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:44.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.848+0000 7f3e477fe640 1 -- 172.21.15.2:0/563194295 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480cd6e0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e477fe640 1 --2- 172.21.15.2:0/563194295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e4806c630 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f2fd4879dab03e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e467fc640 1 -- 172.21.15.2:0/563194295 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400a57b0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e467fc640 1 -- 172.21.15.2:0/563194295 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e400a5910 con 0x7f3e4815d2b0 2023-11-04T01:47:44.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e467fc640 1 -- 172.21.15.2:0/563194295 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400a5ca0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/563194295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 msgr2=0x7f3e4806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/563194295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e4806c630 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4001c910 comp rx=0 tx=0).stop 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/563194295 shutdown_connections 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/563194295 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4815d690 0x7f3e480ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/563194295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e4806c630 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/563194295 >> 172.21.15.2:0/563194295 conn(0x7f3e480cebb0 msgr2=0x7f3e480cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/563194295 shutdown_connections 2023-11-04T01:47:44.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/563194295 wait complete. 2023-11-04T01:47:44.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 Processor -- start 2023-11-04T01:47:44.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- start start 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4806f8f0 0x7f3e480cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e480cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e4815d690 0x7f3e4815f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e480cc230 con 0x7f3e4815d2b0 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4815e2b0 con 0x7f3e4815d690 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e4e1e8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4815daa0 con 0x7f3e4806f8f0 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e46ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e480cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e46ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e480cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56024/0 (socket says 172.21.15.2:56024) 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e46ffd640 1 -- 172.21.15.2:0/2433422760 learned_addr learned my addr 172.21.15.2:0/2433422760 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e477fe640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4806f8f0 0x7f3e480cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.852+0000 7f3e47fff640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e4815d690 0x7f3e4815f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e46ffd640 1 -- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4806f8f0 msgr2=0x7f3e480cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e46ffd640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4806f8f0 0x7f3e480cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e46ffd640 1 -- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e4815d690 msgr2=0x7f3e4815f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e46ffd640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e4815d690 0x7f3e4815f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e46ffd640 1 -- 172.21.15.2:0/2433422760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009b30 con 0x7f3e4815d2b0 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e47fff640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e4815d690 0x7f3e4815f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e46ffd640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e480cae90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d800 tx=0x7f3e3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e2ffff640 1 -- 172.21.15.2:0/2433422760 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00b6c0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e2ffff640 1 -- 172.21.15.2:0/2433422760 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c00b820 con 0x7f3e4815d2b0 2023-11-04T01:47:44.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e480cb3d0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e2ffff640 1 -- 172.21.15.2:0/2433422760 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00bbb0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4815dda0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e480744a0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e2ffff640 1 -- 172.21.15.2:0/2433422760 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e3c00bd10 con 0x7f3e4815d2b0 2023-11-04T01:47:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e2ffff640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e340664a0 0x7f3e34068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e2ffff640 1 -- 172.21.15.2:0/2433422760 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f3e3c0848e0 con 0x7f3e4815d2b0 2023-11-04T01:47:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e477fe640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e340664a0 0x7f3e34068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:44.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.856+0000 7f3e477fe640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e340664a0 0x7f3e34068960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ae000 tx=0x7f3e400a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:44.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:44.860+0000 7f3e2ffff640 1 -- 172.21.15.2:0/2433422760 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3e3c051770 con 0x7f3e4815d2b0 2023-11-04T01:47:45.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.056+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e48071cb0 con 0x7f3e4815d2b0 2023-11-04T01:47:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.056+0000 7f3e2ffff640 1 -- 172.21.15.2:0/2433422760 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f3e3c054d90 con 0x7f3e4815d2b0 2023-11-04T01:47:45.060 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:40.926106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:45.060 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 82 2023-11-04T01:47:45.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e340664a0 msgr2=0x7f3e34068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e340664a0 0x7f3e34068960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3e400ae000 tx=0x7f3e400a7070 comp rx=0 tx=0).stop 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 msgr2=0x7f3e480cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e480cae90 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00d800 tx=0x7f3e3c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 shutdown_connections 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3e340664a0 0x7f3e34068960 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e4815d690 0x7f3e4815f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e4815d2b0 0x7f3e480cae90 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 --2- 172.21.15.2:0/2433422760 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3e4806f8f0 0x7f3e480cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 >> 172.21.15.2:0/2433422760 conn(0x7f3e480cebb0 msgr2=0x7f3e480b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 shutdown_connections 2023-11-04T01:47:45.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.060+0000 7f3e4e1e8640 1 -- 172.21.15.2:0/2433422760 wait complete. 2023-11-04T01:47:45.080 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:47:45.223 INFO:teuthology.orchestra.run.smithi090.stdout:{"last_snap":5,"last_created":5,"last_destroyed":1,"pending_noop":[],"snaps":[{"snapid":2,"ino":1099511627777,"stamp":"2023-11-04T01:46:03.907395+0000","name":"s11","metadata":{}},{"snapid":3,"ino":1099511627777,"stamp":"2023-11-04T01:46:29.227900+0000","name":"s12","metadata":{}},{"snapid":4,"ino":1099511627777,"stamp":"2023-11-04T01:46:54.611108+0000","name":"s15","metadata":{}},{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:47:20.783514+0000","name":"s16","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:47:45.224 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 1, "last_snap": 5, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s11", "snapid": 2, "stamp": "2023-11-04T01:46:03.907395+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s12", "snapid": 3, "stamp": "2023-11-04T01:46:29.227900+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s15", "snapid": 4, "stamp": "2023-11-04T01:46:54.611108+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:47:20.783514+0000" } ] } 2023-11-04T01:47:45.224 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:47:45.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:47:45.227 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-04T01:47:45.253 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2023-11-04T01:47:45.253 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2023-11-04T01:47:45.253 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:47:45.253 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:47:45.254 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2023-11-04T01:47:45.255 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2023-11-04T01:47:45.256 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.2,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 5d11bb68-eb80-4957-a295-0326089fcc10 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.257 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2023-11-04T01:47:45.258 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2023-11-04T01:47:45.259 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2023-11-04T01:47:45.260 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2023-11-04T01:47:45.261 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:47:45.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = "" 2023-11-04T01:47:45.263 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds balancer = 20 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2023-11-04T01:47:45.264 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi090.stdout: mds_reconnect_timeout = 5 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2023-11-04T01:47:45.265 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2023-11-04T01:47:45.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2023-11-04T01:47:45.267 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2023-11-04T01:47:45.268 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.90,[v2:172.21.15.90:3301,v1:172.21.15.90:6790]" 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 5d11bb68-eb80-4957-a295-0326089fcc10 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2023-11-04T01:47:45.269 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2023-11-04T01:47:45.270 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2023-11-04T01:47:45.271 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2023-11-04T01:47:45.272 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-04T01:47:45.273 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2023-11-04T01:47:45.274 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2023-11-04T01:47:45.275 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2023-11-04T01:47:45.276 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-04T01:47:45.277 INFO:teuthology.orchestra.run.smithi002.stdout: mds_reconnect_timeout = 5 2023-11-04T01:47:45.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:45.278 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:47:45.395 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=2, also kill snapclient 2023-11-04T01:47:45.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb881fea640 1 Processor -- start 2023-11-04T01:47:45.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb881fea640 1 -- start start 2023-11-04T01:47:45.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb881fea640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb87c0cded0 0x7fb87c0d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb881fea640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0d28c0 0x7fb87c1610e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb881fea640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c0b87c0 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb881fea640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c0d1a80 con 0x7fb87c0cded0 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb881fea640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0b8a60 con 0x7fb87c0d28c0 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb87c0cded0 0x7fb87c0d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb87c0ce2b0 0x7fb87c161620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38854/0 (socket says 172.21.15.2:38854) 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87b7fe640 1 --2- 172.21.15.2:0/1405840128 >> v2:172.21.15.2:3300/0 conn(0x7fb87c0cded0 0x7fb87c0d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56038/0 (socket says 172.21.15.2:56038) 2023-11-04T01:47:45.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87bfff640 1 -- 172.21.15.2:0/1405840128 learned_addr learned my addr 172.21.15.2:0/1405840128 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:45.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87affd640 1 --2- 172.21.15.2:0/1405840128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0d28c0 0x7fb87c1610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87b7fe640 1 -- 172.21.15.2:0/1405840128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0d28c0 msgr2=0x7fb87c1610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:45.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87b7fe640 1 --2- 172.21.15.2:0/1405840128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0d28c0 0x7fb87c1610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87b7fe640 1 -- 172.21.15.2:0/1405840128 >> v1:172.21.15.2:6789/0 conn(0x7fb87c0ce2b0 legacy=0x7fb87c161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87b7fe640 1 -- 172.21.15.2:0/1405840128 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c0b8d40 con 0x7fb87c0cded0 2023-11-04T01:47:45.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87a7fc640 1 -- 172.21.15.2:0/1405840128 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917336038 0 0) 0x7fb87c0b87c0 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.519+0000 7fb87affd640 1 --2- 172.21.15.2:0/1405840128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0d28c0 0x7fb87c1610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87b7fe640 1 --2- 172.21.15.2:0/1405840128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0cded0 0x7fb87c0d0410 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0097c0 tx=0x7fb86c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bc5c853fcb6917 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87a7fc640 1 -- 172.21.15.2:0/1405840128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0a8970 con 0x7fb87c0cded0 2023-11-04T01:47:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87a7fc640 1 -- 172.21.15.2:0/1405840128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c0a8ad0 con 0x7fb87c0cded0 2023-11-04T01:47:45.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87a7fc640 1 -- 172.21.15.2:0/1405840128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c0a8e60 con 0x7fb87c0cded0 2023-11-04T01:47:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- 172.21.15.2:0/1405840128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0cded0 msgr2=0x7fb87c0d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 --2- 172.21.15.2:0/1405840128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0cded0 0x7fb87c0d0410 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0097c0 tx=0x7fb86c01ec70 comp rx=0 tx=0).stop 2023-11-04T01:47:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- 172.21.15.2:0/1405840128 shutdown_connections 2023-11-04T01:47:45.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 --2- 172.21.15.2:0/1405840128 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0d28c0 0x7fb87c1610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 --2- 172.21.15.2:0/1405840128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0cded0 0x7fb87c0d0410 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- 172.21.15.2:0/1405840128 >> 172.21.15.2:0/1405840128 conn(0x7fb87c0cf920 msgr2=0x7fb87c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- 172.21.15.2:0/1405840128 shutdown_connections 2023-11-04T01:47:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- 172.21.15.2:0/1405840128 wait complete. 2023-11-04T01:47:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 Processor -- start 2023-11-04T01:47:45.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- start start 2023-11-04T01:47:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0cded0 0x7fb87c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0ce2b0 0x7fb87c1f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb87c0d28c0 0x7fb87c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c156e50 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0cc560 con 0x7fb87c0d28c0 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb881fea640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c1f2c10 con 0x7fb87c0cded0 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0ce2b0 0x7fb87c1f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0ce2b0 0x7fb87c1f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56048/0 (socket says 172.21.15.2:56048) 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 -- 172.21.15.2:0/2826289339 learned_addr learned my addr 172.21.15.2:0/2826289339 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87b7fe640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0cded0 0x7fb87c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 -- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0cded0 msgr2=0x7fb87c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0cded0 0x7fb87c0cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 -- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb87c0d28c0 msgr2=0x7fb87c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb87c0d28c0 0x7fb87c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87affd640 1 -- 172.21.15.2:0/2826289339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009420 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.523+0000 7fb87b7fe640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0cded0 0x7fb87c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb87affd640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0ce2b0 0x7fb87c1f26d0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fb87000c7c0 tx=0x7fb87000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb863fff640 1 -- 172.21.15.2:0/2826289339 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870007a30 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb863fff640 1 -- 172.21.15.2:0/2826289339 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb870007b90 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c0caf80 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb863fff640 1 -- 172.21.15.2:0/2826289339 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000ce70 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c0cb540 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c04e4a0 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb863fff640 1 -- 172.21.15.2:0/2826289339 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb8700113f0 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb863fff640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb8680664a0 0x7fb868068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb863fff640 1 -- 172.21.15.2:0/2826289339 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7fb870084840 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb87b7fe640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb8680664a0 0x7fb868068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:45.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.527+0000 7fb87b7fe640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb8680664a0 0x7fb868068960 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0b2000 tx=0x7fb86c0aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:45.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.531+0000 7fb863fff640 1 -- 172.21.15.2:0/2826289339 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb870051760 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.723+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb87c0cfe90 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.723+0000 7fb863fff640 1 -- 172.21.15.2:0/2826289339 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4922 (secure 0 0 0) 0x7fb87001e090 con 0x7fb87c0ce2b0 2023-11-04T01:47:45.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:45.728 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:40.926106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:45.728 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 82 2023-11-04T01:47:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb8680664a0 msgr2=0x7fb868068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb8680664a0 0x7fb868068960 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0b2000 tx=0x7fb86c0aa070 comp rx=0 tx=0).stop 2023-11-04T01:47:45.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0ce2b0 msgr2=0x7fb87c1f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0ce2b0 0x7fb87c1f26d0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fb87000c7c0 tx=0x7fb87000cc80 comp rx=0 tx=0).stop 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 shutdown_connections 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb8680664a0 0x7fb868068960 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb87c0d28c0 0x7fb87c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb87c0ce2b0 0x7fb87c1f26d0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 --2- 172.21.15.2:0/2826289339 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb87c0cded0 0x7fb87c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 >> 172.21.15.2:0/2826289339 conn(0x7fb87c0cf920 msgr2=0x7fb87c15bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 shutdown_connections 2023-11-04T01:47:45.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:45.727+0000 7fb881fea640 1 -- 172.21.15.2:0/2826289339 wait complete. 2023-11-04T01:47:45.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:47:45.892 INFO:teuthology.orchestra.run.smithi090.stdout:{"last_snap":9,"last_created":5,"last_destroyed":8,"pending_noop":[],"snaps":[{"snapid":5,"ino":1099511627777,"stamp":"2023-11-04T01:47:20.783514+0000","name":"s16","metadata":{}}],"need_to_purge":{"16":[2,3,4,6,7,8]},"pending_update":[],"pending_destroy":[{"version":16,"removed_snap":5,"seq":9}]} 2023-11-04T01:47:45.892 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 8, "last_snap": 9, "need_to_purge": { "16": [ 2, 3, 4, 6, 7, 8 ] }, "pending_destroy": [ { "removed_snap": 5, "seq": 9, "version": 16 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s16", "snapid": 5, "stamp": "2023-11-04T01:47:20.783514+0000" } ] } 2023-11-04T01:47:45.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:47:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.019+0000 7f5555a20640 1 Processor -- start 2023-11-04T01:47:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.019+0000 7f5555a20640 1 -- start start 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f5555a20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f55501556c0 0x7f555015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f5555a20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f55500cabd0 0x7f55500cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f5555a20640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555015c600 con 0x7f55500c9360 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f5555a20640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55500cb5c0 con 0x7f55500cabd0 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f5555a20640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555006fe50 con 0x7f55501556c0 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f55500c9360 0x7f55500c97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38856/0 (socket says 172.21.15.2:38856) 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554f7fe640 1 -- 172.21.15.2:0/3991375372 learned_addr learned my addr 172.21.15.2:0/3991375372 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554e7fc640 1 --2- 172.21.15.2:0/3991375372 >> v2:172.21.15.2:3300/0 conn(0x7f55500cabd0 0x7f55500cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554effd640 1 --2- 172.21.15.2:0/3991375372 >> v2:172.21.15.90:3300/0 conn(0x7f55501556c0 0x7f555015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554dffb640 1 -- 172.21.15.2:0/3991375372 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549910493 0 0) 0x7f555015c600 con 0x7f55500c9360 2023-11-04T01:47:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554dffb640 1 -- 172.21.15.2:0/3991375372 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f553c003530 con 0x7f55500c9360 2023-11-04T01:47:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554e7fc640 1 -- 172.21.15.2:0/3991375372 >> v2:172.21.15.90:3300/0 conn(0x7f55501556c0 msgr2=0x7f555015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554e7fc640 1 --2- 172.21.15.2:0/3991375372 >> v2:172.21.15.90:3300/0 conn(0x7f55501556c0 0x7f555015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554e7fc640 1 -- 172.21.15.2:0/3991375372 >> v1:172.21.15.2:6789/0 conn(0x7f55500c9360 legacy=0x7f55500c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554e7fc640 1 -- 172.21.15.2:0/3991375372 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500ae7f0 con 0x7f55500cabd0 2023-11-04T01:47:46.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554e7fc640 1 --2- 172.21.15.2:0/3991375372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f55500cb080 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f55380097c0 tx=0x7f553801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475fb0e4192f1db7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:46.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554dffb640 1 -- 172.21.15.2:0/3991375372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55380ab610 con 0x7f55500cabd0 2023-11-04T01:47:46.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554dffb640 1 -- 172.21.15.2:0/3991375372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55380ab770 con 0x7f55500cabd0 2023-11-04T01:47:46.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f554dffb640 1 -- 172.21.15.2:0/3991375372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55380abae0 con 0x7f55500cabd0 2023-11-04T01:47:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f5555a20640 1 -- 172.21.15.2:0/3991375372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 msgr2=0x7f55500cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.023+0000 7f5555a20640 1 --2- 172.21.15.2:0/3991375372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f55500cb080 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f55380097c0 tx=0x7f553801c410 comp rx=0 tx=0).stop 2023-11-04T01:47:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- 172.21.15.2:0/3991375372 shutdown_connections 2023-11-04T01:47:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 --2- 172.21.15.2:0/3991375372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f55500cb080 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 --2- 172.21.15.2:0/3991375372 >> v2:172.21.15.90:3300/0 conn(0x7f55501556c0 0x7f555015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- 172.21.15.2:0/3991375372 >> 172.21.15.2:0/3991375372 conn(0x7f55500ced10 msgr2=0x7f55500cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- 172.21.15.2:0/3991375372 shutdown_connections 2023-11-04T01:47:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- 172.21.15.2:0/3991375372 wait complete. 2023-11-04T01:47:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 Processor -- start 2023-11-04T01:47:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- start start 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55500c9360 0x7f555014cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f5550146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55501556c0 0x7f55500afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555014d7d0 con 0x7f55500cabd0 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555014dab0 con 0x7f55501556c0 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555014dd90 con 0x7f55500c9360 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f5550146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f5550146d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56058/0 (socket says 172.21.15.2:56058) 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 -- 172.21.15.2:0/4067584730 learned_addr learned my addr 172.21.15.2:0/4067584730 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554f7fe640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55501556c0 0x7f55500afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554effd640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55500c9360 0x7f555014cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 -- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55500c9360 msgr2=0x7f555014cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55500c9360 0x7f555014cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 -- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55501556c0 msgr2=0x7f55500afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55501556c0 0x7f55500afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 -- 172.21.15.2:0/4067584730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538009420 con 0x7f55500cabd0 2023-11-04T01:47:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f554e7fc640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f5550146d10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f553801aac0 tx=0x7f553801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5547fff640 1 -- 172.21.15.2:0/4067584730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55380bf610 con 0x7f55500cabd0 2023-11-04T01:47:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5547fff640 1 -- 172.21.15.2:0/4067584730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55380bf770 con 0x7f55500cabd0 2023-11-04T01:47:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555014e070 con 0x7f55500cabd0 2023-11-04T01:47:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5547fff640 1 -- 172.21.15.2:0/4067584730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55380bfae0 con 0x7f55500cabd0 2023-11-04T01:47:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.027+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5550147250 con 0x7f55500cabd0 2023-11-04T01:47:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.031+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55500cc970 con 0x7f55500cabd0 2023-11-04T01:47:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.031+0000 7f5547fff640 1 -- 172.21.15.2:0/4067584730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f55380b5400 con 0x7f55500cabd0 2023-11-04T01:47:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.031+0000 7f5547fff640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55300664a0 0x7f5530068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.031+0000 7f5547fff640 1 -- 172.21.15.2:0/4067584730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 7232+0+0 (secure 0 0 0) 0x7f553811f090 con 0x7f55500cabd0 2023-11-04T01:47:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.031+0000 7f554effd640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55300664a0 0x7f5530068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.031+0000 7f554effd640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55300664a0 0x7f5530068960 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5540003fd0 tx=0x7f55400039c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:46.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.035+0000 7f5547fff640 1 -- 172.21.15.2:0/4067584730 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f55500cc970 con 0x7f55500cabd0 2023-11-04T01:47:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.247+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7f55500cc970 con 0x7f55500cabd0 2023-11-04T01:47:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.955+0000 7f5547fff640 1 -- 172.21.15.2:0/4067584730 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.5807 v83) v1 ==== 112+0+0 (secure 0 0 0) 0x7f55500cc970 con 0x7f55500cabd0 2023-11-04T01:47:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.5807 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55300664a0 msgr2=0x7f5530068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55300664a0 0x7f5530068960 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5540003fd0 tx=0x7f55400039c0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 msgr2=0x7f5550146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f5550146d10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f553801aac0 tx=0x7f553801ac50 comp rx=0 tx=0).stop 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 shutdown_connections 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f55300664a0 0x7f5530068960 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55501556c0 0x7f55500afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55500cabd0 0x7f5550146d10 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 --2- 172.21.15.2:0/4067584730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f55500c9360 0x7f555014cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 >> 172.21.15.2:0/4067584730 conn(0x7f55500ced10 msgr2=0x7f55500b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 shutdown_connections 2023-11-04T01:47:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:46.959+0000 7f5555a20640 1 -- 172.21.15.2:0/4067584730 wait complete. 2023-11-04T01:47:47.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:47:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d69eb5640 1 Processor -- start 2023-11-04T01:47:47.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d69eb5640 1 -- start start 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d69eb5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d640d1cb0 0x7f0d640d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d69eb5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0d6415d5a0 0x7f0d640b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d69eb5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d640d09b0 con 0x7f0d6415d1c0 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d69eb5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640d0110 con 0x7f0d6415d5a0 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d69eb5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d640d03f0 con 0x7f0d640d1cb0 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d63fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0d6415d5a0 0x7f0d640b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d637fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0d6415d1c0 0x7f0d640d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38860/0 (socket says 172.21.15.2:38860) 2023-11-04T01:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.123+0000 7f0d637fe640 1 -- 172.21.15.2:0/1163202512 learned_addr learned my addr 172.21.15.2:0/1163202512 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:47.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d62ffd640 1 --2- 172.21.15.2:0/1163202512 >> v2:172.21.15.90:3300/0 conn(0x7f0d640d1cb0 0x7f0d640d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d63fff640 1 -- 172.21.15.2:0/1163202512 >> v2:172.21.15.90:3300/0 conn(0x7f0d640d1cb0 msgr2=0x7f0d640d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:47.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d63fff640 1 --2- 172.21.15.2:0/1163202512 >> v2:172.21.15.90:3300/0 conn(0x7f0d640d1cb0 0x7f0d640d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d63fff640 1 -- 172.21.15.2:0/1163202512 >> v1:172.21.15.2:6789/0 conn(0x7f0d6415d1c0 legacy=0x7f0d640d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d63fff640 1 -- 172.21.15.2:0/1163202512 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640d06d0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d63fff640 1 --2- 172.21.15.2:0/1163202512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d640b0240 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0d64073c30 tx=0x7f0d5c01c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca2edd826cfefb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d627fc640 1 -- 172.21.15.2:0/1163202512 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0a5790 con 0x7f0d6415d5a0 2023-11-04T01:47:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d627fc640 1 -- 172.21.15.2:0/1163202512 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c0a58f0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d627fc640 1 -- 172.21.15.2:0/1163202512 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0a5c80 con 0x7f0d6415d5a0 2023-11-04T01:47:47.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 -- 172.21.15.2:0/1163202512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 msgr2=0x7f0d640b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/1163202512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d640b0240 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0d64073c30 tx=0x7f0d5c01c770 comp rx=0 tx=0).stop 2023-11-04T01:47:47.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 -- 172.21.15.2:0/1163202512 shutdown_connections 2023-11-04T01:47:47.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/1163202512 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d640b0240 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/1163202512 >> v2:172.21.15.90:3300/0 conn(0x7f0d640d1cb0 0x7f0d640d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 -- 172.21.15.2:0/1163202512 >> 172.21.15.2:0/1163202512 conn(0x7f0d640d2fc0 msgr2=0x7f0d640d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 -- 172.21.15.2:0/1163202512 shutdown_connections 2023-11-04T01:47:47.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.127+0000 7f0d69eb5640 1 -- 172.21.15.2:0/1163202512 wait complete. 2023-11-04T01:47:47.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 Processor -- start 2023-11-04T01:47:47.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 -- start start 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d640d1cb0 0x7f0d640b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d6415d1c0 0x7f0d640b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d64155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640b8ee0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640b73e0 con 0x7f0d640d1cb0 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d640cb540 con 0x7f0d6415d1c0 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d64155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d64155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56064/0 (socket says 172.21.15.2:56064) 2023-11-04T01:47:47.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 -- 172.21.15.2:0/599915658 learned_addr learned my addr 172.21.15.2:0/599915658 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d637fe640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d640d1cb0 0x7f0d640b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d62ffd640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d6415d1c0 0x7f0d640b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 -- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d6415d1c0 msgr2=0x7f0d640b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d6415d1c0 0x7f0d640b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 -- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d640d1cb0 msgr2=0x7f0d640b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d640d1cb0 0x7f0d640b89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 -- 172.21.15.2:0/599915658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c009a70 con 0x7f0d6415d5a0 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d637fe640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d640d1cb0 0x7f0d640b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d62ffd640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d6415d1c0 0x7f0d640b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d63fff640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d64155a50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0b0040 tx=0x7f0d5c019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d4bfff640 1 -- 172.21.15.2:0/599915658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0b9860 con 0x7f0d6415d5a0 2023-11-04T01:47:47.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d4bfff640 1 -- 172.21.15.2:0/599915658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c0b99c0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d640cbed0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d4bfff640 1 -- 172.21.15.2:0/599915658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c0b9d50 con 0x7f0d6415d5a0 2023-11-04T01:47:47.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d640cba70 con 0x7f0d6415d5a0 2023-11-04T01:47:47.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.131+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6404e4a0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.135+0000 7f0d4bfff640 1 -- 172.21.15.2:0/599915658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0d5c0c4460 con 0x7f0d6415d5a0 2023-11-04T01:47:47.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.135+0000 7f0d4bfff640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d500664a0 0x7f0d50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:47.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.135+0000 7f0d4bfff640 1 -- 172.21.15.2:0/599915658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 7320+0+0 (secure 0 0 0) 0x7f0d5c11f910 con 0x7f0d6415d5a0 2023-11-04T01:47:47.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.135+0000 7f0d637fe640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d500664a0 0x7f0d50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:47.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.135+0000 7f0d637fe640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d500664a0 0x7f0d50068960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000f70 tx=0x7f0d58009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:47.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.139+0000 7f0d4bfff640 1 -- 172.21.15.2:0/599915658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0d5c0ec6a0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.355+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f0d6404e4a0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.955+0000 7f0d4bfff640 1 -- 172.21.15.2:0/599915658 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.7128 v84) v1 ==== 112+0+0 (secure 0 0 0) 0x7f0d5c0b20a0 con 0x7f0d6415d5a0 2023-11-04T01:47:47.962 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.7128 2023-11-04T01:47:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d500664a0 msgr2=0x7f0d50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d500664a0 0x7f0d50068960 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0d58000f70 tx=0x7f0d58009040 comp rx=0 tx=0).stop 2023-11-04T01:47:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 msgr2=0x7f0d64155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d64155a50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0b0040 tx=0x7f0d5c019510 comp rx=0 tx=0).stop 2023-11-04T01:47:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 shutdown_connections 2023-11-04T01:47:47.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0d500664a0 0x7f0d50068960 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0d6415d5a0 0x7f0d64155a50 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0d6415d1c0 0x7f0d640b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 --2- 172.21.15.2:0/599915658 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d640d1cb0 0x7f0d640b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:47.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 >> 172.21.15.2:0/599915658 conn(0x7f0d640d2fc0 msgr2=0x7f0d64159120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:47.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 shutdown_connections 2023-11-04T01:47:47.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:47.959+0000 7f0d69eb5640 1 -- 172.21.15.2:0/599915658 wait complete. 2023-11-04T01:47:47.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json config set mds_kill_mdstable_at 2 2023-11-04T01:47:48.134 INFO:teuthology.orchestra.run.smithi090.stdout:{"success":"mds_kill_mdstable_at = '2' (not observed, change may require restart) "} 2023-11-04T01:47:48.135 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '2' (not observed, change may require restart) " } 2023-11-04T01:47:48.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:47:48.135 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s22) 2023-11-04T01:47:48.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:47:48.161 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd1b157640 time 2023-11-04T01:47:48.163042+0000 2023-11-04T01:47:48.161 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:47:48.162 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.162 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd2728ffae] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:47:48.162+0000 7fcd1b157640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd1b157640 time 2023-11-04T01:47:48.163042+0000 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.163 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd2728ffae] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:47:48.164 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7fcd1b157640 thread_name:MR_Finisher 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd26bca520] 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd27290008] 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.165 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:47:48.162+0000 7fcd1b157640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7fcd1b157640 thread_name:MR_Finisher 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd26bca520] 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd27290008] 2023-11-04T01:47:48.166 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:48.167 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.170 INFO:tasks.ceph.mds.d.smithi090.stderr: -893> 2023-11-04T01:47:42.706+0000 7fcd1e95e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:48.170 INFO:tasks.ceph.mds.d.smithi090.stderr: -891> 2023-11-04T01:47:42.706+0000 7fcd1e95e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:48.172 INFO:tasks.ceph.mds.d.smithi090.stderr: -1> 2023-11-04T01:47:48.162+0000 7fcd1b157640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd1b157640 time 2023-11-04T01:47:48.163042+0000 2023-11-04T01:47:48.172 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:47:48.172 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.172 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd2728ffae] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 0> 2023-11-04T01:47:48.162+0000 7fcd1b157640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7fcd1b157640 thread_name:MR_Finisher 2023-11-04T01:47:48.173 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd26bca520] 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd27290008] 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.174 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.175 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.175 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.175 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:48.175 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.178 INFO:tasks.ceph.mds.d.smithi090.stderr: -893> 2023-11-04T01:47:42.706+0000 7fcd1e95e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:47:48.178 INFO:tasks.ceph.mds.d.smithi090.stderr: -891> 2023-11-04T01:47:42.706+0000 7fcd1e95e640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:47:48.179 INFO:tasks.ceph.mds.d.smithi090.stderr: -1> 2023-11-04T01:47:48.162+0000 7fcd1b157640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_prepare_logged(ceph::cref_t&, version_t)' thread 7fcd1b157640 time 2023-11-04T01:47:48.163042+0000 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr:./src/mds/MDSTableServer.cc: 77: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 2) 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fcd2728ffae] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.180 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 0> 2023-11-04T01:47:48.162+0000 7fcd1b157640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: in thread 7fcd1b157640 thread_name:MR_Finisher 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fcd26bca520] 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 2: pthread_kill() 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 3: raise() 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 4: abort() 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fcd27290008] 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fcd27290162] 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 7: (MDSTableServer::_prepare_logged(boost::intrusive_ptr const&, unsigned long)+0x735) [0x55ae5d60e4c5] 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 8: (MDSContext::complete(int)+0x5c) [0x55ae5d64308c] 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x55ae5d6434bc] 2023-11-04T01:47:48.181 INFO:tasks.ceph.mds.d.smithi090.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x55ae5d6435f3] 2023-11-04T01:47:48.182 INFO:tasks.ceph.mds.d.smithi090.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fcd27336305] 2023-11-04T01:47:48.182 INFO:tasks.ceph.mds.d.smithi090.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fcd26c1cb43] 2023-11-04T01:47:48.182 INFO:tasks.ceph.mds.d.smithi090.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fcd26caea00] 2023-11-04T01:47:48.182 INFO:tasks.ceph.mds.d.smithi090.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:47:48.182 INFO:tasks.ceph.mds.d.smithi090.stderr: 2023-11-04T01:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:47:48.320 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:47:48.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:48.408 INFO:tasks.ceph.mds.d.smithi090.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:47:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f59990b4640 1 Processor -- start 2023-11-04T01:47:48.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f59990b4640 1 -- start start 2023-11-04T01:47:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f59990b4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142ad0 0x7f599415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f59990b4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f59940cbd80 0x7f59940cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f59990b4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59940ca100 con 0x7f5994142eb0 2023-11-04T01:47:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f59990b4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59940ca3e0 con 0x7f59940cbd80 2023-11-04T01:47:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f59990b4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59940ca6c0 con 0x7f5994142ad0 2023-11-04T01:47:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f598bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5994142eb0 0x7f59940cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:38870/0 (socket says 172.21.15.2:38870) 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f598bfff640 1 -- 172.21.15.2:0/4138498407 learned_addr learned my addr 172.21.15.2:0/4138498407 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599359e640 1 --2- 172.21.15.2:0/4138498407 >> v2:172.21.15.90:3300/0 conn(0x7f59940cbd80 0x7f59940cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f5992d9d640 1 --2- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142ad0 0x7f599415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599259c640 1 -- 172.21.15.2:0/4138498407 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498125750 0 0) 0x7f59940ca100 con 0x7f5994142eb0 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599259c640 1 -- 172.21.15.2:0/4138498407 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5980005740 con 0x7f5994142eb0 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599259c640 1 -- 172.21.15.2:0/4138498407 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3907740819 0 0) 0x7f5980005740 con 0x7f5994142eb0 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599359e640 1 -- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142ad0 msgr2=0x7f599415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599359e640 1 --2- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142ad0 0x7f599415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599359e640 1 -- 172.21.15.2:0/4138498407 >> v1:172.21.15.2:6789/0 conn(0x7f5994142eb0 legacy=0x7f59940cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.443+0000 7f599359e640 1 -- 172.21.15.2:0/4138498407 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940ca9a0 con 0x7f59940cbd80 2023-11-04T01:47:48.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f599359e640 1 --2- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59940cbd80 0x7f59940cc830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f598c009d90 tx=0x7f598c01c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b30d5e7d193a0bfc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f599259c640 1 -- 172.21.15.2:0/4138498407 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0016a0 con 0x7f59940cbd80 2023-11-04T01:47:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f599259c640 1 -- 172.21.15.2:0/4138498407 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c0a5600 con 0x7f59940cbd80 2023-11-04T01:47:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f599259c640 1 -- 172.21.15.2:0/4138498407 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0a5970 con 0x7f59940cbd80 2023-11-04T01:47:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59940cbd80 msgr2=0x7f59940cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 --2- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59940cbd80 0x7f59940cc830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f598c009d90 tx=0x7f598c01c7e0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- 172.21.15.2:0/4138498407 shutdown_connections 2023-11-04T01:47:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 --2- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59940cbd80 0x7f59940cc830 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 --2- 172.21.15.2:0/4138498407 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142ad0 0x7f599415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- 172.21.15.2:0/4138498407 >> 172.21.15.2:0/4138498407 conn(0x7f59940b0890 msgr2=0x7f59940b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- 172.21.15.2:0/4138498407 shutdown_connections 2023-11-04T01:47:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- 172.21.15.2:0/4138498407 wait complete. 2023-11-04T01:47:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 Processor -- start 2023-11-04T01:47:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- start start 2023-11-04T01:47:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59940cbd80 0x7f5994157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5994142ad0 0x7f59941593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142eb0 0x7f599413d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599413e200 con 0x7f59940cbd80 2023-11-04T01:47:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59941408c0 con 0x7f5994142ad0 2023-11-04T01:47:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f59990b4640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5994159900 con 0x7f5994142eb0 2023-11-04T01:47:48.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.447+0000 7f5992d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59940cbd80 0x7f5994157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59940cbd80 0x7f5994157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56078/0 (socket says 172.21.15.2:56078) 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 -- 172.21.15.2:0/338449626 learned_addr learned my addr 172.21.15.2:0/338449626 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f599359e640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142eb0 0x7f599413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598bfff640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5994142ad0 0x7f59941593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 -- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142eb0 msgr2=0x7f599413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142eb0 0x7f599413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 -- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5994142ad0 msgr2=0x7f59941593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5994142ad0 0x7f59941593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 -- 172.21.15.2:0/338449626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c009a70 con 0x7f59940cbd80 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598bfff640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5994142ad0 0x7f59941593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f599359e640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142eb0 0x7f599413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f5992d9d640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59940cbd80 0x7f5994157590 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f598400e930 tx=0x7f598400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598b7fe640 1 -- 172.21.15.2:0/338449626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984009690 con 0x7f59940cbd80 2023-11-04T01:47:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598b7fe640 1 -- 172.21.15.2:0/338449626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598400c9a0 con 0x7f59940cbd80 2023-11-04T01:47:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599413df20 con 0x7f59940cbd80 2023-11-04T01:47:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598b7fe640 1 -- 172.21.15.2:0/338449626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598400cd10 con 0x7f59940cbd80 2023-11-04T01:47:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5994140550 con 0x7f59940cbd80 2023-11-04T01:47:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599404e4a0 con 0x7f59940cbd80 2023-11-04T01:47:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598b7fe640 1 -- 172.21.15.2:0/338449626 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5984013470 con 0x7f59940cbd80 2023-11-04T01:47:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598b7fe640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59740664a0 0x7f5974068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598b7fe640 1 -- 172.21.15.2:0/338449626 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7304+0+0 (secure 0 0 0) 0x7f59840846f0 con 0x7f59940cbd80 2023-11-04T01:47:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598bfff640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59740664a0 0x7f5974068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:48.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.451+0000 7f598bfff640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59740664a0 0x7f5974068960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f597c001ec0 tx=0x7f597c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:48.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.455+0000 7f598b7fe640 1 -- 172.21.15.2:0/338449626 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59840515f0 con 0x7f59940cbd80 2023-11-04T01:47:48.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.647+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f599406d010 con 0x7f59940cbd80 2023-11-04T01:47:48.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f598b7fe640 1 -- 172.21.15.2:0/338449626 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f5984054c10 con 0x7f59940cbd80 2023-11-04T01:47:48.655 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:48.656 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:47.360656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 84 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59740664a0 msgr2=0x7f5974068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59740664a0 0x7f5974068960 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f597c001ec0 tx=0x7f597c009040 comp rx=0 tx=0).stop 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59940cbd80 msgr2=0x7f5994157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59940cbd80 0x7f5994157590 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f598400e930 tx=0x7f598400edf0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 shutdown_connections 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f59740664a0 0x7f5974068960 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5994142eb0 0x7f599413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5994142ad0 0x7f59941593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 --2- 172.21.15.2:0/338449626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59940cbd80 0x7f5994157590 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:48.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 >> 172.21.15.2:0/338449626 conn(0x7f59940b0890 msgr2=0x7f59940cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 shutdown_connections 2023-11-04T01:47:48.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:48.651+0000 7f59990b4640 1 -- 172.21.15.2:0/338449626 wait complete. 2023-11-04T01:47:48.673 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:48.824 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:47:53.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:53.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd37f8640 1 Processor -- start 2023-11-04T01:47:53.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd37f8640 1 -- start start 2023-11-04T01:47:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd37f8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bcc06bde0 0x7f0bcc0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd37f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc0c92b0 0x7f0bcc15c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd37f8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0c9ac0 con 0x7f0bcc06c1c0 2023-11-04T01:47:53.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd37f8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0caf20 con 0x7f0bcc06bde0 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd37f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc15c5d0 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd1594640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bcc06bde0 0x7f0bcc0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd1d95640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0bcc06c1c0 0x7f0bcc1442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56682/0 (socket says 172.21.15.2:56682) 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd1d95640 1 -- 172.21.15.2:0/1736377589 learned_addr learned my addr 172.21.15.2:0/1736377589 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd0d93640 1 --2- 172.21.15.2:0/1736377589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc0c92b0 0x7f0bcc15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1736377589 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750812972 0 0) 0x7f0bcc0c9ac0 con 0x7f0bcc06c1c0 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1736377589 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb8003530 con 0x7f0bcc06c1c0 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd1594640 1 -- 172.21.15.2:0/1736377589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc0c92b0 msgr2=0x7f0bcc15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd1594640 1 --2- 172.21.15.2:0/1736377589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc0c92b0 0x7f0bcc15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd1594640 1 -- 172.21.15.2:0/1736377589 >> v1:172.21.15.2:6789/0 conn(0x7f0bcc06c1c0 legacy=0x7f0bcc1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd1594640 1 -- 172.21.15.2:0/1736377589 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0c97e0 con 0x7f0bcc06bde0 2023-11-04T01:47:53.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.803+0000 7f0bd0d93640 1 --2- 172.21.15.2:0/1736377589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc0c92b0 0x7f0bcc15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd1594640 1 --2- 172.21.15.2:0/1736377589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc06bde0 0x7f0bcc0cbca0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80097c0 tx=0x7f0bc801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106cfb0d83f8cce7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1736377589 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80ab600 con 0x7f0bcc06bde0 2023-11-04T01:47:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1736377589 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc80a7050 con 0x7f0bcc06bde0 2023-11-04T01:47:53.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bc3fff640 1 -- 172.21.15.2:0/1736377589 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80ab980 con 0x7f0bcc06bde0 2023-11-04T01:47:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 -- 172.21.15.2:0/1736377589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc06bde0 msgr2=0x7f0bcc0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/1736377589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc06bde0 0x7f0bcc0cbca0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80097c0 tx=0x7f0bc801c480 comp rx=0 tx=0).stop 2023-11-04T01:47:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 -- 172.21.15.2:0/1736377589 shutdown_connections 2023-11-04T01:47:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/1736377589 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc0c92b0 0x7f0bcc15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/1736377589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc06bde0 0x7f0bcc0cbca0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 -- 172.21.15.2:0/1736377589 >> 172.21.15.2:0/1736377589 conn(0x7f0bcc0b0890 msgr2=0x7f0bcc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 -- 172.21.15.2:0/1736377589 shutdown_connections 2023-11-04T01:47:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 -- 172.21.15.2:0/1736377589 wait complete. 2023-11-04T01:47:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 Processor -- start 2023-11-04T01:47:53.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.807+0000 7f0bd37f8640 1 -- start start 2023-11-04T01:47:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc06bde0 0x7f0bcc1435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bcc06c1c0 0x7f0bcc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0c92b0 0x7f0bcc13b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b1d20 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b2000 con 0x7f0bcc06c1c0 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0b22e0 con 0x7f0bcc06bde0 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0c92b0 0x7f0bcc13b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0c92b0 0x7f0bcc13b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46626/0 (socket says 172.21.15.2:46626) 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 -- 172.21.15.2:0/118000051 learned_addr learned my addr 172.21.15.2:0/118000051 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1594640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc06bde0 0x7f0bcc1435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd0d93640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bcc06c1c0 0x7f0bcc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 -- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc06bde0 msgr2=0x7f0bcc1435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc06bde0 0x7f0bcc1435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 -- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bcc06c1c0 msgr2=0x7f0bcc15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bcc06c1c0 0x7f0bcc15aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 -- 172.21.15.2:0/118000051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8009420 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1594640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc06bde0 0x7f0bcc1435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd0d93640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bcc06c1c0 0x7f0bcc15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1d95640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0c92b0 0x7f0bcc13b840 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400cb40 tx=0x7f0bc400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bc1ffb640 1 -- 172.21.15.2:0/118000051 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400aca0 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bc1ffb640 1 -- 172.21.15.2:0/118000051 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc400ae00 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bc1ffb640 1 -- 172.21.15.2:0/118000051 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4012620 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc0b25c0 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc15b430 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0b2ae0 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bc1ffb640 1 -- 172.21.15.2:0/118000051 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0bc4007070 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bc1ffb640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bb00664a0 0x7f0bb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bc1ffb640 1 -- 172.21.15.2:0/118000051 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 7304+0+0 (secure 0 0 0) 0x7f0bc40844b0 con 0x7f0bcc0c92b0 2023-11-04T01:47:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.811+0000 7f0bd1594640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bb00664a0 0x7f0bb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:53.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.815+0000 7f0bd1594640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bb00664a0 0x7f0bb0068960 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80ad000 tx=0x7f0bc80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:53.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:53.819+0000 7f0bc1ffb640 1 -- 172.21.15.2:0/118000051 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0bc4051380 con 0x7f0bcc0c92b0 2023-11-04T01:47:54.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.007+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bcc04e4a0 con 0x7f0bcc0c92b0 2023-11-04T01:47:54.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.007+0000 7f0bc1ffb640 1 -- 172.21.15.2:0/118000051 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f0bc40549a0 con 0x7f0bcc0c92b0 2023-11-04T01:47:54.013 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:54.013 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:47.360656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:54.013 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 84 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bb00664a0 msgr2=0x7f0bb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bb00664a0 0x7f0bb0068960 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80ad000 tx=0x7f0bc80a6000 comp rx=0 tx=0).stop 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0c92b0 msgr2=0x7f0bcc13b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0c92b0 0x7f0bcc13b840 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400cb40 tx=0x7f0bc400a060 comp rx=0 tx=0).stop 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 shutdown_connections 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0bb00664a0 0x7f0bb0068960 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bcc0c92b0 0x7f0bcc13b840 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bcc06c1c0 0x7f0bcc15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 --2- 172.21.15.2:0/118000051 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0bcc06bde0 0x7f0bcc1435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:54.015 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 >> 172.21.15.2:0/118000051 conn(0x7f0bcc0b0890 msgr2=0x7f0bcc070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 shutdown_connections 2023-11-04T01:47:54.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:54.011+0000 7f0bd37f8640 1 -- 172.21.15.2:0/118000051 wait complete. 2023-11-04T01:47:54.030 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:47:55.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:55.101 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:47:55.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-11-04T01:47:59.031 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:47:59.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.159+0000 7f14a328e640 1 Processor -- start 2023-11-04T01:47:59.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.159+0000 7f14a328e640 1 -- start start 2023-11-04T01:47:59.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a328e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c0cb8b0 0x7f149c0cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a328e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149c162860 0x7f149c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a328e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c161da0 con 0x7f149c0ccd70 2023-11-04T01:47:59.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a328e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149c161bb0 con 0x7f149c162860 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a328e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0cd200 con 0x7f149c0cb8b0 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149c162860 0x7f149c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f149c162860 0x7f149c0cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46630/0 (socket says 172.21.15.2:46630) 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a182b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f149c0ccd70 0x7f149c1651a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56692/0 (socket says 172.21.15.2:56692) 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 -- 172.21.15.2:0/3011497396 learned_addr learned my addr 172.21.15.2:0/3011497396 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a102a640 1 --2- 172.21.15.2:0/3011497396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c0cb8b0 0x7f149c0cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 -- 172.21.15.2:0/3011497396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c0cb8b0 msgr2=0x7f149c0cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 --2- 172.21.15.2:0/3011497396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c0cb8b0 0x7f149c0cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 -- 172.21.15.2:0/3011497396 >> v1:172.21.15.2:6789/0 conn(0x7f149c0ccd70 legacy=0x7f149c1651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f1493fff640 1 -- 172.21.15.2:0/3011497396 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222430592 0 0) 0x7f149c161da0 con 0x7f149c0ccd70 2023-11-04T01:47:59.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 -- 172.21.15.2:0/3011497396 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c165ed0 con 0x7f149c162860 2023-11-04T01:47:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f14a0829640 1 --2- 172.21.15.2:0/3011497396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c162860 0x7f149c0cc830 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f148c009870 tx=0x7f148c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b92cf5d18b5abf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.163+0000 7f1493fff640 1 -- 172.21.15.2:0/3011497396 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0ab650 con 0x7f149c162860 2023-11-04T01:47:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f1493fff640 1 -- 172.21.15.2:0/3011497396 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0ab7b0 con 0x7f149c162860 2023-11-04T01:47:59.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f1493fff640 1 -- 172.21.15.2:0/3011497396 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0abb40 con 0x7f149c162860 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- 172.21.15.2:0/3011497396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c162860 msgr2=0x7f149c0cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 --2- 172.21.15.2:0/3011497396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c162860 0x7f149c0cc830 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f148c009870 tx=0x7f148c01c540 comp rx=0 tx=0).stop 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- 172.21.15.2:0/3011497396 shutdown_connections 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 --2- 172.21.15.2:0/3011497396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c162860 0x7f149c0cc830 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 --2- 172.21.15.2:0/3011497396 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c0cb8b0 0x7f149c0cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- 172.21.15.2:0/3011497396 >> 172.21.15.2:0/3011497396 conn(0x7f149c0b0890 msgr2=0x7f149c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- 172.21.15.2:0/3011497396 shutdown_connections 2023-11-04T01:47:59.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- 172.21.15.2:0/3011497396 wait complete. 2023-11-04T01:47:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 Processor -- start 2023-11-04T01:47:59.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- start start 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c0cb8b0 0x7f149c157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149c0ccd70 0x7f149c141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c162860 0x7f149c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c13d6d0 con 0x7f149c0cb8b0 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c13cac0 con 0x7f149c0ccd70 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c13cda0 con 0x7f149c162860 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c0cb8b0 0x7f149c157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c0cb8b0 0x7f149c157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46646/0 (socket says 172.21.15.2:46646) 2023-11-04T01:47:59.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 -- 172.21.15.2:0/3517643384 learned_addr learned my addr 172.21.15.2:0/3517643384 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a182b640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c162860 0x7f149c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a0829640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149c0ccd70 0x7f149c141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 -- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c162860 msgr2=0x7f149c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c162860 0x7f149c143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 -- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149c0ccd70 msgr2=0x7f149c141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149c0ccd70 0x7f149c141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 -- 172.21.15.2:0/3517643384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0094d0 con 0x7f149c0cb8b0 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a182b640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c162860 0x7f149c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a0829640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149c0ccd70 0x7f149c141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:47:59.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a102a640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c0cb8b0 0x7f149c157720 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f149800d5f0 tx=0x7f149800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f1491ffb640 1 -- 172.21.15.2:0/3517643384 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980125f0 con 0x7f149c0cb8b0 2023-11-04T01:47:59.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f1491ffb640 1 -- 172.21.15.2:0/3517643384 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1498012750 con 0x7f149c0cb8b0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c13d080 con 0x7f149c0cb8b0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f1491ffb640 1 -- 172.21.15.2:0/3517643384 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1498012ae0 con 0x7f149c0cb8b0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.167+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c157c60 con 0x7f149c0cb8b0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.171+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c04e4a0 con 0x7f149c0cb8b0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.171+0000 7f1491ffb640 1 -- 172.21.15.2:0/3517643384 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1498012c40 con 0x7f149c0cb8b0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.171+0000 7f1491ffb640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14800664a0 0x7f1480068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.171+0000 7f1491ffb640 1 -- 172.21.15.2:0/3517643384 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7260+0+0 (secure 0 0 0) 0x7f1498084970 con 0x7f149c0cb8b0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.171+0000 7f14a0829640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14800664a0 0x7f1480068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:47:59.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.171+0000 7f14a0829640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14800664a0 0x7f1480068960 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f148c0af000 tx=0x7f148c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:47:59.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.175+0000 7f1491ffb640 1 -- 172.21.15.2:0/3517643384 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f14980517e0 con 0x7f149c0cb8b0 2023-11-04T01:47:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.363+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f149c06cf10 con 0x7f149c0cb8b0 2023-11-04T01:47:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.363+0000 7f1491ffb640 1 -- 172.21.15.2:0/3517643384 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4922 (secure 0 0 0) 0x7f1498007380 con 0x7f149c0cb8b0 2023-11-04T01:47:59.368 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:47:59.368 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":84,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:47:47.360656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:47:59.369 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 84 2023-11-04T01:47:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14800664a0 msgr2=0x7f1480068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14800664a0 0x7f1480068960 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f148c0af000 tx=0x7f148c008040 comp rx=0 tx=0).stop 2023-11-04T01:47:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c0cb8b0 msgr2=0x7f149c157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c0cb8b0 0x7f149c157720 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f149800d5f0 tx=0x7f149800dab0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 shutdown_connections 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14800664a0 0x7f1480068960 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f149c162860 0x7f149c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f149c0ccd70 0x7f149c141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 --2- 172.21.15.2:0/3517643384 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f149c0cb8b0 0x7f149c157720 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 >> 172.21.15.2:0/3517643384 conn(0x7f149c0b0890 msgr2=0x7f149c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 shutdown_connections 2023-11-04T01:47:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:47:59.367+0000 7f14a328e640 1 -- 172.21.15.2:0/3517643384 wait complete. 2023-11-04T01:47:59.386 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:02.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-11-04T01:48:04.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:04.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a8679640 1 Processor -- start 2023-11-04T01:48:04.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a8679640 1 -- start start 2023-11-04T01:48:04.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a8679640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc7a00b72f0 0x7fc7a0167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a8679640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a00cf000 con 0x7fc7a0160a60 2023-11-04T01:48:04.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a8679640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a00b5de0 con 0x7fc7a0160680 2023-11-04T01:48:04.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a8679640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a00d09b0 con 0x7fc7a00b72f0 2023-11-04T01:48:04.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5c14640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc7a0160a60 0x7fc7a00ce2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42000/0 (socket says 172.21.15.2:42000) 2023-11-04T01:48:04.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5c14640 1 -- 172.21.15.2:0/1138520730 learned_addr learned my addr 172.21.15.2:0/1138520730 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:04.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6c16640 1 --2- 172.21.15.2:0/1138520730 >> v2:172.21.15.90:3300/0 conn(0x7fc7a00b72f0 0x7fc7a0167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930885829 0 0) 0x7fc7a00cf000 con 0x7fc7a0160a60 2023-11-04T01:48:04.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc78c003530 con 0x7fc7a0160a60 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 21896412 0 0) 0x7fc78c003530 con 0x7fc7a0160a60 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 >> v2:172.21.15.90:3300/0 conn(0x7fc7a00b72f0 msgr2=0x7fc7a0167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 --2- 172.21.15.2:0/1138520730 >> v2:172.21.15.90:3300/0 conn(0x7fc7a00b72f0 0x7fc7a0167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 >> v1:172.21.15.90:6789/0 conn(0x7fc7a0160680 legacy=0x7fc7a00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a00d1610 con 0x7fc7a0160a60 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc790001680 con 0x7fc7a0160a60 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 >> v1:172.21.15.2:6789/0 conn(0x7fc7a0160a60 legacy=0x7fc7a00ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c003980 0x7fc78c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0047d0 0x7fc78c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c005190 0x7fc78c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00d09b0 con 0x7fc78c005190 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c00c030 con 0x7fc78c003980 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c00c1f0 con 0x7fc78c0047d0 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6c16640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c005190 0x7fc78c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6415640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c003980 0x7fc78c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a5c14640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0047d0 0x7fc78c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6c16640 1 -- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0047d0 msgr2=0x7fc78c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6c16640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc78c0047d0 0x7fc78c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6c16640 1 -- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c003980 msgr2=0x7fc78c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6c16640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c003980 0x7fc78c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6c16640 1 -- 172.21.15.2:0/1138520730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c003530 con 0x7fc78c005190 2023-11-04T01:48:04.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.519+0000 7fc7a6415640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c003980 0x7fc78c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:04.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a6c16640 1 -- 172.21.15.2:0/1138520730 reap_dead start 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a6c16640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c005190 0x7fc78c00b990 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fc798009ae0 tx=0x7fc79801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dad573867bdd1fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798004020 con 0x7fc78c005190 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7980041c0 con 0x7fc78c005190 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a5413640 1 -- 172.21.15.2:0/1138520730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7980a5680 con 0x7fc78c005190 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 -- 172.21.15.2:0/1138520730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c005190 msgr2=0x7fc78c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c005190 0x7fc78c00b990 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fc798009ae0 tx=0x7fc79801ca90 comp rx=0 tx=0).stop 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 -- 172.21.15.2:0/1138520730 shutdown_connections 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1138520730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc78c005190 0x7fc78c00b990 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 -- 172.21.15.2:0/1138520730 >> 172.21.15.2:0/1138520730 conn(0x7fc7a00d2f90 msgr2=0x7fc7a00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 -- 172.21.15.2:0/1138520730 shutdown_connections 2023-11-04T01:48:04.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 -- 172.21.15.2:0/1138520730 wait complete. 2023-11-04T01:48:04.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 Processor -- start 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.523+0000 7fc7a8679640 1 -- start start 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c005190 0x7fc7a0155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0155540 0x7fc7a00c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7a00c7780 0x7fc7a00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00cbcd0 con 0x7fc7a0155540 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00c7f70 con 0x7fc78c005190 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a01559c0 con 0x7fc7a00c7780 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0155540 0x7fc7a00c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0155540 0x7fc7a00c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42760/0 (socket says 172.21.15.2:42760) 2023-11-04T01:48:04.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 -- 172.21.15.2:0/1086978472 learned_addr learned my addr 172.21.15.2:0/1086978472 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a6415640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c005190 0x7fc7a0155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a6c16640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7a00c7780 0x7fc7a00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 -- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7a00c7780 msgr2=0x7fc7a00b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7a00c7780 0x7fc7a00b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 -- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c005190 msgr2=0x7fc7a0155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c005190 0x7fc7a0155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 -- 172.21.15.2:0/1086978472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a00c7c90 con 0x7fc7a0155540 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a5c14640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0155540 0x7fc7a00c7240 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fc79000e820 tx=0x7fc79000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc796ffd640 1 -- 172.21.15.2:0/1086978472 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000c8d0 con 0x7fc7a0155540 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc796ffd640 1 -- 172.21.15.2:0/1086978472 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79000ca30 con 0x7fc7a0155540 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a00cb680 con 0x7fc7a0155540 2023-11-04T01:48:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc796ffd640 1 -- 172.21.15.2:0/1086978472 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000cde0 con 0x7fc7a0155540 2023-11-04T01:48:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a0158ba0 con 0x7fc7a0155540 2023-11-04T01:48:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a00cb4e0 con 0x7fc7a0155540 2023-11-04T01:48:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc796ffd640 1 -- 172.21.15.2:0/1086978472 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc79001d460 con 0x7fc7a0155540 2023-11-04T01:48:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc796ffd640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc7840664a0 0x7fc784068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc796ffd640 1 -- 172.21.15.2:0/1086978472 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7260+0+0 (secure 0 0 0) 0x7fc7900844d0 con 0x7fc7a0155540 2023-11-04T01:48:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.527+0000 7fc7a6415640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc7840664a0 0x7fc784068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.531+0000 7fc7a6415640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc7840664a0 0x7fc784068960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000f90 tx=0x7fc79c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.531+0000 7fc796ffd640 1 -- 172.21.15.2:0/1086978472 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc7a00cb4e0 con 0x7fc7a0155540 2023-11-04T01:48:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.719+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7a00cb4e0 con 0x7fc7a0155540 2023-11-04T01:48:04.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc796ffd640 1 -- 172.21.15.2:0/1086978472 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4970 (secure 0 0 0) 0x7fc7a00cb4e0 con 0x7fc7a0155540 2023-11-04T01:48:04.727 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:04.727 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:04.617573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:48:04.617573+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:04.727 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 85 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc7840664a0 msgr2=0x7fc784068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc7840664a0 0x7fc784068960 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000f90 tx=0x7fc79c009040 comp rx=0 tx=0).stop 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0155540 msgr2=0x7fc7a00c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0155540 0x7fc7a00c7240 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fc79000e820 tx=0x7fc79000ece0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 shutdown_connections 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc7840664a0 0x7fc784068960 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc7a00c7780 0x7fc7a00b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.729 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7a0155540 0x7fc7a00c7240 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 --2- 172.21.15.2:0/1086978472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc78c005190 0x7fc7a0155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:04.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 >> 172.21.15.2:0/1086978472 conn(0x7fc7a00d2f90 msgr2=0x7fc7a006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:04.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 shutdown_connections 2023-11-04T01:48:04.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.723+0000 7fc7a8679640 1 -- 172.21.15.2:0/1086978472 wait complete. 2023-11-04T01:48:04.744 DEBUG:tasks.ceph_test_case:wait_until_true: success in 15s and 0 retries 2023-11-04T01:48:04.744 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:48:04.757 INFO:teuthology.orchestra.run.smithi090.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:48:04.758 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:48:04.758 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:48:04.819 INFO:teuthology.orchestra.run.smithi090.stdout:1699062468.44175.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i d', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:48:04.821 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062468.44175.core'] 2023-11-04T01:48:04.821 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062468.44175.core, deleting it 2023-11-04T01:48:04.821 DEBUG:teuthology.orchestra.run.smithi090:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062468.44175.core 2023-11-04T01:48:04.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:05.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccac559640 1 Processor -- start 2023-11-04T01:48:05.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccac559640 1 -- start start 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccac559640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcca40c92b0 0x7fcca40cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccac559640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406c1c0 0x7fcca41442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccac559640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca40c9ac0 con 0x7fcca406bde0 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccac559640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca40caf20 con 0x7fcca40c92b0 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccac559640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40c97e0 con 0x7fcca406c1c0 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fcca9af4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcca40c92b0 0x7fcca40cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fcca9af4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcca40c92b0 0x7fcca40cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42770/0 (socket says 172.21.15.2:42770) 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fcca9af4640 1 -- 172.21.15.2:0/3969088808 learned_addr learned my addr 172.21.15.2:0/3969088808 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fccaaaf6640 1 --2- 172.21.15.2:0/3969088808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406c1c0 0x7fcca41442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fcca9af4640 1 -- 172.21.15.2:0/3969088808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406c1c0 msgr2=0x7fcca41442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fcca9af4640 1 --2- 172.21.15.2:0/3969088808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406c1c0 0x7fcca41442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fcca9af4640 1 -- 172.21.15.2:0/3969088808 >> v1:172.21.15.90:6789/0 conn(0x7fcca406bde0 legacy=0x7fcca415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:04.999+0000 7fcca9af4640 1 -- 172.21.15.2:0/3969088808 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca40cb1c0 con 0x7fcca40c92b0 2023-11-04T01:48:05.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fcca9af4640 1 --2- 172.21.15.2:0/3969088808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca40cbca0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009870 tx=0x7fcc9801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63048f4c74a73f6d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fcca92f3640 1 -- 172.21.15.2:0/3969088808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980ac600 con 0x7fcca40c92b0 2023-11-04T01:48:05.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fcca92f3640 1 -- 172.21.15.2:0/3969088808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980a8050 con 0x7fcca40c92b0 2023-11-04T01:48:05.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fcca92f3640 1 -- 172.21.15.2:0/3969088808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980ac980 con 0x7fcca40c92b0 2023-11-04T01:48:05.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- 172.21.15.2:0/3969088808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 msgr2=0x7fcca40cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 --2- 172.21.15.2:0/3969088808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca40cbca0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009870 tx=0x7fcc9801c4b0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- 172.21.15.2:0/3969088808 shutdown_connections 2023-11-04T01:48:05.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 --2- 172.21.15.2:0/3969088808 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406c1c0 0x7fcca41442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 --2- 172.21.15.2:0/3969088808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca40cbca0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- 172.21.15.2:0/3969088808 >> 172.21.15.2:0/3969088808 conn(0x7fcca40b0890 msgr2=0x7fcca40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- 172.21.15.2:0/3969088808 shutdown_connections 2023-11-04T01:48:05.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- 172.21.15.2:0/3969088808 wait complete. 2023-11-04T01:48:05.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 Processor -- start 2023-11-04T01:48:05.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- start start 2023-11-04T01:48:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406bde0 0x7fcca415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcca406c1c0 0x7fcca413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca413bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40b3b10 con 0x7fcca40c92b0 2023-11-04T01:48:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40b3df0 con 0x7fcca406c1c0 2023-11-04T01:48:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccac559640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca40b40d0 con 0x7fcca406bde0 2023-11-04T01:48:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca413bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca413bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42776/0 (socket says 172.21.15.2:42776) 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 -- 172.21.15.2:0/3269063925 learned_addr learned my addr 172.21.15.2:0/3269063925 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaa2f5640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406bde0 0x7fcca415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fcca9af4640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcca406c1c0 0x7fcca413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 -- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406bde0 msgr2=0x7fcca415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406bde0 0x7fcca415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 -- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcca406c1c0 msgr2=0x7fcca413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcca406c1c0 0x7fcca413b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaaaf6640 1 -- 172.21.15.2:0/3269063925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980094d0 con 0x7fcca40c92b0 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.003+0000 7fccaa2f5640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406bde0 0x7fcca415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fccaaaf6640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca413bd20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00d800 tx=0x7fcc9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fcca2ffd640 1 -- 172.21.15.2:0/3269063925 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00b6c0 con 0x7fcca40c92b0 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fcca2ffd640 1 -- 172.21.15.2:0/3269063925 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c00b820 con 0x7fcca40c92b0 2023-11-04T01:48:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fcca2ffd640 1 -- 172.21.15.2:0/3269063925 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c00bbd0 con 0x7fcca40c92b0 2023-11-04T01:48:05.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca40b43b0 con 0x7fcca40c92b0 2023-11-04T01:48:05.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca415ab80 con 0x7fcca40c92b0 2023-11-04T01:48:05.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca404e4a0 con 0x7fcca40c92b0 2023-11-04T01:48:05.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fcca2ffd640 1 -- 172.21.15.2:0/3269063925 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcc9c00bd30 con 0x7fcca40c92b0 2023-11-04T01:48:05.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fcca2ffd640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc900664a0 0x7fcc90068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.012 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fcca2ffd640 1 -- 172.21.15.2:0/3269063925 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7260+0+0 (secure 0 0 0) 0x7fcc9c0849f0 con 0x7fcca40c92b0 2023-11-04T01:48:05.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fccaa2f5640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc900664a0 0x7fcc90068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.007+0000 7fccaa2f5640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc900664a0 0x7fcc90068960 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcc94007fd0 tx=0x7fcc94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.016 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.011+0000 7fcca2ffd640 1 -- 172.21.15.2:0/3269063925 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcc9c051850 con 0x7fcca40c92b0 2023-11-04T01:48:05.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.191+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcca40b1520 con 0x7fcca40c92b0 2023-11-04T01:48:05.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fcca2ffd640 1 -- 172.21.15.2:0/3269063925 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4970 (secure 0 0 0) 0x7fcc9c054e70 con 0x7fcca40c92b0 2023-11-04T01:48:05.198 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:05.198 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7815,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:04.617573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":5807,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5807":{"gid":5807,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/433120793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":433120793},{"type":"v1","addr":"172.21.15.90:6837","nonce":433120793}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:48:04.617573+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:05.199 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 85 2023-11-04T01:48:05.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc900664a0 msgr2=0x7fcc90068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc900664a0 0x7fcc90068960 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fcc94007fd0 tx=0x7fcc94009040 comp rx=0 tx=0).stop 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 msgr2=0x7fcca413bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca413bd20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00d800 tx=0x7fcc9c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 shutdown_connections 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcc900664a0 0x7fcc90068960 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcca40c92b0 0x7fcca413bd20 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcca406c1c0 0x7fcca413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 --2- 172.21.15.2:0/3269063925 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcca406bde0 0x7fcca415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 >> 172.21.15.2:0/3269063925 conn(0x7fcca40b0890 msgr2=0x7fcca40b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 shutdown_connections 2023-11-04T01:48:05.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.195+0000 7fccac559640 1 -- 172.21.15.2:0/3269063925 wait complete. 2023-11-04T01:48:05.216 INFO:tasks.ceph.mds.a:Sent signal 9 2023-11-04T01:48:05.217 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:05.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:05.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 down 2023-11-04T01:48:05.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:48:05.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9b5bb5640 1 Processor -- start 2023-11-04T01:48:05.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9b5bb5640 1 -- start start 2023-11-04T01:48:05.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9b5bb5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd9b00add70 0x7fd9b015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9b5bb5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b00cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9b5bb5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00c4910 con 0x7fd9b015cf80 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9b5bb5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b006bbf0 con 0x7fd9b00add70 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9b5bb5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00acff0 con 0x7fd9b00ae200 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9af7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd9b015cf80 0x7fd9b00ac8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42004/0 (socket says 172.21.15.2:42004) 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9af7fe640 1 -- 172.21.15.2:0/2428244918 learned_addr learned my addr 172.21.15.2:0/2428244918 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9aeffd640 1 --2- 172.21.15.2:0/2428244918 >> v2:172.21.15.2:3300/0 conn(0x7fd9b00add70 0x7fd9b015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9affff640 1 --2- 172.21.15.2:0/2428244918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b00cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9aeffd640 1 -- 172.21.15.2:0/2428244918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 msgr2=0x7fd9b00cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9aeffd640 1 --2- 172.21.15.2:0/2428244918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b00cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9aeffd640 1 -- 172.21.15.2:0/2428244918 >> v1:172.21.15.2:6789/0 conn(0x7fd9b015cf80 legacy=0x7fd9b00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.379+0000 7fd9aeffd640 1 -- 172.21.15.2:0/2428244918 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b015dcf0 con 0x7fd9b00add70 2023-11-04T01:48:05.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9aeffd640 1 --2- 172.21.15.2:0/2428244918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b015d360 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00097c0 tx=0x7fd9a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb4d4334adf85b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9ae7fc640 1 -- 172.21.15.2:0/2428244918 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00ad660 con 0x7fd9b00add70 2023-11-04T01:48:05.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9ae7fc640 1 -- 172.21.15.2:0/2428244918 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a00ad7c0 con 0x7fd9b00add70 2023-11-04T01:48:05.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9ae7fc640 1 -- 172.21.15.2:0/2428244918 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a00adb50 con 0x7fd9b00add70 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2428244918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 msgr2=0x7fd9b015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2428244918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b015d360 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00097c0 tx=0x7fd9a001c450 comp rx=0 tx=0).stop 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2428244918 shutdown_connections 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2428244918 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b015d360 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2428244918 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b00cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2428244918 >> 172.21.15.2:0/2428244918 conn(0x7fd9b00b0890 msgr2=0x7fd9b00b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2428244918 shutdown_connections 2023-11-04T01:48:05.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2428244918 wait complete. 2023-11-04T01:48:05.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 Processor -- start 2023-11-04T01:48:05.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- start start 2023-11-04T01:48:05.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b0151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b01490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b015cf80 0x7fd9b0150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b015c840 con 0x7fd9b00add70 2023-11-04T01:48:05.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b015aee0 con 0x7fd9b015cf80 2023-11-04T01:48:05.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.383+0000 7fd9b5bb5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b014d860 con 0x7fd9b00ae200 2023-11-04T01:48:05.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b0151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b0151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42792/0 (socket says 172.21.15.2:42792) 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 -- 172.21.15.2:0/2410832568 learned_addr learned my addr 172.21.15.2:0/2410832568 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9aeffd640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b01490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9affff640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b015cf80 0x7fd9b0150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 -- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 msgr2=0x7fd9b01490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b01490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 -- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b015cf80 msgr2=0x7fd9b0150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b015cf80 0x7fd9b0150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 -- 172.21.15.2:0/2410832568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0009420 con 0x7fd9b00add70 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9aeffd640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b01490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9af7fe640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b0151a10 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4007fd0 tx=0x7fd9a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd997fff640 1 -- 172.21.15.2:0/2410832568 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4005cf0 con 0x7fd9b00add70 2023-11-04T01:48:05.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd997fff640 1 -- 172.21.15.2:0/2410832568 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a4005e70 con 0x7fd9b00add70 2023-11-04T01:48:05.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b014db40 con 0x7fd9b00add70 2023-11-04T01:48:05.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd997fff640 1 -- 172.21.15.2:0/2410832568 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40072f0 con 0x7fd9b00add70 2023-11-04T01:48:05.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b015ab00 con 0x7fd9b00add70 2023-11-04T01:48:05.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b004e4a0 con 0x7fd9b00add70 2023-11-04T01:48:05.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd997fff640 1 -- 172.21.15.2:0/2410832568 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd9a4007450 con 0x7fd9b00add70 2023-11-04T01:48:05.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd997fff640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd99c0664d0 0x7fd99c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd997fff640 1 -- 172.21.15.2:0/2410832568 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 7260+0+0 (secure 0 0 0) 0x7fd9a40839f0 con 0x7fd9b00add70 2023-11-04T01:48:05.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.387+0000 7fd9aeffd640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd99c0664d0 0x7fd99c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.391+0000 7fd9aeffd640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd99c0664d0 0x7fd99c068990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00af000 tx=0x7fd9a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.391+0000 7fd997fff640 1 -- 172.21.15.2:0/2410832568 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd9a4050860 con 0x7fd9b00add70 2023-11-04T01:48:05.418 INFO:tasks.ceph.mds.a.smithi002.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:48:05.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.607+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7fd9b006cf10 con 0x7fd9b00add70 2023-11-04T01:48:05.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd997fff640 1 -- 172.21.15.2:0/2410832568 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 5807 v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd9a4053e80 con 0x7fd9b00add70 2023-11-04T01:48:05.615 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 5807 2023-11-04T01:48:05.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd99c0664d0 msgr2=0x7fd99c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd99c0664d0 0x7fd99c068990 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00af000 tx=0x7fd9a0008040 comp rx=0 tx=0).stop 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 msgr2=0x7fd9b0151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b0151a10 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4007fd0 tx=0x7fd9a400c890 comp rx=0 tx=0).stop 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 shutdown_connections 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd99c0664d0 0x7fd99c068990 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9b015cf80 0x7fd9b0150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd9b00ae200 0x7fd9b01490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 --2- 172.21.15.2:0/2410832568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9b00add70 0x7fd9b0151a10 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 >> 172.21.15.2:0/2410832568 conn(0x7fd9b00b0890 msgr2=0x7fd9b015fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 shutdown_connections 2023-11-04T01:48:05.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.611+0000 7fd9b5bb5640 1 -- 172.21.15.2:0/2410832568 wait complete. 2023-11-04T01:48:05.636 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:48:05.636 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:48:05.637 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:48:05.637 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:48:05.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:05.637 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi090 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:48:05.638 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:48:05.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:48:05.642 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:48:05.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:05.715 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:48:05.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 Processor -- start 2023-11-04T01:48:05.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 -- start start 2023-11-04T01:48:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bbc0caf00 0x7f4bbc0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4bbc15d130 0x7f4bbc15d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc0cd5b0 con 0x7f4bbc0caf00 2023-11-04T01:48:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc15dae0 con 0x7f4bbc15d130 2023-11-04T01:48:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc2c41640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0ca010 con 0x7f4bbc0cd1d0 2023-11-04T01:48:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bbc0caf00 0x7f4bbc0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc11de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4bbc15d130 0x7f4bbc15d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bbc0caf00 0x7f4bbc0cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42794/0 (socket says 172.21.15.2:42794) 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bc09dd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 -- 172.21.15.2:0/2914545385 learned_addr learned my addr 172.21.15.2:0/2914545385 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 -- 172.21.15.2:0/2914545385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 msgr2=0x7f4bbc153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 --2- 172.21.15.2:0/2914545385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 -- 172.21.15.2:0/2914545385 >> v2:172.21.15.90:3300/0 conn(0x7f4bbc15d130 msgr2=0x7f4bbc15d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 --2- 172.21.15.2:0/2914545385 >> v2:172.21.15.90:3300/0 conn(0x7f4bbc15d130 0x7f4bbc15d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.751+0000 7f4bbbfff640 1 -- 172.21.15.2:0/2914545385 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc154020 con 0x7f4bbc0caf00 2023-11-04T01:48:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bbbfff640 1 --2- 172.21.15.2:0/2914545385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc0cb6e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0cc120 tx=0x7f4ba401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a24ec4973d1416 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bbb7fe640 1 -- 172.21.15.2:0/2914545385 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40ac410 con 0x7f4bbc0caf00 2023-11-04T01:48:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bbb7fe640 1 -- 172.21.15.2:0/2914545385 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba40ac570 con 0x7f4bbc0caf00 2023-11-04T01:48:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bbb7fe640 1 -- 172.21.15.2:0/2914545385 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40ac900 con 0x7f4bbc0caf00 2023-11-04T01:48:05.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2914545385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 msgr2=0x7f4bbc0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2914545385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc0cb6e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0cc120 tx=0x7f4ba401c500 comp rx=0 tx=0).stop 2023-11-04T01:48:05.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2914545385 shutdown_connections 2023-11-04T01:48:05.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2914545385 >> v2:172.21.15.90:3300/0 conn(0x7f4bbc15d130 0x7f4bbc15d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2914545385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc0cb6e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2914545385 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2914545385 >> 172.21.15.2:0/2914545385 conn(0x7f4bbc0b0890 msgr2=0x7f4bbc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2914545385 shutdown_connections 2023-11-04T01:48:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2914545385 wait complete. 2023-11-04T01:48:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 Processor -- start 2023-11-04T01:48:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- start start 2023-11-04T01:48:05.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc13f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc0c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bbc15d130 0x7f4bbc158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c58f0 con 0x7f4bbc0caf00 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c4ce0 con 0x7f4bbc15d130 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc2c41640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c4fc0 con 0x7f4bbc0cd1d0 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc13f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42798/0 (socket says 172.21.15.2:42798) 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 -- 172.21.15.2:0/2616488793 learned_addr learned my addr 172.21.15.2:0/2616488793 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc11de640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bbc15d130 0x7f4bbc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bbbfff640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc0c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 -- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 msgr2=0x7f4bbc0c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc0c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 -- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bbc15d130 msgr2=0x7f4bbc158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bbc15d130 0x7f4bbc158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.755+0000 7f4bc09dd640 1 -- 172.21.15.2:0/2616488793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba40094d0 con 0x7f4bbc0caf00 2023-11-04T01:48:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bc09dd640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc13f450 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00eed0 tx=0x7f4bac00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bb97fa640 1 -- 172.21.15.2:0/2616488793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac010040 con 0x7f4bbc0caf00 2023-11-04T01:48:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bb97fa640 1 -- 172.21.15.2:0/2616488793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bac009e80 con 0x7f4bbc0caf00 2023-11-04T01:48:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc0c52a0 con 0x7f4bbc0caf00 2023-11-04T01:48:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bb97fa640 1 -- 172.21.15.2:0/2616488793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac014620 con 0x7f4bbc0caf00 2023-11-04T01:48:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc0b1a90 con 0x7f4bbc0caf00 2023-11-04T01:48:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc04e4a0 con 0x7f4bbc0caf00 2023-11-04T01:48:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bb97fa640 1 -- 172.21.15.2:0/2616488793 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4bac014780 con 0x7f4bbc0caf00 2023-11-04T01:48:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bb97fa640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b9c0664a0 0x7f4b9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bb97fa640 1 -- 172.21.15.2:0/2616488793 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7318+0+0 (secure 0 0 0) 0x7f4bac084b30 con 0x7f4bbc0caf00 2023-11-04T01:48:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bbbfff640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b9c0664a0 0x7f4b9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:05.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.759+0000 7f4bbbfff640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b9c0664a0 0x7f4b9c068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40ae000 tx=0x7f4ba4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:05.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.763+0000 7f4bb97fa640 1 -- 172.21.15.2:0/2616488793 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4bac051a10 con 0x7f4bbc0caf00 2023-11-04T01:48:05.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bbc0cc5f0 con 0x7f4bbc0caf00 2023-11-04T01:48:05.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bb97fa640 1 -- 172.21.15.2:0/2616488793 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4134 (secure 0 0 0) 0x7f4bac055030 con 0x7f4bbc0caf00 2023-11-04T01:48:05.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:05.952 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":87,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:05.621013+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:05.952 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 87 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b9c0664a0 msgr2=0x7f4b9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b9c0664a0 0x7f4b9c068960 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40ae000 tx=0x7f4ba4009040 comp rx=0 tx=0).stop 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 msgr2=0x7f4bbc13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc13f450 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00eed0 tx=0x7f4bac00b480 comp rx=0 tx=0).stop 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 shutdown_connections 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4b9c0664a0 0x7f4b9c068960 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bbc15d130 0x7f4bbc158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4bbc0cd1d0 0x7f4bbc0c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 --2- 172.21.15.2:0/2616488793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bbc0caf00 0x7f4bbc13f450 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:05.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 >> 172.21.15.2:0/2616488793 conn(0x7f4bbc0b0890 msgr2=0x7f4bbc0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 shutdown_connections 2023-11-04T01:48:05.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:05.947+0000 7f4bc2c41640 1 -- 172.21.15.2:0/2616488793 wait complete. 2023-11-04T01:48:05.969 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:48:08.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:48:08.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:48:10.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:11.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e2bcd640 1 Processor -- start 2023-11-04T01:48:11.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e2bcd640 1 -- start start 2023-11-04T01:48:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e2bcd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f45dc15cf80 0x7f45dc0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e2bcd640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0c4910 con 0x7f45dc0ae200 2023-11-04T01:48:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e2bcd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc15da70 con 0x7f45dc0add70 2023-11-04T01:48:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e2bcd640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc06bbf0 con 0x7f45dc15cf80 2023-11-04T01:48:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e116a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f45dc0ae200 0x7f45dc0cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42014/0 (socket says 172.21.15.2:42014) 2023-11-04T01:48:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e116a640 1 -- 172.21.15.2:0/234619881 learned_addr learned my addr 172.21.15.2:0/234619881 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e0969640 1 --2- 172.21.15.2:0/234619881 >> v2:172.21.15.2:3300/0 conn(0x7f45dc15cf80 0x7f45dc0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e0969640 1 -- 172.21.15.2:0/234619881 >> v1:172.21.15.90:6789/0 conn(0x7f45dc0add70 legacy=0x7f45dc15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e0969640 1 -- 172.21.15.2:0/234619881 >> v1:172.21.15.2:6789/0 conn(0x7f45dc0ae200 legacy=0x7f45dc0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.103+0000 7f45e0969640 1 -- 172.21.15.2:0/234619881 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc15dcf0 con 0x7f45dc15cf80 2023-11-04T01:48:11.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e0969640 1 --2- 172.21.15.2:0/234619881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc15cf80 0x7f45dc0ac8e0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0097c0 tx=0x7f45cc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963b1a3f2b867a80 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45d37fe640 1 -- 172.21.15.2:0/234619881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0ac620 con 0x7f45dc15cf80 2023-11-04T01:48:11.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45d37fe640 1 -- 172.21.15.2:0/234619881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc0ac780 con 0x7f45dc15cf80 2023-11-04T01:48:11.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45d37fe640 1 -- 172.21.15.2:0/234619881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc0acb10 con 0x7f45dc15cf80 2023-11-04T01:48:11.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- 172.21.15.2:0/234619881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc15cf80 msgr2=0x7f45dc0ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/234619881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc15cf80 0x7f45dc0ac8e0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0097c0 tx=0x7f45cc01c3c0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- 172.21.15.2:0/234619881 shutdown_connections 2023-11-04T01:48:11.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/234619881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc15cf80 0x7f45dc0ac8e0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- 172.21.15.2:0/234619881 >> 172.21.15.2:0/234619881 conn(0x7f45dc0b0890 msgr2=0x7f45dc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- 172.21.15.2:0/234619881 shutdown_connections 2023-11-04T01:48:11.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- 172.21.15.2:0/234619881 wait complete. 2023-11-04T01:48:11.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 Processor -- start 2023-11-04T01:48:11.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- start start 2023-11-04T01:48:11.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45dc0add70 0x7f45dc0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc0ae200 0x7f45dc15fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45dc15cf80 0x7f45dc14d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc150850 con 0x7f45dc0ae200 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc1541b0 con 0x7f45dc15cf80 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45e2bcd640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc154490 con 0x7f45dc0add70 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc0ae200 0x7f45dc15fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45d3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc0ae200 0x7f45dc15fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42810/0 (socket says 172.21.15.2:42810) 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.107+0000 7f45d3fff640 1 -- 172.21.15.2:0/1967884880 learned_addr learned my addr 172.21.15.2:0/1967884880 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45e116a640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45dc15cf80 0x7f45dc14d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45e0969640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45dc0add70 0x7f45dc0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d3fff640 1 -- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45dc0add70 msgr2=0x7f45dc0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d3fff640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45dc0add70 0x7f45dc0b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d3fff640 1 -- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45dc15cf80 msgr2=0x7f45dc14d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d3fff640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45dc15cf80 0x7f45dc14d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d3fff640 1 -- 172.21.15.2:0/1967884880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc009420 con 0x7f45dc0ae200 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d3fff640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc0ae200 0x7f45dc15fba0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c500 tx=0x7f45d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d17fa640 1 -- 172.21.15.2:0/1967884880 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8005220 con 0x7f45dc0ae200 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d17fa640 1 -- 172.21.15.2:0/1967884880 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d8005380 con 0x7f45dc0ae200 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc1525a0 con 0x7f45dc0ae200 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d17fa640 1 -- 172.21.15.2:0/1967884880 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8007270 con 0x7f45dc0ae200 2023-11-04T01:48:11.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc1600e0 con 0x7f45dc0ae200 2023-11-04T01:48:11.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc152790 con 0x7f45dc0ae200 2023-11-04T01:48:11.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d17fa640 1 -- 172.21.15.2:0/1967884880 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f45d80073d0 con 0x7f45dc0ae200 2023-11-04T01:48:11.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d17fa640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45c80664a0 0x7f45c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45d17fa640 1 -- 172.21.15.2:0/1967884880 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7318+0+0 (secure 0 0 0) 0x7f45d8083dd0 con 0x7f45dc0ae200 2023-11-04T01:48:11.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45e0969640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45c80664a0 0x7f45c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.111+0000 7f45e0969640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45c80664a0 0x7f45c8068960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ae000 tx=0x7f45cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.115+0000 7f45d17fa640 1 -- 172.21.15.2:0/1967884880 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f45d8050bf0 con 0x7f45dc0ae200 2023-11-04T01:48:11.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.323+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45dc04e4a0 con 0x7f45dc0ae200 2023-11-04T01:48:11.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45d17fa640 1 -- 172.21.15.2:0/1967884880 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f45d8054210 con 0x7f45dc0ae200 2023-11-04T01:48:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:11.331 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:05.651825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:resolve","state_seq":8,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:11.331 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 88 2023-11-04T01:48:11.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45c80664a0 msgr2=0x7f45c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45c80664a0 0x7f45c8068960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ae000 tx=0x7f45cc008040 comp rx=0 tx=0).stop 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc0ae200 msgr2=0x7f45dc15fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc0ae200 0x7f45dc15fba0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c500 tx=0x7f45d800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 shutdown_connections 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f45c80664a0 0x7f45c8068960 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45dc15cf80 0x7f45dc14d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f45dc0ae200 0x7f45dc15fba0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 --2- 172.21.15.2:0/1967884880 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f45dc0add70 0x7f45dc0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 >> 172.21.15.2:0/1967884880 conn(0x7f45dc0b0890 msgr2=0x7f45dc0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 shutdown_connections 2023-11-04T01:48:11.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.327+0000 7f45e2bcd640 1 -- 172.21.15.2:0/1967884880 wait complete. 2023-11-04T01:48:11.350 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:48:11.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:11.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.471+0000 7fdc02db9640 1 Processor -- start 2023-11-04T01:48:11.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.471+0000 7fdc02db9640 1 -- start start 2023-11-04T01:48:11.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc02db9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdbfc142ad0 0x7fdbfc15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc02db9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbfc142eb0 0x7fdbfc0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc02db9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc0caec0 0x7fdbfc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc02db9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0ca100 con 0x7fdbfc142eb0 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc02db9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc0ca3e0 con 0x7fdbfc142ad0 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc02db9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0ca6c0 con 0x7fdbfc0caec0 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbfc142eb0 0x7fdbfc0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbfc142eb0 0x7fdbfc0cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48964/0 (socket says 172.21.15.2:48964) 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 -- 172.21.15.2:0/3777598255 learned_addr learned my addr 172.21.15.2:0/3777598255 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc01356640 1 --2- 172.21.15.2:0/3777598255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc0caec0 0x7fdbfc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc00b55640 1 --2- 172.21.15.2:0/3777598255 >> v2:172.21.15.90:3300/0 conn(0x7fdbfc142ad0 0x7fdbfc15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 -- 172.21.15.2:0/3777598255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc0caec0 msgr2=0x7fdbfc0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 --2- 172.21.15.2:0/3777598255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc0caec0 0x7fdbfc0cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 -- 172.21.15.2:0/3777598255 >> v2:172.21.15.90:3300/0 conn(0x7fdbfc142ad0 msgr2=0x7fdbfc15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 --2- 172.21.15.2:0/3777598255 >> v2:172.21.15.90:3300/0 conn(0x7fdbfc142ad0 0x7fdbfc15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 -- 172.21.15.2:0/3777598255 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc0ca9a0 con 0x7fdbfc142eb0 2023-11-04T01:48:11.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdc01356640 1 --2- 172.21.15.2:0/3777598255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc0caec0 0x7fdbfc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:11.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfbfff640 1 --2- 172.21.15.2:0/3777598255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc142eb0 0x7fdbfc0cc830 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0cc450 tx=0x7fdbf001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a9b19790f08f4f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfb7fe640 1 -- 172.21.15.2:0/3777598255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00ab600 con 0x7fdbfc142eb0 2023-11-04T01:48:11.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfb7fe640 1 -- 172.21.15.2:0/3777598255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf00a7050 con 0x7fdbfc142eb0 2023-11-04T01:48:11.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.475+0000 7fdbfb7fe640 1 -- 172.21.15.2:0/3777598255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00ab980 con 0x7fdbfc142eb0 2023-11-04T01:48:11.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- 172.21.15.2:0/3777598255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc142eb0 msgr2=0x7fdbfc0cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 --2- 172.21.15.2:0/3777598255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc142eb0 0x7fdbfc0cc830 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0cc450 tx=0x7fdbf001c3e0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- 172.21.15.2:0/3777598255 shutdown_connections 2023-11-04T01:48:11.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 --2- 172.21.15.2:0/3777598255 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc0caec0 0x7fdbfc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 --2- 172.21.15.2:0/3777598255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc142eb0 0x7fdbfc0cc830 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 --2- 172.21.15.2:0/3777598255 >> v2:172.21.15.90:3300/0 conn(0x7fdbfc142ad0 0x7fdbfc15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- 172.21.15.2:0/3777598255 >> 172.21.15.2:0/3777598255 conn(0x7fdbfc0b0890 msgr2=0x7fdbfc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- 172.21.15.2:0/3777598255 shutdown_connections 2023-11-04T01:48:11.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- 172.21.15.2:0/3777598255 wait complete. 2023-11-04T01:48:11.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 Processor -- start 2023-11-04T01:48:11.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- start start 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc0caec0 0x7fdbfc159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc142ad0 0x7fdbfc0af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbfc142eb0 0x7fdbfc06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc159b70 con 0x7fdbfc0caec0 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c7680 con 0x7fdbfc142eb0 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0c7960 con 0x7fdbfc142ad0 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc0caec0 0x7fdbfc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc0caec0 0x7fdbfc159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48966/0 (socket says 172.21.15.2:48966) 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 -- 172.21.15.2:0/2847250489 learned_addr learned my addr 172.21.15.2:0/2847250489 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdbfbfff640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc142ad0 0x7fdbfc0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc01356640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbfc142eb0 0x7fdbfc06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 -- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc142ad0 msgr2=0x7fdbfc0af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc142ad0 0x7fdbfc0af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 -- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbfc142eb0 msgr2=0x7fdbfc06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbfc142eb0 0x7fdbfc06f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 -- 172.21.15.2:0/2847250489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf00094d0 con 0x7fdbfc0caec0 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc00b55640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc0caec0 0x7fdbfc159630 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e930 tx=0x7fdbec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdbf97fa640 1 -- 172.21.15.2:0/2847250489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec009690 con 0x7fdbfc0caec0 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdbf97fa640 1 -- 172.21.15.2:0/2847250489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00ca00 con 0x7fdbfc0caec0 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc0c7c40 con 0x7fdbfc0caec0 2023-11-04T01:48:11.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdbf97fa640 1 -- 172.21.15.2:0/2847250489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00cd70 con 0x7fdbfc0caec0 2023-11-04T01:48:11.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.479+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc0c8200 con 0x7fdbfc0caec0 2023-11-04T01:48:11.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.483+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc04e4a0 con 0x7fdbfc0caec0 2023-11-04T01:48:11.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.483+0000 7fdbf97fa640 1 -- 172.21.15.2:0/2847250489 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbec013470 con 0x7fdbfc0caec0 2023-11-04T01:48:11.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.483+0000 7fdbf97fa640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdbe80664a0 0x7fdbe8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.483+0000 7fdbf97fa640 1 -- 172.21.15.2:0/2847250489 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7318+0+0 (secure 0 0 0) 0x7fdbec0847a0 con 0x7fdbfc0caec0 2023-11-04T01:48:11.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.483+0000 7fdbfbfff640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdbe80664a0 0x7fdbe8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.483+0000 7fdbfbfff640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdbe80664a0 0x7fdbe8068960 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00ad000 tx=0x7fdbf0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.487+0000 7fdbf97fa640 1 -- 172.21.15.2:0/2847250489 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdbec051690 con 0x7fdbfc0caec0 2023-11-04T01:48:11.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.675+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbfc06d010 con 0x7fdbfc0caec0 2023-11-04T01:48:11.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdbf97fa640 1 -- 172.21.15.2:0/2847250489 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fdbec054cb0 con 0x7fdbfc0caec0 2023-11-04T01:48:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:11.682 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:05.651825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:resolve","state_seq":8,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:11.683 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 88 2023-11-04T01:48:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdbe80664a0 msgr2=0x7fdbe8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdbe80664a0 0x7fdbe8068960 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00ad000 tx=0x7fdbf0008040 comp rx=0 tx=0).stop 2023-11-04T01:48:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc0caec0 msgr2=0x7fdbfc159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc0caec0 0x7fdbfc159630 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00e930 tx=0x7fdbec00edf0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 shutdown_connections 2023-11-04T01:48:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdbe80664a0 0x7fdbe8068960 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdbfc142eb0 0x7fdbfc06f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdbfc142ad0 0x7fdbfc0af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 --2- 172.21.15.2:0/2847250489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbfc0caec0 0x7fdbfc159630 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 >> 172.21.15.2:0/2847250489 conn(0x7fdbfc0b0890 msgr2=0x7fdbfc0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 shutdown_connections 2023-11-04T01:48:11.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.679+0000 7fdc02db9640 1 -- 172.21.15.2:0/2847250489 wait complete. 2023-11-04T01:48:11.701 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:48:11.701 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.35080480575561523s 2023-11-04T01:48:11.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12f3d0640 1 Processor -- start 2023-11-04T01:48:11.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12f3d0640 1 -- start start 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12f3d0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1280b4be0 0x7fd128160f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12f3d0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd12806a130 0x7fd12806a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12f3d0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1281614b0 con 0x7fd12815d2a0 2023-11-04T01:48:11.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12f3d0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12806aaf0 con 0x7fd12806a130 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12f3d0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280b38d0 con 0x7fd1280b4be0 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12d96d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd12806a130 0x7fd12806a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12c96b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1280b4be0 0x7fd128160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12d96d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd12806a130 0x7fd12806a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:44490/0 (socket says 172.21.15.2:44490) 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12d16c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd12815d2a0 0x7fd12806cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:55672/0 (socket says 172.21.15.2:55672) 2023-11-04T01:48:11.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12d96d640 1 -- 172.21.15.2:0/3131722748 learned_addr learned my addr 172.21.15.2:0/3131722748 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12c96b640 1 -- 172.21.15.2:0/3131722748 >> v2:172.21.15.90:3300/0 conn(0x7fd12806a130 msgr2=0x7fd12806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12c96b640 1 --2- 172.21.15.2:0/3131722748 >> v2:172.21.15.90:3300/0 conn(0x7fd12806a130 0x7fd12806a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12c96b640 1 -- 172.21.15.2:0/3131722748 >> v1:172.21.15.90:6789/0 conn(0x7fd12815d2a0 legacy=0x7fd12806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.823+0000 7fd12c96b640 1 -- 172.21.15.2:0/3131722748 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280b3bb0 con 0x7fd1280b4be0 2023-11-04T01:48:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12c96b640 1 --2- 172.21.15.2:0/3131722748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1280b4be0 0x7fd128160f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1180097c0 tx=0x7fd11801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc0d4c27a9d4503e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd11ffff640 1 -- 172.21.15.2:0/3131722748 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180ab600 con 0x7fd1280b4be0 2023-11-04T01:48:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd11ffff640 1 -- 172.21.15.2:0/3131722748 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1180a7050 con 0x7fd1280b4be0 2023-11-04T01:48:11.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd11ffff640 1 -- 172.21.15.2:0/3131722748 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180ab980 con 0x7fd1280b4be0 2023-11-04T01:48:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 -- 172.21.15.2:0/3131722748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1280b4be0 msgr2=0x7fd128160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/3131722748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1280b4be0 0x7fd128160f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1180097c0 tx=0x7fd11801c480 comp rx=0 tx=0).stop 2023-11-04T01:48:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 -- 172.21.15.2:0/3131722748 shutdown_connections 2023-11-04T01:48:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/3131722748 >> v2:172.21.15.90:3300/0 conn(0x7fd12806a130 0x7fd12806a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/3131722748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd1280b4be0 0x7fd128160f70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 -- 172.21.15.2:0/3131722748 >> 172.21.15.2:0/3131722748 conn(0x7fd1280b18a0 msgr2=0x7fd1280b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 -- 172.21.15.2:0/3131722748 shutdown_connections 2023-11-04T01:48:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 -- 172.21.15.2:0/3131722748 wait complete. 2023-11-04T01:48:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 Processor -- start 2023-11-04T01:48:11.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.827+0000 7fd12f3d0640 1 -- start start 2023-11-04T01:48:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd12806a130 0x7fd1280ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1280b4be0 0x7fd1280b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd12815d2a0 0x7fd1280cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280cdc90 con 0x7fd12815d2a0 2023-11-04T01:48:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280cd080 con 0x7fd1280b4be0 2023-11-04T01:48:11.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280cd360 con 0x7fd12806a130 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd12815d2a0 0x7fd1280cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd12815d2a0 0x7fd1280cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48976/0 (socket says 172.21.15.2:48976) 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 -- 172.21.15.2:0/2015133585 learned_addr learned my addr 172.21.15.2:0/2015133585 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d16c640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd12806a130 0x7fd1280ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12c96b640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1280b4be0 0x7fd1280b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 -- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd12806a130 msgr2=0x7fd1280ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd12806a130 0x7fd1280ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 -- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1280b4be0 msgr2=0x7fd1280b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1280b4be0 0x7fd1280b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 -- 172.21.15.2:0/2015133585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118009420 con 0x7fd12815d2a0 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12d96d640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd12815d2a0 0x7fd1280cc6a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd12000efc0 tx=0x7fd12000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd11dffb640 1 -- 172.21.15.2:0/2015133585 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120009b60 con 0x7fd12815d2a0 2023-11-04T01:48:11.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd11dffb640 1 -- 172.21.15.2:0/2015133585 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12000f040 con 0x7fd12815d2a0 2023-11-04T01:48:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd11dffb640 1 -- 172.21.15.2:0/2015133585 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200039a0 con 0x7fd12815d2a0 2023-11-04T01:48:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1280cd640 con 0x7fd12815d2a0 2023-11-04T01:48:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1280b0eb0 con 0x7fd12815d2a0 2023-11-04T01:48:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1280b31a0 con 0x7fd12815d2a0 2023-11-04T01:48:11.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd11dffb640 1 -- 172.21.15.2:0/2015133585 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd120003b00 con 0x7fd12815d2a0 2023-11-04T01:48:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd11dffb640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd10c0664a0 0x7fd10c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.831+0000 7fd11dffb640 1 -- 172.21.15.2:0/2015133585 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7318+0+0 (secure 0 0 0) 0x7fd1200849d0 con 0x7fd12815d2a0 2023-11-04T01:48:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.835+0000 7fd12d16c640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd10c0664a0 0x7fd10c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:11.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.835+0000 7fd12d16c640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd10c0664a0 0x7fd10c068960 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd124000f70 tx=0x7fd124007cb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:11.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:11.839+0000 7fd11dffb640 1 -- 172.21.15.2:0/2015133585 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd120051890 con 0x7fd12815d2a0 2023-11-04T01:48:12.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.023+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1280b1d20 con 0x7fd12815d2a0 2023-11-04T01:48:12.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.023+0000 7fd11dffb640 1 -- 172.21.15.2:0/2015133585 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fd120003db0 con 0x7fd12815d2a0 2023-11-04T01:48:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:12.029 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":5930,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:05.651825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":7128},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7128":{"gid":7128,"name":"a","rank":1,"incarnation":48,"state":"up:active","state_seq":6,"addr":"172.21.15.2:6835/3725992406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3725992406},{"type":"v1","addr":"172.21.15.2:6835","nonce":3725992406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:resolve","state_seq":8,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:12.029 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 88 2023-11-04T01:48:12.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd10c0664a0 msgr2=0x7fd10c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd10c0664a0 0x7fd10c068960 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd124000f70 tx=0x7fd124007cb0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd12815d2a0 msgr2=0x7fd1280cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd12815d2a0 0x7fd1280cc6a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fd12000efc0 tx=0x7fd12000c490 comp rx=0 tx=0).stop 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 shutdown_connections 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd10c0664a0 0x7fd10c068960 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd12815d2a0 0x7fd1280cc6a0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1280b4be0 0x7fd1280b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 --2- 172.21.15.2:0/2015133585 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd12806a130 0x7fd1280ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 >> 172.21.15.2:0/2015133585 conn(0x7fd1280b18a0 msgr2=0x7fd128155d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 shutdown_connections 2023-11-04T01:48:12.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.027+0000 7fd12f3d0640 1 -- 172.21.15.2:0/2015133585 wait complete. 2023-11-04T01:48:12.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:48:12.174 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":19,"snapinfo":{"snapid":10,"ino":1099511627777,"stamp":"2023-11-04T01:47:48.151703+0000","name":"s22","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:48:12.175 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s22", "snapid": 10, "stamp": "2023-11-04T01:47:48.151703+0000" }, "version": 19 } ], "snaps": [] } 2023-11-04T01:48:12.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:48:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7b0525c640 1 Processor -- start 2023-11-04T01:48:12.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7b0525c640 1 -- start start 2023-11-04T01:48:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7b0525c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7b0015cf80 0x7f7b000ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7b0525c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b000cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7b0525c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b000c4910 con 0x7f7b000add70 2023-11-04T01:48:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7b0525c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0006bbf0 con 0x7f7b0015cf80 2023-11-04T01:48:12.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7b0525c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0015da70 con 0x7f7b000ae200 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7aff59e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b000cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7afe59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f7b000add70 0x7f7b0015d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:55676/0 (socket says 172.21.15.2:55676) 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7afe59c640 1 -- 172.21.15.2:0/291065207 learned_addr learned my addr 172.21.15.2:0/291065207 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7afed9d640 1 --2- 172.21.15.2:0/291065207 >> v2:172.21.15.90:3300/0 conn(0x7f7b0015cf80 0x7f7b000ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7aff59e640 1 -- 172.21.15.2:0/291065207 >> v2:172.21.15.90:3300/0 conn(0x7f7b0015cf80 msgr2=0x7f7b000ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7aff59e640 1 --2- 172.21.15.2:0/291065207 >> v2:172.21.15.90:3300/0 conn(0x7f7b0015cf80 0x7f7b000ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7aff59e640 1 -- 172.21.15.2:0/291065207 >> v1:172.21.15.90:6789/0 conn(0x7f7b000add70 legacy=0x7f7b0015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.299+0000 7f7aff59e640 1 -- 172.21.15.2:0/291065207 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0015dcf0 con 0x7f7b000ae200 2023-11-04T01:48:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7aff59e640 1 --2- 172.21.15.2:0/291065207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b000cb600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7af00097c0 tx=0x7f7af001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7917232cd7b1f676 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7afdd9b640 1 -- 172.21.15.2:0/291065207 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00ad660 con 0x7f7b000ae200 2023-11-04T01:48:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7afdd9b640 1 -- 172.21.15.2:0/291065207 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af00ad7c0 con 0x7f7b000ae200 2023-11-04T01:48:12.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7afdd9b640 1 -- 172.21.15.2:0/291065207 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00adb50 con 0x7f7b000ae200 2023-11-04T01:48:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 -- 172.21.15.2:0/291065207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 msgr2=0x7f7b000cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 --2- 172.21.15.2:0/291065207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b000cb600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7af00097c0 tx=0x7f7af001c450 comp rx=0 tx=0).stop 2023-11-04T01:48:12.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 -- 172.21.15.2:0/291065207 shutdown_connections 2023-11-04T01:48:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 --2- 172.21.15.2:0/291065207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b000cb600 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 --2- 172.21.15.2:0/291065207 >> v2:172.21.15.90:3300/0 conn(0x7f7b0015cf80 0x7f7b000ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 -- 172.21.15.2:0/291065207 >> 172.21.15.2:0/291065207 conn(0x7f7b000b0890 msgr2=0x7f7b000b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 -- 172.21.15.2:0/291065207 shutdown_connections 2023-11-04T01:48:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 -- 172.21.15.2:0/291065207 wait complete. 2023-11-04T01:48:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 Processor -- start 2023-11-04T01:48:12.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.303+0000 7f7b0525c640 1 -- start start 2023-11-04T01:48:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b000add70 0x7f7b000c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b00158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b0015cf80 0x7f7b001427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000b20d0 con 0x7f7b0015cf80 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b00158e90 con 0x7f7b000add70 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000c63c0 con 0x7f7b000ae200 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b0015cf80 0x7f7b001427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b0015cf80 0x7f7b001427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48980/0 (socket says 172.21.15.2:48980) 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 -- 172.21.15.2:0/2059320474 learned_addr learned my addr 172.21.15.2:0/2059320474 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7afed9d640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b000add70 0x7f7b000c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7afe59c640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b00158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 -- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 msgr2=0x7f7b00158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b00158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 -- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b000add70 msgr2=0x7f7b000c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b000add70 0x7f7b000c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 -- 172.21.15.2:0/2059320474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af0009420 con 0x7f7b0015cf80 2023-11-04T01:48:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7aff59e640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b0015cf80 0x7f7b001427d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7af001a080 tx=0x7f7af00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7ae77fe640 1 -- 172.21.15.2:0/2059320474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00b6610 con 0x7f7b0015cf80 2023-11-04T01:48:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7ae77fe640 1 -- 172.21.15.2:0/2059320474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af00b6770 con 0x7f7b0015cf80 2023-11-04T01:48:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b000b1730 con 0x7f7b0015cf80 2023-11-04T01:48:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7ae77fe640 1 -- 172.21.15.2:0/2059320474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00b6b00 con 0x7f7b0015cf80 2023-11-04T01:48:12.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b000b1cf0 con 0x7f7b0015cf80 2023-11-04T01:48:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b000b2210 con 0x7f7b0015cf80 2023-11-04T01:48:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7ae77fe640 1 -- 172.21.15.2:0/2059320474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7af00b4040 con 0x7f7b0015cf80 2023-11-04T01:48:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7ae77fe640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7aec0664d0 0x7f7aec068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7ae77fe640 1 -- 172.21.15.2:0/2059320474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 7318+0+0 (secure 0 0 0) 0x7f7af011e700 con 0x7f7b0015cf80 2023-11-04T01:48:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.307+0000 7f7afed9d640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7aec0664d0 0x7f7aec068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.311+0000 7f7afed9d640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7aec0664d0 0x7f7aec068990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009a50 tx=0x7f7af8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.311+0000 7f7ae77fe640 1 -- 172.21.15.2:0/2059320474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b000b2210 con 0x7f7b0015cf80 2023-11-04T01:48:12.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.531+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f7b000b2210 con 0x7f7b0015cf80 2023-11-04T01:48:12.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7ae77fe640 1 -- 172.21.15.2:0/2059320474 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 7128 v89) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b000b2210 con 0x7f7b0015cf80 2023-11-04T01:48:12.538 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 7128 2023-11-04T01:48:12.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7aec0664d0 msgr2=0x7f7aec068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7aec0664d0 0x7f7aec068990 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009a50 tx=0x7f7af8008040 comp rx=0 tx=0).stop 2023-11-04T01:48:12.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b0015cf80 msgr2=0x7f7b001427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b0015cf80 0x7f7b001427d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7af001a080 tx=0x7f7af00191f0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 shutdown_connections 2023-11-04T01:48:12.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7aec0664d0 0x7f7aec068990 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b0015cf80 0x7f7b001427d0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b000ae200 0x7f7b00158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 --2- 172.21.15.2:0/2059320474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b000add70 0x7f7b000c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 >> 172.21.15.2:0/2059320474 conn(0x7f7b000b0890 msgr2=0x7f7b0015d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 shutdown_connections 2023-11-04T01:48:12.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.535+0000 7f7b0525c640 1 -- 172.21.15.2:0/2059320474 wait complete. 2023-11-04T01:48:12.560 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:48:12.560 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:48:12.560 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:48:12.560 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:48:12.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:12.560 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:48:12.561 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:48:12.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:48:12.563 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:48:12.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:12.627 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:48:12.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9f648640 1 Processor -- start 2023-11-04T01:48:12.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9f648640 1 -- start start 2023-11-04T01:48:12.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9f648640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fde98160680 0x7fde980cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9f648640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160a60 0x7fde980ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9f648640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980cf000 con 0x7fde980b3e30 2023-11-04T01:48:12.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9f648640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde980b5de0 con 0x7fde98160680 2023-11-04T01:48:12.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9f648640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980d1610 con 0x7fde98160a60 2023-11-04T01:48:12.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9cbe3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160a60 0x7fde980ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9cbe3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160a60 0x7fde980ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:45554/0 (socket says 172.21.15.2:45554) 2023-11-04T01:48:12.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9cbe3640 1 -- 172.21.15.2:0/1846143848 learned_addr learned my addr 172.21.15.2:0/1846143848 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:12.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.683+0000 7fde9d3e4640 1 --2- 172.21.15.2:0/1846143848 >> v2:172.21.15.90:3300/0 conn(0x7fde98160680 0x7fde980cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9cbe3640 1 -- 172.21.15.2:0/1846143848 >> v2:172.21.15.90:3300/0 conn(0x7fde98160680 msgr2=0x7fde980cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:12.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9cbe3640 1 --2- 172.21.15.2:0/1846143848 >> v2:172.21.15.90:3300/0 conn(0x7fde98160680 0x7fde980cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9cbe3640 1 -- 172.21.15.2:0/1846143848 >> v1:172.21.15.90:6789/0 conn(0x7fde980b3e30 legacy=0x7fde980cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9cbe3640 1 -- 172.21.15.2:0/1846143848 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980d18f0 con 0x7fde98160a60 2023-11-04T01:48:12.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9cbe3640 1 --2- 172.21.15.2:0/1846143848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160a60 0x7fde980ce0e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde88009870 tx=0x7fde8801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78d476bba62e4a88 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde8ffff640 1 -- 172.21.15.2:0/1846143848 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880ab680 con 0x7fde98160a60 2023-11-04T01:48:12.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde8ffff640 1 -- 172.21.15.2:0/1846143848 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880ab7e0 con 0x7fde98160a60 2023-11-04T01:48:12.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde8ffff640 1 -- 172.21.15.2:0/1846143848 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880abb70 con 0x7fde98160a60 2023-11-04T01:48:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 -- 172.21.15.2:0/1846143848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160a60 msgr2=0x7fde980ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 --2- 172.21.15.2:0/1846143848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160a60 0x7fde980ce0e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde88009870 tx=0x7fde8801c480 comp rx=0 tx=0).stop 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 -- 172.21.15.2:0/1846143848 shutdown_connections 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 --2- 172.21.15.2:0/1846143848 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160a60 0x7fde980ce0e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 --2- 172.21.15.2:0/1846143848 >> v2:172.21.15.90:3300/0 conn(0x7fde98160680 0x7fde980cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 -- 172.21.15.2:0/1846143848 >> 172.21.15.2:0/1846143848 conn(0x7fde980d2f90 msgr2=0x7fde980d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 -- 172.21.15.2:0/1846143848 shutdown_connections 2023-11-04T01:48:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.687+0000 7fde9f648640 1 -- 172.21.15.2:0/1846143848 wait complete. 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 Processor -- start 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 -- start start 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde980b3e30 0x7fde9815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160680 0x7fde98155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde98160a60 0x7fde980c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c7bc0 con 0x7fde980b3e30 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c98a0 con 0x7fde98160a60 2023-11-04T01:48:12.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980c95c0 con 0x7fde98160680 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde980b3e30 0x7fde9815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde980b3e30 0x7fde9815abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49010/0 (socket says 172.21.15.2:49010) 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 -- 172.21.15.2:0/3907566578 learned_addr learned my addr 172.21.15.2:0/3907566578 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9cbe3640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160680 0x7fde98155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9dbe5640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde98160a60 0x7fde980c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 -- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160680 msgr2=0x7fde98155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160680 0x7fde98155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 -- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde98160a60 msgr2=0x7fde980c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde98160a60 0x7fde980c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 -- 172.21.15.2:0/3907566578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880094d0 con 0x7fde980b3e30 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9d3e4640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde980b3e30 0x7fde9815abf0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e930 tx=0x7fde9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde8dffb640 1 -- 172.21.15.2:0/3907566578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94009690 con 0x7fde980b3e30 2023-11-04T01:48:12.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde8dffb640 1 -- 172.21.15.2:0/3907566578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9400ca00 con 0x7fde980b3e30 2023-11-04T01:48:12.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde8dffb640 1 -- 172.21.15.2:0/3907566578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9400cd70 con 0x7fde980b3e30 2023-11-04T01:48:12.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde980c7570 con 0x7fde980b3e30 2023-11-04T01:48:12.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde98156f90 con 0x7fde980b3e30 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9804e4a0 con 0x7fde980b3e30 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.691+0000 7fde8dffb640 1 -- 172.21.15.2:0/3907566578 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fde94013470 con 0x7fde980b3e30 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.695+0000 7fde8dffb640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde7c0664a0 0x7fde7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.695+0000 7fde8dffb640 1 -- 172.21.15.2:0/3907566578 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7404+0+0 (secure 0 0 0) 0x7fde94084630 con 0x7fde980b3e30 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.695+0000 7fde9cbe3640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde7c0664a0 0x7fde7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:12.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.695+0000 7fde9cbe3640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde7c0664a0 0x7fde7c068960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fde880af000 tx=0x7fde880a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:12.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.699+0000 7fde8dffb640 1 -- 172.21.15.2:0/3907566578 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde94051610 con 0x7fde980b3e30 2023-11-04T01:48:12.885 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.879+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde9815bd70 con 0x7fde980b3e30 2023-11-04T01:48:12.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde8dffb640 1 -- 172.21.15.2:0/3907566578 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4135 (secure 0 0 0) 0x7fde94054c30 con 0x7fde980b3e30 2023-11-04T01:48:12.886 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:12.886 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":90,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:12.544197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:resolve","state_seq":8,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:12.886 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 90 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde7c0664a0 msgr2=0x7fde7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde7c0664a0 0x7fde7c068960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fde880af000 tx=0x7fde880a7000 comp rx=0 tx=0).stop 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde980b3e30 msgr2=0x7fde9815abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde980b3e30 0x7fde9815abf0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e930 tx=0x7fde9400edf0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 shutdown_connections 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde7c0664a0 0x7fde7c068960 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde98160a60 0x7fde980c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde98160680 0x7fde98155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 --2- 172.21.15.2:0/3907566578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde980b3e30 0x7fde9815abf0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:12.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 >> 172.21.15.2:0/3907566578 conn(0x7fde980d2f90 msgr2=0x7fde980d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:12.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 shutdown_connections 2023-11-04T01:48:12.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:12.883+0000 7fde9f648640 1 -- 172.21.15.2:0/3907566578 wait complete. 2023-11-04T01:48:12.904 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:48:15.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:48:17.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:18.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 Processor -- start 2023-11-04T01:48:18.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 -- start start 2023-11-04T01:48:18.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06bde0 0x7f4edc0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4edc0c92b0 0x7f4edc15c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4edc06c1c0 0x7f4edc1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc0c9ac0 con 0x7f4edc06c1c0 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc0caf20 con 0x7f4edc0c92b0 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee302f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc15c5d0 con 0x7f4edc06bde0 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4edc06c1c0 0x7f4edc1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4edc06c1c0 0x7f4edc1442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49018/0 (socket says 172.21.15.2:49018) 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 -- 172.21.15.2:0/1909458674 learned_addr learned my addr 172.21.15.2:0/1909458674 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee0dcb640 1 --2- 172.21.15.2:0/1909458674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06bde0 0x7f4edc0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4edbfff640 1 --2- 172.21.15.2:0/1909458674 >> v2:172.21.15.90:3300/0 conn(0x7f4edc0c92b0 0x7f4edc15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 -- 172.21.15.2:0/1909458674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06bde0 msgr2=0x7f4edc0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 --2- 172.21.15.2:0/1909458674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06bde0 0x7f4edc0cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 -- 172.21.15.2:0/1909458674 >> v2:172.21.15.90:3300/0 conn(0x7f4edc0c92b0 msgr2=0x7f4edc15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 --2- 172.21.15.2:0/1909458674 >> v2:172.21.15.90:3300/0 conn(0x7f4edc0c92b0 0x7f4edc15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.039+0000 7f4ee15cc640 1 -- 172.21.15.2:0/1909458674 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0c97e0 con 0x7f4edc06c1c0 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 --2- 172.21.15.2:0/1909458674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc06c1c0 0x7f4edc1442b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4edc06dc00 tx=0x7f4ed401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827cbdc90d2f087e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4edb7fe640 1 -- 172.21.15.2:0/1909458674 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40a5740 con 0x7f4edc06c1c0 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4edb7fe640 1 -- 172.21.15.2:0/1909458674 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed40a58a0 con 0x7f4edc06c1c0 2023-11-04T01:48:18.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4edb7fe640 1 -- 172.21.15.2:0/1909458674 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40a5c30 con 0x7f4edc06c1c0 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- 172.21.15.2:0/1909458674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc06c1c0 msgr2=0x7f4edc1442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 --2- 172.21.15.2:0/1909458674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc06c1c0 0x7f4edc1442b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4edc06dc00 tx=0x7f4ed401c9d0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- 172.21.15.2:0/1909458674 shutdown_connections 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 --2- 172.21.15.2:0/1909458674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc06c1c0 0x7f4edc1442b0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 --2- 172.21.15.2:0/1909458674 >> v2:172.21.15.90:3300/0 conn(0x7f4edc0c92b0 0x7f4edc15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 --2- 172.21.15.2:0/1909458674 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06bde0 0x7f4edc0cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- 172.21.15.2:0/1909458674 >> 172.21.15.2:0/1909458674 conn(0x7f4edc0b0890 msgr2=0x7f4edc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- 172.21.15.2:0/1909458674 shutdown_connections 2023-11-04T01:48:18.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- 172.21.15.2:0/1909458674 wait complete. 2023-11-04T01:48:18.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 Processor -- start 2023-11-04T01:48:18.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- start start 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4edc06bde0 0x7f4edc13df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06c1c0 0x7f4edc13fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc0c92b0 0x7f4edc0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc158440 con 0x7f4edc0c92b0 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc13e460 con 0x7f4edc06bde0 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee302f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc1586b0 con 0x7f4edc06c1c0 2023-11-04T01:48:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc0c92b0 0x7f4edc0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc0c92b0 0x7f4edc0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49030/0 (socket says 172.21.15.2:49030) 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 -- 172.21.15.2:0/2832648942 learned_addr learned my addr 172.21.15.2:0/2832648942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4edbfff640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06c1c0 0x7f4edc13fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee0dcb640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4edc06bde0 0x7f4edc13df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 -- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06c1c0 msgr2=0x7f4edc13fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06c1c0 0x7f4edc13fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 -- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4edc06bde0 msgr2=0x7f4edc13df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4edc06bde0 0x7f4edc13df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 -- 172.21.15.2:0/2832648942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009b30 con 0x7f4edc0c92b0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.043+0000 7f4ee15cc640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc0c92b0 0x7f4edc0b1980 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40af040 tx=0x7f4ed4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ed97fa640 1 -- 172.21.15.2:0/2832648942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40b8670 con 0x7f4edc0c92b0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ed97fa640 1 -- 172.21.15.2:0/2832648942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed40b87f0 con 0x7f4edc0c92b0 2023-11-04T01:48:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0b3de0 con 0x7f4edc0c92b0 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ed97fa640 1 -- 172.21.15.2:0/2832648942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40b8ba0 con 0x7f4edc0c92b0 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc0b43a0 con 0x7f4edc0c92b0 2023-11-04T01:48:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc158840 con 0x7f4edc0c92b0 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ed97fa640 1 -- 172.21.15.2:0/2832648942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ed40b8d00 con 0x7f4edc0c92b0 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ed97fa640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ec00664d0 0x7f4ec0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ed97fa640 1 -- 172.21.15.2:0/2832648942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7404+0+0 (secure 0 0 0) 0x7f4ed411fb70 con 0x7f4edc0c92b0 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ee0dcb640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ec00664d0 0x7f4ec0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.047+0000 7f4ee0dcb640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ec00664d0 0x7f4ec0068990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4edc13b820 tx=0x7f4ed0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:18.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.051+0000 7f4ed97fa640 1 -- 172.21.15.2:0/2832648942 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ed40eca70 con 0x7f4edc0c92b0 2023-11-04T01:48:18.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.239+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4edc0b4590 con 0x7f4edc0c92b0 2023-11-04T01:48:18.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ed97fa640 1 -- 172.21.15.2:0/2832648942 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f4ed40f0090 con 0x7f4edc0c92b0 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:13.573044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:18.247 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 92 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ec00664d0 msgr2=0x7f4ec0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ec00664d0 0x7f4ec0068990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4edc13b820 tx=0x7f4ed0008040 comp rx=0 tx=0).stop 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc0c92b0 msgr2=0x7f4edc0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc0c92b0 0x7f4edc0b1980 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40af040 tx=0x7f4ed4019770 comp rx=0 tx=0).stop 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 shutdown_connections 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4ec00664d0 0x7f4ec0068990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4edc0c92b0 0x7f4edc0b1980 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4edc06c1c0 0x7f4edc13fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 --2- 172.21.15.2:0/2832648942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4edc06bde0 0x7f4edc13df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 >> 172.21.15.2:0/2832648942 conn(0x7f4edc0b0890 msgr2=0x7f4edc0cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 shutdown_connections 2023-11-04T01:48:18.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.243+0000 7f4ee302f640 1 -- 172.21.15.2:0/2832648942 wait complete. 2023-11-04T01:48:18.266 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:48:18.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.379+0000 7f7b832bb640 1 Processor -- start 2023-11-04T01:48:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.379+0000 7f7b832bb640 1 -- start start 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b832bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b7c0cd1d0 0x7f7b7c153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b832bb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c0ca010 con 0x7f7b7c0caf00 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b832bb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c154020 con 0x7f7b7c15d130 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b832bb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c0cd5b0 con 0x7f7b7c0cd1d0 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b81057640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b7c0cd1d0 0x7f7b7c153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b81057640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7b7c0cd1d0 0x7f7b7c153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49032/0 (socket says 172.21.15.2:49032) 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b80856640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7b7c0caf00 0x7f7b7c0cb6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47464/0 (socket says 172.21.15.2:47464) 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b81057640 1 -- 172.21.15.2:0/1514227408 learned_addr learned my addr 172.21.15.2:0/1514227408 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b81057640 1 -- 172.21.15.2:0/1514227408 >> v1:172.21.15.90:6789/0 conn(0x7f7b7c15d130 legacy=0x7f7b7c1644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b81057640 1 -- 172.21.15.2:0/1514227408 >> v1:172.21.15.2:6789/0 conn(0x7f7b7c0caf00 legacy=0x7f7b7c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b81057640 1 -- 172.21.15.2:0/1514227408 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0cd7b0 con 0x7f7b7c0cd1d0 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b81057640 1 --2- 172.21.15.2:0/1514227408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0cd1d0 0x7f7b7c153ae0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009e50 tx=0x7f7b6c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33204e144f84738 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b7bfff640 1 -- 172.21.15.2:0/1514227408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a5690 con 0x7f7b7c0cd1d0 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b7bfff640 1 -- 172.21.15.2:0/1514227408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0a57f0 con 0x7f7b7c0cd1d0 2023-11-04T01:48:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.383+0000 7f7b7bfff640 1 -- 172.21.15.2:0/1514227408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a5b80 con 0x7f7b7c0cd1d0 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- 172.21.15.2:0/1514227408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0cd1d0 msgr2=0x7f7b7c153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 --2- 172.21.15.2:0/1514227408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0cd1d0 0x7f7b7c153ae0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009e50 tx=0x7f7b6c01c9d0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- 172.21.15.2:0/1514227408 shutdown_connections 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 --2- 172.21.15.2:0/1514227408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c0cd1d0 0x7f7b7c153ae0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- 172.21.15.2:0/1514227408 >> 172.21.15.2:0/1514227408 conn(0x7f7b7c0b0890 msgr2=0x7f7b7c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- 172.21.15.2:0/1514227408 shutdown_connections 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- 172.21.15.2:0/1514227408 wait complete. 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 Processor -- start 2023-11-04T01:48:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- start start 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0caf00 0x7f7b7c0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c0cd1d0 0x7f7b7c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c15d130 0x7f7b7c0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c5440 con 0x7f7b7c15d130 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c4e80 con 0x7f7b7c0caf00 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c5160 con 0x7f7b7c0cd1d0 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c15d130 0x7f7b7c0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c15d130 0x7f7b7c0c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49036/0 (socket says 172.21.15.2:49036) 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 -- 172.21.15.2:0/2023652905 learned_addr learned my addr 172.21.15.2:0/2023652905 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81057640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0caf00 0x7f7b7c0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b80856640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c0cd1d0 0x7f7b7c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 -- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c0cd1d0 msgr2=0x7f7b7c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c0cd1d0 0x7f7b7c0b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 -- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0caf00 msgr2=0x7f7b7c0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0caf00 0x7f7b7c0b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 -- 172.21.15.2:0/2023652905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c009b30 con 0x7f7b7c15d130 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b81858640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c15d130 0x7f7b7c0c4220 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400d990 tx=0x7f7b7400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b79ffb640 1 -- 172.21.15.2:0/2023652905 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400ece0 con 0x7f7b7c15d130 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b79ffb640 1 -- 172.21.15.2:0/2023652905 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7400ee40 con 0x7f7b7c15d130 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b79ffb640 1 -- 172.21.15.2:0/2023652905 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74016680 con 0x7f7b7c15d130 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c149300 con 0x7f7b7c15d130 2023-11-04T01:48:18.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.387+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c14b7d0 con 0x7f7b7c15d130 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.391+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c14bab0 con 0x7f7b7c15d130 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.391+0000 7f7b79ffb640 1 -- 172.21.15.2:0/2023652905 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b74004020 con 0x7f7b7c15d130 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.391+0000 7f7b79ffb640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b680664a0 0x7f7b68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.391+0000 7f7b79ffb640 1 -- 172.21.15.2:0/2023652905 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7404+0+0 (secure 0 0 0) 0x7f7b74086350 con 0x7f7b7c15d130 2023-11-04T01:48:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.391+0000 7f7b81057640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b680664a0 0x7f7b68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:18.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.391+0000 7f7b81057640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b680664a0 0x7f7b68068960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0ae000 tx=0x7f7b6c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:18.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.395+0000 7f7b79ffb640 1 -- 172.21.15.2:0/2023652905 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b740531c0 con 0x7f7b7c15d130 2023-11-04T01:48:18.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.583+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b7c04e4a0 con 0x7f7b7c15d130 2023-11-04T01:48:18.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.583+0000 7f7b79ffb640 1 -- 172.21.15.2:0/2023652905 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f7b740567e0 con 0x7f7b7c15d130 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:13.573044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:18.589 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 92 2023-11-04T01:48:18.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b680664a0 msgr2=0x7f7b68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b680664a0 0x7f7b68068960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0ae000 tx=0x7f7b6c0a7070 comp rx=0 tx=0).stop 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c15d130 msgr2=0x7f7b7c0c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c15d130 0x7f7b7c0c4220 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400d990 tx=0x7f7b7400de50 comp rx=0 tx=0).stop 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 shutdown_connections 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b680664a0 0x7f7b68068960 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b7c15d130 0x7f7b7c0c4220 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7c0cd1d0 0x7f7b7c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 --2- 172.21.15.2:0/2023652905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b7c0caf00 0x7f7b7c0b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 >> 172.21.15.2:0/2023652905 conn(0x7f7b7c0b0890 msgr2=0x7f7b7c0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 shutdown_connections 2023-11-04T01:48:18.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:18.587+0000 7f7b832bb640 1 -- 172.21.15.2:0/2023652905 wait complete. 2023-11-04T01:48:18.607 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:48:19.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec9ec0640 1 Processor -- start 2023-11-04T01:48:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec9ec0640 1 -- start start 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec9ec0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 0x7f6ec415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec9ec0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec40ca100 con 0x7f6ec40cbd80 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec9ec0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec40ca3e0 con 0x7f6ec4142ad0 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec9ec0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40ca6c0 con 0x7f6ec4142eb0 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec3fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6ec40cbd80 0x7f6ec40c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47476/0 (socket says 172.21.15.2:47476) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec3fff640 1 -- 172.21.15.2:0/1308670189 learned_addr learned my addr 172.21.15.2:0/1308670189 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:19.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 0x7f6ec415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391948681 0 0) 0x7f6ec40ca100 con 0x7f6ec40cbd80 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eac003530 con 0x7f6ec40cbd80 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257542444 0 0) 0x7f6ec40ca3e0 con 0x7f6ec4142ad0 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec40ca100 con 0x7f6ec4142ad0 2023-11-04T01:48:19.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360304512 0 0) 0x7f6eac003530 con 0x7f6ec40cbd80 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 msgr2=0x7f6ec415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 0x7f6ec415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 >> v1:172.21.15.90:6789/0 conn(0x7f6ec4142ad0 legacy=0x7f6ec40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec40ca9a0 con 0x7f6ec40cbd80 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f6ebc001a20 con 0x7f6ec40cbd80 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 >> v1:172.21.15.2:6789/0 conn(0x7f6ec40cbd80 legacy=0x7f6ec40c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eac003b40 0x7f6eac003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6eac0047d0 0x7f6eac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 0x7f6eac0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40ca6c0 con 0x7f6eac0047d0 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac00bad0 con 0x7f6eac003b40 2023-11-04T01:48:19.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac00bc90 con 0x7f6ec4142eb0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6eac0047d0 0x7f6eac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec37fe640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eac003b40 0x7f6eac003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec3fff640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 0x7f6eac0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec2ffd640 1 -- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 msgr2=0x7f6eac0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 0x7f6eac0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec2ffd640 1 -- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eac003b40 msgr2=0x7f6eac003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eac003b40 0x7f6eac003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec2ffd640 1 -- 172.21.15.2:0/1308670189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac003530 con 0x7f6eac0047d0 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec3fff640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ec4142eb0 0x7f6eac0051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:19.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.739+0000 7f6ec37fe640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6eac003b40 0x7f6eac003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6eac0047d0 0x7f6eac004c50 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009ae0 tx=0x7f6eb801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5f7afc3989d6ce server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:19.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80a5640 con 0x7f6eac0047d0 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb80a57a0 con 0x7f6eac0047d0 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec27fc640 1 -- 172.21.15.2:0/1308670189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80a5b50 con 0x7f6eac0047d0 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/1308670189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6eac0047d0 msgr2=0x7f6eac004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 --2- 172.21.15.2:0/1308670189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6eac0047d0 0x7f6eac004c50 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009ae0 tx=0x7f6eb801ca50 comp rx=0 tx=0).stop 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec3fff640 1 -- 172.21.15.2:0/1308670189 reap_dead start 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/1308670189 shutdown_connections 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/1308670189 >> 172.21.15.2:0/1308670189 conn(0x7f6ec40b0890 msgr2=0x7f6ec40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/1308670189 shutdown_connections 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/1308670189 wait complete. 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 Processor -- start 2023-11-04T01:48:19.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- start start 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6eac0047d0 0x7f6ec413e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec4160980 0x7f6ec40aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ec40af530 0x7f6ec415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40af9b0 con 0x7f6ec4160980 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec413ec50 con 0x7f6ec40af530 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.743+0000 7f6ec9ec0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec415f8e0 con 0x7f6eac0047d0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec4160980 0x7f6ec40aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec4160980 0x7f6ec40aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49060/0 (socket says 172.21.15.2:49060) 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 -- 172.21.15.2:0/4259557103 learned_addr learned my addr 172.21.15.2:0/4259557103 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec3fff640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ec40af530 0x7f6ec415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec37fe640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6eac0047d0 0x7f6ec413e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 -- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6eac0047d0 msgr2=0x7f6ec413e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6eac0047d0 0x7f6ec413e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 -- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ec40af530 msgr2=0x7f6ec415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:19.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ec40af530 0x7f6ec415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 -- 172.21.15.2:0/4259557103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec415fbc0 con 0x7f6ec4160980 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec2ffd640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec4160980 0x7f6ec40aeff0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009ae0 tx=0x7f6eac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6eabfff640 1 -- 172.21.15.2:0/4259557103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80be070 con 0x7f6ec4160980 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6eabfff640 1 -- 172.21.15.2:0/4259557103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb800f000 con 0x7f6ec4160980 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec415fea0 con 0x7f6ec4160980 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6eabfff640 1 -- 172.21.15.2:0/4259557103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80a5640 con 0x7f6ec4160980 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec4160460 con 0x7f6ec4160980 2023-11-04T01:48:19.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec404e4a0 con 0x7f6ec4160980 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6eabfff640 1 -- 172.21.15.2:0/4259557103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6eb80b4040 con 0x7f6ec4160980 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6eabfff640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6eb00664a0 0x7f6eb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6eabfff640 1 -- 172.21.15.2:0/4259557103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7404+0+0 (secure 0 0 0) 0x7f6eb811dd20 con 0x7f6ec4160980 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.747+0000 7f6ec37fe640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6eb00664a0 0x7f6eb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:19.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.751+0000 7f6ec37fe640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6eb00664a0 0x7f6eb0068960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6ec415daa0 tx=0x7f6eb4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:19.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.751+0000 7f6eabfff640 1 -- 172.21.15.2:0/4259557103 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6eb80eaba0 con 0x7f6ec4160980 2023-11-04T01:48:19.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.943+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ec406d010 con 0x7f6ec4160980 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.943+0000 7f6eabfff640 1 -- 172.21.15.2:0/4259557103 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4929 (secure 0 0 0) 0x7f6eb80ee1c0 con 0x7f6ec4160980 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:13.573044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:19.949 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 92 2023-11-04T01:48:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6eb00664a0 msgr2=0x7f6eb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6eb00664a0 0x7f6eb0068960 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6ec415daa0 tx=0x7f6eb4009040 comp rx=0 tx=0).stop 2023-11-04T01:48:19.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec4160980 msgr2=0x7f6ec40aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec4160980 0x7f6ec40aeff0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009ae0 tx=0x7f6eac005800 comp rx=0 tx=0).stop 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 shutdown_connections 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6eb00664a0 0x7f6eb0068960 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ec40af530 0x7f6ec415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec4160980 0x7f6ec40aeff0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 --2- 172.21.15.2:0/4259557103 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6eac0047d0 0x7f6ec413e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 >> 172.21.15.2:0/4259557103 conn(0x7f6ec40b0890 msgr2=0x7f6ec40ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 shutdown_connections 2023-11-04T01:48:19.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:19.947+0000 7f6ec9ec0640 1 -- 172.21.15.2:0/4259557103 wait complete. 2023-11-04T01:48:19.968 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:48:20.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e7a10640 1 Processor -- start 2023-11-04T01:48:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e7a10640 1 -- start start 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e7a10640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 0x7fa8e00ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e7a10640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e00cf000 con 0x7fa8e00ce7f0 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e7a10640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e00b5de0 con 0x7fa8e0160680 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e7a10640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00d09b0 con 0x7fa8e0160a60 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e5fad640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa8e00ce7f0 0x7fa8e00b62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:47492/0 (socket says 172.21.15.2:47492) 2023-11-04T01:48:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e5fad640 1 -- 172.21.15.2:0/1015623337 learned_addr learned my addr 172.21.15.2:0/1015623337 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 0x7fa8e00ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591348911 0 0) 0x7fa8e00cf000 con 0x7fa8e00ce7f0 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8cc003530 con 0x7fa8e00ce7f0 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3699226062 0 0) 0x7fa8cc003530 con 0x7fa8e00ce7f0 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 msgr2=0x7fa8e00ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 0x7fa8e00ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 >> v1:172.21.15.90:6789/0 conn(0x7fa8e0160680 legacy=0x7fa8e00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00d1610 con 0x7fa8e00ce7f0 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa8d8001a00 con 0x7fa8e00ce7f0 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 >> v1:172.21.15.2:6789/0 conn(0x7fa8e00ce7f0 legacy=0x7fa8e00b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0039b0 0x7fa8cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc0047d0 0x7fa8cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 0x7fa8cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00d09b0 con 0x7fa8cc0047d0 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc00ba70 con 0x7fa8cc0039b0 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc00bc30 con 0x7fa8e0160a60 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc0047d0 0x7fa8cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e57ac640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0039b0 0x7fa8cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e5fad640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 0x7fa8cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e4fab640 1 -- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 msgr2=0x7fa8cc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 0x7fa8cc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e4fab640 1 -- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0039b0 msgr2=0x7fa8cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0039b0 0x7fa8cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e4fab640 1 -- 172.21.15.2:0/1015623337 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc003530 con 0x7fa8cc0047d0 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e57ac640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0039b0 0x7fa8cc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.099+0000 7fa8e5fad640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0160a60 0x7fa8cc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc0047d0 0x7fa8cc004c50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009ab0 tx=0x7fa8d001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2510d7a65538f14d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00a5600 con 0x7fa8cc0047d0 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8002100 con 0x7fa8cc0047d0 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8d7fff640 1 -- 172.21.15.2:0/1015623337 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d00a59a0 con 0x7fa8cc0047d0 2023-11-04T01:48:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 -- 172.21.15.2:0/1015623337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc0047d0 msgr2=0x7fa8cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 --2- 172.21.15.2:0/1015623337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8cc0047d0 0x7fa8cc004c50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009ab0 tx=0x7fa8d001ca10 comp rx=0 tx=0).stop 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e5fad640 1 -- 172.21.15.2:0/1015623337 reap_dead start 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 -- 172.21.15.2:0/1015623337 shutdown_connections 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 -- 172.21.15.2:0/1015623337 >> 172.21.15.2:0/1015623337 conn(0x7fa8e00d2f90 msgr2=0x7fa8e00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 -- 172.21.15.2:0/1015623337 shutdown_connections 2023-11-04T01:48:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 -- 172.21.15.2:0/1015623337 wait complete. 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 Processor -- start 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.103+0000 7fa8e7a10640 1 -- start start 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0047d0 0x7fa8e0152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e00c7880 0x7fa8e015c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0153420 0x7fa8e00b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015c880 con 0x7fa8e00c7880 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e015cb50 con 0x7fa8cc0047d0 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00c6ac0 con 0x7fa8e0153420 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e00c7880 0x7fa8e015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e00c7880 0x7fa8e015c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49072/0 (socket says 172.21.15.2:49072) 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 -- 172.21.15.2:0/963361127 learned_addr learned my addr 172.21.15.2:0/963361127 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 -- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0153420 msgr2=0x7fa8e00b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0153420 0x7fa8e00b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 -- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0047d0 msgr2=0x7fa8e0152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0047d0 0x7fa8e0152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 -- 172.21.15.2:0/963361127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e00c6da0 con 0x7fa8e00c7880 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e4fab640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e00c7880 0x7fa8e015c340 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009ab0 tx=0x7fa8cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8d5ffb640 1 -- 172.21.15.2:0/963361127 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0004220 con 0x7fa8e00c7880 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8d5ffb640 1 -- 172.21.15.2:0/963361127 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d0004380 con 0x7fa8e00c7880 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e00c7080 con 0x7fa8e00c7880 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8d5ffb640 1 -- 172.21.15.2:0/963361127 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0003820 con 0x7fa8e00c7880 2023-11-04T01:48:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e00b7bd0 con 0x7fa8e00c7880 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e004e4a0 con 0x7fa8e00c7880 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8d5ffb640 1 -- 172.21.15.2:0/963361127 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8d00b4040 con 0x7fa8e00c7880 2023-11-04T01:48:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8d5ffb640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8c40664d0 0x7fa8c4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8d5ffb640 1 -- 172.21.15.2:0/963361127 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 7404+0+0 (secure 0 0 0) 0x7fa8d011e9e0 con 0x7fa8e00c7880 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.107+0000 7fa8e57ac640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8c40664d0 0x7fa8c4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.111+0000 7fa8e57ac640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8c40664d0 0x7fa8c4068990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007ab0 tx=0x7fa8dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.111+0000 7fa8d5ffb640 1 -- 172.21.15.2:0/963361127 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8d00eb980 con 0x7fa8e00c7880 2023-11-04T01:48:21.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.299+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8e00b8dd0 con 0x7fa8e00c7880 2023-11-04T01:48:21.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8d5ffb640 1 -- 172.21.15.2:0/963361127 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4929 (secure 0 0 0) 0x7fa8d00eefa0 con 0x7fa8e00c7880 2023-11-04T01:48:21.307 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:21.307 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":92,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:13.573044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:21.307 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 92 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8c40664d0 msgr2=0x7fa8c4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8c40664d0 0x7fa8c4068990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007ab0 tx=0x7fa8dc009040 comp rx=0 tx=0).stop 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e00c7880 msgr2=0x7fa8e015c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e00c7880 0x7fa8e015c340 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009ab0 tx=0x7fa8cc005800 comp rx=0 tx=0).stop 2023-11-04T01:48:21.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 shutdown_connections 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa8c40664d0 0x7fa8c4068990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa8e0153420 0x7fa8e00b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8e00c7880 0x7fa8e015c340 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 --2- 172.21.15.2:0/963361127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8cc0047d0 0x7fa8e0152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 >> 172.21.15.2:0/963361127 conn(0x7fa8e00d2f90 msgr2=0x7fa8e00ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 shutdown_connections 2023-11-04T01:48:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:21.303+0000 7fa8e7a10640 1 -- 172.21.15.2:0/963361127 wait complete. 2023-11-04T01:48:21.327 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:48:22.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:22.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.455+0000 7f372b807640 1 Processor -- start 2023-11-04T01:48:22.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.455+0000 7f372b807640 1 -- start start 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f372b807640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 0x7f37240cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f372b807640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f372406c1c0 0x7f37241442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f372b807640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37240c9ac0 con 0x7f372406bde0 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f372b807640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37240caf20 con 0x7f372406c1c0 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f372b807640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c97e0 con 0x7f37240c92b0 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f37295a3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f372406bde0 0x7f372415c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43814/0 (socket says 172.21.15.2:43814) 2023-11-04T01:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f37295a3640 1 -- 172.21.15.2:0/1287653015 learned_addr learned my addr 172.21.15.2:0/1287653015 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3728da2640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 0x7f37240cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3729da4640 1 --2- 172.21.15.2:0/1287653015 >> v2:172.21.15.90:3300/0 conn(0x7f372406c1c0 0x7f37241442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227283962 0 0) 0x7f37240c9ac0 con 0x7f372406bde0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3710003530 con 0x7f372406bde0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 474887029 0 0) 0x7f3710003530 con 0x7f372406bde0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 msgr2=0x7f37240cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 0x7f37240cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 >> v2:172.21.15.90:3300/0 conn(0x7f372406c1c0 msgr2=0x7f37241442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 --2- 172.21.15.2:0/1287653015 >> v2:172.21.15.90:3300/0 conn(0x7f372406c1c0 0x7f37241442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240cb1c0 con 0x7f372406bde0 2023-11-04T01:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3720001a00 con 0x7f372406bde0 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 >> v1:172.21.15.2:6789/0 conn(0x7f372406bde0 legacy=0x7f372415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 0x7f3710003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3710003f00 0x7f37100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3710004d10 0x7f3710005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240caf20 con 0x7f3710004d10 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c97e0 con 0x7f3710003f00 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371000b990 con 0x7f37240c92b0 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3729da4640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3710004d10 0x7f3710005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3728da2640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3710003f00 0x7f37100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f37295a3640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 0x7f3710003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3729da4640 1 -- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 msgr2=0x7f3710003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3729da4640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f37240c92b0 0x7f3710003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3729da4640 1 -- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3710003f00 msgr2=0x7f37100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3729da4640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3710003f00 0x7f37100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3729da4640 1 -- 172.21.15.2:0/1287653015 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3710003530 con 0x7f3710004d10 2023-11-04T01:48:22.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.459+0000 7f3728da2640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3710003f00 0x7f37100047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f3729da4640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3710004d10 0x7f3710005190 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f371c00de10 tx=0x7f371c020a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2f853820ecd57 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00d2d0 con 0x7f3710004d10 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c013040 con 0x7f3710004d10 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f371bfff640 1 -- 172.21.15.2:0/1287653015 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0a9b30 con 0x7f3710004d10 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 -- 172.21.15.2:0/1287653015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3710004d10 msgr2=0x7f3710005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 --2- 172.21.15.2:0/1287653015 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3710004d10 0x7f3710005190 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f371c00de10 tx=0x7f371c020a80 comp rx=0 tx=0).stop 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f3729da4640 1 -- 172.21.15.2:0/1287653015 reap_dead start 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 -- 172.21.15.2:0/1287653015 shutdown_connections 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 -- 172.21.15.2:0/1287653015 >> 172.21.15.2:0/1287653015 conn(0x7f37240b0890 msgr2=0x7f37240b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 -- 172.21.15.2:0/1287653015 shutdown_connections 2023-11-04T01:48:22.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 -- 172.21.15.2:0/1287653015 wait complete. 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 Processor -- start 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.463+0000 7f372b807640 1 -- start start 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3710004d10 0x7f372414c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372413b1b0 0x7f372414b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37240b3b50 0x7f37241496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240b36c0 con 0x7f372413b1b0 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240b2af0 con 0x7f37240b3b50 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240b2d90 con 0x7f3710004d10 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372413b1b0 0x7f372414b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372413b1b0 0x7f372414b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40502/0 (socket says 172.21.15.2:40502) 2023-11-04T01:48:22.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 -- 172.21.15.2:0/2337018787 learned_addr learned my addr 172.21.15.2:0/2337018787 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3729da4640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37240b3b50 0x7f37241496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f37295a3640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3710004d10 0x7f372414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 -- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3710004d10 msgr2=0x7f372414c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3710004d10 0x7f372414c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 -- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37240b3b50 msgr2=0x7f37241496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37240b3b50 0x7f37241496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 -- 172.21.15.2:0/2337018787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240b3070 con 0x7f372413b1b0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3728da2640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372413b1b0 0x7f372414b960 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f3714011560 tx=0x7f3714011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3719ffb640 1 -- 172.21.15.2:0/2337018787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714015870 con 0x7f372413b1b0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3719ffb640 1 -- 172.21.15.2:0/2337018787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37140159d0 con 0x7f372413b1b0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3719ffb640 1 -- 172.21.15.2:0/2337018787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3714015d60 con 0x7f372413b1b0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240b3350 con 0x7f372413b1b0 2023-11-04T01:48:22.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372414bea0 con 0x7f372413b1b0 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372404e4a0 con 0x7f372413b1b0 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3719ffb640 1 -- 172.21.15.2:0/2337018787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f371401d400 con 0x7f372413b1b0 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3719ffb640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37080664a0 0x7f3708068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:22.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f3719ffb640 1 -- 172.21.15.2:0/2337018787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f3714084db0 con 0x7f372413b1b0 2023-11-04T01:48:22.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.467+0000 7f37295a3640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37080664a0 0x7f3708068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:22.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.471+0000 7f37295a3640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37080664a0 0x7f3708068960 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f37200013e0 tx=0x7f3720009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:22.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.471+0000 7f3719ffb640 1 -- 172.21.15.2:0/2337018787 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3714051b60 con 0x7f372413b1b0 2023-11-04T01:48:22.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.663+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37240b3800 con 0x7f372413b1b0 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.663+0000 7f3719ffb640 1 -- 172.21.15.2:0/2337018787 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f3714055180 con 0x7f372413b1b0 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":93,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:21.660316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:22.668 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 93 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37080664a0 msgr2=0x7f3708068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37080664a0 0x7f3708068960 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f37200013e0 tx=0x7f3720009040 comp rx=0 tx=0).stop 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372413b1b0 msgr2=0x7f372414b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372413b1b0 0x7f372414b960 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f3714011560 tx=0x7f3714011a20 comp rx=0 tx=0).stop 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 shutdown_connections 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37080664a0 0x7f3708068960 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37240b3b50 0x7f37241496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372413b1b0 0x7f372414b960 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 --2- 172.21.15.2:0/2337018787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3710004d10 0x7f372414c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 >> 172.21.15.2:0/2337018787 conn(0x7f37240b0890 msgr2=0x7f37240cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 shutdown_connections 2023-11-04T01:48:22.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:22.667+0000 7f372b807640 1 -- 172.21.15.2:0/2337018787 wait complete. 2023-11-04T01:48:22.687 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:rejoin 2023-11-04T01:48:23.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1783727640 1 Processor -- start 2023-11-04T01:48:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1783727640 1 -- start start 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1783727640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f177c15d840 0x7f177c1644c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1783727640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c0ca010 con 0x7f177c0cd1d0 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1783727640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c0cd7b0 con 0x7f177c153ae0 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1783727640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c0ca260 con 0x7f177c15d840 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1780cc2640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f177c0cd1d0 0x7f177c15d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43820/0 (socket says 172.21.15.2:43820) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1780cc2640 1 -- 172.21.15.2:0/2899970174 learned_addr learned my addr 172.21.15.2:0/2899970174 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1781cc4640 1 --2- 172.21.15.2:0/2899970174 >> v2:172.21.15.2:3300/0 conn(0x7f177c15d840 0x7f177c1644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1773fff640 1 -- 172.21.15.2:0/2899970174 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406602587 0 0) 0x7f177c0ca010 con 0x7f177c0cd1d0 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1773fff640 1 -- 172.21.15.2:0/2899970174 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1768003450 con 0x7f177c0cd1d0 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1781cc4640 1 -- 172.21.15.2:0/2899970174 >> v1:172.21.15.90:6789/0 conn(0x7f177c153ae0 legacy=0x7f177c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1781cc4640 1 -- 172.21.15.2:0/2899970174 >> v1:172.21.15.2:6789/0 conn(0x7f177c0cd1d0 legacy=0x7f177c15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.819+0000 7f1781cc4640 1 -- 172.21.15.2:0/2899970174 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c0ca540 con 0x7f177c15d840 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1781cc4640 1 --2- 172.21.15.2:0/2899970174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c15d840 0x7f177c1644c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f58ef041204c69c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1773fff640 1 -- 172.21.15.2:0/2899970174 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740a5790 con 0x7f177c15d840 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1773fff640 1 -- 172.21.15.2:0/2899970174 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17740a58f0 con 0x7f177c15d840 2023-11-04T01:48:23.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1773fff640 1 -- 172.21.15.2:0/2899970174 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17740a5c80 con 0x7f177c15d840 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- 172.21.15.2:0/2899970174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c15d840 msgr2=0x7f177c1644c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 --2- 172.21.15.2:0/2899970174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c15d840 0x7f177c1644c0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f1774009d90 tx=0x7f177401c950 comp rx=0 tx=0).stop 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- 172.21.15.2:0/2899970174 shutdown_connections 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 --2- 172.21.15.2:0/2899970174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c15d840 0x7f177c1644c0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- 172.21.15.2:0/2899970174 >> 172.21.15.2:0/2899970174 conn(0x7f177c0b0890 msgr2=0x7f177c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- 172.21.15.2:0/2899970174 shutdown_connections 2023-11-04T01:48:23.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- 172.21.15.2:0/2899970174 wait complete. 2023-11-04T01:48:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 Processor -- start 2023-11-04T01:48:23.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- start start 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0cd1d0 0x7f177c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f177c153ae0 0x7f177c148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f177c15d840 0x7f177c151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c070900 con 0x7f177c0cd1d0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c070b30 con 0x7f177c15d840 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1783727640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c070e10 con 0x7f177c153ae0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0cd1d0 0x7f177c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0cd1d0 0x7f177c0703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40524/0 (socket says 172.21.15.2:40524) 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 -- 172.21.15.2:0/890004419 learned_addr learned my addr 172.21.15.2:0/890004419 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1780cc2640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f177c153ae0 0x7f177c148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f1781cc4640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f177c15d840 0x7f177c151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 -- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f177c153ae0 msgr2=0x7f177c148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f177c153ae0 0x7f177c148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 -- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f177c15d840 msgr2=0x7f177c151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f177c15d840 0x7f177c151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.823+0000 7f17814c3640 1 -- 172.21.15.2:0/890004419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774009a70 con 0x7f177c0cd1d0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f17814c3640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0cd1d0 0x7f177c0703c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f177800c500 tx=0x7f177800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1771ffb640 1 -- 172.21.15.2:0/890004419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778005220 con 0x7f177c0cd1d0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1771ffb640 1 -- 172.21.15.2:0/890004419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778005380 con 0x7f177c0cd1d0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c0710f0 con 0x7f177c0cd1d0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1771ffb640 1 -- 172.21.15.2:0/890004419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778007270 con 0x7f177c0cd1d0 2023-11-04T01:48:23.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c1485d0 con 0x7f177c0cd1d0 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c0c4080 con 0x7f177c0cd1d0 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1771ffb640 1 -- 172.21.15.2:0/890004419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17780073d0 con 0x7f177c0cd1d0 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1771ffb640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17600664a0 0x7f1760068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1771ffb640 1 -- 172.21.15.2:0/890004419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f1778083e30 con 0x7f177c0cd1d0 2023-11-04T01:48:23.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1780cc2640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17600664a0 0x7f1760068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:23.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.827+0000 7f1780cc2640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17600664a0 0x7f1760068960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f177c153350 tx=0x7f176c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:23.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:23.831+0000 7f1771ffb640 1 -- 172.21.15.2:0/890004419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1778050bf0 con 0x7f177c0cd1d0 2023-11-04T01:48:23.909 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:48:23.903+0000 7f9cec7e8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:48:23.909 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:48:23.903+0000 7f9cec7e8640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:48:24.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.019+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f177c04e4a0 con 0x7f177c0cd1d0 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1771ffb640 1 -- 172.21.15.2:0/890004419 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f1778054210 con 0x7f177c0cd1d0 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:22.665194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:24.026 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 94 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17600664a0 msgr2=0x7f1760068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17600664a0 0x7f1760068960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f177c153350 tx=0x7f176c009040 comp rx=0 tx=0).stop 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0cd1d0 msgr2=0x7f177c0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0cd1d0 0x7f177c0703c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f177800c500 tx=0x7f177800c9c0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 shutdown_connections 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f17600664a0 0x7f1760068960 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f177c15d840 0x7f177c151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f177c153ae0 0x7f177c148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 --2- 172.21.15.2:0/890004419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f177c0cd1d0 0x7f177c0703c0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 >> 172.21.15.2:0/890004419 conn(0x7f177c0b0890 msgr2=0x7f177c0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 shutdown_connections 2023-11-04T01:48:24.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.023+0000 7f1783727640 1 -- 172.21.15.2:0/890004419 wait complete. 2023-11-04T01:48:24.046 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:48:24.046 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.779541015625s 2023-11-04T01:48:24.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:24.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.163+0000 7fa111ef1640 1 Processor -- start 2023-11-04T01:48:24.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.163+0000 7fa111ef1640 1 -- start start 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa111ef1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa10c0cf930 0x7fa10c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa111ef1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 0x7fa10c0b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa111ef1640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c0ce6b0 con 0x7fa10c0c6270 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa111ef1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c0d0800 con 0x7fa10c0cf930 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa111ef1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0cea00 con 0x7fa10c0b5de0 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10affd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa10c0c6270 0x7fa10c0cfd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43834/0 (socket says 172.21.15.2:43834) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10affd640 1 -- 172.21.15.2:0/3818917371 learned_addr learned my addr 172.21.15.2:0/3818917371 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10bfff640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 0x7fa10c0b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10b7fe640 1 --2- 172.21.15.2:0/3818917371 >> v2:172.21.15.90:3300/0 conn(0x7fa10c0cf930 0x7fa10c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898865825 0 0) 0x7fa10c0ce6b0 con 0x7fa10c0c6270 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f8003530 con 0x7fa10c0c6270 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3505084413 0 0) 0x7fa0f8003530 con 0x7fa10c0c6270 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 msgr2=0x7fa10c0b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 0x7fa10c0b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 >> v2:172.21.15.90:3300/0 conn(0x7fa10c0cf930 msgr2=0x7fa10c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 --2- 172.21.15.2:0/3818917371 >> v2:172.21.15.90:3300/0 conn(0x7fa10c0cf930 0x7fa10c0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0b4360 con 0x7fa10c0c6270 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fa0f4001680 con 0x7fa10c0c6270 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 >> v1:172.21.15.2:6789/0 conn(0x7fa10c0c6270 legacy=0x7fa10c0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f8003980 0x7fa0f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 0x7fa0f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0f8004d10 0x7fa0f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0d0800 con 0x7fa0f8004d10 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0cea00 con 0x7fa0f8003980 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f800b990 con 0x7fa10c0b5de0 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10bfff640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0f8004d10 0x7fa0f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10b7fe640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f8003980 0x7fa0f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10affd640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 0x7fa0f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10bfff640 1 -- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 msgr2=0x7fa0f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10bfff640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa10c0b5de0 0x7fa0f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10bfff640 1 -- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f8003980 msgr2=0x7fa0f8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10bfff640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa0f8003980 0x7fa0f8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.167+0000 7fa10bfff640 1 -- 172.21.15.2:0/3818917371 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f8003530 con 0x7fa0f8004d10 2023-11-04T01:48:24.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0f8004d10 0x7fa0f8005190 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fa104009b10 tx=0x7fa10401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eba41d33188afff server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040a5640 con 0x7fa0f8004d10 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1040a57a0 con 0x7fa0f8004d10 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10a7fc640 1 -- 172.21.15.2:0/3818917371 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040a5b50 con 0x7fa0f8004d10 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- 172.21.15.2:0/3818917371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0f8004d10 msgr2=0x7fa0f8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 --2- 172.21.15.2:0/3818917371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa0f8004d10 0x7fa0f8005190 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fa104009b10 tx=0x7fa10401ca50 comp rx=0 tx=0).stop 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 -- 172.21.15.2:0/3818917371 reap_dead start 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- 172.21.15.2:0/3818917371 shutdown_connections 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- 172.21.15.2:0/3818917371 >> 172.21.15.2:0/3818917371 conn(0x7fa10c0d2f90 msgr2=0x7fa10c0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- 172.21.15.2:0/3818917371 shutdown_connections 2023-11-04T01:48:24.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- 172.21.15.2:0/3818917371 wait complete. 2023-11-04T01:48:24.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 Processor -- start 2023-11-04T01:48:24.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- start start 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0f8004d10 0x7fa10c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10c1e9640 0x7fa10c0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c0cb9c0 0x7fa10c0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0ca5a0 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c1e9ac0 con 0x7fa10c1e9640 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa111ef1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0cc8d0 con 0x7fa0f8004d10 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c0cb9c0 0x7fa10c0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c0cb9c0 0x7fa10c0cbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40546/0 (socket says 172.21.15.2:40546) 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 -- 172.21.15.2:0/2612595130 learned_addr learned my addr 172.21.15.2:0/2612595130 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10affd640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10c1e9640 0x7fa10c0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10b7fe640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0f8004d10 0x7fa10c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 -- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0f8004d10 msgr2=0x7fa10c0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0f8004d10 0x7fa10c0b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 -- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10c1e9640 msgr2=0x7fa10c0ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10c1e9640 0x7fa10c0ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.171+0000 7fa10bfff640 1 -- 172.21.15.2:0/2612595130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0ccbb0 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa10bfff640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c0cb9c0 0x7fa10c0cbe40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa1040b0040 tx=0x7fa0f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa103fff640 1 -- 172.21.15.2:0/2612595130 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040a5640 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa103fff640 1 -- 172.21.15.2:0/2612595130 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104004220 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c0cce90 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa103fff640 1 -- 172.21.15.2:0/2612595130 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104003620 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c0cc380 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c0cd340 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa103fff640 1 -- 172.21.15.2:0/2612595130 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa1040b4070 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa103fff640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ec0664a0 0x7fa0ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa103fff640 1 -- 172.21.15.2:0/2612595130 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7fa10411e4a0 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa10b7fe640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ec0664a0 0x7fa0ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.175+0000 7fa10b7fe640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ec0664a0 0x7fa0ec068960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009fd0 tx=0x7fa0fc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.179+0000 7fa103fff640 1 -- 172.21.15.2:0/2612595130 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa10c0cd340 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.367+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa10c0cd340 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.367+0000 7fa103fff640 1 -- 172.21.15.2:0/2612595130 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fa10c0cd340 con 0x7fa10c0cb9c0 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:24.372 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:22.665194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:24.373 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 94 2023-11-04T01:48:24.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ec0664a0 msgr2=0x7fa0ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ec0664a0 0x7fa0ec068960 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009fd0 tx=0x7fa0fc00b040 comp rx=0 tx=0).stop 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c0cb9c0 msgr2=0x7fa10c0cbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c0cb9c0 0x7fa10c0cbe40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa1040b0040 tx=0x7fa0f8005800 comp rx=0 tx=0).stop 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 shutdown_connections 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fa0ec0664a0 0x7fa0ec068960 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa10c0cb9c0 0x7fa10c0cbe40 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa10c1e9640 0x7fa10c0ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 --2- 172.21.15.2:0/2612595130 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fa0f8004d10 0x7fa10c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 >> 172.21.15.2:0/2612595130 conn(0x7fa10c0d2f90 msgr2=0x7fa10c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 shutdown_connections 2023-11-04T01:48:24.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.371+0000 7fa111ef1640 1 -- 172.21.15.2:0/2612595130 wait complete. 2023-11-04T01:48:24.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:48:24.521 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:48:24.522 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:48:24.522 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:48:24.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:24.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faece28a640 1 Processor -- start 2023-11-04T01:48:24.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faece28a640 1 -- start start 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faece28a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faec80cc830 0x7faec813e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faece28a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec80ccc10 0x7faec8070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faece28a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec813edf0 con 0x7faec806a130 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faece28a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec815c870 con 0x7faec80cc830 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faece28a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec8071480 con 0x7faec80ccc10 2023-11-04T01:48:24.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faec80cc830 0x7faec813e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faec80cc830 0x7faec813e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40562/0 (socket says 172.21.15.2:40562) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 -- 172.21.15.2:0/2778141594 learned_addr learned my addr 172.21.15.2:0/2778141594 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faebf7fe640 1 --2- 172.21.15.2:0/2778141594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec80ccc10 0x7faec8070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 -- 172.21.15.2:0/2778141594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec80ccc10 msgr2=0x7faec8070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 --2- 172.21.15.2:0/2778141594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec80ccc10 0x7faec8070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 -- 172.21.15.2:0/2778141594 >> v1:172.21.15.90:6789/0 conn(0x7faec806a130 legacy=0x7faec80cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:24.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 -- 172.21.15.2:0/2778141594 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8071760 con 0x7faec80cc830 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec7fff640 1 --2- 172.21.15.2:0/2778141594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813e8b0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7faec806b100 tx=0x7faeb801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a7bf74e176e4d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec77fe640 1 -- 172.21.15.2:0/2778141594 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb80ab650 con 0x7faec80cc830 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec77fe640 1 -- 172.21.15.2:0/2778141594 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb80ab7b0 con 0x7faec80cc830 2023-11-04T01:48:24.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.631+0000 7faec77fe640 1 -- 172.21.15.2:0/2778141594 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb80abb40 con 0x7faec80cc830 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- 172.21.15.2:0/2778141594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 msgr2=0x7faec813e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 --2- 172.21.15.2:0/2778141594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813e8b0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7faec806b100 tx=0x7faeb801c490 comp rx=0 tx=0).stop 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- 172.21.15.2:0/2778141594 shutdown_connections 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 --2- 172.21.15.2:0/2778141594 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec80ccc10 0x7faec8070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 --2- 172.21.15.2:0/2778141594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813e8b0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- 172.21.15.2:0/2778141594 >> 172.21.15.2:0/2778141594 conn(0x7faec80b18a0 msgr2=0x7faec80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- 172.21.15.2:0/2778141594 shutdown_connections 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- 172.21.15.2:0/2778141594 wait complete. 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 Processor -- start 2023-11-04T01:48:24.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- start start 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec806a130 0x7faec8154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec80ccc10 0x7faec8140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80b3f50 con 0x7faec80cc830 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80b4230 con 0x7faec80ccc10 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faece28a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec813ff80 con 0x7faec806a130 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40570/0 (socket says 172.21.15.2:40570) 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 -- 172.21.15.2:0/4088193303 learned_addr learned my addr 172.21.15.2:0/4088193303 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faec7fff640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec806a130 0x7faec8154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faecc827640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec80ccc10 0x7faec8140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 -- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec806a130 msgr2=0x7faec8154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec806a130 0x7faec8154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 -- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec80ccc10 msgr2=0x7faec8140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec80ccc10 0x7faec8140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.635+0000 7faebf7fe640 1 -- 172.21.15.2:0/4088193303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80094d0 con 0x7faec80cc830 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faebf7fe640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813c6b0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c7f0 tx=0x7faeb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec57fa640 1 -- 172.21.15.2:0/4088193303 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0004220 con 0x7faec80cc830 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec57fa640 1 -- 172.21.15.2:0/4088193303 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb00043a0 con 0x7faec80cc830 2023-11-04T01:48:24.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec57fa640 1 -- 172.21.15.2:0/4088193303 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0004510 con 0x7faec80cc830 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec8140260 con 0x7faec80cc830 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec813cbf0 con 0x7faec80cc830 2023-11-04T01:48:24.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec813f4e0 con 0x7faec80cc830 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec57fa640 1 -- 172.21.15.2:0/4088193303 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faeb0003a70 con 0x7faec80cc830 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec57fa640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faea80664a0 0x7faea8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec57fa640 1 -- 172.21.15.2:0/4088193303 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7faeb0084560 con 0x7faec80cc830 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec7fff640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faea80664a0 0x7faea8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:24.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.639+0000 7faec7fff640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faea80664a0 0x7faea8068960 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7faeb80af000 tx=0x7faeb80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:24.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.643+0000 7faec57fa640 1 -- 172.21.15.2:0/4088193303 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faeb0051310 con 0x7faec80cc830 2023-11-04T01:48:24.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faec813f200 con 0x7faec80cc830 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faec57fa640 1 -- 172.21.15.2:0/4088193303 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4923 (secure 0 0 0) 0x7faeb0059e60 con 0x7faec80cc830 2023-11-04T01:48:24.835 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:24.836 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:22.665194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:24.836 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 94 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faea80664a0 msgr2=0x7faea8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faea80664a0 0x7faea8068960 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7faeb80af000 tx=0x7faeb80a7000 comp rx=0 tx=0).stop 2023-11-04T01:48:24.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 msgr2=0x7faec813c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813c6b0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c7f0 tx=0x7faeb000ccb0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 shutdown_connections 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faea80664a0 0x7faea8068960 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faec80ccc10 0x7faec8140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faec80cc830 0x7faec813c6b0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 --2- 172.21.15.2:0/4088193303 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faec806a130 0x7faec8154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 >> 172.21.15.2:0/4088193303 conn(0x7faec80b18a0 msgr2=0x7faec80b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.831+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 shutdown_connections 2023-11-04T01:48:24.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:24.835+0000 7faece28a640 1 -- 172.21.15.2:0/4088193303 wait complete. 2023-11-04T01:48:24.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:48:24.978 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:48:24.978 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:48:24.978 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:24.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:24.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:48:24.990 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:48:24.990 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:25.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:48:25.150 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:25.152 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:25.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6cea2640 1 Processor -- start 2023-11-04T01:48:25.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6cea2640 1 -- start start 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6cea2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 0x7efd680ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6cea2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efd68159580 0x7efd680cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6cea2640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6806a5e0 con 0x7efd68070450 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6cea2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680726a0 con 0x7efd68159580 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6cea2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680cf2b0 con 0x7efd6806a130 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efd68070450 0x7efd68073170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43838/0 (socket says 172.21.15.2:43838) 2023-11-04T01:48:25.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd6659c640 1 -- 172.21.15.2:0/544142011 learned_addr learned my addr 172.21.15.2:0/544142011 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd5ffff640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 0x7efd680ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd66d9d640 1 --2- 172.21.15.2:0/544142011 >> v2:172.21.15.90:3300/0 conn(0x7efd68159580 0x7efd680cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653268272 0 0) 0x7efd6806a5e0 con 0x7efd68070450 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.199+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd54003530 con 0x7efd68070450 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 31652225 0 0) 0x7efd54003530 con 0x7efd68070450 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 msgr2=0x7efd680ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 0x7efd680ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 >> v2:172.21.15.90:3300/0 conn(0x7efd68159580 msgr2=0x7efd680cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 --2- 172.21.15.2:0/544142011 >> v2:172.21.15.90:3300/0 conn(0x7efd68159580 0x7efd680cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6806b0b0 con 0x7efd68070450 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7efd58001680 con 0x7efd68070450 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 >> v1:172.21.15.2:6789/0 conn(0x7efd68070450 legacy=0x7efd68073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 0x7efd54003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd54004d10 0x7efd54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680cf2b0 con 0x7efd54003f00 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5400b990 con 0x7efd54004d10 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5400bb20 con 0x7efd6806a130 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd5ffff640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd6659c640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 0x7efd54003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd66d9d640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd54004d10 0x7efd54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd5ffff640 1 -- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 msgr2=0x7efd54003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd5ffff640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd6806a130 0x7efd54003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd5ffff640 1 -- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd54004d10 msgr2=0x7efd54005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd5ffff640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd54004d10 0x7efd54005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd5ffff640 1 -- 172.21.15.2:0/544142011 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54003530 con 0x7efd54003f00 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd5ffff640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd540047d0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7efd50009b10 tx=0x7efd5001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48381e0b97d1884 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a6430 con 0x7efd54003f00 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500a6590 con 0x7efd54003f00 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd65d9b640 1 -- 172.21.15.2:0/544142011 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a6940 con 0x7efd54003f00 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd6cea2640 1 -- 172.21.15.2:0/544142011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 msgr2=0x7efd540047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.212 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd6cea2640 1 --2- 172.21.15.2:0/544142011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd540047d0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7efd50009b10 tx=0x7efd5001ca50 comp rx=0 tx=0).stop 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd66d9d640 1 -- 172.21.15.2:0/544142011 reap_dead start 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd6cea2640 1 -- 172.21.15.2:0/544142011 shutdown_connections 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd6cea2640 1 -- 172.21.15.2:0/544142011 >> 172.21.15.2:0/544142011 conn(0x7efd680b1050 msgr2=0x7efd680b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd6cea2640 1 -- 172.21.15.2:0/544142011 shutdown_connections 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.203+0000 7efd6cea2640 1 -- 172.21.15.2:0/544142011 wait complete. 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 Processor -- start 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 -- start start 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd6814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd680710d0 0x7efd68071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd68159990 0x7efd68159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6815b1f0 con 0x7efd54003f00 2023-11-04T01:48:25.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68071a90 con 0x7efd680710d0 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6815a350 con 0x7efd68159990 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd6814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd6814b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40574/0 (socket says 172.21.15.2:40574) 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 -- 172.21.15.2:0/4263732351 learned_addr learned my addr 172.21.15.2:0/4263732351 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd66d9d640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd68159990 0x7efd68159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd5ffff640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd680710d0 0x7efd68071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 -- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd68159990 msgr2=0x7efd68159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd68159990 0x7efd68159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 -- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd680710d0 msgr2=0x7efd68071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd680710d0 0x7efd68071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 -- 172.21.15.2:0/4263732351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680c4a60 con 0x7efd54003f00 2023-11-04T01:48:25.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd66d9d640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd68159990 0x7efd68159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6659c640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd6814b9f0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7efd58001ab0 tx=0x7efd580077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd5effd640 1 -- 172.21.15.2:0/4263732351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800f990 con 0x7efd54003f00 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd5effd640 1 -- 172.21.15.2:0/4263732351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800fb10 con 0x7efd54003f00 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6815b610 con 0x7efd54003f00 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd5effd640 1 -- 172.21.15.2:0/4263732351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800fec0 con 0x7efd54003f00 2023-11-04T01:48:25.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6815a850 con 0x7efd54003f00 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6815b460 con 0x7efd54003f00 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.207+0000 7efd5effd640 1 -- 172.21.15.2:0/4263732351 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd5801d460 con 0x7efd54003f00 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.211+0000 7efd5effd640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd480664a0 0x7efd48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.211+0000 7efd5effd640 1 -- 172.21.15.2:0/4263732351 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7efd58084760 con 0x7efd54003f00 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.211+0000 7efd5ffff640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd480664a0 0x7efd48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.211+0000 7efd5ffff640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd480664a0 0x7efd48068960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efd500ad000 tx=0x7efd500b2040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.215+0000 7efd5effd640 1 -- 172.21.15.2:0/4263732351 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efd58051510 con 0x7efd54003f00 2023-11-04T01:48:25.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.375+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd680d02a0 con 0x7efd54003f00 2023-11-04T01:48:25.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.379+0000 7efd5effd640 1 -- 172.21.15.2:0/4263732351 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+22764 (secure 0 0 0) 0x7efd58054b30 con 0x7efd54003f00 2023-11-04T01:48:25.384 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:25.384 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":104,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:48:21.630477+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":100,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.f","mappings":[{"from":2,"to":3}]},{"pgid":"16.12","mappings":[{"from":4,"to":3}]},{"pgid":"16.39","mappings":[{"from":4,"to":6}]},{"pgid":"16.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2023608941":"2023-11-04T02:48:20.721790+0000","172.21.15.2:6835/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.90:6837/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6833/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.2:6832/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.90:6837/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6834/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.90:6834/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.90:6834/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6833/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.2:6832/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.90:6837/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.90:6834/1345296201":"2023-11-05T01:46:20.984713+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd480664a0 msgr2=0x7efd48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd480664a0 0x7efd48068960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efd500ad000 tx=0x7efd500b2040 comp rx=0 tx=0).stop 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 msgr2=0x7efd6814b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd6814b9f0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7efd58001ab0 tx=0x7efd580077a0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 shutdown_connections 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efd480664a0 0x7efd48068960 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efd68159990 0x7efd68159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd680710d0 0x7efd68071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 --2- 172.21.15.2:0/4263732351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd54003f00 0x7efd6814b9f0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 >> 172.21.15.2:0/4263732351 conn(0x7efd680b1050 msgr2=0x7efd68163960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 shutdown_connections 2023-11-04T01:48:25.387 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.383+0000 7efd6cea2640 1 -- 172.21.15.2:0/4263732351 wait complete. 2023-11-04T01:48:25.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:45:33.227500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:45:34.004628+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 100, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:48:25.403 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.567+0000 7f326a467640 1 Processor -- start 2023-11-04T01:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.567+0000 7f326a467640 1 -- start start 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f326a467640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f32640cabd0 0x7f32640cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f326a467640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f32640af2d0 0x7f32640af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f326a467640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326406fe50 con 0x7f32641556c0 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f326a467640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640cb5c0 con 0x7f32640af2d0 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f326a467640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640ae7f0 con 0x7f32640cabd0 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f32640af2d0 0x7f32640af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f32640af2d0 0x7f32640af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40578/0 (socket says 172.21.15.2:40578) 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 -- 172.21.15.2:0/1593686000 learned_addr learned my addr 172.21.15.2:0/1593686000 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f32637fe640 1 --2- 172.21.15.2:0/1593686000 >> v2:172.21.15.90:3300/0 conn(0x7f32640cabd0 0x7f32640cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 -- 172.21.15.2:0/1593686000 >> v2:172.21.15.90:3300/0 conn(0x7f32640cabd0 msgr2=0x7f32640cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 --2- 172.21.15.2:0/1593686000 >> v2:172.21.15.90:3300/0 conn(0x7f32640cabd0 0x7f32640cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 -- 172.21.15.2:0/1593686000 >> v1:172.21.15.90:6789/0 conn(0x7f32641556c0 legacy=0x7f326415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 -- 172.21.15.2:0/1593686000 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640aead0 con 0x7f32640af2d0 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3268a04640 1 --2- 172.21.15.2:0/1593686000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32640af2d0 0x7f32640af740 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f325c009870 tx=0x7f325c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf4e20c587920dd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3262ffd640 1 -- 172.21.15.2:0/1593686000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0a7070 con 0x7f32640af2d0 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3262ffd640 1 -- 172.21.15.2:0/1593686000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c0ab430 con 0x7f32640af2d0 2023-11-04T01:48:25.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.571+0000 7f3262ffd640 1 -- 172.21.15.2:0/1593686000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0ab7c0 con 0x7f32640af2d0 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- 172.21.15.2:0/1593686000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32640af2d0 msgr2=0x7f32640af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 --2- 172.21.15.2:0/1593686000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32640af2d0 0x7f32640af740 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f325c009870 tx=0x7f325c01c490 comp rx=0 tx=0).stop 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- 172.21.15.2:0/1593686000 shutdown_connections 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 --2- 172.21.15.2:0/1593686000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32640af2d0 0x7f32640af740 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 --2- 172.21.15.2:0/1593686000 >> v2:172.21.15.90:3300/0 conn(0x7f32640cabd0 0x7f32640cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- 172.21.15.2:0/1593686000 >> 172.21.15.2:0/1593686000 conn(0x7f32640ced10 msgr2=0x7f32640cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- 172.21.15.2:0/1593686000 shutdown_connections 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- 172.21.15.2:0/1593686000 wait complete. 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 Processor -- start 2023-11-04T01:48:25.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- start start 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640af2d0 0x7f32640c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32640cabd0 0x7f32640adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32641556c0 0x7f326406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264151260 con 0x7f32641556c0 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640ae490 con 0x7f32640af2d0 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32640c9e00 con 0x7f32640cabd0 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32641556c0 0x7f326406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32641556c0 0x7f326406d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40580/0 (socket says 172.21.15.2:40580) 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 -- 172.21.15.2:0/2139974078 learned_addr learned my addr 172.21.15.2:0/2139974078 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3263fff640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640af2d0 0x7f32640c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 -- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32640cabd0 msgr2=0x7f32640adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f32637fe640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32640cabd0 0x7f32640adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32640cabd0 0x7f32640adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 -- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640af2d0 msgr2=0x7f32640c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640af2d0 0x7f32640c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 -- 172.21.15.2:0/2139974078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c0094d0 con 0x7f32641556c0 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f32637fe640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32640cabd0 0x7f32640adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3268a04640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32641556c0 0x7f326406d2a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f325c0ad040 tx=0x7f325c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3260ff9640 1 -- 172.21.15.2:0/2139974078 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0bc070 con 0x7f32641556c0 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3260ff9640 1 -- 172.21.15.2:0/2139974078 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c0abe30 con 0x7f32641556c0 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32640c8130 con 0x7f32641556c0 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f3260ff9640 1 -- 172.21.15.2:0/2139974078 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0b4830 con 0x7f32641556c0 2023-11-04T01:48:25.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.575+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32640c86f0 con 0x7f32641556c0 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.579+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326404e4a0 con 0x7f32641556c0 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.579+0000 7f3260ff9640 1 -- 172.21.15.2:0/2139974078 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f325c0b4990 con 0x7f32641556c0 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.579+0000 7f3260ff9640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32440664d0 0x7f3244068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.579+0000 7f3260ff9640 1 -- 172.21.15.2:0/2139974078 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f325c11e080 con 0x7f32641556c0 2023-11-04T01:48:25.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.579+0000 7f3263fff640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32440664d0 0x7f3244068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.579+0000 7f3263fff640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32440664d0 0x7f3244068990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f325400b810 tx=0x7f3254008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.583+0000 7f3260ff9640 1 -- 172.21.15.2:0/2139974078 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f325c0eaec0 con 0x7f32641556c0 2023-11-04T01:48:25.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.739+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32640c88e0 con 0x7f32641556c0 2023-11-04T01:48:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f3260ff9640 1 -- 172.21.15.2:0/2139974078 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7f325c0ee4e0 con 0x7f32641556c0 2023-11-04T01:48:25.746 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:48:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32440664d0 msgr2=0x7f3244068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32440664d0 0x7f3244068990 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f325400b810 tx=0x7f3254008040 comp rx=0 tx=0).stop 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32641556c0 msgr2=0x7f326406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32641556c0 0x7f326406d2a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f325c0ad040 tx=0x7f325c019230 comp rx=0 tx=0).stop 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 shutdown_connections 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f32440664d0 0x7f3244068990 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32641556c0 0x7f326406d2a0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f32640cabd0 0x7f32640adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 --2- 172.21.15.2:0/2139974078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32640af2d0 0x7f32640c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 >> 172.21.15.2:0/2139974078 conn(0x7f32640ced10 msgr2=0x7f326406c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 shutdown_connections 2023-11-04T01:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.743+0000 7f326a467640 1 -- 172.21.15.2:0/2139974078 wait complete. 2023-11-04T01:48:25.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:48:25.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee7b3a640 1 Processor -- start 2023-11-04T01:48:25.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee7b3a640 1 -- start start 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee7b3a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faee015d1c0 0x7faee00d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee7b3a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faee015d5a0 0x7faee00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee7b3a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00d09b0 con 0x7faee00b1ec0 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee7b3a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00d0110 con 0x7faee015d1c0 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee7b3a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00d03f0 con 0x7faee015d5a0 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee58d6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faee015d1c0 0x7faee00d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee58d6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faee015d1c0 0x7faee00d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40586/0 (socket says 172.21.15.2:40586) 2023-11-04T01:48:25.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee58d6640 1 -- 172.21.15.2:0/2499658275 learned_addr learned my addr 172.21.15.2:0/2499658275 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee50d5640 1 --2- 172.21.15.2:0/2499658275 >> v2:172.21.15.90:3300/0 conn(0x7faee015d5a0 0x7faee00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee58d6640 1 -- 172.21.15.2:0/2499658275 >> v2:172.21.15.90:3300/0 conn(0x7faee015d5a0 msgr2=0x7faee00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee58d6640 1 --2- 172.21.15.2:0/2499658275 >> v2:172.21.15.90:3300/0 conn(0x7faee015d5a0 0x7faee00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee58d6640 1 -- 172.21.15.2:0/2499658275 >> v1:172.21.15.90:6789/0 conn(0x7faee00b1ec0 legacy=0x7faee00cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.895+0000 7faee58d6640 1 -- 172.21.15.2:0/2499658275 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00d06d0 con 0x7faee015d1c0 2023-11-04T01:48:25.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee58d6640 1 --2- 172.21.15.2:0/2499658275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d1c0 0x7faee00d3ae0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7faee0073c30 tx=0x7faedc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e02fdf194d466c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee48d4640 1 -- 172.21.15.2:0/2499658275 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0a5800 con 0x7faee015d1c0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee48d4640 1 -- 172.21.15.2:0/2499658275 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc0a5960 con 0x7faee015d1c0 2023-11-04T01:48:25.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee48d4640 1 -- 172.21.15.2:0/2499658275 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0a5cf0 con 0x7faee015d1c0 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 -- 172.21.15.2:0/2499658275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d1c0 msgr2=0x7faee00d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 --2- 172.21.15.2:0/2499658275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d1c0 0x7faee00d3ae0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7faee0073c30 tx=0x7faedc01c960 comp rx=0 tx=0).stop 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 -- 172.21.15.2:0/2499658275 shutdown_connections 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 --2- 172.21.15.2:0/2499658275 >> v2:172.21.15.90:3300/0 conn(0x7faee015d5a0 0x7faee00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 --2- 172.21.15.2:0/2499658275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d1c0 0x7faee00d3ae0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 -- 172.21.15.2:0/2499658275 >> 172.21.15.2:0/2499658275 conn(0x7faee00d2fc0 msgr2=0x7faee00d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 -- 172.21.15.2:0/2499658275 shutdown_connections 2023-11-04T01:48:25.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 -- 172.21.15.2:0/2499658275 wait complete. 2023-11-04T01:48:25.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 Processor -- start 2023-11-04T01:48:25.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.899+0000 7faee7b3a640 1 -- start start 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faee00b1ec0 0x7faee00c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faee015d1c0 0x7faee00cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d5a0 0x7faee00b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00b23a0 con 0x7faee015d5a0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee00ca500 con 0x7faee015d1c0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00ca7e0 con 0x7faee00b1ec0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d5a0 0x7faee00b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d5a0 0x7faee00b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40590/0 (socket says 172.21.15.2:40590) 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 -- 172.21.15.2:0/1557406771 learned_addr learned my addr 172.21.15.2:0/1557406771 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee50d5640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faee015d1c0 0x7faee00cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee58d6640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faee00b1ec0 0x7faee00c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 -- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faee00b1ec0 msgr2=0x7faee00c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faee00b1ec0 0x7faee00c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 -- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faee015d1c0 msgr2=0x7faee00cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faee015d1c0 0x7faee00cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 -- 172.21.15.2:0/1557406771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc009b30 con 0x7faee015d5a0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee58d6640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faee00b1ec0 0x7faee00c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee60d7640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d5a0 0x7faee00b6ca0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7faed800b490 tx=0x7faed800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faed67fc640 1 -- 172.21.15.2:0/1557406771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8011830 con 0x7faee015d5a0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faed67fc640 1 -- 172.21.15.2:0/1557406771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed8011990 con 0x7faee015d5a0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faed67fc640 1 -- 172.21.15.2:0/1557406771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8011d80 con 0x7faee015d5a0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee00caac0 con 0x7faee015d5a0 2023-11-04T01:48:25.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee00cb080 con 0x7faee015d5a0 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee004e4a0 con 0x7faee015d5a0 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faed67fc640 1 -- 172.21.15.2:0/1557406771 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faed801a400 con 0x7faee015d5a0 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faed67fc640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faec40664a0 0x7faec4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faed67fc640 1 -- 172.21.15.2:0/1557406771 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7faed80841c0 con 0x7faee015d5a0 2023-11-04T01:48:25.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.903+0000 7faee58d6640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faec40664a0 0x7faec4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:25.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.907+0000 7faee58d6640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faec40664a0 0x7faec4068960 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faedc0ae000 tx=0x7faedc0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:25.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:25.907+0000 7faed67fc640 1 -- 172.21.15.2:0/1557406771 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faed8051000 con 0x7faee015d5a0 2023-11-04T01:48:25.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:48:25.911+0000 7fe3be7fc640 -1 client.7296 mds.1 rejected us (blocklisted (blacklisted)) 2023-11-04T01:48:25.914 INFO:teuthology.orchestra.run.smithi002.stderr:mkdir: cannot create directory 'd1/dir/.snap/s22': Operation not permitted 2023-11-04T01:48:26.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7faee00d2430 con 0x7faee015d5a0 2023-11-04T01:48:26.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faed67fc640 1 -- 172.21.15.2:0/1557406771 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v104) v1 ==== 103+0+11 (secure 0 0 0) 0x7faed8054620 con 0x7faee015d5a0 2023-11-04T01:48:26.071 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faec40664a0 msgr2=0x7faec4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faec40664a0 0x7faec4068960 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faedc0ae000 tx=0x7faedc0a7070 comp rx=0 tx=0).stop 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d5a0 msgr2=0x7faee00b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d5a0 0x7faee00b6ca0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7faed800b490 tx=0x7faed800b950 comp rx=0 tx=0).stop 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 shutdown_connections 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faec40664a0 0x7faec4068960 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faee015d5a0 0x7faee00b6ca0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faee015d1c0 0x7faee00cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 --2- 172.21.15.2:0/1557406771 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faee00b1ec0 0x7faee00c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 >> 172.21.15.2:0/1557406771 conn(0x7faee00d2fc0 msgr2=0x7faee00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 shutdown_connections 2023-11-04T01:48:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.067+0000 7faee7b3a640 1 -- 172.21.15.2:0/1557406771 wait complete. 2023-11-04T01:48:26.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:48:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.211+0000 7f7bfa329640 1 Processor -- start 2023-11-04T01:48:26.217 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.211+0000 7f7bfa329640 1 -- start start 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bfa329640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7bf415d1c0 0x7f7bf40d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bfa329640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bf415d5a0 0x7f7bf40d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bfa329640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40d09b0 con 0x7f7bf40b1ec0 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bfa329640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40d0110 con 0x7f7bf415d5a0 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bfa329640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40d03f0 con 0x7f7bf415d1c0 2023-11-04T01:48:26.218 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bf415d5a0 0x7f7bf40d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bf415d5a0 0x7f7bf40d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40602/0 (socket says 172.21.15.2:40602) 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 -- 172.21.15.2:0/3579093582 learned_addr learned my addr 172.21.15.2:0/3579093582 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf3fff640 1 --2- 172.21.15.2:0/3579093582 >> v2:172.21.15.90:3300/0 conn(0x7f7bf415d1c0 0x7f7bf40d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 -- 172.21.15.2:0/3579093582 >> v2:172.21.15.90:3300/0 conn(0x7f7bf415d1c0 msgr2=0x7f7bf40d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 --2- 172.21.15.2:0/3579093582 >> v2:172.21.15.90:3300/0 conn(0x7f7bf415d1c0 0x7f7bf40d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 -- 172.21.15.2:0/3579093582 >> v1:172.21.15.90:6789/0 conn(0x7f7bf40b1ec0 legacy=0x7f7bf40cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 -- 172.21.15.2:0/3579093582 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40d06d0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf37fe640 1 --2- 172.21.15.2:0/3579093582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf40d15a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40b5bb0 tx=0x7f7be801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94626e23c2d2a628 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf2ffd640 1 -- 172.21.15.2:0/3579093582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80ab670 con 0x7f7bf415d5a0 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf2ffd640 1 -- 172.21.15.2:0/3579093582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be80ab7d0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.215+0000 7f7bf2ffd640 1 -- 172.21.15.2:0/3579093582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80abb60 con 0x7f7bf415d5a0 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- 172.21.15.2:0/3579093582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 msgr2=0x7f7bf40d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 --2- 172.21.15.2:0/3579093582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf40d15a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40b5bb0 tx=0x7f7be801c490 comp rx=0 tx=0).stop 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- 172.21.15.2:0/3579093582 shutdown_connections 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 --2- 172.21.15.2:0/3579093582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf40d15a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 --2- 172.21.15.2:0/3579093582 >> v2:172.21.15.90:3300/0 conn(0x7f7bf415d1c0 0x7f7bf40d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- 172.21.15.2:0/3579093582 >> 172.21.15.2:0/3579093582 conn(0x7f7bf40d2fc0 msgr2=0x7f7bf40d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- 172.21.15.2:0/3579093582 shutdown_connections 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- 172.21.15.2:0/3579093582 wait complete. 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 Processor -- start 2023-11-04T01:48:26.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- start start 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b1ec0 0x7f7bf40b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf415d1c0 0x7f7bf409cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf4148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40c9840 con 0x7f7bf415d5a0 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40b6550 con 0x7f7bf40b1ec0 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf409d1b0 con 0x7f7bf415d1c0 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf4148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf4148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40606/0 (socket says 172.21.15.2:40606) 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 -- 172.21.15.2:0/2369963863 learned_addr learned my addr 172.21.15.2:0/2369963863 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:26.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf3fff640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b1ec0 0x7f7bf40b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf37fe640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf415d1c0 0x7f7bf409cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 -- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf415d1c0 msgr2=0x7f7bf409cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf415d1c0 0x7f7bf409cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 -- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b1ec0 msgr2=0x7f7bf40b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b1ec0 0x7f7bf40b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 -- 172.21.15.2:0/2369963863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80094d0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf88c6640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf4148120 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c780 tx=0x7f7bec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf0ff9640 1 -- 172.21.15.2:0/2369963863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00a9f0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf0ff9640 1 -- 172.21.15.2:0/2369963863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00ce90 con 0x7f7bf415d5a0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf40b5770 con 0x7f7bf415d5a0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bf0ff9640 1 -- 172.21.15.2:0/2369963863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00add0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.219+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf40b6ac0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.223+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404e4a0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.223+0000 7f7bf0ff9640 1 -- 172.21.15.2:0/2369963863 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7bec012420 con 0x7f7bf415d5a0 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.223+0000 7f7bf0ff9640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7be00664a0 0x7f7be0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.223+0000 7f7bf0ff9640 1 -- 172.21.15.2:0/2369963863 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f7bec0847e0 con 0x7f7bf415d5a0 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.223+0000 7f7bf3fff640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7be00664a0 0x7f7be0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.223+0000 7f7bf3fff640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7be00664a0 0x7f7be0068960 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7be400b9d0 tx=0x7f7be4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.227+0000 7f7bf0ff9640 1 -- 172.21.15.2:0/2369963863 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7bec051470 con 0x7f7bf415d5a0 2023-11-04T01:48:26.388 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.383+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f7bf40d2430 con 0x7f7bf415d5a0 2023-11-04T01:48:26.389 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.383+0000 7f7bf0ff9640 1 -- 172.21.15.2:0/2369963863 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v104) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7bec054a90 con 0x7f7bf415d5a0 2023-11-04T01:48:26.389 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:48:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7be00664a0 msgr2=0x7f7be0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7be00664a0 0x7f7be0068960 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7be400b9d0 tx=0x7f7be4008040 comp rx=0 tx=0).stop 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 msgr2=0x7f7bf4148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf4148120 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00c780 tx=0x7f7bec00cc40 comp rx=0 tx=0).stop 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 shutdown_connections 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7be00664a0 0x7f7be0068960 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bf415d5a0 0x7f7bf4148120 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bf415d1c0 0x7f7bf409cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 --2- 172.21.15.2:0/2369963863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bf40b1ec0 0x7f7bf40b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 >> 172.21.15.2:0/2369963863 conn(0x7f7bf40d2fc0 msgr2=0x7f7bf415fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 shutdown_connections 2023-11-04T01:48:26.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.387+0000 7f7bfa329640 1 -- 172.21.15.2:0/2369963863 wait complete. 2023-11-04T01:48:26.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:48:26.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 Processor -- start 2023-11-04T01:48:26.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 -- start start 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7bd81556c0 0x7f7bd815c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bd80cabd0 0x7f7bd80cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd80c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd80cb5c0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd815c600 con 0x7f7bd81556c0 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bdccd0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd806fe50 con 0x7f7bd80c9360 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bd80cabd0 0x7f7bd80cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7bd80cabd0 0x7f7bd80cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40610/0 (socket says 172.21.15.2:40610) 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2414433836 learned_addr learned my addr 172.21.15.2:0/2414433836 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd6d9d640 1 --2- 172.21.15.2:0/2414433836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd80c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd659c640 1 --2- 172.21.15.2:0/2414433836 >> v2:172.21.15.90:3300/0 conn(0x7f7bd81556c0 0x7f7bd815c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2414433836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 msgr2=0x7f7bd80c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 --2- 172.21.15.2:0/2414433836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd80c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2414433836 >> v2:172.21.15.90:3300/0 conn(0x7f7bd81556c0 msgr2=0x7f7bd815c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 --2- 172.21.15.2:0/2414433836 >> v2:172.21.15.90:3300/0 conn(0x7f7bd81556c0 0x7f7bd815c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2414433836 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd80ae7f0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.527+0000 7f7bd659c640 1 --2- 172.21.15.2:0/2414433836 >> v2:172.21.15.90:3300/0 conn(0x7f7bd81556c0 0x7f7bd815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bd5d9b640 1 --2- 172.21.15.2:0/2414433836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd80cb080 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009870 tx=0x7f7bc001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb60566656153df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bd559a640 1 -- 172.21.15.2:0/2414433836 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc00aa5f0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bd559a640 1 -- 172.21.15.2:0/2414433836 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc00aa750 con 0x7f7bd80cabd0 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bd559a640 1 -- 172.21.15.2:0/2414433836 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc00aaae0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2414433836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 msgr2=0x7f7bd80cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2414433836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd80cb080 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009870 tx=0x7f7bc001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2414433836 shutdown_connections 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2414433836 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd80c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2414433836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd80cb080 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2414433836 >> v2:172.21.15.90:3300/0 conn(0x7f7bd81556c0 0x7f7bd815c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2414433836 >> 172.21.15.2:0/2414433836 conn(0x7f7bd80ced10 msgr2=0x7f7bd80cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2414433836 shutdown_connections 2023-11-04T01:48:26.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.531+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2414433836 wait complete. 2023-11-04T01:48:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 Processor -- start 2023-11-04T01:48:26.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 -- start start 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd81579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd81556c0 0x7f7bd8158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd81592a0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd81580a0 con 0x7f7bd81556c0 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd815a600 con 0x7f7bd80c9360 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd81579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd81579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40624/0 (socket says 172.21.15.2:40624) 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2224230596 learned_addr learned my addr 172.21.15.2:0/2224230596 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd659c640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd6d9d640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd81556c0 0x7f7bd8158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 msgr2=0x7f7bd815aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd815aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd81556c0 msgr2=0x7f7bd8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd81556c0 0x7f7bd8158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 -- 172.21.15.2:0/2224230596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00094d0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd6d9d640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd81556c0 0x7f7bd8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bd5d9b640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd81579a0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00ac040 tx=0x7f7bc001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bceffd640 1 -- 172.21.15.2:0/2224230596 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc00bd5f0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bceffd640 1 -- 172.21.15.2:0/2224230596 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc00bd770 con 0x7f7bd80cabd0 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd8159d10 con 0x7f7bd80cabd0 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bceffd640 1 -- 172.21.15.2:0/2224230596 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc00bdb20 con 0x7f7bd80cabd0 2023-11-04T01:48:26.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd815a290 con 0x7f7bd80cabd0 2023-11-04T01:48:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd804e4a0 con 0x7f7bd80cabd0 2023-11-04T01:48:26.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bceffd640 1 -- 172.21.15.2:0/2224230596 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7bc00b3600 con 0x7f7bd80cabd0 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.535+0000 7f7bceffd640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7bb80664a0 0x7f7bb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.539+0000 7f7bceffd640 1 -- 172.21.15.2:0/2224230596 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f7bc00a7070 con 0x7f7bd80cabd0 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.539+0000 7f7bd659c640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7bb80664a0 0x7f7bb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.539+0000 7f7bd659c640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7bb80664a0 0x7f7bb8068960 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8006fd0 tx=0x7f7bc8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.543+0000 7f7bceffd640 1 -- 172.21.15.2:0/2224230596 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7bc00ec030 con 0x7f7bd80cabd0 2023-11-04T01:48:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.695+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f7bd80b4840 con 0x7f7bd80cabd0 2023-11-04T01:48:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.695+0000 7f7bceffd640 1 -- 172.21.15.2:0/2224230596 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v104) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7bc00ef650 con 0x7f7bd80cabd0 2023-11-04T01:48:26.701 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:48:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7bb80664a0 msgr2=0x7f7bb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7bb80664a0 0x7f7bb8068960 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8006fd0 tx=0x7f7bc8008040 comp rx=0 tx=0).stop 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 msgr2=0x7f7bd81579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd81579a0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f7bc00ac040 tx=0x7f7bc001ad10 comp rx=0 tx=0).stop 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 shutdown_connections 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7bb80664a0 0x7f7bb8068960 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd81556c0 0x7f7bd8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bd80cabd0 0x7f7bd81579a0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 --2- 172.21.15.2:0/2224230596 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7bd80c9360 0x7f7bd815aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 >> 172.21.15.2:0/2224230596 conn(0x7f7bd80ced10 msgr2=0x7f7bd80afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 shutdown_connections 2023-11-04T01:48:26.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.699+0000 7f7bdccd0640 1 -- 172.21.15.2:0/2224230596 wait complete. 2023-11-04T01:48:26.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53b5694640 1 Processor -- start 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53b5694640 1 -- start start 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53b5694640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 0x7f53b00b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53b5694640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f53b00caaa0 0x7f53b00cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53b5694640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b00ccdf0 con 0x7f53b015d410 2023-11-04T01:48:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53b5694640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b006fe50 con 0x7f53b00caaa0 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53b5694640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b00aef20 con 0x7f53b00c9a70 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53aeffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f53b015d410 0x7f53b00c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43842/0 (socket says 172.21.15.2:43842) 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53aeffd640 1 -- 172.21.15.2:0/775933887 learned_addr learned my addr 172.21.15.2:0/775933887 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53af7fe640 1 --2- 172.21.15.2:0/775933887 >> v2:172.21.15.90:3300/0 conn(0x7f53b00caaa0 0x7f53b00cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53ae7fc640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 0x7f53b00b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144699152 0 0) 0x7f53b00ccdf0 con 0x7f53b015d410 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5398003530 con 0x7f53b015d410 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3064996727 0 0) 0x7f5398003530 con 0x7f53b015d410 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 msgr2=0x7f53b00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 0x7f53b00b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 >> v2:172.21.15.90:3300/0 conn(0x7f53b00caaa0 msgr2=0x7f53b00cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 --2- 172.21.15.2:0/775933887 >> v2:172.21.15.90:3300/0 conn(0x7f53b00caaa0 0x7f53b00cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00b0750 con 0x7f53b015d410 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f53a0001680 con 0x7f53b015d410 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 >> v1:172.21.15.2:6789/0 conn(0x7f53b015d410 legacy=0x7f53b00c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 0x7f5398003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398003f00 0x7f53980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398004d10 0x7f5398005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b00aef20 con 0x7f5398003f00 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539800b990 con 0x7f5398004d10 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539800bad0 con 0x7f53b00c9a70 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53ae7fc640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398003f00 0x7f53980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53aeffd640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 0x7f5398003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53af7fe640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398004d10 0x7f5398005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53ae7fc640 1 -- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 msgr2=0x7f5398003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53ae7fc640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 0x7f5398003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53ae7fc640 1 -- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398004d10 msgr2=0x7f5398005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53ae7fc640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398004d10 0x7f5398005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53ae7fc640 1 -- 172.21.15.2:0/775933887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398003530 con 0x7f5398003f00 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53aeffd640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b00c9a70 0x7f5398003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:26.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.847+0000 7f53af7fe640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398004d10 0x7f5398005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53ae7fc640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398003f00 0x7f53980047d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009ae0 tx=0x7f53a401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89cf5fd6f434275 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40a5640 con 0x7f5398003f00 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40a57a0 con 0x7f5398003f00 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53adffb640 1 -- 172.21.15.2:0/775933887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40a5b50 con 0x7f5398003f00 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53b5694640 1 -- 172.21.15.2:0/775933887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398003f00 msgr2=0x7f53980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53b5694640 1 --2- 172.21.15.2:0/775933887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5398003f00 0x7f53980047d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009ae0 tx=0x7f53a401c9f0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53af7fe640 1 -- 172.21.15.2:0/775933887 reap_dead start 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53b5694640 1 -- 172.21.15.2:0/775933887 shutdown_connections 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53b5694640 1 -- 172.21.15.2:0/775933887 >> 172.21.15.2:0/775933887 conn(0x7f53b00ced10 msgr2=0x7f53b00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53b5694640 1 -- 172.21.15.2:0/775933887 shutdown_connections 2023-11-04T01:48:26.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.851+0000 7f53b5694640 1 -- 172.21.15.2:0/775933887 wait complete. 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 Processor -- start 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 -- start start 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398003f00 0x7f53b01e4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b01e75b0 0x7f53b01f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b01f2520 0x7f53b01f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b00c8730 con 0x7f53b01f2520 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b01e7a30 con 0x7f5398003f00 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b00c7970 con 0x7f53b01e75b0 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b01f2520 0x7f53b01f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b01f2520 0x7f53b01f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40638/0 (socket says 172.21.15.2:40638) 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 -- 172.21.15.2:0/1955612207 learned_addr learned my addr 172.21.15.2:0/1955612207 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53aeffd640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398003f00 0x7f53b01e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 -- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b01e75b0 msgr2=0x7f53b01f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b01e75b0 0x7f53b01f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 -- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398003f00 msgr2=0x7f53b01e4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398003f00 0x7f53b01e4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 -- 172.21.15.2:0/1955612207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00c7c50 con 0x7f53b01f2520 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53aeffd640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398003f00 0x7f53b01e4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53af7fe640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b01f2520 0x7f53b01f5f80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f53b0066c50 tx=0x7f53a80093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53977fe640 1 -- 172.21.15.2:0/1955612207 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a801b070 con 0x7f53b01f2520 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53977fe640 1 -- 172.21.15.2:0/1955612207 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8011040 con 0x7f53b01f2520 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b00c7f30 con 0x7f53b01f2520 2023-11-04T01:48:26.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53977fe640 1 -- 172.21.15.2:0/1955612207 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8010050 con 0x7f53b01f2520 2023-11-04T01:48:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b01e4f10 con 0x7f53b01f2520 2023-11-04T01:48:26.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b004e4a0 con 0x7f53b01f2520 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.855+0000 7f53977fe640 1 -- 172.21.15.2:0/1955612207 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53a8008d00 con 0x7f53b01f2520 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.859+0000 7f53977fe640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f539c0664d0 0x7f539c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.859+0000 7f53977fe640 1 -- 172.21.15.2:0/1955612207 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f53a8084570 con 0x7f53b01f2520 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.859+0000 7f53aeffd640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f539c0664d0 0x7f539c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:26.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.859+0000 7f53aeffd640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f539c0664d0 0x7f539c068990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f53b01e7c70 tx=0x7f53a0001450 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:26.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:26.863+0000 7f53977fe640 1 -- 172.21.15.2:0/1955612207 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f53a8051390 con 0x7f53b01f2520 2023-11-04T01:48:27.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.015+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53b006e430 con 0x7f53b01f2520 2023-11-04T01:48:27.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.015+0000 7f53977fe640 1 -- 172.21.15.2:0/1955612207 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53a80549b0 con 0x7f53b01f2520 2023-11-04T01:48:27.021 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:48:27.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f539c0664d0 msgr2=0x7f539c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f539c0664d0 0x7f539c068990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f53b01e7c70 tx=0x7f53a0001450 comp rx=0 tx=0).stop 2023-11-04T01:48:27.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b01f2520 msgr2=0x7f53b01f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b01f2520 0x7f53b01f5f80 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f53b0066c50 tx=0x7f53a80093e0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 shutdown_connections 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f539c0664d0 0x7f539c068990 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53b01f2520 0x7f53b01f5f80 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f53b01e75b0 0x7f53b01f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 --2- 172.21.15.2:0/1955612207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5398003f00 0x7f53b01e4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 >> 172.21.15.2:0/1955612207 conn(0x7f53b00ced10 msgr2=0x7f53b00cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 shutdown_connections 2023-11-04T01:48:27.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.019+0000 7f53b5694640 1 -- 172.21.15.2:0/1955612207 wait complete. 2023-11-04T01:48:27.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:48:27.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f74f10640 1 Processor -- start 2023-11-04T01:48:27.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f74f10640 1 -- start start 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f74f10640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1f7015d510 0x7f1f700d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f74f10640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f700b6700 con 0x7f1f7015d130 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f74f10640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f700ceec0 con 0x7f1f700d15f0 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f74f10640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f700b5ea0 con 0x7f1f7015d510 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6e59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1f7015d130 0x7f1f700ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43856/0 (socket says 172.21.15.2:43856) 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6e59c640 1 -- 172.21.15.2:0/305446460 learned_addr learned my addr 172.21.15.2:0/305446460 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6dd9b640 1 --2- 172.21.15.2:0/305446460 >> v2:172.21.15.2:3300/0 conn(0x7f1f7015d510 0x7f1f700d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6d59a640 1 -- 172.21.15.2:0/305446460 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907472265 0 0) 0x7f1f700b6700 con 0x7f1f7015d130 2023-11-04T01:48:27.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6d59a640 1 -- 172.21.15.2:0/305446460 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f58003530 con 0x7f1f7015d130 2023-11-04T01:48:27.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6dd9b640 1 -- 172.21.15.2:0/305446460 >> v1:172.21.15.90:6789/0 conn(0x7f1f700d15f0 legacy=0x7f1f700b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6dd9b640 1 -- 172.21.15.2:0/305446460 >> v1:172.21.15.2:6789/0 conn(0x7f1f7015d130 legacy=0x7f1f700ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6dd9b640 1 -- 172.21.15.2:0/305446460 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f700b60b0 con 0x7f1f7015d510 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6dd9b640 1 --2- 172.21.15.2:0/305446460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f700d1060 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097c0 tx=0x7f1f6001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afeaeb989079e538 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6d59a640 1 -- 172.21.15.2:0/305446460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f600a7070 con 0x7f1f7015d510 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6d59a640 1 -- 172.21.15.2:0/305446460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f600ab430 con 0x7f1f7015d510 2023-11-04T01:48:27.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.155+0000 7f1f6d59a640 1 -- 172.21.15.2:0/305446460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f600ab7a0 con 0x7f1f7015d510 2023-11-04T01:48:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- 172.21.15.2:0/305446460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 msgr2=0x7f1f700d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 --2- 172.21.15.2:0/305446460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f700d1060 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f1f600097c0 tx=0x7f1f6001c410 comp rx=0 tx=0).stop 2023-11-04T01:48:27.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- 172.21.15.2:0/305446460 shutdown_connections 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 --2- 172.21.15.2:0/305446460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f700d1060 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- 172.21.15.2:0/305446460 >> 172.21.15.2:0/305446460 conn(0x7f1f700d3050 msgr2=0x7f1f700d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- 172.21.15.2:0/305446460 shutdown_connections 2023-11-04T01:48:27.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- 172.21.15.2:0/305446460 wait complete. 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 Processor -- start 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- start start 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f700d15f0 0x7f1f700cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f7015d130 0x7f1f70157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f7014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7015ec10 con 0x7f1f7015d510 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7015fa70 con 0x7f1f7015d130 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7015ee60 con 0x7f1f700d15f0 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f7014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f7014fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40650/0 (socket says 172.21.15.2:40650) 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 -- 172.21.15.2:0/141791919 learned_addr learned my addr 172.21.15.2:0/141791919 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6e59c640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f700d15f0 0x7f1f700cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6dd9b640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f7015d130 0x7f1f70157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 -- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f700d15f0 msgr2=0x7f1f700cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f700d15f0 0x7f1f700cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 -- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f7015d130 msgr2=0x7f1f70157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f7015d130 0x7f1f70157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 -- 172.21.15.2:0/141791919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f60009420 con 0x7f1f7015d510 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f6ed9d640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f7014fe60 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800c7b0 tx=0x7f1f6800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f5effd640 1 -- 172.21.15.2:0/141791919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f68004b70 con 0x7f1f7015d510 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f5effd640 1 -- 172.21.15.2:0/141791919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f68004cd0 con 0x7f1f7015d510 2023-11-04T01:48:27.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7015f140 con 0x7f1f7015d510 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f5effd640 1 -- 172.21.15.2:0/141791919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6800aa90 con 0x7f1f7015d510 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.159+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7015f700 con 0x7f1f7015d510 2023-11-04T01:48:27.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.163+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f70067610 con 0x7f1f7015d510 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.163+0000 7f1f5effd640 1 -- 172.21.15.2:0/141791919 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1f6800abf0 con 0x7f1f7015d510 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.163+0000 7f1f5effd640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f500664a0 0x7f1f50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.163+0000 7f1f5effd640 1 -- 172.21.15.2:0/141791919 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f1f68084750 con 0x7f1f7015d510 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.163+0000 7f1f6e59c640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f500664a0 0x7f1f50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.163+0000 7f1f6e59c640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f500664a0 0x7f1f50068960 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1f64005890 tx=0x7f1f64009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.167+0000 7f1f5effd640 1 -- 172.21.15.2:0/141791919 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1f68051500 con 0x7f1f7015d510 2023-11-04T01:48:27.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.323+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f7015fbb0 con 0x7f1f7015d510 2023-11-04T01:48:27.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.323+0000 7f1f5effd640 1 -- 172.21.15.2:0/141791919 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f68054b20 con 0x7f1f7015d510 2023-11-04T01:48:27.327 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.323+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f500664a0 msgr2=0x7f1f50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.323+0000 7f1f74f10640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f500664a0 0x7f1f50068960 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1f64005890 tx=0x7f1f64009040 comp rx=0 tx=0).stop 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 msgr2=0x7f1f7014fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f7014fe60 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800c7b0 tx=0x7f1f6800cc70 comp rx=0 tx=0).stop 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 shutdown_connections 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1f500664a0 0x7f1f50068960 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f7015d510 0x7f1f7014fe60 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1f7015d130 0x7f1f70157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 --2- 172.21.15.2:0/141791919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1f700d15f0 0x7f1f700cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 >> 172.21.15.2:0/141791919 conn(0x7f1f700d3050 msgr2=0x7f1f700cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 shutdown_connections 2023-11-04T01:48:27.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.327+0000 7f1f74f10640 1 -- 172.21.15.2:0/141791919 wait complete. 2023-11-04T01:48:27.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.467+0000 7f229ae6a640 1 Processor -- start 2023-11-04T01:48:27.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.467+0000 7f229ae6a640 1 -- start start 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f229ae6a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f22940c92b0 0x7f22940cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f229ae6a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f229406c1c0 0x7f22941442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f229ae6a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940c9ac0 con 0x7f229406bde0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f229ae6a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940caf20 con 0x7f22940c92b0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f229ae6a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c97e0 con 0x7f229406c1c0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f229406bde0 0x7f229415c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43866/0 (socket says 172.21.15.2:43866) 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 -- 172.21.15.2:0/3834212659 learned_addr learned my addr 172.21.15.2:0/3834212659 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2293fff640 1 --2- 172.21.15.2:0/3834212659 >> v2:172.21.15.90:3300/0 conn(0x7f22940c92b0 0x7f22940cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749905851 0 0) 0x7f22940c9ac0 con 0x7f229406bde0 2023-11-04T01:48:27.476 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2299407640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f229406c1c0 0x7f22941442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f227c003530 con 0x7f229406bde0 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4009545044 0 0) 0x7f227c003530 con 0x7f229406bde0 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f229406c1c0 msgr2=0x7f22941442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f229406c1c0 0x7f22941442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 >> v2:172.21.15.90:3300/0 conn(0x7f22940c92b0 msgr2=0x7f22940cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 --2- 172.21.15.2:0/3834212659 >> v2:172.21.15.90:3300/0 conn(0x7f22940c92b0 0x7f22940cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940cb1c0 con 0x7f229406bde0 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2284001a00 con 0x7f229406bde0 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 >> v1:172.21.15.2:6789/0 conn(0x7f229406bde0 legacy=0x7f229415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227c003980 0x7f227c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c0047d0 0x7f227c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f229406c1c0 0x7f227c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940caf20 con 0x7f227c003980 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c97e0 con 0x7f227c0047d0 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c00b9e0 con 0x7f229406c1c0 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227c003980 0x7f227c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2293fff640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c0047d0 0x7f227c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 -- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f229406c1c0 msgr2=0x7f227c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f229406c1c0 0x7f227c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 -- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c0047d0 msgr2=0x7f227c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c0047d0 0x7f227c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 -- 172.21.15.2:0/3834212659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c003530 con 0x7f227c003980 2023-11-04T01:48:27.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2293fff640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c0047d0 0x7f227c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.471+0000 7f2298c06640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227c003980 0x7f227c003da0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f228400a840 tx=0x7f228401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ea0703cd407e0b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840ad630 con 0x7f227c003980 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22840a8070 con 0x7f227c003980 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f22937fe640 1 -- 172.21.15.2:0/3834212659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840ad9f0 con 0x7f227c003980 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- 172.21.15.2:0/3834212659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227c003980 msgr2=0x7f227c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 --2- 172.21.15.2:0/3834212659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f227c003980 0x7f227c003da0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f228400a840 tx=0x7f228401d300 comp rx=0 tx=0).stop 2023-11-04T01:48:27.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 -- 172.21.15.2:0/3834212659 reap_dead start 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- 172.21.15.2:0/3834212659 shutdown_connections 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- 172.21.15.2:0/3834212659 >> 172.21.15.2:0/3834212659 conn(0x7f22940b0890 msgr2=0x7f22940b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- 172.21.15.2:0/3834212659 shutdown_connections 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- 172.21.15.2:0/3834212659 wait complete. 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 Processor -- start 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- start start 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c003980 0x7f2294159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22940cc8c0 0x7f22940ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22940c5da0 0x7f22940c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940cd280 con 0x7f22940c5da0 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c75d0 con 0x7f227c003980 2023-11-04T01:48:27.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c78b0 con 0x7f22940cc8c0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22940c5da0 0x7f22940c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22940c5da0 0x7f22940c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40660/0 (socket says 172.21.15.2:40660) 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 -- 172.21.15.2:0/3270891386 learned_addr learned my addr 172.21.15.2:0/3270891386 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2293fff640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22940cc8c0 0x7f22940ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2298c06640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c003980 0x7f2294159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 -- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22940cc8c0 msgr2=0x7f22940ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22940cc8c0 0x7f22940ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 -- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c003980 msgr2=0x7f2294159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c003980 0x7f2294159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 -- 172.21.15.2:0/3270891386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294144dc0 con 0x7f22940c5da0 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2298c06640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c003980 0x7f2294159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:27.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f2299407640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22940c5da0 0x7f22940c6220 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f22940c9690 tx=0x7f228c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f22917fa640 1 -- 172.21.15.2:0/3270891386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00c680 con 0x7f22940c5da0 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f22917fa640 1 -- 172.21.15.2:0/3270891386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00c800 con 0x7f22940c5da0 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22940c7b90 con 0x7f22940c5da0 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f22917fa640 1 -- 172.21.15.2:0/3270891386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00cbb0 con 0x7f22940c5da0 2023-11-04T01:48:27.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.475+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22940c8390 con 0x7f22940c5da0 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.479+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22940c7710 con 0x7f22940c5da0 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.479+0000 7f22917fa640 1 -- 172.21.15.2:0/3270891386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f228c00cd10 con 0x7f22940c5da0 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.479+0000 7f22917fa640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22800664a0 0x7f2280068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.479+0000 7f22917fa640 1 -- 172.21.15.2:0/3270891386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f228c083e40 con 0x7f22940c5da0 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.479+0000 7f2298c06640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22800664a0 0x7f2280068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.479+0000 7f2298c06640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22800664a0 0x7f2280068960 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f22840ad000 tx=0x7f2284001cc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.483+0000 7f22917fa640 1 -- 172.21.15.2:0/3270891386 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f22940c7710 con 0x7f22940c5da0 2023-11-04T01:48:27.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f22940c7710 con 0x7f22940c5da0 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f22917fa640 1 -- 172.21.15.2:0/3270891386 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 13 entries v104) v1 ==== 81+0+779 (secure 0 0 0) 0x7f22940c7710 con 0x7f22940c5da0 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2023608941 2023-11-04T02:48:20.721790+0000 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:48:27.647 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:48:27.648 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:listed 13 entries 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22800664a0 msgr2=0x7f2280068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22800664a0 0x7f2280068960 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f22840ad000 tx=0x7f2284001cc0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22940c5da0 msgr2=0x7f22940c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22940c5da0 0x7f22940c6220 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f22940c9690 tx=0x7f228c00ec00 comp rx=0 tx=0).stop 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 shutdown_connections 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f22800664a0 0x7f2280068960 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22940c5da0 0x7f22940c6220 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f22940cc8c0 0x7f22940ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 --2- 172.21.15.2:0/3270891386 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f227c003980 0x7f2294159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 >> 172.21.15.2:0/3270891386 conn(0x7f22940b0890 msgr2=0x7f2294070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 shutdown_connections 2023-11-04T01:48:27.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.643+0000 7f229ae6a640 1 -- 172.21.15.2:0/3270891386 wait complete. 2023-11-04T01:48:27.664 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:48:27.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:27.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:27.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[54963]: fuse finished with error 0 and tester_r 0 2023-11-04T01:48:27.691 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:48:27.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:27.691 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:48:27.738 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:48:27.738 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:48:27.786 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:48:27.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2f3ce640 1 Processor -- start 2023-11-04T01:48:27.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2f3ce640 1 -- start start 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2f3ce640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 0x7fbb280cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2f3ce640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280c4910 con 0x7fbb280add70 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2f3ce640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2815da70 con 0x7fbb2815cf80 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2f3ce640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2806bbf0 con 0x7fbb280ae200 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbb280add70 0x7fbb2815d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43882/0 (socket says 172.21.15.2:43882) 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 -- 172.21.15.2:0/1505058096 learned_addr learned my addr 172.21.15.2:0/1505058096 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2d96b640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 0x7fbb280cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2934653234 0 0) 0x7fbb280c4910 con 0x7fbb280add70 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb14003530 con 0x7fbb280add70 2023-11-04T01:48:27.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521638475 0 0) 0x7fbb2815da70 con 0x7fbb2815cf80 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb280c4910 con 0x7fbb2815cf80 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208438536 0 0) 0x7fbb14003530 con 0x7fbb280add70 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 msgr2=0x7fbb280cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 0x7fbb280cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 >> v1:172.21.15.90:6789/0 conn(0x7fbb2815cf80 legacy=0x7fbb280ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2815dcf0 con 0x7fbb280add70 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fbb180016a0 con 0x7fbb280add70 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 >> v1:172.21.15.2:6789/0 conn(0x7fbb280add70 legacy=0x7fbb2815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 0x7fbb14003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb14004d10 0x7fbb14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2806bbf0 con 0x7fbb140040a0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400ba70 con 0x7fbb14004d10 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1400bc30 con 0x7fbb280ae200 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2d16a640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 0x7fbb14003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 -- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 msgr2=0x7fbb14003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb280ae200 0x7fbb14003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2d96b640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb14004d10 0x7fbb14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 -- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb14004d10 msgr2=0x7fbb14005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb14004d10 0x7fbb14005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.951+0000 7fbb2c969640 1 -- 172.21.15.2:0/1505058096 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14003530 con 0x7fbb140040a0 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2c969640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb140047d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbb280c4aa0 tx=0x7fbb1801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2752f764d2949c2f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180058e0 con 0x7fbb140040a0 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18005a60 con 0x7fbb140040a0 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb1ffff640 1 -- 172.21.15.2:0/1505058096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18005e10 con 0x7fbb140040a0 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1505058096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 msgr2=0x7fbb140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 --2- 172.21.15.2:0/1505058096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb140047d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fbb280c4aa0 tx=0x7fbb1801cb80 comp rx=0 tx=0).stop 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2d96b640 1 -- 172.21.15.2:0/1505058096 reap_dead start 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1505058096 shutdown_connections 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1505058096 >> 172.21.15.2:0/1505058096 conn(0x7fbb280b0890 msgr2=0x7fbb280b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1505058096 shutdown_connections 2023-11-04T01:48:27.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1505058096 wait complete. 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 Processor -- start 2023-11-04T01:48:27.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- start start 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb281500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb28153170 0x7fbb280cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb280cd720 0x7fbb280cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28153900 con 0x7fbb140040a0 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280b2110 con 0x7fbb280cd720 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.955+0000 7fbb2f3ce640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28150630 con 0x7fbb28153170 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb281500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb281500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40676/0 (socket says 172.21.15.2:40676) 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 -- 172.21.15.2:0/1338026200 learned_addr learned my addr 172.21.15.2:0/1338026200 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2c969640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb28153170 0x7fbb280cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d96b640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb280cd720 0x7fbb280cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 -- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb28153170 msgr2=0x7fbb280cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb28153170 0x7fbb280cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 -- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb280cd720 msgr2=0x7fbb280cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb280cd720 0x7fbb280cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:27.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 -- 172.21.15.2:0/1338026200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28155e50 con 0x7fbb140040a0 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2d16a640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb281500f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fbb24011ee0 tx=0x7fbb2400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb1dffb640 1 -- 172.21.15.2:0/1338026200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24015610 con 0x7fbb140040a0 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb1dffb640 1 -- 172.21.15.2:0/1338026200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24015770 con 0x7fbb140040a0 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb28156130 con 0x7fbb140040a0 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb1dffb640 1 -- 172.21.15.2:0/1338026200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24015b20 con 0x7fbb140040a0 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb28156410 con 0x7fbb140040a0 2023-11-04T01:48:27.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2804e4a0 con 0x7fbb140040a0 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb1dffb640 1 -- 172.21.15.2:0/1338026200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbb24015c80 con 0x7fbb140040a0 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb1dffb640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb0c0664a0 0x7fbb0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb1dffb640 1 -- 172.21.15.2:0/1338026200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7fbb24087f20 con 0x7fbb140040a0 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.959+0000 7fbb2c969640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb0c0664a0 0x7fbb0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:27.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.963+0000 7fbb2c969640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb0c0664a0 0x7fbb0c068960 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbb180aa000 tx=0x7fbb18001a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:27.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:27.963+0000 7fbb1dffb640 1 -- 172.21.15.2:0/1338026200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbb24054c50 con 0x7fbb140040a0 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.151+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb2806cf10 con 0x7fbb140040a0 2023-11-04T01:48:28.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.151+0000 7fbb1dffb640 1 -- 172.21.15.2:0/1338026200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbb24058270 con 0x7fbb140040a0 2023-11-04T01:48:28.157 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb0c0664a0 msgr2=0x7fbb0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb0c0664a0 0x7fbb0c068960 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbb180aa000 tx=0x7fbb18001a20 comp rx=0 tx=0).stop 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 msgr2=0x7fbb281500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb281500f0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fbb24011ee0 tx=0x7fbb2400f540 comp rx=0 tx=0).stop 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 shutdown_connections 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbb0c0664a0 0x7fbb0c068960 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb280cd720 0x7fbb280cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbb28153170 0x7fbb280cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 --2- 172.21.15.2:0/1338026200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb140040a0 0x7fbb281500f0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:28.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 >> 172.21.15.2:0/1338026200 conn(0x7fbb280b0890 msgr2=0x7fbb2806f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 shutdown_connections 2023-11-04T01:48:28.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:28.155+0000 7fbb2f3ce640 1 -- 172.21.15.2:0/1338026200 wait complete. 2023-11-04T01:48:28.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:48:28.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:48:28.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:48:28.175 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:48:28.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:28.175 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:48:28.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:48:28.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:48:28.175 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:28.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.175 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:48:28.181 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:48:28.182 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41836sec preferred_lft 41836sec 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:48:28.183 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:48:28.184 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:48:28.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.185 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:48:28.238 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:48:28.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.240 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:48:28.287 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:48:28.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.288 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:48:28.288 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:48:28.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:48:28.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:48:28.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:48:28.289 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:48:28.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.361 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:48:28.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:48:28.410 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:28.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:48:28.465 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:48:28.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:48:28.466 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:28.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:48:28.515 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:28.534 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:48:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:28.539 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:48:28.599 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:48:28.600 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:28.601 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:28.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.602 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:48:28.650 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:48:28.650 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:48:28.695 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:48:28.702 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:48:28.703 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:28.704 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:28.705 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:28.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:28.705 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:48:28.784 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:48:28.779+0000 7f321961a580 -1 init, newargv = 0x5649af4298e0 newargc=15 2023-11-04T01:48:28.785 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[58067]: starting ceph client 2023-11-04T01:48:28.795 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[58067]: starting fuse 2023-11-04T01:48:29.855 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:48:29.863 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:48:29.864 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:48:29.865 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:48:29.866 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:29.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:29.867 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:48:29.914 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:48:29.915 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:48:29.915 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:48:29.916 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:48:29.917 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:48:29.917 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:48:29.917 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:48:29.917 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:48:29.917 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:48:29.917 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:48:30.044 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.58067.asok 2023-11-04T01:48:30.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:30.057 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58067.asok 2023-11-04T01:48:30.057 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:30.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.58067.asok status 2023-11-04T01:48:30.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:48:30.262 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "58067", 2023-11-04T01:48:30.263 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 8106, 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:48:30.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 8106 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:48:30.265 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2988241810 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:48:30.266 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2988241810 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.8106 192.168.0.1:0/2988241810", 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/2988241810", 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:48:30.267 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 94, 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 104, 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:48:30.268 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:48:30.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:30.284 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:30.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:48:30.284 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:30.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:48:30.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:30.339 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:30.339 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:48:30.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:48:30.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:48:30.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:48:30.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:48:30.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2d054fb640 1 Processor -- start 2023-11-04T01:48:30.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2d054fb640 1 -- start start 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2d054fb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d000d1cb0 0x7f2d000d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2d054fb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d0015d5a0 0x7f2d000b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2d054fb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d000d09b0 con 0x7f2d0015d1c0 2023-11-04T01:48:30.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2d054fb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d000d0110 con 0x7f2d000d1cb0 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2d054fb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d000d03f0 con 0x7f2d0015d5a0 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfe7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d000d1cb0 0x7f2d000d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfeffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2d0015d1c0 0x7f2d000d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43886/0 (socket says 172.21.15.2:43886) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfeffd640 1 -- 172.21.15.2:0/1061677079 learned_addr learned my addr 172.21.15.2:0/1061677079 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/1061677079 >> v2:172.21.15.90:3300/0 conn(0x7f2d0015d5a0 0x7f2d000b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/1061677079 >> v2:172.21.15.90:3300/0 conn(0x7f2d0015d5a0 msgr2=0x7f2d000b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/1061677079 >> v2:172.21.15.90:3300/0 conn(0x7f2d0015d5a0 0x7f2d000b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/1061677079 >> v1:172.21.15.2:6789/0 conn(0x7f2d0015d1c0 legacy=0x7f2d000d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfdffb640 1 -- 172.21.15.2:0/1061677079 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213297118 0 0) 0x7f2d000d09b0 con 0x7f2d0015d1c0 2023-11-04T01:48:30.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.567+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/1061677079 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d000d06d0 con 0x7f2d000d1cb0 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/1061677079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d000d1cb0 0x7f2d000d3ae0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2d0008d4c0 tx=0x7f2cf401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4a09057c04c8b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cfdffb640 1 -- 172.21.15.2:0/1061677079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40ab610 con 0x7f2d000d1cb0 2023-11-04T01:48:30.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cfdffb640 1 -- 172.21.15.2:0/1061677079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf40ab770 con 0x7f2d000d1cb0 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cfdffb640 1 -- 172.21.15.2:0/1061677079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40abb00 con 0x7f2d000d1cb0 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- 172.21.15.2:0/1061677079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d000d1cb0 msgr2=0x7f2d000d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 --2- 172.21.15.2:0/1061677079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d000d1cb0 0x7f2d000d3ae0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f2d0008d4c0 tx=0x7f2cf401c430 comp rx=0 tx=0).stop 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- 172.21.15.2:0/1061677079 shutdown_connections 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 --2- 172.21.15.2:0/1061677079 >> v2:172.21.15.90:3300/0 conn(0x7f2d0015d5a0 0x7f2d000b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 --2- 172.21.15.2:0/1061677079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d000d1cb0 0x7f2d000d3ae0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- 172.21.15.2:0/1061677079 >> 172.21.15.2:0/1061677079 conn(0x7f2d000d2fc0 msgr2=0x7f2d000d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- 172.21.15.2:0/1061677079 shutdown_connections 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- 172.21.15.2:0/1061677079 wait complete. 2023-11-04T01:48:30.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 Processor -- start 2023-11-04T01:48:30.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- start start 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d0015d1c0 0x7f2d00154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d0015d5a0 0x7f2d000b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d001f61a0 0x7f2d0015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d001f54d0 con 0x7f2d001f61a0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000cb010 con 0x7f2d0015d5a0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d001f56c0 con 0x7f2d0015d1c0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d001f61a0 0x7f2d0015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d001f61a0 0x7f2d0015b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40686/0 (socket says 172.21.15.2:40686) 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 -- 172.21.15.2:0/3937767971 learned_addr learned my addr 172.21.15.2:0/3937767971 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 -- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d0015d1c0 msgr2=0x7f2d00154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d0015d1c0 0x7f2d00154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 -- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d0015d5a0 msgr2=0x7f2d000b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d0015d5a0 0x7f2d000b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 -- 172.21.15.2:0/3937767971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4009420 con 0x7f2d001f61a0 2023-11-04T01:48:30.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d001f61a0 0x7f2d0015b180 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8007e60 tx=0x7f2cf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2ce77fe640 1 -- 172.21.15.2:0/3937767971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8014420 con 0x7f2d001f61a0 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2ce77fe640 1 -- 172.21.15.2:0/3937767971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf80145a0 con 0x7f2d001f61a0 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d001f59a0 con 0x7f2d001f61a0 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2ce77fe640 1 -- 172.21.15.2:0/3937767971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8014950 con 0x7f2d001f61a0 2023-11-04T01:48:30.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.571+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d000cb2f0 con 0x7f2d001f61a0 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2ce77fe640 1 -- 172.21.15.2:0/3937767971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2cf8014ab0 con 0x7f2d001f61a0 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2ce77fe640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2cec0664a0 0x7f2cec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2ce77fe640 1 -- 172.21.15.2:0/3937767971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f2cf8084e80 con 0x7f2d001f61a0 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2cec0664a0 0x7f2cec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 Processor -- start 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 -- start start 2023-11-04T01:48:30.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2cec0664a0 0x7f2cec068960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00011f0 tx=0x7f2cf0007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a24079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a2407f10 0x5610a23bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a23bdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a2285d80 con 0x5610a2407f10 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a22167a0 con 0x5610a23bd7f0 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610a2213cd0 con 0x5610a24075f0 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a2407f10 0x5610a23bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a2407f10 0x5610a23bd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40702/0 (socket says 172.21.15.2:40702) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2402876206 learned_addr learned my addr 172.21.15.2:0/2402876206 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a23bdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a24079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 msgr2=0x5610a24079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a24079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 msgr2=0x5610a23bdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.575+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a23bdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2402876206 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610a21ac180 con 0x5610a2407f10 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a23bdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a2407f10 0x5610a23bd2b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40ad040 tx=0x7f2cf4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fcf282df3883b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2ce4ff9640 1 -- 172.21.15.2:0/2402876206 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4004030 con 0x5610a2407f10 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2ce4ff9640 1 -- 172.21.15.2:0/2402876206 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf40041b0 con 0x5610a2407f10 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2ce4ff9640 1 -- 172.21.15.2:0/2402876206 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40ab8e0 con 0x5610a2407f10 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- 172.21.15.2:0/2402876206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a2407f10 msgr2=0x5610a23bd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a2407f10 0x5610a23bd2b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40ad040 tx=0x7f2cf4004740 comp rx=0 tx=0).stop 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- 172.21.15.2:0/2402876206 shutdown_connections 2023-11-04T01:48:30.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a23bdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a2407f10 0x5610a23bd2b0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 --2- 172.21.15.2:0/2402876206 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a24079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- 172.21.15.2:0/2402876206 >> 172.21.15.2:0/2402876206 conn(0x5610a22a5d50 msgr2=0x5610a23bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- 172.21.15.2:0/2402876206 shutdown_connections 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- 172.21.15.2:0/2402876206 wait complete. 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- start start 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 Processor -- start 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a23bd7f0 0x5610a23ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a23ec110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a23ec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a220f5c0 con 0x5610a23bd7f0 2023-11-04T01:48:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a21cd8c0 con 0x5610a2407f10 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610a21cd560 con 0x5610a24075f0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 10 client.0 _ll_register_callbacks cb 0x5610a23a8ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a23bd7f0 0x5610a23ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a23bd7f0 0x5610a23ebbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40706/0 (socket says 172.21.15.2:40706) 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 -- 172.21.15.2:0/2830809486 learned_addr learned my addr 172.21.15.2:0/2830809486 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a23ec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a23ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 -- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 msgr2=0x5610a23ec110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a23ec110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 -- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 msgr2=0x5610a23ec650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a23ec650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 -- 172.21.15.2:0/2830809486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d000d06d0 con 0x5610a23bd7f0 2023-11-04T01:48:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a23ec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a23bd7f0 0x5610a23ebbd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005b80 tx=0x7f2cf0001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0325cbd5441532 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cddffb640 1 -- 172.21.15.2:0/2830809486 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000ce90 con 0x5610a23bd7f0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cddffb640 1 -- 172.21.15.2:0/2830809486 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f2cf0012440 con 0x5610a23bd7f0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610a21dada0 con 0x5610a23bd7f0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cddffb640 1 -- 172.21.15.2:0/2830809486 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cf0012600 con 0x5610a23bd7f0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 10 client.8121 fetch_fsmap learned FSMap version 94 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x5610a1f07e20 con 0x5610a23bd7f0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cddffb640 1 -- 172.21.15.2:0/2830809486 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610a21dada0 con 0x5610a23bd7f0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2cddffb640 1 -- 172.21.15.2:0/2830809486 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 94) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2cf0012760 con 0x5610a23bd7f0 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 10 client.8121 fetch_fsmap finished waiting for FSMap version 94 2023-11-04T01:48:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 10 client.8121 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.579+0000 7f2d08628000 20 client.8121 populate_metadata read hostname 'smithi002' 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a23ecf20 0x5610a2418d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 4 client.8121 mds_command: new command op to 7815 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 --> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610a21dab80 con 0x5610a23ecf20 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a23ecf20 0x5610a2418d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2cddffb640 10 client.8121 ms_handle_connect on v2:172.21.15.2:6832/3051439603 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a23ecf20 0x5610a2418d70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e25c857ac726905 server_cookie=f76bff3e48d8937f in_seq=0 out_seq=0 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2cddffb640 1 -- 172.21.15.2:0/2830809486 <== mds.0 v2:172.21.15.2:6832/3051439603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5610a21dab80 con 0x5610a23ecf20 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2cddffb640 10 client.8121 handle_command_reply: tid=0 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 client.8121 shutdown 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a23bd7f0 msgr2=0x5610a23ebbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a23bd7f0 0x5610a23ebbd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005b80 tx=0x7f2cf0001090 comp rx=0 tx=0).stop 2023-11-04T01:48:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 shutdown_connections 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a23ecf20 0x5610a2418d70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a23ec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a24075f0 0x5610a23ec110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 --2- 172.21.15.2:0/2830809486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a23bd7f0 0x5610a23ebbd0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2cddffb640 0 client.8121 ms_handle_reset on v2:172.21.15.2:6832/3051439603 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 >> 172.21.15.2:0/2830809486 conn(0x5610a22a5d50 msgr2=0x5610a23bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 shutdown_connections 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 1 -- 172.21.15.2:0/2830809486 wait complete. 2023-11-04T01:48:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.583+0000 7f2d08628000 20 client.8121 trim_cache size 0 max 16384 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 Processor -- start 2023-11-04T01:48:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 -- start start 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a241b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2418d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a2407f10 0x5610a24192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a1ec8aa0 con 0x5610a24075f0 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a220af30 con 0x5610a23bd7f0 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.595+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610a220e450 con 0x5610a2407f10 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2418d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2418d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40708/0 (socket says 172.21.15.2:40708) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/1019991253 learned_addr learned my addr 172.21.15.2:0/1019991253 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:30.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a241b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a2407f10 0x5610a24192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a2407f10 msgr2=0x5610a24192b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a2407f10 0x5610a24192b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 msgr2=0x5610a241b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a241b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/1019991253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610a21d02f0 con 0x5610a24075f0 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a241b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2418d70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4008010 tx=0x7f2cf40a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5b5426ee79bacb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2ce57fa640 1 -- 172.21.15.2:0/1019991253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40c4040 con 0x5610a24075f0 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2ce57fa640 1 -- 172.21.15.2:0/1019991253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf40c6040 con 0x5610a24075f0 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2ce57fa640 1 -- 172.21.15.2:0/1019991253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4004500 con 0x5610a24075f0 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- 172.21.15.2:0/1019991253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 msgr2=0x5610a2418d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2418d70 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4008010 tx=0x7f2cf40a9000 comp rx=0 tx=0).stop 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- 172.21.15.2:0/1019991253 shutdown_connections 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a2407f10 0x5610a24192b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2418d70 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 --2- 172.21.15.2:0/1019991253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a23bd7f0 0x5610a241b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- 172.21.15.2:0/1019991253 >> 172.21.15.2:0/1019991253 conn(0x5610a22a5d50 msgr2=0x5610a23be460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- 172.21.15.2:0/1019991253 shutdown_connections 2023-11-04T01:48:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- 172.21.15.2:0/1019991253 wait complete. 2023-11-04T01:48:30.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- start start 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 Processor -- start 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a23bd7f0 0x5610a2468a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2468f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a2423840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a224f600 con 0x5610a24075f0 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610a21e6960 con 0x5610a2407f10 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610a23ebe00 con 0x5610a23bd7f0 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 10 client.0 _ll_register_callbacks cb 0x5610a22c0bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2468f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2468f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40714/0 (socket says 172.21.15.2:40714) 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2249536602 learned_addr learned my addr 172.21.15.2:0/2249536602 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:30.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cff7fe640 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a2423840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a23bd7f0 0x5610a2468a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a23bd7f0 msgr2=0x5610a2468a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a23bd7f0 0x5610a2468a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 msgr2=0x5610a2423840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a2423840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 -- 172.21.15.2:0/2249536602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610a21ac180 con 0x5610a24075f0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cfe7fc640 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2468f40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4008010 tx=0x7f2cf401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64f01ae80b68651 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cddffb640 1 -- 172.21.15.2:0/2249536602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf40d1070 con 0x5610a24075f0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2cddffb640 1 -- 172.21.15.2:0/2249536602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f2cf4004380 con 0x5610a24075f0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.599+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610a23c04e0 con 0x5610a24075f0 2023-11-04T01:48:30.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2cddffb640 1 -- 172.21.15.2:0/2249536602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cf40c4070 con 0x5610a24075f0 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 10 client.8127 fetch_fsmap learned FSMap version 94 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x5610a21b67f0 con 0x5610a24075f0 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2cddffb640 1 -- 172.21.15.2:0/2249536602 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610a23c04e0 con 0x5610a24075f0 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2cddffb640 1 -- 172.21.15.2:0/2249536602 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 94) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f2cf40bd030 con 0x5610a24075f0 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 10 client.8127 fetch_fsmap finished waiting for FSMap version 94 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 10 client.8127 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 20 client.8127 populate_metadata read hostname 'smithi002' 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a2424230 0x5610a2424640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 4 client.8127 mds_command: new command op to 7815 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 --> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5610a22068b0 con 0x5610a2424230 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a2424230 0x5610a2424640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2cfeffd640 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a2424230 0x5610a2424640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52d403086ed79584 server_cookie=fe9d1a947e0783bb in_seq=0 out_seq=0 2023-11-04T01:48:30.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.603+0000 7f2cddffb640 10 client.8127 ms_handle_connect on v2:172.21.15.2:6832/3051439603 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2cddffb640 1 -- 172.21.15.2:0/2249536602 <== mds.0 v2:172.21.15.2:6832/3051439603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5610a22068b0 con 0x5610a2424230 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2cddffb640 10 client.8127 handle_command_reply: tid=0 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 client.8127 shutdown 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 msgr2=0x5610a2468f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2468f40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4008010 tx=0x7f2cf401ac70 comp rx=0 tx=0).stop 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 shutdown_connections 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:6832/3051439603,v1:172.21.15.2:6833/3051439603] conn(0x5610a2424230 0x5610a2424640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5610a2407f10 0x5610a2423840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5610a24075f0 0x5610a2468f40 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2cddffb640 0 client.8127 ms_handle_reset on v2:172.21.15.2:6832/3051439603 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 --2- 172.21.15.2:0/2249536602 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x5610a23bd7f0 0x5610a2468a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 >> 172.21.15.2:0/2249536602 conn(0x5610a22a5d50 msgr2=0x5610a23bdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 shutdown_connections 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 1 -- 172.21.15.2:0/2249536602 wait complete. 2023-11-04T01:48:30.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d08628000 20 client.8127 trim_cache size 0 max 16384 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0 2023-11-04T01:48:30.630 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2cec0664a0 msgr2=0x7f2cec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2cec0664a0 0x7f2cec068960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00011f0 tx=0x7f2cf0007930 comp rx=0 tx=0).stop 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d001f61a0 msgr2=0x7f2d0015b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d001f61a0 0x7f2d0015b180 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8007e60 tx=0x7f2cf800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 shutdown_connections 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2cec0664a0 0x7f2cec068960 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d001f61a0 0x7f2d0015b180 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d0015d5a0 0x7f2d000b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 --2- 172.21.15.2:0/3937767971 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d0015d1c0 0x7f2d00154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 >> 172.21.15.2:0/3937767971 conn(0x7f2d000d2fc0 msgr2=0x7f2d000ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 shutdown_connections 2023-11-04T01:48:30.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.623+0000 7f2d054fb640 1 -- 172.21.15.2:0/3937767971 wait complete. 2023-11-04T01:48:30.645 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=5, also kill snapclient 2023-11-04T01:48:30.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:30.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.759+0000 7f9a9ff53640 1 Processor -- start 2023-11-04T01:48:30.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.759+0000 7f9a9ff53640 1 -- start start 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9ff53640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160680 0x7f9a980cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9ff53640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a98160a60 0x7f9a980ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9ff53640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980cf000 con 0x7f9a980b3e30 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9ff53640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a980b5de0 con 0x7f9a98160a60 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9ff53640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980d1610 con 0x7f9a98160680 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a98160a60 0x7f9a980ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9a98160a60 0x7f9a980ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40716/0 (socket says 172.21.15.2:40716) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2586708378 learned_addr learned my addr 172.21.15.2:0/2586708378 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9dcef640 1 --2- 172.21.15.2:0/2586708378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160680 0x7f9a980cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2586708378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160680 msgr2=0x7f9a980cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 --2- 172.21.15.2:0/2586708378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160680 0x7f9a980cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2586708378 >> v1:172.21.15.90:6789/0 conn(0x7f9a980b3e30 legacy=0x7f9a980cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2586708378 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980d18f0 con 0x7f9a98160a60 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9d4ee640 1 --2- 172.21.15.2:0/2586708378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160a60 0x7f9a980ce0e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009870 tx=0x7f9a9401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b00a9c0653aa99 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9cced640 1 -- 172.21.15.2:0/2586708378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940ab680 con 0x7f9a98160a60 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9cced640 1 -- 172.21.15.2:0/2586708378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a940ab7e0 con 0x7f9a98160a60 2023-11-04T01:48:30.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.763+0000 7f9a9cced640 1 -- 172.21.15.2:0/2586708378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940abb70 con 0x7f9a98160a60 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2586708378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160a60 msgr2=0x7f9a980ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2586708378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160a60 0x7f9a980ce0e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009870 tx=0x7f9a9401c480 comp rx=0 tx=0).stop 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2586708378 shutdown_connections 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2586708378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160a60 0x7f9a980ce0e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2586708378 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160680 0x7f9a980cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2586708378 >> 172.21.15.2:0/2586708378 conn(0x7f9a980d2f90 msgr2=0x7f9a980d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2586708378 shutdown_connections 2023-11-04T01:48:30.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2586708378 wait complete. 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 Processor -- start 2023-11-04T01:48:30.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- start start 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a980b3e30 0x7f9a980c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160680 0x7f9a980c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160a60 0x7f9a980ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c7cb0 con 0x7f9a98160680 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c7f90 con 0x7f9a980b3e30 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c8270 con 0x7f9a98160a60 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160680 0x7f9a980c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160680 0x7f9a980c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40722/0 (socket says 172.21.15.2:40722) 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2397592120 learned_addr learned my addr 172.21.15.2:0/2397592120 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:30.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9dcef640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a980b3e30 0x7f9a980c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9e4f0640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160a60 0x7f9a980ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160a60 msgr2=0x7f9a980ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160a60 0x7f9a980ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a980b3e30 msgr2=0x7f9a980c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a980b3e30 0x7f9a980c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 -- 172.21.15.2:0/2397592120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a940094d0 con 0x7f9a98160680 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9dcef640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a980b3e30 0x7f9a980c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9e4f0640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160a60 0x7f9a980ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9d4ee640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160680 0x7f9a980c8d50 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9a940ad040 tx=0x7f9a94019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a8e7fc640 1 -- 172.21.15.2:0/2397592120 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940b5810 con 0x7f9a98160680 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a8e7fc640 1 -- 172.21.15.2:0/2397592120 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a940b59b0 con 0x7f9a98160680 2023-11-04T01:48:30.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a8e7fc640 1 -- 172.21.15.2:0/2397592120 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a940b5d60 con 0x7f9a98160680 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a980c8550 con 0x7f9a98160680 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.767+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a98157640 con 0x7f9a98160680 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.771+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9804e4a0 con 0x7f9a98160680 2023-11-04T01:48:30.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.771+0000 7f9a8e7fc640 1 -- 172.21.15.2:0/2397592120 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a940b4390 con 0x7f9a98160680 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.771+0000 7f9a8e7fc640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a7c0664a0 0x7f9a7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.771+0000 7f9a8e7fc640 1 -- 172.21.15.2:0/2397592120 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f9a9411f150 con 0x7f9a98160680 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.771+0000 7f9a9dcef640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a7c0664a0 0x7f9a7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:30.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.771+0000 7f9a9dcef640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a7c0664a0 0x7f9a7c068960 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009ae0 tx=0x7f9a88008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:30.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.775+0000 7f9a8e7fc640 1 -- 172.21.15.2:0/2397592120 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9a940ebf00 con 0x7f9a98160680 2023-11-04T01:48:30.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.967+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a980c8a00 con 0x7f9a98160680 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.967+0000 7f9a8e7fc640 1 -- 172.21.15.2:0/2397592120 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f9a940ab640 con 0x7f9a98160680 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:22.665194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:30.972 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 94 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a7c0664a0 msgr2=0x7f9a7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a7c0664a0 0x7f9a7c068960 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009ae0 tx=0x7f9a88008040 comp rx=0 tx=0).stop 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160680 msgr2=0x7f9a980c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160680 0x7f9a980c8d50 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9a940ad040 tx=0x7f9a94019220 comp rx=0 tx=0).stop 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 shutdown_connections 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9a7c0664a0 0x7f9a7c068960 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9a98160a60 0x7f9a980ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a98160680 0x7f9a980c8d50 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 --2- 172.21.15.2:0/2397592120 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9a980b3e30 0x7f9a980c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 >> 172.21.15.2:0/2397592120 conn(0x7f9a980d2f90 msgr2=0x7f9a9815e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 shutdown_connections 2023-11-04T01:48:30.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:30.971+0000 7f9a9ff53640 1 -- 172.21.15.2:0/2397592120 wait complete. 2023-11-04T01:48:30.992 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump snaps --server 2023-11-04T01:48:31.121 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":10,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:48:31.121 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 10, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [] } 2023-11-04T01:48:31.121 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:48:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a9ed9640 1 Processor -- start 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a9ed9640 1 -- start start 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a9ed9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a40cabd0 0x7fb2a40cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a9ed9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2a40af2d0 0x7fb2a40af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a9ed9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a406fe50 con 0x7fb2a41556c0 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a9ed9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a40cb590 con 0x7fb2a40af2d0 2023-11-04T01:48:31.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a9ed9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40ae7f0 con 0x7fb2a40cabd0 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a3fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2a40af2d0 0x7fb2a40af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a37fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb2a41556c0 0x7fb2a415c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:41746/0 (socket says 172.21.15.2:41746) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a2ffd640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a40cabd0 0x7fb2a40cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.247+0000 7fb2a37fe640 1 -- 172.21.15.2:0/493349094 learned_addr learned my addr 172.21.15.2:0/493349094 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a27fc640 1 -- 172.21.15.2:0/493349094 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440121755 0 0) 0x7fb2a406fe50 con 0x7fb2a41556c0 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a27fc640 1 -- 172.21.15.2:0/493349094 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb28c003530 con 0x7fb2a41556c0 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a3fff640 1 -- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a40cabd0 msgr2=0x7fb2a40cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a3fff640 1 --2- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a40cabd0 0x7fb2a40cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a3fff640 1 -- 172.21.15.2:0/493349094 >> v1:172.21.15.90:6789/0 conn(0x7fb2a41556c0 legacy=0x7fb2a415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a3fff640 1 -- 172.21.15.2:0/493349094 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40aead0 con 0x7fb2a40af2d0 2023-11-04T01:48:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a40cabd0 0x7fb2a40cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:48:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a3fff640 1 --2- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 0x7fb2a40af760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0097c0 tx=0x7fb29c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7456e13e16884e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a27fc640 1 -- 172.21.15.2:0/493349094 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0ab5f0 con 0x7fb2a40af2d0 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a27fc640 1 -- 172.21.15.2:0/493349094 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c0ab750 con 0x7fb2a40af2d0 2023-11-04T01:48:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.251+0000 7fb2a27fc640 1 -- 172.21.15.2:0/493349094 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0abac0 con 0x7fb2a40af2d0 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 msgr2=0x7fb2a40af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 0x7fb2a40af760 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0097c0 tx=0x7fb29c01c450 comp rx=0 tx=0).stop 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/493349094 shutdown_connections 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 0x7fb2a40af760 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/493349094 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a40cabd0 0x7fb2a40cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/493349094 >> 172.21.15.2:0/493349094 conn(0x7fb2a40ced10 msgr2=0x7fb2a40cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/493349094 shutdown_connections 2023-11-04T01:48:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/493349094 wait complete. 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 Processor -- start 2023-11-04T01:48:31.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- start start 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 0x7fb2a414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cabd0 0x7fb2a4152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a41556c0 0x7fb2a40c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a414d920 con 0x7fb2a40cabd0 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4149070 con 0x7fb2a40af2d0 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4148460 con 0x7fb2a41556c0 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cabd0 0x7fb2a4152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cabd0 0x7fb2a4152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40730/0 (socket says 172.21.15.2:40730) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/1176870921 learned_addr learned my addr 172.21.15.2:0/1176870921 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:31.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a3fff640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a41556c0 0x7fb2a40c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a37fe640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 0x7fb2a414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a41556c0 msgr2=0x7fb2a40c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a41556c0 0x7fb2a40c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 msgr2=0x7fb2a414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 0x7fb2a414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/1176870921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298009420 con 0x7fb2a40cabd0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cabd0 0x7fb2a4152810 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fb29800e980 tx=0x7fb29800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb28bfff640 1 -- 172.21.15.2:0/1176870921 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29800ca00 con 0x7fb2a40cabd0 2023-11-04T01:48:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb28bfff640 1 -- 172.21.15.2:0/1176870921 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29800cb60 con 0x7fb2a40cabd0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c009420 con 0x7fb2a40cabd0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb28bfff640 1 -- 172.21.15.2:0/1176870921 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb298013470 con 0x7fb2a40cabd0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.255+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a4148a20 con 0x7fb2a40cabd0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.259+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a404e4a0 con 0x7fb2a40cabd0 2023-11-04T01:48:31.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.259+0000 7fb28bfff640 1 -- 172.21.15.2:0/1176870921 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb2980135d0 con 0x7fb2a40cabd0 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.259+0000 7fb28bfff640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2900664a0 0x7fb290068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.259+0000 7fb28bfff640 1 -- 172.21.15.2:0/1176870921 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7fb298084820 con 0x7fb2a40cabd0 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.259+0000 7fb2a37fe640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2900664a0 0x7fb290068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.259+0000 7fb2a37fe640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2900664a0 0x7fb290068960 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb294005c10 tx=0x7fb294009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:31.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.263+0000 7fb28bfff640 1 -- 172.21.15.2:0/1176870921 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb2980515d0 con 0x7fb2a40cabd0 2023-11-04T01:48:31.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.475+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7fb2a40b3f30 con 0x7fb2a40cabd0 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.699+0000 7fb28bfff640 1 -- 172.21.15.2:0/1176870921 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7815 v95) v1 ==== 112+0+0 (secure 0 0 0) 0x7fb298054bf0 con 0x7fb2a40cabd0 2023-11-04T01:48:31.703 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.7815 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2900664a0 msgr2=0x7fb290068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2900664a0 0x7fb290068960 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb294005c10 tx=0x7fb294009040 comp rx=0 tx=0).stop 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cabd0 msgr2=0x7fb2a4152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cabd0 0x7fb2a4152810 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fb29800e980 tx=0x7fb29800ee40 comp rx=0 tx=0).stop 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 shutdown_connections 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb2900664a0 0x7fb290068960 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb2a41556c0 0x7fb2a40c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cabd0 0x7fb2a4152810 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 --2- 172.21.15.2:0/1176870921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a40af2d0 0x7fb2a414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 >> 172.21.15.2:0/1176870921 conn(0x7fb2a40ced10 msgr2=0x7fb2a40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 shutdown_connections 2023-11-04T01:48:31.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.703+0000 7fb2a9ed9640 1 -- 172.21.15.2:0/1176870921 wait complete. 2023-11-04T01:48:31.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.851+0000 7f05b6961640 1 Processor -- start 2023-11-04T01:48:31.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.851+0000 7f05b6961640 1 -- start start 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.851+0000 7f05b6961640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b0159720 0x7f05b00c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.851+0000 7f05b6961640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05b00cf830 0x7f05b00af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05b6961640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b00afa90 con 0x7f05b00af640 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05b6961640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00ca5a0 con 0x7f05b00cf830 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05b6961640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00c9d40 con 0x7f05b0159720 2023-11-04T01:48:31.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05b00cf830 0x7f05b00af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05b00cf830 0x7f05b00af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41976/0 (socket says 172.21.15.2:41976) 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05b4efe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f05b00af640 0x7f05b00cc8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36084/0 (socket says 172.21.15.2:36084) 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 -- 172.21.15.2:0/2285775273 learned_addr learned my addr 172.21.15.2:0/2285775273 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05affff640 1 --2- 172.21.15.2:0/2285775273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b0159720 0x7f05b00c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 -- 172.21.15.2:0/2285775273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b0159720 msgr2=0x7f05b00c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 --2- 172.21.15.2:0/2285775273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b0159720 0x7f05b00c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 -- 172.21.15.2:0/2285775273 >> v1:172.21.15.2:6789/0 conn(0x7f05b00af640 legacy=0x7f05b00cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05af7fe640 1 -- 172.21.15.2:0/2285775273 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704342012 0 0) 0x7f05a80014a0 con 0x7f05b00af640 2023-11-04T01:48:31.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 -- 172.21.15.2:0/2285775273 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00c9fe0 con 0x7f05b00cf830 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05a77fe640 1 --2- 172.21.15.2:0/2285775273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b00cf830 0x7f05b00af100 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f059800bb10 tx=0x7f059801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73aee9e3f241cbd server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05af7fe640 1 -- 172.21.15.2:0/2285775273 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980a7ba0 con 0x7f05b00cf830 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05af7fe640 1 -- 172.21.15.2:0/2285775273 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980a7d00 con 0x7f05b00cf830 2023-11-04T01:48:31.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.855+0000 7f05af7fe640 1 -- 172.21.15.2:0/2285775273 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980af660 con 0x7f05b00cf830 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- 172.21.15.2:0/2285775273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b00cf830 msgr2=0x7f05b00af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 --2- 172.21.15.2:0/2285775273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b00cf830 0x7f05b00af100 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f059800bb10 tx=0x7f059801eb50 comp rx=0 tx=0).stop 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- 172.21.15.2:0/2285775273 shutdown_connections 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 --2- 172.21.15.2:0/2285775273 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b00cf830 0x7f05b00af100 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 --2- 172.21.15.2:0/2285775273 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b0159720 0x7f05b00c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- 172.21.15.2:0/2285775273 >> 172.21.15.2:0/2285775273 conn(0x7f05b00ced10 msgr2=0x7f05b00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- 172.21.15.2:0/2285775273 shutdown_connections 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- 172.21.15.2:0/2285775273 wait complete. 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 Processor -- start 2023-11-04T01:48:31.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- start start 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05b00af640 0x7f05b0148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b00cf830 0x7f05b014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b0159720 0x7f05b014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b014e340 con 0x7f05b0159720 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b014e060 con 0x7f05b00af640 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0159ed0 con 0x7f05b00cf830 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b0159720 0x7f05b014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b0159720 0x7f05b014eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41978/0 (socket says 172.21.15.2:41978) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 -- 172.21.15.2:0/186773315 learned_addr learned my addr 172.21.15.2:0/186773315 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05a77fe640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b00cf830 0x7f05b014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05affff640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05b00af640 0x7f05b0148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 -- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b00cf830 msgr2=0x7f05b014e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b00cf830 0x7f05b014e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 -- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05b00af640 msgr2=0x7f05b0148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05b00af640 0x7f05b0148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:31.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 -- 172.21.15.2:0/186773315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059800b770 con 0x7f05b0159720 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05a77fe640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b00cf830 0x7f05b014e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05affff640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05b00af640 0x7f05b0148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b4efe640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b0159720 0x7f05b014eb50 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c780 tx=0x7f05a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05ad7fa640 1 -- 172.21.15.2:0/186773315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800ce90 con 0x7f05b0159720 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05ad7fa640 1 -- 172.21.15.2:0/186773315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800a640 con 0x7f05b0159720 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b015a1b0 con 0x7f05b0159720 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05ad7fa640 1 -- 172.21.15.2:0/186773315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800a9d0 con 0x7f05b0159720 2023-11-04T01:48:31.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.859+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b0148bc0 con 0x7f05b0159720 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.863+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b015a6d0 con 0x7f05b0159720 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.863+0000 7f05ad7fa640 1 -- 172.21.15.2:0/186773315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f05a800ab30 con 0x7f05b0159720 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.863+0000 7f05ad7fa640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05900664a0 0x7f0590068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:31.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.863+0000 7f05ad7fa640 1 -- 172.21.15.2:0/186773315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f05a8083b80 con 0x7f05b0159720 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.863+0000 7f05affff640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05900664a0 0x7f0590068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:31.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.863+0000 7f05affff640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05900664a0 0x7f0590068960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009840 tx=0x7f05a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:31.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:31.867+0000 7f05ad7fa640 1 -- 172.21.15.2:0/186773315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f05b015a6d0 con 0x7f05b0159720 2023-11-04T01:48:32.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.075+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f05b014e480 con 0x7f05b0159720 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.703+0000 7f05ad7fa640 1 -- 172.21.15.2:0/186773315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.5930 v96) v1 ==== 112+0+0 (secure 0 0 0) 0x7f05a80180a0 con 0x7f05b0159720 2023-11-04T01:48:32.706 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.5930 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05900664a0 msgr2=0x7f0590068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05900664a0 0x7f0590068960 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009840 tx=0x7f05a0008040 comp rx=0 tx=0).stop 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b0159720 msgr2=0x7f05b014eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b0159720 0x7f05b014eb50 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c780 tx=0x7f05a800cc40 comp rx=0 tx=0).stop 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 shutdown_connections 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f05900664a0 0x7f0590068960 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05b0159720 0x7f05b014eb50 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:32.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f05b00cf830 0x7f05b014e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 --2- 172.21.15.2:0/186773315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05b00af640 0x7f05b0148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 >> 172.21.15.2:0/186773315 conn(0x7f05b00ced10 msgr2=0x7f05b006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 shutdown_connections 2023-11-04T01:48:32.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:32.707+0000 7f05b6961640 1 -- 172.21.15.2:0/186773315 wait complete. 2023-11-04T01:48:32.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_kill_mdstable_at 5 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_kill_mdstable_at = '5' (not observed, change may require restart) "} 2023-11-04T01:48:32.874 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '5' (not observed, change may require restart) " } 2023-11-04T01:48:32.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:32.874 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s25) 2023-11-04T01:48:32.877 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:48:32.898 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f9ceefed640 time 2023-11-04T01:48:32.899460+0000 2023-11-04T01:48:32.898 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9cf5119fae] 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.899 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:48:32.895+0000 7f9ceefed640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f9ceefed640 time 2023-11-04T01:48:32.899460+0000 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9cf5119fae] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.900 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:48:32.901 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f9ceefed640 thread_name:ms_dispatch 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9cf4a54520] 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9cf511a008] 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.902 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:48:32.895+0000 7f9ceefed640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f9ceefed640 thread_name:ms_dispatch 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9cf4a54520] 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:48:32.903 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9cf511a008] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:48:32.904 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.906 INFO:tasks.ceph.mds.c.smithi002.stderr: -1080> 2023-11-04T01:48:23.903+0000 7f9cec7e8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:48:32.906 INFO:tasks.ceph.mds.c.smithi002.stderr: -1078> 2023-11-04T01:48:23.903+0000 7f9cec7e8640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr: -1> 2023-11-04T01:48:32.895+0000 7f9ceefed640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f9ceefed640 time 2023-11-04T01:48:32.899460+0000 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9cf5119fae] 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.908 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 0> 2023-11-04T01:48:32.895+0000 7f9ceefed640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f9ceefed640 thread_name:ms_dispatch 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.909 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9cf4a54520] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9cf511a008] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.910 INFO:tasks.ceph.mds.c.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.911 INFO:tasks.ceph.mds.c.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.911 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:48:32.911 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.913 INFO:tasks.ceph.mds.c.smithi002.stderr: -1080> 2023-11-04T01:48:23.903+0000 7f9cec7e8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:48:32.913 INFO:tasks.ceph.mds.c.smithi002.stderr: -1078> 2023-11-04T01:48:23.903+0000 7f9cec7e8640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:48:32.914 INFO:tasks.ceph.mds.c.smithi002.stderr: -1> 2023-11-04T01:48:32.895+0000 7f9ceefed640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::handle_commit(ceph::cref_t&)' thread 7f9ceefed640 time 2023-11-04T01:48:32.899460+0000 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr:./src/mds/MDSTableServer.cc: 145: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 5) 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9cf5119fae] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.915 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 0> 2023-11-04T01:48:32.895+0000 7f9ceefed640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: in thread 7f9ceefed640 thread_name:ms_dispatch 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9cf4a54520] 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 3: raise() 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 4: abort() 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9cf511a008] 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f9cf511a162] 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 7: (MDSTableServer::handle_commit(boost::intrusive_ptr const&)+0x7ad) [0x55ae65bca16d] 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xe9) [0x55ae6595c969] 2023-11-04T01:48:32.916 INFO:tasks.ceph.mds.c.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x55ae6595e9eb] 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae6595eebc] 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x55ae659497f5] 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f9cf5305f2a] 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f9cf53987f1] 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f9cf4aa6b43] 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f9cf4b38a00] 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:48:32.917 INFO:tasks.ceph.mds.c.smithi002.stderr: 2023-11-04T01:48:33.029 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:48:33.029 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:48:33.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7239d640 1 Processor -- start 2023-11-04T01:48:33.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7239d640 1 -- start start 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7239d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 0x7f3c6c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7239d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3c6c15d840 0x7f3c6c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7239d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c0ca010 con 0x7f3c6c0caf00 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7239d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c0cd7b0 con 0x7f3c6c15d840 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7239d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0ca260 con 0x7f3c6c153ae0 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c6c0caf00 0x7f3c6c15d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36098/0 (socket says 172.21.15.2:36098) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6b7fe640 1 -- 172.21.15.2:0/2741297781 learned_addr learned my addr 172.21.15.2:0/2741297781 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 0x7f3c6c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7093a640 1 --2- 172.21.15.2:0/2741297781 >> v2:172.21.15.90:3300/0 conn(0x7f3c6c15d840 0x7f3c6c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614929067 0 0) 0x7f3c6c0ca010 con 0x7f3c6c0caf00 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c58003510 con 0x7f3c6c0caf00 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501469764 0 0) 0x7f3c58003510 con 0x7f3c6c0caf00 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 msgr2=0x7f3c6c0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:33.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 0x7f3c6c0cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 >> v2:172.21.15.90:3300/0 conn(0x7f3c6c15d840 msgr2=0x7f3c6c06bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 --2- 172.21.15.2:0/2741297781 >> v2:172.21.15.90:3300/0 conn(0x7f3c6c15d840 0x7f3c6c06bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0ca540 con 0x7f3c6c0caf00 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3c54001a00 con 0x7f3c6c0caf00 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 >> v1:172.21.15.2:6789/0 conn(0x7f3c6c0caf00 legacy=0x7f3c6c15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c58004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 0x7f3c58003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c58003ce0 0x7f3c58004140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0cd7b0 con 0x7f3c58004b40 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c58004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0ca260 con 0x7f3c58003ce0 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5800b8d0 con 0x7f3c6c153ae0 2023-11-04T01:48:33.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c6b7fe640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 0x7f3c58003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.187+0000 7f3c7093a640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c58003ce0 0x7f3c58004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6bfff640 1 -- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 msgr2=0x7f3c58003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 0x7f3c58003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6bfff640 1 -- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c58003ce0 msgr2=0x7f3c58004140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c58003ce0 0x7f3c58004140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6bfff640 1 -- 172.21.15.2:0/2741297781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c58003510 con 0x7f3c58004b40 2023-11-04T01:48:33.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6b7fe640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c153ae0 0x7f3c58003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c58004f60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00a9c0 tx=0x7f3c5c01cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c856d6a65907560 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0a5b50 con 0x7f3c58004b40 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c0a9070 con 0x7f3c58004b40 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c6affd640 1 -- 172.21.15.2:0/2741297781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0af400 con 0x7f3c58004b40 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c7239d640 1 -- 172.21.15.2:0/2741297781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 msgr2=0x7f3c58004f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c7239d640 1 --2- 172.21.15.2:0/2741297781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c58004f60 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c00a9c0 tx=0x7f3c5c01cde0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c7093a640 1 -- 172.21.15.2:0/2741297781 reap_dead start 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c7239d640 1 -- 172.21.15.2:0/2741297781 shutdown_connections 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c7239d640 1 -- 172.21.15.2:0/2741297781 >> 172.21.15.2:0/2741297781 conn(0x7f3c6c0b0890 msgr2=0x7f3c6c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c7239d640 1 -- 172.21.15.2:0/2741297781 shutdown_connections 2023-11-04T01:48:33.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.191+0000 7f3c7239d640 1 -- 172.21.15.2:0/2741297781 wait complete. 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 Processor -- start 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 -- start start 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c6c1f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c6c13f0d0 0x7f3c6c141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c144cb0 0x7f3c6c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0b3e90 con 0x7f3c58004b40 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1f1f70 con 0x7f3c6c13f0d0 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0c7850 con 0x7f3c6c144cb0 2023-11-04T01:48:33.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c6c1f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c6c1f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41996/0 (socket says 172.21.15.2:41996) 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 -- 172.21.15.2:0/3293861940 learned_addr learned my addr 172.21.15.2:0/3293861940 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7093a640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c144cb0 0x7f3c6c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6b7fe640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c6c13f0d0 0x7f3c6c141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 -- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c144cb0 msgr2=0x7f3c6c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c144cb0 0x7f3c6c157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 -- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c6c13f0d0 msgr2=0x7f3c6c141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c6c13f0d0 0x7f3c6c141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 -- 172.21.15.2:0/3293861940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c1420b0 con 0x7f3c58004b40 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7093a640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c144cb0 0x7f3c6c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6b7fe640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c6c13f0d0 0x7f3c6c141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c6bfff640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c6c1f1a30 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c01cc10 tx=0x7f3c5c019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:33.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c68ff9640 1 -- 172.21.15.2:0/3293861940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0a6d60 con 0x7f3c58004b40 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c68ff9640 1 -- 172.21.15.2:0/3293861940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c0a6ec0 con 0x7f3c58004b40 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c0b4080 con 0x7f3c58004b40 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c68ff9640 1 -- 172.21.15.2:0/3293861940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0ba690 con 0x7f3c58004b40 2023-11-04T01:48:33.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c0c74e0 con 0x7f3c58004b40 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c0c7340 con 0x7f3c58004b40 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.195+0000 7f3c68ff9640 1 -- 172.21.15.2:0/3293861940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c5c0ba7f0 con 0x7f3c58004b40 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.199+0000 7f3c68ff9640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c4c0664a0 0x7f3c4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.199+0000 7f3c68ff9640 1 -- 172.21.15.2:0/3293861940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f3c5c11f6d0 con 0x7f3c58004b40 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.199+0000 7f3c6b7fe640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c4c0664a0 0x7f3c4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:33.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.199+0000 7f3c6b7fe640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c4c0664a0 0x7f3c4c068960 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3c54002240 tx=0x7f3c54001260 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.203+0000 7f3c68ff9640 1 -- 172.21.15.2:0/3293861940 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c6c0c7340 con 0x7f3c58004b40 2023-11-04T01:48:33.235 INFO:tasks.ceph.mds.c.smithi002.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:48:33.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c6c0c7340 con 0x7f3c58004b40 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c68ff9640 1 -- 172.21.15.2:0/3293861940 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f3c6c0c7340 con 0x7f3c58004b40 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:32.082248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:33.395 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 96 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c4c0664a0 msgr2=0x7f3c4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c4c0664a0 0x7f3c4c068960 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3c54002240 tx=0x7f3c54001260 comp rx=0 tx=0).stop 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 msgr2=0x7f3c6c1f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c6c1f1a30 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c01cc10 tx=0x7f3c5c019b80 comp rx=0 tx=0).stop 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 shutdown_connections 2023-11-04T01:48:33.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c4c0664a0 0x7f3c4c068960 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c6c144cb0 0x7f3c6c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c6c13f0d0 0x7f3c6c141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 --2- 172.21.15.2:0/3293861940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c58004b40 0x7f3c6c1f1a30 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 >> 172.21.15.2:0/3293861940 conn(0x7f3c6c0b0890 msgr2=0x7f3c6c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 shutdown_connections 2023-11-04T01:48:33.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:33.391+0000 7f3c7239d640 1 -- 172.21.15.2:0/3293861940 wait complete. 2023-11-04T01:48:33.415 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:35.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:48:38.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:38.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe950948640 1 Processor -- start 2023-11-04T01:48:38.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe950948640 1 -- start start 2023-11-04T01:48:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe950948640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe94c0c92b0 0x7fe94c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe950948640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c0c9ac0 con 0x7fe94c06bde0 2023-11-04T01:48:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe950948640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c0caf20 con 0x7fe94c06c1c0 2023-11-04T01:48:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe950948640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c0c97e0 con 0x7fe94c0c92b0 2023-11-04T01:48:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe94c06bde0 0x7fe94c15c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36110/0 (socket says 172.21.15.2:36110) 2023-11-04T01:48:38.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94a59c640 1 -- 172.21.15.2:0/4016042221 learned_addr learned my addr 172.21.15.2:0/4016042221 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081244863 0 0) 0x7fe94c0c9ac0 con 0x7fe94c06bde0 2023-11-04T01:48:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe949d9b640 1 --2- 172.21.15.2:0/4016042221 >> v2:172.21.15.90:3300/0 conn(0x7fe94c0c92b0 0x7fe94c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe938003530 con 0x7fe94c06bde0 2023-11-04T01:48:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3043512219 0 0) 0x7fe938003530 con 0x7fe94c06bde0 2023-11-04T01:48:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 >> v2:172.21.15.90:3300/0 conn(0x7fe94c0c92b0 msgr2=0x7fe94c0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 --2- 172.21.15.2:0/4016042221 >> v2:172.21.15.90:3300/0 conn(0x7fe94c0c92b0 0x7fe94c0cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 >> v1:172.21.15.90:6789/0 conn(0x7fe94c06c1c0 legacy=0x7fe94c1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0cb1c0 con 0x7fe94c06bde0 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fe93c001680 con 0x7fe94c06bde0 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 >> v1:172.21.15.2:6789/0 conn(0x7fe94c06bde0 legacy=0x7fe94c15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe938003980 0x7fe938003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe9380047d0 0x7fe938004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe938005190 0x7fe93800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0c97e0 con 0x7fe938005190 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93800c030 con 0x7fe938003980 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93800c1f0 con 0x7fe9380047d0 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94ad9d640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe938005190 0x7fe93800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94a59c640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe938003980 0x7fe938003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe949d9b640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe9380047d0 0x7fe938004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94ad9d640 1 -- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe9380047d0 msgr2=0x7fe938004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94ad9d640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe9380047d0 0x7fe938004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94ad9d640 1 -- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe938003980 msgr2=0x7fe938003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94ad9d640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe938003980 0x7fe938003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94ad9d640 1 -- 172.21.15.2:0/4016042221 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938003530 con 0x7fe938005190 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe949d9b640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe9380047d0 0x7fe938004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:38.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.547+0000 7fe94a59c640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe938003980 0x7fe938003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe94ad9d640 1 -- 172.21.15.2:0/4016042221 reap_dead start 2023-11-04T01:48:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe94ad9d640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe938005190 0x7fe93800b990 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fe944001e70 tx=0x7fe94401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8887ff730fbe4f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944003b80 con 0x7fe938005190 2023-11-04T01:48:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944003d20 con 0x7fe938005190 2023-11-04T01:48:38.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe94959a640 1 -- 172.21.15.2:0/4016042221 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944005260 con 0x7fe938005190 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- 172.21.15.2:0/4016042221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe938005190 msgr2=0x7fe93800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe938005190 0x7fe93800b990 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fe944001e70 tx=0x7fe94401c760 comp rx=0 tx=0).stop 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- 172.21.15.2:0/4016042221 shutdown_connections 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 --2- 172.21.15.2:0/4016042221 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe938005190 0x7fe93800b990 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- 172.21.15.2:0/4016042221 >> 172.21.15.2:0/4016042221 conn(0x7fe94c0b0890 msgr2=0x7fe94c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- 172.21.15.2:0/4016042221 shutdown_connections 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- 172.21.15.2:0/4016042221 wait complete. 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 Processor -- start 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- start start 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe938005190 0x7fe94c141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0b4290 0x7fe94c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cf3c0 0x7fe94c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0cf840 con 0x7fe94c0b4290 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0ae8b0 con 0x7fe94c0cf3c0 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe950948640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c140da0 con 0x7fe938005190 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe949d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0b4290 0x7fe94c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe949d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0b4290 0x7fe94c0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42020/0 (socket says 172.21.15.2:42020) 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.551+0000 7fe949d9b640 1 -- 172.21.15.2:0/904721566 learned_addr learned my addr 172.21.15.2:0/904721566 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe94ad9d640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cf3c0 0x7fe94c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe94a59c640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe938005190 0x7fe94c141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe949d9b640 1 -- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe938005190 msgr2=0x7fe94c141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe949d9b640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe938005190 0x7fe94c141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe949d9b640 1 -- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cf3c0 msgr2=0x7fe94c0adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:38.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe949d9b640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cf3c0 0x7fe94c0adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe949d9b640 1 -- 172.21.15.2:0/904721566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c141080 con 0x7fe94c0b4290 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe94a59c640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe938005190 0x7fe94c141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe949d9b640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0b4290 0x7fe94c0cee80 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe9340108d0 tx=0x7fe934010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe942ffd640 1 -- 172.21.15.2:0/904721566 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934004220 con 0x7fe94c0b4290 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe942ffd640 1 -- 172.21.15.2:0/904721566 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934004380 con 0x7fe94c0b4290 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c141360 con 0x7fe94c0b4290 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe942ffd640 1 -- 172.21.15.2:0/904721566 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400eba0 con 0x7fe94c0b4290 2023-11-04T01:48:38.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c0b46f0 con 0x7fe94c0b4290 2023-11-04T01:48:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c04e4a0 con 0x7fe94c0b4290 2023-11-04T01:48:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe942ffd640 1 -- 172.21.15.2:0/904721566 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe93400ed00 con 0x7fe94c0b4290 2023-11-04T01:48:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe942ffd640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe92c0664a0 0x7fe92c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe942ffd640 1 -- 172.21.15.2:0/904721566 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7fe934084540 con 0x7fe94c0b4290 2023-11-04T01:48:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe94a59c640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe92c0664a0 0x7fe92c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:38.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.555+0000 7fe94a59c640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe92c0664a0 0x7fe92c068960 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001ec0 tx=0x7fe93c000f20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.559+0000 7fe942ffd640 1 -- 172.21.15.2:0/904721566 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe9340512f0 con 0x7fe94c0b4290 2023-11-04T01:48:38.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe94c06cf10 con 0x7fe94c0b4290 2023-11-04T01:48:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe942ffd640 1 -- 172.21.15.2:0/904721566 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4923 (secure 0 0 0) 0x7fe934054910 con 0x7fe94c0b4290 2023-11-04T01:48:38.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:38.755 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:32.082248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:38.755 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 96 2023-11-04T01:48:38.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe92c0664a0 msgr2=0x7fe92c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:38.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe92c0664a0 0x7fe92c068960 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe93c001ec0 tx=0x7fe93c000f20 comp rx=0 tx=0).stop 2023-11-04T01:48:38.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0b4290 msgr2=0x7fe94c0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:38.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0b4290 0x7fe94c0cee80 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe9340108d0 tx=0x7fe934010d90 comp rx=0 tx=0).stop 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 shutdown_connections 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe92c0664a0 0x7fe92c068960 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe94c0cf3c0 0x7fe94c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe94c0b4290 0x7fe94c0cee80 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 --2- 172.21.15.2:0/904721566 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe938005190 0x7fe94c141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 >> 172.21.15.2:0/904721566 conn(0x7fe94c0b0890 msgr2=0x7fe94c15df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 shutdown_connections 2023-11-04T01:48:38.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:38.751+0000 7fe950948640 1 -- 172.21.15.2:0/904721566 wait complete. 2023-11-04T01:48:38.772 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:42.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-11-04T01:48:43.773 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.903+0000 7f183f9b8640 1 Processor -- start 2023-11-04T01:48:43.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.903+0000 7f183f9b8640 1 -- start start 2023-11-04T01:48:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183f9b8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1838142eb0 0x7f183815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183f9b8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18380cbd80 0x7f18380cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183f9b8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18380ca100 con 0x7f1838142ad0 2023-11-04T01:48:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183f9b8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380ca3e0 con 0x7f1838142eb0 2023-11-04T01:48:43.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183f9b8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18380ca6c0 con 0x7f18380cbd80 2023-11-04T01:48:43.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183d754640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1838142ad0 0x7f18380cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:53780/0 (socket says 172.21.15.2:53780) 2023-11-04T01:48:43.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183d754640 1 -- 172.21.15.2:0/2764722426 learned_addr learned my addr 172.21.15.2:0/2764722426 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183df55640 1 --2- 172.21.15.2:0/2764722426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18380cbd80 0x7f18380cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183cf53640 1 --2- 172.21.15.2:0/2764722426 >> v2:172.21.15.90:3300/0 conn(0x7f1838142eb0 0x7f183815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f182ffff640 1 -- 172.21.15.2:0/2764722426 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071861778 0 0) 0x7f18380ca100 con 0x7f1838142ad0 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f182ffff640 1 -- 172.21.15.2:0/2764722426 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1824003530 con 0x7f1838142ad0 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183df55640 1 -- 172.21.15.2:0/2764722426 >> v2:172.21.15.90:3300/0 conn(0x7f1838142eb0 msgr2=0x7f183815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183df55640 1 --2- 172.21.15.2:0/2764722426 >> v2:172.21.15.90:3300/0 conn(0x7f1838142eb0 0x7f183815e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183df55640 1 -- 172.21.15.2:0/2764722426 >> v1:172.21.15.90:6789/0 conn(0x7f1838142ad0 legacy=0x7f18380cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:43.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.907+0000 7f183df55640 1 -- 172.21.15.2:0/2764722426 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380ca9a0 con 0x7f18380cbd80 2023-11-04T01:48:43.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183df55640 1 --2- 172.21.15.2:0/2764722426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18380cbd80 0x7f18380cc830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18300097c0 tx=0x7f183001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e948c149ad7a65 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f182ffff640 1 -- 172.21.15.2:0/2764722426 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300ab610 con 0x7f18380cbd80 2023-11-04T01:48:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f182ffff640 1 -- 172.21.15.2:0/2764722426 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18300ab770 con 0x7f18380cbd80 2023-11-04T01:48:43.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f182ffff640 1 -- 172.21.15.2:0/2764722426 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300abb00 con 0x7f18380cbd80 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- 172.21.15.2:0/2764722426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18380cbd80 msgr2=0x7f18380cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 --2- 172.21.15.2:0/2764722426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18380cbd80 0x7f18380cc830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f18300097c0 tx=0x7f183001c3f0 comp rx=0 tx=0).stop 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- 172.21.15.2:0/2764722426 shutdown_connections 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 --2- 172.21.15.2:0/2764722426 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f18380cbd80 0x7f18380cc830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 --2- 172.21.15.2:0/2764722426 >> v2:172.21.15.90:3300/0 conn(0x7f1838142eb0 0x7f183815e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- 172.21.15.2:0/2764722426 >> 172.21.15.2:0/2764722426 conn(0x7f18380b0890 msgr2=0x7f18380b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- 172.21.15.2:0/2764722426 shutdown_connections 2023-11-04T01:48:43.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- 172.21.15.2:0/2764722426 wait complete. 2023-11-04T01:48:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 Processor -- start 2023-11-04T01:48:43.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- start start 2023-11-04T01:48:43.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18380cbd80 0x7f1838159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1838142ad0 0x7f183806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1838142eb0 0x7f18380700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1838141530 con 0x7f18380cbd80 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1838140920 con 0x7f1838142eb0 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183f9b8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838140c00 con 0x7f1838142ad0 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18380cbd80 0x7f1838159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18380cbd80 0x7f1838159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47276/0 (socket says 172.21.15.2:47276) 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 -- 172.21.15.2:0/3028596282 learned_addr learned my addr 172.21.15.2:0/3028596282 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183df55640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1838142eb0 0x7f18380700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:43.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183cf53640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1838142ad0 0x7f183806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 -- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1838142ad0 msgr2=0x7f183806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1838142ad0 0x7f183806fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 -- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1838142eb0 msgr2=0x7f18380700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1838142eb0 0x7f18380700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 -- 172.21.15.2:0/3028596282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009420 con 0x7f18380cbd80 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.911+0000 7f183d754640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18380cbd80 0x7f1838159b80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f183400cbc0 tx=0x7f183400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f182dffb640 1 -- 172.21.15.2:0/3028596282 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400ad40 con 0x7f18380cbd80 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f182dffb640 1 -- 172.21.15.2:0/3028596282 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834012400 con 0x7f18380cbd80 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f182dffb640 1 -- 172.21.15.2:0/3028596282 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400aea0 con 0x7f18380cbd80 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1838140ee0 con 0x7f18380cbd80 2023-11-04T01:48:43.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838140560 con 0x7f18380cbd80 2023-11-04T01:48:43.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183813a080 con 0x7f18380cbd80 2023-11-04T01:48:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f182dffb640 1 -- 172.21.15.2:0/3028596282 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1834007070 con 0x7f18380cbd80 2023-11-04T01:48:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f182dffb640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f181c0664a0 0x7f181c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f182dffb640 1 -- 172.21.15.2:0/3028596282 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f18340843f0 con 0x7f18380cbd80 2023-11-04T01:48:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f183cf53640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f181c0664a0 0x7f181c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:43.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.915+0000 7f183cf53640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f181c0664a0 0x7f181c068960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f18380c9210 tx=0x7f1828008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:43.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:43.919+0000 7f182dffb640 1 -- 172.21.15.2:0/3028596282 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18340512e0 con 0x7f18380cbd80 2023-11-04T01:48:44.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.111+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18381f5e40 con 0x7f18380cbd80 2023-11-04T01:48:44.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.111+0000 7f182dffb640 1 -- 172.21.15.2:0/3028596282 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f1834054900 con 0x7f18380cbd80 2023-11-04T01:48:44.117 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:32.082248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:44.117 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 96 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f181c0664a0 msgr2=0x7f181c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f181c0664a0 0x7f181c068960 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f18380c9210 tx=0x7f1828008040 comp rx=0 tx=0).stop 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18380cbd80 msgr2=0x7f1838159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18380cbd80 0x7f1838159b80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f183400cbc0 tx=0x7f183400a430 comp rx=0 tx=0).stop 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 shutdown_connections 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f181c0664a0 0x7f181c068960 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1838142eb0 0x7f18380700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:44.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1838142ad0 0x7f183806fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 --2- 172.21.15.2:0/3028596282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18380cbd80 0x7f1838159b80 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 >> 172.21.15.2:0/3028596282 conn(0x7f18380b0890 msgr2=0x7f183806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 shutdown_connections 2023-11-04T01:48:44.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:44.115+0000 7f183f9b8640 1 -- 172.21.15.2:0/3028596282 wait complete. 2023-11-04T01:48:44.136 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:48.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-11-04T01:48:49.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.267+0000 7f7b75965640 1 Processor -- start 2023-11-04T01:48:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b75965640 1 -- start start 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b75965640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 0x7f7b70160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b75965640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b700cb460 con 0x7f7b700ce8b0 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b75965640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b70161110 con 0x7f7b700cdc70 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b75965640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b701613f0 con 0x7f7b7015d100 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7b700ce8b0 0x7f7b700cd560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55430/0 (socket says 172.21.15.2:55430) 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 -- 172.21.15.2:0/558469761 learned_addr learned my addr 172.21.15.2:0/558469761 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6effd640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 0x7f7b70160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923281019 0 0) 0x7f7b700cb460 con 0x7f7b700ce8b0 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b5c003530 con 0x7f7b700ce8b0 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119276618 0 0) 0x7f7b5c003530 con 0x7f7b700ce8b0 2023-11-04T01:48:49.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 msgr2=0x7f7b70160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 0x7f7b70160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 >> v1:172.21.15.90:6789/0 conn(0x7f7b700cdc70 legacy=0x7f7b700cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b701616d0 con 0x7f7b700ce8b0 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f7b60001a00 con 0x7f7b700ce8b0 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 >> v1:172.21.15.2:6789/0 conn(0x7f7b700ce8b0 legacy=0x7f7b700cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 0x7f7b5c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b5c004d10 0x7f7b5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b701613f0 con 0x7f7b5c003f30 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c00ba70 con 0x7f7b5c004d10 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c00bc30 con 0x7f7b7015d100 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6effd640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 0x7f7b5c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6f7fe640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b5c004d10 0x7f7b5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 -- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 msgr2=0x7f7b5c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b7015d100 0x7f7b5c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 -- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b5c004d10 msgr2=0x7f7b5c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b5c004d10 0x7f7b5c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.271+0000 7f7b6e7fc640 1 -- 172.21.15.2:0/558469761 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c003530 con 0x7f7b5c003f30 2023-11-04T01:48:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b6e7fc640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b5c0047d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000a830 tx=0x7f7b6001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c4c73b86d7d25d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600aa6d0 con 0x7f7b5c003f30 2023-11-04T01:48:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b600aa850 con 0x7f7b5c003f30 2023-11-04T01:48:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b6dffb640 1 -- 172.21.15.2:0/558469761 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600aac00 con 0x7f7b5c003f30 2023-11-04T01:48:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- 172.21.15.2:0/558469761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 msgr2=0x7f7b5c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 --2- 172.21.15.2:0/558469761 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b5c0047d0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000a830 tx=0x7f7b6001faa0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b6f7fe640 1 -- 172.21.15.2:0/558469761 reap_dead start 2023-11-04T01:48:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- 172.21.15.2:0/558469761 shutdown_connections 2023-11-04T01:48:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- 172.21.15.2:0/558469761 >> 172.21.15.2:0/558469761 conn(0x7f7b7006dd80 msgr2=0x7f7b7006e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- 172.21.15.2:0/558469761 shutdown_connections 2023-11-04T01:48:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- 172.21.15.2:0/558469761 wait complete. 2023-11-04T01:48:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 Processor -- start 2023-11-04T01:48:49.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- start start 2023-11-04T01:48:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b7014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b700b4fb0 0x7f7b700aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b700b65d0 0x7f7b700af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7014e710 con 0x7f7b5c003f30 2023-11-04T01:48:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b700b4280 con 0x7f7b700b65d0 2023-11-04T01:48:49.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.275+0000 7f7b75965640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b700b4b20 con 0x7f7b700b4fb0 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b7014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b7014e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47302/0 (socket says 172.21.15.2:47302) 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 -- 172.21.15.2:0/301796576 learned_addr learned my addr 172.21.15.2:0/301796576 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6e7fc640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b700b4fb0 0x7f7b700aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6f7fe640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b700b65d0 0x7f7b700af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 -- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b700b4fb0 msgr2=0x7f7b700aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b700b4fb0 0x7f7b700aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 -- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b700b65d0 msgr2=0x7f7b700af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b700b65d0 0x7f7b700af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 -- 172.21.15.2:0/301796576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70158800 con 0x7f7b5c003f30 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6effd640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b7014e1d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7b58011610 tx=0x7f7b58011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:49.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b67fff640 1 -- 172.21.15.2:0/301796576 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800f8f0 con 0x7f7b5c003f30 2023-11-04T01:48:49.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b67fff640 1 -- 172.21.15.2:0/301796576 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5800fa50 con 0x7f7b5c003f30 2023-11-04T01:48:49.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b700ae020 con 0x7f7b5c003f30 2023-11-04T01:48:49.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b67fff640 1 -- 172.21.15.2:0/301796576 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800fdc0 con 0x7f7b5c003f30 2023-11-04T01:48:49.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b700b47b0 con 0x7f7b5c003f30 2023-11-04T01:48:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7004e4a0 con 0x7f7b5c003f30 2023-11-04T01:48:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b67fff640 1 -- 172.21.15.2:0/301796576 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b58015460 con 0x7f7b5c003f30 2023-11-04T01:48:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b67fff640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b500664a0 0x7f7b50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b67fff640 1 -- 172.21.15.2:0/301796576 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f7b58084e10 con 0x7f7b5c003f30 2023-11-04T01:48:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.279+0000 7f7b6e7fc640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b500664a0 0x7f7b50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:49.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.283+0000 7f7b6e7fc640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b500664a0 0x7f7b50068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7b600b1000 tx=0x7f7b60009050 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:49.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.283+0000 7f7b67fff640 1 -- 172.21.15.2:0/301796576 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b58051ca0 con 0x7f7b5c003f30 2023-11-04T01:48:49.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.475+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b700b6c60 con 0x7f7b5c003f30 2023-11-04T01:48:49.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.475+0000 7f7b67fff640 1 -- 172.21.15.2:0/301796576 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4923 (secure 0 0 0) 0x7f7b58082e60 con 0x7f7b5c003f30 2023-11-04T01:48:49.481 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:49.481 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:32.082248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:49.482 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 96 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b500664a0 msgr2=0x7f7b50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b500664a0 0x7f7b50068960 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7b600b1000 tx=0x7f7b60009050 comp rx=0 tx=0).stop 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 msgr2=0x7f7b7014e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b7014e1d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f7b58011610 tx=0x7f7b58011ad0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 shutdown_connections 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f7b500664a0 0x7f7b50068960 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7b700b65d0 0x7f7b700af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f7b700b4fb0 0x7f7b700aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 --2- 172.21.15.2:0/301796576 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b5c003f30 0x7f7b7014e1d0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 >> 172.21.15.2:0/301796576 conn(0x7f7b7006dd80 msgr2=0x7f7b700d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 shutdown_connections 2023-11-04T01:48:49.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:49.479+0000 7f7b75965640 1 -- 172.21.15.2:0/301796576 wait complete. 2023-11-04T01:48:49.499 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:48:54.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:54.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc483c12640 1 Processor -- start 2023-11-04T01:48:54.638 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc483c12640 1 -- start start 2023-11-04T01:48:54.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc483c12640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc47c142eb0 0x7fc47c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:54.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc483c12640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0ca100 con 0x7fc47c0cbd80 2023-11-04T01:48:54.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc483c12640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c0ca3e0 con 0x7fc47c142ad0 2023-11-04T01:48:54.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc483c12640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0ca6c0 con 0x7fc47c142eb0 2023-11-04T01:48:54.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4821af640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc47c0cbd80 0x7fc47c0c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34472/0 (socket says 172.21.15.2:34472) 2023-11-04T01:48:54.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4821af640 1 -- 172.21.15.2:0/1981713525 learned_addr learned my addr 172.21.15.2:0/1981713525 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:54.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4811ad640 1 --2- 172.21.15.2:0/1981713525 >> v2:172.21.15.90:3300/0 conn(0x7fc47c142eb0 0x7fc47c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:54.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4809ac640 1 -- 172.21.15.2:0/1981713525 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765086120 0 0) 0x7fc47c0ca100 con 0x7fc47c0cbd80 2023-11-04T01:48:54.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4809ac640 1 -- 172.21.15.2:0/1981713525 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc468003530 con 0x7fc47c0cbd80 2023-11-04T01:48:54.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4811ad640 1 -- 172.21.15.2:0/1981713525 >> v1:172.21.15.90:6789/0 conn(0x7fc47c142ad0 legacy=0x7fc47c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:54.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4811ad640 1 -- 172.21.15.2:0/1981713525 >> v1:172.21.15.2:6789/0 conn(0x7fc47c0cbd80 legacy=0x7fc47c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:54.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.635+0000 7fc4811ad640 1 -- 172.21.15.2:0/1981713525 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0ca9a0 con 0x7fc47c142eb0 2023-11-04T01:48:54.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.639+0000 7fc4811ad640 1 --2- 172.21.15.2:0/1981713525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 0x7fc47c15e4e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0097c0 tx=0x7fc46c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ff9456b0c9ccba server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:54.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4809ac640 1 -- 172.21.15.2:0/1981713525 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0ab600 con 0x7fc47c142eb0 2023-11-04T01:48:54.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4809ac640 1 -- 172.21.15.2:0/1981713525 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c0a7050 con 0x7fc47c142eb0 2023-11-04T01:48:54.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4809ac640 1 -- 172.21.15.2:0/1981713525 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0ab960 con 0x7fc47c142eb0 2023-11-04T01:48:54.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- 172.21.15.2:0/1981713525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 msgr2=0x7fc47c15e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:54.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 --2- 172.21.15.2:0/1981713525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 0x7fc47c15e4e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0097c0 tx=0x7fc46c01c3f0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- 172.21.15.2:0/1981713525 shutdown_connections 2023-11-04T01:48:54.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 --2- 172.21.15.2:0/1981713525 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 0x7fc47c15e4e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- 172.21.15.2:0/1981713525 >> 172.21.15.2:0/1981713525 conn(0x7fc47c0b0890 msgr2=0x7fc47c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:54.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- 172.21.15.2:0/1981713525 shutdown_connections 2023-11-04T01:48:54.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- 172.21.15.2:0/1981713525 wait complete. 2023-11-04T01:48:54.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 Processor -- start 2023-11-04T01:48:54.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- start start 2023-11-04T01:48:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c0cbd80 0x7fc47c13dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc47c142ad0 0x7fc47c1401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 0x7fc47c1406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c141b60 con 0x7fc47c0cbd80 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c140c30 con 0x7fc47c142eb0 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc483c12640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c140ee0 con 0x7fc47c142ad0 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c0cbd80 0x7fc47c13dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c0cbd80 0x7fc47c13dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56570/0 (socket says 172.21.15.2:56570) 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 -- 172.21.15.2:0/620760372 learned_addr learned my addr 172.21.15.2:0/620760372 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4811ad640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc47c142ad0 0x7fc47c1401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4821af640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 0x7fc47c1406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 -- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc47c142ad0 msgr2=0x7fc47c1401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc47c142ad0 0x7fc47c1401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 -- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 msgr2=0x7fc47c1406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 0x7fc47c1406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.647+0000 7fc4819ae640 1 -- 172.21.15.2:0/620760372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c009420 con 0x7fc47c0cbd80 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4819ae640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c0cbd80 0x7fc47c13dd10 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c420 tx=0x7fc47800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4727fc640 1 -- 172.21.15.2:0/620760372 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780052d0 con 0x7fc47c0cbd80 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4727fc640 1 -- 172.21.15.2:0/620760372 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc478005430 con 0x7fc47c0cbd80 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c1411c0 con 0x7fc47c0cbd80 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4727fc640 1 -- 172.21.15.2:0/620760372 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478007260 con 0x7fc47c0cbd80 2023-11-04T01:48:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c141780 con 0x7fc47c0cbd80 2023-11-04T01:48:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c141ca0 con 0x7fc47c0cbd80 2023-11-04T01:48:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4727fc640 1 -- 172.21.15.2:0/620760372 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4780073c0 con 0x7fc47c0cbd80 2023-11-04T01:48:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4727fc640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4600664a0 0x7fc460068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4727fc640 1 -- 172.21.15.2:0/620760372 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7fc4780838d0 con 0x7fc47c0cbd80 2023-11-04T01:48:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4811ad640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4600664a0 0x7fc460068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.651+0000 7fc4811ad640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4600664a0 0x7fc460068960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0ad000 tx=0x7fc46c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:54.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.655+0000 7fc4727fc640 1 -- 172.21.15.2:0/620760372 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc47c141ca0 con 0x7fc47c0cbd80 2023-11-04T01:48:54.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc47c141ca0 con 0x7fc47c0cbd80 2023-11-04T01:48:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc4727fc640 1 -- 172.21.15.2:0/620760372 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4971 (secure 0 0 0) 0x7fc478050710 con 0x7fc47c0cbd80 2023-11-04T01:48:54.851 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:54.851 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:49.636232+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:48:49.636232+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:54.851 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 97 2023-11-04T01:48:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4600664a0 msgr2=0x7fc460068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4600664a0 0x7fc460068960 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0ad000 tx=0x7fc46c0a6000 comp rx=0 tx=0).stop 2023-11-04T01:48:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c0cbd80 msgr2=0x7fc47c13dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c0cbd80 0x7fc47c13dd10 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c420 tx=0x7fc47800c8e0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 shutdown_connections 2023-11-04T01:48:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4600664a0 0x7fc460068960 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc47c142eb0 0x7fc47c1406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc47c142ad0 0x7fc47c1401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 --2- 172.21.15.2:0/620760372 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c0cbd80 0x7fc47c13dd10 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 >> 172.21.15.2:0/620760372 conn(0x7fc47c0b0890 msgr2=0x7fc47c0cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 shutdown_connections 2023-11-04T01:48:54.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:54.847+0000 7fc483c12640 1 -- 172.21.15.2:0/620760372 wait complete. 2023-11-04T01:48:54.869 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:48:54.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:48:54.879 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:48:54.880 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:48:54.880 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:48:54.939 INFO:teuthology.orchestra.run.smithi002.stdout:1699062512.56895.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i c', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:48:54.941 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062512.56895.core'] 2023-11-04T01:48:54.941 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062512.56895.core, deleting it 2023-11-04T01:48:54.941 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062512.56895.core 2023-11-04T01:48:55.004 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:55.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a335ff640 1 Processor -- start 2023-11-04T01:48:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a335ff640 1 -- start start 2023-11-04T01:48:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a335ff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c06c780 0x7f4a2c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a335ff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a2c165000 0x7f4a2c165490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a335ff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c06d120 con 0x7f4a2c0c4230 2023-11-04T01:48:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a335ff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c162a20 con 0x7f4a2c165000 2023-11-04T01:48:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a335ff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0b31a0 con 0x7f4a2c06c780 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a31b9c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a2c165000 0x7f4a2c165490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a31b9c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4a2c165000 0x7f4a2c165490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56584/0 (socket says 172.21.15.2:56584) 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a31b9c640 1 -- 172.21.15.2:0/2117682243 learned_addr learned my addr 172.21.15.2:0/2117682243 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a30b9a640 1 --2- 172.21.15.2:0/2117682243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c06c780 0x7f4a2c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a31b9c640 1 -- 172.21.15.2:0/2117682243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c06c780 msgr2=0x7f4a2c06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a31b9c640 1 --2- 172.21.15.2:0/2117682243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c06c780 0x7f4a2c06cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a31b9c640 1 -- 172.21.15.2:0/2117682243 >> v1:172.21.15.90:6789/0 conn(0x7f4a2c0c4230 legacy=0x7f4a2c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.167+0000 7f4a31b9c640 1 -- 172.21.15.2:0/2117682243 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c0b3630 con 0x7f4a2c165000 2023-11-04T01:48:55.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a31b9c640 1 --2- 172.21.15.2:0/2117682243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c165000 0x7f4a2c165490 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a2801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3caae1befb211d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a23fff640 1 -- 172.21.15.2:0/2117682243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280aa670 con 0x7f4a2c165000 2023-11-04T01:48:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a23fff640 1 -- 172.21.15.2:0/2117682243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280aa7d0 con 0x7f4a2c165000 2023-11-04T01:48:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a23fff640 1 -- 172.21.15.2:0/2117682243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280aab60 con 0x7f4a2c165000 2023-11-04T01:48:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 -- 172.21.15.2:0/2117682243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c165000 msgr2=0x7f4a2c165490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 --2- 172.21.15.2:0/2117682243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c165000 0x7f4a2c165490 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009870 tx=0x7f4a2801c510 comp rx=0 tx=0).stop 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 -- 172.21.15.2:0/2117682243 shutdown_connections 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 --2- 172.21.15.2:0/2117682243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c165000 0x7f4a2c165490 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 --2- 172.21.15.2:0/2117682243 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c06c780 0x7f4a2c06cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 -- 172.21.15.2:0/2117682243 >> 172.21.15.2:0/2117682243 conn(0x7f4a2c06a130 msgr2=0x7f4a2c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 -- 172.21.15.2:0/2117682243 shutdown_connections 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 -- 172.21.15.2:0/2117682243 wait complete. 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 Processor -- start 2023-11-04T01:48:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.171+0000 7f4a335ff640 1 -- start start 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c06c780 0x7f4a2c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c0c4230 0x7f4a2c15c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2c165000 0x7f4a2c15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0b1b50 con 0x7f4a2c06c780 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0b25d0 con 0x7f4a2c165000 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0b0850 con 0x7f4a2c0c4230 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c06c780 0x7f4a2c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c06c780 0x7f4a2c0b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56586/0 (socket says 172.21.15.2:56586) 2023-11-04T01:48:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 -- 172.21.15.2:0/37591714 learned_addr learned my addr 172.21.15.2:0/37591714 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a30b9a640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c0c4230 0x7f4a2c15c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 -- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c0c4230 msgr2=0x7f4a2c15c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c0c4230 0x7f4a2c15c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 -- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2c165000 msgr2=0x7f4a2c15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a31b9c640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2c165000 0x7f4a2c15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2c165000 0x7f4a2c15c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 -- 172.21.15.2:0/37591714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280094d0 con 0x7f4a2c06c780 2023-11-04T01:48:55.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a3139b640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c06c780 0x7f4a2c0b1610 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c790 tx=0x7f4a2400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a21ffb640 1 -- 172.21.15.2:0/37591714 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400cea0 con 0x7f4a2c06c780 2023-11-04T01:48:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a21ffb640 1 -- 172.21.15.2:0/37591714 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24006d60 con 0x7f4a2c06c780 2023-11-04T01:48:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a21ffb640 1 -- 172.21.15.2:0/37591714 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24003bc0 con 0x7f4a2c06c780 2023-11-04T01:48:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c0b0b30 con 0x7f4a2c06c780 2023-11-04T01:48:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c0b10f0 con 0x7f4a2c06c780 2023-11-04T01:48:55.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c0b1cc0 con 0x7f4a2c06c780 2023-11-04T01:48:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a21ffb640 1 -- 172.21.15.2:0/37591714 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4a24003d20 con 0x7f4a2c06c780 2023-11-04T01:48:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a21ffb640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a100664d0 0x7f4a10068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.175+0000 7f4a21ffb640 1 -- 172.21.15.2:0/37591714 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f4a24084120 con 0x7f4a2c06c780 2023-11-04T01:48:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.179+0000 7f4a30b9a640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a100664d0 0x7f4a10068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.179+0000 7f4a30b9a640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a100664d0 0x7f4a10068990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cae20 tx=0x7f4a1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.183+0000 7f4a21ffb640 1 -- 172.21.15.2:0/37591714 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4a2c0b1cc0 con 0x7f4a2c06c780 2023-11-04T01:48:55.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:55.201 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:48:55.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-11-04T01:48:55.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a2c0ceb10 con 0x7f4a2c06c780 2023-11-04T01:48:55.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a21ffb640 1 -- 172.21.15.2:0/37591714 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4971 (secure 0 0 0) 0x7f4a240549f0 con 0x7f4a2c06c780 2023-11-04T01:48:55.378 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:55.378 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":7986,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:49.636232+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7815,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7815":{"gid":7815,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":14,"addr":"172.21.15.2:6833/3051439603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3051439603},{"type":"v1","addr":"172.21.15.2:6833","nonce":3051439603}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:48:49.636232+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:55.379 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 97 2023-11-04T01:48:55.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a100664d0 msgr2=0x7f4a10068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a100664d0 0x7f4a10068990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c0cae20 tx=0x7f4a1c008040 comp rx=0 tx=0).stop 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c06c780 msgr2=0x7f4a2c0b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c06c780 0x7f4a2c0b1610 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c790 tx=0x7f4a2400cc50 comp rx=0 tx=0).stop 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 shutdown_connections 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4a100664d0 0x7f4a10068990 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a2c165000 0x7f4a2c15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4a2c0c4230 0x7f4a2c15c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 --2- 172.21.15.2:0/37591714 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a2c06c780 0x7f4a2c0b1610 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 >> 172.21.15.2:0/37591714 conn(0x7f4a2c06a130 msgr2=0x7f4a2c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 shutdown_connections 2023-11-04T01:48:55.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.371+0000 7f4a335ff640 1 -- 172.21.15.2:0/37591714 wait complete. 2023-11-04T01:48:55.394 INFO:tasks.ceph.mds.d:Sent signal 9 2023-11-04T01:48:55.394 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:48:55.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:48:55.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 down 2023-11-04T01:48:55.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:48:55.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b276c0640 1 Processor -- start 2023-11-04T01:48:55.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b276c0640 1 -- start start 2023-11-04T01:48:55.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b276c0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b20160680 0x7f0b200cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b276c0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b20160a60 0x7f0b200ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b276c0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b200cf000 con 0x7f0b200b3e30 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b276c0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200b5de0 con 0x7f0b20160680 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b276c0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200d1610 con 0x7f0b20160a60 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b2545c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b20160680 0x7f0b200cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b25c5d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0b200b3e30 0x7f0b200cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:34488/0 (socket says 172.21.15.2:34488) 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b2545c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0b20160680 0x7f0b200cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56592/0 (socket says 172.21.15.2:56592) 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b25c5d640 1 -- 172.21.15.2:0/3955674757 learned_addr learned my addr 172.21.15.2:0/3955674757 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b24c5b640 1 --2- 172.21.15.2:0/3955674757 >> v2:172.21.15.90:3300/0 conn(0x7f0b20160a60 0x7f0b200ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b2545c640 1 -- 172.21.15.2:0/3955674757 >> v2:172.21.15.90:3300/0 conn(0x7f0b20160a60 msgr2=0x7f0b200ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b2545c640 1 --2- 172.21.15.2:0/3955674757 >> v2:172.21.15.90:3300/0 conn(0x7f0b20160a60 0x7f0b200ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b2545c640 1 -- 172.21.15.2:0/3955674757 >> v1:172.21.15.2:6789/0 conn(0x7f0b200b3e30 legacy=0x7f0b200cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b17fff640 1 -- 172.21.15.2:0/3955674757 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666536305 0 0) 0x7f0b200cf000 con 0x7f0b200b3e30 2023-11-04T01:48:55.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.579+0000 7f0b2545c640 1 -- 172.21.15.2:0/3955674757 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200d18f0 con 0x7f0b20160680 2023-11-04T01:48:55.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b2545c640 1 --2- 172.21.15.2:0/3955674757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b200cdba0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f0b2008bc00 tx=0x7f0b1c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265d3257c7b3fe71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b17fff640 1 -- 172.21.15.2:0/3955674757 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0a7070 con 0x7f0b20160680 2023-11-04T01:48:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b17fff640 1 -- 172.21.15.2:0/3955674757 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c0ab430 con 0x7f0b20160680 2023-11-04T01:48:55.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b17fff640 1 -- 172.21.15.2:0/3955674757 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0ab7c0 con 0x7f0b20160680 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 -- 172.21.15.2:0/3955674757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 msgr2=0x7f0b200cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 --2- 172.21.15.2:0/3955674757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b200cdba0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f0b2008bc00 tx=0x7f0b1c01c430 comp rx=0 tx=0).stop 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 -- 172.21.15.2:0/3955674757 shutdown_connections 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 --2- 172.21.15.2:0/3955674757 >> v2:172.21.15.90:3300/0 conn(0x7f0b20160a60 0x7f0b200ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 --2- 172.21.15.2:0/3955674757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b200cdba0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 -- 172.21.15.2:0/3955674757 >> 172.21.15.2:0/3955674757 conn(0x7f0b200d2f90 msgr2=0x7f0b200d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 -- 172.21.15.2:0/3955674757 shutdown_connections 2023-11-04T01:48:55.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.583+0000 7f0b276c0640 1 -- 172.21.15.2:0/3955674757 wait complete. 2023-11-04T01:48:55.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 Processor -- start 2023-11-04T01:48:55.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 -- start start 2023-11-04T01:48:55.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b200b3e30 0x7f0b200c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b2006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b20160a60 0x7f0b2006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c9e80 con 0x7f0b20160680 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20156a40 con 0x7f0b200b3e30 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b20156d20 con 0x7f0b20160a60 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b2006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b2006b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56604/0 (socket says 172.21.15.2:56604) 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 -- 172.21.15.2:0/369495205 learned_addr learned my addr 172.21.15.2:0/369495205 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b25c5d640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b20160a60 0x7f0b2006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 -- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b20160a60 msgr2=0x7f0b2006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b20160a60 0x7f0b2006b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b2545c640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b200b3e30 0x7f0b200c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 -- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b200b3e30 msgr2=0x7f0b200c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b200b3e30 0x7f0b200c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 -- 172.21.15.2:0/369495205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c009420 con 0x7f0b20160680 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b2545c640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b200b3e30 0x7f0b200c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b24c5b640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b2006b3b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000d5f0 tx=0x7f0b1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b15ffb640 1 -- 172.21.15.2:0/369495205 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b100125f0 con 0x7f0b20160680 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b15ffb640 1 -- 172.21.15.2:0/369495205 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b10012750 con 0x7f0b20160680 2023-11-04T01:48:55.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b20157000 con 0x7f0b20160680 2023-11-04T01:48:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b15ffb640 1 -- 172.21.15.2:0/369495205 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10012ae0 con 0x7f0b20160680 2023-11-04T01:48:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200c7a00 con 0x7f0b20160680 2023-11-04T01:48:55.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.587+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2004e4a0 con 0x7f0b20160680 2023-11-04T01:48:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.591+0000 7f0b15ffb640 1 -- 172.21.15.2:0/369495205 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b10012c40 con 0x7f0b20160680 2023-11-04T01:48:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.591+0000 7f0b15ffb640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b040664a0 0x7f0b04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.591+0000 7f0b15ffb640 1 -- 172.21.15.2:0/369495205 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f0b10084a40 con 0x7f0b20160680 2023-11-04T01:48:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.591+0000 7f0b2545c640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b040664a0 0x7f0b04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.591+0000 7f0b2545c640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b040664a0 0x7f0b04068960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0af000 tx=0x7f0b1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.596 INFO:tasks.ceph.mds.d.smithi090.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:48:55.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.595+0000 7f0b15ffb640 1 -- 172.21.15.2:0/369495205 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0b100517e0 con 0x7f0b20160680 2023-11-04T01:48:55.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.815+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f0b2006c600 con 0x7f0b20160680 2023-11-04T01:48:55.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.819+0000 7f0b15ffb640 1 -- 172.21.15.2:0/369495205 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7815 v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0b10007380 con 0x7f0b20160680 2023-11-04T01:48:55.824 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 7815 2023-11-04T01:48:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b040664a0 msgr2=0x7f0b04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b040664a0 0x7f0b04068960 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0af000 tx=0x7f0b1c008040 comp rx=0 tx=0).stop 2023-11-04T01:48:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 msgr2=0x7f0b2006b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b2006b3b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000d5f0 tx=0x7f0b1000dab0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 shutdown_connections 2023-11-04T01:48:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0b040664a0 0x7f0b04068960 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0b20160a60 0x7f0b2006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0b20160680 0x7f0b2006b3b0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 --2- 172.21.15.2:0/369495205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b200b3e30 0x7f0b200c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 >> 172.21.15.2:0/369495205 conn(0x7f0b200d2f90 msgr2=0x7f0b200b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 shutdown_connections 2023-11-04T01:48:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.823+0000 7f0b276c0640 1 -- 172.21.15.2:0/369495205 wait complete. 2023-11-04T01:48:55.849 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:48:55.849 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:48:55.849 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:48:55.849 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:48:55.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:48:55.849 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:48:55.850 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:48:55.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:48:55.852 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:48:55.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:48:55.910 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:48:55.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.955+0000 7fc0c0f38640 1 Processor -- start 2023-11-04T01:48:55.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0c0f38640 1 -- start start 2023-11-04T01:48:55.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0c0f38640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0c0f38640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc0bc0b2a60 0x7fc0bc06a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0c0f38640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc0cb460 con 0x7fc0bc070310 2023-11-04T01:48:55.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0c0f38640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc0caf40 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0c0f38640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0ca500 con 0x7fc0bc15b030 2023-11-04T01:48:55.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0bad9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc0bc0b2a60 0x7fc0bc06a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0ba59c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc0caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:52596/0 (socket says 172.21.15.2:52596) 2023-11-04T01:48:55.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0ba59c640 1 -- 172.21.15.2:0/1991406247 learned_addr learned my addr 172.21.15.2:0/1991406247 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:55.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0bad9d640 1 -- 172.21.15.2:0/1991406247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 msgr2=0x7fc0bc0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:48:55.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1991406247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0bad9d640 1 -- 172.21.15.2:0/1991406247 >> v1:172.21.15.90:6789/0 conn(0x7fc0bc070310 legacy=0x7fc0bc0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.959+0000 7fc0bad9d640 1 -- 172.21.15.2:0/1991406247 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc0707d0 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/1991406247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc06a130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0097c0 tx=0x7fc0ac01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481c9cf9fc9a9ed5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0b959a640 1 -- 172.21.15.2:0/1991406247 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0ab650 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0b959a640 1 -- 172.21.15.2:0/1991406247 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac0ab7b0 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0b959a640 1 -- 172.21.15.2:0/1991406247 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0abb40 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- 172.21.15.2:0/1991406247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc0b2a60 msgr2=0x7fc0bc06a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/1991406247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc06a130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0097c0 tx=0x7fc0ac01c450 comp rx=0 tx=0).stop 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- 172.21.15.2:0/1991406247 shutdown_connections 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/1991406247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc06a130 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/1991406247 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- 172.21.15.2:0/1991406247 >> 172.21.15.2:0/1991406247 conn(0x7fc0bc0b1050 msgr2=0x7fc0bc0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- 172.21.15.2:0/1991406247 shutdown_connections 2023-11-04T01:48:55.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- 172.21.15.2:0/1991406247 wait complete. 2023-11-04T01:48:55.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 Processor -- start 2023-11-04T01:48:55.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- start start 2023-11-04T01:48:55.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc070310 0x7fc0bc144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc15db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc162eb0 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0ce020 con 0x7fc0bc070310 2023-11-04T01:48:55.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0c0f38640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc144ca0 con 0x7fc0bc15b030 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0b9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc15db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0b9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc15db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56634/0 (socket says 172.21.15.2:56634) 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/2255191211 learned_addr learned my addr 172.21.15.2:0/2255191211 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc070310 0x7fc0bc144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.963+0000 7fc0bad9d640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 msgr2=0x7fc0bc15e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc15e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc070310 msgr2=0x7fc0bc144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc070310 0x7fc0bc144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0b9d9b640 1 -- 172.21.15.2:0/2255191211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac009420 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0b9d9b640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc15db20 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c420 tx=0x7fc0b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0aaffd640 1 -- 172.21.15.2:0/2255191211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00052d0 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0aaffd640 1 -- 172.21.15.2:0/2255191211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0005430 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc0ce2a0 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0aaffd640 1 -- 172.21.15.2:0/2255191211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0007260 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc0ce860 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc15ca80 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0aaffd640 1 -- 172.21.15.2:0/2255191211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc0b00073c0 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0aaffd640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc09c0664a0 0x7fc09c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:48:55.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0aaffd640 1 -- 172.21.15.2:0/2255191211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7533+0+0 (secure 0 0 0) 0x7fc0b00838e0 con 0x7fc0bc0b2a60 2023-11-04T01:48:55.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc09c0664a0 0x7fc09c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:48:55.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.967+0000 7fc0ba59c640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc09c0664a0 0x7fc09c068960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4011340 tx=0x7fc0b400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:48:55.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:55.971+0000 7fc0aaffd640 1 -- 172.21.15.2:0/2255191211 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc0b0050670 con 0x7fc0bc0b2a60 2023-11-04T01:48:56.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0bc06a260 con 0x7fc0bc0b2a60 2023-11-04T01:48:56.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0aaffd640 1 -- 172.21.15.2:0/2255191211 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4134 (secure 0 0 0) 0x7fc0b0053c90 con 0x7fc0bc0b2a60 2023-11-04T01:48:56.163 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:48:56.163 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:55.829766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:48:56.163 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 99 2023-11-04T01:48:56.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc09c0664a0 msgr2=0x7fc09c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:56.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc09c0664a0 0x7fc09c068960 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4011340 tx=0x7fc0b400b040 comp rx=0 tx=0).stop 2023-11-04T01:48:56.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc0b2a60 msgr2=0x7fc0bc15db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:48:56.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc15db20 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000c420 tx=0x7fc0b000c8e0 comp rx=0 tx=0).stop 2023-11-04T01:48:56.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 shutdown_connections 2023-11-04T01:48:56.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc09c0664a0 0x7fc09c068960 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:56.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc0bc15b030 0x7fc0bc15e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:56.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0bc0b2a60 0x7fc0bc15db20 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:56.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 --2- 172.21.15.2:0/2255191211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0bc070310 0x7fc0bc144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:48:56.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 >> 172.21.15.2:0/2255191211 conn(0x7fc0bc0b1050 msgr2=0x7fc0bc157c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:48:56.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 shutdown_connections 2023-11-04T01:48:56.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:48:56.159+0000 7fc0c0f38640 1 -- 172.21.15.2:0/2255191211 wait complete. 2023-11-04T01:48:56.180 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:49:01.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:01.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.311+0000 7f2f0af68640 1 Processor -- start 2023-11-04T01:49:01.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.311+0000 7f2f0af68640 1 -- start start 2023-11-04T01:49:01.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f0af68640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f040c92b0 0x7f2f040cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f0af68640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f0406c1c0 0x7f2f041442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f0af68640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040c9ac0 con 0x7f2f0406bde0 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f0af68640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f040caf20 con 0x7f2f0406c1c0 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f0af68640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040c97e0 con 0x7f2f040c92b0 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f0406c1c0 0x7f2f041442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2f0406c1c0 0x7f2f041442b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56886/0 (socket says 172.21.15.2:56886) 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 -- 172.21.15.2:0/3854465517 learned_addr learned my addr 172.21.15.2:0/3854465517 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f03fff640 1 --2- 172.21.15.2:0/3854465517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f040c92b0 0x7f2f040cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 -- 172.21.15.2:0/3854465517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f040c92b0 msgr2=0x7f2f040cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 --2- 172.21.15.2:0/3854465517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f040c92b0 0x7f2f040cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 -- 172.21.15.2:0/3854465517 >> v1:172.21.15.90:6789/0 conn(0x7f2f0406bde0 legacy=0x7f2f0415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:01.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 -- 172.21.15.2:0/3854465517 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040cb1c0 con 0x7f2f0406c1c0 2023-11-04T01:49:01.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f09505640 1 --2- 172.21.15.2:0/3854465517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406c1c0 0x7f2f041442b0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0098a0 tx=0x7f2efc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3782c105f6556c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:01.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f037fe640 1 -- 172.21.15.2:0/3854465517 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0ad640 con 0x7f2f0406c1c0 2023-11-04T01:49:01.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f037fe640 1 -- 172.21.15.2:0/3854465517 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc0ad7a0 con 0x7f2f0406c1c0 2023-11-04T01:49:01.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.315+0000 7f2f037fe640 1 -- 172.21.15.2:0/3854465517 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0adb30 con 0x7f2f0406c1c0 2023-11-04T01:49:01.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- 172.21.15.2:0/3854465517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406c1c0 msgr2=0x7f2f041442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3854465517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406c1c0 0x7f2f041442b0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0098a0 tx=0x7f2efc01c4e0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- 172.21.15.2:0/3854465517 shutdown_connections 2023-11-04T01:49:01.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3854465517 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406c1c0 0x7f2f041442b0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3854465517 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f040c92b0 0x7f2f040cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- 172.21.15.2:0/3854465517 >> 172.21.15.2:0/3854465517 conn(0x7f2f040b0890 msgr2=0x7f2f040b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:01.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- 172.21.15.2:0/3854465517 shutdown_connections 2023-11-04T01:49:01.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- 172.21.15.2:0/3854465517 wait complete. 2023-11-04T01:49:01.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 Processor -- start 2023-11-04T01:49:01.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- start start 2023-11-04T01:49:01.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406bde0 0x7f2f0415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f0406c1c0 0x7f2f0413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f040c92b0 0x7f2f0415d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0413f070 con 0x7f2f0406bde0 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0413e6a0 con 0x7f2f040c92b0 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0415e250 con 0x7f2f0406c1c0 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406bde0 0x7f2f0415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406bde0 0x7f2f0415ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56902/0 (socket says 172.21.15.2:56902) 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 -- 172.21.15.2:0/3330257038 learned_addr learned my addr 172.21.15.2:0/3330257038 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f03fff640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f0406c1c0 0x7f2f0413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f09505640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f040c92b0 0x7f2f0415d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 -- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f0406c1c0 msgr2=0x7f2f0413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f0406c1c0 0x7f2f0413eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 -- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f040c92b0 msgr2=0x7f2f0415d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f040c92b0 0x7f2f0415d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 -- 172.21.15.2:0/3330257038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0094d0 con 0x7f2f0406bde0 2023-11-04T01:49:01.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f08d04640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406bde0 0x7f2f0415ab10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400c450 tx=0x7f2ef400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:01.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f017fa640 1 -- 172.21.15.2:0/3330257038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4012830 con 0x7f2f0406bde0 2023-11-04T01:49:01.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f017fa640 1 -- 172.21.15.2:0/3330257038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef40129b0 con 0x7f2f0406bde0 2023-11-04T01:49:01.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0413e050 con 0x7f2f0406bde0 2023-11-04T01:49:01.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f017fa640 1 -- 172.21.15.2:0/3330257038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4012d60 con 0x7f2f0406bde0 2023-11-04T01:49:01.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.319+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0415e530 con 0x7f2f0406bde0 2023-11-04T01:49:01.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.323+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0404e4a0 con 0x7f2f0406bde0 2023-11-04T01:49:01.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.323+0000 7f2f017fa640 1 -- 172.21.15.2:0/3330257038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ef401c460 con 0x7f2f0406bde0 2023-11-04T01:49:01.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.323+0000 7f2f017fa640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ef00664a0 0x7f2ef0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.323+0000 7f2f017fa640 1 -- 172.21.15.2:0/3330257038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7533+0+0 (secure 0 0 0) 0x7f2ef40843a0 con 0x7f2f0406bde0 2023-11-04T01:49:01.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.323+0000 7f2f03fff640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ef00664a0 0x7f2ef0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.323+0000 7f2f03fff640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ef00664a0 0x7f2ef0068960 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2f040ca050 tx=0x7f2ef80039c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:01.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.327+0000 7f2f017fa640 1 -- 172.21.15.2:0/3330257038 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ef40510f0 con 0x7f2f0406bde0 2023-11-04T01:49:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.519+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f040c9da0 con 0x7f2f0406bde0 2023-11-04T01:49:01.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.519+0000 7f2f017fa640 1 -- 172.21.15.2:0/3330257038 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4927 (secure 0 0 0) 0x7f2ef4054710 con 0x7f2f0406bde0 2023-11-04T01:49:01.524 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:01.524 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:55.857524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:resolve","state_seq":12,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:01.524 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 100 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ef00664a0 msgr2=0x7f2ef0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ef00664a0 0x7f2ef0068960 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2f040ca050 tx=0x7f2ef80039c0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406bde0 msgr2=0x7f2f0415ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406bde0 0x7f2f0415ab10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400c450 tx=0x7f2ef400c910 comp rx=0 tx=0).stop 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 shutdown_connections 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2ef00664a0 0x7f2ef0068960 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2f040c92b0 0x7f2f0415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2f0406c1c0 0x7f2f0413eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 --2- 172.21.15.2:0/3330257038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f0406bde0 0x7f2f0415ab10 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 >> 172.21.15.2:0/3330257038 conn(0x7f2f040b0890 msgr2=0x7f2f040b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:01.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 shutdown_connections 2023-11-04T01:49:01.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.523+0000 7f2f0af68640 1 -- 172.21.15.2:0/3330257038 wait complete. 2023-11-04T01:49:01.544 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:49:01.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:01.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.659+0000 7f42d2bd2640 1 Processor -- start 2023-11-04T01:49:01.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.659+0000 7f42d2bd2640 1 -- start start 2023-11-04T01:49:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d2bd2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42cc13e220 0x7f42cc15c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d2bd2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f42cc06a130 0x7f42cc06a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d2bd2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d2bd2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc06aad0 con 0x7f42cc13e220 2023-11-04T01:49:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d2bd2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc071a70 con 0x7f42cc06a130 2023-11-04T01:49:01.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d2bd2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc070bc0 con 0x7f42cc15ec90 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42cc13e220 0x7f42cc15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42cc13e220 0x7f42cc15c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56904/0 (socket says 172.21.15.2:56904) 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 -- 172.21.15.2:0/1455113105 learned_addr learned my addr 172.21.15.2:0/1455113105 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d116f640 1 --2- 172.21.15.2:0/1455113105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42cbfff640 1 --2- 172.21.15.2:0/1455113105 >> v2:172.21.15.90:3300/0 conn(0x7f42cc06a130 0x7f42cc06a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 -- 172.21.15.2:0/1455113105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 msgr2=0x7f42cc15f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 --2- 172.21.15.2:0/1455113105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 -- 172.21.15.2:0/1455113105 >> v2:172.21.15.90:3300/0 conn(0x7f42cc06a130 msgr2=0x7f42cc06a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 --2- 172.21.15.2:0/1455113105 >> v2:172.21.15.90:3300/0 conn(0x7f42cc06a130 0x7f42cc06a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 -- 172.21.15.2:0/1455113105 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc070e60 con 0x7f42cc13e220 2023-11-04T01:49:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42d096e640 1 --2- 172.21.15.2:0/1455113105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc13e220 0x7f42cc15c020 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0cd770 tx=0x7f42c401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be653a395611119c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42cb7fe640 1 -- 172.21.15.2:0/1455113105 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40a5820 con 0x7f42cc13e220 2023-11-04T01:49:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42cb7fe640 1 -- 172.21.15.2:0/1455113105 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c40a5980 con 0x7f42cc13e220 2023-11-04T01:49:01.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.663+0000 7f42cb7fe640 1 -- 172.21.15.2:0/1455113105 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40a5d10 con 0x7f42cc13e220 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- 172.21.15.2:0/1455113105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc13e220 msgr2=0x7f42cc15c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/1455113105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc13e220 0x7f42cc15c020 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0cd770 tx=0x7f42c401c9a0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- 172.21.15.2:0/1455113105 shutdown_connections 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/1455113105 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/1455113105 >> v2:172.21.15.90:3300/0 conn(0x7f42cc06a130 0x7f42cc06a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/1455113105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc13e220 0x7f42cc15c020 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- 172.21.15.2:0/1455113105 >> 172.21.15.2:0/1455113105 conn(0x7f42cc0b18a0 msgr2=0x7f42cc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:01.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- 172.21.15.2:0/1455113105 shutdown_connections 2023-11-04T01:49:01.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- 172.21.15.2:0/1455113105 wait complete. 2023-11-04T01:49:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 Processor -- start 2023-11-04T01:49:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- start start 2023-11-04T01:49:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc06a130 0x7f42cc150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42cc13e220 0x7f42cc13a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc140480 con 0x7f42cc06a130 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc13b590 con 0x7f42cc13e220 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d2bd2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc140690 con 0x7f42cc15ec90 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc06a130 0x7f42cc150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc06a130 0x7f42cc150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56910/0 (socket says 172.21.15.2:56910) 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 -- 172.21.15.2:0/2744889085 learned_addr learned my addr 172.21.15.2:0/2744889085 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d116f640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42cbfff640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42cc13e220 0x7f42cc13a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 -- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 msgr2=0x7f42cc15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 -- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42cc13e220 msgr2=0x7f42cc13a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42cc13e220 0x7f42cc13a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 -- 172.21.15.2:0/2744889085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4009b30 con 0x7f42cc06a130 2023-11-04T01:49:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42cbfff640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42cc13e220 0x7f42cc13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42d096e640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc06a130 0x7f42cc150d10 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f42c401c7d0 tx=0x7f42c4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:01.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42c97fa640 1 -- 172.21.15.2:0/2744889085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40b8670 con 0x7f42cc06a130 2023-11-04T01:49:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42c97fa640 1 -- 172.21.15.2:0/2744889085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c40b87d0 con 0x7f42cc06a130 2023-11-04T01:49:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.667+0000 7f42c97fa640 1 -- 172.21.15.2:0/2744889085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40b8b60 con 0x7f42cc06a130 2023-11-04T01:49:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc140970 con 0x7f42cc06a130 2023-11-04T01:49:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc140f30 con 0x7f42cc06a130 2023-11-04T01:49:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42cc165e00 con 0x7f42cc06a130 2023-11-04T01:49:01.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42c97fa640 1 -- 172.21.15.2:0/2744889085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f42c40b8cc0 con 0x7f42cc06a130 2023-11-04T01:49:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42c97fa640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42ac0664a0 0x7f42ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42c97fa640 1 -- 172.21.15.2:0/2744889085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7533+0+0 (secure 0 0 0) 0x7f42c411fc20 con 0x7f42cc06a130 2023-11-04T01:49:01.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42cbfff640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42ac0664a0 0x7f42ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:01.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.671+0000 7f42cbfff640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42ac0664a0 0x7f42ac068960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0b2a90 tx=0x7f42b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:01.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.675+0000 7f42c97fa640 1 -- 172.21.15.2:0/2744889085 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f42c40eca00 con 0x7f42cc06a130 2023-11-04T01:49:01.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-04T01:49:01.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:49:01.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.871+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42cc06cfd0 con 0x7f42cc06a130 2023-11-04T01:49:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.871+0000 7f42c97fa640 1 -- 172.21.15.2:0/2744889085 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4927 (secure 0 0 0) 0x7f42c40f0020 con 0x7f42cc06a130 2023-11-04T01:49:01.875 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:01.875 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:55.857524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:resolve","state_seq":12,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:01.875 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 100 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42ac0664a0 msgr2=0x7f42ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42ac0664a0 0x7f42ac068960 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0b2a90 tx=0x7f42b4008040 comp rx=0 tx=0).stop 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc06a130 msgr2=0x7f42cc150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc06a130 0x7f42cc150d10 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f42c401c7d0 tx=0x7f42c4019740 comp rx=0 tx=0).stop 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 shutdown_connections 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f42ac0664a0 0x7f42ac068960 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f42cc15ec90 0x7f42cc15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42cc13e220 0x7f42cc13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 --2- 172.21.15.2:0/2744889085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42cc06a130 0x7f42cc150d10 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:01.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 >> 172.21.15.2:0/2744889085 conn(0x7f42cc0b18a0 msgr2=0x7f42cc13cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:01.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 shutdown_connections 2023-11-04T01:49:01.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:01.875+0000 7f42d2bd2640 1 -- 172.21.15.2:0/2744889085 wait complete. 2023-11-04T01:49:01.895 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:49:01.895 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.3509213924407959s 2023-11-04T01:49:01.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:02.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0acba91640 1 Processor -- start 2023-11-04T01:49:02.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0acba91640 1 -- start start 2023-11-04T01:49:02.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0acba91640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ac4142ad0 0x7f0ac415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0acba91640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ac40cbd80 0x7f0ac40cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.019 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0acba91640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac40ca100 con 0x7f0ac4142eb0 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0acba91640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40ca3e0 con 0x7f0ac40cbd80 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0acba91640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40ca6c0 con 0x7f0ac4142ad0 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0aca02e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ac40cbd80 0x7f0ac40cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0aca02e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ac40cbd80 0x7f0ac40cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56922/0 (socket says 172.21.15.2:56922) 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0aca02e640 1 -- 172.21.15.2:0/677538139 learned_addr learned my addr 172.21.15.2:0/677538139 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0ac982d640 1 --2- 172.21.15.2:0/677538139 >> v2:172.21.15.90:3300/0 conn(0x7f0ac4142ad0 0x7f0ac415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0aca02e640 1 -- 172.21.15.2:0/677538139 >> v2:172.21.15.90:3300/0 conn(0x7f0ac4142ad0 msgr2=0x7f0ac415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0aca02e640 1 --2- 172.21.15.2:0/677538139 >> v2:172.21.15.90:3300/0 conn(0x7f0ac4142ad0 0x7f0ac415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0aca02e640 1 -- 172.21.15.2:0/677538139 >> v1:172.21.15.90:6789/0 conn(0x7f0ac4142eb0 legacy=0x7f0ac40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.020 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.015+0000 7f0aca02e640 1 -- 172.21.15.2:0/677538139 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40ca9a0 con 0x7f0ac40cbd80 2023-11-04T01:49:02.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0aca02e640 1 --2- 172.21.15.2:0/677538139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac40cbd80 0x7f0ac40cc830 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40cc450 tx=0x7f0ab401eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a5622d630c0182 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac882b640 1 -- 172.21.15.2:0/677538139 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400b2d0 con 0x7f0ac40cbd80 2023-11-04T01:49:02.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac882b640 1 -- 172.21.15.2:0/677538139 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab400b430 con 0x7f0ac40cbd80 2023-11-04T01:49:02.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac882b640 1 -- 172.21.15.2:0/677538139 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40a7c50 con 0x7f0ac40cbd80 2023-11-04T01:49:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- 172.21.15.2:0/677538139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac40cbd80 msgr2=0x7f0ac40cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 --2- 172.21.15.2:0/677538139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac40cbd80 0x7f0ac40cc830 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40cc450 tx=0x7f0ab401eb40 comp rx=0 tx=0).stop 2023-11-04T01:49:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- 172.21.15.2:0/677538139 shutdown_connections 2023-11-04T01:49:02.022 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 --2- 172.21.15.2:0/677538139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac40cbd80 0x7f0ac40cc830 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 --2- 172.21.15.2:0/677538139 >> v2:172.21.15.90:3300/0 conn(0x7f0ac4142ad0 0x7f0ac415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- 172.21.15.2:0/677538139 >> 172.21.15.2:0/677538139 conn(0x7f0ac40b0890 msgr2=0x7f0ac40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- 172.21.15.2:0/677538139 shutdown_connections 2023-11-04T01:49:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- 172.21.15.2:0/677538139 wait complete. 2023-11-04T01:49:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 Processor -- start 2023-11-04T01:49:02.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- start start 2023-11-04T01:49:02.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ac40cbd80 0x7f0ac413d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac4142ad0 0x7f0ac413d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ac4142eb0 0x7f0ac4139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac40c6540 con 0x7f0ac4142ad0 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac413b630 con 0x7f0ac4142eb0 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0acba91640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac413aab0 con 0x7f0ac40cbd80 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac4142ad0 0x7f0ac413d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac4142ad0 0x7f0ac413d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56932/0 (socket says 172.21.15.2:56932) 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 -- 172.21.15.2:0/2807421618 learned_addr learned my addr 172.21.15.2:0/2807421618 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0aca02e640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ac4142eb0 0x7f0ac4139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac982d640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ac40cbd80 0x7f0ac413d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 -- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ac40cbd80 msgr2=0x7f0ac413d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ac40cbd80 0x7f0ac413d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 -- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ac4142eb0 msgr2=0x7f0ac4139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ac4142eb0 0x7f0ac4139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 -- 172.21.15.2:0/2807421618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab400bd40 con 0x7f0ac4142ad0 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac902c640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac4142ad0 0x7f0ac413d870 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800c3c0 tx=0x7f0ab800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.019+0000 7f0ac27fc640 1 -- 172.21.15.2:0/2807421618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80052d0 con 0x7f0ac4142ad0 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0ac27fc640 1 -- 172.21.15.2:0/2807421618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab8005430 con 0x7f0ac4142ad0 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac413ad90 con 0x7f0ac4142ad0 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0ac27fc640 1 -- 172.21.15.2:0/2807421618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8003840 con 0x7f0ac4142ad0 2023-11-04T01:49:02.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac413b350 con 0x7f0ac4142ad0 2023-11-04T01:49:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac404e4a0 con 0x7f0ac4142ad0 2023-11-04T01:49:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0ac27fc640 1 -- 172.21.15.2:0/2807421618 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ab80039a0 con 0x7f0ac4142ad0 2023-11-04T01:49:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0ac27fc640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ab00664a0 0x7f0ab0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0ac27fc640 1 -- 172.21.15.2:0/2807421618 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7533+0+0 (secure 0 0 0) 0x7f0ab8083b80 con 0x7f0ac4142ad0 2023-11-04T01:49:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0ac982d640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ab00664a0 0x7f0ab0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.023+0000 7f0ac982d640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ab00664a0 0x7f0ab0068960 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b9d0 tx=0x7f0abc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.027+0000 7f0ac27fc640 1 -- 172.21.15.2:0/2807421618 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0ab8050840 con 0x7f0ac4142ad0 2023-11-04T01:49:02.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.215+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ac406d010 con 0x7f0ac4142ad0 2023-11-04T01:49:02.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0ac27fc640 1 -- 172.21.15.2:0/2807421618 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4927 (secure 0 0 0) 0x7f0ab8053e60 con 0x7f0ac4142ad0 2023-11-04T01:49:02.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:02.252 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:48:55.857524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":5930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5930":{"gid":5930,"name":"d","rank":1,"incarnation":90,"state":"up:active","state_seq":8,"addr":"172.21.15.90:6837/238645283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":238645283},{"type":"v1","addr":"172.21.15.90:6837","nonce":238645283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:resolve","state_seq":12,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:02.253 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 100 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ab00664a0 msgr2=0x7f0ab0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ab00664a0 0x7f0ab0068960 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00b9d0 tx=0x7f0abc008040 comp rx=0 tx=0).stop 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac4142ad0 msgr2=0x7f0ac413d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac4142ad0 0x7f0ac413d870 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800c3c0 tx=0x7f0ab800c880 comp rx=0 tx=0).stop 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 shutdown_connections 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0ab00664a0 0x7f0ab0068960 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ac4142eb0 0x7f0ac4139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ac4142ad0 0x7f0ac413d870 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 --2- 172.21.15.2:0/2807421618 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0ac40cbd80 0x7f0ac413d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 >> 172.21.15.2:0/2807421618 conn(0x7f0ac40b0890 msgr2=0x7f0ac40b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 shutdown_connections 2023-11-04T01:49:02.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.219+0000 7f0acba91640 1 -- 172.21.15.2:0/2807421618 wait complete. 2023-11-04T01:49:02.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:49:02.387 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":11,"last_created":5,"last_destroyed":9,"pending_noop":[],"snaps":[],"need_to_purge":{},"pending_update":[{"version":21,"snapinfo":{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:48:32.891232+0000","name":"s25","metadata":{}}}],"pending_destroy":[]} 2023-11-04T01:49:02.388 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 5, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [ { "snapInfinityo": { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:48:32.891232+0000" }, "version": 21 } ], "snaps": [] } 2023-11-04T01:49:02.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:49:02.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.511+0000 7f302c33a640 1 Processor -- start 2023-11-04T01:49:02.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.511+0000 7f302c33a640 1 -- start start 2023-11-04T01:49:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.511+0000 7f302c33a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3024160680 0x7f30240cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.511+0000 7f302c33a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 0x7f30240b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.511+0000 7f302c33a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240cf000 con 0x7f3024160a60 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.511+0000 7f302c33a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240d09b0 con 0x7f3024160680 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.511+0000 7f302c33a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30240b5de0 con 0x7f30240ce7f0 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30298d5640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3024160a60 0x7f30240ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51084/0 (socket says 172.21.15.2:51084) 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30298d5640 1 -- 172.21.15.2:0/3883143778 learned_addr learned my addr 172.21.15.2:0/3883143778 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a0d6640 1 --2- 172.21.15.2:0/3883143778 >> v2:172.21.15.90:3300/0 conn(0x7f3024160680 0x7f30240cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 0x7f30240b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977852343 0 0) 0x7f30240cf000 con 0x7f3024160a60 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3010003530 con 0x7f3024160a60 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 872343494 0 0) 0x7f3010003530 con 0x7f3024160a60 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 msgr2=0x7f30240b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 0x7f30240b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 >> v2:172.21.15.90:3300/0 conn(0x7f3024160680 msgr2=0x7f30240cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 --2- 172.21.15.2:0/3883143778 >> v2:172.21.15.90:3300/0 conn(0x7f3024160680 0x7f30240cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240d1610 con 0x7f3024160a60 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3014001680 con 0x7f3024160a60 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 >> v1:172.21.15.2:6789/0 conn(0x7f3024160a60 legacy=0x7f30240ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3010003980 0x7f3010003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 0x7f30100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3010005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240d09b0 con 0x7f3010004d10 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240b5de0 con 0x7f3010003980 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301000b990 con 0x7f30240ce7f0 2023-11-04T01:49:02.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3010005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a0d6640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3010003980 0x7f3010003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30298d5640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 0x7f30100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 -- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 msgr2=0x7f30100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f30240ce7f0 0x7f30100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 -- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3010003980 msgr2=0x7f3010003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3010003980 0x7f3010003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 -- 172.21.15.2:0/3883143778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010003530 con 0x7f3010004d10 2023-11-04T01:49:02.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f302a8d7640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3010005190 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f301c009f90 tx=0x7f301c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a6621294497c3b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0a5c30 con 0x7f3010004d10 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00f040 con 0x7f3010004d10 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.515+0000 7f30290d4640 1 -- 172.21.15.2:0/3883143778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0ad440 con 0x7f3010004d10 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- 172.21.15.2:0/3883143778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 msgr2=0x7f3010005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 --2- 172.21.15.2:0/3883143778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3010005190 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f301c009f90 tx=0x7f301c01cc20 comp rx=0 tx=0).stop 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a8d7640 1 -- 172.21.15.2:0/3883143778 reap_dead start 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- 172.21.15.2:0/3883143778 shutdown_connections 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- 172.21.15.2:0/3883143778 >> 172.21.15.2:0/3883143778 conn(0x7f30240d2f90 msgr2=0x7f30240d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- 172.21.15.2:0/3883143778 shutdown_connections 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- 172.21.15.2:0/3883143778 wait complete. 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 Processor -- start 2023-11-04T01:49:02.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- start start 2023-11-04T01:49:02.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3024156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f302415bed0 0x7f302415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30241f35b0 0x7f3024158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302415ea50 con 0x7f3010004d10 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024156b50 con 0x7f30241f35b0 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30241f2880 con 0x7f302415bed0 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3024156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3024156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56940/0 (socket says 172.21.15.2:56940) 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 -- 172.21.15.2:0/2038553320 learned_addr learned my addr 172.21.15.2:0/2038553320 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a8d7640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30241f35b0 0x7f3024158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f30298d5640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f302415bed0 0x7f302415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 -- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f302415bed0 msgr2=0x7f302415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f302415bed0 0x7f302415dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 -- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30241f35b0 msgr2=0x7f3024158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30241f35b0 0x7f3024158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 -- 172.21.15.2:0/2038553320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024157060 con 0x7f3010004d10 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a8d7640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30241f35b0 0x7f3024158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302a0d6640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3024156610 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3020011640 tx=0x7f3020011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f301affd640 1 -- 172.21.15.2:0/2038553320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000f920 con 0x7f3010004d10 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f301affd640 1 -- 172.21.15.2:0/2038553320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000fa80 con 0x7f3010004d10 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30241f3120 con 0x7f3010004d10 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f301affd640 1 -- 172.21.15.2:0/2038553320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302000fdf0 con 0x7f3010004d10 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.519+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30241f2ad0 con 0x7f3010004d10 2023-11-04T01:49:02.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.523+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302404e4a0 con 0x7f3010004d10 2023-11-04T01:49:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.523+0000 7f301affd640 1 -- 172.21.15.2:0/2038553320 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3020015460 con 0x7f3010004d10 2023-11-04T01:49:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.523+0000 7f301affd640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30080664d0 0x7f3008068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.523+0000 7f301affd640 1 -- 172.21.15.2:0/2038553320 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 7533+0+0 (secure 0 0 0) 0x7f3020084b60 con 0x7f3010004d10 2023-11-04T01:49:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.523+0000 7f30298d5640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30080664d0 0x7f3008068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.523+0000 7f30298d5640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30080664d0 0x7f3008068990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f30240b7050 tx=0x7f3014001440 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.527+0000 7f301affd640 1 -- 172.21.15.2:0/2038553320 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3020051820 con 0x7f3010004d10 2023-11-04T01:49:02.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.747+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7f30240b8630 con 0x7f3010004d10 2023-11-04T01:49:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f301affd640 1 -- 172.21.15.2:0/2038553320 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 5930 v101) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3020054e40 con 0x7f3010004d10 2023-11-04T01:49:02.754 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 5930 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30080664d0 msgr2=0x7f3008068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30080664d0 0x7f3008068990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f30240b7050 tx=0x7f3014001440 comp rx=0 tx=0).stop 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 msgr2=0x7f3024156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3024156610 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3020011640 tx=0x7f3020011b00 comp rx=0 tx=0).stop 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 shutdown_connections 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f30080664d0 0x7f3008068990 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30241f35b0 0x7f3024158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f302415bed0 0x7f302415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 --2- 172.21.15.2:0/2038553320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3010004d10 0x7f3024156610 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 >> 172.21.15.2:0/2038553320 conn(0x7f30240d2f90 msgr2=0x7f30240c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:02.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 shutdown_connections 2023-11-04T01:49:02.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.751+0000 7f302c33a640 1 -- 172.21.15.2:0/2038553320 wait complete. 2023-11-04T01:49:02.778 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-04T01:49:02.778 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-04T01:49:02.778 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T01:49:02.778 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:49:02.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:02.778 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi090 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-11-04T01:49:02.779 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T01:49:02.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-04T01:49:02.781 INFO:tasks.ceph.mds.d:Started 2023-11-04T01:49:02.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:02.857 INFO:tasks.ceph.mds.d.smithi090.stdout:starting mds.d at 2023-11-04T01:49:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe75a7a640 1 Processor -- start 2023-11-04T01:49:02.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe75a7a640 1 -- start start 2023-11-04T01:49:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe75a7a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbe7006bde0 0x7fbe700cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe75a7a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe7006c1c0 0x7fbe701442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe75a7a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe700c9ac0 con 0x7fbe700c92b0 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe75a7a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700caf20 con 0x7fbe7006bde0 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe75a7a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700c97e0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6effd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbe700c92b0 0x7fbe7015c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:46872/0 (socket says 172.21.15.2:46872) 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6effd640 1 -- 172.21.15.2:0/2477326308 learned_addr learned my addr 172.21.15.2:0/2477326308 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6ffff640 1 --2- 172.21.15.2:0/2477326308 >> v2:172.21.15.90:3300/0 conn(0x7fbe7006c1c0 0x7fbe701442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6f7fe640 1 --2- 172.21.15.2:0/2477326308 >> v2:172.21.15.2:3300/0 conn(0x7fbe7006bde0 0x7fbe700cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6e7fc640 1 -- 172.21.15.2:0/2477326308 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547533442 0 0) 0x7fbe700c9ac0 con 0x7fbe700c92b0 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6e7fc640 1 -- 172.21.15.2:0/2477326308 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe5c003530 con 0x7fbe700c92b0 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6ffff640 1 -- 172.21.15.2:0/2477326308 >> v2:172.21.15.2:3300/0 conn(0x7fbe7006bde0 msgr2=0x7fbe700cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6ffff640 1 --2- 172.21.15.2:0/2477326308 >> v2:172.21.15.2:3300/0 conn(0x7fbe7006bde0 0x7fbe700cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6ffff640 1 -- 172.21.15.2:0/2477326308 >> v1:172.21.15.90:6789/0 conn(0x7fbe700c92b0 legacy=0x7fbe7015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6ffff640 1 -- 172.21.15.2:0/2477326308 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700cb1c0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.891+0000 7fbe6f7fe640 1 --2- 172.21.15.2:0/2477326308 >> v2:172.21.15.2:3300/0 conn(0x7fbe7006bde0 0x7fbe700cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:49:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6ffff640 1 --2- 172.21.15.2:0/2477326308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7006c1c0 0x7fbe701442b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbe7015b660 tx=0x7fbe6801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d3500eb10f9909 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6e7fc640 1 -- 172.21.15.2:0/2477326308 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe680a58c0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6e7fc640 1 -- 172.21.15.2:0/2477326308 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe680a5a20 con 0x7fbe7006c1c0 2023-11-04T01:49:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6e7fc640 1 -- 172.21.15.2:0/2477326308 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe680a5db0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- 172.21.15.2:0/2477326308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7006c1c0 msgr2=0x7fbe701442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/2477326308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7006c1c0 0x7fbe701442b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbe7015b660 tx=0x7fbe6801c910 comp rx=0 tx=0).stop 2023-11-04T01:49:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- 172.21.15.2:0/2477326308 shutdown_connections 2023-11-04T01:49:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/2477326308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe7006c1c0 0x7fbe701442b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/2477326308 >> v2:172.21.15.2:3300/0 conn(0x7fbe7006bde0 0x7fbe700cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- 172.21.15.2:0/2477326308 >> 172.21.15.2:0/2477326308 conn(0x7fbe700b0890 msgr2=0x7fbe700b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- 172.21.15.2:0/2477326308 shutdown_connections 2023-11-04T01:49:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- 172.21.15.2:0/2477326308 wait complete. 2023-11-04T01:49:02.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 Processor -- start 2023-11-04T01:49:02.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- start start 2023-11-04T01:49:02.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe7006bde0 0x7fbe7013f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe7006c1c0 0x7fbe700c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe700c92b0 0x7fbe7015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700c8d80 con 0x7fbe7006c1c0 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700c8100 con 0x7fbe700c92b0 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700c83e0 con 0x7fbe7006bde0 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe7006c1c0 0x7fbe700c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe7006c1c0 0x7fbe700c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56964/0 (socket says 172.21.15.2:56964) 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 -- 172.21.15.2:0/1727634041 learned_addr learned my addr 172.21.15.2:0/1727634041 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6ffff640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe700c92b0 0x7fbe7015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6f7fe640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe7006bde0 0x7fbe7013f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 -- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe7006bde0 msgr2=0x7fbe7013f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe7006bde0 0x7fbe7013f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 -- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe700c92b0 msgr2=0x7fbe7015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe700c92b0 0x7fbe7015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 -- 172.21.15.2:0/1727634041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60009420 con 0x7fbe7006c1c0 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe6effd640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe7006c1c0 0x7fbe700c77a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c420 tx=0x7fbe5800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe67fff640 1 -- 172.21.15.2:0/1727634041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58005cf0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe67fff640 1 -- 172.21.15.2:0/1727634041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe58005e50 con 0x7fbe7006c1c0 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.895+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe68009a70 con 0x7fbe7006c1c0 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe67fff640 1 -- 172.21.15.2:0/1727634041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580072d0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe700c89a0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700c8ec0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe67fff640 1 -- 172.21.15.2:0/1727634041 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe58007430 con 0x7fbe7006c1c0 2023-11-04T01:49:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe67fff640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe500664a0 0x7fbe50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe67fff640 1 -- 172.21.15.2:0/1727634041 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7619+0+0 (secure 0 0 0) 0x7fbe58083ec0 con 0x7fbe7006c1c0 2023-11-04T01:49:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe6f7fe640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe500664a0 0x7fbe50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:02.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.899+0000 7fbe6f7fe640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe500664a0 0x7fbe50068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009c80 tx=0x7fbe60008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:02.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:02.903+0000 7fbe67fff640 1 -- 172.21.15.2:0/1727634041 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe58054870 con 0x7fbe7006c1c0 2023-11-04T01:49:03.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.087+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe7004e4a0 con 0x7fbe7006c1c0 2023-11-04T01:49:03.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.087+0000 7fbe67fff640 1 -- 172.21.15.2:0/1727634041 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4139 (secure 0 0 0) 0x7fbe58081e60 con 0x7fbe7006c1c0 2023-11-04T01:49:03.093 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:03.093 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:02.761783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:resolve","state_seq":12,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:03.094 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 102 2023-11-04T01:49:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe500664a0 msgr2=0x7fbe50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe500664a0 0x7fbe50068960 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009c80 tx=0x7fbe60008040 comp rx=0 tx=0).stop 2023-11-04T01:49:03.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe7006c1c0 msgr2=0x7fbe700c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe7006c1c0 0x7fbe700c77a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c420 tx=0x7fbe5800c8e0 comp rx=0 tx=0).stop 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 shutdown_connections 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fbe500664a0 0x7fbe50068960 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe700c92b0 0x7fbe7015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbe7006c1c0 0x7fbe700c77a0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 --2- 172.21.15.2:0/1727634041 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fbe7006bde0 0x7fbe7013f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 >> 172.21.15.2:0/1727634041 conn(0x7fbe700b0890 msgr2=0x7fbe70071130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 shutdown_connections 2023-11-04T01:49:03.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:03.091+0000 7fbe75a7a640 1 -- 172.21.15.2:0/1727634041 wait complete. 2023-11-04T01:49:03.110 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:49:08.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:08.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e6d15640 1 Processor -- start 2023-11-04T01:49:08.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e6d15640 1 -- start start 2023-11-04T01:49:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e6d15640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40e0160680 0x7f40e00cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e6d15640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f40e0160a60 0x7f40e00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e6d15640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e00cf000 con 0x7f40e00b3e30 2023-11-04T01:49:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e6d15640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00b5de0 con 0x7f40e0160680 2023-11-04T01:49:08.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e6d15640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00d1610 con 0x7f40e0160a60 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e4ab1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40e0160680 0x7f40e00cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e4ab1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f40e0160680 0x7f40e00cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56966/0 (socket says 172.21.15.2:56966) 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e4ab1640 1 -- 172.21.15.2:0/3502094140 learned_addr learned my addr 172.21.15.2:0/3502094140 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40dffff640 1 --2- 172.21.15.2:0/3502094140 >> v2:172.21.15.90:3300/0 conn(0x7f40e0160a60 0x7f40e00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e4ab1640 1 -- 172.21.15.2:0/3502094140 >> v2:172.21.15.90:3300/0 conn(0x7f40e0160a60 msgr2=0x7f40e00ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e4ab1640 1 --2- 172.21.15.2:0/3502094140 >> v2:172.21.15.90:3300/0 conn(0x7f40e0160a60 0x7f40e00ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e4ab1640 1 -- 172.21.15.2:0/3502094140 >> v1:172.21.15.2:6789/0 conn(0x7f40e00b3e30 legacy=0x7f40e00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40e4ab1640 1 -- 172.21.15.2:0/3502094140 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00d18f0 con 0x7f40e0160680 2023-11-04T01:49:08.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.246+0000 7f40df7fe640 1 -- 172.21.15.2:0/3502094140 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737731117 0 0) 0x7f40e00cf000 con 0x7f40e00b3e30 2023-11-04T01:49:08.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e4ab1640 1 --2- 172.21.15.2:0/3502094140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e00cdba0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f40e008bc00 tx=0x7f40d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b48b8be99908872 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40df7fe640 1 -- 172.21.15.2:0/3502094140 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00aa430 con 0x7f40e0160680 2023-11-04T01:49:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40df7fe640 1 -- 172.21.15.2:0/3502094140 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d00aa590 con 0x7f40e0160680 2023-11-04T01:49:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40df7fe640 1 -- 172.21.15.2:0/3502094140 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00aa920 con 0x7f40e0160680 2023-11-04T01:49:08.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- 172.21.15.2:0/3502094140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 msgr2=0x7f40e00cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 --2- 172.21.15.2:0/3502094140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e00cdba0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f40e008bc00 tx=0x7f40d001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- 172.21.15.2:0/3502094140 shutdown_connections 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 --2- 172.21.15.2:0/3502094140 >> v2:172.21.15.90:3300/0 conn(0x7f40e0160a60 0x7f40e00ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 --2- 172.21.15.2:0/3502094140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e00cdba0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- 172.21.15.2:0/3502094140 >> 172.21.15.2:0/3502094140 conn(0x7f40e00d2f90 msgr2=0x7f40e00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- 172.21.15.2:0/3502094140 shutdown_connections 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- 172.21.15.2:0/3502094140 wait complete. 2023-11-04T01:49:08.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 Processor -- start 2023-11-04T01:49:08.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- start start 2023-11-04T01:49:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e00b3e30 0x7f40e00c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e006b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40e0160a60 0x7f40e006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00c9e80 con 0x7f40e0160680 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0156a40 con 0x7f40e00b3e30 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e6d15640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0156d20 con 0x7f40e0160a60 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e006b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e006b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56968/0 (socket says 172.21.15.2:56968) 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 -- 172.21.15.2:0/4282249144 learned_addr learned my addr 172.21.15.2:0/4282249144 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e52b2640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40e0160a60 0x7f40e006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e4ab1640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e00b3e30 0x7f40e00c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 -- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40e0160a60 msgr2=0x7f40e006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40e0160a60 0x7f40e006b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 -- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e00b3e30 msgr2=0x7f40e00c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e00b3e30 0x7f40e00c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40dffff640 1 -- 172.21.15.2:0/4282249144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00094d0 con 0x7f40e0160680 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.250+0000 7f40e52b2640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40e0160a60 0x7f40e006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40dffff640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e006b3b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007e40 tx=0x7f40c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40dd7fa640 1 -- 172.21.15.2:0/4282249144 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8014620 con 0x7f40e0160680 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40dd7fa640 1 -- 172.21.15.2:0/4282249144 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800ee90 con 0x7f40e0160680 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e0157000 con 0x7f40e0160680 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40dd7fa640 1 -- 172.21.15.2:0/4282249144 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80149c0 con 0x7f40e0160680 2023-11-04T01:49:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e00c7a00 con 0x7f40e0160680 2023-11-04T01:49:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e004e4a0 con 0x7f40e0160680 2023-11-04T01:49:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40dd7fa640 1 -- 172.21.15.2:0/4282249144 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40c8014b20 con 0x7f40e0160680 2023-11-04T01:49:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40dd7fa640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c00664a0 0x7f40c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40dd7fa640 1 -- 172.21.15.2:0/4282249144 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7619+0+0 (secure 0 0 0) 0x7f40c8084ee0 con 0x7f40e0160680 2023-11-04T01:49:08.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40e4ab1640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c00664a0 0x7f40c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.254+0000 7f40e4ab1640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c00664a0 0x7f40c0068960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f40d00ae000 tx=0x7f40d00b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:08.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.258+0000 7f40dd7fa640 1 -- 172.21.15.2:0/4282249144 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40c8051bd0 con 0x7f40e0160680 2023-11-04T01:49:08.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.446+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e006c600 con 0x7f40e0160680 2023-11-04T01:49:08.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.446+0000 7f40dd7fa640 1 -- 172.21.15.2:0/4282249144 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4936 (secure 0 0 0) 0x7f40c80551f0 con 0x7f40e0160680 2023-11-04T01:49:08.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:08.449 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:03.780140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:08.449 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 104 2023-11-04T01:49:08.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c00664a0 msgr2=0x7f40c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c00664a0 0x7f40c0068960 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f40d00ae000 tx=0x7f40d00b5040 comp rx=0 tx=0).stop 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 msgr2=0x7f40e006b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e006b3b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007e40 tx=0x7f40c800e4b0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 shutdown_connections 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f40c00664a0 0x7f40c0068960 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f40e0160a60 0x7f40e006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40e0160680 0x7f40e006b3b0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 --2- 172.21.15.2:0/4282249144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f40e00b3e30 0x7f40e00c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 >> 172.21.15.2:0/4282249144 conn(0x7f40e00d2f90 msgr2=0x7f40e00b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 shutdown_connections 2023-11-04T01:49:08.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.450+0000 7f40e6d15640 1 -- 172.21.15.2:0/4282249144 wait complete. 2023-11-04T01:49:08.468 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:49:08.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:08.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-04T01:49:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff845b3b640 1 Processor -- start 2023-11-04T01:49:08.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff845b3b640 1 -- start start 2023-11-04T01:49:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff845b3b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff84006bde0 0x7ff8400cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff845b3b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8400c92b0 0x7ff84015c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff845b3b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400c9ac0 con 0x7ff84006c1c0 2023-11-04T01:49:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff845b3b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400caf20 con 0x7ff8400c92b0 2023-11-04T01:49:08.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff845b3b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84015c5d0 con 0x7ff84006bde0 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff83effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8400c92b0 0x7ff84015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff83effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff8400c92b0 0x7ff84015c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56982/0 (socket says 172.21.15.2:56982) 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.590+0000 7ff83effd640 1 -- 172.21.15.2:0/3469028394 learned_addr learned my addr 172.21.15.2:0/3469028394 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83f7fe640 1 --2- 172.21.15.2:0/3469028394 >> v2:172.21.15.90:3300/0 conn(0x7ff84006bde0 0x7ff8400cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83effd640 1 -- 172.21.15.2:0/3469028394 >> v2:172.21.15.90:3300/0 conn(0x7ff84006bde0 msgr2=0x7ff8400cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83effd640 1 --2- 172.21.15.2:0/3469028394 >> v2:172.21.15.90:3300/0 conn(0x7ff84006bde0 0x7ff8400cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83effd640 1 -- 172.21.15.2:0/3469028394 >> v1:172.21.15.90:6789/0 conn(0x7ff84006c1c0 legacy=0x7ff8401442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83effd640 1 -- 172.21.15.2:0/3469028394 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400c97e0 con 0x7ff8400c92b0 2023-11-04T01:49:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83effd640 1 --2- 172.21.15.2:0/3469028394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff84015c090 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7ff84006dcf0 tx=0x7ff82801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fd2867b4de6dbf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83e7fc640 1 -- 172.21.15.2:0/3469028394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280ab600 con 0x7ff8400c92b0 2023-11-04T01:49:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83e7fc640 1 -- 172.21.15.2:0/3469028394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8280a7050 con 0x7ff8400c92b0 2023-11-04T01:49:08.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff83e7fc640 1 -- 172.21.15.2:0/3469028394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280ab980 con 0x7ff8400c92b0 2023-11-04T01:49:08.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 -- 172.21.15.2:0/3469028394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 msgr2=0x7ff84015c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 --2- 172.21.15.2:0/3469028394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff84015c090 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7ff84006dcf0 tx=0x7ff82801c4c0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 -- 172.21.15.2:0/3469028394 shutdown_connections 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 --2- 172.21.15.2:0/3469028394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff84015c090 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 --2- 172.21.15.2:0/3469028394 >> v2:172.21.15.90:3300/0 conn(0x7ff84006bde0 0x7ff8400cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 -- 172.21.15.2:0/3469028394 >> 172.21.15.2:0/3469028394 conn(0x7ff8400b0890 msgr2=0x7ff8400b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 -- 172.21.15.2:0/3469028394 shutdown_connections 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.594+0000 7ff845b3b640 1 -- 172.21.15.2:0/3469028394 wait complete. 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 Processor -- start 2023-11-04T01:49:08.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 -- start start 2023-11-04T01:49:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff84006bde0 0x7ff840070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff84006c1c0 0x7ff84012f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff8400c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840071330 con 0x7ff8400c92b0 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401f9b10 con 0x7ff84006bde0 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401f9df0 con 0x7ff84006c1c0 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff8400c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff8400c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56986/0 (socket says 172.21.15.2:56986) 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 -- 172.21.15.2:0/38673687 learned_addr learned my addr 172.21.15.2:0/38673687 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83f7fe640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff84006bde0 0x7ff840070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83effd640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff84006c1c0 0x7ff84012f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 -- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff84006c1c0 msgr2=0x7ff84012f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff84006c1c0 0x7ff84012f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 -- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff84006bde0 msgr2=0x7ff840070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff84006bde0 0x7ff840070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 -- 172.21.15.2:0/38673687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280094d0 con 0x7ff8400c92b0 2023-11-04T01:49:08.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83effd640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff84006c1c0 0x7ff84012f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:08.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff83ffff640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff8400c4340 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c3c0 tx=0x7ff83000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:08.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff837fff640 1 -- 172.21.15.2:0/38673687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830011790 con 0x7ff8400c92b0 2023-11-04T01:49:08.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff837fff640 1 -- 172.21.15.2:0/38673687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8300118f0 con 0x7ff8400c92b0 2023-11-04T01:49:08.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff837fff640 1 -- 172.21.15.2:0/38673687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830011ca0 con 0x7ff8400c92b0 2023-11-04T01:49:08.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8401fa0d0 con 0x7ff8400c92b0 2023-11-04T01:49:08.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84012f990 con 0x7ff8400c92b0 2023-11-04T01:49:08.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84004e4a0 con 0x7ff8400c92b0 2023-11-04T01:49:08.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff837fff640 1 -- 172.21.15.2:0/38673687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff83001c460 con 0x7ff8400c92b0 2023-11-04T01:49:08.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.598+0000 7ff837fff640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff8200664a0 0x7ff820068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:08.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.602+0000 7ff837fff640 1 -- 172.21.15.2:0/38673687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7619+0+0 (secure 0 0 0) 0x7ff8300844b0 con 0x7ff8400c92b0 2023-11-04T01:49:08.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.602+0000 7ff83f7fe640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff8200664a0 0x7ff820068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:08.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.602+0000 7ff83f7fe640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff8200664a0 0x7ff820068960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff838003fd0 tx=0x7ff8380039c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:08.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.606+0000 7ff837fff640 1 -- 172.21.15.2:0/38673687 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8300511a0 con 0x7ff8400c92b0 2023-11-04T01:49:08.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.790+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8400b4c40 con 0x7ff8400c92b0 2023-11-04T01:49:08.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff837fff640 1 -- 172.21.15.2:0/38673687 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4936 (secure 0 0 0) 0x7ff8300547c0 con 0x7ff8400c92b0 2023-11-04T01:49:08.793 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:08.793 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:03.780140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:08.794 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 104 2023-11-04T01:49:08.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff8200664a0 msgr2=0x7ff820068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff8200664a0 0x7ff820068960 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff838003fd0 tx=0x7ff8380039c0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 msgr2=0x7ff8400c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff8400c4340 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c3c0 tx=0x7ff83000c880 comp rx=0 tx=0).stop 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 shutdown_connections 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff8200664a0 0x7ff820068960 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8400c92b0 0x7ff8400c4340 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff84006c1c0 0x7ff84012f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 --2- 172.21.15.2:0/38673687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff84006bde0 0x7ff840070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 >> 172.21.15.2:0/38673687 conn(0x7ff8400b0890 msgr2=0x7ff8400cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 shutdown_connections 2023-11-04T01:49:08.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:08.794+0000 7ff845b3b640 1 -- 172.21.15.2:0/38673687 wait complete. 2023-11-04T01:49:08.811 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:49:09.812 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:09.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb3414e640 1 Processor -- start 2023-11-04T01:49:09.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb3414e640 1 -- start start 2023-11-04T01:49:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb3414e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb2c1605b0 0x7ffb2c0cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb3414e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb3414e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c0d3e20 con 0x7ffb2c0ce570 2023-11-04T01:49:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb3414e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0d1b30 con 0x7ffb2c1605b0 2023-11-04T01:49:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb3414e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0d1e10 con 0x7ffb2c0d1560 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb31eea640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffb2c1605b0 0x7ffb2c0cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb326eb640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffb2c0ce570 0x7ffb2c0cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51106/0 (socket says 172.21.15.2:51106) 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb326eb640 1 -- 172.21.15.2:0/1880697799 learned_addr learned my addr 172.21.15.2:0/1880697799 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb31eea640 1 --2- 172.21.15.2:0/1880697799 >> v2:172.21.15.2:3300/0 conn(0x7ffb2c1605b0 0x7ffb2c0cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56988/0 (socket says 172.21.15.2:56988) 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb316e9640 1 --2- 172.21.15.2:0/1880697799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb31eea640 1 -- 172.21.15.2:0/1880697799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 msgr2=0x7ffb2c0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb31eea640 1 --2- 172.21.15.2:0/1880697799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb31eea640 1 -- 172.21.15.2:0/1880697799 >> v1:172.21.15.2:6789/0 conn(0x7ffb2c0ce570 legacy=0x7ffb2c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb31eea640 1 -- 172.21.15.2:0/1880697799 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0b29e0 con 0x7ffb2c1605b0 2023-11-04T01:49:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.946+0000 7ffb30ee8640 1 -- 172.21.15.2:0/1880697799 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337332372 0 0) 0x7ffb2c0d3e20 con 0x7ffb2c0ce570 2023-11-04T01:49:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb31eea640 1 --2- 172.21.15.2:0/1880697799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c0cdaf0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009d90 tx=0x7ffb2801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a003f75a4adae7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb30ee8640 1 -- 172.21.15.2:0/1880697799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280af600 con 0x7ffb2c1605b0 2023-11-04T01:49:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb30ee8640 1 -- 172.21.15.2:0/1880697799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb280ab050 con 0x7ffb2c1605b0 2023-11-04T01:49:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb30ee8640 1 -- 172.21.15.2:0/1880697799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280af980 con 0x7ffb2c1605b0 2023-11-04T01:49:09.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- 172.21.15.2:0/1880697799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 msgr2=0x7ffb2c0cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 --2- 172.21.15.2:0/1880697799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c0cdaf0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009d90 tx=0x7ffb2801f130 comp rx=0 tx=0).stop 2023-11-04T01:49:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- 172.21.15.2:0/1880697799 shutdown_connections 2023-11-04T01:49:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 --2- 172.21.15.2:0/1880697799 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 --2- 172.21.15.2:0/1880697799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c0cdaf0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- 172.21.15.2:0/1880697799 >> 172.21.15.2:0/1880697799 conn(0x7ffb2c0d2fe0 msgr2=0x7ffb2c0d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- 172.21.15.2:0/1880697799 shutdown_connections 2023-11-04T01:49:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- 172.21.15.2:0/1880697799 wait complete. 2023-11-04T01:49:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 Processor -- start 2023-11-04T01:49:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- start start 2023-11-04T01:49:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0ce570 0x7ffb2c0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c14f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c14fda0 con 0x7ffb2c1605b0 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0cb820 con 0x7ffb2c0ce570 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb3414e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0cba70 con 0x7ffb2c0d1560 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c14f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56992/0 (socket says 172.21.15.2:56992) 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 -- 172.21.15.2:0/2261786259 learned_addr learned my addr 172.21.15.2:0/2261786259 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb31eea640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0ce570 0x7ffb2c0b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb316e9640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 -- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 msgr2=0x7ffb2c14f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:09.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c14f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 -- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0ce570 msgr2=0x7ffb2c0b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0ce570 0x7ffb2c0b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.950+0000 7ffb326eb640 1 -- 172.21.15.2:0/2261786259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28009a70 con 0x7ffb2c1605b0 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb326eb640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c14f860 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c480 tx=0x7ffb2400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb227fc640 1 -- 172.21.15.2:0/2261786259 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240074e0 con 0x7ffb2c1605b0 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb227fc640 1 -- 172.21.15.2:0/2261786259 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb24007640 con 0x7ffb2c1605b0 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c0cbd50 con 0x7ffb2c1605b0 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb227fc640 1 -- 172.21.15.2:0/2261786259 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb24004a10 con 0x7ffb2c1605b0 2023-11-04T01:49:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c0cc310 con 0x7ffb2c1605b0 2023-11-04T01:49:09.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c067610 con 0x7ffb2c1605b0 2023-11-04T01:49:09.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb227fc640 1 -- 172.21.15.2:0/2261786259 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffb24004b70 con 0x7ffb2c1605b0 2023-11-04T01:49:09.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb227fc640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb100664a0 0x7ffb10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:09.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb227fc640 1 -- 172.21.15.2:0/2261786259 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7619+0+0 (secure 0 0 0) 0x7ffb24083760 con 0x7ffb2c1605b0 2023-11-04T01:49:09.956 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb31eea640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb100664a0 0x7ffb10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:09.957 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.954+0000 7ffb31eea640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb100664a0 0x7ffb10068960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b1000 tx=0x7ffb280aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:09.958+0000 7ffb227fc640 1 -- 172.21.15.2:0/2261786259 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffb24050500 con 0x7ffb2c1605b0 2023-11-04T01:49:10.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.146+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb2c0d2dc0 con 0x7ffb2c1605b0 2023-11-04T01:49:10.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb227fc640 1 -- 172.21.15.2:0/2261786259 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4936 (secure 0 0 0) 0x7ffb24053b20 con 0x7ffb2c1605b0 2023-11-04T01:49:10.150 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:10.150 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:03.780140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:10.150 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 104 2023-11-04T01:49:10.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb100664a0 msgr2=0x7ffb10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:10.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb100664a0 0x7ffb10068960 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb280b1000 tx=0x7ffb280aa000 comp rx=0 tx=0).stop 2023-11-04T01:49:10.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 msgr2=0x7ffb2c14f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c14f860 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c480 tx=0x7ffb2400c940 comp rx=0 tx=0).stop 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 shutdown_connections 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffb100664a0 0x7ffb10068960 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb2c1605b0 0x7ffb2c14f860 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffb2c0d1560 0x7ffb2c14f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 --2- 172.21.15.2:0/2261786259 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb2c0ce570 0x7ffb2c0b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 >> 172.21.15.2:0/2261786259 conn(0x7ffb2c0d2fe0 msgr2=0x7ffb2c06c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 shutdown_connections 2023-11-04T01:49:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:10.150+0000 7ffb3414e640 1 -- 172.21.15.2:0/2261786259 wait complete. 2023-11-04T01:49:10.170 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:49:11.171 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 Processor -- start 2023-11-04T01:49:11.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 -- start start 2023-11-04T01:49:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff494160680 0x7ff4940cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff494160a60 0x7ff4940ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:11.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff4940b3e30 0x7ff4940ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940ceb60 con 0x7ff494160680 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940cf000 con 0x7ff4940b3e30 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49c7a1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b5de0 con 0x7ff494160a60 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff494160680 0x7ff4940cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff494160680 0x7ff4940cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37484/0 (socket says 172.21.15.2:37484) 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 -- 172.21.15.2:0/1137302428 learned_addr learned my addr 172.21.15.2:0/1137302428 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49ad3e640 1 --2- 172.21.15.2:0/1137302428 >> v2:172.21.15.90:3300/0 conn(0x7ff4940b3e30 0x7ff4940ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff499d3c640 1 --2- 172.21.15.2:0/1137302428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff494160a60 0x7ff4940ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 -- 172.21.15.2:0/1137302428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff494160a60 msgr2=0x7ff4940ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 --2- 172.21.15.2:0/1137302428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff494160a60 0x7ff4940ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 -- 172.21.15.2:0/1137302428 >> v2:172.21.15.90:3300/0 conn(0x7ff4940b3e30 msgr2=0x7ff4940ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 --2- 172.21.15.2:0/1137302428 >> v2:172.21.15.90:3300/0 conn(0x7ff4940b3e30 0x7ff4940ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.306+0000 7ff49a53d640 1 -- 172.21.15.2:0/1137302428 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940d1610 con 0x7ff494160680 2023-11-04T01:49:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49a53d640 1 --2- 172.21.15.2:0/1137302428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160680 0x7ff4940cdba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff49408bc00 tx=0x7ff48801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb66deb44fb691b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49953b640 1 -- 172.21.15.2:0/1137302428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940d09b0 con 0x7ff494160680 2023-11-04T01:49:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49953b640 1 -- 172.21.15.2:0/1137302428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880ab600 con 0x7ff494160680 2023-11-04T01:49:11.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49953b640 1 -- 172.21.15.2:0/1137302428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880ab990 con 0x7ff494160680 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- 172.21.15.2:0/1137302428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160680 msgr2=0x7ff4940cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/1137302428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160680 0x7ff4940cdba0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff49408bc00 tx=0x7ff48801c440 comp rx=0 tx=0).stop 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- 172.21.15.2:0/1137302428 shutdown_connections 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/1137302428 >> v2:172.21.15.90:3300/0 conn(0x7ff4940b3e30 0x7ff4940ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/1137302428 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff494160a60 0x7ff4940ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/1137302428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160680 0x7ff4940cdba0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- 172.21.15.2:0/1137302428 >> 172.21.15.2:0/1137302428 conn(0x7ff4940d2f90 msgr2=0x7ff4940d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:11.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- 172.21.15.2:0/1137302428 shutdown_connections 2023-11-04T01:49:11.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- 172.21.15.2:0/1137302428 wait complete. 2023-11-04T01:49:11.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 Processor -- start 2023-11-04T01:49:11.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- start start 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3e30 0x7ff49414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff494160680 0x7ff4941564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160a60 0x7ff494151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49414b310 con 0x7ff494160a60 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49415b420 con 0x7ff494160680 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49c7a1640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49415b700 con 0x7ff4940b3e30 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49ad3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160a60 0x7ff494151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49ad3e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160a60 0x7ff494151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37496/0 (socket says 172.21.15.2:37496) 2023-11-04T01:49:11.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.310+0000 7ff49ad3e640 1 -- 172.21.15.2:0/4265075092 learned_addr learned my addr 172.21.15.2:0/4265075092 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff499d3c640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff494160680 0x7ff4941564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49a53d640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3e30 0x7ff49414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49ad3e640 1 -- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3e30 msgr2=0x7ff49414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49ad3e640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3e30 0x7ff49414a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49ad3e640 1 -- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff494160680 msgr2=0x7ff4941564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49ad3e640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff494160680 0x7ff4941564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49ad3e640 1 -- 172.21.15.2:0/4265075092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880094d0 con 0x7ff494160a60 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49ad3e640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160a60 0x7ff494151850 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00d800 tx=0x7ff48c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff486ffd640 1 -- 172.21.15.2:0/4265075092 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0096c0 con 0x7ff494160a60 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff486ffd640 1 -- 172.21.15.2:0/4265075092 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c009820 con 0x7ff494160a60 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff486ffd640 1 -- 172.21.15.2:0/4265075092 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c009bd0 con 0x7ff494160a60 2023-11-04T01:49:11.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49414acc0 con 0x7ff494160a60 2023-11-04T01:49:11.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49414a9d0 con 0x7ff494160a60 2023-11-04T01:49:11.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49414b4c0 con 0x7ff494160a60 2023-11-04T01:49:11.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff486ffd640 1 -- 172.21.15.2:0/4265075092 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff48c009d30 con 0x7ff494160a60 2023-11-04T01:49:11.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff486ffd640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4780664a0 0x7ff478068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:11.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff486ffd640 1 -- 172.21.15.2:0/4265075092 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 7619+0+0 (secure 0 0 0) 0x7ff48c084b90 con 0x7ff494160a60 2023-11-04T01:49:11.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49a53d640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4780664a0 0x7ff478068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:11.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.314+0000 7ff49a53d640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4780664a0 0x7ff478068960 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff4880af000 tx=0x7ff4880b6040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:11.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.318+0000 7ff486ffd640 1 -- 172.21.15.2:0/4265075092 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff48c051940 con 0x7ff494160a60 2023-11-04T01:49:11.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.510+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff49404e4a0 con 0x7ff494160a60 2023-11-04T01:49:11.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.510+0000 7ff486ffd640 1 -- 172.21.15.2:0/4265075092 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4936 (secure 0 0 0) 0x7ff48c00b3c0 con 0x7ff494160a60 2023-11-04T01:49:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:11.513 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:03.780140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:11.513 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 104 2023-11-04T01:49:11.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4780664a0 msgr2=0x7ff478068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:11.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4780664a0 0x7ff478068960 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff4880af000 tx=0x7ff4880b6040 comp rx=0 tx=0).stop 2023-11-04T01:49:11.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160a60 msgr2=0x7ff494151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:11.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160a60 0x7ff494151850 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00d800 tx=0x7ff48c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 shutdown_connections 2023-11-04T01:49:11.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff4780664a0 0x7ff478068960 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff494160a60 0x7ff494151850 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff494160680 0x7ff4941564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 --2- 172.21.15.2:0/4265075092 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff4940b3e30 0x7ff49414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:11.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 >> 172.21.15.2:0/4265075092 conn(0x7ff4940d2f90 msgr2=0x7ff4941590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:11.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 shutdown_connections 2023-11-04T01:49:11.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:11.514+0000 7ff49c7a1640 1 -- 172.21.15.2:0/4265075092 wait complete. 2023-11-04T01:49:11.533 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:49:12.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:12.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.666+0000 7f373414e640 1 Processor -- start 2023-11-04T01:49:12.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f373414e640 1 -- start start 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f373414e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f372c142ad0 0x7f372c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f373414e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f372c142eb0 0x7f372c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f373414e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372c0ca100 con 0x7f372c0caec0 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f373414e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c0ca3e0 con 0x7f372c142ad0 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f373414e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c0ca6c0 con 0x7f372c142eb0 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f37326eb640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f372c0caec0 0x7f372c0cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53242/0 (socket says 172.21.15.2:53242) 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f37326eb640 1 -- 172.21.15.2:0/4082744283 learned_addr learned my addr 172.21.15.2:0/4082744283 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:12.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3731eea640 1 --2- 172.21.15.2:0/4082744283 >> v2:172.21.15.2:3300/0 conn(0x7f372c142ad0 0x7f372c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f37316e9640 1 --2- 172.21.15.2:0/4082744283 >> v2:172.21.15.90:3300/0 conn(0x7f372c142eb0 0x7f372c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3730ee8640 1 -- 172.21.15.2:0/4082744283 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620369347 0 0) 0x7f372c0ca100 con 0x7f372c0caec0 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3730ee8640 1 -- 172.21.15.2:0/4082744283 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3718005740 con 0x7f372c0caec0 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3731eea640 1 -- 172.21.15.2:0/4082744283 >> v2:172.21.15.90:3300/0 conn(0x7f372c142eb0 msgr2=0x7f372c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3731eea640 1 --2- 172.21.15.2:0/4082744283 >> v2:172.21.15.90:3300/0 conn(0x7f372c142eb0 0x7f372c0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3731eea640 1 -- 172.21.15.2:0/4082744283 >> v1:172.21.15.2:6789/0 conn(0x7f372c0caec0 legacy=0x7f372c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3731eea640 1 -- 172.21.15.2:0/4082744283 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c0ca9a0 con 0x7f372c142ad0 2023-11-04T01:49:12.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f37316e9640 1 --2- 172.21.15.2:0/4082744283 >> v2:172.21.15.90:3300/0 conn(0x7f372c142eb0 0x7f372c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:12.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.670+0000 7f3731eea640 1 --2- 172.21.15.2:0/4082744283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c15e4e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f372c0c5ce0 tx=0x7f372801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5553ab9894236 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:12.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f3730ee8640 1 -- 172.21.15.2:0/4082744283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37280ab5f0 con 0x7f372c142ad0 2023-11-04T01:49:12.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f3730ee8640 1 -- 172.21.15.2:0/4082744283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37280ab750 con 0x7f372c142ad0 2023-11-04T01:49:12.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f3730ee8640 1 -- 172.21.15.2:0/4082744283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37280abae0 con 0x7f372c142ad0 2023-11-04T01:49:12.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- 172.21.15.2:0/4082744283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 msgr2=0x7f372c15e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:12.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 --2- 172.21.15.2:0/4082744283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c15e4e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f372c0c5ce0 tx=0x7f372801c3d0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- 172.21.15.2:0/4082744283 shutdown_connections 2023-11-04T01:49:12.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 --2- 172.21.15.2:0/4082744283 >> v2:172.21.15.90:3300/0 conn(0x7f372c142eb0 0x7f372c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 --2- 172.21.15.2:0/4082744283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c15e4e0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- 172.21.15.2:0/4082744283 >> 172.21.15.2:0/4082744283 conn(0x7f372c0b0890 msgr2=0x7f372c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- 172.21.15.2:0/4082744283 shutdown_connections 2023-11-04T01:49:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- 172.21.15.2:0/4082744283 wait complete. 2023-11-04T01:49:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 Processor -- start 2023-11-04T01:49:12.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- start start 2023-11-04T01:49:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f372c0caec0 0x7f372c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c06bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f372c142eb0 0x7f372c06c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0b3350 con 0x7f372c142ad0 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0b1ec0 con 0x7f372c142eb0 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0b35f0 con 0x7f372c0caec0 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c06bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c06bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37502/0 (socket says 172.21.15.2:37502) 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 -- 172.21.15.2:0/754416039 learned_addr learned my addr 172.21.15.2:0/754416039 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37326eb640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f372c142eb0 0x7f372c06c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f3731eea640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f372c0caec0 0x7f372c0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 -- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f372c0caec0 msgr2=0x7f372c0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f372c0caec0 0x7f372c0b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 -- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f372c142eb0 msgr2=0x7f372c06c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f372c142eb0 0x7f372c06c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 -- 172.21.15.2:0/754416039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3728009420 con 0x7f372c142ad0 2023-11-04T01:49:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f3731eea640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f372c0caec0 0x7f372c0b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37316e9640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c06bb80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f371c00d800 tx=0x7f371c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37227fc640 1 -- 172.21.15.2:0/754416039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0096c0 con 0x7f372c142ad0 2023-11-04T01:49:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37227fc640 1 -- 172.21.15.2:0/754416039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c009820 con 0x7f372c142ad0 2023-11-04T01:49:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f37227fc640 1 -- 172.21.15.2:0/754416039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c009bd0 con 0x7f372c142ad0 2023-11-04T01:49:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c0b38d0 con 0x7f372c142ad0 2023-11-04T01:49:12.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.674+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c0b3e90 con 0x7f372c142ad0 2023-11-04T01:49:12.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.678+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c04e4a0 con 0x7f372c142ad0 2023-11-04T01:49:12.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.678+0000 7f37227fc640 1 -- 172.21.15.2:0/754416039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f371c009d30 con 0x7f372c142ad0 2023-11-04T01:49:12.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.678+0000 7f37227fc640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37100664a0 0x7f3710068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:12.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.678+0000 7f37227fc640 1 -- 172.21.15.2:0/754416039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f371c084dc0 con 0x7f372c142ad0 2023-11-04T01:49:12.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.678+0000 7f3731eea640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37100664a0 0x7f3710068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:12.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.678+0000 7f3731eea640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37100664a0 0x7f3710068960 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f37280af000 tx=0x7f3728008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:12.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.682+0000 7f37227fc640 1 -- 172.21.15.2:0/754416039 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f371c051a00 con 0x7f372c142ad0 2023-11-04T01:49:12.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.870+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f372c1369c0 con 0x7f372c142ad0 2023-11-04T01:49:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.870+0000 7f37227fc640 1 -- 172.21.15.2:0/754416039 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4936 (secure 0 0 0) 0x7f371c055020 con 0x7f372c142ad0 2023-11-04T01:49:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:12.873 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:03.780140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:reconnect","state_seq":14,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:12.873 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 104 2023-11-04T01:49:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37100664a0 msgr2=0x7f3710068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37100664a0 0x7f3710068960 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f37280af000 tx=0x7f3728008040 comp rx=0 tx=0).stop 2023-11-04T01:49:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 msgr2=0x7f372c06bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c06bb80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f371c00d800 tx=0x7f371c00dcc0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 shutdown_connections 2023-11-04T01:49:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f37100664a0 0x7f3710068960 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f372c142eb0 0x7f372c06c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f372c142ad0 0x7f372c06bb80 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 --2- 172.21.15.2:0/754416039 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f372c0caec0 0x7f372c0b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 >> 172.21.15.2:0/754416039 conn(0x7f372c0b0890 msgr2=0x7f372c136ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 shutdown_connections 2023-11-04T01:49:12.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:12.874+0000 7f373414e640 1 -- 172.21.15.2:0/754416039 wait complete. 2023-11-04T01:49:12.891 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:49:13.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:14.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe56350f640 1 Processor -- start 2023-11-04T01:49:14.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe56350f640 1 -- start start 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe56350f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 0x7fe55c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe56350f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe55c0b27d0 0x7fe55c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe56350f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c15ea70 con 0x7fe55c15b9c0 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe56350f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c0b2c90 con 0x7fe55c0b27d0 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe56350f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0b2f70 con 0x7fe55c0b5ef0 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe55c15b9c0 0x7fe55c15ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53252/0 (socket says 172.21.15.2:53252) 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 -- 172.21.15.2:0/2595631578 learned_addr learned my addr 172.21.15.2:0/2595631578 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:14.027 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe5612ab640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 0x7fe55c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.028 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe560aaa640 1 --2- 172.21.15.2:0/2595631578 >> v2:172.21.15.90:3300/0 conn(0x7fe55c0b27d0 0x7fe55c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499172828 0 0) 0x7fe55c15ea70 con 0x7fe55c15b9c0 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe548003530 con 0x7fe55c15b9c0 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 855776091 0 0) 0x7fe548003530 con 0x7fe55c15b9c0 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 msgr2=0x7fe55c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 0x7fe55c0ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 >> v2:172.21.15.90:3300/0 conn(0x7fe55c0b27d0 msgr2=0x7fe55c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 --2- 172.21.15.2:0/2595631578 >> v2:172.21.15.90:3300/0 conn(0x7fe55c0b27d0 0x7fe55c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0b3250 con 0x7fe55c15b9c0 2023-11-04T01:49:14.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fe554001a00 con 0x7fe55c15b9c0 2023-11-04T01:49:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 >> v1:172.21.15.2:6789/0 conn(0x7fe55c15b9c0 legacy=0x7fe55c15ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548003980 0x7fe548003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 0x7fe5480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe548004d10 0x7fe548005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0b2c90 con 0x7fe548004d10 2023-11-04T01:49:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0b2f70 con 0x7fe548003980 2023-11-04T01:49:14.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54800b990 con 0x7fe55c0b5ef0 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe548004d10 0x7fe548005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe5612ab640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548003980 0x7fe548003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe560aaa640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 0x7fe5480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 -- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 msgr2=0x7fe5480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b5ef0 0x7fe5480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 -- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548003980 msgr2=0x7fe548003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548003980 0x7fe548003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe561aac640 1 -- 172.21.15.2:0/2595631578 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548003530 con 0x7fe548004d10 2023-11-04T01:49:14.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.026+0000 7fe5612ab640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548003980 0x7fe548003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe561aac640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe548004d10 0x7fe548005190 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe55c15be30 tx=0x7fe55401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21378fe288b12458 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540ad630 con 0x7fe548004d10 2023-11-04T01:49:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5540a8070 con 0x7fe548004d10 2023-11-04T01:49:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe553fff640 1 -- 172.21.15.2:0/2595631578 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540ad9d0 con 0x7fe548004d10 2023-11-04T01:49:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 -- 172.21.15.2:0/2595631578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe548004d10 msgr2=0x7fe548005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 --2- 172.21.15.2:0/2595631578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe548004d10 0x7fe548005190 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe55c15be30 tx=0x7fe55401d300 comp rx=0 tx=0).stop 2023-11-04T01:49:14.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe561aac640 1 -- 172.21.15.2:0/2595631578 reap_dead start 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 -- 172.21.15.2:0/2595631578 shutdown_connections 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 -- 172.21.15.2:0/2595631578 >> 172.21.15.2:0/2595631578 conn(0x7fe55c06a130 msgr2=0x7fe55c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 -- 172.21.15.2:0/2595631578 shutdown_connections 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 -- 172.21.15.2:0/2595631578 wait complete. 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 Processor -- start 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.030+0000 7fe56350f640 1 -- start start 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548004d10 0x7fe55c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe55c0c6170 0x7fe55c06c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b3a50 0x7fe55c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c06b240 con 0x7fe55c0c6170 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0b43f0 con 0x7fe548004d10 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1547e0 con 0x7fe55c0b3a50 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe55c0c6170 0x7fe55c06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe55c0c6170 0x7fe55c06c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37524/0 (socket says 172.21.15.2:37524) 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 -- 172.21.15.2:0/3280230934 learned_addr learned my addr 172.21.15.2:0/3280230934 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe561aac640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b3a50 0x7fe55c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe5612ab640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548004d10 0x7fe55c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 -- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b3a50 msgr2=0x7fe55c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b3a50 0x7fe55c0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 -- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548004d10 msgr2=0x7fe55c1542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548004d10 0x7fe55c1542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 -- 172.21.15.2:0/3280230934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c1f67e0 con 0x7fe55c0c6170 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe560aaa640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe55c0c6170 0x7fe55c06c720 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe54c011630 tx=0x7fe54c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe551ffb640 1 -- 172.21.15.2:0/3280230934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c009510 con 0x7fe55c0c6170 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe551ffb640 1 -- 172.21.15.2:0/3280230934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c00f920 con 0x7fe55c0c6170 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c1f6ac0 con 0x7fe55c0c6170 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe551ffb640 1 -- 172.21.15.2:0/3280230934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00fc90 con 0x7fe55c0c6170 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c1f7080 con 0x7fe55c0c6170 2023-11-04T01:49:14.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c067610 con 0x7fe55c0c6170 2023-11-04T01:49:14.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe551ffb640 1 -- 172.21.15.2:0/3280230934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe54c015460 con 0x7fe55c0c6170 2023-11-04T01:49:14.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe551ffb640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5400664d0 0x7fe540068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe551ffb640 1 -- 172.21.15.2:0/3280230934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7fe54c084e60 con 0x7fe55c0c6170 2023-11-04T01:49:14.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.034+0000 7fe5612ab640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5400664d0 0x7fe540068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.038+0000 7fe5612ab640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5400664d0 0x7fe540068990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe5580099b0 tx=0x7fe558008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.038+0000 7fe551ffb640 1 -- 172.21.15.2:0/3280230934 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe54c051bf0 con 0x7fe55c0c6170 2023-11-04T01:49:14.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe55c06df80 con 0x7fe55c0c6170 2023-11-04T01:49:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe551ffb640 1 -- 172.21.15.2:0/3280230934 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4930 (secure 0 0 0) 0x7fe54c055210 con 0x7fe55c0c6170 2023-11-04T01:49:14.230 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:14.230 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:12.929745+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:14.230 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 106 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5400664d0 msgr2=0x7fe540068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5400664d0 0x7fe540068990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe5580099b0 tx=0x7fe558008040 comp rx=0 tx=0).stop 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe55c0c6170 msgr2=0x7fe55c06c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe55c0c6170 0x7fe55c06c720 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe54c011630 tx=0x7fe54c011af0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 shutdown_connections 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5400664d0 0x7fe540068990 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe55c0b3a50 0x7fe55c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe55c0c6170 0x7fe55c06c720 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 --2- 172.21.15.2:0/3280230934 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe548004d10 0x7fe55c1542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 >> 172.21.15.2:0/3280230934 conn(0x7fe55c06a130 msgr2=0x7fe55c15d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 shutdown_connections 2023-11-04T01:49:14.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.230+0000 7fe56350f640 1 -- 172.21.15.2:0/3280230934 wait complete. 2023-11-04T01:49:14.247 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:49:14.248 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 5.779602527618408s 2023-11-04T01:49:14.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:14.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f076945f640 1 Processor -- start 2023-11-04T01:49:14.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f076945f640 1 -- start start 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f076945f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f076406bde0 0x7f07640cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f076945f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640c9ac0 con 0x7f076406c1c0 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f076945f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640caf20 con 0x7f07640c92b0 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f076945f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640c97e0 con 0x7f076406bde0 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f0762ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f076406bde0 0x7f07640cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f0762ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f076406bde0 0x7f07640cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37530/0 (socket says 172.21.15.2:37530) 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f0762ffd640 1 -- 172.21.15.2:0/2201940304 learned_addr learned my addr 172.21.15.2:0/2201940304 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f0762ffd640 1 -- 172.21.15.2:0/2201940304 >> v1:172.21.15.90:6789/0 conn(0x7f07640c92b0 legacy=0x7f076415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f0762ffd640 1 -- 172.21.15.2:0/2201940304 >> v1:172.21.15.2:6789/0 conn(0x7f076406c1c0 legacy=0x7f07641442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f0762ffd640 1 -- 172.21.15.2:0/2201940304 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640cb1c0 con 0x7f076406bde0 2023-11-04T01:49:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.362+0000 7f0762ffd640 1 --2- 172.21.15.2:0/2201940304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f07640cbca0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1183251cabe6a35a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0761ffb640 1 -- 172.21.15.2:0/2201940304 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540ab600 con 0x7f076406bde0 2023-11-04T01:49:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0761ffb640 1 -- 172.21.15.2:0/2201940304 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540a7050 con 0x7f076406bde0 2023-11-04T01:49:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0761ffb640 1 -- 172.21.15.2:0/2201940304 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540ab980 con 0x7f076406bde0 2023-11-04T01:49:14.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- 172.21.15.2:0/2201940304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 msgr2=0x7f07640cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 --2- 172.21.15.2:0/2201940304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f07640cbca0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c500 comp rx=0 tx=0).stop 2023-11-04T01:49:14.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- 172.21.15.2:0/2201940304 shutdown_connections 2023-11-04T01:49:14.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 --2- 172.21.15.2:0/2201940304 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f07640cbca0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- 172.21.15.2:0/2201940304 >> 172.21.15.2:0/2201940304 conn(0x7f07640b0890 msgr2=0x7f07640b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:14.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- 172.21.15.2:0/2201940304 shutdown_connections 2023-11-04T01:49:14.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- 172.21.15.2:0/2201940304 wait complete. 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 Processor -- start 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- start start 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f0764158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f076406c1c0 0x7f07640b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07640c92b0 0x7f07640c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c6080 con 0x7f076406bde0 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c5d30 con 0x7f07640c92b0 2023-11-04T01:49:14.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640b3660 con 0x7f076406c1c0 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f0764158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f0764158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37536/0 (socket says 172.21.15.2:37536) 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 -- 172.21.15.2:0/1539925111 learned_addr learned my addr 172.21.15.2:0/1539925111 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 -- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f076406c1c0 msgr2=0x7f07640b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f07627fc640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f076406c1c0 0x7f07640b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f07637fe640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07640c92b0 0x7f07640c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f076406c1c0 0x7f07640b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 -- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07640c92b0 msgr2=0x7f07640c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07640c92b0 0x7f07640c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 -- 172.21.15.2:0/1539925111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540094d0 con 0x7f076406bde0 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f07637fe640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07640c92b0 0x7f07640c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:14.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f0762ffd640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f0764158010 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f07540ae040 tx=0x7f075401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f074b7fe640 1 -- 172.21.15.2:0/1539925111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540b6620 con 0x7f076406bde0 2023-11-04T01:49:14.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f074b7fe640 1 -- 172.21.15.2:0/1539925111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540b67a0 con 0x7f076406bde0 2023-11-04T01:49:14.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f074b7fe640 1 -- 172.21.15.2:0/1539925111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540b6b50 con 0x7f076406bde0 2023-11-04T01:49:14.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07640b3940 con 0x7f076406bde0 2023-11-04T01:49:14.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.366+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0764158550 con 0x7f076406bde0 2023-11-04T01:49:14.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.370+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07640c61c0 con 0x7f076406bde0 2023-11-04T01:49:14.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.370+0000 7f074b7fe640 1 -- 172.21.15.2:0/1539925111 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f07540b2040 con 0x7f076406bde0 2023-11-04T01:49:14.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.370+0000 7f074b7fe640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07500664a0 0x7f0750068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.370+0000 7f074b7fe640 1 -- 172.21.15.2:0/1539925111 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f075411ed80 con 0x7f076406bde0 2023-11-04T01:49:14.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.370+0000 7f07627fc640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07500664a0 0x7f0750068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.370+0000 7f07627fc640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07500664a0 0x7f0750068960 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f076413f520 tx=0x7f0758008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.374+0000 7f074b7fe640 1 -- 172.21.15.2:0/1539925111 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07540ebad0 con 0x7f076406bde0 2023-11-04T01:49:14.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.554+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07640c61c0 con 0x7f076406bde0 2023-11-04T01:49:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f074b7fe640 1 -- 172.21.15.2:0/1539925111 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4930 (secure 0 0 0) 0x7f07640c61c0 con 0x7f076406bde0 2023-11-04T01:49:14.558 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:14.558 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:12.929745+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:14.558 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 106 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07500664a0 msgr2=0x7f0750068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07500664a0 0x7f0750068960 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f076413f520 tx=0x7f0758008040 comp rx=0 tx=0).stop 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 msgr2=0x7f0764158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f0764158010 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f07540ae040 tx=0x7f075401ad40 comp rx=0 tx=0).stop 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 shutdown_connections 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07500664a0 0x7f0750068960 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f07640c92b0 0x7f07640c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f076406c1c0 0x7f07640b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 --2- 172.21.15.2:0/1539925111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f076406bde0 0x7f0764158010 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 >> 172.21.15.2:0/1539925111 conn(0x7f07640b0890 msgr2=0x7f07640ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 shutdown_connections 2023-11-04T01:49:14.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.558+0000 7f076945f640 1 -- 172.21.15.2:0/1539925111 wait complete. 2023-11-04T01:49:14.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:49:14.714 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:48:32.891232+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:49:14.715 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:48:32.891232+0000" } ] } 2023-11-04T01:49:14.715 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-11-04T01:49:14.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.838+0000 7f5d5147d640 1 Processor -- start 2023-11-04T01:49:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.838+0000 7f5d5147d640 1 -- start start 2023-11-04T01:49:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d5147d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d4c142ad0 0x7f5d4c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d5147d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0ca100 con 0x7f5d4c142eb0 2023-11-04T01:49:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d5147d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0ca3e0 con 0x7f5d4c0cbd80 2023-11-04T01:49:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d5147d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c0ca6c0 con 0x7f5d4c142ad0 2023-11-04T01:49:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4a7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5d4c142eb0 0x7f5d4c0cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53268/0 (socket says 172.21.15.2:53268) 2023-11-04T01:49:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4a7fc640 1 -- 172.21.15.2:0/1788568229 learned_addr learned my addr 172.21.15.2:0/1788568229 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:14.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4affd640 1 --2- 172.21.15.2:0/1788568229 >> v2:172.21.15.90:3300/0 conn(0x7f5d4c142ad0 0x7f5d4c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360430406 0 0) 0x7f5d4c0ca100 con 0x7f5d4c142eb0 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003530 con 0x7f5d4c142eb0 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2329134065 0 0) 0x7f5d34003530 con 0x7f5d4c142eb0 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 >> v2:172.21.15.90:3300/0 conn(0x7f5d4c142ad0 msgr2=0x7f5d4c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 --2- 172.21.15.2:0/1788568229 >> v2:172.21.15.90:3300/0 conn(0x7f5d4c142ad0 0x7f5d4c15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 >> v1:172.21.15.90:6789/0 conn(0x7f5d4c0cbd80 legacy=0x7f5d4c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0ca9a0 con 0x7f5d4c142eb0 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f5d40001680 con 0x7f5d4c142eb0 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 >> v1:172.21.15.2:6789/0 conn(0x7f5d4c142eb0 legacy=0x7f5d4c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d340039d0 0x7f5d34003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d340047d0 0x7f5d34004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0ca6c0 con 0x7f5d340051e0 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3400c130 con 0x7f5d340047d0 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3400c2f0 con 0x7f5d340039d0 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4b7fe640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4a7fc640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d340047d0 0x7f5d34004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4affd640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d340039d0 0x7f5d34003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4b7fe640 1 -- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d340039d0 msgr2=0x7f5d34003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4b7fe640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d340039d0 0x7f5d34003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4b7fe640 1 -- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d340047d0 msgr2=0x7f5d34004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4b7fe640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d340047d0 0x7f5d34004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.842+0000 7f5d4b7fe640 1 -- 172.21.15.2:0/1788568229 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34003530 con 0x7f5d340051e0 2023-11-04T01:49:14.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4b7fe640 1 -- 172.21.15.2:0/1788568229 reap_dead start 2023-11-04T01:49:14.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4b7fe640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d3400b990 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c15ea80 tx=0x7f5d4401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b025631c8c88fd9c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44003b80 con 0x7f5d340051e0 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44003ce0 con 0x7f5d340051e0 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d49ffb640 1 -- 172.21.15.2:0/1788568229 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44005310 con 0x7f5d340051e0 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- 172.21.15.2:0/1788568229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 msgr2=0x7f5d3400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d3400b990 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c15ea80 tx=0x7f5d4401c700 comp rx=0 tx=0).stop 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- 172.21.15.2:0/1788568229 shutdown_connections 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 --2- 172.21.15.2:0/1788568229 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d3400b990 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- 172.21.15.2:0/1788568229 >> 172.21.15.2:0/1788568229 conn(0x7f5d4c0b0890 msgr2=0x7f5d4c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- 172.21.15.2:0/1788568229 shutdown_connections 2023-11-04T01:49:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- 172.21.15.2:0/1788568229 wait complete. 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 Processor -- start 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- start start 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d4c159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d4c0c5e50 0x7f5d4c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d4c0cd6a0 0x7f5d4c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c7200 con 0x7f5d340051e0 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0ce090 con 0x7f5d4c0c5e50 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d5147d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c1598a0 con 0x7f5d4c0cd6a0 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d4c159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d4c159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37548/0 (socket says 172.21.15.2:37548) 2023-11-04T01:49:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 -- 172.21.15.2:0/875557097 learned_addr learned my addr 172.21.15.2:0/875557097 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4a7fc640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d4c0c5e50 0x7f5d4c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4b7fe640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d4c0cd6a0 0x7f5d4c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 -- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d4c0cd6a0 msgr2=0x7f5d4c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d4c0cd6a0 0x7f5d4c0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 -- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d4c0c5e50 msgr2=0x7f5d4c150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d4c0c5e50 0x7f5d4c150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.846+0000 7f5d4affd640 1 -- 172.21.15.2:0/875557097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c150a80 con 0x7f5d340051e0 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d4affd640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d4c159a30 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c011590 tx=0x7f5d3c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d337fe640 1 -- 172.21.15.2:0/875557097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c015930 con 0x7f5d340051e0 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d337fe640 1 -- 172.21.15.2:0/875557097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c015a90 con 0x7f5d340051e0 2023-11-04T01:49:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c0c62b0 con 0x7f5d340051e0 2023-11-04T01:49:14.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d337fe640 1 -- 172.21.15.2:0/875557097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c015e20 con 0x7f5d340051e0 2023-11-04T01:49:14.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c0c6860 con 0x7f5d340051e0 2023-11-04T01:49:14.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c04e4a0 con 0x7f5d340051e0 2023-11-04T01:49:14.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d337fe640 1 -- 172.21.15.2:0/875557097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d3c00f460 con 0x7f5d340051e0 2023-11-04T01:49:14.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d337fe640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d380664a0 0x7f5d38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:14.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d337fe640 1 -- 172.21.15.2:0/875557097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f5d3c084e70 con 0x7f5d340051e0 2023-11-04T01:49:14.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d4a7fc640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d380664a0 0x7f5d38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:14.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.850+0000 7f5d4a7fc640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d380664a0 0x7f5d38068960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c06d380 tx=0x7f5d40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:14.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:14.854+0000 7f5d337fe640 1 -- 172.21.15.2:0/875557097 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5d3c051cc0 con 0x7f5d340051e0 2023-11-04T01:49:15.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.046+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d4c06d010 con 0x7f5d340051e0 2023-11-04T01:49:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.046+0000 7f5d337fe640 1 -- 172.21.15.2:0/875557097 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4930 (secure 0 0 0) 0x7f5d3c0552e0 con 0x7f5d340051e0 2023-11-04T01:49:15.048 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:15.048 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:12.929745+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:15.048 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 106 2023-11-04T01:49:15.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d380664a0 msgr2=0x7f5d38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d380664a0 0x7f5d38068960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c06d380 tx=0x7f5d40009040 comp rx=0 tx=0).stop 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 msgr2=0x7f5d4c159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d4c159a30 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c011590 tx=0x7f5d3c011a50 comp rx=0 tx=0).stop 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 shutdown_connections 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d380664a0 0x7f5d38068960 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d4c0cd6a0 0x7f5d4c0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d4c0c5e50 0x7f5d4c150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 --2- 172.21.15.2:0/875557097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d340051e0 0x7f5d4c159a30 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 >> 172.21.15.2:0/875557097 conn(0x7f5d4c0b0890 msgr2=0x7f5d4c0c5400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 shutdown_connections 2023-11-04T01:49:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.050+0000 7f5d5147d640 1 -- 172.21.15.2:0/875557097 wait complete. 2023-11-04T01:49:15.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:49:15.198 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:48:32.891232+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:49:15.198 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:48:32.891232+0000" } ] } 2023-11-04T01:49:15.199 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:49:15.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:15.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:49:15.212 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:49:15.212 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:15.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:49:15.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52dcce5640 1 Processor -- start 2023-11-04T01:49:15.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52dcce5640 1 -- start start 2023-11-04T01:49:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52dcce5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52d806bde0 0x7f52d80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52dcce5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f52d806c1c0 0x7f52d81442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52dcce5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d80c9ac0 con 0x7f52d80c92b0 2023-11-04T01:49:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52dcce5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80caf20 con 0x7f52d806bde0 2023-11-04T01:49:15.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52dcce5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80c97e0 con 0x7f52d806c1c0 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f52d806bde0 0x7f52d80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d5d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f52d80c92b0 0x7f52d815c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53278/0 (socket says 172.21.15.2:53278) 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d5d9b640 1 -- 172.21.15.2:0/659660148 learned_addr learned my addr 172.21.15.2:0/659660148 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d6d9d640 1 --2- 172.21.15.2:0/659660148 >> v2:172.21.15.90:3300/0 conn(0x7f52d806c1c0 0x7f52d81442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d659c640 1 -- 172.21.15.2:0/659660148 >> v2:172.21.15.90:3300/0 conn(0x7f52d806c1c0 msgr2=0x7f52d81442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d659c640 1 --2- 172.21.15.2:0/659660148 >> v2:172.21.15.90:3300/0 conn(0x7f52d806c1c0 0x7f52d81442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d659c640 1 -- 172.21.15.2:0/659660148 >> v1:172.21.15.2:6789/0 conn(0x7f52d80c92b0 legacy=0x7f52d815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d659c640 1 -- 172.21.15.2:0/659660148 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80cb1c0 con 0x7f52d806bde0 2023-11-04T01:49:15.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.426+0000 7f52d559a640 1 -- 172.21.15.2:0/659660148 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278701774 0 0) 0x7f52d80c9ac0 con 0x7f52d80c92b0 2023-11-04T01:49:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 --2- 172.21.15.2:0/659660148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d80cbca0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f52d815b660 tx=0x7f52c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492d4fe8d6fe645d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:15.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d559a640 1 -- 172.21.15.2:0/659660148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8004230 con 0x7f52d806bde0 2023-11-04T01:49:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d559a640 1 -- 172.21.15.2:0/659660148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c80a7050 con 0x7f52d806bde0 2023-11-04T01:49:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d559a640 1 -- 172.21.15.2:0/659660148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8003620 con 0x7f52d806bde0 2023-11-04T01:49:15.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- 172.21.15.2:0/659660148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 msgr2=0x7f52d80cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 --2- 172.21.15.2:0/659660148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d80cbca0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f52d815b660 tx=0x7f52c801c460 comp rx=0 tx=0).stop 2023-11-04T01:49:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- 172.21.15.2:0/659660148 shutdown_connections 2023-11-04T01:49:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 --2- 172.21.15.2:0/659660148 >> v2:172.21.15.90:3300/0 conn(0x7f52d806c1c0 0x7f52d81442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 --2- 172.21.15.2:0/659660148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d80cbca0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- 172.21.15.2:0/659660148 >> 172.21.15.2:0/659660148 conn(0x7f52d80b0890 msgr2=0x7f52d80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- 172.21.15.2:0/659660148 shutdown_connections 2023-11-04T01:49:15.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- 172.21.15.2:0/659660148 wait complete. 2023-11-04T01:49:15.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 Processor -- start 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- start start 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52d806c1c0 0x7f52d80c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52d80c92b0 0x7f52d80c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8138b60 con 0x7f52d806bde0 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8165c50 con 0x7f52d806c1c0 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52dcce5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80c5680 con 0x7f52d80c92b0 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d815d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37560/0 (socket says 172.21.15.2:37560) 2023-11-04T01:49:15.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 -- 172.21.15.2:0/2624485648 learned_addr learned my addr 172.21.15.2:0/2624485648 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d6d9d640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52d80c92b0 0x7f52d80c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d5d9b640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52d806c1c0 0x7f52d80c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 -- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52d80c92b0 msgr2=0x7f52d80c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52d80c92b0 0x7f52d80c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 -- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52d806c1c0 msgr2=0x7f52d80c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52d806c1c0 0x7f52d80c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 -- 172.21.15.2:0/2624485648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c8009420 con 0x7f52d806bde0 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d5d9b640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52d806c1c0 0x7f52d80c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.430+0000 7f52d659c640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d815d2d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f52c80ae040 tx=0x7f52c8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52c6ffd640 1 -- 172.21.15.2:0/2624485648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8003bb0 con 0x7f52d806bde0 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52c6ffd640 1 -- 172.21.15.2:0/2624485648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8003d10 con 0x7f52d806bde0 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d80c4a70 con 0x7f52d806bde0 2023-11-04T01:49:15.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52c6ffd640 1 -- 172.21.15.2:0/2624485648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80ab680 con 0x7f52d806bde0 2023-11-04T01:49:15.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80c5030 con 0x7f52d806bde0 2023-11-04T01:49:15.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d804e4a0 con 0x7f52d806bde0 2023-11-04T01:49:15.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52c6ffd640 1 -- 172.21.15.2:0/2624485648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52c80b2040 con 0x7f52d806bde0 2023-11-04T01:49:15.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52c6ffd640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52b80664a0 0x7f52b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52c6ffd640 1 -- 172.21.15.2:0/2624485648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f52c811f220 con 0x7f52d806bde0 2023-11-04T01:49:15.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.434+0000 7f52d5d9b640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52b80664a0 0x7f52b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.438+0000 7f52d5d9b640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52b80664a0 0x7f52b8068960 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f52cc007fd0 tx=0x7f52cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:15.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.438+0000 7f52c6ffd640 1 -- 172.21.15.2:0/2624485648 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52c80ec000 con 0x7f52d806bde0 2023-11-04T01:49:15.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.590+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d815cb50 con 0x7f52d806bde0 2023-11-04T01:49:15.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.594+0000 7f52c6ffd640 1 -- 172.21.15.2:0/2624485648 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+23081 (secure 0 0 0) 0x7f52c80b0090 con 0x7f52d806bde0 2023-11-04T01:49:15.594 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:15.594 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":107,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:49:11.904386+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":100,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.f","mappings":[{"from":2,"to":3}]},{"pgid":"16.12","mappings":[{"from":4,"to":3}]},{"pgid":"16.39","mappings":[{"from":4,"to":6}]},{"pgid":"16.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/2988241810":"2023-11-04T02:49:10.916906+0000","172.21.15.90:6837/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.90:6834/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.2:6833/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6837/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.2:6832/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.2:6833/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.90:6834/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6834/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.2:6832/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6834/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.90:6837/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6832/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.90:6834/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6833/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.90:6837/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6835/3725992406":"2023-11-05T01:48:12.536544+0000","192.168.0.1:0/2023608941":"2023-11-04T02:48:20.721790+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:49:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.594+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52b80664a0 msgr2=0x7f52b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.594+0000 7f52dcce5640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52b80664a0 0x7f52b8068960 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f52cc007fd0 tx=0x7f52cc009040 comp rx=0 tx=0).stop 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 msgr2=0x7f52d815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d815d2d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f52c80ae040 tx=0x7f52c8019200 comp rx=0 tx=0).stop 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 shutdown_connections 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52b80664a0 0x7f52b8068960 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52d80c92b0 0x7f52d80c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52d806c1c0 0x7f52d80c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 --2- 172.21.15.2:0/2624485648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52d806bde0 0x7f52d815d2d0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 >> 172.21.15.2:0/2624485648 conn(0x7f52d80b0890 msgr2=0x7f52d8070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 shutdown_connections 2023-11-04T01:49:15.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.598+0000 7f52dcce5640 1 -- 172.21.15.2:0/2624485648 wait complete. 2023-11-04T01:49:15.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:45:33.227500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:45:34.004628+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 100, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:49:15.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:49:15.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.730+0000 7f1b4865c640 1 Processor -- start 2023-11-04T01:49:15.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.730+0000 7f1b4865c640 1 -- start start 2023-11-04T01:49:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b4865c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b401556c0 0x7f1b4015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b4865c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b400cb050 0x7f1b400c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b4865c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4015c600 con 0x7f1b400cabd0 2023-11-04T01:49:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b4865c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b400cb4e0 con 0x7f1b400cb050 2023-11-04T01:49:15.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b4865c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4006fe50 con 0x7f1b401556c0 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b46bf9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b400cb050 0x7f1b400c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b45bf7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1b400cabd0 0x7f1b400c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53280/0 (socket says 172.21.15.2:53280) 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b45bf7640 1 -- 172.21.15.2:0/4135242804 learned_addr learned my addr 172.21.15.2:0/4135242804 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b463f8640 1 --2- 172.21.15.2:0/4135242804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b401556c0 0x7f1b4015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b46bf9640 1 -- 172.21.15.2:0/4135242804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b401556c0 msgr2=0x7f1b4015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b46bf9640 1 --2- 172.21.15.2:0/4135242804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b401556c0 0x7f1b4015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b46bf9640 1 -- 172.21.15.2:0/4135242804 >> v1:172.21.15.2:6789/0 conn(0x7f1b400cabd0 legacy=0x7f1b400c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b46bf9640 1 -- 172.21.15.2:0/4135242804 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400ae7f0 con 0x7f1b400cb050 2023-11-04T01:49:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b46bf9640 1 --2- 172.21.15.2:0/4135242804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b400c9a70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009d90 tx=0x7f1b3801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becbd11572eb419d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:15.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b453f6640 1 -- 172.21.15.2:0/4135242804 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380a59e0 con 0x7f1b400cb050 2023-11-04T01:49:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b453f6640 1 -- 172.21.15.2:0/4135242804 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b380a5b40 con 0x7f1b400cb050 2023-11-04T01:49:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.734+0000 7f1b453f6640 1 -- 172.21.15.2:0/4135242804 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380ad440 con 0x7f1b400cb050 2023-11-04T01:49:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/4135242804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 msgr2=0x7f1b400c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 --2- 172.21.15.2:0/4135242804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b400c9a70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1b38009d90 tx=0x7f1b3801c920 comp rx=0 tx=0).stop 2023-11-04T01:49:15.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/4135242804 shutdown_connections 2023-11-04T01:49:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 --2- 172.21.15.2:0/4135242804 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b400c9a70 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 --2- 172.21.15.2:0/4135242804 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b401556c0 0x7f1b4015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/4135242804 >> 172.21.15.2:0/4135242804 conn(0x7f1b400ced10 msgr2=0x7f1b400cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/4135242804 shutdown_connections 2023-11-04T01:49:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/4135242804 wait complete. 2023-11-04T01:49:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 Processor -- start 2023-11-04T01:49:15.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- start start 2023-11-04T01:49:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b400cabd0 0x7f1b400c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b40145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b401556c0 0x7f1b400c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40144e70 con 0x7f1b400cb050 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400c0dd0 con 0x7f1b401556c0 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b401441f0 con 0x7f1b400cabd0 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b40145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b40145680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37572/0 (socket says 172.21.15.2:37572) 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 -- 172.21.15.2:0/3262089787 learned_addr learned my addr 172.21.15.2:0/3262089787 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b463f8640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b400cabd0 0x7f1b400c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b46bf9640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b401556c0 0x7f1b400c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 -- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b400cabd0 msgr2=0x7f1b400c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b400cabd0 0x7f1b400c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 -- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b401556c0 msgr2=0x7f1b400c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b401556c0 0x7f1b400c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 -- 172.21.15.2:0/3262089787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009a70 con 0x7f1b400cb050 2023-11-04T01:49:15.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b45bf7640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b40145680 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c400 tx=0x7f1b3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b36ffd640 1 -- 172.21.15.2:0/3262089787 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30005cf0 con 0x7f1b400cb050 2023-11-04T01:49:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b36ffd640 1 -- 172.21.15.2:0/3262089787 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30005e50 con 0x7f1b400cb050 2023-11-04T01:49:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b401444d0 con 0x7f1b400cb050 2023-11-04T01:49:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b36ffd640 1 -- 172.21.15.2:0/3262089787 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300072d0 con 0x7f1b400cb050 2023-11-04T01:49:15.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b40144a90 con 0x7f1b400cb050 2023-11-04T01:49:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.738+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4004e4a0 con 0x7f1b400cb050 2023-11-04T01:49:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.742+0000 7f1b36ffd640 1 -- 172.21.15.2:0/3262089787 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b30007430 con 0x7f1b400cb050 2023-11-04T01:49:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.742+0000 7f1b36ffd640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.742+0000 7f1b36ffd640 1 -- 172.21.15.2:0/3262089787 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f1b30084130 con 0x7f1b400cb050 2023-11-04T01:49:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.742+0000 7f1b463f8640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:15.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.742+0000 7f1b463f8640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00b9d0 tx=0x7f1b3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:15.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.746+0000 7f1b36ffd640 1 -- 172.21.15.2:0/3262089787 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b30051030 con 0x7f1b400cb050 2023-11-04T01:49:15.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b4006c400 con 0x7f1b400cb050 2023-11-04T01:49:15.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b36ffd640 1 -- 172.21.15.2:0/3262089787 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b300210a0 con 0x7f1b400cb050 2023-11-04T01:49:15.898 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 msgr2=0x7f1b24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00b9d0 tx=0x7f1b3c008040 comp rx=0 tx=0).stop 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 msgr2=0x7f1b40145680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b40145680 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c400 tx=0x7f1b3000c8c0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 shutdown_connections 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b401556c0 0x7f1b400c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b400cb050 0x7f1b40145680 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 --2- 172.21.15.2:0/3262089787 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b400cabd0 0x7f1b400c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 >> 172.21.15.2:0/3262089787 conn(0x7f1b400ced10 msgr2=0x7f1b4014b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:15.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 shutdown_connections 2023-11-04T01:49:15.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:15.898+0000 7f1b4865c640 1 -- 172.21.15.2:0/3262089787 wait complete. 2023-11-04T01:49:15.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:49:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b41428640 1 Processor -- start 2023-11-04T01:49:16.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b41428640 1 -- start start 2023-11-04T01:49:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b41428640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1b3c1556c0 0x7f1b3c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b41428640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b3c0cb080 0x7f1b3c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b41428640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c15c600 con 0x7f1b3c0cabd0 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b41428640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0cb4d0 con 0x7f1b3c0cb080 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b41428640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c06fe50 con 0x7f1b3c1556c0 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.030+0000 7f1b3b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b3c0cb080 0x7f1b3c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1b3c0cb080 0x7f1b3c0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37586/0 (socket says 172.21.15.2:37586) 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3b7fe640 1 -- 172.21.15.2:0/573737314 learned_addr learned my addr 172.21.15.2:0/573737314 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3b7fe640 1 -- 172.21.15.2:0/573737314 >> v2:172.21.15.90:3300/0 conn(0x7f1b3c1556c0 msgr2=0x7f1b3c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3affd640 1 --2- 172.21.15.2:0/573737314 >> v2:172.21.15.90:3300/0 conn(0x7f1b3c1556c0 0x7f1b3c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3b7fe640 1 --2- 172.21.15.2:0/573737314 >> v2:172.21.15.90:3300/0 conn(0x7f1b3c1556c0 0x7f1b3c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3b7fe640 1 -- 172.21.15.2:0/573737314 >> v1:172.21.15.90:6789/0 conn(0x7f1b3c0cabd0 legacy=0x7f1b3c0c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3b7fe640 1 -- 172.21.15.2:0/573737314 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0ae7f0 con 0x7f1b3c0cb080 2023-11-04T01:49:16.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3affd640 1 --2- 172.21.15.2:0/573737314 >> v2:172.21.15.90:3300/0 conn(0x7f1b3c1556c0 0x7f1b3c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b3b7fe640 1 --2- 172.21.15.2:0/573737314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c0c9a70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009e50 tx=0x7f1b3401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f1d358010fd7df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b39ffb640 1 -- 172.21.15.2:0/573737314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340a5820 con 0x7f1b3c0cb080 2023-11-04T01:49:16.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b39ffb640 1 -- 172.21.15.2:0/573737314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b340a5980 con 0x7f1b3c0cb080 2023-11-04T01:49:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b39ffb640 1 -- 172.21.15.2:0/573737314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340a5d10 con 0x7f1b3c0cb080 2023-11-04T01:49:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 -- 172.21.15.2:0/573737314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 msgr2=0x7f1b3c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 --2- 172.21.15.2:0/573737314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c0c9a70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009e50 tx=0x7f1b3401c960 comp rx=0 tx=0).stop 2023-11-04T01:49:16.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 -- 172.21.15.2:0/573737314 shutdown_connections 2023-11-04T01:49:16.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 --2- 172.21.15.2:0/573737314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c0c9a70 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 --2- 172.21.15.2:0/573737314 >> v2:172.21.15.90:3300/0 conn(0x7f1b3c1556c0 0x7f1b3c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 -- 172.21.15.2:0/573737314 >> 172.21.15.2:0/573737314 conn(0x7f1b3c0ced10 msgr2=0x7f1b3c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:16.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 -- 172.21.15.2:0/573737314 shutdown_connections 2023-11-04T01:49:16.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.034+0000 7f1b41428640 1 -- 172.21.15.2:0/573737314 wait complete. 2023-11-04T01:49:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 Processor -- start 2023-11-04T01:49:16.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 -- start start 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b3c0cabd0 0x7f1b3c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b3c1556c0 0x7f1b3c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c152a50 con 0x7f1b3c0cb080 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c150b50 con 0x7f1b3c1556c0 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c1502b0 con 0x7f1b3c0cabd0 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c14b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37588/0 (socket says 172.21.15.2:37588) 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 -- 172.21.15.2:0/1002125425 learned_addr learned my addr 172.21.15.2:0/1002125425 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:16.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3affd640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b3c0cabd0 0x7f1b3c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3b7fe640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b3c1556c0 0x7f1b3c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 -- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b3c0cabd0 msgr2=0x7f1b3c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b3c0cabd0 0x7f1b3c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 -- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b3c1556c0 msgr2=0x7f1b3c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b3c1556c0 0x7f1b3c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 -- 172.21.15.2:0/1002125425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34009b30 con 0x7f1b3c0cb080 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b3a7fc640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c14b170 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800b410 tx=0x7f1b2800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b337fe640 1 -- 172.21.15.2:0/1002125425 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28004020 con 0x7f1b3c0cb080 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b337fe640 1 -- 172.21.15.2:0/1002125425 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28004180 con 0x7f1b3c0cb080 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b337fe640 1 -- 172.21.15.2:0/1002125425 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28011630 con 0x7f1b3c0cb080 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c150590 con 0x7f1b3c0cb080 2023-11-04T01:49:16.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c0b2c30 con 0x7f1b3c0cb080 2023-11-04T01:49:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.038+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c0b2e50 con 0x7f1b3c0cb080 2023-11-04T01:49:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.042+0000 7f1b337fe640 1 -- 172.21.15.2:0/1002125425 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b28011790 con 0x7f1b3c0cb080 2023-11-04T01:49:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.042+0000 7f1b337fe640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.042+0000 7f1b337fe640 1 -- 172.21.15.2:0/1002125425 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f1b28084360 con 0x7f1b3c0cb080 2023-11-04T01:49:16.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.042+0000 7f1b3affd640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.042+0000 7f1b3affd640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00a9a0 tx=0x7f1b2c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.046+0000 7f1b337fe640 1 -- 172.21.15.2:0/1002125425 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b28051070 con 0x7f1b3c0cb080 2023-11-04T01:49:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f1b3c04e4a0 con 0x7f1b3c0cb080 2023-11-04T01:49:16.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b337fe640 1 -- 172.21.15.2:0/1002125425 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v107) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1b28054690 con 0x7f1b3c0cb080 2023-11-04T01:49:16.198 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:49:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 msgr2=0x7f1b24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00a9a0 tx=0x7f1b2c008040 comp rx=0 tx=0).stop 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 msgr2=0x7f1b3c14b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c14b170 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800b410 tx=0x7f1b2800b8d0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 shutdown_connections 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1b240664a0 0x7f1b24068960 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b3c1556c0 0x7f1b3c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b3c0cb080 0x7f1b3c14b170 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 --2- 172.21.15.2:0/1002125425 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1b3c0cabd0 0x7f1b3c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 >> 172.21.15.2:0/1002125425 conn(0x7f1b3c0ced10 msgr2=0x7f1b3c0af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 shutdown_connections 2023-11-04T01:49:16.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.198+0000 7f1b41428640 1 -- 172.21.15.2:0/1002125425 wait complete. 2023-11-04T01:49:16.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:49:16.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d89855640 1 Processor -- start 2023-11-04T01:49:16.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d89855640 1 -- start start 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d89855640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d840d1cb0 0x7f5d840d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d89855640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d840b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d89855640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d840d09b0 con 0x7f5d8415d1c0 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d89855640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d840d0110 con 0x7f5d840d1cb0 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d89855640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840d03f0 con 0x7f5d8415d5a0 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d840d1cb0 0x7f5d840d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5d840d1cb0 0x7f5d840d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37604/0 (socket says 172.21.15.2:37604) 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 -- 172.21.15.2:0/3445241926 learned_addr learned my addr 172.21.15.2:0/3445241926 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:16.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d837fe640 1 --2- 172.21.15.2:0/3445241926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d840b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 -- 172.21.15.2:0/3445241926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 msgr2=0x7f5d840b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 --2- 172.21.15.2:0/3445241926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d840b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 -- 172.21.15.2:0/3445241926 >> v1:172.21.15.90:6789/0 conn(0x7f5d8415d1c0 legacy=0x7f5d840d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 -- 172.21.15.2:0/3445241926 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840d06d0 con 0x7f5d840d1cb0 2023-11-04T01:49:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.330+0000 7f5d827fc640 1 --2- 172.21.15.2:0/3445241926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d840d1cb0 0x7f5d840d3ae0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009870 tx=0x7f5d7801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7701913033f558e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d81ffb640 1 -- 172.21.15.2:0/3445241926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d780aa650 con 0x7f5d840d1cb0 2023-11-04T01:49:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d81ffb640 1 -- 172.21.15.2:0/3445241926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d780aa7b0 con 0x7f5d840d1cb0 2023-11-04T01:49:16.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d81ffb640 1 -- 172.21.15.2:0/3445241926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d780aab40 con 0x7f5d840d1cb0 2023-11-04T01:49:16.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- 172.21.15.2:0/3445241926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d840d1cb0 msgr2=0x7f5d840d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 --2- 172.21.15.2:0/3445241926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d840d1cb0 0x7f5d840d3ae0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009870 tx=0x7f5d7801c510 comp rx=0 tx=0).stop 2023-11-04T01:49:16.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- 172.21.15.2:0/3445241926 shutdown_connections 2023-11-04T01:49:16.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 --2- 172.21.15.2:0/3445241926 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d840b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 --2- 172.21.15.2:0/3445241926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d840d1cb0 0x7f5d840d3ae0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- 172.21.15.2:0/3445241926 >> 172.21.15.2:0/3445241926 conn(0x7f5d840d2fc0 msgr2=0x7f5d840d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:16.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- 172.21.15.2:0/3445241926 shutdown_connections 2023-11-04T01:49:16.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- 172.21.15.2:0/3445241926 wait complete. 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 Processor -- start 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- start start 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d840d1cb0 0x7f5d84154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8415d1c0 0x7f5d840ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d8406af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840cc260 con 0x7f5d8415d1c0 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840cb1c0 con 0x7f5d840d1cb0 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840cb4a0 con 0x7f5d8415d5a0 2023-11-04T01:49:16.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8415d1c0 0x7f5d840ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8415d1c0 0x7f5d840ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37614/0 (socket says 172.21.15.2:37614) 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 -- 172.21.15.2:0/956449864 learned_addr learned my addr 172.21.15.2:0/956449864 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d837fe640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d8406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d82ffd640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d840d1cb0 0x7f5d84154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 -- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 msgr2=0x7f5d8406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d8406af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 -- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d840d1cb0 msgr2=0x7f5d84154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d840d1cb0 0x7f5d84154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 -- 172.21.15.2:0/956449864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d780094d0 con 0x7f5d8415d1c0 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d837fe640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d8406af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d827fc640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8415d1c0 0x7f5d840ca7d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5d780ac040 tx=0x7f5d7801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d6bfff640 1 -- 172.21.15.2:0/956449864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d780b3800 con 0x7f5d8415d1c0 2023-11-04T01:49:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d6bfff640 1 -- 172.21.15.2:0/956449864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d780b3960 con 0x7f5d8415d1c0 2023-11-04T01:49:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d840cb780 con 0x7f5d8415d1c0 2023-11-04T01:49:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d6bfff640 1 -- 172.21.15.2:0/956449864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d780b3d10 con 0x7f5d8415d1c0 2023-11-04T01:49:16.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.334+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d840cbd40 con 0x7f5d8415d1c0 2023-11-04T01:49:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.338+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d840cf490 con 0x7f5d8415d1c0 2023-11-04T01:49:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.338+0000 7f5d6bfff640 1 -- 172.21.15.2:0/956449864 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5d780b2380 con 0x7f5d8415d1c0 2023-11-04T01:49:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.338+0000 7f5d6bfff640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d700664d0 0x7f5d70068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.338+0000 7f5d6bfff640 1 -- 172.21.15.2:0/956449864 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f5d7811ed40 con 0x7f5d8415d1c0 2023-11-04T01:49:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.338+0000 7f5d82ffd640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d700664d0 0x7f5d70068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.338+0000 7f5d82ffd640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d700664d0 0x7f5d70068990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5d740012f0 tx=0x7f5d74009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.342+0000 7f5d6bfff640 1 -- 172.21.15.2:0/956449864 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5d780ebb60 con 0x7f5d8415d1c0 2023-11-04T01:49:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.490+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f5d8404e4a0 con 0x7f5d8415d1c0 2023-11-04T01:49:16.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.490+0000 7f5d6bfff640 1 -- 172.21.15.2:0/956449864 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v107) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5d780ef180 con 0x7f5d8415d1c0 2023-11-04T01:49:16.493 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:49:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d700664d0 msgr2=0x7f5d70068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d700664d0 0x7f5d70068990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5d740012f0 tx=0x7f5d74009040 comp rx=0 tx=0).stop 2023-11-04T01:49:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8415d1c0 msgr2=0x7f5d840ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8415d1c0 0x7f5d840ca7d0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f5d780ac040 tx=0x7f5d7801ad50 comp rx=0 tx=0).stop 2023-11-04T01:49:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 shutdown_connections 2023-11-04T01:49:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5d700664d0 0x7f5d70068990 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5d8415d5a0 0x7f5d8406af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5d8415d1c0 0x7f5d840ca7d0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 --2- 172.21.15.2:0/956449864 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d840d1cb0 0x7f5d84154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 >> 172.21.15.2:0/956449864 conn(0x7f5d840d2fc0 msgr2=0x7f5d840d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 shutdown_connections 2023-11-04T01:49:16.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.494+0000 7f5d89855640 1 -- 172.21.15.2:0/956449864 wait complete. 2023-11-04T01:49:16.510 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:49:16.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69fa0ab640 1 Processor -- start 2023-11-04T01:49:16.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69fa0ab640 1 -- start start 2023-11-04T01:49:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69fa0ab640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f69f415d4d0 0x7f69f40aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69fa0ab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f69f40cd940 0x7f69f406a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69fa0ab640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f40716d0 con 0x7f69f415d0f0 2023-11-04T01:49:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69fa0ab640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f4071ee0 con 0x7f69f40cd940 2023-11-04T01:49:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69fa0ab640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40cde00 con 0x7f69f415d4d0 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f69f415d0f0 0x7f69f40ac8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53294/0 (socket says 172.21.15.2:53294) 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f37fe640 1 -- 172.21.15.2:0/2568163766 learned_addr learned my addr 172.21.15.2:0/2568163766 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f3fff640 1 --2- 172.21.15.2:0/2568163766 >> v2:172.21.15.2:3300/0 conn(0x7f69f40cd940 0x7f69f406a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f2ffd640 1 --2- 172.21.15.2:0/2568163766 >> v2:172.21.15.90:3300/0 conn(0x7f69f415d4d0 0x7f69f40aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f3fff640 1 -- 172.21.15.2:0/2568163766 >> v2:172.21.15.90:3300/0 conn(0x7f69f415d4d0 msgr2=0x7f69f40aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f3fff640 1 --2- 172.21.15.2:0/2568163766 >> v2:172.21.15.90:3300/0 conn(0x7f69f415d4d0 0x7f69f40aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f3fff640 1 -- 172.21.15.2:0/2568163766 >> v1:172.21.15.2:6789/0 conn(0x7f69f415d0f0 legacy=0x7f69f40ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f27fc640 1 -- 172.21.15.2:0/2568163766 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842911155 0 0) 0x7f69f40716d0 con 0x7f69f415d0f0 2023-11-04T01:49:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.626+0000 7f69f3fff640 1 -- 172.21.15.2:0/2568163766 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4071920 con 0x7f69f40cd940 2023-11-04T01:49:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 --2- 172.21.15.2:0/2568163766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f40cd940 0x7f69f406a130 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097c0 tx=0x7f69ec01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0a75cdf35031b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f27fc640 1 -- 172.21.15.2:0/2568163766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0ab600 con 0x7f69f40cd940 2023-11-04T01:49:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f27fc640 1 -- 172.21.15.2:0/2568163766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec0a7050 con 0x7f69f40cd940 2023-11-04T01:49:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f27fc640 1 -- 172.21.15.2:0/2568163766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0ab980 con 0x7f69f40cd940 2023-11-04T01:49:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- 172.21.15.2:0/2568163766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f40cd940 msgr2=0x7f69f406a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/2568163766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f40cd940 0x7f69f406a130 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097c0 tx=0x7f69ec01c410 comp rx=0 tx=0).stop 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- 172.21.15.2:0/2568163766 shutdown_connections 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/2568163766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f40cd940 0x7f69f406a130 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/2568163766 >> v2:172.21.15.90:3300/0 conn(0x7f69f415d4d0 0x7f69f40aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- 172.21.15.2:0/2568163766 >> 172.21.15.2:0/2568163766 conn(0x7f69f406b240 msgr2=0x7f69f406b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- 172.21.15.2:0/2568163766 shutdown_connections 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- 172.21.15.2:0/2568163766 wait complete. 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 Processor -- start 2023-11-04T01:49:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- start start 2023-11-04T01:49:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40cd940 0x7f69f4157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f415d0f0 0x7f69f40c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f415d4d0 0x7f69f40c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c3cc0 con 0x7f69f415d4d0 2023-11-04T01:49:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c3fa0 con 0x7f69f40cd940 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69fa0ab640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c4280 con 0x7f69f415d0f0 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f415d4d0 0x7f69f40c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f415d4d0 0x7f69f40c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37628/0 (socket says 172.21.15.2:37628) 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 -- 172.21.15.2:0/3320828722 learned_addr learned my addr 172.21.15.2:0/3320828722 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f2ffd640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f415d0f0 0x7f69f40c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f37fe640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40cd940 0x7f69f4157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 -- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f415d0f0 msgr2=0x7f69f40c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f415d0f0 0x7f69f40c3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 -- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40cd940 msgr2=0x7f69f4157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40cd940 0x7f69f4157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 -- 172.21.15.2:0/3320828722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec009420 con 0x7f69f415d4d0 2023-11-04T01:49:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.630+0000 7f69f3fff640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f415d4d0 0x7f69f40c4d60 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0ae040 tx=0x7f69ec0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69dbfff640 1 -- 172.21.15.2:0/3320828722 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0bb070 con 0x7f69f415d4d0 2023-11-04T01:49:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69dbfff640 1 -- 172.21.15.2:0/3320828722 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec0abdf0 con 0x7f69f415d4d0 2023-11-04T01:49:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69dbfff640 1 -- 172.21.15.2:0/3320828722 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0b4630 con 0x7f69f415d4d0 2023-11-04T01:49:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f40c4560 con 0x7f69f415d4d0 2023-11-04T01:49:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f40c39d0 con 0x7f69f415d4d0 2023-11-04T01:49:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f40c4a10 con 0x7f69f415d4d0 2023-11-04T01:49:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69dbfff640 1 -- 172.21.15.2:0/3320828722 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f69ec0b2040 con 0x7f69f415d4d0 2023-11-04T01:49:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69dbfff640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69dbfff640 1 -- 172.21.15.2:0/3320828722 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f69ec11dae0 con 0x7f69f415d4d0 2023-11-04T01:49:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69f37fe640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.634+0000 7f69f37fe640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4007ee0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.638+0000 7f69dbfff640 1 -- 172.21.15.2:0/3320828722 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f69ec0ea850 con 0x7f69f415d4d0 2023-11-04T01:49:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f69f40b5cf0 con 0x7f69f415d4d0 2023-11-04T01:49:16.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69dbfff640 1 -- 172.21.15.2:0/3320828722 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v107) v1 ==== 107+0+11 (secure 0 0 0) 0x7f69ec0b00b0 con 0x7f69f415d4d0 2023-11-04T01:49:16.787 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 msgr2=0x7f69e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007fd0 tx=0x7f69e4007ee0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f415d4d0 msgr2=0x7f69f40c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f415d4d0 0x7f69f40c4d60 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0ae040 tx=0x7f69ec0191b0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 shutdown_connections 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f69e00664a0 0x7f69e0068960 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69f415d4d0 0x7f69f40c4d60 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f69f415d0f0 0x7f69f40c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 --2- 172.21.15.2:0/3320828722 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f69f40cd940 0x7f69f4157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 >> 172.21.15.2:0/3320828722 conn(0x7f69f406b240 msgr2=0x7f69f4158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 shutdown_connections 2023-11-04T01:49:16.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.786+0000 7f69fa0ab640 1 -- 172.21.15.2:0/3320828722 wait complete. 2023-11-04T01:49:16.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:49:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb5a514f640 1 Processor -- start 2023-11-04T01:49:16.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb5a514f640 1 -- start start 2023-11-04T01:49:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb5a514f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb5a015d5a0 0x7fb5a00d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb5a514f640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00d09b0 con 0x7fb5a015d1c0 2023-11-04T01:49:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb5a514f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00d0110 con 0x7fb5a00d1cb0 2023-11-04T01:49:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb5a514f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a00d03f0 con 0x7fb5a015d5a0 2023-11-04T01:49:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59ed9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb5a015d1c0 0x7fb5a00d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53300/0 (socket says 172.21.15.2:53300) 2023-11-04T01:49:16.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59ed9d640 1 -- 172.21.15.2:0/2726256489 learned_addr learned my addr 172.21.15.2:0/2726256489 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59f59e640 1 --2- 172.21.15.2:0/2726256489 >> v2:172.21.15.2:3300/0 conn(0x7fb5a015d5a0 0x7fb5a00d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59dd9b640 1 -- 172.21.15.2:0/2726256489 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884098872 0 0) 0x7fb5a00d09b0 con 0x7fb5a015d1c0 2023-11-04T01:49:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59dd9b640 1 -- 172.21.15.2:0/2726256489 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb58c003530 con 0x7fb5a015d1c0 2023-11-04T01:49:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59f59e640 1 -- 172.21.15.2:0/2726256489 >> v1:172.21.15.90:6789/0 conn(0x7fb5a00d1cb0 legacy=0x7fb5a00b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59f59e640 1 -- 172.21.15.2:0/2726256489 >> v1:172.21.15.2:6789/0 conn(0x7fb5a015d1c0 legacy=0x7fb5a00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.930+0000 7fb59f59e640 1 -- 172.21.15.2:0/2726256489 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00d06d0 con 0x7fb5a015d5a0 2023-11-04T01:49:16.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb59f59e640 1 --2- 172.21.15.2:0/2726256489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d5a0 0x7fb5a00d3ae0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fb5980097c0 tx=0x7fb59801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21f18396666795 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb59dd9b640 1 -- 172.21.15.2:0/2726256489 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980a7070 con 0x7fb5a015d5a0 2023-11-04T01:49:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb59dd9b640 1 -- 172.21.15.2:0/2726256489 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980ab430 con 0x7fb5a015d5a0 2023-11-04T01:49:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb59dd9b640 1 -- 172.21.15.2:0/2726256489 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980ab7a0 con 0x7fb5a015d5a0 2023-11-04T01:49:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb5a514f640 1 -- 172.21.15.2:0/2726256489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d5a0 msgr2=0x7fb5a00d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2726256489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d5a0 0x7fb5a00d3ae0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fb5980097c0 tx=0x7fb59801c450 comp rx=0 tx=0).stop 2023-11-04T01:49:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb5a514f640 1 -- 172.21.15.2:0/2726256489 shutdown_connections 2023-11-04T01:49:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2726256489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d5a0 0x7fb5a00d3ae0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb5a514f640 1 -- 172.21.15.2:0/2726256489 >> 172.21.15.2:0/2726256489 conn(0x7fb5a00d2fc0 msgr2=0x7fb5a00d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb5a514f640 1 -- 172.21.15.2:0/2726256489 shutdown_connections 2023-11-04T01:49:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.934+0000 7fb5a514f640 1 -- 172.21.15.2:0/2726256489 wait complete. 2023-11-04T01:49:16.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 Processor -- start 2023-11-04T01:49:16.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 -- start start 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00d1cb0 0x7fb5a01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d1c0 0x7fb5a00b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5a015d5a0 0x7fb5a00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00b33e0 con 0x7fb5a015d1c0 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00b2e20 con 0x7fb5a00d1cb0 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00b3100 con 0x7fb5a015d5a0 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d1c0 0x7fb5a00b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d1c0 0x7fb5a00b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37644/0 (socket says 172.21.15.2:37644) 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 -- 172.21.15.2:0/2426702363 learned_addr learned my addr 172.21.15.2:0/2426702363 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59f59e640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5a015d5a0 0x7fb5a00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59ed9d640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00d1cb0 0x7fb5a01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 -- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5a015d5a0 msgr2=0x7fb5a00cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5a015d5a0 0x7fb5a00cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 -- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00d1cb0 msgr2=0x7fb5a01523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00d1cb0 0x7fb5a01523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 -- 172.21.15.2:0/2426702363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598009420 con 0x7fb5a015d1c0 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb59e59c640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d1c0 0x7fb5a00b2360 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c420 tx=0x7fb58800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5977fe640 1 -- 172.21.15.2:0/2426702363 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880052d0 con 0x7fb5a015d1c0 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5977fe640 1 -- 172.21.15.2:0/2426702363 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588005430 con 0x7fb5a015d1c0 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a00b5d80 con 0x7fb5a015d1c0 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5977fe640 1 -- 172.21.15.2:0/2426702363 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588007260 con 0x7fb5a015d1c0 2023-11-04T01:49:16.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a0155370 con 0x7fb5a015d1c0 2023-11-04T01:49:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.938+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00b5be0 con 0x7fb5a015d1c0 2023-11-04T01:49:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.942+0000 7fb5977fe640 1 -- 172.21.15.2:0/2426702363 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5880073c0 con 0x7fb5a015d1c0 2023-11-04T01:49:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.942+0000 7fb5977fe640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5800664d0 0x7fb580068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:16.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.942+0000 7fb5977fe640 1 -- 172.21.15.2:0/2426702363 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7fb588083950 con 0x7fb5a015d1c0 2023-11-04T01:49:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.942+0000 7fb59ed9d640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5800664d0 0x7fb580068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:16.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.942+0000 7fb59ed9d640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5800664d0 0x7fb580068990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb590001570 tx=0x7fb590009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:16.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:16.946+0000 7fb5977fe640 1 -- 172.21.15.2:0/2426702363 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5a00b5be0 con 0x7fb5a015d1c0 2023-11-04T01:49:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.102+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5a00b5be0 con 0x7fb5a015d1c0 2023-11-04T01:49:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.102+0000 7fb5977fe640 1 -- 172.21.15.2:0/2426702363 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5a00b5be0 con 0x7fb5a015d1c0 2023-11-04T01:49:17.104 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5800664d0 msgr2=0x7fb580068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5800664d0 0x7fb580068990 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fb590001570 tx=0x7fb590009040 comp rx=0 tx=0).stop 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d1c0 msgr2=0x7fb5a00b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d1c0 0x7fb5a00b2360 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb58800c420 tx=0x7fb58800c8e0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 shutdown_connections 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb5800664d0 0x7fb580068990 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb5a015d5a0 0x7fb5a00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5a015d1c0 0x7fb5a00b2360 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 --2- 172.21.15.2:0/2426702363 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00d1cb0 0x7fb5a01523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 >> 172.21.15.2:0/2426702363 conn(0x7fb5a00d2fc0 msgr2=0x7fb5a015e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 shutdown_connections 2023-11-04T01:49:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.106+0000 7fb5a514f640 1 -- 172.21.15.2:0/2426702363 wait complete. 2023-11-04T01:49:17.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:49:17.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.246+0000 7fdd22e90640 1 Processor -- start 2023-11-04T01:49:17.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.246+0000 7fdd22e90640 1 -- start start 2023-11-04T01:49:17.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd22e90640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0cabd0 0x7fdd1c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd22e90640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd1c0af2d0 0x7fdd1c0af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd22e90640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c06fe50 con 0x7fdd1c1556c0 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd22e90640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cb590 con 0x7fdd1c0af2d0 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd22e90640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0ae7f0 con 0x7fdd1c0cabd0 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd1c0af2d0 0x7fdd1c0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdd1c0af2d0 0x7fdd1c0af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37650/0 (socket says 172.21.15.2:37650) 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 -- 172.21.15.2:0/1145045794 learned_addr learned my addr 172.21.15.2:0/1145045794 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd1bfff640 1 --2- 172.21.15.2:0/1145045794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0cabd0 0x7fdd1c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 -- 172.21.15.2:0/1145045794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0cabd0 msgr2=0x7fdd1c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 --2- 172.21.15.2:0/1145045794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0cabd0 0x7fdd1c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 -- 172.21.15.2:0/1145045794 >> v1:172.21.15.90:6789/0 conn(0x7fdd1c1556c0 legacy=0x7fdd1c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 -- 172.21.15.2:0/1145045794 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0aead0 con 0x7fdd1c0af2d0 2023-11-04T01:49:17.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.250+0000 7fdd2142d640 1 --2- 172.21.15.2:0/1145045794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c0af2d0 0x7fdd1c0af760 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e50 tx=0x7fdd1401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e0fd09aa865ee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:17.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd1b7fe640 1 -- 172.21.15.2:0/1145045794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140a5850 con 0x7fdd1c0af2d0 2023-11-04T01:49:17.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd1b7fe640 1 -- 172.21.15.2:0/1145045794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140a59b0 con 0x7fdd1c0af2d0 2023-11-04T01:49:17.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd1b7fe640 1 -- 172.21.15.2:0/1145045794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140a5d40 con 0x7fdd1c0af2d0 2023-11-04T01:49:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- 172.21.15.2:0/1145045794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c0af2d0 msgr2=0x7fdd1c0af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 --2- 172.21.15.2:0/1145045794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c0af2d0 0x7fdd1c0af760 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e50 tx=0x7fdd1401c9e0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- 172.21.15.2:0/1145045794 shutdown_connections 2023-11-04T01:49:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 --2- 172.21.15.2:0/1145045794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c0af2d0 0x7fdd1c0af760 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 --2- 172.21.15.2:0/1145045794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0cabd0 0x7fdd1c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- 172.21.15.2:0/1145045794 >> 172.21.15.2:0/1145045794 conn(0x7fdd1c0ced10 msgr2=0x7fdd1c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- 172.21.15.2:0/1145045794 shutdown_connections 2023-11-04T01:49:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- 172.21.15.2:0/1145045794 wait complete. 2023-11-04T01:49:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 Processor -- start 2023-11-04T01:49:17.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- start start 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0af2d0 0x7fdd1c0c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0cabd0 0x7fdd1c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c1556c0 0x7fdd1c06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b3020 con 0x7fdd1c1556c0 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0c55e0 con 0x7fdd1c0cabd0 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0b2410 con 0x7fdd1c0af2d0 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c1556c0 0x7fdd1c06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c1556c0 0x7fdd1c06c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37656/0 (socket says 172.21.15.2:37656) 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 -- 172.21.15.2:0/674888269 learned_addr learned my addr 172.21.15.2:0/674888269 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd20c2c640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0af2d0 0x7fdd1c0c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd1bfff640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0cabd0 0x7fdd1c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 -- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0af2d0 msgr2=0x7fdd1c0c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0af2d0 0x7fdd1c0c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 -- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0cabd0 msgr2=0x7fdd1c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0cabd0 0x7fdd1c1563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 -- 172.21.15.2:0/674888269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd14009b30 con 0x7fdd1c1556c0 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd2142d640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c1556c0 0x7fdd1c06c1e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fdd140af040 tx=0x7fdd14019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd197fa640 1 -- 172.21.15.2:0/674888269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140b8670 con 0x7fdd1c1556c0 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd197fa640 1 -- 172.21.15.2:0/674888269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140b87f0 con 0x7fdd1c1556c0 2023-11-04T01:49:17.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c0b26f0 con 0x7fdd1c1556c0 2023-11-04T01:49:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd197fa640 1 -- 172.21.15.2:0/674888269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140b8ba0 con 0x7fdd1c1556c0 2023-11-04T01:49:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.254+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c0b2cb0 con 0x7fdd1c1556c0 2023-11-04T01:49:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.258+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0b3190 con 0x7fdd1c1556c0 2023-11-04T01:49:17.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.258+0000 7fdd197fa640 1 -- 172.21.15.2:0/674888269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd140b8d00 con 0x7fdd1c1556c0 2023-11-04T01:49:17.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.258+0000 7fdd197fa640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcfc0664a0 0x7fdcfc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.258+0000 7fdd197fa640 1 -- 172.21.15.2:0/674888269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7fdd1411fd40 con 0x7fdd1c1556c0 2023-11-04T01:49:17.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.258+0000 7fdd20c2c640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcfc0664a0 0x7fdcfc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.258+0000 7fdd20c2c640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcfc0664a0 0x7fdcfc068960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c000f70 tx=0x7fdd0c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:17.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.262+0000 7fdd197fa640 1 -- 172.21.15.2:0/674888269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd140ecaa0 con 0x7fdd1c1556c0 2023-11-04T01:49:17.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd1c04e4a0 con 0x7fdd1c1556c0 2023-11-04T01:49:17.418 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd197fa640 1 -- 172.21.15.2:0/674888269 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd140f00c0 con 0x7fdd1c1556c0 2023-11-04T01:49:17.418 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcfc0664a0 msgr2=0x7fdcfc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcfc0664a0 0x7fdcfc068960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c000f70 tx=0x7fdd0c009040 comp rx=0 tx=0).stop 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c1556c0 msgr2=0x7fdd1c06c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c1556c0 0x7fdd1c06c1e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fdd140af040 tx=0x7fdd14019780 comp rx=0 tx=0).stop 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 shutdown_connections 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fdcfc0664a0 0x7fdcfc068960 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd1c1556c0 0x7fdd1c06c1e0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdd1c0cabd0 0x7fdd1c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 --2- 172.21.15.2:0/674888269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fdd1c0af2d0 0x7fdd1c0c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 >> 172.21.15.2:0/674888269 conn(0x7fdd1c0ced10 msgr2=0x7fdd1c0ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 shutdown_connections 2023-11-04T01:49:17.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.418+0000 7fdd22e90640 1 -- 172.21.15.2:0/674888269 wait complete. 2023-11-04T01:49:17.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:49:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e909d640 1 Processor -- start 2023-11-04T01:49:17.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e909d640 1 -- start start 2023-11-04T01:49:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e909d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4e415d130 0x7fc4e4161730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e909d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40cf080 0x7fc4e40cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e909d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e4070310 con 0x7fc4e40c9af0 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e909d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e4161c70 con 0x7fc4e415d130 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e909d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e406a1d0 con 0x7fc4e40cf080 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e359e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40cf080 0x7fc4e40cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e2d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4e415d130 0x7fc4e4161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e359e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40cf080 0x7fc4e40cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:37576/0 (socket says 172.21.15.2:37576) 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e359e640 1 -- 172.21.15.2:0/899643155 learned_addr learned my addr 172.21.15.2:0/899643155 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:17.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e359e640 1 -- 172.21.15.2:0/899643155 >> v2:172.21.15.90:3300/0 conn(0x7fc4e415d130 msgr2=0x7fc4e4161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e359e640 1 --2- 172.21.15.2:0/899643155 >> v2:172.21.15.90:3300/0 conn(0x7fc4e415d130 0x7fc4e4161730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e359e640 1 -- 172.21.15.2:0/899643155 >> v1:172.21.15.90:6789/0 conn(0x7fc4e40c9af0 legacy=0x7fc4e40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e1d9b640 1 -- 172.21.15.2:0/899643155 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821767773 0 0) 0x7fc4e4070310 con 0x7fc4e40c9af0 2023-11-04T01:49:17.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.558+0000 7fc4e359e640 1 -- 172.21.15.2:0/899643155 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e406a4b0 con 0x7fc4e40cf080 2023-11-04T01:49:17.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e359e640 1 --2- 172.21.15.2:0/899643155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40cf080 0x7fc4e40cb6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009870 tx=0x7fc4cc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a846b638d3ba42c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e1d9b640 1 -- 172.21.15.2:0/899643155 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0aa670 con 0x7fc4e40cf080 2023-11-04T01:49:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e1d9b640 1 -- 172.21.15.2:0/899643155 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc0aa7d0 con 0x7fc4e40cf080 2023-11-04T01:49:17.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e1d9b640 1 -- 172.21.15.2:0/899643155 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0aab60 con 0x7fc4e40cf080 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 -- 172.21.15.2:0/899643155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40cf080 msgr2=0x7fc4e40cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 --2- 172.21.15.2:0/899643155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40cf080 0x7fc4e40cb6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009870 tx=0x7fc4cc01c510 comp rx=0 tx=0).stop 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 -- 172.21.15.2:0/899643155 shutdown_connections 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 --2- 172.21.15.2:0/899643155 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40cf080 0x7fc4e40cb6d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 --2- 172.21.15.2:0/899643155 >> v2:172.21.15.90:3300/0 conn(0x7fc4e415d130 0x7fc4e4161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 -- 172.21.15.2:0/899643155 >> 172.21.15.2:0/899643155 conn(0x7fc4e40b1050 msgr2=0x7fc4e40b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 -- 172.21.15.2:0/899643155 shutdown_connections 2023-11-04T01:49:17.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 -- 172.21.15.2:0/899643155 wait complete. 2023-11-04T01:49:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 Processor -- start 2023-11-04T01:49:17.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.562+0000 7fc4e909d640 1 -- start start 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40c9af0 0x7fc4e415e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e40cf080 0x7fc4e4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e415d130 0x7fc4e4070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e415f4c0 con 0x7fc4e40cf080 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e40c6680 con 0x7fc4e415d130 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e415e840 con 0x7fc4e40c9af0 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e40cf080 0x7fc4e4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e40cf080 0x7fc4e4158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37668/0 (socket says 172.21.15.2:37668) 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 -- 172.21.15.2:0/1037493538 learned_addr learned my addr 172.21.15.2:0/1037493538 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:17.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e2d9d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40c9af0 0x7fc4e415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e359e640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e415d130 0x7fc4e4070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 -- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40c9af0 msgr2=0x7fc4e415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40c9af0 0x7fc4e415e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 -- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e415d130 msgr2=0x7fc4e4070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e415d130 0x7fc4e4070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 -- 172.21.15.2:0/1037493538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0094d0 con 0x7fc4e40cf080 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e259c640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e40cf080 0x7fc4e4158c50 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4001ec0 tx=0x7fc4d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4db7fe640 1 -- 172.21.15.2:0/1037493538 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40054e0 con 0x7fc4e40cf080 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4db7fe640 1 -- 172.21.15.2:0/1037493538 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d4003600 con 0x7fc4e40cf080 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e415eb20 con 0x7fc4e40cf080 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4db7fe640 1 -- 172.21.15.2:0/1037493538 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40039b0 con 0x7fc4e40cf080 2023-11-04T01:49:17.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e415f0e0 con 0x7fc4e40cf080 2023-11-04T01:49:17.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e415f600 con 0x7fc4e40cf080 2023-11-04T01:49:17.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4db7fe640 1 -- 172.21.15.2:0/1037493538 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4d4003b10 con 0x7fc4e40cf080 2023-11-04T01:49:17.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4db7fe640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4c80664a0 0x7fc4c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:17.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4db7fe640 1 -- 172.21.15.2:0/1037493538 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7fc4d4083be0 con 0x7fc4e40cf080 2023-11-04T01:49:17.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.566+0000 7fc4e2d9d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4c80664a0 0x7fc4c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:17.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.570+0000 7fc4e2d9d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4c80664a0 0x7fc4c8068960 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0074a0 tx=0x7fc4dc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:17.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.570+0000 7fc4db7fe640 1 -- 172.21.15.2:0/1037493538 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4d40508b0 con 0x7fc4e40cf080 2023-11-04T01:49:17.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.738+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4e40c2bd0 con 0x7fc4e40cf080 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.738+0000 7fc4db7fe640 1 -- 172.21.15.2:0/1037493538 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 18 entries v107) v1 ==== 81+0+1076 (secure 0 0 0) 0x7fc4d4017020 con 0x7fc4e40cf080 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2988241810 2023-11-04T02:49:10.916906+0000 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:49:17.741 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2023608941 2023-11-04T02:48:20.721790+0000 2023-11-04T01:49:17.742 INFO:teuthology.orchestra.run.smithi002.stderr:listed 18 entries 2023-11-04T01:49:17.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4c80664a0 msgr2=0x7fc4c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4c80664a0 0x7fc4c8068960 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0074a0 tx=0x7fc4dc00b040 comp rx=0 tx=0).stop 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e40cf080 msgr2=0x7fc4e4158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e40cf080 0x7fc4e4158c50 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4001ec0 tx=0x7fc4d400c8e0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 shutdown_connections 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc4c80664a0 0x7fc4c8068960 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4e415d130 0x7fc4e4070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4e40cf080 0x7fc4e4158c50 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 --2- 172.21.15.2:0/1037493538 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc4e40c9af0 0x7fc4e415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 >> 172.21.15.2:0/1037493538 conn(0x7fc4e40b1050 msgr2=0x7fc4e40b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 shutdown_connections 2023-11-04T01:49:17.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:17.742+0000 7fc4e909d640 1 -- 172.21.15.2:0/1037493538 wait complete. 2023-11-04T01:49:17.760 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:49:17.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:17.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:17.772 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[58067]: fuse finished with error 0 and tester_r 0 2023-11-04T01:49:17.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:49:17.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:17.773 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:49:17.826 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:49:17.826 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:49:17.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:49:17.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:49:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f295b230640 1 Processor -- start 2023-11-04T01:49:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f295b230640 1 -- start start 2023-11-04T01:49:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f295b230640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f295406c1c0 0x7f29540cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f295b230640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29540c9ac0 con 0x7f29540c92b0 2023-11-04T01:49:18.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f295b230640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29540caf20 con 0x7f295406bde0 2023-11-04T01:49:18.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f295b230640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c97e0 con 0x7f295406c1c0 2023-11-04T01:49:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f2953fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f29540c92b0 0x7f29541442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53308/0 (socket says 172.21.15.2:53308) 2023-11-04T01:49:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f2953fff640 1 -- 172.21.15.2:0/6415838 learned_addr learned my addr 172.21.15.2:0/6415838 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:18.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29597cd640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f295406c1c0 0x7f29540cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169938123 0 0) 0x7f29540c9ac0 con 0x7f29540c92b0 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293c003530 con 0x7f29540c92b0 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2242321844 0 0) 0x7f293c003530 con 0x7f29540c92b0 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f295406c1c0 msgr2=0x7f29540cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f295406c1c0 0x7f29540cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 >> v1:172.21.15.90:6789/0 conn(0x7f295406bde0 legacy=0x7f295415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540cb1c0 con 0x7f29540c92b0 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2948001680 con 0x7f29540c92b0 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 >> v1:172.21.15.2:6789/0 conn(0x7f29540c92b0 legacy=0x7f29541442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f293c0039b0 0x7f293c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f295406c1c0 0x7f293c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f293c004d10 0x7f293c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c97e0 con 0x7f293c004d10 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c00bac0 con 0x7f293c0039b0 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c00bc80 con 0x7f295406c1c0 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29597cd640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f293c004d10 0x7f293c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f2958fcc640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f293c0039b0 0x7f293c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29597cd640 1 -- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f295406c1c0 msgr2=0x7f293c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29597cd640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f295406c1c0 0x7f293c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29597cd640 1 -- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f293c0039b0 msgr2=0x7f293c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29597cd640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f293c0039b0 0x7f293c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.050+0000 7f29597cd640 1 -- 172.21.15.2:0/6415838 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c003530 con 0x7f293c004d10 2023-11-04T01:49:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f29597cd640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f293c004d10 0x7f293c005190 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f294c009fc0 tx=0x7f294c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4685758c2dbbed67 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c0a5cb0 con 0x7f293c004d10 2023-11-04T01:49:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c00f040 con 0x7f293c004d10 2023-11-04T01:49:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f29537fe640 1 -- 172.21.15.2:0/6415838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c0ad680 con 0x7f293c004d10 2023-11-04T01:49:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- 172.21.15.2:0/6415838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f293c004d10 msgr2=0x7f293c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:18.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 --2- 172.21.15.2:0/6415838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f293c004d10 0x7f293c005190 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f294c009fc0 tx=0x7f294c01cca0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f29597cd640 1 -- 172.21.15.2:0/6415838 reap_dead start 2023-11-04T01:49:18.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- 172.21.15.2:0/6415838 shutdown_connections 2023-11-04T01:49:18.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- 172.21.15.2:0/6415838 >> 172.21.15.2:0/6415838 conn(0x7f29540b0890 msgr2=0x7f29540b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:18.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- 172.21.15.2:0/6415838 shutdown_connections 2023-11-04T01:49:18.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- 172.21.15.2:0/6415838 wait complete. 2023-11-04T01:49:18.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 Processor -- start 2023-11-04T01:49:18.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- start start 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f295414fa10 0x7f29540c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295413e350 0x7f29540b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29540c6c80 0x7f29540b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540b1980 con 0x7f295414fa10 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c71c0 con 0x7f295413e350 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.054+0000 7f295b230640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29540c74a0 con 0x7f29540c6c80 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f295414fa10 0x7f29540c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2953fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295413e350 0x7f29540b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2953fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295413e350 0x7f29540b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.2:35830/0 (socket says 172.21.15.2:35830) 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f295414fa10 0x7f29540c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37690/0 (socket says 172.21.15.2:37690) 2023-11-04T01:49:18.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2953fff640 1 -- 172.21.15.2:0/1681668499 learned_addr learned my addr 172.21.15.2:0/1681668499 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f29597cd640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29540c6c80 0x7f29540b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 -- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29540c6c80 msgr2=0x7f29540b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29540c6c80 0x7f29540b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 -- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295413e350 msgr2=0x7f29540b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295413e350 0x7f29540b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 -- 172.21.15.2:0/1681668499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540b1bd0 con 0x7f295414fa10 2023-11-04T01:49:18.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2958fcc640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f295414fa10 0x7f29540c6740 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f294400f5c0 tx=0x7f294400fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f29517fa640 1 -- 172.21.15.2:0/1681668499 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440052e0 con 0x7f295414fa10 2023-11-04T01:49:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f29517fa640 1 -- 172.21.15.2:0/1681668499 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2944005440 con 0x7f295414fa10 2023-11-04T01:49:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29540b1eb0 con 0x7f295414fa10 2023-11-04T01:49:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f29517fa640 1 -- 172.21.15.2:0/1681668499 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944003820 con 0x7f295414fa10 2023-11-04T01:49:18.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295414fdf0 con 0x7f295414fa10 2023-11-04T01:49:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295404e4a0 con 0x7f295414fa10 2023-11-04T01:49:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f29517fa640 1 -- 172.21.15.2:0/1681668499 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2944003980 con 0x7f295414fa10 2023-11-04T01:49:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f29517fa640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29400664d0 0x7f2940068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f29517fa640 1 -- 172.21.15.2:0/1681668499 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f29440843f0 con 0x7f295414fa10 2023-11-04T01:49:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.058+0000 7f2953fff640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29400664d0 0x7f2940068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:18.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.062+0000 7f2953fff640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29400664d0 0x7f2940068990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f295413e750 tx=0x7f294800a9d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:18.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.062+0000 7f29517fa640 1 -- 172.21.15.2:0/1681668499 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2944051180 con 0x7f295414fa10 2023-11-04T01:49:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.254+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29540c7660 con 0x7f295414fa10 2023-11-04T01:49:18.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.254+0000 7f29517fa640 1 -- 172.21.15.2:0/1681668499 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v106) v1 ==== 53+0+73 (secure 0 0 0) 0x7f29440547a0 con 0x7f295414fa10 2023-11-04T01:49:18.255 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29400664d0 msgr2=0x7f2940068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29400664d0 0x7f2940068990 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f295413e750 tx=0x7f294800a9d0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f295414fa10 msgr2=0x7f29540c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f295414fa10 0x7f29540c6740 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f294400f5c0 tx=0x7f294400fa80 comp rx=0 tx=0).stop 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 shutdown_connections 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f29400664d0 0x7f2940068990 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f29540c6c80 0x7f29540b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295413e350 0x7f29540b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 --2- 172.21.15.2:0/1681668499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f295414fa10 0x7f29540c6740 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 >> 172.21.15.2:0/1681668499 conn(0x7f29540b0890 msgr2=0x7f295415d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 shutdown_connections 2023-11-04T01:49:18.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:18.258+0000 7f295b230640 1 -- 172.21.15.2:0/1681668499 wait complete. 2023-11-04T01:49:18.273 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:49:18.273 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:49:18.273 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:49:18.274 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:49:18.274 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:18.274 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:49:18.274 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:49:18.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:49:18.275 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:49:18.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.275 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:49:18.281 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41786sec preferred_lft 41786sec 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:49:18.282 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:49:18.283 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:49:18.284 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.284 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:49:18.284 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:49:18.284 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:49:18.284 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:49:18.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.285 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:49:18.336 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:49:18.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.337 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:49:18.387 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:49:18.387 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:49:18.387 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:49:18.387 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:49:18.387 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:49:18.387 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:49:18.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.388 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:49:18.388 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:49:18.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:49:18.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:49:18.388 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:49:18.388 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:49:18.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.465 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:49:18.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:49:18.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:49:18.515 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:49:18.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.515 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:49:18.571 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:49:18.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:49:18.571 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:18.581 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:49:18.578+0000 7fec3780a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:49:18.581 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:49:18.578+0000 7fec3780a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:49:18.586 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:49:18.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:49:18.587 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:18.634 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:49:18.683 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:49:18.683 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:49:18.683 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:49:18.683 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:49:18.684 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:49:18.685 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:49:18.686 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:49:18.686 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:49:18.686 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:49:18.686 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:49:18.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.687 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:49:18.734 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:49:18.734 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:49:18.778 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:49:18.779 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:49:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:49:18.785 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:49:18.785 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:49:18.785 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:49:18.785 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:49:18.785 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:49:18.786 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:49:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:49:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:49:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:49:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:49:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:49:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:49:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:49:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:49:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:49:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:49:18.789 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:49:18.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:18.790 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:49:18.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:49:18.862+0000 7fa98d9ed580 -1 init, newargv = 0x55a2d7d809d0 newargc=15 2023-11-04T01:49:18.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[59155]: starting ceph client 2023-11-04T01:49:18.872 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[59155]: starting fuse 2023-11-04T01:49:19.939 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:49:19.949 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:49:19.950 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:49:19.951 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:49:19.952 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:49:19.952 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:19.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:19.953 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:49:20.002 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:49:20.002 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:49:20.003 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:49:20.004 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:49:20.005 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:49:20.005 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:49:20.005 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:49:20.005 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:49:20.129 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.59155.asok 2023-11-04T01:49:20.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:49:20.141 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59155.asok 2023-11-04T01:49:20.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:49:20.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.59155.asok status 2023-11-04T01:49:20.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:49:20.344 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:49:20.345 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:49:20.345 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:49:20.345 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:49:20.345 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:49:20.345 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:49:20.346 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:49:20.346 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "59155", 2023-11-04T01:49:20.346 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:49:20.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:49:20.346 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:49:20.346 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:49:20.347 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 8358, 2023-11-04T01:49:20.347 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:49:20.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:49:20.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:49:20.347 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 8358 2023-11-04T01:49:20.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:49:20.348 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:49:20.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:49:20.348 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:49:20.348 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 4169282097 2023-11-04T01:49:20.348 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:49:20.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:49:20.349 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:49:20.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:49:20.349 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:49:20.349 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 4169282097 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.8358 192.168.0.1:0/4169282097", 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/4169282097", 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 106, 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 107, 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:49:20.350 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:49:20.351 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:49:20.351 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:49:20.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:49:20.364 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:49:20.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:49:20.364 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:20.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:49:20.416 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:49:20.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:49:20.423 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:20.423 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:49:20.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:49:20.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:49:20.469 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:49:20.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:49:20.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.654+0000 7fb0efd9b640 1 Processor -- start 2023-11-04T01:49:20.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.654+0000 7fb0efd9b640 1 -- start start 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0efd9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb0e815a460 0x7fb0e80cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0efd9b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e815a840 con 0x7fb0e80d0210 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0efd9b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80ca2d0 con 0x7fb0e80cb150 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0efd9b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e8071380 con 0x7fb0e815a460 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ed336640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb0e80d0210 0x7fb0e80caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53318/0 (socket says 172.21.15.2:53318) 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ed336640 1 -- 172.21.15.2:0/3193975997 learned_addr learned my addr 172.21.15.2:0/3193975997 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3193975997 >> v2:172.21.15.90:3300/0 conn(0x7fb0e815a460 0x7fb0e80cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382663813 0 0) 0x7fb0e815a840 con 0x7fb0e80d0210 2023-11-04T01:49:20.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d4003530 con 0x7fb0e80d0210 2023-11-04T01:49:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448529680 0 0) 0x7fb0d4003530 con 0x7fb0e80d0210 2023-11-04T01:49:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 >> v2:172.21.15.90:3300/0 conn(0x7fb0e815a460 msgr2=0x7fb0e80cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 --2- 172.21.15.2:0/3193975997 >> v2:172.21.15.90:3300/0 conn(0x7fb0e815a460 0x7fb0e80cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 >> v1:172.21.15.90:6789/0 conn(0x7fb0e80cb150 legacy=0x7fb0e80717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80c9d10 con 0x7fb0e80d0210 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fb0d8001680 con 0x7fb0e80d0210 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 >> v1:172.21.15.2:6789/0 conn(0x7fb0e80d0210 legacy=0x7fb0e80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d40039d0 0x7fb0d4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40047d0 0x7fb0d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d4005190 0x7fb0d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8071380 con 0x7fb0d40039d0 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d400c090 con 0x7fb0d4005190 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d400c250 con 0x7fb0d40047d0 2023-11-04T01:49:20.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d40039d0 0x7fb0d4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ed336640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40047d0 0x7fb0d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ee338640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d4005190 0x7fb0d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0edb37640 1 -- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40047d0 msgr2=0x7fb0d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40047d0 0x7fb0d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0edb37640 1 -- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d4005190 msgr2=0x7fb0d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0d4005190 0x7fb0d400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0edb37640 1 -- 172.21.15.2:0/3193975997 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d4003530 con 0x7fb0d40039d0 2023-11-04T01:49:20.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.658+0000 7fb0ee338640 1 -- 172.21.15.2:0/3193975997 reap_dead start 2023-11-04T01:49:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d40039d0 0x7fb0d4003df0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009ae0 tx=0x7fb0e401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bf21bd578680e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40a8460 con 0x7fb0d40039d0 2023-11-04T01:49:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e40a85c0 con 0x7fb0d40039d0 2023-11-04T01:49:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0ecb35640 1 -- 172.21.15.2:0/3193975997 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40a8970 con 0x7fb0d40039d0 2023-11-04T01:49:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- 172.21.15.2:0/3193975997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d40039d0 msgr2=0x7fb0d4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d40039d0 0x7fb0d4003df0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009ae0 tx=0x7fb0e401ca50 comp rx=0 tx=0).stop 2023-11-04T01:49:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- 172.21.15.2:0/3193975997 shutdown_connections 2023-11-04T01:49:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/3193975997 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d40039d0 0x7fb0d4003df0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- 172.21.15.2:0/3193975997 >> 172.21.15.2:0/3193975997 conn(0x7fb0e80cf520 msgr2=0x7fb0e80cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- 172.21.15.2:0/3193975997 shutdown_connections 2023-11-04T01:49:20.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- 172.21.15.2:0/3193975997 wait complete. 2023-11-04T01:49:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 Processor -- start 2023-11-04T01:49:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- start start 2023-11-04T01:49:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40039d0 0x7fb0e80b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b2120 0x7fb0e815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e815c760 0x7fb0e80b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e81fafb0 con 0x7fb0e815c760 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80c3160 con 0x7fb0e80b2120 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0efd9b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e81fa330 con 0x7fb0d40039d0 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0ee338640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e815c760 0x7fb0e80b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0ee338640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e815c760 0x7fb0e80b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37716/0 (socket says 172.21.15.2:37716) 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0ee338640 1 -- 172.21.15.2:0/15354992 learned_addr learned my addr 172.21.15.2:0/15354992 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0edb37640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40039d0 0x7fb0e80b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.662+0000 7fb0ed336640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b2120 0x7fb0e815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0ee338640 1 -- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40039d0 msgr2=0x7fb0e80b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0ee338640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40039d0 0x7fb0e80b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0ee338640 1 -- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b2120 msgr2=0x7fb0e815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0ee338640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b2120 0x7fb0e815c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0ee338640 1 -- 172.21.15.2:0/15354992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e81fa610 con 0x7fb0e815c760 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0edb37640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40039d0 0x7fb0e80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0ed336640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b2120 0x7fb0e815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0ee338640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e815c760 0x7fb0e80b28f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fb0e806bc40 tx=0x7fb0e000e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0de7fc640 1 -- 172.21.15.2:0/15354992 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0006e30 con 0x7fb0e815c760 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0de7fc640 1 -- 172.21.15.2:0/15354992 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0003980 con 0x7fb0e815c760 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e81fa8f0 con 0x7fb0e815c760 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0de7fc640 1 -- 172.21.15.2:0/15354992 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0003d10 con 0x7fb0e815c760 2023-11-04T01:49:20.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e815d350 con 0x7fb0e815c760 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0de7fc640 1 -- 172.21.15.2:0/15354992 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb0e0005110 con 0x7fb0e815c760 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0de7fc640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb0cc0664a0 0x7fb0cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0de7fc640 1 -- 172.21.15.2:0/15354992 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7fb0e0083cf0 con 0x7fb0e815c760 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0edb37640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb0cc0664a0 0x7fb0cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0f2ec8000 1 Processor -- start 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0f2ec8000 1 -- start start 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.666+0000 7fb0edb37640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb0cc0664a0 0x7fb0cc068960 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40af000 tx=0x7fb0e40046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdc5f0 0x55f18abdc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18ab922b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18ab92bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18aa5ad80 con 0x55f18abdcf10 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9eb7a0 con 0x55f18abdc5f0 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9e8cd0 con 0x55f18ab927f0 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18ab922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18ab922b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37718/0 (socket says 172.21.15.2:37718) 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/3846333308 learned_addr learned my addr 172.21.15.2:0/3846333308 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdc5f0 0x55f18abdc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ee338640 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18ab92bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 msgr2=0x55f18ab92bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18ab92bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdc5f0 msgr2=0x55f18abdc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdc5f0 0x55f18abdc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/3846333308 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f18a981180 con 0x55f18abdcf10 2023-11-04T01:49:20.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ee338640 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18ab92bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18ab922b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8005a30 tx=0x7fb0d8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e8d2def1378315 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0cb7fe640 1 -- 172.21.15.2:0/3846333308 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8018070 con 0x55f18abdcf10 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0cb7fe640 1 -- 172.21.15.2:0/3846333308 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8010940 con 0x55f18abdcf10 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0cb7fe640 1 -- 172.21.15.2:0/3846333308 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8010cb0 con 0x55f18abdcf10 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3846333308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 msgr2=0x55f18ab922b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18ab922b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8005a30 tx=0x7fb0d8005ef0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3846333308 shutdown_connections 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18ab92bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18ab922b0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3846333308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdc5f0 0x55f18abdc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3846333308 >> 172.21.15.2:0/3846333308 conn(0x55f18aa7ad50 msgr2=0x55f18ab90b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3846333308 shutdown_connections 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3846333308 wait complete. 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- start start 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 Processor -- start 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abc0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abc1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abc1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9e45c0 con 0x55f18abdc5f0 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9a28c0 con 0x55f18abdcf10 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9a2560 con 0x55f18ab927f0 2023-11-04T01:49:20.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0f2ec8000 10 client.0 _ll_register_callbacks cb 0x55f18ab7ded0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abc1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abc1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37732/0 (socket says 172.21.15.2:37732) 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/4186771348 learned_addr learned my addr 172.21.15.2:0/4186771348 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ee338640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abc1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0edb37640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abc0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 msgr2=0x55f18abc0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abc0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 msgr2=0x55f18abc1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abc1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 -- 172.21.15.2:0/4186771348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d800f040 con 0x55f18abdc5f0 2023-11-04T01:49:20.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ee338640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abc1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0ed336640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abc1110 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8016040 tx=0x7fb0d8001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3c3bbc7bfb189a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.670+0000 7fb0c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/4186771348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8018030 con 0x55f18abdc5f0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/4186771348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7fb0d8019070 con 0x55f18abdc5f0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f18a9afda0 con 0x55f18abdc5f0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/4186771348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0d80019b0 con 0x55f18abdc5f0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 10 client.8370 fetch_fsmap learned FSMap version 106 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x55f18a6dce20 con 0x55f18abdc5f0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/4186771348 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f18a9afda0 con 0x55f18abdc5f0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/4186771348 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 106) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fb0d8024020 con 0x55f18abdc5f0 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 10 client.8370 fetch_fsmap finished waiting for FSMap version 106 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 10 client.8370 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:49:20.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 20 client.8370 populate_metadata read hostname 'smithi002' 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abc1ef0 0x55f18abedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 4 client.8370 mds_command: new command op to 7986 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 --> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f18a9afb80 con 0x55f18abc1ef0 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0edb37640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abc1ef0 0x55f18abedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 10 client.8370 ms_handle_connect on v2:172.21.15.2:6834/2449846925 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0edb37640 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abc1ef0 0x55f18abedd70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=745845034cd67d19 server_cookie=aa59e57e3e6e8c59 in_seq=0 out_seq=0 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/4186771348 <== mds.0 v2:172.21.15.2:6834/2449846925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f18a9afb80 con 0x55f18abc1ef0 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 10 client.8370 handle_command_reply: tid=0 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 client.8370 shutdown 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 msgr2=0x55f18abc1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abc1110 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8016040 tx=0x7fb0d8001940 comp rx=0 tx=0).stop 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 shutdown_connections 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abc1ef0 0x55f18abedd70 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abc1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abc1110 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/4186771348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abc0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 >> 172.21.15.2:0/4186771348 conn(0x55f18aa7ad50 msgr2=0x55f18ab90b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0c8ff9640 0 client.8370 ms_handle_reset on v2:172.21.15.2:6834/2449846925 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 shutdown_connections 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/4186771348 wait complete. 2023-11-04T01:49:20.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.674+0000 7fb0f2ec8000 20 client.8370 trim_cache size 0 max 16384 2023-11-04T01:49:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.686+0000 7fb0f2ec8000 1 Processor -- start 2023-11-04T01:49:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.686+0000 7fb0f2ec8000 1 -- start start 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18a69daa0 con 0x55f18abdc5f0 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9a17b0 con 0x55f18abdcf10 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9e1dd0 con 0x55f18ab927f0 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abee2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37744/0 (socket says 172.21.15.2:37744) 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 -- 172.21.15.2:0/2208458768 learned_addr learned my addr 172.21.15.2:0/2208458768 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0edb37640 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 -- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 msgr2=0x55f18abedd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abedd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 -- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 msgr2=0x55f18abee7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abee7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 -- 172.21.15.2:0/2208458768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f18a9a52f0 con 0x55f18abdc5f0 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abee2b0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8000eb0 tx=0x7fb0d801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6318e89d643d4246 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0cbfff640 1 -- 172.21.15.2:0/2208458768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8018040 con 0x55f18abdc5f0 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0cbfff640 1 -- 172.21.15.2:0/2208458768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8010c50 con 0x55f18abdc5f0 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0cbfff640 1 -- 172.21.15.2:0/2208458768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8004eb0 con 0x55f18abdc5f0 2023-11-04T01:49:20.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/2208458768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 msgr2=0x55f18abee2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abee2b0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8000eb0 tx=0x7fb0d801f000 comp rx=0 tx=0).stop 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/2208458768 shutdown_connections 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18abdcf10 0x55f18abee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdc5f0 0x55f18abee2b0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/2208458768 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18ab927f0 0x55f18abedd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/2208458768 >> 172.21.15.2:0/2208458768 conn(0x55f18aa7ad50 msgr2=0x55f18ab93460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/2208458768 shutdown_connections 2023-11-04T01:49:20.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/2208458768 wait complete. 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- start start 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 Processor -- start 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18ab927f0 0x55f18ac3da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18abdc5f0 0x55f18ac3df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18abf8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9e7120 con 0x55f18abdcf10 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9dff30 con 0x55f18ab927f0 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f18a9de8c0 con 0x55f18abdc5f0 2023-11-04T01:49:20.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0f2ec8000 10 client.0 _ll_register_callbacks cb 0x55f18aa95bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18abf8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18abf8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37750/0 (socket says 172.21.15.2:37750) 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 -- 172.21.15.2:0/3039664769 learned_addr learned my addr 172.21.15.2:0/3039664769 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18ab927f0 0x55f18ac3da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18abdc5f0 0x55f18ac3df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 -- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18abdc5f0 msgr2=0x55f18ac3df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18abdc5f0 0x55f18ac3df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 -- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18ab927f0 msgr2=0x55f18ac3da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18ab927f0 0x55f18ac3da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ee338640 1 -- 172.21.15.2:0/3039664769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f18a6dce20 con 0x55f18abdcf10 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0ed336640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18abdc5f0 0x55f18ac3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.690+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18ab927f0 0x55f18ac3da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:20.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0ee338640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18abf8840 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0081a10 tx=0x7fb0e0054680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cf257afc103074 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/3039664769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e005c4f0 con 0x55f18abdcf10 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/3039664769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7fb0e0081e40 con 0x55f18abdcf10 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f18ab954e0 con 0x55f18abdcf10 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/3039664769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0e005c650 con 0x55f18abdcf10 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 10 client.8376 fetch_fsmap learned FSMap version 106 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x55f18a98b7f0 con 0x55f18abdcf10 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/3039664769 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f18ab954e0 con 0x55f18abdcf10 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/3039664769 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 106) v1 ==== 3306+0+0 (secure 0 0 0) 0x7fb0e0050470 con 0x55f18abdcf10 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 10 client.8376 fetch_fsmap finished waiting for FSMap version 106 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 10 client.8376 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-11-04T01:49:20.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 20 client.8376 populate_metadata read hostname 'smithi002' 2023-11-04T01:49:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abf9430 0x55f18abf9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 4 client.8376 mds_command: new command op to 7986 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:49:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 --> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f18a9db8b0 con 0x55f18abf9430 2023-11-04T01:49:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abf9430 0x55f18abf9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0edb37640 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abf9430 0x55f18abf9840 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc65b122bf0d8fae server_cookie=5d0cc1e16ce7d5ba in_seq=0 out_seq=0 2023-11-04T01:49:20.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.694+0000 7fb0c8ff9640 10 client.8376 ms_handle_connect on v2:172.21.15.2:6834/2449846925 2023-11-04T01:49:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0c8ff9640 1 -- 172.21.15.2:0/3039664769 <== mds.0 v2:172.21.15.2:6834/2449846925 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f18a9db8b0 con 0x55f18abf9430 2023-11-04T01:49:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0c8ff9640 10 client.8376 handle_command_reply: tid=0 2023-11-04T01:49:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 client.8376 shutdown 2023-11-04T01:49:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 msgr2=0x55f18abf8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18abf8840 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0081a10 tx=0x7fb0e0054680 comp rx=0 tx=0).stop 2023-11-04T01:49:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 shutdown_connections 2023-11-04T01:49:20.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:6834/2449846925,v1:172.21.15.2:6835/2449846925] conn(0x55f18abf9430 0x55f18abf9840 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f18abdcf10 0x55f18abf8840 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55f18abdc5f0 0x55f18ac3df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0c8ff9640 0 client.8376 ms_handle_reset on v2:172.21.15.2:6834/2449846925 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 --2- 172.21.15.2:0/3039664769 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55f18ab927f0 0x55f18ac3da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 >> 172.21.15.2:0/3039664769 conn(0x55f18aa7ad50 msgr2=0x55f18ab93b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 shutdown_connections 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 1 -- 172.21.15.2:0/3039664769 wait complete. 2023-11-04T01:49:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0f2ec8000 20 client.8376 trim_cache size 0 max 16384 2023-11-04T01:49:20.709 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:49:20.709 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2023-11-04T01:49:20.709 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0 2023-11-04T01:49:20.709 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:49:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb0cc0664a0 msgr2=0x7fb0cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb0cc0664a0 0x7fb0cc068960 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40af000 tx=0x7fb0e40046d0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e815c760 msgr2=0x7fb0e80b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e815c760 0x7fb0e80b28f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fb0e806bc40 tx=0x7fb0e000e8b0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 shutdown_connections 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fb0cc0664a0 0x7fb0cc068960 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0e815c760 0x7fb0e80b28f0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0e80b2120 0x7fb0e815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 --2- 172.21.15.2:0/15354992 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fb0d40039d0 0x7fb0e80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 >> 172.21.15.2:0/15354992 conn(0x7fb0e80cf520 msgr2=0x7fb0e8158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 shutdown_connections 2023-11-04T01:49:20.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.706+0000 7fb0efd9b640 1 -- 172.21.15.2:0/15354992 wait complete. 2023-11-04T01:49:20.724 INFO:tasks.cephfs.test_snapshots:testing snapserver mds_kill_mdstable_at=6, also kill snapclient 2023-11-04T01:49:20.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:20.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.838+0000 7f3c2c000640 1 Processor -- start 2023-11-04T01:49:20.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.838+0000 7f3c2c000640 1 -- start start 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2c000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 0x7f3c2415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2c000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240ca100 con 0x7f3c24142eb0 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2c000640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240ca3e0 con 0x7f3c240cbd80 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2c000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ca6c0 con 0x7f3c24142ad0 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2959b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c24142eb0 0x7f3c240cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53326/0 (socket says 172.21.15.2:53326) 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2959b640 1 -- 172.21.15.2:0/4229057794 learned_addr learned my addr 172.21.15.2:0/4229057794 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c29d9c640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 0x7f3c2415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635323502 0 0) 0x7f3c240ca100 con 0x7f3c24142eb0 2023-11-04T01:49:20.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c10005740 con 0x7f3c24142eb0 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1851154711 0 0) 0x7f3c10005740 con 0x7f3c24142eb0 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 msgr2=0x7f3c2415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 0x7f3c2415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 >> v1:172.21.15.90:6789/0 conn(0x7f3c240cbd80 legacy=0x7f3c240c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240ca9a0 con 0x7f3c24142eb0 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3c140016a0 con 0x7f3c24142eb0 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 >> v1:172.21.15.2:6789/0 conn(0x7f3c24142eb0 legacy=0x7f3c240cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10005bc0 0x7f3c10005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 0x7f3c100069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10006f20 0x7f3c100073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ca6c0 con 0x7f3c10006f20 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1000dcd0 con 0x7f3c10005bc0 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1000de90 con 0x7f3c24142ad0 2023-11-04T01:49:20.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2a59d640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10006f20 0x7f3c100073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c29d9c640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10005bc0 0x7f3c10005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2959b640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 0x7f3c100069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2a59d640 1 -- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 msgr2=0x7f3c100069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2a59d640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c24142ad0 0x7f3c100069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2a59d640 1 -- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10005bc0 msgr2=0x7f3c10005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2a59d640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10005bc0 0x7f3c10005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c2a59d640 1 -- 172.21.15.2:0/4229057794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10005740 con 0x7f3c10006f20 2023-11-04T01:49:20.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.842+0000 7f3c29d9c640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c10005bc0 0x7f3c10005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2a59d640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10006f20 0x7f3c100073a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001e70 tx=0x7f3c1c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b3b159adb36084 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c003b80 con 0x7f3c10006f20 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c003ce0 con 0x7f3c10006f20 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c28d9a640 1 -- 172.21.15.2:0/4229057794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0052c0 con 0x7f3c10006f20 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- 172.21.15.2:0/4229057794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10006f20 msgr2=0x7f3c100073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 --2- 172.21.15.2:0/4229057794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c10006f20 0x7f3c100073a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001e70 tx=0x7f3c1c01c760 comp rx=0 tx=0).stop 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2a59d640 1 -- 172.21.15.2:0/4229057794 reap_dead start 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- 172.21.15.2:0/4229057794 shutdown_connections 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- 172.21.15.2:0/4229057794 >> 172.21.15.2:0/4229057794 conn(0x7f3c240b0890 msgr2=0x7f3c240b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- 172.21.15.2:0/4229057794 shutdown_connections 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- 172.21.15.2:0/4229057794 wait complete. 2023-11-04T01:49:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 Processor -- start 2023-11-04T01:49:20.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- start start 2023-11-04T01:49:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241590b0 0x7f3c24135e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24134870 0x7f3c240b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240c5d30 0x7f3c240c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240c66f0 con 0x7f3c24134870 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c241363a0 con 0x7f3c240c5d30 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2c000640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240c68e0 con 0x7f3c241590b0 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2959b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24134870 0x7f3c240b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2959b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24134870 0x7f3c240b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37774/0 (socket says 172.21.15.2:37774) 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2959b640 1 -- 172.21.15.2:0/4186567895 learned_addr learned my addr 172.21.15.2:0/4186567895 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c29d9c640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241590b0 0x7f3c24135e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.846+0000 7f3c2a59d640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240c5d30 0x7f3c240c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2959b640 1 -- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241590b0 msgr2=0x7f3c24135e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2959b640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241590b0 0x7f3c24135e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2959b640 1 -- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240c5d30 msgr2=0x7f3c240c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2959b640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240c5d30 0x7f3c240c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2959b640 1 -- 172.21.15.2:0/4186567895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24159490 con 0x7f3c24134870 2023-11-04T01:49:20.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2959b640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24134870 0x7f3c240b3e00 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f3c140118b0 tx=0x7f3c14011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c1a7fc640 1 -- 172.21.15.2:0/4186567895 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400fb60 con 0x7f3c24134870 2023-11-04T01:49:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c1a7fc640 1 -- 172.21.15.2:0/4186567895 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1400fcc0 con 0x7f3c24134870 2023-11-04T01:49:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c24134dc0 con 0x7f3c24134870 2023-11-04T01:49:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c1a7fc640 1 -- 172.21.15.2:0/4186567895 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14015630 con 0x7f3c24134870 2023-11-04T01:49:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24135380 con 0x7f3c24134870 2023-11-04T01:49:20.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c240c9db0 con 0x7f3c24134870 2023-11-04T01:49:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c1a7fc640 1 -- 172.21.15.2:0/4186567895 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c14015790 con 0x7f3c24134870 2023-11-04T01:49:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c1a7fc640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c080664a0 0x7f3c08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c1a7fc640 1 -- 172.21.15.2:0/4186567895 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f3c140879f0 con 0x7f3c24134870 2023-11-04T01:49:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c29d9c640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c080664a0 0x7f3c08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.850+0000 7f3c29d9c640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c080664a0 0x7f3c08068960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009ab0 tx=0x7f3c20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:20.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:20.854+0000 7f3c1a7fc640 1 -- 172.21.15.2:0/4186567895 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c140546d0 con 0x7f3c24134870 2023-11-04T01:49:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.050+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c2404e4a0 con 0x7f3c24134870 2023-11-04T01:49:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c1a7fc640 1 -- 172.21.15.2:0/4186567895 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4930 (secure 0 0 0) 0x7f3c14057cf0 con 0x7f3c24134870 2023-11-04T01:49:21.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:21.053 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":106,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:12.929745+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 106 2023-11-04T01:49:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c080664a0 msgr2=0x7f3c08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c080664a0 0x7f3c08068960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009ab0 tx=0x7f3c20008040 comp rx=0 tx=0).stop 2023-11-04T01:49:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24134870 msgr2=0x7f3c240b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24134870 0x7f3c240b3e00 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f3c140118b0 tx=0x7f3c14011d70 comp rx=0 tx=0).stop 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 shutdown_connections 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c080664a0 0x7f3c08068960 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240c5d30 0x7f3c240c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c24134870 0x7f3c240b3e00 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 --2- 172.21.15.2:0/4186567895 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241590b0 0x7f3c24135e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 >> 172.21.15.2:0/4186567895 conn(0x7f3c240b0890 msgr2=0x7f3c2406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 shutdown_connections 2023-11-04T01:49:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.054+0000 7f3c2c000640 1 -- 172.21.15.2:0/4186567895 wait complete. 2023-11-04T01:49:21.072 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump snaps --server 2023-11-04T01:49:21.212 INFO:teuthology.orchestra.run.smithi002.stdout:{"last_snap":11,"last_created":11,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:48:32.891232+0000","name":"s25","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:49:21.212 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 11, "last_destroyed": 9, "last_snap": 11, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:48:32.891232+0000" } ] } 2023-11-04T01:49:21.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:0 true 2023-11-04T01:49:21.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.334+0000 7faf570b3640 1 Processor -- start 2023-11-04T01:49:21.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.334+0000 7faf570b3640 1 -- start start 2023-11-04T01:49:21.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.334+0000 7faf570b3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf500c9a70 0x7faf500b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.334+0000 7faf570b3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faf500caaa0 0x7faf500cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.334+0000 7faf570b3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf500ccdf0 con 0x7faf5015d410 2023-11-04T01:49:21.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf570b3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5006fe50 con 0x7faf500caaa0 2023-11-04T01:49:21.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf570b3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf500aef20 con 0x7faf500c9a70 2023-11-04T01:49:21.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf500c9a70 0x7faf500b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf500c9a70 0x7faf500b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3301/0 says I am v2:172.21.15.2:40536/0 (socket says 172.21.15.2:40536) 2023-11-04T01:49:21.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 -- 172.21.15.2:0/2090115271 learned_addr learned my addr 172.21.15.2:0/2090115271 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:21.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf55650640 1 --2- 172.21.15.2:0/2090115271 >> v2:172.21.15.90:3300/0 conn(0x7faf500caaa0 0x7faf500cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 -- 172.21.15.2:0/2090115271 >> v2:172.21.15.90:3300/0 conn(0x7faf500caaa0 msgr2=0x7faf500cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:21.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 --2- 172.21.15.2:0/2090115271 >> v2:172.21.15.90:3300/0 conn(0x7faf500caaa0 0x7faf500cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 -- 172.21.15.2:0/2090115271 >> v1:172.21.15.90:6789/0 conn(0x7faf5015d410 legacy=0x7faf500c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 -- 172.21.15.2:0/2090115271 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf500b0750 con 0x7faf500c9a70 2023-11-04T01:49:21.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4ffff640 1 --2- 172.21.15.2:0/2090115271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf500c9a70 0x7faf500b0210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf3800bb10 tx=0x7faf3801ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d1816581c67d9b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:21.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4f7fe640 1 -- 172.21.15.2:0/2090115271 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380a7bd0 con 0x7faf500c9a70 2023-11-04T01:49:21.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4f7fe640 1 -- 172.21.15.2:0/2090115271 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf380a7d30 con 0x7faf500c9a70 2023-11-04T01:49:21.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.338+0000 7faf4f7fe640 1 -- 172.21.15.2:0/2090115271 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380a7ea0 con 0x7faf500c9a70 2023-11-04T01:49:21.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- 172.21.15.2:0/2090115271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf500c9a70 msgr2=0x7faf500b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 --2- 172.21.15.2:0/2090115271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf500c9a70 0x7faf500b0210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf3800bb10 tx=0x7faf3801ec10 comp rx=0 tx=0).stop 2023-11-04T01:49:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- 172.21.15.2:0/2090115271 shutdown_connections 2023-11-04T01:49:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 --2- 172.21.15.2:0/2090115271 >> v2:172.21.15.90:3300/0 conn(0x7faf500caaa0 0x7faf500cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 --2- 172.21.15.2:0/2090115271 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf500c9a70 0x7faf500b0210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- 172.21.15.2:0/2090115271 >> 172.21.15.2:0/2090115271 conn(0x7faf500ced10 msgr2=0x7faf500cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- 172.21.15.2:0/2090115271 shutdown_connections 2023-11-04T01:49:21.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- 172.21.15.2:0/2090115271 wait complete. 2023-11-04T01:49:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 Processor -- start 2023-11-04T01:49:21.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- start start 2023-11-04T01:49:21.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf500c9a70 0x7faf50153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf500caaa0 0x7faf500ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf5015d410 0x7faf500c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500acf00 con 0x7faf500caaa0 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500ac8f0 con 0x7faf500c9a70 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf50153d70 con 0x7faf5015d410 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf500caaa0 0x7faf500ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf500caaa0 0x7faf500ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58062/0 (socket says 172.21.15.2:58062) 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 -- 172.21.15.2:0/3891560029 learned_addr learned my addr 172.21.15.2:0/3891560029 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf55650640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf5015d410 0x7faf500c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf54e4f640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf500c9a70 0x7faf50153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 -- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf5015d410 msgr2=0x7faf500c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf5015d410 0x7faf500c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 -- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf500c9a70 msgr2=0x7faf50153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf500c9a70 0x7faf50153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 -- 172.21.15.2:0/3891560029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3800b770 con 0x7faf500caaa0 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf54e4f640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf500c9a70 0x7faf50153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4ffff640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf500caaa0 0x7faf500ad390 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7faf3800b2c0 tx=0x7faf3801b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4d7fa640 1 -- 172.21.15.2:0/3891560029 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380a7ea0 con 0x7faf500caaa0 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4d7fa640 1 -- 172.21.15.2:0/3891560029 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf380afd90 con 0x7faf500caaa0 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf50154050 con 0x7faf500caaa0 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf4d7fa640 1 -- 172.21.15.2:0/3891560029 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf380ba650 con 0x7faf500caaa0 2023-11-04T01:49:21.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.342+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf500c6400 con 0x7faf500caaa0 2023-11-04T01:49:21.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.346+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5006cfc0 con 0x7faf500caaa0 2023-11-04T01:49:21.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.346+0000 7faf4d7fa640 1 -- 172.21.15.2:0/3891560029 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf380c3450 con 0x7faf500caaa0 2023-11-04T01:49:21.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.346+0000 7faf4d7fa640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf300664a0 0x7faf30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.346+0000 7faf4d7fa640 1 -- 172.21.15.2:0/3891560029 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7faf3811edd0 con 0x7faf500caaa0 2023-11-04T01:49:21.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.346+0000 7faf54e4f640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf300664a0 0x7faf30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.346+0000 7faf54e4f640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf300664a0 0x7faf30068960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7faf48007fd0 tx=0x7faf48009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:21.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.350+0000 7faf4d7fa640 1 -- 172.21.15.2:0/3891560029 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faf5006cfc0 con 0x7faf500caaa0 2023-11-04T01:49:21.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.566+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"} v 0) v1 -- 0x7faf5006cfc0 con 0x7faf500caaa0 2023-11-04T01:49:21.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.662+0000 7faf4d7fa640 1 -- 172.21.15.2:0/3891560029 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:0", "val": "true"}]=0 freezing mds.7986 v107) v1 ==== 112+0+0 (secure 0 0 0) 0x7faf5006cfc0 con 0x7faf500caaa0 2023-11-04T01:49:21.664 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.7986 2023-11-04T01:49:21.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf300664a0 msgr2=0x7faf30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf300664a0 0x7faf30068960 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7faf48007fd0 tx=0x7faf48009040 comp rx=0 tx=0).stop 2023-11-04T01:49:21.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf500caaa0 msgr2=0x7faf500ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf500caaa0 0x7faf500ad390 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7faf3800b2c0 tx=0x7faf3801b9b0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 shutdown_connections 2023-11-04T01:49:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7faf300664a0 0x7faf30068960 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7faf5015d410 0x7faf500c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf500caaa0 0x7faf500ad390 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 --2- 172.21.15.2:0/3891560029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf500c9a70 0x7faf50153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 >> 172.21.15.2:0/3891560029 conn(0x7faf500ced10 msgr2=0x7faf5006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:21.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 shutdown_connections 2023-11-04T01:49:21.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.666+0000 7faf570b3640 1 -- 172.21.15.2:0/3891560029 wait complete. 2023-11-04T01:49:21.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:49:21.800 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:49:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:49:21.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.814+0000 7efdea438640 1 Processor -- start 2023-11-04T01:49:21.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.814+0000 7efdea438640 1 -- start start 2023-11-04T01:49:21.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efdea438640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efde40cd790 0x7efde40cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efdea438640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde40cdb70 0x7efde415f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efdea438640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde415bd50 con 0x7efde415c1e0 2023-11-04T01:49:21.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efdea438640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40d0b80 con 0x7efde40cd790 2023-11-04T01:49:21.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efdea438640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde415fe40 con 0x7efde40cdb70 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde37fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde40cdb70 0x7efde415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde3fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efde40cd790 0x7efde40cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde89d5640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7efde415c1e0 0x7efde40ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:50130/0 (socket says 172.21.15.2:50130) 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde89d5640 1 -- 172.21.15.2:0/2164428182 learned_addr learned my addr 172.21.15.2:0/2164428182 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde3fff640 1 -- 172.21.15.2:0/2164428182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde40cdb70 msgr2=0x7efde415f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde3fff640 1 --2- 172.21.15.2:0/2164428182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde40cdb70 0x7efde415f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde3fff640 1 -- 172.21.15.2:0/2164428182 >> v1:172.21.15.90:6789/0 conn(0x7efde415c1e0 legacy=0x7efde40ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.818+0000 7efde3fff640 1 -- 172.21.15.2:0/2164428182 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40cb470 con 0x7efde40cd790 2023-11-04T01:49:21.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efde3fff640 1 --2- 172.21.15.2:0/2164428182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cd790 0x7efde40cd0b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efdd40097c0 tx=0x7efdd401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25944f23415e72f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efde2ffd640 1 -- 172.21.15.2:0/2164428182 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40ab680 con 0x7efde40cd790 2023-11-04T01:49:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efde2ffd640 1 -- 172.21.15.2:0/2164428182 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd40ab7e0 con 0x7efde40cd790 2023-11-04T01:49:21.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efde2ffd640 1 -- 172.21.15.2:0/2164428182 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40abb70 con 0x7efde40cd790 2023-11-04T01:49:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 -- 172.21.15.2:0/2164428182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cd790 msgr2=0x7efde40cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 --2- 172.21.15.2:0/2164428182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cd790 0x7efde40cd0b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efdd40097c0 tx=0x7efdd401c480 comp rx=0 tx=0).stop 2023-11-04T01:49:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 -- 172.21.15.2:0/2164428182 shutdown_connections 2023-11-04T01:49:21.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 --2- 172.21.15.2:0/2164428182 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde40cdb70 0x7efde415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 --2- 172.21.15.2:0/2164428182 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cd790 0x7efde40cd0b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 -- 172.21.15.2:0/2164428182 >> 172.21.15.2:0/2164428182 conn(0x7efde406dd20 msgr2=0x7efde406e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 -- 172.21.15.2:0/2164428182 shutdown_connections 2023-11-04T01:49:21.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 -- 172.21.15.2:0/2164428182 wait complete. 2023-11-04T01:49:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 Processor -- start 2023-11-04T01:49:21.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.822+0000 7efdea438640 1 -- start start 2023-11-04T01:49:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40cd790 0x7efde4151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cdb70 0x7efde40c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde415c1e0 0x7efde41517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde415e370 con 0x7efde40cd790 2023-11-04T01:49:21.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde415dbb0 con 0x7efde40cdb70 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde4151590 con 0x7efde415c1e0 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40cd790 0x7efde4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40cd790 0x7efde4151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58068/0 (socket says 172.21.15.2:58068) 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 -- 172.21.15.2:0/1109092575 learned_addr learned my addr 172.21.15.2:0/1109092575 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde37fe640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cdb70 0x7efde40c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde89d5640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde415c1e0 0x7efde41517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 -- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde415c1e0 msgr2=0x7efde41517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde415c1e0 0x7efde41517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 -- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cdb70 msgr2=0x7efde40c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cdb70 0x7efde40c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 -- 172.21.15.2:0/1109092575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4009420 con 0x7efde40cd790 2023-11-04T01:49:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde37fe640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cdb70 0x7efde40c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde3fff640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40cd790 0x7efde4151050 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7efdd40ad040 tx=0x7efdd401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde0ff9640 1 -- 172.21.15.2:0/1109092575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40bf610 con 0x7efde40cd790 2023-11-04T01:49:21.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde0ff9640 1 -- 172.21.15.2:0/1109092575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd40bf770 con 0x7efde40cd790 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde0ff9640 1 -- 172.21.15.2:0/1109092575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40bfae0 con 0x7efde40cd790 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde4157100 con 0x7efde40cd790 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde4156e20 con 0x7efde40cd790 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde404e4a0 con 0x7efde40cd790 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde0ff9640 1 -- 172.21.15.2:0/1109092575 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efdd40bfc40 con 0x7efde40cd790 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde0ff9640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efdd00664a0 0x7efdd0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde0ff9640 1 -- 172.21.15.2:0/1109092575 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7efdd411f080 con 0x7efde40cd790 2023-11-04T01:49:21.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.826+0000 7efde37fe640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efdd00664a0 0x7efdd0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.830+0000 7efde37fe640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efdd00664a0 0x7efdd0068960 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efde4156720 tx=0x7efdd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:21.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:21.830+0000 7efde0ff9640 1 -- 172.21.15.2:0/1109092575 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efdd40ebd60 con 0x7efde40cd790 2023-11-04T01:49:22.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.050+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7efde415b1f0 con 0x7efde40cd790 2023-11-04T01:49:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.674+0000 7efde0ff9640 1 -- 172.21.15.2:0/1109092575 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8193 v108) v1 ==== 112+0+0 (secure 0 0 0) 0x7efdd40ef380 con 0x7efde40cd790 2023-11-04T01:49:22.676 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.8193 2023-11-04T01:49:22.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efdd00664a0 msgr2=0x7efdd0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:22.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efdd00664a0 0x7efdd0068960 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efde4156720 tx=0x7efdd8008040 comp rx=0 tx=0).stop 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40cd790 msgr2=0x7efde4151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40cd790 0x7efde4151050 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7efdd40ad040 tx=0x7efdd401acc0 comp rx=0 tx=0).stop 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 shutdown_connections 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efdd00664a0 0x7efdd0068960 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efde415c1e0 0x7efde41517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efde40cdb70 0x7efde40c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 --2- 172.21.15.2:0/1109092575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde40cd790 0x7efde4151050 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 >> 172.21.15.2:0/1109092575 conn(0x7efde406dd20 msgr2=0x7efde40b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 shutdown_connections 2023-11-04T01:49:22.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:22.678+0000 7efdea438640 1 -- 172.21.15.2:0/1109092575 wait complete. 2023-11-04T01:49:22.705 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 6 2023-11-04T01:49:22.896 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_kill_mdstable_at = '6' (not observed, change may require restart) "} 2023-11-04T01:49:22.896 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '6' (not observed, change may require restart) " } 2023-11-04T01:49:22.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:22.897 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s26) 2023-11-04T01:49:22.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:49:23.036 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:49:23.036 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:49:23.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:23.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff583f7a640 1 Processor -- start 2023-11-04T01:49:23.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff583f7a640 1 -- start start 2023-11-04T01:49:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff583f7a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c142ad0 0x7ff57c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff583f7a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff57c142eb0 0x7ff57c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff583f7a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57c0ca100 con 0x7ff57c0caec0 2023-11-04T01:49:23.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff583f7a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57c0ca3e0 con 0x7ff57c142eb0 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff583f7a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c0ca6c0 con 0x7ff57c142ad0 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff581515640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff57c142eb0 0x7ff57c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff582517640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff57c0caec0 0x7ff57c0cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57096/0 (socket says 172.21.15.2:57096) 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff582517640 1 -- 172.21.15.2:0/902278280 learned_addr learned my addr 172.21.15.2:0/902278280 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff581d16640 1 --2- 172.21.15.2:0/902278280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c142ad0 0x7ff57c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff581515640 1 -- 172.21.15.2:0/902278280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c142ad0 msgr2=0x7ff57c15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff581515640 1 --2- 172.21.15.2:0/902278280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c142ad0 0x7ff57c15e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff581515640 1 -- 172.21.15.2:0/902278280 >> v1:172.21.15.2:6789/0 conn(0x7ff57c0caec0 legacy=0x7ff57c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff580d14640 1 -- 172.21.15.2:0/902278280 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762371980 0 0) 0x7ff57c0ca100 con 0x7ff57c0caec0 2023-11-04T01:49:23.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.158+0000 7ff581515640 1 -- 172.21.15.2:0/902278280 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c0ca9a0 con 0x7ff57c142eb0 2023-11-04T01:49:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff581515640 1 --2- 172.21.15.2:0/902278280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142eb0 0x7ff57c0cc830 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097c0 tx=0x7ff56c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de46cf34fc8378cf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff580d14640 1 -- 172.21.15.2:0/902278280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0ab610 con 0x7ff57c142eb0 2023-11-04T01:49:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff580d14640 1 -- 172.21.15.2:0/902278280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0ab770 con 0x7ff57c142eb0 2023-11-04T01:49:23.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff580d14640 1 -- 172.21.15.2:0/902278280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0abb00 con 0x7ff57c142eb0 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- 172.21.15.2:0/902278280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142eb0 msgr2=0x7ff57c0cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 --2- 172.21.15.2:0/902278280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142eb0 0x7ff57c0cc830 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0097c0 tx=0x7ff56c01c3f0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- 172.21.15.2:0/902278280 shutdown_connections 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 --2- 172.21.15.2:0/902278280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142eb0 0x7ff57c0cc830 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 --2- 172.21.15.2:0/902278280 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c142ad0 0x7ff57c15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- 172.21.15.2:0/902278280 >> 172.21.15.2:0/902278280 conn(0x7ff57c0b0890 msgr2=0x7ff57c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- 172.21.15.2:0/902278280 shutdown_connections 2023-11-04T01:49:23.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- 172.21.15.2:0/902278280 wait complete. 2023-11-04T01:49:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 Processor -- start 2023-11-04T01:49:23.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- start start 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0caec0 0x7ff57c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142ad0 0x7ff57c1497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c142eb0 0x7ff57c1400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c149310 con 0x7ff57c142ad0 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1f6110 con 0x7ff57c142eb0 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff583f7a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57c1f63f0 con 0x7ff57c0caec0 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff581515640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142ad0 0x7ff57c1497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff581515640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142ad0 0x7ff57c1497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58082/0 (socket says 172.21.15.2:58082) 2023-11-04T01:49:23.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.162+0000 7ff581515640 1 -- 172.21.15.2:0/1483811976 learned_addr learned my addr 172.21.15.2:0/1483811976 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581d16640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0caec0 0x7ff57c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff582517640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c142eb0 0x7ff57c1400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581515640 1 -- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0caec0 msgr2=0x7ff57c0ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581515640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0caec0 0x7ff57c0ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581515640 1 -- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c142eb0 msgr2=0x7ff57c1400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581515640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c142eb0 0x7ff57c1400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581515640 1 -- 172.21.15.2:0/1483811976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c009420 con 0x7ff57c142ad0 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff582517640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c142eb0 0x7ff57c1400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581515640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142ad0 0x7ff57c1497a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0ad040 tx=0x7ff56c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff5727fc640 1 -- 172.21.15.2:0/1483811976 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0b58d0 con 0x7ff57c142ad0 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff5727fc640 1 -- 172.21.15.2:0/1483811976 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c0b5a70 con 0x7ff57c142ad0 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57c1f66d0 con 0x7ff57c142ad0 2023-11-04T01:49:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff5727fc640 1 -- 172.21.15.2:0/1483811976 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c0b5e20 con 0x7ff57c142ad0 2023-11-04T01:49:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57c149eb0 con 0x7ff57c142ad0 2023-11-04T01:49:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c1f6910 con 0x7ff57c142ad0 2023-11-04T01:49:23.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff5727fc640 1 -- 172.21.15.2:0/1483811976 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff56c0bf410 con 0x7ff57c142ad0 2023-11-04T01:49:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff5727fc640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5600664a0 0x7ff560068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff5727fc640 1 -- 172.21.15.2:0/1483811976 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7ff56c11f370 con 0x7ff57c142ad0 2023-11-04T01:49:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581d16640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5600664a0 0x7ff560068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:23.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.166+0000 7ff581d16640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5600664a0 0x7ff560068960 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff578003fd0 tx=0x7ff5780039a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:23.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.170+0000 7ff5727fc640 1 -- 172.21.15.2:0/1483811976 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff57c1f6910 con 0x7ff57c142ad0 2023-11-04T01:49:23.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff57c1490e0 con 0x7ff57c142ad0 2023-11-04T01:49:23.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff5727fc640 1 -- 172.21.15.2:0/1483811976 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4930 (secure 0 0 0) 0x7ff57c1490e0 con 0x7ff57c142ad0 2023-11-04T01:49:23.363 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:23.363 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:22.053413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:23.364 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 108 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5600664a0 msgr2=0x7ff560068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5600664a0 0x7ff560068960 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff578003fd0 tx=0x7ff5780039a0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142ad0 msgr2=0x7ff57c1497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142ad0 0x7ff57c1497a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff56c0ad040 tx=0x7ff56c01ac30 comp rx=0 tx=0).stop 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 shutdown_connections 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff5600664a0 0x7ff560068960 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff57c142eb0 0x7ff57c1400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff57c142ad0 0x7ff57c1497a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 --2- 172.21.15.2:0/1483811976 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff57c0caec0 0x7ff57c0ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:23.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 >> 172.21.15.2:0/1483811976 conn(0x7ff57c0b0890 msgr2=0x7ff57c065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:23.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 shutdown_connections 2023-11-04T01:49:23.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:23.362+0000 7ff583f7a640 1 -- 172.21.15.2:0/1483811976 wait complete. 2023-11-04T01:49:23.382 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:49:25.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:25.250 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:27.636 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fec34003640 time 2023-11-04T01:49:27.637800+0000 2023-11-04T01:49:27.636 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:49:27.637 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.637 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec4013bfae] 2023-11-04T01:49:27.637 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.637 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.637 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.637 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.637 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:49:27.638+0000 7fec34003640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fec34003640 time 2023-11-04T01:49:27.637800+0000 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec4013bfae] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.638 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.639 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.639 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.639 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.639 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.639 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.639 INFO:tasks.ceph.mds.a.smithi002.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:49:27.639 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7fec34003640 thread_name:MR_Finisher 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec3fa76520] 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec4013c008] 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.640 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:49:27.638+0000 7fec34003640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7fec34003640 thread_name:MR_Finisher 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec3fa76520] 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:49:27.641 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec4013c008] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.642 INFO:tasks.ceph.mds.a.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:49:27.643 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.651 INFO:tasks.ceph.mds.a.smithi002.stderr: -798> 2023-11-04T01:49:18.578+0000 7fec3780a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:49:27.651 INFO:tasks.ceph.mds.a.smithi002.stderr: -796> 2023-11-04T01:49:18.578+0000 7fec3780a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:49:27.654 INFO:tasks.ceph.mds.a.smithi002.stderr: -4> 2023-11-04T01:49:27.638+0000 7fec34003640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fec34003640 time 2023-11-04T01:49:27.637800+0000 2023-11-04T01:49:27.654 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:49:27.654 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.654 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.654 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec4013bfae] 2023-11-04T01:49:27.654 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.654 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 0> 2023-11-04T01:49:27.638+0000 7fec34003640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7fec34003640 thread_name:MR_Finisher 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.655 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec3fa76520] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec4013c008] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.656 INFO:tasks.ceph.mds.a.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:49:27.657 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.664 INFO:tasks.ceph.mds.a.smithi002.stderr: -798> 2023-11-04T01:49:18.578+0000 7fec3780a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:49:27.664 INFO:tasks.ceph.mds.a.smithi002.stderr: -796> 2023-11-04T01:49:18.578+0000 7fec3780a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:49:27.666 INFO:tasks.ceph.mds.a.smithi002.stderr: -4> 2023-11-04T01:49:27.638+0000 7fec34003640 -1 ./src/mds/MDSTableServer.cc: In function 'void MDSTableServer::_commit_logged(ceph::cref_t&)' thread 7fec34003640 time 2023-11-04T01:49:27.637800+0000 2023-11-04T01:49:27.666 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableServer.cc: 171: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 6) 2023-11-04T01:49:27.666 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fec4013bfae] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.667 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 0> 2023-11-04T01:49:27.638+0000 7fec34003640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7fec34003640 thread_name:MR_Finisher 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fec3fa76520] 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fec4013c008] 2023-11-04T01:49:27.668 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7fec4013c162] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableServer::_commit_logged(boost::intrusive_ptr const&)+0x405) [0x561541c3eda5] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSContext::complete(int)+0x5c) [0x561541c6f08c] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSIOContextBase::complete(int)+0x30c) [0x561541c6f4bc] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSLogContextBase::complete(int)+0x53) [0x561541c6f5f3] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (Finisher::finisher_thread_entry()+0x175) [0x7fec401e2305] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fec3fac8b43] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fec3fb5aa00] 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:49:27.669 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:49:27.910 INFO:tasks.ceph.mds.a.smithi002.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:49:28.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:28.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b7d030640 1 Processor -- start 2023-11-04T01:49:28.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b7d030640 1 -- start start 2023-11-04T01:49:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b7d030640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b78160680 0x7f5b780cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:28.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b7d030640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780cf000 con 0x7f5b78160a60 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b7d030640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780b5de0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b7d030640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780d09b0 con 0x7f5b78160680 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b76d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b78160680 0x7f5b780cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b76d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b78160680 0x7f5b780cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58088/0 (socket says 172.21.15.2:58088) 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b76d9d640 1 -- 172.21.15.2:0/2823093412 learned_addr learned my addr 172.21.15.2:0/2823093412 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b7659c640 1 --1- 172.21.15.2:0/2823093412 >> v1:172.21.15.2:6789/0 conn(0x7f5b78160a60 0x7f5b780ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57110/0 (socket says 172.21.15.2:57110) 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b76d9d640 1 -- 172.21.15.2:0/2823093412 >> v1:172.21.15.90:6789/0 conn(0x7f5b780ce7f0 legacy=0x7f5b780b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b76d9d640 1 -- 172.21.15.2:0/2823093412 >> v1:172.21.15.2:6789/0 conn(0x7f5b78160a60 legacy=0x7f5b780ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:28.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b76d9d640 1 -- 172.21.15.2:0/2823093412 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780d1610 con 0x7f5b78160680 2023-11-04T01:49:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.518+0000 7f5b76d9d640 1 --2- 172.21.15.2:0/2823093412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b78160680 0x7f5b780cdba0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009870 tx=0x7f5b6801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846cc484f00330d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b75d9b640 1 -- 172.21.15.2:0/2823093412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b680aa430 con 0x7f5b78160680 2023-11-04T01:49:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b75d9b640 1 -- 172.21.15.2:0/2823093412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b680aa590 con 0x7f5b78160680 2023-11-04T01:49:28.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b75d9b640 1 -- 172.21.15.2:0/2823093412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b680aa920 con 0x7f5b78160680 2023-11-04T01:49:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- 172.21.15.2:0/2823093412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b78160680 msgr2=0x7f5b780cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 --2- 172.21.15.2:0/2823093412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b78160680 0x7f5b780cdba0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009870 tx=0x7f5b6801c4d0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- 172.21.15.2:0/2823093412 shutdown_connections 2023-11-04T01:49:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 --2- 172.21.15.2:0/2823093412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b78160680 0x7f5b780cdba0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- 172.21.15.2:0/2823093412 >> 172.21.15.2:0/2823093412 conn(0x7f5b780d2f90 msgr2=0x7f5b780d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:28.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- 172.21.15.2:0/2823093412 shutdown_connections 2023-11-04T01:49:28.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- 172.21.15.2:0/2823093412 wait complete. 2023-11-04T01:49:28.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 Processor -- start 2023-11-04T01:49:28.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- start start 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b780ce7f0 0x7f5b7814c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b78160680 0x7f5b7814bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b78160a60 0x7f5b7815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7815f5e0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7815f300 con 0x7f5b78160680 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b7d030640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78159460 con 0x7f5b78160a60 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b76d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b780ce7f0 0x7f5b7814c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:28.526 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b76d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b780ce7f0 0x7f5b7814c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58092/0 (socket says 172.21.15.2:58092) 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.522+0000 7f5b76d9d640 1 -- 172.21.15.2:0/3542757549 learned_addr learned my addr 172.21.15.2:0/3542757549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b7659c640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b78160680 0x7f5b7814bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b76d9d640 1 -- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b78160a60 msgr2=0x7f5b7815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b76d9d640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b78160a60 0x7f5b7815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b76d9d640 1 -- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b78160680 msgr2=0x7f5b7814bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b76d9d640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b78160680 0x7f5b7814bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b76d9d640 1 -- 172.21.15.2:0/3542757549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b680094d0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b7659c640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b78160680 0x7f5b7814bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b76d9d640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b780ce7f0 0x7f5b7814c2d0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5b680ac040 tx=0x7f5b6801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b6f7fe640 1 -- 172.21.15.2:0/3542757549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b680b38c0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b6f7fe640 1 -- 172.21.15.2:0/3542757549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b680b3a40 con 0x7f5b780ce7f0 2023-11-04T01:49:28.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b78159740 con 0x7f5b780ce7f0 2023-11-04T01:49:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b6f7fe640 1 -- 172.21.15.2:0/3542757549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b680b3df0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7814eaf0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b781592c0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b6f7fe640 1 -- 172.21.15.2:0/3542757549 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b680c6440 con 0x7f5b780ce7f0 2023-11-04T01:49:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b6f7fe640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b5c0664d0 0x7f5b5c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b6f7fe640 1 -- 172.21.15.2:0/3542757549 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f5b6811f190 con 0x7f5b780ce7f0 2023-11-04T01:49:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.526+0000 7f5b7659c640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b5c0664d0 0x7f5b5c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:28.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.530+0000 7f5b7659c640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b5c0664d0 0x7f5b5c068990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b60000f70 tx=0x7f5b60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:28.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.530+0000 7f5b6f7fe640 1 -- 172.21.15.2:0/3542757549 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b781592c0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:49:28.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.722+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b781592c0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.722+0000 7f5b6f7fe640 1 -- 172.21.15.2:0/3542757549 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4930 (secure 0 0 0) 0x7f5b781592c0 con 0x7f5b780ce7f0 2023-11-04T01:49:28.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:28.724 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:22.053413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:28.724 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 108 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b5c0664d0 msgr2=0x7f5b5c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b5c0664d0 0x7f5b5c068990 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b60000f70 tx=0x7f5b60009040 comp rx=0 tx=0).stop 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b780ce7f0 msgr2=0x7f5b7814c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b780ce7f0 0x7f5b7814c2d0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f5b680ac040 tx=0x7f5b6801ad10 comp rx=0 tx=0).stop 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 shutdown_connections 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b5c0664d0 0x7f5b5c068990 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b78160a60 0x7f5b7815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b78160680 0x7f5b7814bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 --2- 172.21.15.2:0/3542757549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b780ce7f0 0x7f5b7814c2d0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:28.726 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 >> 172.21.15.2:0/3542757549 conn(0x7f5b780d2f90 msgr2=0x7f5b78158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 shutdown_connections 2023-11-04T01:49:28.727 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:28.726+0000 7f5b7d030640 1 -- 172.21.15.2:0/3542757549 wait complete. 2023-11-04T01:49:28.743 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:49:33.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be6429640 1 Processor -- start 2023-11-04T01:49:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be6429640 1 -- start start 2023-11-04T01:49:33.883 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be6429640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 0x7f2be0167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be6429640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be00cf000 con 0x7f2be0160680 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be6429640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be00b5de0 con 0x7f2be0160a60 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be6429640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00d09b0 con 0x7f2be00b72f0 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2be0160680 0x7f2be00cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41588/0 (socket says 172.21.15.2:41588) 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 -- 172.21.15.2:0/840236670 learned_addr learned my addr 172.21.15.2:0/840236670 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be49c6640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 0x7f2be0167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388156027 0 0) 0x7f2be00cf000 con 0x7f2be0160680 2023-11-04T01:49:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc8003530 con 0x7f2be0160680 2023-11-04T01:49:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 104421583 0 0) 0x7f2bc8003530 con 0x7f2be0160680 2023-11-04T01:49:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 msgr2=0x7f2be0167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 0x7f2be0167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 >> v1:172.21.15.90:6789/0 conn(0x7f2be0160a60 legacy=0x7f2be00ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00d1610 con 0x7f2be0160680 2023-11-04T01:49:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2bd0001680 con 0x7f2be0160680 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 >> v1:172.21.15.2:6789/0 conn(0x7f2be0160680 legacy=0x7f2be00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2bc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc80047d0 0x7f2bc8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 0x7f2bc8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00d09b0 con 0x7f2bc80039b0 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc800ba70 con 0x7f2bc80047d0 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc800bc30 con 0x7f2be00b72f0 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2bc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdf7fe640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc80047d0 0x7f2bc8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2be49c6640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 0x7f2bc8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 -- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 msgr2=0x7f2bc8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be00b72f0 0x7f2bc8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 -- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc80047d0 msgr2=0x7f2bc8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bc80047d0 0x7f2bc8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.882+0000 7f2bdffff640 1 -- 172.21.15.2:0/840236670 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8003530 con 0x7f2bc80039b0 2023-11-04T01:49:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2bdffff640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2bc8003dd0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0001ec0 tx=0x7f2bd001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91c9e03872538c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0005ae0 con 0x7f2bc80039b0 2023-11-04T01:49:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd0005c40 con 0x7f2bc80039b0 2023-11-04T01:49:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2bdeffd640 1 -- 172.21.15.2:0/840236670 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00a57d0 con 0x7f2bc80039b0 2023-11-04T01:49:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2be6429640 1 -- 172.21.15.2:0/840236670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 msgr2=0x7f2bc8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2be6429640 1 --2- 172.21.15.2:0/840236670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2bc8003dd0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0001ec0 tx=0x7f2bd001caf0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2be49c6640 1 -- 172.21.15.2:0/840236670 reap_dead start 2023-11-04T01:49:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2be6429640 1 -- 172.21.15.2:0/840236670 shutdown_connections 2023-11-04T01:49:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.886+0000 7f2be6429640 1 -- 172.21.15.2:0/840236670 >> 172.21.15.2:0/840236670 conn(0x7f2be00d2f90 msgr2=0x7f2be00d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- 172.21.15.2:0/840236670 shutdown_connections 2023-11-04T01:49:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- 172.21.15.2:0/840236670 wait complete. 2023-11-04T01:49:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 Processor -- start 2023-11-04T01:49:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- start start 2023-11-04T01:49:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2be01f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be0152f10 0x7f2be0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be0151390 0x7f2be00b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0151120 con 0x7f2bc80039b0 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0157fc0 con 0x7f2be0151390 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be0153390 con 0x7f2be0152f10 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2be01f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2be01f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43210/0 (socket says 172.21.15.2:43210) 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 -- 172.21.15.2:0/428162269 learned_addr learned my addr 172.21.15.2:0/428162269 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be49c6640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be0151390 0x7f2be00b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdf7fe640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be0152f10 0x7f2be0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 -- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be0152f10 msgr2=0x7f2be0152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be0152f10 0x7f2be0152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 -- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be0151390 msgr2=0x7f2be00b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be0151390 0x7f2be00b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 -- 172.21.15.2:0/428162269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0153640 con 0x7f2bc80039b0 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdf7fe640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be0152f10 0x7f2be0152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdffff640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2be01f69b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f2bd001c920 tx=0x7f2bc8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdcff9640 1 -- 172.21.15.2:0/428162269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00b4070 con 0x7f2bc80039b0 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdcff9640 1 -- 172.21.15.2:0/428162269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd00047f0 con 0x7f2bc80039b0 2023-11-04T01:49:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2bdcff9640 1 -- 172.21.15.2:0/428162269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0004b60 con 0x7f2bc80039b0 2023-11-04T01:49:33.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be0153920 con 0x7f2bc80039b0 2023-11-04T01:49:33.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.890+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be0152650 con 0x7f2bc80039b0 2023-11-04T01:49:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.894+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be004e4a0 con 0x7f2bc80039b0 2023-11-04T01:49:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.894+0000 7f2bdcff9640 1 -- 172.21.15.2:0/428162269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2bd00b7070 con 0x7f2bc80039b0 2023-11-04T01:49:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.894+0000 7f2bdcff9640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2bcc0664a0 0x7f2bcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.894+0000 7f2bdcff9640 1 -- 172.21.15.2:0/428162269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f2bd011da80 con 0x7f2bc80039b0 2023-11-04T01:49:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.894+0000 7f2bdf7fe640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2bcc0664a0 0x7f2bcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.894+0000 7f2bdf7fe640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2bcc0664a0 0x7f2bcc068960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4000c10 tx=0x7f2bd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:33.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:33.898+0000 7f2bdcff9640 1 -- 172.21.15.2:0/428162269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2bd00ea750 con 0x7f2bc80039b0 2023-11-04T01:49:34.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.090+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2be015e510 con 0x7f2bc80039b0 2023-11-04T01:49:34.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.090+0000 7f2bdcff9640 1 -- 172.21.15.2:0/428162269 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4930 (secure 0 0 0) 0x7f2bd00edd70 con 0x7f2bc80039b0 2023-11-04T01:49:34.091 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:34.091 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:22.053413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 108 2023-11-04T01:49:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2bcc0664a0 msgr2=0x7f2bcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2bcc0664a0 0x7f2bcc068960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4000c10 tx=0x7f2bd4009040 comp rx=0 tx=0).stop 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 msgr2=0x7f2be01f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2be01f69b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f2bd001c920 tx=0x7f2bc8005800 comp rx=0 tx=0).stop 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 shutdown_connections 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2bcc0664a0 0x7f2bcc068960 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2be0151390 0x7f2be00b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2be0152f10 0x7f2be0152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 --2- 172.21.15.2:0/428162269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80039b0 0x7f2be01f69b0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 >> 172.21.15.2:0/428162269 conn(0x7f2be00d2f90 msgr2=0x7f2be006b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 shutdown_connections 2023-11-04T01:49:34.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:34.094+0000 7f2be6429640 1 -- 172.21.15.2:0/428162269 wait complete. 2023-11-04T01:49:34.111 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:49:35.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:49:39.112 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c694f5640 1 Processor -- start 2023-11-04T01:49:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c694f5640 1 -- start start 2023-11-04T01:49:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c694f5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c640cb8b0 0x7f0c640cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c694f5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c64161da0 con 0x7f0c640ccf40 2023-11-04T01:49:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c694f5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c64165ed0 con 0x7f0c64162860 2023-11-04T01:49:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c694f5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c64161bb0 con 0x7f0c640cb8b0 2023-11-04T01:49:39.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c637fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0c640ccf40 0x7f0c641651a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41604/0 (socket says 172.21.15.2:41604) 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c637fe640 1 -- 172.21.15.2:0/2183368149 learned_addr learned my addr 172.21.15.2:0/2183368149 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c62ffd640 1 --2- 172.21.15.2:0/2183368149 >> v2:172.21.15.90:3300/0 conn(0x7f0c640cb8b0 0x7f0c640cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749978254 0 0) 0x7f0c64161da0 con 0x7f0c640ccf40 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c4c003530 con 0x7f0c640ccf40 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1191553396 0 0) 0x7f0c4c003530 con 0x7f0c640ccf40 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 >> v2:172.21.15.90:3300/0 conn(0x7f0c640cb8b0 msgr2=0x7f0c640cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 --2- 172.21.15.2:0/2183368149 >> v2:172.21.15.90:3300/0 conn(0x7f0c640cb8b0 0x7f0c640cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 >> v1:172.21.15.90:6789/0 conn(0x7f0c64162860 legacy=0x7f0c640cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64162060 con 0x7f0c640ccf40 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f0c5c001680 con 0x7f0c640ccf40 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 >> v1:172.21.15.2:6789/0 conn(0x7f0c640ccf40 legacy=0x7f0c641651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:39.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c003980 0x7f0c4c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c005190 0x7f0c4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c00c0b0 con 0x7f0c4c0047d0 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c00c220 con 0x7f0c4c003980 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c00c3e0 con 0x7f0c4c005190 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c627fc640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c62ffd640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c003980 0x7f0c4c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c637fe640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c005190 0x7f0c4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c627fc640 1 -- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c005190 msgr2=0x7f0c4c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c627fc640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c4c005190 0x7f0c4c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c627fc640 1 -- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c003980 msgr2=0x7f0c4c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c627fc640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c003980 0x7f0c4c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c627fc640 1 -- 172.21.15.2:0/2183368149 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c003530 con 0x7f0c4c0047d0 2023-11-04T01:49:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.250+0000 7f0c637fe640 1 -- 172.21.15.2:0/2183368149 reap_dead start 2023-11-04T01:49:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c627fc640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c50 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0c58001780 tx=0x7f0c5801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a7f0deb4cec6c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580052d0 con 0x7f0c4c0047d0 2023-11-04T01:49:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580a7050 con 0x7f0c4c0047d0 2023-11-04T01:49:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c61ffb640 1 -- 172.21.15.2:0/2183368149 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58003600 con 0x7f0c4c0047d0 2023-11-04T01:49:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 -- 172.21.15.2:0/2183368149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c0047d0 msgr2=0x7f0c4c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c50 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0c58001780 tx=0x7f0c5801c400 comp rx=0 tx=0).stop 2023-11-04T01:49:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 -- 172.21.15.2:0/2183368149 shutdown_connections 2023-11-04T01:49:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2183368149 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c50 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 -- 172.21.15.2:0/2183368149 >> 172.21.15.2:0/2183368149 conn(0x7f0c640b0890 msgr2=0x7f0c640b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 -- 172.21.15.2:0/2183368149 shutdown_connections 2023-11-04T01:49:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 -- 172.21.15.2:0/2183368149 wait complete. 2023-11-04T01:49:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 Processor -- start 2023-11-04T01:49:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.254+0000 7f0c694f5640 1 -- start start 2023-11-04T01:49:39.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c0047d0 0x7f0c6415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c6415c4d0 0x7f0c64141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c6415c930 0x7f0c64141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64157e70 con 0x7f0c6415c930 2023-11-04T01:49:39.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6415e680 con 0x7f0c4c0047d0 2023-11-04T01:49:39.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64159e70 con 0x7f0c6415c4d0 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c6415c930 0x7f0c64141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c6415c930 0x7f0c64141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43238/0 (socket says 172.21.15.2:43238) 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 -- 172.21.15.2:0/2446982659 learned_addr learned my addr 172.21.15.2:0/2446982659 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c627fc640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c6415c4d0 0x7f0c64141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c62ffd640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c0047d0 0x7f0c6415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 -- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c6415c4d0 msgr2=0x7f0c64141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c6415c4d0 0x7f0c64141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 -- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c0047d0 msgr2=0x7f0c6415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c0047d0 0x7f0c6415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 -- 172.21.15.2:0/2446982659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6415a150 con 0x7f0c6415c930 2023-11-04T01:49:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c637fe640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c6415c930 0x7f0c64141f50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c001ec0 tx=0x7f0c5c011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c4b7fe640 1 -- 172.21.15.2:0/2446982659 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00f920 con 0x7f0c6415c930 2023-11-04T01:49:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c4b7fe640 1 -- 172.21.15.2:0/2446982659 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c00fac0 con 0x7f0c6415c930 2023-11-04T01:49:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6415a430 con 0x7f0c6415c930 2023-11-04T01:49:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c4b7fe640 1 -- 172.21.15.2:0/2446982659 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00fe70 con 0x7f0c6415c930 2023-11-04T01:49:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6415a9f0 con 0x7f0c6415c930 2023-11-04T01:49:39.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6415abe0 con 0x7f0c6415c930 2023-11-04T01:49:39.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c4b7fe640 1 -- 172.21.15.2:0/2446982659 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0c5c01f460 con 0x7f0c6415c930 2023-11-04T01:49:39.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c4b7fe640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c500664a0 0x7f0c50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:39.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c4b7fe640 1 -- 172.21.15.2:0/2446982659 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f0c5c0876a0 con 0x7f0c6415c930 2023-11-04T01:49:39.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.258+0000 7f0c62ffd640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c500664a0 0x7f0c50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:39.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.262+0000 7f0c62ffd640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c500664a0 0x7f0c50068960 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0c64063da0 tx=0x7f0c5400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:39.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.262+0000 7f0c4b7fe640 1 -- 172.21.15.2:0/2446982659 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0c5c054380 con 0x7f0c6415c930 2023-11-04T01:49:39.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.454+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c6404e4a0 con 0x7f0c6415c930 2023-11-04T01:49:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.454+0000 7f0c4b7fe640 1 -- 172.21.15.2:0/2446982659 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4930 (secure 0 0 0) 0x7f0c5c0579a0 con 0x7f0c6415c930 2023-11-04T01:49:39.457 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":108,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:22.053413+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 108 2023-11-04T01:49:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c500664a0 msgr2=0x7f0c50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c500664a0 0x7f0c50068960 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0c64063da0 tx=0x7f0c5400b040 comp rx=0 tx=0).stop 2023-11-04T01:49:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c6415c930 msgr2=0x7f0c64141f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c6415c930 0x7f0c64141f50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c001ec0 tx=0x7f0c5c011c20 comp rx=0 tx=0).stop 2023-11-04T01:49:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 shutdown_connections 2023-11-04T01:49:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f0c500664a0 0x7f0c50068960 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c6415c930 0x7f0c64141f50 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c6415c4d0 0x7f0c64141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 --2- 172.21.15.2:0/2446982659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c4c0047d0 0x7f0c6415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 >> 172.21.15.2:0/2446982659 conn(0x7f0c640b0890 msgr2=0x7f0c640ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 shutdown_connections 2023-11-04T01:49:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:39.458+0000 7f0c694f5640 1 -- 172.21.15.2:0/2446982659 wait complete. 2023-11-04T01:49:39.477 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:49:41.825 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:49:44.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.610+0000 7f134cb6d640 1 Processor -- start 2023-11-04T01:49:44.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.610+0000 7f134cb6d640 1 -- start start 2023-11-04T01:49:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134cb6d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f13480add70 0x7f134815d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134cb6d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13480c4910 con 0x7f13480ae200 2023-11-04T01:49:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134cb6d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134815dcf0 con 0x7f134815cf80 2023-11-04T01:49:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134cb6d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134806bbf0 con 0x7f13480add70 2023-11-04T01:49:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1346d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f13480ae200 0x7f13480cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56734/0 (socket says 172.21.15.2:56734) 2023-11-04T01:49:44.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1346d9d640 1 -- 172.21.15.2:0/2564002523 learned_addr learned my addr 172.21.15.2:0/2564002523 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881969525 0 0) 0x7f13480c4910 con 0x7f13480ae200 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1345d9b640 1 --2- 172.21.15.2:0/2564002523 >> v2:172.21.15.90:3300/0 conn(0x7f13480add70 0x7f134815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1334003530 con 0x7f13480ae200 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3178888460 0 0) 0x7f1334003530 con 0x7f13480ae200 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 >> v2:172.21.15.90:3300/0 conn(0x7f13480add70 msgr2=0x7f134815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 --2- 172.21.15.2:0/2564002523 >> v2:172.21.15.90:3300/0 conn(0x7f13480add70 0x7f134815d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 >> v1:172.21.15.90:6789/0 conn(0x7f134815cf80 legacy=0x7f13480ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134815dfd0 con 0x7f13480ae200 2023-11-04T01:49:44.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f13400016a0 con 0x7f13480ae200 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 >> v1:172.21.15.2:6789/0 conn(0x7f13480ae200 legacy=0x7f13480cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1334003980 0x7f1334003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13340047d0 0x7f1334004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1334005190 0x7f133400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134806bbf0 con 0x7f13340047d0 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133400c130 con 0x7f1334003980 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133400c2f0 con 0x7f1334005190 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1345d9b640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13340047d0 0x7f1334004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1346d9d640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1334005190 0x7f133400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1345d9b640 1 -- 172.21.15.2:0/2564002523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1334005190 msgr2=0x7f133400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1345d9b640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1334005190 0x7f133400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1345d9b640 1 -- 172.21.15.2:0/2564002523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1334003980 msgr2=0x7f1334003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:44.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1345d9b640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1334003980 0x7f1334003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1346d9d640 1 -- 172.21.15.2:0/2564002523 reap_dead start 2023-11-04T01:49:44.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.614+0000 7f1345d9b640 1 -- 172.21.15.2:0/2564002523 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1334003530 con 0x7f13340047d0 2023-11-04T01:49:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1345d9b640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13340047d0 0x7f1334004c50 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1330009ae0 tx=0x7f133001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1c80f4ea3c5f03 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300a55b0 con 0x7f13340047d0 2023-11-04T01:49:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13300a5710 con 0x7f13340047d0 2023-11-04T01:49:44.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134559a640 1 -- 172.21.15.2:0/2564002523 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300a5ac0 con 0x7f13340047d0 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- 172.21.15.2:0/2564002523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13340047d0 msgr2=0x7f1334004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13340047d0 0x7f1334004c50 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f1330009ae0 tx=0x7f133001c9c0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- 172.21.15.2:0/2564002523 shutdown_connections 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2564002523 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13340047d0 0x7f1334004c50 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- 172.21.15.2:0/2564002523 >> 172.21.15.2:0/2564002523 conn(0x7f13480b0890 msgr2=0x7f13480b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- 172.21.15.2:0/2564002523 shutdown_connections 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- 172.21.15.2:0/2564002523 wait complete. 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 Processor -- start 2023-11-04T01:49:44.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- start start 2023-11-04T01:49:44.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13340047d0 0x7f134815fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13480b1730 0x7f13480b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13480b3d60 0x7f13480b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348152530 con 0x7f13480b3d60 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480b20f0 con 0x7f13480b1730 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134cb6d640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1348160260 con 0x7f13340047d0 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13480b3d60 0x7f13480b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13480b3d60 0x7f13480b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59570/0 (socket says 172.21.15.2:59570) 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 -- 172.21.15.2:0/2504423919 learned_addr learned my addr 172.21.15.2:0/2504423919 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1345d9b640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13480b1730 0x7f13480b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134659c640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13340047d0 0x7f134815fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 -- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13340047d0 msgr2=0x7f134815fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13340047d0 0x7f134815fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 -- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13480b1730 msgr2=0x7f13480b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13480b1730 0x7f13480b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1346d9d640 1 -- 172.21.15.2:0/2504423919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134815ec80 con 0x7f13480b3d60 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f1345d9b640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13480b1730 0x7f13480b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.618+0000 7f134659c640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13340047d0 0x7f134815fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f1346d9d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13480b3d60 0x7f13480b41e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f13480c4aa0 tx=0x7f134000e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f133effd640 1 -- 172.21.15.2:0/2504423919 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340010510 con 0x7f13480b3d60 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f133effd640 1 -- 172.21.15.2:0/2504423919 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340010670 con 0x7f13480b3d60 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134815ef60 con 0x7f13480b3d60 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f133effd640 1 -- 172.21.15.2:0/2504423919 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340010a20 con 0x7f13480b3d60 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134815f520 con 0x7f13480b3d60 2023-11-04T01:49:44.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134804e4a0 con 0x7f13480b3d60 2023-11-04T01:49:44.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f133effd640 1 -- 172.21.15.2:0/2504423919 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1340010b80 con 0x7f13480b3d60 2023-11-04T01:49:44.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f133effd640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13280664a0 0x7f1328068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:44.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f133effd640 1 -- 172.21.15.2:0/2504423919 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f1340083ce0 con 0x7f13480b3d60 2023-11-04T01:49:44.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f134659c640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13280664a0 0x7f1328068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:44.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.622+0000 7f134659c640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13280664a0 0x7f1328068960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1338007fd0 tx=0x7f1338009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:44.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.626+0000 7f133effd640 1 -- 172.21.15.2:0/2504423919 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1340054450 con 0x7f13480b3d60 2023-11-04T01:49:44.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.818+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f134806cf10 con 0x7f13480b3d60 2023-11-04T01:49:44.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.818+0000 7f133effd640 1 -- 172.21.15.2:0/2504423919 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4978 (secure 0 0 0) 0x7f1340053fe0 con 0x7f13480b3d60 2023-11-04T01:49:44.820 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:44.658536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:49:44.658536+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:44.820 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 109 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13280664a0 msgr2=0x7f1328068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13280664a0 0x7f1328068960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1338007fd0 tx=0x7f1338009040 comp rx=0 tx=0).stop 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13480b3d60 msgr2=0x7f13480b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13480b3d60 0x7f13480b41e0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f13480c4aa0 tx=0x7f134000e8f0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 shutdown_connections 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f13280664a0 0x7f1328068960 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f13480b3d60 0x7f13480b41e0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f13480b1730 0x7f13480b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 --2- 172.21.15.2:0/2504423919 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f13340047d0 0x7f134815fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 >> 172.21.15.2:0/2504423919 conn(0x7f13480b0890 msgr2=0x7f1348161580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 shutdown_connections 2023-11-04T01:49:44.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:44.822+0000 7f134cb6d640 1 -- 172.21.15.2:0/2504423919 wait complete. 2023-11-04T01:49:44.838 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:49:44.838 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:49:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:49:44.850 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:49:44.850 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:49:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:1699062567.57525.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:49:44.913 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062567.57525.core'] 2023-11-04T01:49:44.913 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062567.57525.core, deleting it 2023-11-04T01:49:44.913 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062567.57525.core 2023-11-04T01:49:44.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:45.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbfb71e640 1 Processor -- start 2023-11-04T01:49:45.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbfb71e640 1 -- start start 2023-11-04T01:49:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbfb71e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbfb71e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffbf40cbd80 0x7ffbf40cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbfb71e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbf40ca100 con 0x7ffbf4142eb0 2023-11-04T01:49:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbfb71e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbf40ca3e0 con 0x7ffbf40cbd80 2023-11-04T01:49:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbfb71e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40ca6c0 con 0x7ffbf4142ad0 2023-11-04T01:49:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf8cb9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffbf4142eb0 0x7ffbf40cb670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56746/0 (socket says 172.21.15.2:56746) 2023-11-04T01:49:45.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf8cb9640 1 -- 172.21.15.2:0/3903789141 learned_addr learned my addr 172.21.15.2:0/3903789141 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf9cbb640 1 --2- 172.21.15.2:0/3903789141 >> v2:172.21.15.2:3300/0 conn(0x7ffbf40cbd80 0x7ffbf40cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf94ba640 1 --2- 172.21.15.2:0/3903789141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbebfff640 1 -- 172.21.15.2:0/3903789141 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345980196 0 0) 0x7ffbf40ca100 con 0x7ffbf4142eb0 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbebfff640 1 -- 172.21.15.2:0/3903789141 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbe0003530 con 0x7ffbf4142eb0 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf9cbb640 1 -- 172.21.15.2:0/3903789141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 msgr2=0x7ffbf415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf9cbb640 1 --2- 172.21.15.2:0/3903789141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf9cbb640 1 -- 172.21.15.2:0/3903789141 >> v1:172.21.15.2:6789/0 conn(0x7ffbf4142eb0 legacy=0x7ffbf40cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.138+0000 7ffbf9cbb640 1 -- 172.21.15.2:0/3903789141 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf40ca9a0 con 0x7ffbf40cbd80 2023-11-04T01:49:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbf9cbb640 1 --2- 172.21.15.2:0/3903789141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40cc830 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009d90 tx=0x7ffbec01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956ce191e8ea975 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbebfff640 1 -- 172.21.15.2:0/3903789141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbec0a59a0 con 0x7ffbf40cbd80 2023-11-04T01:49:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbebfff640 1 -- 172.21.15.2:0/3903789141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbec0a5b00 con 0x7ffbf40cbd80 2023-11-04T01:49:45.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbebfff640 1 -- 172.21.15.2:0/3903789141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbec0a5e90 con 0x7ffbf40cbd80 2023-11-04T01:49:45.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 -- 172.21.15.2:0/3903789141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 msgr2=0x7ffbf40cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/3903789141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40cc830 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009d90 tx=0x7ffbec01c8c0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 -- 172.21.15.2:0/3903789141 shutdown_connections 2023-11-04T01:49:45.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/3903789141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40cc830 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/3903789141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 -- 172.21.15.2:0/3903789141 >> 172.21.15.2:0/3903789141 conn(0x7ffbf40b0890 msgr2=0x7ffbf40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:45.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 -- 172.21.15.2:0/3903789141 shutdown_connections 2023-11-04T01:49:45.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 -- 172.21.15.2:0/3903789141 wait complete. 2023-11-04T01:49:45.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 Processor -- start 2023-11-04T01:49:45.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.142+0000 7ffbfb71e640 1 -- start start 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf4070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbf4142eb0 0x7ffbf412e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40b1980 con 0x7ffbf40cbd80 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40b1c60 con 0x7ffbf4142eb0 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40b1f40 con 0x7ffbf4142ad0 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59580/0 (socket says 172.21.15.2:59580) 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 -- 172.21.15.2:0/810760433 learned_addr learned my addr 172.21.15.2:0/810760433 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf8cb9640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf4070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf9cbb640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbf4142eb0 0x7ffbf412e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 -- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 msgr2=0x7ffbf4070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf4070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 -- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbf4142eb0 msgr2=0x7ffbf412e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbf4142eb0 0x7ffbf412e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 -- 172.21.15.2:0/810760433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec009a70 con 0x7ffbf40cbd80 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf94ba640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40c8590 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ffbf000e930 tx=0x7ffbf000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbe9ffb640 1 -- 172.21.15.2:0/810760433 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbf0009690 con 0x7ffbf40cbd80 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbe9ffb640 1 -- 172.21.15.2:0/810760433 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbf000ca00 con 0x7ffbf40cbd80 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbf4070660 con 0x7ffbf40cbd80 2023-11-04T01:49:45.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbe9ffb640 1 -- 172.21.15.2:0/810760433 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbf000cd70 con 0x7ffbf40cbd80 2023-11-04T01:49:45.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf4070370 con 0x7ffbf40cbd80 2023-11-04T01:49:45.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf40b2160 con 0x7ffbf40cbd80 2023-11-04T01:49:45.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbe9ffb640 1 -- 172.21.15.2:0/810760433 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffbf0013470 con 0x7ffbf40cbd80 2023-11-04T01:49:45.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbe9ffb640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbd80664a0 0x7ffbd8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbe9ffb640 1 -- 172.21.15.2:0/810760433 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7ffbf0084a00 con 0x7ffbf40cbd80 2023-11-04T01:49:45.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.146+0000 7ffbf8cb9640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbd80664a0 0x7ffbd8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.150+0000 7ffbf8cb9640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbd80664a0 0x7ffbd8068960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ffbf41f9300 tx=0x7ffbe4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.150+0000 7ffbe9ffb640 1 -- 172.21.15.2:0/810760433 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffbf40b2160 con 0x7ffbf40cbd80 2023-11-04T01:49:45.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.342+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbf40b2100 con 0x7ffbf40cbd80 2023-11-04T01:49:45.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.342+0000 7ffbe9ffb640 1 -- 172.21.15.2:0/810760433 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4978 (secure 0 0 0) 0x7ffbf0017090 con 0x7ffbf40cbd80 2023-11-04T01:49:45.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:45.346 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":6925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:44.658536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":106,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":7986,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7986":{"gid":7986,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":18,"addr":"172.21.15.2:6835/2449846925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":2449846925},{"type":"v1","addr":"172.21.15.2:6835","nonce":2449846925}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:49:44.658536+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:45.347 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 109 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbd80664a0 msgr2=0x7ffbd8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbd80664a0 0x7ffbd8068960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ffbf41f9300 tx=0x7ffbe4009040 comp rx=0 tx=0).stop 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 msgr2=0x7ffbf40c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40c8590 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ffbf000e930 tx=0x7ffbf000edf0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 shutdown_connections 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ffbd80664a0 0x7ffbd8068960 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffbf4142eb0 0x7ffbf412e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ffbf4142ad0 0x7ffbf4070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 --2- 172.21.15.2:0/810760433 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbf40cbd80 0x7ffbf40c8590 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 >> 172.21.15.2:0/810760433 conn(0x7ffbf40b0890 msgr2=0x7ffbf40cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 shutdown_connections 2023-11-04T01:49:45.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.346+0000 7ffbfb71e640 1 -- 172.21.15.2:0/810760433 wait complete. 2023-11-04T01:49:45.363 INFO:tasks.ceph.mds.c:Sent signal 9 2023-11-04T01:49:45.363 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:49:45.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:49:45.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 down 2023-11-04T01:49:45.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:0 2023-11-04T01:49:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f667a0c5640 1 Processor -- start 2023-11-04T01:49:45.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f667a0c5640 1 -- start start 2023-11-04T01:49:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f667a0c5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66740b4070 0x7f66740b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f667a0c5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740b3be0 con 0x7f66740b4bc0 2023-11-04T01:49:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f667a0c5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740b38b0 con 0x7f667415d310 2023-11-04T01:49:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f667a0c5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740b4a40 con 0x7f66740b4070 2023-11-04T01:49:45.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f6672ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f66740b4bc0 0x7f667406cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56748/0 (socket says 172.21.15.2:56748) 2023-11-04T01:49:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f6672ffd640 1 -- 172.21.15.2:0/2609873882 learned_addr learned my addr 172.21.15.2:0/2609873882 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f6673fff640 1 --2- 172.21.15.2:0/2609873882 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66740b4070 0x7f66740b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f66727fc640 1 -- 172.21.15.2:0/2609873882 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665266160 0 0) 0x7f66740b3be0 con 0x7f66740b4bc0 2023-11-04T01:49:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f66727fc640 1 -- 172.21.15.2:0/2609873882 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665c003530 con 0x7f66740b4bc0 2023-11-04T01:49:45.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f6673fff640 1 -- 172.21.15.2:0/2609873882 >> v1:172.21.15.90:6789/0 conn(0x7f667415d310 legacy=0x7f6674160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f6673fff640 1 -- 172.21.15.2:0/2609873882 >> v1:172.21.15.2:6789/0 conn(0x7f66740b4bc0 legacy=0x7f667406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.538+0000 7f6673fff640 1 -- 172.21.15.2:0/2609873882 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674161790 con 0x7f66740b4070 2023-11-04T01:49:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f6673fff640 1 --2- 172.21.15.2:0/2609873882 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66740b4070 0x7f66740b4500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f666c009dc0 tx=0x7f666c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=960560351dcb53bf server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f66727fc640 1 -- 172.21.15.2:0/2609873882 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0a5880 con 0x7f66740b4070 2023-11-04T01:49:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f66727fc640 1 -- 172.21.15.2:0/2609873882 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666c0a59e0 con 0x7f66740b4070 2023-11-04T01:49:45.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f66727fc640 1 -- 172.21.15.2:0/2609873882 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666c0a5d70 con 0x7f66740b4070 2023-11-04T01:49:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f667a0c5640 1 -- 172.21.15.2:0/2609873882 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66740b4070 msgr2=0x7f66740b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f667a0c5640 1 --2- 172.21.15.2:0/2609873882 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66740b4070 0x7f66740b4500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f666c009dc0 tx=0x7f666c01c8b0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f667a0c5640 1 -- 172.21.15.2:0/2609873882 shutdown_connections 2023-11-04T01:49:45.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f667a0c5640 1 --2- 172.21.15.2:0/2609873882 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f66740b4070 0x7f66740b4500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f667a0c5640 1 -- 172.21.15.2:0/2609873882 >> 172.21.15.2:0/2609873882 conn(0x7f66740b18a0 msgr2=0x7f66740b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f667a0c5640 1 -- 172.21.15.2:0/2609873882 shutdown_connections 2023-11-04T01:49:45.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.542+0000 7f667a0c5640 1 -- 172.21.15.2:0/2609873882 wait complete. 2023-11-04T01:49:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 Processor -- start 2023-11-04T01:49:45.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 -- start start 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66740b4070 0x7f66740cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66740b4bc0 0x7f66740cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667415d310 0x7f66740cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740cd0c0 con 0x7f66740b4bc0 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740cd3a0 con 0x7f66740b4070 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740cd680 con 0x7f667415d310 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66740b4bc0 0x7f66740cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66740b4bc0 0x7f66740cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59594/0 (socket says 172.21.15.2:59594) 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 -- 172.21.15.2:0/3166659724 learned_addr learned my addr 172.21.15.2:0/3166659724 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6673fff640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667415d310 0x7f66740cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f66737fe640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66740b4070 0x7f66740cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 -- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667415d310 msgr2=0x7f66740cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667415d310 0x7f66740cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 -- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66740b4070 msgr2=0x7f66740cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66740b4070 0x7f66740cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 -- 172.21.15.2:0/3166659724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c009a70 con 0x7f66740b4bc0 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f6672ffd640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66740b4bc0 0x7f66740cef00 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f666800c4d0 tx=0x7f666800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f665bfff640 1 -- 172.21.15.2:0/3166659724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668005cf0 con 0x7f66740b4bc0 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f665bfff640 1 -- 172.21.15.2:0/3166659724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668005e50 con 0x7f66740b4bc0 2023-11-04T01:49:45.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f665bfff640 1 -- 172.21.15.2:0/3166659724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668007270 con 0x7f66740b4bc0 2023-11-04T01:49:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66740cd960 con 0x7f66740b4bc0 2023-11-04T01:49:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.546+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66740ccdb0 con 0x7f66740b4bc0 2023-11-04T01:49:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.550+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66740cde80 con 0x7f66740b4bc0 2023-11-04T01:49:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.550+0000 7f665bfff640 1 -- 172.21.15.2:0/3166659724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f66680073d0 con 0x7f66740b4bc0 2023-11-04T01:49:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.550+0000 7f665bfff640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66600664a0 0x7f6660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.550+0000 7f665bfff640 1 -- 172.21.15.2:0/3166659724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 7662+0+0 (secure 0 0 0) 0x7f6668083b80 con 0x7f66740b4bc0 2023-11-04T01:49:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.550+0000 7f66737fe640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66600664a0 0x7f6660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.550+0000 7f66737fe640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66600664a0 0x7f6660068960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f66740b00b0 tx=0x7f6664009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.554+0000 7f665bfff640 1 -- 172.21.15.2:0/3166659724 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f66740cde80 con 0x7f66740b4bc0 2023-11-04T01:49:45.564 INFO:tasks.ceph.mds.c.smithi002.stderr:daemon-helper: command crashed with signal 9 2023-11-04T01:49:45.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.774+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:0"} v 0) v1 -- 0x7f66740cde80 con 0x7f66740b4bc0 2023-11-04T01:49:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.782+0000 7f665bfff640 1 -- 172.21.15.2:0/3166659724 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:0"}]=0 failed mds gid 7986 v110) v1 ==== 97+0+0 (secure 0 0 0) 0x7f66740cde80 con 0x7f66740b4bc0 2023-11-04T01:49:45.784 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 7986 2023-11-04T01:49:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66600664a0 msgr2=0x7f6660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66600664a0 0x7f6660068960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f66740b00b0 tx=0x7f6664009040 comp rx=0 tx=0).stop 2023-11-04T01:49:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66740b4bc0 msgr2=0x7f66740cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66740b4bc0 0x7f66740cef00 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f666800c4d0 tx=0x7f666800c990 comp rx=0 tx=0).stop 2023-11-04T01:49:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 shutdown_connections 2023-11-04T01:49:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f66600664a0 0x7f6660068960 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f667415d310 0x7f66740cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f66740b4bc0 0x7f66740cef00 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 --2- 172.21.15.2:0/3166659724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66740b4070 0x7f66740cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 >> 172.21.15.2:0/3166659724 conn(0x7f66740b18a0 msgr2=0x7f66740aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 shutdown_connections 2023-11-04T01:49:45.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.786+0000 7f667a0c5640 1 -- 172.21.15.2:0/3166659724 wait complete. 2023-11-04T01:49:45.805 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-04T01:49:45.805 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-04T01:49:45.805 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T01:49:45.806 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:49:45.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:45.806 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T01:49:45.806 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T01:49:45.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-04T01:49:45.808 INFO:tasks.ceph.mds.a:Started 2023-11-04T01:49:45.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:45.873 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-04T01:49:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.930+0000 7fe923a26640 1 Processor -- start 2023-11-04T01:49:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.930+0000 7fe923a26640 1 -- start start 2023-11-04T01:49:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.930+0000 7fe923a26640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe91c0b5ef0 0x7fe91c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.930+0000 7fe923a26640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.930+0000 7fe923a26640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c15ea70 con 0x7fe91c15b9c0 2023-11-04T01:49:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.930+0000 7fe923a26640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c0b2c90 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.930+0000 7fe923a26640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c0b2f70 con 0x7fe91c0b27d0 2023-11-04T01:49:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe921fc3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe91c15b9c0 0x7fe91c15ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:56752/0 (socket says 172.21.15.2:56752) 2023-11-04T01:49:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe921fc3640 1 -- 172.21.15.2:0/4107740400 learned_addr learned my addr 172.21.15.2:0/4107740400 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe9217c2640 1 --2- 172.21.15.2:0/4107740400 >> v2:172.21.15.90:3300/0 conn(0x7fe91c0b5ef0 0x7fe91c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe920fc1640 1 --2- 172.21.15.2:0/4107740400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe913fff640 1 -- 172.21.15.2:0/4107740400 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150105055 0 0) 0x7fe91c15ea70 con 0x7fe91c15b9c0 2023-11-04T01:49:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe913fff640 1 -- 172.21.15.2:0/4107740400 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe908003530 con 0x7fe91c15b9c0 2023-11-04T01:49:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe913fff640 1 -- 172.21.15.2:0/4107740400 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338830640 0 0) 0x7fe908003530 con 0x7fe91c15b9c0 2023-11-04T01:49:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe920fc1640 1 -- 172.21.15.2:0/4107740400 >> v2:172.21.15.90:3300/0 conn(0x7fe91c0b5ef0 msgr2=0x7fe91c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:45.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe920fc1640 1 --2- 172.21.15.2:0/4107740400 >> v2:172.21.15.90:3300/0 conn(0x7fe91c0b5ef0 0x7fe91c0ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe920fc1640 1 -- 172.21.15.2:0/4107740400 >> v1:172.21.15.2:6789/0 conn(0x7fe91c15b9c0 legacy=0x7fe91c15ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe920fc1640 1 -- 172.21.15.2:0/4107740400 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0b3250 con 0x7fe91c0b27d0 2023-11-04T01:49:45.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe9217c2640 1 --2- 172.21.15.2:0/4107740400 >> v2:172.21.15.90:3300/0 conn(0x7fe91c0b5ef0 0x7fe91c0ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-04T01:49:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe920fc1640 1 --2- 172.21.15.2:0/4107740400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c15b480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0097c0 tx=0x7fe90c01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660589e8d32d8799 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe913fff640 1 -- 172.21.15.2:0/4107740400 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe914001a00 con 0x7fe91c0b27d0 2023-11-04T01:49:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe913fff640 1 -- 172.21.15.2:0/4107740400 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0a7050 con 0x7fe91c0b27d0 2023-11-04T01:49:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.934+0000 7fe913fff640 1 -- 172.21.15.2:0/4107740400 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0ab600 con 0x7fe91c0b27d0 2023-11-04T01:49:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- 172.21.15.2:0/4107740400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 msgr2=0x7fe91c15b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 --2- 172.21.15.2:0/4107740400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c15b480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0097c0 tx=0x7fe90c01c370 comp rx=0 tx=0).stop 2023-11-04T01:49:45.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- 172.21.15.2:0/4107740400 shutdown_connections 2023-11-04T01:49:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 --2- 172.21.15.2:0/4107740400 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c15b480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 --2- 172.21.15.2:0/4107740400 >> v2:172.21.15.90:3300/0 conn(0x7fe91c0b5ef0 0x7fe91c0ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- 172.21.15.2:0/4107740400 >> 172.21.15.2:0/4107740400 conn(0x7fe91c06a130 msgr2=0x7fe91c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- 172.21.15.2:0/4107740400 shutdown_connections 2023-11-04T01:49:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- 172.21.15.2:0/4107740400 wait complete. 2023-11-04T01:49:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 Processor -- start 2023-11-04T01:49:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- start start 2023-11-04T01:49:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe91c0b5ef0 0x7fe91c06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe91c15b9c0 0x7fe91c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c06c6a0 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c06c980 con 0x7fe91c15b9c0 2023-11-04T01:49:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c06cc60 con 0x7fe91c0b27d0 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe91c0b5ef0 0x7fe91c06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe91c0b5ef0 0x7fe91c06bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59618/0 (socket says 172.21.15.2:59618) 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 -- 172.21.15.2:0/3829586141 learned_addr learned my addr 172.21.15.2:0/3829586141 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe9217c2640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe921fc3640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe91c15b9c0 0x7fe91c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 -- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 msgr2=0x7fe91c150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 -- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe91c15b9c0 msgr2=0x7fe91c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe91c15b9c0 0x7fe91c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 -- 172.21.15.2:0/3829586141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009420 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe9217c2640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe920fc1640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe91c0b5ef0 0x7fe91c06bc20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe90c000c10 tx=0x7fe90c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe911ffb640 1 -- 172.21.15.2:0/3829586141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c0b9070 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe911ffb640 1 -- 172.21.15.2:0/3829586141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0038b0 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c009420 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe911ffb640 1 -- 172.21.15.2:0/3829586141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c003c40 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.938+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c0c81b0 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.942+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c0c8460 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.942+0000 7fe911ffb640 1 -- 172.21.15.2:0/3829586141 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe90c0b2040 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.942+0000 7fe911ffb640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9000664a0 0x7fe900068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.942+0000 7fe911ffb640 1 -- 172.21.15.2:0/3829586141 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7748+0+0 (secure 0 0 0) 0x7fe90c11dca0 con 0x7fe91c0b5ef0 2023-11-04T01:49:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.942+0000 7fe9217c2640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9000664a0 0x7fe900068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.942+0000 7fe9217c2640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9000664a0 0x7fe900068960 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe918009c70 tx=0x7fe918008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:45.946+0000 7fe911ffb640 1 -- 172.21.15.2:0/3829586141 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe90c0ea9b0 con 0x7fe91c0b5ef0 2023-11-04T01:49:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.134+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe91c067610 con 0x7fe91c0b5ef0 2023-11-04T01:49:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.134+0000 7fe911ffb640 1 -- 172.21.15.2:0/3829586141 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4141 (secure 0 0 0) 0x7fe90c0b22f0 con 0x7fe91c0b5ef0 2023-11-04T01:49:46.136 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:46.136 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":111,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:45.791923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 111 2023-11-04T01:49:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9000664a0 msgr2=0x7fe900068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9000664a0 0x7fe900068960 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe918009c70 tx=0x7fe918008040 comp rx=0 tx=0).stop 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe91c0b5ef0 msgr2=0x7fe91c06bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe91c0b5ef0 0x7fe91c06bc20 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe90c000c10 tx=0x7fe90c019110 comp rx=0 tx=0).stop 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 shutdown_connections 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe9000664a0 0x7fe900068960 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe91c15b9c0 0x7fe91c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe91c0b5ef0 0x7fe91c06bc20 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 --2- 172.21.15.2:0/3829586141 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe91c0b27d0 0x7fe91c150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 >> 172.21.15.2:0/3829586141 conn(0x7fe91c06a130 msgr2=0x7fe91c0b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 shutdown_connections 2023-11-04T01:49:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:46.138+0000 7fe923a26640 1 -- 172.21.15.2:0/3829586141 wait complete. 2023-11-04T01:49:46.155 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:49:48.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-04T01:49:48.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-04T01:49:51.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:51.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.290+0000 7fd16edf3640 1 Processor -- start 2023-11-04T01:49:51.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.290+0000 7fd16edf3640 1 -- start start 2023-11-04T01:49:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16edf3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 0x7fd1680ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16edf3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1680cf000 con 0x7fd168160680 2023-11-04T01:49:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16edf3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1680b5de0 con 0x7fd1680ce7f0 2023-11-04T01:49:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16edf3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680d09b0 con 0x7fd168160a60 2023-11-04T01:49:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16cb8f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd168160680 0x7fd1680cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54144/0 (socket says 172.21.15.2:54144) 2023-11-04T01:49:51.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16cb8f640 1 -- 172.21.15.2:0/3977793028 learned_addr learned my addr 172.21.15.2:0/3977793028 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:51.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd167fff640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 0x7fd1680ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084023363 0 0) 0x7fd1680cf000 con 0x7fd168160680 2023-11-04T01:49:51.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd154003530 con 0x7fd168160680 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250363733 0 0) 0x7fd154003530 con 0x7fd168160680 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 msgr2=0x7fd1680ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 0x7fd1680ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 >> v1:172.21.15.90:6789/0 conn(0x7fd1680ce7f0 legacy=0x7fd1680b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1680d1610 con 0x7fd168160680 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fd150001680 con 0x7fd168160680 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 >> v1:172.21.15.2:6789/0 conn(0x7fd168160680 legacy=0x7fd1680cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1540039b0 0x7fd154003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd154004360 0x7fd154004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 0x7fd154005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680d09b0 con 0x7fd154004360 2023-11-04T01:49:51.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15400b9c0 con 0x7fd1540039b0 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15400bb80 con 0x7fd168160a60 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd167fff640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd154004360 0x7fd154004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16d390640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 0x7fd154005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16cb8f640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1540039b0 0x7fd154003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd167fff640 1 -- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 msgr2=0x7fd154005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd167fff640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd168160a60 0x7fd154005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd167fff640 1 -- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1540039b0 msgr2=0x7fd154003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd167fff640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1540039b0 0x7fd154003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd167fff640 1 -- 172.21.15.2:0/3977793028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd154003530 con 0x7fd154004360 2023-11-04T01:49:51.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.294+0000 7fd16cb8f640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1540039b0 0x7fd154003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:51.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.298+0000 7fd167fff640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd154004360 0x7fd154004830 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd158009fc0 tx=0x7fd15801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7c7fed91764145 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:51.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.298+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1580a5c70 con 0x7fd154004360 2023-11-04T01:49:51.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.298+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15800f040 con 0x7fd154004360 2023-11-04T01:49:51.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.298+0000 7fd1677fe640 1 -- 172.21.15.2:0/3977793028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1580ad440 con 0x7fd154004360 2023-11-04T01:49:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.298+0000 7fd16edf3640 1 -- 172.21.15.2:0/3977793028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd154004360 msgr2=0x7fd154004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.298+0000 7fd16edf3640 1 --2- 172.21.15.2:0/3977793028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd154004360 0x7fd154004830 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd158009fc0 tx=0x7fd15801cc60 comp rx=0 tx=0).stop 2023-11-04T01:49:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.298+0000 7fd16d390640 1 -- 172.21.15.2:0/3977793028 reap_dead start 2023-11-04T01:49:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- 172.21.15.2:0/3977793028 shutdown_connections 2023-11-04T01:49:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- 172.21.15.2:0/3977793028 >> 172.21.15.2:0/3977793028 conn(0x7fd1680d2f90 msgr2=0x7fd1680d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- 172.21.15.2:0/3977793028 shutdown_connections 2023-11-04T01:49:51.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- 172.21.15.2:0/3977793028 wait complete. 2023-11-04T01:49:51.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 Processor -- start 2023-11-04T01:49:51.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- start start 2023-11-04T01:49:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd154004360 0x7fd1681f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd16815a960 0x7fd1681573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd168159dc0 0x7fd16815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16815a760 con 0x7fd168159dc0 2023-11-04T01:49:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681f3ab0 con 0x7fd16815a960 2023-11-04T01:49:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1681580f0 con 0x7fd154004360 2023-11-04T01:49:51.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd168159dc0 0x7fd16815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd168159dc0 0x7fd16815a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56980/0 (socket says 172.21.15.2:56980) 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 -- 172.21.15.2:0/1078582791 learned_addr learned my addr 172.21.15.2:0/1078582791 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16cb8f640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd154004360 0x7fd1681f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd167fff640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd16815a960 0x7fd1681573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 -- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd154004360 msgr2=0x7fd1681f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd154004360 0x7fd1681f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 -- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd16815a960 msgr2=0x7fd1681573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd16815a960 0x7fd1681573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 -- 172.21.15.2:0/1078582791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1681583d0 con 0x7fd168159dc0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16d390640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd168159dc0 0x7fd16815a220 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd1680d2f40 tx=0x7fd16000aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd1657fa640 1 -- 172.21.15.2:0/1078582791 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600052e0 con 0x7fd168159dc0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd1657fa640 1 -- 172.21.15.2:0/1078582791 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160005440 con 0x7fd168159dc0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd1657fa640 1 -- 172.21.15.2:0/1078582791 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000fac0 con 0x7fd168159dc0 2023-11-04T01:49:51.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1681586b0 con 0x7fd168159dc0 2023-11-04T01:49:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.302+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd168158c70 con 0x7fd168159dc0 2023-11-04T01:49:51.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.306+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd168158e60 con 0x7fd168159dc0 2023-11-04T01:49:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.306+0000 7fd1657fa640 1 -- 172.21.15.2:0/1078582791 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd16000fc20 con 0x7fd168159dc0 2023-11-04T01:49:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.306+0000 7fd1657fa640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1480664d0 0x7fd148068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.306+0000 7fd1657fa640 1 -- 172.21.15.2:0/1078582791 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7748+0+0 (secure 0 0 0) 0x7fd160087aa0 con 0x7fd168159dc0 2023-11-04T01:49:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.306+0000 7fd16cb8f640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1480664d0 0x7fd148068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.306+0000 7fd16cb8f640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1480664d0 0x7fd148068990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd150000c10 tx=0x7fd150009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:51.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.310+0000 7fd1657fa640 1 -- 172.21.15.2:0/1078582791 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd160054680 con 0x7fd168159dc0 2023-11-04T01:49:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.498+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd16804e4a0 con 0x7fd168159dc0 2023-11-04T01:49:51.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.498+0000 7fd1657fa640 1 -- 172.21.15.2:0/1078582791 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4932 (secure 0 0 0) 0x7fd160057ca0 con 0x7fd168159dc0 2023-11-04T01:49:51.499 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:51.499 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:45.828878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:resolve","state_seq":12,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:51.499 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 112 2023-11-04T01:49:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.498+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1480664d0 msgr2=0x7fd148068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.498+0000 7fd16edf3640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1480664d0 0x7fd148068990 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd150000c10 tx=0x7fd150009040 comp rx=0 tx=0).stop 2023-11-04T01:49:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.498+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd168159dc0 msgr2=0x7fd16815a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.498+0000 7fd16edf3640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd168159dc0 0x7fd16815a220 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd1680d2f40 tx=0x7fd16000aee0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 shutdown_connections 2023-11-04T01:49:51.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd1480664d0 0x7fd148068990 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd168159dc0 0x7fd16815a220 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd16815a960 0x7fd1681573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 --2- 172.21.15.2:0/1078582791 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd154004360 0x7fd1681f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 >> 172.21.15.2:0/1078582791 conn(0x7fd1680d2f90 msgr2=0x7fd1680cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 shutdown_connections 2023-11-04T01:49:51.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.502+0000 7fd16edf3640 1 -- 172.21.15.2:0/1078582791 wait complete. 2023-11-04T01:49:51.517 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:49:51.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f5740238640 1 Processor -- start 2023-11-04T01:49:51.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f5740238640 1 -- start start 2023-11-04T01:49:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f5740238640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f57380c92b0 0x7f57380cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f5740238640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f573806c1c0 0x7f57381442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f5740238640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57380c9ac0 con 0x7f573806bde0 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f5740238640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380caf20 con 0x7f57380c92b0 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f5740238640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57380c97e0 con 0x7f573806c1c0 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573dfd4640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f573806bde0 0x7f573815c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:41488/0 (socket says 172.21.15.2:41488) 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573dfd4640 1 -- 172.21.15.2:0/2372068017 learned_addr learned my addr 172.21.15.2:0/2372068017 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573e7d5640 1 --2- 172.21.15.2:0/2372068017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f573806c1c0 0x7f57381442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573d7d3640 1 --2- 172.21.15.2:0/2372068017 >> v2:172.21.15.90:3300/0 conn(0x7f57380c92b0 0x7f57380cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573cfd2640 1 -- 172.21.15.2:0/2372068017 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721138636 0 0) 0x7f57380c9ac0 con 0x7f573806bde0 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573cfd2640 1 -- 172.21.15.2:0/2372068017 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5724003530 con 0x7f573806bde0 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573e7d5640 1 -- 172.21.15.2:0/2372068017 >> v2:172.21.15.90:3300/0 conn(0x7f57380c92b0 msgr2=0x7f57380cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573e7d5640 1 --2- 172.21.15.2:0/2372068017 >> v2:172.21.15.90:3300/0 conn(0x7f57380c92b0 0x7f57380cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573e7d5640 1 -- 172.21.15.2:0/2372068017 >> v1:172.21.15.90:6789/0 conn(0x7f573806bde0 legacy=0x7f573815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.638+0000 7f573e7d5640 1 -- 172.21.15.2:0/2372068017 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380cb1c0 con 0x7f573806c1c0 2023-11-04T01:49:51.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f573e7d5640 1 --2- 172.21.15.2:0/2372068017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f573806c1c0 0x7f57381442b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5730009d90 tx=0x7f573001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fc9076f8eeef31 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:51.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f573cfd2640 1 -- 172.21.15.2:0/2372068017 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300a5870 con 0x7f573806c1c0 2023-11-04T01:49:51.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f573cfd2640 1 -- 172.21.15.2:0/2372068017 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57300a59d0 con 0x7f573806c1c0 2023-11-04T01:49:51.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f573cfd2640 1 -- 172.21.15.2:0/2372068017 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300a5d40 con 0x7f573806c1c0 2023-11-04T01:49:51.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 -- 172.21.15.2:0/2372068017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f573806c1c0 msgr2=0x7f57381442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 --2- 172.21.15.2:0/2372068017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f573806c1c0 0x7f57381442b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5730009d90 tx=0x7f573001c8c0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 -- 172.21.15.2:0/2372068017 shutdown_connections 2023-11-04T01:49:51.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 --2- 172.21.15.2:0/2372068017 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f573806c1c0 0x7f57381442b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 --2- 172.21.15.2:0/2372068017 >> v2:172.21.15.90:3300/0 conn(0x7f57380c92b0 0x7f57380cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 -- 172.21.15.2:0/2372068017 >> 172.21.15.2:0/2372068017 conn(0x7f57380b0890 msgr2=0x7f57380b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:51.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 -- 172.21.15.2:0/2372068017 shutdown_connections 2023-11-04T01:49:51.644 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 -- 172.21.15.2:0/2372068017 wait complete. 2023-11-04T01:49:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 Processor -- start 2023-11-04T01:49:51.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.642+0000 7f5740238640 1 -- start start 2023-11-04T01:49:51.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573806bde0 0x7f573815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573806c1c0 0x7f5738165320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57380c92b0 0x7f573815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573813eea0 con 0x7f573806c1c0 2023-11-04T01:49:51.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573813f180 con 0x7f573806bde0 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573813f460 con 0x7f57380c92b0 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573806c1c0 0x7f5738165320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573806c1c0 0x7f5738165320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56996/0 (socket says 172.21.15.2:56996) 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 -- 172.21.15.2:0/1450290300 learned_addr learned my addr 172.21.15.2:0/1450290300 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573e7d5640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57380c92b0 0x7f573815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573dfd4640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573806bde0 0x7f573815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 -- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57380c92b0 msgr2=0x7f573815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57380c92b0 0x7f573815cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 -- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573806bde0 msgr2=0x7f573815fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573806bde0 0x7f573815fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 -- 172.21.15.2:0/1450290300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009a70 con 0x7f573806c1c0 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573d7d3640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573806c1c0 0x7f5738165320 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f572800e870 tx=0x7f572800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f572e7fc640 1 -- 172.21.15.2:0/1450290300 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728009510 con 0x7f573806c1c0 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f572e7fc640 1 -- 172.21.15.2:0/1450290300 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572800eec0 con 0x7f573806c1c0 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573813f740 con 0x7f573806c1c0 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f572e7fc640 1 -- 172.21.15.2:0/1450290300 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800cb40 con 0x7f573806c1c0 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5738160130 con 0x7f573806c1c0 2023-11-04T01:49:51.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573804e4a0 con 0x7f573806c1c0 2023-11-04T01:49:51.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f572e7fc640 1 -- 172.21.15.2:0/1450290300 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f572800cca0 con 0x7f573806c1c0 2023-11-04T01:49:51.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f572e7fc640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f571c0664d0 0x7f571c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f572e7fc640 1 -- 172.21.15.2:0/1450290300 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7748+0+0 (secure 0 0 0) 0x7f57280847a0 con 0x7f573806c1c0 2023-11-04T01:49:51.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.646+0000 7f573dfd4640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f571c0664d0 0x7f571c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.650+0000 7f573dfd4640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f571c0664d0 0x7f571c068990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5734005890 tx=0x7f5734009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:51.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.650+0000 7f572e7fc640 1 -- 172.21.15.2:0/1450290300 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5728051420 con 0x7f573806c1c0 2023-11-04T01:49:51.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.846+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f573815b490 con 0x7f573806c1c0 2023-11-04T01:49:51.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.846+0000 7f572e7fc640 1 -- 172.21.15.2:0/1450290300 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4932 (secure 0 0 0) 0x7f5728054a40 con 0x7f573806c1c0 2023-11-04T01:49:51.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:51.847 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:45.828878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:resolve","state_seq":12,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:51.848 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 112 2023-11-04T01:49:51.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f571c0664d0 msgr2=0x7f571c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f571c0664d0 0x7f571c068990 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5734005890 tx=0x7f5734009040 comp rx=0 tx=0).stop 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573806c1c0 msgr2=0x7f5738165320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573806c1c0 0x7f5738165320 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f572800e870 tx=0x7f572800ec70 comp rx=0 tx=0).stop 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 shutdown_connections 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f571c0664d0 0x7f571c068990 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f57380c92b0 0x7f573815cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f573806c1c0 0x7f5738165320 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 --2- 172.21.15.2:0/1450290300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f573806bde0 0x7f573815fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 >> 172.21.15.2:0/1450290300 conn(0x7f57380b0890 msgr2=0x7f57380cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 shutdown_connections 2023-11-04T01:49:51.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.850+0000 7f5740238640 1 -- 172.21.15.2:0/1450290300 wait complete. 2023-11-04T01:49:51.867 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:resolve 2023-11-04T01:49:51.867 DEBUG:tasks.cephfs.filesystem:reached state 'up:resolve' in 0.34964489936828613s 2023-11-04T01:49:51.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:51.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b2b97640 1 Processor -- start 2023-11-04T01:49:51.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b2b97640 1 -- start start 2023-11-04T01:49:51.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b2b97640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f20ac0cefe0 0x7f20ac0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b2b97640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20ac15d430 0x7f20ac0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b2b97640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ac0cd280 con 0x7f20ac15d050 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b2b97640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0cd070 con 0x7f20ac15d430 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b2b97640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0cd560 con 0x7f20ac0cefe0 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b1134640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20ac15d430 0x7f20ac0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b1134640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20ac15d430 0x7f20ac0ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57004/0 (socket says 172.21.15.2:57004) 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b1134640 1 -- 172.21.15.2:0/964789571 learned_addr learned my addr 172.21.15.2:0/964789571 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20abfff640 1 --2- 172.21.15.2:0/964789571 >> v2:172.21.15.90:3300/0 conn(0x7f20ac0cefe0 0x7f20ac0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b1134640 1 -- 172.21.15.2:0/964789571 >> v2:172.21.15.90:3300/0 conn(0x7f20ac0cefe0 msgr2=0x7f20ac0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b1134640 1 --2- 172.21.15.2:0/964789571 >> v2:172.21.15.90:3300/0 conn(0x7f20ac0cefe0 0x7f20ac0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b1134640 1 -- 172.21.15.2:0/964789571 >> v1:172.21.15.90:6789/0 conn(0x7f20ac15d050 legacy=0x7f20ac0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.990+0000 7f20b1134640 1 -- 172.21.15.2:0/964789571 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0cd840 con 0x7f20ac15d430 2023-11-04T01:49:51.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b1134640 1 --2- 172.21.15.2:0/964789571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d430 0x7f20ac0ce8f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0b1ed0 tx=0x7f209c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16586a6cb404e315 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:51.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20ab7fe640 1 -- 172.21.15.2:0/964789571 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c0aa660 con 0x7f20ac15d430 2023-11-04T01:49:51.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20ab7fe640 1 -- 172.21.15.2:0/964789571 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c0aa7c0 con 0x7f20ac15d430 2023-11-04T01:49:51.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20ab7fe640 1 -- 172.21.15.2:0/964789571 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c0aab50 con 0x7f20ac15d430 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 -- 172.21.15.2:0/964789571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d430 msgr2=0x7f20ac0ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 --2- 172.21.15.2:0/964789571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d430 0x7f20ac0ce8f0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0b1ed0 tx=0x7f209c01c500 comp rx=0 tx=0).stop 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 -- 172.21.15.2:0/964789571 shutdown_connections 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 --2- 172.21.15.2:0/964789571 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d430 0x7f20ac0ce8f0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 --2- 172.21.15.2:0/964789571 >> v2:172.21.15.90:3300/0 conn(0x7f20ac0cefe0 0x7f20ac0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 -- 172.21.15.2:0/964789571 >> 172.21.15.2:0/964789571 conn(0x7f20ac0b1050 msgr2=0x7f20ac0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 -- 172.21.15.2:0/964789571 shutdown_connections 2023-11-04T01:49:51.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 -- 172.21.15.2:0/964789571 wait complete. 2023-11-04T01:49:51.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 Processor -- start 2023-11-04T01:49:51.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.994+0000 7f20b2b97640 1 -- start start 2023-11-04T01:49:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20ac0cefe0 0x7f20ac14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d050 0x7f20ac151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20ac15d430 0x7f20ac15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac156f40 con 0x7f20ac15d050 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac157220 con 0x7f20ac15d430 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac157500 con 0x7f20ac0cefe0 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d050 0x7f20ac151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d050 0x7f20ac151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57006/0 (socket says 172.21.15.2:57006) 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 -- 172.21.15.2:0/765847710 learned_addr learned my addr 172.21.15.2:0/765847710 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b1134640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20ac15d430 0x7f20ac15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b0933640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20ac0cefe0 0x7f20ac14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 -- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20ac0cefe0 msgr2=0x7f20ac14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20ac0cefe0 0x7f20ac14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 -- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20ac15d430 msgr2=0x7f20ac15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20ac15d430 0x7f20ac15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 -- 172.21.15.2:0/765847710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c0094d0 con 0x7f20ac15d050 2023-11-04T01:49:52.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20abfff640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d050 0x7f20ac151d90 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f20a000d800 tx=0x7f20a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20a97fa640 1 -- 172.21.15.2:0/765847710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000b6c0 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20a97fa640 1 -- 172.21.15.2:0/765847710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000b820 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac1577e0 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20a97fa640 1 -- 172.21.15.2:0/765847710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000bb90 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac14f800 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac073580 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20a97fa640 1 -- 172.21.15.2:0/765847710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f20a000bcf0 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20a97fa640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20980664a0 0x7f2098068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20a97fa640 1 -- 172.21.15.2:0/765847710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7748+0+0 (secure 0 0 0) 0x7f20a0084b80 con 0x7f20ac15d050 2023-11-04T01:49:52.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:51.998+0000 7f20b0933640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20980664a0 0x7f2098068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.002+0000 7f20b0933640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20980664a0 0x7f2098068960 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f20ac15c080 tx=0x7f20a4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.002+0000 7f20a97fa640 1 -- 172.21.15.2:0/765847710 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f20a0051890 con 0x7f20ac15d050 2023-11-04T01:49:52.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.190+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20ac0b1680 con 0x7f20ac15d050 2023-11-04T01:49:52.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.190+0000 7f20a97fa640 1 -- 172.21.15.2:0/765847710 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4932 (secure 0 0 0) 0x7f20a0054eb0 con 0x7f20ac15d050 2023-11-04T01:49:52.191 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:52.192 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:45.828878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:resolve","state_seq":12,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 112 2023-11-04T01:49:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20980664a0 msgr2=0x7f2098068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20980664a0 0x7f2098068960 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f20ac15c080 tx=0x7f20a4009040 comp rx=0 tx=0).stop 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d050 msgr2=0x7f20ac151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d050 0x7f20ac151d90 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f20a000d800 tx=0x7f20a000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 shutdown_connections 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f20980664a0 0x7f2098068960 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f20ac15d430 0x7f20ac15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20ac15d050 0x7f20ac151d90 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 --2- 172.21.15.2:0/765847710 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f20ac0cefe0 0x7f20ac14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 >> 172.21.15.2:0/765847710 conn(0x7f20ac0b1050 msgr2=0x7f20ac070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 shutdown_connections 2023-11-04T01:49:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.194+0000 7f20b2b97640 1 -- 172.21.15.2:0/765847710 wait complete. 2023-11-04T01:49:52.210 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:49:52.354 INFO:teuthology.orchestra.run.smithi090.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:48:32.891232+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:49:22.909916+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:49:52.354 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:48:32.891232+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:49:22.909916+0000" } ] } 2023-11-04T01:49:52.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:52.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 Processor -- start 2023-11-04T01:49:52.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 -- start start 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b4c15d0e0 0x7f5b4c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b4c0cdca0 0x7f5b4c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c0ce130 con 0x7f5b4c0cdca0 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c0b0420 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b50dd7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0ced80 con 0x7f5b4c0ce920 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b4c0cdca0 0x7f5b4c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b4c0cdca0 0x7f5b4c0b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57018/0 (socket says 172.21.15.2:57018) 2023-11-04T01:49:52.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/3028804603 learned_addr learned my addr 172.21.15.2:0/3028804603 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4a59c640 1 --2- 172.21.15.2:0/3028804603 >> v2:172.21.15.90:3300/0 conn(0x7f5b4c15d0e0 0x7f5b4c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b41d9b640 1 --2- 172.21.15.2:0/3028804603 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/3028804603 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 msgr2=0x7f5b4c0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 --2- 172.21.15.2:0/3028804603 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c0cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/3028804603 >> v2:172.21.15.90:3300/0 conn(0x7f5b4c15d0e0 msgr2=0x7f5b4c06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 --2- 172.21.15.2:0/3028804603 >> v2:172.21.15.90:3300/0 conn(0x7f5b4c15d0e0 0x7f5b4c06e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.482+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/3028804603 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c160cf0 con 0x7f5b4c0cdca0 2023-11-04T01:49:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 --2- 172.21.15.2:0/3028804603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c0cdca0 0x7f5b4c0b27d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0b38e0 tx=0x7f5b4401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77990149dde50050 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b49d9b640 1 -- 172.21.15.2:0/3028804603 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440a5560 con 0x7f5b4c0cdca0 2023-11-04T01:49:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b49d9b640 1 -- 172.21.15.2:0/3028804603 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b440a56c0 con 0x7f5b4c0cdca0 2023-11-04T01:49:52.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b49d9b640 1 -- 172.21.15.2:0/3028804603 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440a5a50 con 0x7f5b4c0cdca0 2023-11-04T01:49:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- 172.21.15.2:0/3028804603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c0cdca0 msgr2=0x7f5b4c0b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/3028804603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c0cdca0 0x7f5b4c0b27d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0b38e0 tx=0x7f5b4401c6e0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- 172.21.15.2:0/3028804603 shutdown_connections 2023-11-04T01:49:52.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/3028804603 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c0cdca0 0x7f5b4c0b27d0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/3028804603 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c0cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/3028804603 >> v2:172.21.15.90:3300/0 conn(0x7f5b4c15d0e0 0x7f5b4c06e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- 172.21.15.2:0/3028804603 >> 172.21.15.2:0/3028804603 conn(0x7f5b4c06a130 msgr2=0x7f5b4c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- 172.21.15.2:0/3028804603 shutdown_connections 2023-11-04T01:49:52.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- 172.21.15.2:0/3028804603 wait complete. 2023-11-04T01:49:52.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 Processor -- start 2023-11-04T01:49:52.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- start start 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4c0cdca0 0x7f5b4c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c15c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c15d0e0 0x7f5b4c15c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c15b5d0 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c15bb90 con 0x7f5b4c0cdca0 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b50dd7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c1577d0 con 0x7f5b4c0ce920 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c15d0e0 0x7f5b4c15c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c15d0e0 0x7f5b4c15c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57028/0 (socket says 172.21.15.2:57028) 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/1345135334 learned_addr learned my addr 172.21.15.2:0/1345135334 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4a59c640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4c0cdca0 0x7f5b4c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b41d9b640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c15c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 msgr2=0x7f5b4c15c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c15c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4c0cdca0 msgr2=0x7f5b4c1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4c0cdca0 0x7f5b4c1537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 -- 172.21.15.2:0/1345135334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b44009b30 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.486+0000 7f5b4ad9d640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c15d0e0 0x7f5b4c15c560 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f5b4401ad90 tx=0x7f5b44019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b437fe640 1 -- 172.21.15.2:0/1345135334 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440b8670 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b437fe640 1 -- 172.21.15.2:0/1345135334 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b440b87f0 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c157ab0 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b437fe640 1 -- 172.21.15.2:0/1345135334 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b440b8ba0 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c153320 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c15bd00 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b437fe640 1 -- 172.21.15.2:0/1345135334 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5b440b8d00 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b437fe640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b2c0664a0 0x7f5b2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b437fe640 1 -- 172.21.15.2:0/1345135334 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7748+0+0 (secure 0 0 0) 0x7f5b4411fb40 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b4a59c640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b2c0664a0 0x7f5b2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.490+0000 7f5b4a59c640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b2c0664a0 0x7f5b2c068960 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00d8d0 tx=0x7f5b3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.494+0000 7f5b437fe640 1 -- 172.21.15.2:0/1345135334 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b440ec970 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.678+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b4c067610 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.678+0000 7f5b437fe640 1 -- 172.21.15.2:0/1345135334 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4932 (secure 0 0 0) 0x7f5b44009510 con 0x7f5b4c15d0e0 2023-11-04T01:49:52.680 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:52.680 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8445,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":112}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:45.828878+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:resolve","state_seq":12,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8193":{"gid":8193,"name":"c","rank":1,"incarnation":102,"state":"up:active","state_seq":8,"addr":"172.21.15.2:6833/3695355178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3695355178},{"type":"v1","addr":"172.21.15.2:6833","nonce":3695355178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:52.681 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 112 2023-11-04T01:49:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b2c0664a0 msgr2=0x7f5b2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b2c0664a0 0x7f5b2c068960 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00d8d0 tx=0x7f5b3c008040 comp rx=0 tx=0).stop 2023-11-04T01:49:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c15d0e0 msgr2=0x7f5b4c15c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c15d0e0 0x7f5b4c15c560 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f5b4401ad90 tx=0x7f5b44019480 comp rx=0 tx=0).stop 2023-11-04T01:49:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 shutdown_connections 2023-11-04T01:49:52.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5b2c0664a0 0x7f5b2c068960 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b4c15d0e0 0x7f5b4c15c560 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b4c0ce920 0x7f5b4c15c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 --2- 172.21.15.2:0/1345135334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b4c0cdca0 0x7f5b4c1537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 >> 172.21.15.2:0/1345135334 conn(0x7f5b4c06a130 msgr2=0x7f5b4c0b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 shutdown_connections 2023-11-04T01:49:52.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.682+0000 7f5b50dd7640 1 -- 172.21.15.2:0/1345135334 wait complete. 2023-11-04T01:49:52.698 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:49:52.839 INFO:teuthology.orchestra.run.smithi090.stdout:{"last_snap":12,"last_created":12,"last_destroyed":9,"pending_noop":[],"snaps":[{"snapid":11,"ino":1099511627777,"stamp":"2023-11-04T01:48:32.891232+0000","name":"s25","metadata":{}},{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:49:22.909916+0000","name":"s26","metadata":{}}],"need_to_purge":{},"pending_update":[],"pending_destroy":[]} 2023-11-04T01:49:52.840 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 9, "last_snap": 12, "need_to_purge": {}, "pending_destroy": [], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s25", "snapid": 11, "stamp": "2023-11-04T01:48:32.891232+0000" }, { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:49:22.909916+0000" } ] } 2023-11-04T01:49:52.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail 6:1 2023-11-04T01:49:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9fb3b640 1 Processor -- start 2023-11-04T01:49:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9fb3b640 1 -- start start 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9fb3b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 0x7efe980cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9fb3b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980c9ac0 con 0x7efe980c92b0 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9fb3b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980caf20 con 0x7efe9806bde0 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9fb3b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c97e0 con 0x7efe9806c1c0 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efe980c92b0 0x7efe981442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54156/0 (socket says 172.21.15.2:54156) 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 -- 172.21.15.2:0/769314617 learned_addr learned my addr 172.21.15.2:0/769314617 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9e0d8640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 0x7efe980cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820878810 0 0) 0x7efe980c9ac0 con 0x7efe980c92b0 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe84003530 con 0x7efe980c92b0 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355009438 0 0) 0x7efe84003530 con 0x7efe980c92b0 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 msgr2=0x7efe980cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 0x7efe980cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 >> v1:172.21.15.90:6789/0 conn(0x7efe9806bde0 legacy=0x7efe9815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980cb1c0 con 0x7efe980c92b0 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7efe88001680 con 0x7efe980c92b0 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 >> v1:172.21.15.2:6789/0 conn(0x7efe980c92b0 legacy=0x7efe981442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840039b0 0x7efe84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe840047d0 0x7efe84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 0x7efe840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c97e0 con 0x7efe840047d0 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8400bac0 con 0x7efe840039b0 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8400bc80 con 0x7efe9806c1c0 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe840047d0 0x7efe84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9e0d8640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 0x7efe840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d8d7640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840039b0 0x7efe84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 -- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 msgr2=0x7efe840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe9806c1c0 0x7efe840051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 -- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840039b0 msgr2=0x7efe84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840039b0 0x7efe84003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.970+0000 7efe9d0d6640 1 -- 172.21.15.2:0/769314617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84003530 con 0x7efe840047d0 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9d0d6640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe840047d0 0x7efe84004c50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c1c0 tx=0x7efe8801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c3dc380e521f71 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88005ae0 con 0x7efe840047d0 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe88005c40 con 0x7efe840047d0 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9c8d5640 1 -- 172.21.15.2:0/769314617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88007070 con 0x7efe840047d0 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 -- 172.21.15.2:0/769314617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe840047d0 msgr2=0x7efe84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 --2- 172.21.15.2:0/769314617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe840047d0 0x7efe84004c50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c1c0 tx=0x7efe8801cc20 comp rx=0 tx=0).stop 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9e0d8640 1 -- 172.21.15.2:0/769314617 reap_dead start 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 -- 172.21.15.2:0/769314617 shutdown_connections 2023-11-04T01:49:52.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 -- 172.21.15.2:0/769314617 >> 172.21.15.2:0/769314617 conn(0x7efe980b0890 msgr2=0x7efe980b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 -- 172.21.15.2:0/769314617 shutdown_connections 2023-11-04T01:49:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 -- 172.21.15.2:0/769314617 wait complete. 2023-11-04T01:49:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 Processor -- start 2023-11-04T01:49:52.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.974+0000 7efe9fb3b640 1 -- start start 2023-11-04T01:49:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840047d0 0x7efe980c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe980c5d30 0x7efe980c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe981f3d80 0x7efe981f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9815afd0 con 0x7efe981f3d80 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c66f0 con 0x7efe840047d0 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c9000 con 0x7efe980c5d30 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe981f3d80 0x7efe981f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe981f3d80 0x7efe981f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57052/0 (socket says 172.21.15.2:57052) 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 -- 172.21.15.2:0/578976573 learned_addr learned my addr 172.21.15.2:0/578976573 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9d8d7640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840047d0 0x7efe980c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9d0d6640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe980c5d30 0x7efe980c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 -- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe980c5d30 msgr2=0x7efe980c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe980c5d30 0x7efe980c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 -- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840047d0 msgr2=0x7efe980c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840047d0 0x7efe980c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 -- 172.21.15.2:0/578976573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980c8480 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9e0d8640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe981f3d80 0x7efe981f4200 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7efe98071f60 tx=0x7efe9000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe8e7fc640 1 -- 172.21.15.2:0/578976573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90017400 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe8e7fc640 1 -- 172.21.15.2:0/578976573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90011040 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe980c8760 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe8e7fc640 1 -- 172.21.15.2:0/578976573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900177c0 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe980c8d20 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9804e4a0 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe8e7fc640 1 -- 172.21.15.2:0/578976573 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe90017920 con 0x7efe981f3d80 2023-11-04T01:49:52.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe8e7fc640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efe7c0664a0 0x7efe7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.978+0000 7efe8e7fc640 1 -- 172.21.15.2:0/578976573 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 7748+0+0 (secure 0 0 0) 0x7efe90084bc0 con 0x7efe981f3d80 2023-11-04T01:49:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.982+0000 7efe9d8d7640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efe7c0664a0 0x7efe7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:52.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.982+0000 7efe9d8d7640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efe7c0664a0 0x7efe7c068960 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efe94001660 tx=0x7efe94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:52.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:52.986+0000 7efe8e7fc640 1 -- 172.21.15.2:0/578976573 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe90051830 con 0x7efe981f3d80 2023-11-04T01:49:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.198+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "6:1"} v 0) v1 -- 0x7efe9815c890 con 0x7efe981f3d80 2023-11-04T01:49:53.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe8e7fc640 1 -- 172.21.15.2:0/578976573 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "6:1"}]=0 failed mds gid 8193 v113) v1 ==== 97+0+0 (secure 0 0 0) 0x7efe9001c020 con 0x7efe981f3d80 2023-11-04T01:49:53.202 INFO:teuthology.orchestra.run.smithi002.stderr:failed mds gid 8193 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efe7c0664a0 msgr2=0x7efe7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efe7c0664a0 0x7efe7c068960 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7efe94001660 tx=0x7efe94009040 comp rx=0 tx=0).stop 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe981f3d80 msgr2=0x7efe981f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe981f3d80 0x7efe981f4200 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7efe98071f60 tx=0x7efe9000f4a0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 shutdown_connections 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7efe7c0664a0 0x7efe7c068960 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe981f3d80 0x7efe981f4200 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7efe980c5d30 0x7efe980c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 --2- 172.21.15.2:0/578976573 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe840047d0 0x7efe980c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 >> 172.21.15.2:0/578976573 conn(0x7efe980b0890 msgr2=0x7efe98070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 shutdown_connections 2023-11-04T01:49:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.202+0000 7efe9fb3b640 1 -- 172.21.15.2:0/578976573 wait complete. 2023-11-04T01:49:53.224 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-04T01:49:53.224 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-04T01:49:53.224 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T01:49:53.224 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:49:53.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:49:53.225 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-11-04T01:49:53.225 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T01:49:53.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-04T01:49:53.227 INFO:tasks.ceph.mds.c:Started 2023-11-04T01:49:53.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:53.285 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-04T01:49:53.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11f27e0640 1 Processor -- start 2023-11-04T01:49:53.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11f27e0640 1 -- start start 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11f27e0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f11ec160a60 0x7f11ec0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11f27e0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ec0cf000 con 0x7f11ec160680 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11f27e0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ec0b5de0 con 0x7f11ec0ce7f0 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11f27e0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec0d09b0 con 0x7f11ec160a60 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11ebfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f11ec160680 0x7f11ec0cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54180/0 (socket says 172.21.15.2:54180) 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.330+0000 7f11ebfff640 1 -- 172.21.15.2:0/2786056172 learned_addr learned my addr 172.21.15.2:0/2786056172 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062479241 0 0) 0x7f11ec0cf000 con 0x7f11ec160680 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11d8003530 con 0x7f11ec160680 2023-11-04T01:49:53.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2786056172 >> v2:172.21.15.90:3300/0 conn(0x7f11ec160a60 0x7f11ec0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815340334 0 0) 0x7f11d8003530 con 0x7f11ec160680 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 >> v2:172.21.15.90:3300/0 conn(0x7f11ec160a60 msgr2=0x7f11ec0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 --2- 172.21.15.2:0/2786056172 >> v2:172.21.15.90:3300/0 conn(0x7f11ec160a60 0x7f11ec0ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 >> v1:172.21.15.90:6789/0 conn(0x7f11ec0ce7f0 legacy=0x7f11ec0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec0d1610 con 0x7f11ec160680 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f11dc001680 con 0x7f11ec160680 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 >> v1:172.21.15.2:6789/0 conn(0x7f11ec160680 legacy=0x7f11ec0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11d8003980 0x7f11d8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d80047d0 0x7f11d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d8005190 0x7f11d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0d09b0 con 0x7f11d80047d0 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d800c0c0 con 0x7f11d8005190 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d800c280 con 0x7f11d8003980 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d80047d0 0x7f11d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11ebfff640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11d8003980 0x7f11d8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f0d7d640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d8005190 0x7f11d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 -- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11d8003980 msgr2=0x7f11d8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11d8003980 0x7f11d8003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 -- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d8005190 msgr2=0x7f11d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d8005190 0x7f11d800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 -- 172.21.15.2:0/2786056172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8003530 con 0x7f11d80047d0 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f0d7d640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d8005190 0x7f11d800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:49:53.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f0d7d640 1 -- 172.21.15.2:0/2786056172 reap_dead start 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d80047d0 0x7f11d8004c50 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f11d400ba00 tx=0x7f11d401c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2640f68eccf2db3a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40ad640 con 0x7f11d80047d0 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d40ad7a0 con 0x7f11d80047d0 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11eb7fe640 1 -- 172.21.15.2:0/2786056172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40adb50 con 0x7f11d80047d0 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f27e0640 1 -- 172.21.15.2:0/2786056172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d80047d0 msgr2=0x7f11d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d80047d0 0x7f11d8004c50 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f11d400ba00 tx=0x7f11d401c640 comp rx=0 tx=0).stop 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f27e0640 1 -- 172.21.15.2:0/2786056172 shutdown_connections 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2786056172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11d80047d0 0x7f11d8004c50 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f27e0640 1 -- 172.21.15.2:0/2786056172 >> 172.21.15.2:0/2786056172 conn(0x7f11ec0d2f90 msgr2=0x7f11ec0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f27e0640 1 -- 172.21.15.2:0/2786056172 shutdown_connections 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.334+0000 7f11f27e0640 1 -- 172.21.15.2:0/2786056172 wait complete. 2023-11-04T01:49:53.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 Processor -- start 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 -- start start 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d80047d0 0x7f11ec0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ec1f69b0 0x7f11ec0b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11ec0ca060 0x7f11ec15f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0b8080 con 0x7f11ec1f69b0 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0ccaa0 con 0x7f11d80047d0 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec0ccd80 con 0x7f11ec0ca060 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ec1f69b0 0x7f11ec0b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ec1f69b0 0x7f11ec0b7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57102/0 (socket says 172.21.15.2:57102) 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 -- 172.21.15.2:0/2642918744 learned_addr learned my addr 172.21.15.2:0/2642918744 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:53.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11ebfff640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d80047d0 0x7f11ec0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f0d7d640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11ec0ca060 0x7f11ec15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 -- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11ec0ca060 msgr2=0x7f11ec15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11ec0ca060 0x7f11ec15f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 -- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d80047d0 msgr2=0x7f11ec0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d80047d0 0x7f11ec0cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 -- 172.21.15.2:0/2642918744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec0c8350 con 0x7f11ec1f69b0 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e37fe640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ec1f69b0 0x7f11ec0b7b40 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f11d401cb20 tx=0x7f11d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e97fa640 1 -- 172.21.15.2:0/2642918744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40be070 con 0x7f11ec1f69b0 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e97fa640 1 -- 172.21.15.2:0/2642918744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d4004020 con 0x7f11ec1f69b0 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec0c8630 con 0x7f11ec1f69b0 2023-11-04T01:49:53.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e97fa640 1 -- 172.21.15.2:0/2642918744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d4004390 con 0x7f11ec1f69b0 2023-11-04T01:49:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec0ca4e0 con 0x7f11ec1f69b0 2023-11-04T01:49:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec0c60d0 con 0x7f11ec1f69b0 2023-11-04T01:49:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.338+0000 7f11e97fa640 1 -- 172.21.15.2:0/2642918744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f11d40b4040 con 0x7f11ec1f69b0 2023-11-04T01:49:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.342+0000 7f11e97fa640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11cc0664a0 0x7f11cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.342+0000 7f11e97fa640 1 -- 172.21.15.2:0/2642918744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7834+0+0 (secure 0 0 0) 0x7f11d411eba0 con 0x7f11ec1f69b0 2023-11-04T01:49:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.342+0000 7f11ebfff640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11cc0664a0 0x7f11cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.342+0000 7f11ebfff640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11cc0664a0 0x7f11cc068960 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f11dc001060 tx=0x7f11dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:53.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.346+0000 7f11e97fa640 1 -- 172.21.15.2:0/2642918744 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11ec0c60d0 con 0x7f11ec1f69b0 2023-11-04T01:49:53.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11ec0c60d0 con 0x7f11ec1f69b0 2023-11-04T01:49:53.530 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11e97fa640 1 -- 172.21.15.2:0/2642918744 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4143 (secure 0 0 0) 0x7f11ec0c60d0 con 0x7f11ec1f69b0 2023-11-04T01:49:53.531 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:53.531 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":114,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:53.207266+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:resolve","state_seq":12,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:replay","state_seq":1,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:53.531 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 114 2023-11-04T01:49:53.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11cc0664a0 msgr2=0x7f11cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11cc0664a0 0x7f11cc068960 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f11dc001060 tx=0x7f11dc009040 comp rx=0 tx=0).stop 2023-11-04T01:49:53.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ec1f69b0 msgr2=0x7f11ec0b7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:53.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ec1f69b0 0x7f11ec0b7b40 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f11d401cb20 tx=0x7f11d8005800 comp rx=0 tx=0).stop 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 shutdown_connections 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f11cc0664a0 0x7f11cc068960 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f11ec0ca060 0x7f11ec15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11ec1f69b0 0x7f11ec0b7b40 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 --2- 172.21.15.2:0/2642918744 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11d80047d0 0x7f11ec0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 >> 172.21.15.2:0/2642918744 conn(0x7f11ec0d2f90 msgr2=0x7f11ec0b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 shutdown_connections 2023-11-04T01:49:53.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:53.530+0000 7f11f27e0640 1 -- 172.21.15.2:0/2642918744 wait complete. 2023-11-04T01:49:53.548 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2023-11-04T01:49:55.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-04T01:49:55.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:55.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:49:58.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:58.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 Processor -- start 2023-11-04T01:49:58.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 -- start start 2023-11-04T01:49:58.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe39c15cf80 0x7fe39c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe39c0ae200 0x7fe39c0cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c06bbf0 con 0x7fe39c15cf80 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c0c4910 con 0x7fe39c0ae200 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe3a0a6b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c15dcf0 con 0x7fe39c0add70 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe39c15cf80 0x7fe39c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe39c15cf80 0x7fe39c0ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57112/0 (socket says 172.21.15.2:57112) 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 -- 172.21.15.2:0/1992366613 learned_addr learned my addr 172.21.15.2:0/1992366613 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39ad9d640 1 --2- 172.21.15.2:0/1992366613 >> v2:172.21.15.90:3300/0 conn(0x7fe39c0ae200 0x7fe39c0cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe399d9b640 1 --2- 172.21.15.2:0/1992366613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 -- 172.21.15.2:0/1992366613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 msgr2=0x7fe39c15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 --2- 172.21.15.2:0/1992366613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c15d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 -- 172.21.15.2:0/1992366613 >> v2:172.21.15.90:3300/0 conn(0x7fe39c0ae200 msgr2=0x7fe39c0cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:58.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 --2- 172.21.15.2:0/1992366613 >> v2:172.21.15.90:3300/0 conn(0x7fe39c0ae200 0x7fe39c0cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39a59c640 1 -- 172.21.15.2:0/1992366613 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c15dfd0 con 0x7fe39c15cf80 2023-11-04T01:49:58.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.686+0000 7fe39ad9d640 1 --2- 172.21.15.2:0/1992366613 >> v2:172.21.15.90:3300/0 conn(0x7fe39c0ae200 0x7fe39c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:58.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe39a59c640 1 --2- 172.21.15.2:0/1992366613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c15cf80 0x7fe39c0ac8e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06cee0 tx=0x7fe38c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e66cd4904c56b97 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:58.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe39959a640 1 -- 172.21.15.2:0/1992366613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0ac600 con 0x7fe39c15cf80 2023-11-04T01:49:58.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe39959a640 1 -- 172.21.15.2:0/1992366613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c0a8050 con 0x7fe39c15cf80 2023-11-04T01:49:58.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe39959a640 1 -- 172.21.15.2:0/1992366613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0ac980 con 0x7fe39c15cf80 2023-11-04T01:49:58.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/1992366613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c15cf80 msgr2=0x7fe39c0ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:58.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/1992366613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c15cf80 0x7fe39c0ac8e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe39c06cee0 tx=0x7fe38c01c4d0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/1992366613 shutdown_connections 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/1992366613 >> v2:172.21.15.90:3300/0 conn(0x7fe39c0ae200 0x7fe39c0cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/1992366613 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/1992366613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c15cf80 0x7fe39c0ac8e0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/1992366613 >> 172.21.15.2:0/1992366613 conn(0x7fe39c0b0890 msgr2=0x7fe39c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/1992366613 shutdown_connections 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/1992366613 wait complete. 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 Processor -- start 2023-11-04T01:49:58.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.690+0000 7fe3a0a6b640 1 -- start start 2023-11-04T01:49:58.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c0ae200 0x7fe39c14e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c15cf80 0x7fe39c0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c14ed70 con 0x7fe39c0ae200 2023-11-04T01:49:58.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0aeb50 con 0x7fe39c15cf80 2023-11-04T01:49:58.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c0aedf0 con 0x7fe39c0add70 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c0ae200 0x7fe39c14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c0ae200 0x7fe39c14e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57118/0 (socket says 172.21.15.2:57118) 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 -- 172.21.15.2:0/2078801906 learned_addr learned my addr 172.21.15.2:0/2078801906 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe39a59c640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe39ad9d640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c15cf80 0x7fe39c0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 -- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 msgr2=0x7fe39c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 -- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c15cf80 msgr2=0x7fe39c0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c15cf80 0x7fe39c0cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 -- 172.21.15.2:0/2078801906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c0094d0 con 0x7fe39c0ae200 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe399d9b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c0ae200 0x7fe39c14e830 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d800 tx=0x7fe39000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe38affd640 1 -- 172.21.15.2:0/2078801906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900096a0 con 0x7fe39c0ae200 2023-11-04T01:49:58.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe38affd640 1 -- 172.21.15.2:0/2078801906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390009800 con 0x7fe39c0ae200 2023-11-04T01:49:58.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c0af0d0 con 0x7fe39c0ae200 2023-11-04T01:49:58.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe38affd640 1 -- 172.21.15.2:0/2078801906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390009b70 con 0x7fe39c0ae200 2023-11-04T01:49:58.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c0af690 con 0x7fe39c0ae200 2023-11-04T01:49:58.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c04e4a0 con 0x7fe39c0ae200 2023-11-04T01:49:58.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe38affd640 1 -- 172.21.15.2:0/2078801906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe390009cd0 con 0x7fe39c0ae200 2023-11-04T01:49:58.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe38affd640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe37c0664a0 0x7fe37c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:58.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe38affd640 1 -- 172.21.15.2:0/2078801906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7834+0+0 (secure 0 0 0) 0x7fe390084e50 con 0x7fe39c0ae200 2023-11-04T01:49:58.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.694+0000 7fe39a59c640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe37c0664a0 0x7fe37c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:58.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.698+0000 7fe39a59c640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe37c0664a0 0x7fe37c068960 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ae000 tx=0x7fe38c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:58.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.698+0000 7fe38affd640 1 -- 172.21.15.2:0/2078801906 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe390051b10 con 0x7fe39c0ae200 2023-11-04T01:49:58.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.894+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe39c06cf10 con 0x7fe39c0ae200 2023-11-04T01:49:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.894+0000 7fe38affd640 1 -- 172.21.15.2:0/2078801906 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4931 (secure 0 0 0) 0x7fe390055130 con 0x7fe39c0ae200 2023-11-04T01:49:58.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:58.895 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:54.229249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:58.895 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 116 2023-11-04T01:49:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe37c0664a0 msgr2=0x7fe37c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe37c0664a0 0x7fe37c068960 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0ae000 tx=0x7fe38c0a7000 comp rx=0 tx=0).stop 2023-11-04T01:49:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c0ae200 msgr2=0x7fe39c14e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c0ae200 0x7fe39c14e830 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d800 tx=0x7fe39000dcc0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 shutdown_connections 2023-11-04T01:49:58.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe37c0664a0 0x7fe37c068960 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe39c15cf80 0x7fe39c0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe39c0ae200 0x7fe39c14e830 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 --2- 172.21.15.2:0/2078801906 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe39c0add70 0x7fe39c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:58.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 >> 172.21.15.2:0/2078801906 conn(0x7fe39c0b0890 msgr2=0x7fe39c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:58.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 shutdown_connections 2023-11-04T01:49:58.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:58.898+0000 7fe3a0a6b640 1 -- 172.21.15.2:0/2078801906 wait complete. 2023-11-04T01:49:58.914 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-11-04T01:49:58.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:49:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f9b32640 1 Processor -- start 2023-11-04T01:49:59.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f9b32640 1 -- start start 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f9b32640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 0x7f52f4167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f9b32640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40cf000 con 0x7f52f4160680 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f9b32640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40b5de0 con 0x7f52f4160a60 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f9b32640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40d09b0 con 0x7f52f40b72f0 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f52f4160680 0x7f52f40cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54188/0 (socket says 172.21.15.2:54188) 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f37fe640 1 -- 172.21.15.2:0/3808961508 learned_addr learned my addr 172.21.15.2:0/3808961508 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f3fff640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 0x7f52f4167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237329902 0 0) 0x7f52f40cf000 con 0x7f52f4160680 2023-11-04T01:49:59.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52dc003530 con 0x7f52f4160680 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110823433 0 0) 0x7f52f40b5de0 con 0x7f52f4160a60 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f40cf000 con 0x7f52f4160a60 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 218779317 0 0) 0x7f52dc003530 con 0x7f52f4160680 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 msgr2=0x7f52f4167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 0x7f52f4167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 >> v1:172.21.15.90:6789/0 conn(0x7f52f4160a60 legacy=0x7f52f40ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40d1610 con 0x7f52f4160680 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f52e4001680 con 0x7f52f4160680 2023-11-04T01:49:59.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 >> v1:172.21.15.2:6789/0 conn(0x7f52f4160680 legacy=0x7f52f40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52dc003b40 0x7f52dc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 0x7f52dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40d09b0 con 0x7f52dc004d10 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc00ba40 con 0x7f52dc003b40 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc00bbb0 con 0x7f52f40b72f0 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f3fff640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f37fe640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52dc003b40 0x7f52dc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f2ffd640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 0x7f52dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f3fff640 1 -- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 msgr2=0x7f52dc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f3fff640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f40b72f0 0x7f52dc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f3fff640 1 -- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52dc003b40 msgr2=0x7f52dc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:49:59.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f3fff640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52dc003b40 0x7f52dc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f3fff640 1 -- 172.21.15.2:0/3808961508 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc003530 con 0x7f52dc004d10 2023-11-04T01:49:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.034+0000 7f52f37fe640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52dc003b40 0x7f52dc003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:59.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f3fff640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52dc005190 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009f90 tx=0x7f52ec01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53b639527223b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0a5b20 con 0x7f52dc004d10 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00f040 con 0x7f52dc004d10 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f27fc640 1 -- 172.21.15.2:0/3808961508 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0a5e80 con 0x7f52dc004d10 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 -- 172.21.15.2:0/3808961508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 msgr2=0x7f52dc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 --2- 172.21.15.2:0/3808961508 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52dc005190 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009f90 tx=0x7f52ec01cc20 comp rx=0 tx=0).stop 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f3fff640 1 -- 172.21.15.2:0/3808961508 reap_dead start 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 -- 172.21.15.2:0/3808961508 shutdown_connections 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 -- 172.21.15.2:0/3808961508 >> 172.21.15.2:0/3808961508 conn(0x7f52f40d2f90 msgr2=0x7f52f40d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 -- 172.21.15.2:0/3808961508 shutdown_connections 2023-11-04T01:49:59.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 -- 172.21.15.2:0/3808961508 wait complete. 2023-11-04T01:49:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 Processor -- start 2023-11-04T01:49:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.038+0000 7f52f9b32640 1 -- start start 2023-11-04T01:49:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52f41e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f415aa90 0x7f52f4157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f415af10 0x7f52f41583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41e6ca0 con 0x7f52dc004d10 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41e75e0 con 0x7f52f415af10 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41e6020 con 0x7f52f415aa90 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52f41e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52f41e70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57136/0 (socket says 172.21.15.2:57136) 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 -- 172.21.15.2:0/2607053028 learned_addr learned my addr 172.21.15.2:0/2607053028 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f2ffd640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f415aa90 0x7f52f4157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f3fff640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f415af10 0x7f52f41583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 -- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f415aa90 msgr2=0x7f52f4157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f415aa90 0x7f52f4157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 -- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f415af10 msgr2=0x7f52f41583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f415af10 0x7f52f41583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 -- 172.21.15.2:0/2607053028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f41e6300 con 0x7f52dc004d10 2023-11-04T01:49:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f2ffd640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f415aa90 0x7f52f4157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:49:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f37fe640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52f41e70a0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f52e4011880 tx=0x7f52e4011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52dbfff640 1 -- 172.21.15.2:0/2607053028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400fb00 con 0x7f52dc004d10 2023-11-04T01:49:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52dbfff640 1 -- 172.21.15.2:0/2607053028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400fc60 con 0x7f52dc004d10 2023-11-04T01:49:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52dbfff640 1 -- 172.21.15.2:0/2607053028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4015410 con 0x7f52dc004d10 2023-11-04T01:49:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f41e65e0 con 0x7f52dc004d10 2023-11-04T01:49:59.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f41e5c40 con 0x7f52dc004d10 2023-11-04T01:49:59.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f404e4a0 con 0x7f52dc004d10 2023-11-04T01:49:59.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52dbfff640 1 -- 172.21.15.2:0/2607053028 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52e4015570 con 0x7f52dc004d10 2023-11-04T01:49:59.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52dbfff640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52e00664a0 0x7f52e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:49:59.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52dbfff640 1 -- 172.21.15.2:0/2607053028 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7834+0+0 (secure 0 0 0) 0x7f52e40879a0 con 0x7f52dc004d10 2023-11-04T01:49:59.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.042+0000 7f52f2ffd640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52e00664a0 0x7f52e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:49:59.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.046+0000 7f52f2ffd640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52e00664a0 0x7f52e0068960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f52e8007af0 tx=0x7f52e8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:49:59.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.046+0000 7f52dbfff640 1 -- 172.21.15.2:0/2607053028 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f52e4054660 con 0x7f52dc004d10 2023-11-04T01:49:59.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.234+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52f415e1a0 con 0x7f52dc004d10 2023-11-04T01:49:59.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52dbfff640 1 -- 172.21.15.2:0/2607053028 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f52e4057c80 con 0x7f52dc004d10 2023-11-04T01:49:59.239 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:49:59.239 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:54.229249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:49:59.239 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 116 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52e00664a0 msgr2=0x7f52e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52e00664a0 0x7f52e0068960 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f52e8007af0 tx=0x7f52e8009040 comp rx=0 tx=0).stop 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 msgr2=0x7f52f41e70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52f41e70a0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f52e4011880 tx=0x7f52e4011d40 comp rx=0 tx=0).stop 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 shutdown_connections 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f52e00664a0 0x7f52e0068960 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f52f415af10 0x7f52f41583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f52f415aa90 0x7f52f4157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 --2- 172.21.15.2:0/2607053028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f52dc004d10 0x7f52f41e70a0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:49:59.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 >> 172.21.15.2:0/2607053028 conn(0x7f52f40d2f90 msgr2=0x7f52f40d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:49:59.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 shutdown_connections 2023-11-04T01:49:59.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:49:59.238+0000 7f52f9b32640 1 -- 172.21.15.2:0/2607053028 wait complete. 2023-11-04T01:49:59.257 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:50:00.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:00.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.390+0000 7ff2be609640 1 Processor -- start 2023-11-04T01:50:00.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.390+0000 7ff2be609640 1 -- start start 2023-11-04T01:50:00.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2be609640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2b806bde0 0x7ff2b80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2be609640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 0x7ff2b815c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2be609640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b80c9ac0 con 0x7ff2b806c1c0 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2be609640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b80caf20 con 0x7ff2b806bde0 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2be609640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b815c5d0 con 0x7ff2b80c92b0 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff2b806c1c0 0x7ff2b81442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54204/0 (socket says 172.21.15.2:54204) 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 -- 172.21.15.2:0/1666121202 learned_addr learned my addr 172.21.15.2:0/1666121202 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b77fe640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 0x7ff2b815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b7fff640 1 --2- 172.21.15.2:0/1666121202 >> v2:172.21.15.90:3300/0 conn(0x7ff2b806bde0 0x7ff2b80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617006832 0 0) 0x7ff2b80c9ac0 con 0x7ff2b806c1c0 2023-11-04T01:50:00.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a0003530 con 0x7ff2b806c1c0 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3766552512 0 0) 0x7ff2a0003530 con 0x7ff2b806c1c0 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 msgr2=0x7ff2b815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 0x7ff2b815c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 >> v2:172.21.15.90:3300/0 conn(0x7ff2b806bde0 msgr2=0x7ff2b80cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 --2- 172.21.15.2:0/1666121202 >> v2:172.21.15.90:3300/0 conn(0x7ff2b806bde0 0x7ff2b80cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b80c97e0 con 0x7ff2b806c1c0 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff2b0001a00 con 0x7ff2b806c1c0 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 >> v1:172.21.15.2:6789/0 conn(0x7ff2b806c1c0 legacy=0x7ff2b81442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a0003980 0x7ff2a0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 0x7ff2a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80caf20 con 0x7ff2a0004d10 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b815c5d0 con 0x7ff2a0003980 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a000b990 con 0x7ff2b80c92b0 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b7fff640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a0003980 0x7ff2a0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b77fe640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 0x7ff2a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 -- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 msgr2=0x7ff2a00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 0x7ff2a00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 -- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a0003980 msgr2=0x7ff2a0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2a0003980 0x7ff2a0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2bcba6640 1 -- 172.21.15.2:0/1666121202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0003530 con 0x7ff2a0004d10 2023-11-04T01:50:00.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.394+0000 7ff2b77fe640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b80c92b0 0x7ff2a00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:00.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005190 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000a890 tx=0x7ff2b001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc5e9c275d68927 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:00.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00ad630 con 0x7ff2a0004d10 2023-11-04T01:50:00.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00a8070 con 0x7ff2a0004d10 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2b6ffd640 1 -- 172.21.15.2:0/1666121202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00ad9f0 con 0x7ff2a0004d10 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- 172.21.15.2:0/1666121202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a0004d10 msgr2=0x7ff2a0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 --2- 172.21.15.2:0/1666121202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2a0004d10 0x7ff2a0005190 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000a890 tx=0x7ff2b001d360 comp rx=0 tx=0).stop 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 -- 172.21.15.2:0/1666121202 reap_dead start 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- 172.21.15.2:0/1666121202 shutdown_connections 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- 172.21.15.2:0/1666121202 >> 172.21.15.2:0/1666121202 conn(0x7ff2b80b0890 msgr2=0x7ff2b80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- 172.21.15.2:0/1666121202 shutdown_connections 2023-11-04T01:50:00.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- 172.21.15.2:0/1666121202 wait complete. 2023-11-04T01:50:00.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 Processor -- start 2023-11-04T01:50:00.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- start start 2023-11-04T01:50:00.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2b814d8f0 0x7ff2b813dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b81f47f0 0x7ff2b81f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2b81f51b0 0x7ff2b813f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b8143040 con 0x7ff2b81f51b0 2023-11-04T01:50:00.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b813e120 con 0x7ff2b814d8f0 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2be609640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b81f5660 con 0x7ff2b81f47f0 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2b81f51b0 0x7ff2b813f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2b81f51b0 0x7ff2b813f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57154/0 (socket says 172.21.15.2:57154) 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 -- 172.21.15.2:0/2404224148 learned_addr learned my addr 172.21.15.2:0/2404224148 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2b7fff640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2b814d8f0 0x7ff2b813dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2b77fe640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b81f47f0 0x7ff2b81f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 -- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b81f47f0 msgr2=0x7ff2b81f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b81f47f0 0x7ff2b81f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 -- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2b814d8f0 msgr2=0x7ff2b813dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2b814d8f0 0x7ff2b813dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2bcba6640 1 -- 172.21.15.2:0/2404224148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8143460 con 0x7ff2b81f51b0 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.398+0000 7ff2b77fe640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b81f47f0 0x7ff2b81f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:00.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2bcba6640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2b81f51b0 0x7ff2b813f7d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000a890 tx=0x7ff2a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:00.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b4ff9640 1 -- 172.21.15.2:0/2404224148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00019d0 con 0x7ff2b81f51b0 2023-11-04T01:50:00.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b4ff9640 1 -- 172.21.15.2:0/2404224148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00b6450 con 0x7ff2b81f51b0 2023-11-04T01:50:00.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b813e350 con 0x7ff2b81f51b0 2023-11-04T01:50:00.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b4ff9640 1 -- 172.21.15.2:0/2404224148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00b67e0 con 0x7ff2b81f51b0 2023-11-04T01:50:00.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b8142980 con 0x7ff2b81f51b0 2023-11-04T01:50:00.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b8143180 con 0x7ff2b81f51b0 2023-11-04T01:50:00.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b4ff9640 1 -- 172.21.15.2:0/2404224148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2b00aa030 con 0x7ff2b81f51b0 2023-11-04T01:50:00.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b4ff9640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2a40664d0 0x7ff2a4068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:00.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b4ff9640 1 -- 172.21.15.2:0/2404224148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 7834+0+0 (secure 0 0 0) 0x7ff2b011e2b0 con 0x7ff2b81f51b0 2023-11-04T01:50:00.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b7fff640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2a40664d0 0x7ff2a4068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:00.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.402+0000 7ff2b7fff640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2a40664d0 0x7ff2a4068990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff2b813a870 tx=0x7ff2a8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:00.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.406+0000 7ff2b4ff9640 1 -- 172.21.15.2:0/2404224148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2b8143180 con 0x7ff2b81f51b0 2023-11-04T01:50:00.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.598+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2b8143180 con 0x7ff2b81f51b0 2023-11-04T01:50:00.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.598+0000 7ff2b4ff9640 1 -- 172.21.15.2:0/2404224148 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4931 (secure 0 0 0) 0x7ff2b8143180 con 0x7ff2b81f51b0 2023-11-04T01:50:00.600 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:00.600 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:54.229249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:00.600 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 116 2023-11-04T01:50:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2a40664d0 msgr2=0x7ff2a4068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2a40664d0 0x7ff2a4068990 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff2b813a870 tx=0x7ff2a8009190 comp rx=0 tx=0).stop 2023-11-04T01:50:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2b81f51b0 msgr2=0x7ff2b813f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2b81f51b0 0x7ff2b813f7d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000a890 tx=0x7ff2a0005800 comp rx=0 tx=0).stop 2023-11-04T01:50:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 shutdown_connections 2023-11-04T01:50:00.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2a40664d0 0x7ff2a4068990 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2b81f51b0 0x7ff2b813f7d0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2b81f47f0 0x7ff2b81f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 --2- 172.21.15.2:0/2404224148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2b814d8f0 0x7ff2b813dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 >> 172.21.15.2:0/2404224148 conn(0x7ff2b80b0890 msgr2=0x7ff2b80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 shutdown_connections 2023-11-04T01:50:00.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:00.602+0000 7ff2be609640 1 -- 172.21.15.2:0/2404224148 wait complete. 2023-11-04T01:50:00.620 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:50:01.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:01.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f40113ef640 1 Processor -- start 2023-11-04T01:50:01.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f40113ef640 1 -- start start 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f40113ef640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f400c15d0e0 0x7f400c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f40113ef640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 0x7f400c0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f40113ef640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400c0ced80 con 0x7f400c0cdca0 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f40113ef640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400c0ce130 con 0x7f400c15d0e0 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f40113ef640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c0b0420 con 0x7f400c0ce920 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f400affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f400c15d0e0 0x7f400c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f400affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f400c15d0e0 0x7f400c06e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39468/0 (socket says 172.21.15.2:39468) 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f400affd640 1 -- 172.21.15.2:0/900795575 learned_addr learned my addr 172.21.15.2:0/900795575 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:01.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f400affd640 1 -- 172.21.15.2:0/900795575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 msgr2=0x7f400c0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f400affd640 1 --2- 172.21.15.2:0/900795575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 0x7f400c0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f400affd640 1 -- 172.21.15.2:0/900795575 >> v1:172.21.15.90:6789/0 conn(0x7f400c0cdca0 legacy=0x7f400c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:01.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.758+0000 7f400affd640 1 -- 172.21.15.2:0/900795575 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c160cf0 con 0x7f400c15d0e0 2023-11-04T01:50:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 --2- 172.21.15.2:0/900795575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c15d0e0 0x7f400c06e660 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f4000009870 tx=0x7f400001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644084177e3fe45f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f4009ffb640 1 -- 172.21.15.2:0/900795575 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000aa5f0 con 0x7f400c15d0e0 2023-11-04T01:50:01.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f4009ffb640 1 -- 172.21.15.2:0/900795575 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40000aa750 con 0x7f400c15d0e0 2023-11-04T01:50:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f4009ffb640 1 -- 172.21.15.2:0/900795575 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000aaae0 con 0x7f400c15d0e0 2023-11-04T01:50:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- 172.21.15.2:0/900795575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c15d0e0 msgr2=0x7f400c06e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:01.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 --2- 172.21.15.2:0/900795575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c15d0e0 0x7f400c06e660 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f4000009870 tx=0x7f400001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- 172.21.15.2:0/900795575 shutdown_connections 2023-11-04T01:50:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 --2- 172.21.15.2:0/900795575 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 0x7f400c0cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 --2- 172.21.15.2:0/900795575 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c15d0e0 0x7f400c06e660 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- 172.21.15.2:0/900795575 >> 172.21.15.2:0/900795575 conn(0x7f400c06a130 msgr2=0x7f400c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- 172.21.15.2:0/900795575 shutdown_connections 2023-11-04T01:50:01.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- 172.21.15.2:0/900795575 wait complete. 2023-11-04T01:50:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 Processor -- start 2023-11-04T01:50:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- start start 2023-11-04T01:50:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c0cdca0 0x7f400c14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 0x7f400c0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:01.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f400c15d0e0 0x7f400c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c15a370 con 0x7f400c0cdca0 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c1596f0 con 0x7f400c15d0e0 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f40113ef640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c1599d0 con 0x7f400c0ce920 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c0cdca0 0x7f400c14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c0cdca0 0x7f400c14b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39474/0 (socket says 172.21.15.2:39474) 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 -- 172.21.15.2:0/2986071647 learned_addr learned my addr 172.21.15.2:0/2986071647 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400a7fc640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 0x7f400c0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400b7fe640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f400c15d0e0 0x7f400c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 -- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 msgr2=0x7f400c0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:01.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 0x7f400c0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 -- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f400c15d0e0 msgr2=0x7f400c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f400c15d0e0 0x7f400c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400affd640 1 -- 172.21.15.2:0/2986071647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000094d0 con 0x7f400c0cdca0 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.762+0000 7f400b7fe640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f400c15d0e0 0x7f400c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f400affd640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c0cdca0 0x7f400c14b050 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f40000ac040 tx=0x7f400001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f3ff37fe640 1 -- 172.21.15.2:0/2986071647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000b3800 con 0x7f400c0cdca0 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f3ff37fe640 1 -- 172.21.15.2:0/2986071647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40000b3980 con 0x7f400c0cdca0 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400c159cb0 con 0x7f400c0cdca0 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f3ff37fe640 1 -- 172.21.15.2:0/2986071647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40000b3d30 con 0x7f400c0cdca0 2023-11-04T01:50:01.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c14b590 con 0x7f400c0cdca0 2023-11-04T01:50:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400c067610 con 0x7f400c0cdca0 2023-11-04T01:50:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f3ff37fe640 1 -- 172.21.15.2:0/2986071647 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40000c8430 con 0x7f400c0cdca0 2023-11-04T01:50:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f3ff37fe640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ff80664a0 0x7f3ff8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:01.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f3ff37fe640 1 -- 172.21.15.2:0/2986071647 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f40000a7070 con 0x7f400c0cdca0 2023-11-04T01:50:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f400a7fc640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ff80664a0 0x7f3ff8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:01.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.766+0000 7f400a7fc640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ff80664a0 0x7f3ff8068960 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc006fd0 tx=0x7f3ffc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:01.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.770+0000 7f3ff37fe640 1 -- 172.21.15.2:0/2986071647 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40000ebdf0 con 0x7f400c0cdca0 2023-11-04T01:50:01.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.962+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f400c159b10 con 0x7f400c0cdca0 2023-11-04T01:50:01.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.962+0000 7f3ff37fe640 1 -- 172.21.15.2:0/2986071647 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4931 (secure 0 0 0) 0x7f400c159b10 con 0x7f400c0cdca0 2023-11-04T01:50:01.963 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:01.963 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":116,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:49:54.229249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:reconnect","state_seq":15,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:reconnect","state_seq":4,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:01.964 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 116 2023-11-04T01:50:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ff80664a0 msgr2=0x7f3ff8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:01.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ff80664a0 0x7f3ff8068960 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc006fd0 tx=0x7f3ffc008040 comp rx=0 tx=0).stop 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c0cdca0 msgr2=0x7f400c14b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c0cdca0 0x7f400c14b050 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f40000ac040 tx=0x7f400001ad10 comp rx=0 tx=0).stop 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 shutdown_connections 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3ff80664a0 0x7f3ff8068960 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f400c15d0e0 0x7f400c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f400c0ce920 0x7f400c0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 --2- 172.21.15.2:0/2986071647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f400c0cdca0 0x7f400c14b050 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 >> 172.21.15.2:0/2986071647 conn(0x7f400c06a130 msgr2=0x7f400c06c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 shutdown_connections 2023-11-04T01:50:01.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:01.966+0000 7f40113ef640 1 -- 172.21.15.2:0/2986071647 wait complete. 2023-11-04T01:50:01.983 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:reconnect 2023-11-04T01:50:02.983 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:03.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.114+0000 7f2fd041a640 1 Processor -- start 2023-11-04T01:50:03.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fd041a640 1 -- start start 2023-11-04T01:50:03.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fd041a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fc8142eb0 0x7f2fc815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fd041a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80ca100 con 0x7f2fc80cbd80 2023-11-04T01:50:03.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fd041a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80ca3e0 con 0x7f2fc8142ad0 2023-11-04T01:50:03.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fd041a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80ca6c0 con 0x7f2fc8142eb0 2023-11-04T01:50:03.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fce9b7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2fc80cbd80 0x7f2fc80c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50742/0 (socket says 172.21.15.2:50742) 2023-11-04T01:50:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fcd9b5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2fc8142eb0 0x7f2fc815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fce9b7640 1 -- 172.21.15.2:0/2373036613 learned_addr learned my addr 172.21.15.2:0/2373036613 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fcd9b5640 1 -- 172.21.15.2:0/2373036613 >> v1:172.21.15.90:6789/0 conn(0x7f2fc8142ad0 legacy=0x7f2fc80cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fcd9b5640 1 -- 172.21.15.2:0/2373036613 >> v1:172.21.15.2:6789/0 conn(0x7f2fc80cbd80 legacy=0x7f2fc80c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fcd9b5640 1 -- 172.21.15.2:0/2373036613 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80ca9a0 con 0x7f2fc8142eb0 2023-11-04T01:50:03.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fcd1b4640 1 -- 172.21.15.2:0/2373036613 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238478377 0 0) 0x7f2fc80ca100 con 0x7f2fc80cbd80 2023-11-04T01:50:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.118+0000 7f2fcd9b5640 1 --2- 172.21.15.2:0/2373036613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc815e4e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80097c0 tx=0x7f2fb801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618c7b00158e3a4e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fcd1b4640 1 -- 172.21.15.2:0/2373036613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80ab600 con 0x7f2fc8142eb0 2023-11-04T01:50:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fcd1b4640 1 -- 172.21.15.2:0/2373036613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb80a7050 con 0x7f2fc8142eb0 2023-11-04T01:50:03.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fcd1b4640 1 -- 172.21.15.2:0/2373036613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80ab980 con 0x7f2fc8142eb0 2023-11-04T01:50:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- 172.21.15.2:0/2373036613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 msgr2=0x7f2fc815e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 --2- 172.21.15.2:0/2373036613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc815e4e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2fb80097c0 tx=0x7f2fb801c3f0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- 172.21.15.2:0/2373036613 shutdown_connections 2023-11-04T01:50:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 --2- 172.21.15.2:0/2373036613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc815e4e0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- 172.21.15.2:0/2373036613 >> 172.21.15.2:0/2373036613 conn(0x7f2fc80b0890 msgr2=0x7f2fc80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- 172.21.15.2:0/2373036613 shutdown_connections 2023-11-04T01:50:03.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- 172.21.15.2:0/2373036613 wait complete. 2023-11-04T01:50:03.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 Processor -- start 2023-11-04T01:50:03.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- start start 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fc80cbd80 0x7f2fc8158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc8142ad0 0x7f2fc81400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc8164f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc8141a70 con 0x7f2fc8142eb0 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc81409d0 con 0x7f2fc8142ad0 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fd041a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc8140cb0 con 0x7f2fc80cbd80 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc8164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc8164f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39488/0 (socket says 172.21.15.2:39488) 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 -- 172.21.15.2:0/27581082 learned_addr learned my addr 172.21.15.2:0/27581082 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fcd9b5640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc8142ad0 0x7f2fc81400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce1b6640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fc80cbd80 0x7f2fc8158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 -- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fc80cbd80 msgr2=0x7f2fc8158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fc80cbd80 0x7f2fc8158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 -- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc8142ad0 msgr2=0x7f2fc81400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc8142ad0 0x7f2fc81400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 -- 172.21.15.2:0/27581082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8009420 con 0x7f2fc8142eb0 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce1b6640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fc80cbd80 0x7f2fc8158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fcd9b5640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc8142ad0 0x7f2fc81400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:03.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.122+0000 7f2fce9b7640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc8164f20 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0001570 tx=0x7f2fc000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fbeffd640 1 -- 172.21.15.2:0/27581082 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000a640 con 0x7f2fc8142eb0 2023-11-04T01:50:03.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fbeffd640 1 -- 172.21.15.2:0/27581082 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000a7a0 con 0x7f2fc8142eb0 2023-11-04T01:50:03.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fbeffd640 1 -- 172.21.15.2:0/27581082 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000ab90 con 0x7f2fc8142eb0 2023-11-04T01:50:03.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc8140f90 con 0x7f2fc8142eb0 2023-11-04T01:50:03.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc8141550 con 0x7f2fc8142eb0 2023-11-04T01:50:03.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc804e4a0 con 0x7f2fc8142eb0 2023-11-04T01:50:03.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fbeffd640 1 -- 172.21.15.2:0/27581082 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2fc000acf0 con 0x7f2fc8142eb0 2023-11-04T01:50:03.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fbeffd640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fac0664a0 0x7f2fac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fbeffd640 1 -- 172.21.15.2:0/27581082 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f2fc0083c10 con 0x7f2fc8142eb0 2023-11-04T01:50:03.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fce1b6640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fac0664a0 0x7f2fac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.126+0000 7f2fce1b6640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fac0664a0 0x7f2fac068960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000f70 tx=0x7f2fc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.130+0000 7f2fbeffd640 1 -- 172.21.15.2:0/27581082 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2fc0050820 con 0x7f2fc8142eb0 2023-11-04T01:50:03.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.326+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fc8141740 con 0x7f2fc8142eb0 2023-11-04T01:50:03.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.326+0000 7f2fbeffd640 1 -- 172.21.15.2:0/27581082 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4925 (secure 0 0 0) 0x7f2fc0018030 con 0x7f2fc8142eb0 2023-11-04T01:50:03.328 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:03.328 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:02.280323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:03.329 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 118 2023-11-04T01:50:03.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fac0664a0 msgr2=0x7f2fac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fac0664a0 0x7f2fac068960 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000f70 tx=0x7f2fc4009040 comp rx=0 tx=0).stop 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 msgr2=0x7f2fc8164f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc8164f20 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0001570 tx=0x7f2fc000cc70 comp rx=0 tx=0).stop 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 shutdown_connections 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2fac0664a0 0x7f2fac068960 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2fc8142eb0 0x7f2fc8164f20 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc8142ad0 0x7f2fc81400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 --2- 172.21.15.2:0/27581082 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2fc80cbd80 0x7f2fc8158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 >> 172.21.15.2:0/27581082 conn(0x7f2fc80b0890 msgr2=0x7f2fc813bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 shutdown_connections 2023-11-04T01:50:03.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.330+0000 7f2fd041a640 1 -- 172.21.15.2:0/27581082 wait complete. 2023-11-04T01:50:03.347 DEBUG:tasks.cephfs.filesystem:Looked up MDS state for mds.0: up:active 2023-11-04T01:50:03.347 DEBUG:tasks.cephfs.filesystem:reached state 'up:active' in 4.4333672523498535s 2023-11-04T01:50:03.348 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:50:03.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:03.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:50:03.361 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:50:03.361 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:03.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:50:03.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.578+0000 7f3938a6a640 1 Processor -- start 2023-11-04T01:50:03.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.578+0000 7f3938a6a640 1 -- start start 2023-11-04T01:50:03.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3938a6a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f393406bde0 0x7f39340cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3938a6a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 0x7f393415c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3938a6a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39340c9ac0 con 0x7f393406c1c0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3938a6a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39340caf20 con 0x7f393406bde0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3938a6a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393415c5d0 con 0x7f39340c92b0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f393406c1c0 0x7f39341442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50752/0 (socket says 172.21.15.2:50752) 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 -- 172.21.15.2:0/3350911643 learned_addr learned my addr 172.21.15.2:0/3350911643 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3931d9b640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 0x7f393415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393259c640 1 --2- 172.21.15.2:0/3350911643 >> v2:172.21.15.90:3300/0 conn(0x7f393406bde0 0x7f39340cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209147891 0 0) 0x7f39340c9ac0 con 0x7f393406c1c0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f391c003530 con 0x7f393406c1c0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 601432966 0 0) 0x7f391c003530 con 0x7f393406c1c0 2023-11-04T01:50:03.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 msgr2=0x7f393415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 0x7f393415c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 >> v2:172.21.15.90:3300/0 conn(0x7f393406bde0 msgr2=0x7f39340cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 --2- 172.21.15.2:0/3350911643 >> v2:172.21.15.90:3300/0 conn(0x7f393406bde0 0x7f39340cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340c97e0 con 0x7f393406c1c0 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f392c001a00 con 0x7f393406c1c0 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 >> v1:172.21.15.2:6789/0 conn(0x7f393406c1c0 legacy=0x7f39341442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f391c003980 0x7f391c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 0x7f391c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f391c004d10 0x7f391c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39340caf20 con 0x7f391c004d10 2023-11-04T01:50:03.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393415c5d0 con 0x7f391c003980 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c00b990 con 0x7f39340c92b0 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f391c004d10 0x7f391c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3931d9b640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 0x7f391c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393259c640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f391c003980 0x7f391c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 -- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 msgr2=0x7f391c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39340c92b0 0x7f391c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 -- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f391c003980 msgr2=0x7f391c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f391c003980 0x7f391c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f3932d9d640 1 -- 172.21.15.2:0/3350911643 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c003530 con 0x7f391c004d10 2023-11-04T01:50:03.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.582+0000 7f393259c640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f391c003980 0x7f391c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:03.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3932d9d640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f391c004d10 0x7f391c005190 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f392c00a900 tx=0x7f392c01d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c76c1ff5fb6562 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0ad630 con 0x7f391c004d10 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0a8070 con 0x7f391c004d10 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f393159a640 1 -- 172.21.15.2:0/3350911643 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0ad9d0 con 0x7f391c004d10 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3938a6a640 1 -- 172.21.15.2:0/3350911643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f391c004d10 msgr2=0x7f391c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3938a6a640 1 --2- 172.21.15.2:0/3350911643 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f391c004d10 0x7f391c005190 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f392c00a900 tx=0x7f392c01d3c0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3932d9d640 1 -- 172.21.15.2:0/3350911643 reap_dead start 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3938a6a640 1 -- 172.21.15.2:0/3350911643 shutdown_connections 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3938a6a640 1 -- 172.21.15.2:0/3350911643 >> 172.21.15.2:0/3350911643 conn(0x7f39340b0890 msgr2=0x7f39340b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3938a6a640 1 -- 172.21.15.2:0/3350911643 shutdown_connections 2023-11-04T01:50:03.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3938a6a640 1 -- 172.21.15.2:0/3350911643 wait complete. 2023-11-04T01:50:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.586+0000 7f3938a6a640 1 Processor -- start 2023-11-04T01:50:03.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 -- start start 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3934158650 0x7f393413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39341f1e70 0x7f39340cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39341f1110 0x7f39341f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393413a7d0 con 0x7f39341f1110 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39341f1ae0 con 0x7f3934158650 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393413d110 con 0x7f39341f1e70 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39341f1110 0x7f39341f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39341f1110 0x7f39341f15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39500/0 (socket says 172.21.15.2:39500) 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 -- 172.21.15.2:0/835987887 learned_addr learned my addr 172.21.15.2:0/835987887 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:03.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f393259c640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3934158650 0x7f393413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3931d9b640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39341f1e70 0x7f39340cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 -- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39341f1e70 msgr2=0x7f39340cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39341f1e70 0x7f39340cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 -- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3934158650 msgr2=0x7f393413c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3934158650 0x7f393413c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 -- 172.21.15.2:0/835987887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393413a180 con 0x7f39341f1110 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f393259c640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3934158650 0x7f393413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3932d9d640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39341f1110 0x7f39341f15a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f392c01d1f0 tx=0x7f391c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3922ffd640 1 -- 172.21.15.2:0/835987887 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0019d0 con 0x7f39341f1110 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3922ffd640 1 -- 172.21.15.2:0/835987887 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c0b6450 con 0x7f39341f1110 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3922ffd640 1 -- 172.21.15.2:0/835987887 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0b67c0 con 0x7f39341f1110 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393413a460 con 0x7f39341f1110 2023-11-04T01:50:03.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39340ccd50 con 0x7f39341f1110 2023-11-04T01:50:03.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393413a620 con 0x7f39341f1110 2023-11-04T01:50:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3922ffd640 1 -- 172.21.15.2:0/835987887 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f392c0aa030 con 0x7f39341f1110 2023-11-04T01:50:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.590+0000 7f3922ffd640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664d0 0x7f3914068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.594+0000 7f3922ffd640 1 -- 172.21.15.2:0/835987887 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f392c11e350 con 0x7f39341f1110 2023-11-04T01:50:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.594+0000 7f393259c640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664d0 0x7f3914068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.594+0000 7f393259c640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664d0 0x7f3914068990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3924009a50 tx=0x7f3924008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.598+0000 7f3922ffd640 1 -- 172.21.15.2:0/835987887 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f392c0eaf70 con 0x7f39341f1110 2023-11-04T01:50:03.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.754+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3934139fe0 con 0x7f39341f1110 2023-11-04T01:50:03.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3922ffd640 1 -- 172.21.15.2:0/835987887 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+23398 (secure 0 0 0) 0x7f3934139fe0 con 0x7f39341f1110 2023-11-04T01:50:03.757 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:03.757 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":110,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:50:01.247124+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":9,"snap_epoch":100,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.f","mappings":[{"from":2,"to":3}]},{"pgid":"16.12","mappings":[{"from":4,"to":3}]},{"pgid":"16.39","mappings":[{"from":4,"to":6}]},{"pgid":"16.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4169282097":"2023-11-04T02:50:00.880111+0000","172.21.15.2:6833/3695355178":"2023-11-05T01:49:53.201635+0000","192.168.0.1:0/2988241810":"2023-11-04T02:49:10.916906+0000","172.21.15.90:6837/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.90:6834/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.2:6833/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6837/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.2:6832/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.2:6833/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.90:6834/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6834/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.2:6832/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6834/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.90:6837/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6834/2449846925":"2023-11-05T01:49:45.775757+0000","172.21.15.2:6832/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.90:6834/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6833/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.2:6832/3695355178":"2023-11-05T01:49:53.201635+0000","172.21.15.90:6837/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6835/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.2:6835/2449846925":"2023-11-05T01:49:45.775757+0000","192.168.0.1:0/2023608941":"2023-11-04T02:48:20.721790+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:50:03.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664d0 msgr2=0x7f3914068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664d0 0x7f3914068990 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3924009a50 tx=0x7f3924008040 comp rx=0 tx=0).stop 2023-11-04T01:50:03.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39341f1110 msgr2=0x7f39341f15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39341f1110 0x7f39341f15a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f392c01d1f0 tx=0x7f391c005800 comp rx=0 tx=0).stop 2023-11-04T01:50:03.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 shutdown_connections 2023-11-04T01:50:03.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f39140664d0 0x7f3914068990 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39341f1110 0x7f39341f15a0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f39341f1e70 0x7f39340cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 --2- 172.21.15.2:0/835987887 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3934158650 0x7f393413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 >> 172.21.15.2:0/835987887 conn(0x7f39340b0890 msgr2=0x7f393415d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:03.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 shutdown_connections 2023-11-04T01:50:03.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.758+0000 7f3938a6a640 1 -- 172.21.15.2:0/835987887 wait complete. 2023-11-04T01:50:03.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:45:33.227500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:45:34.004628+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 100, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:50:03.777 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:50:03.786 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:50:03.785+0000 7f76bb37f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-04T01:50:03.786 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:50:03.785+0000 7f76bb37f640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-11-04T01:50:03.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.906+0000 7f1cf7b5b640 1 Processor -- start 2023-11-04T01:50:03.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf7b5b640 1 -- start start 2023-11-04T01:50:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf7b5b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1cf015d1c0 0x7f1cf00d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf7b5b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1cf015d5a0 0x7f1cf00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf7b5b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf7b5b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00d09b0 con 0x7f1cf015d1c0 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf7b5b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf00d0110 con 0x7f1cf015d5a0 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf7b5b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00d03f0 con 0x7f1cf00b1ec0 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1cf015d1c0 0x7f1cf00d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf50f6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1cf015d5a0 0x7f1cf00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf60f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1cf015d1c0 0x7f1cf00d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39516/0 (socket says 172.21.15.2:39516) 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 -- 172.21.15.2:0/2719163263 learned_addr learned my addr 172.21.15.2:0/2719163263 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 -- 172.21.15.2:0/2719163263 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 msgr2=0x7f1cf00d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 --2- 172.21.15.2:0/2719163263 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 -- 172.21.15.2:0/2719163263 >> v2:172.21.15.90:3300/0 conn(0x7f1cf015d5a0 msgr2=0x7f1cf00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:03.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 --2- 172.21.15.2:0/2719163263 >> v2:172.21.15.90:3300/0 conn(0x7f1cf015d5a0 0x7f1cf00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 -- 172.21.15.2:0/2719163263 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf00d06d0 con 0x7f1cf015d1c0 2023-11-04T01:50:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.910+0000 7f1cf58f7640 1 --2- 172.21.15.2:0/2719163263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d1c0 0x7f1cf00d3ae0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0073c30 tx=0x7f1cec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c1c3e6d34393bb server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf48f5640 1 -- 172.21.15.2:0/2719163263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec0a5700 con 0x7f1cf015d1c0 2023-11-04T01:50:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf48f5640 1 -- 172.21.15.2:0/2719163263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec0a5860 con 0x7f1cf015d1c0 2023-11-04T01:50:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf48f5640 1 -- 172.21.15.2:0/2719163263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec0a5bf0 con 0x7f1cf015d1c0 2023-11-04T01:50:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2719163263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d1c0 msgr2=0x7f1cf00d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2719163263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d1c0 0x7f1cf00d3ae0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0073c30 tx=0x7f1cec01c9a0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2719163263 shutdown_connections 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2719163263 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2719163263 >> v2:172.21.15.90:3300/0 conn(0x7f1cf015d5a0 0x7f1cf00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2719163263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d1c0 0x7f1cf00d3ae0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2719163263 >> 172.21.15.2:0/2719163263 conn(0x7f1cf00d2fc0 msgr2=0x7f1cf00d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2719163263 shutdown_connections 2023-11-04T01:50:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2719163263 wait complete. 2023-11-04T01:50:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 Processor -- start 2023-11-04T01:50:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- start start 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf015d1c0 0x7f1cf00b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d5a0 0x7f1cf01576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00cb700 con 0x7f1cf015d5a0 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00cb9e0 con 0x7f1cf015d1c0 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf00cbcc0 con 0x7f1cf00b1ec0 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d5a0 0x7f1cf01576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d5a0 0x7f1cf01576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39520/0 (socket says 172.21.15.2:39520) 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 -- 172.21.15.2:0/2996105403 learned_addr learned my addr 172.21.15.2:0/2996105403 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf58f7640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf50f6640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf015d1c0 0x7f1cf00b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 -- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 msgr2=0x7f1cf00c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 -- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf015d1c0 msgr2=0x7f1cf00b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf015d1c0 0x7f1cf00b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 -- 172.21.15.2:0/2996105403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec009b30 con 0x7f1cf015d5a0 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf58f7640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf60f8640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d5a0 0x7f1cf01576a0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800e7f0 tx=0x7f1ce800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1ce67fc640 1 -- 172.21.15.2:0/2996105403 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80095d0 con 0x7f1cf015d5a0 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1ce67fc640 1 -- 172.21.15.2:0/2996105403 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce800c940 con 0x7f1cf015d5a0 2023-11-04T01:50:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1ce67fc640 1 -- 172.21.15.2:0/2996105403 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce800ccd0 con 0x7f1cf015d5a0 2023-11-04T01:50:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf00cbfa0 con 0x7f1cf015d5a0 2023-11-04T01:50:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.914+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf00b28e0 con 0x7f1cf015d5a0 2023-11-04T01:50:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.918+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf004e4a0 con 0x7f1cf015d5a0 2023-11-04T01:50:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.918+0000 7f1ce67fc640 1 -- 172.21.15.2:0/2996105403 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ce8013470 con 0x7f1cf015d5a0 2023-11-04T01:50:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.918+0000 7f1ce67fc640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1cd40664a0 0x7f1cd4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.918+0000 7f1ce67fc640 1 -- 172.21.15.2:0/2996105403 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f1ce80848e0 con 0x7f1cf015d5a0 2023-11-04T01:50:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.918+0000 7f1cf58f7640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1cd40664a0 0x7f1cd4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.918+0000 7f1cf58f7640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1cd40664a0 0x7f1cd4068960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0ae000 tx=0x7f1cec0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:03.922+0000 7f1ce67fc640 1 -- 172.21.15.2:0/2996105403 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1ce80514e0 con 0x7f1cf015d5a0 2023-11-04T01:50:04.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.078+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cf00cb840 con 0x7f1cf015d5a0 2023-11-04T01:50:04.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.078+0000 7f1ce67fc640 1 -- 172.21.15.2:0/2996105403 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1cf00cb840 con 0x7f1cf015d5a0 2023-11-04T01:50:04.079 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:50:04.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1cd40664a0 msgr2=0x7f1cd4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1cd40664a0 0x7f1cd4068960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0ae000 tx=0x7f1cec0a7070 comp rx=0 tx=0).stop 2023-11-04T01:50:04.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d5a0 msgr2=0x7f1cf01576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d5a0 0x7f1cf01576a0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800e7f0 tx=0x7f1ce800ecb0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 shutdown_connections 2023-11-04T01:50:04.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f1cd40664a0 0x7f1cd4068960 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf015d5a0 0x7f1cf01576a0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1cf015d1c0 0x7f1cf00b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 --2- 172.21.15.2:0/2996105403 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f1cf00b1ec0 0x7f1cf00c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 >> 172.21.15.2:0/2996105403 conn(0x7f1cf00d2fc0 msgr2=0x7f1cf006c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:04.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 shutdown_connections 2023-11-04T01:50:04.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.082+0000 7f1cf7b5b640 1 -- 172.21.15.2:0/2996105403 wait complete. 2023-11-04T01:50:04.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:50:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca8b6c640 1 Processor -- start 2023-11-04T01:50:04.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca8b6c640 1 -- start start 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca8b6c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5ca40b2bf0 0x7f5ca415d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca8b6c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ca40b1db0 0x7f5ca406c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca8b6c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca4071d10 con 0x7f5ca4159310 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca8b6c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40cb6a0 con 0x7f5ca40b1db0 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca8b6c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40b22e0 con 0x7f5ca40b2bf0 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca2d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ca40b1db0 0x7f5ca406c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca2d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ca40b1db0 0x7f5ca406c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39528/0 (socket says 172.21.15.2:39528) 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/1406327536 learned_addr learned my addr 172.21.15.2:0/1406327536 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5c99d9b640 1 --2- 172.21.15.2:0/1406327536 >> v2:172.21.15.90:3300/0 conn(0x7f5ca40b2bf0 0x7f5ca415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/1406327536 >> v2:172.21.15.90:3300/0 conn(0x7f5ca40b2bf0 msgr2=0x7f5ca415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca2d9d640 1 --2- 172.21.15.2:0/1406327536 >> v2:172.21.15.90:3300/0 conn(0x7f5ca40b2bf0 0x7f5ca415d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/1406327536 >> v1:172.21.15.90:6789/0 conn(0x7f5ca4159310 legacy=0x7f5ca415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.222+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/1406327536 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4071750 con 0x7f5ca40b1db0 2023-11-04T01:50:04.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca2d9d640 1 --2- 172.21.15.2:0/1406327536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca40b1db0 0x7f5ca406c1e0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f5ca406dec0 tx=0x7f5c9c01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f68e1cc5fdd9e8b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca1d9b640 1 -- 172.21.15.2:0/1406327536 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0a7980 con 0x7f5ca40b1db0 2023-11-04T01:50:04.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca1d9b640 1 -- 172.21.15.2:0/1406327536 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0a7ae0 con 0x7f5ca40b1db0 2023-11-04T01:50:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca1d9b640 1 -- 172.21.15.2:0/1406327536 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0a7e70 con 0x7f5ca40b1db0 2023-11-04T01:50:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/1406327536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca40b1db0 msgr2=0x7f5ca406c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/1406327536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca40b1db0 0x7f5ca406c1e0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f5ca406dec0 tx=0x7f5c9c01eb30 comp rx=0 tx=0).stop 2023-11-04T01:50:04.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/1406327536 shutdown_connections 2023-11-04T01:50:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/1406327536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca40b1db0 0x7f5ca406c1e0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/1406327536 >> v2:172.21.15.90:3300/0 conn(0x7f5ca40b2bf0 0x7f5ca415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/1406327536 >> 172.21.15.2:0/1406327536 conn(0x7f5ca40b0790 msgr2=0x7f5ca40b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/1406327536 shutdown_connections 2023-11-04T01:50:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/1406327536 wait complete. 2023-11-04T01:50:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 Processor -- start 2023-11-04T01:50:04.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- start start 2023-11-04T01:50:04.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca40b1db0 0x7f5ca414cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ca40b2bf0 0x7f5ca41f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca4159310 0x7f5ca41f9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca414cb30 con 0x7f5ca4159310 2023-11-04T01:50:04.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca414bf20 con 0x7f5ca40b2bf0 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca8b6c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca414c200 con 0x7f5ca40b1db0 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca4159310 0x7f5ca41f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca4159310 0x7f5ca41f9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39534/0 (socket says 172.21.15.2:39534) 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/2947534439 learned_addr learned my addr 172.21.15.2:0/2947534439 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.226+0000 7f5c99d9b640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ca40b2bf0 0x7f5ca41f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca259c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca40b1db0 0x7f5ca414cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca40b1db0 msgr2=0x7f5ca414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca2d9d640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca40b1db0 0x7f5ca414cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ca40b2bf0 msgr2=0x7f5ca41f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca2d9d640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ca40b2bf0 0x7f5ca41f9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca2d9d640 1 -- 172.21.15.2:0/2947534439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c009b30 con 0x7f5ca4159310 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca2d9d640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca4159310 0x7f5ca41f9650 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0b1040 tx=0x7f5c9c01b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5c9b7fe640 1 -- 172.21.15.2:0/2947534439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0b9430 con 0x7f5ca4159310 2023-11-04T01:50:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5c9b7fe640 1 -- 172.21.15.2:0/2947534439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0b95d0 con 0x7f5ca4159310 2023-11-04T01:50:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5c9b7fe640 1 -- 172.21.15.2:0/2947534439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0b9980 con 0x7f5ca4159310 2023-11-04T01:50:04.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca414c4e0 con 0x7f5ca4159310 2023-11-04T01:50:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca414d500 con 0x7f5ca4159310 2023-11-04T01:50:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca414cca0 con 0x7f5ca4159310 2023-11-04T01:50:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5c9b7fe640 1 -- 172.21.15.2:0/2947534439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c9c0b9ae0 con 0x7f5ca4159310 2023-11-04T01:50:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5c9b7fe640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c840664a0 0x7f5c84068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5c9b7fe640 1 -- 172.21.15.2:0/2947534439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f5c9c11f930 con 0x7f5ca4159310 2023-11-04T01:50:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.230+0000 7f5ca259c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c840664a0 0x7f5c84068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.234+0000 7f5ca259c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c840664a0 0x7f5c84068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5c94007fd0 tx=0x7f5c94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.234+0000 7f5c9b7fe640 1 -- 172.21.15.2:0/2947534439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c9c0ec550 con 0x7f5ca4159310 2023-11-04T01:50:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.390+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f5ca404e4a0 con 0x7f5ca4159310 2023-11-04T01:50:04.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5c9b7fe640 1 -- 172.21.15.2:0/2947534439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v110) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5c9c0efb70 con 0x7f5ca4159310 2023-11-04T01:50:04.393 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c840664a0 msgr2=0x7f5c84068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c840664a0 0x7f5c84068960 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5c94007fd0 tx=0x7f5c94009040 comp rx=0 tx=0).stop 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca4159310 msgr2=0x7f5ca41f9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca4159310 0x7f5ca41f9650 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c0b1040 tx=0x7f5c9c01b8d0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 shutdown_connections 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f5c840664a0 0x7f5c84068960 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ca4159310 0x7f5ca41f9650 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ca40b2bf0 0x7f5ca41f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 --2- 172.21.15.2:0/2947534439 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5ca40b1db0 0x7f5ca414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 >> 172.21.15.2:0/2947534439 conn(0x7f5ca40b0790 msgr2=0x7f5ca414f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:04.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 shutdown_connections 2023-11-04T01:50:04.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.394+0000 7f5ca8b6c640 1 -- 172.21.15.2:0/2947534439 wait complete. 2023-11-04T01:50:04.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:50:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.530+0000 7f25d2f4a640 1 Processor -- start 2023-11-04T01:50:04.533 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d2f4a640 1 -- start start 2023-11-04T01:50:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d2f4a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25cc15d2f0 0x7f25cc0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.534 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d2f4a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc15d6d0 0x7f25cc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d2f4a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc0ad8e0 con 0x7f25cc0cd100 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d2f4a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc0cd590 con 0x7f25cc15d2f0 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d2f4a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0adbc0 con 0x7f25cc15d6d0 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d0ce6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25cc15d2f0 0x7f25cc0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d14e7640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f25cc0cd100 0x7f25cc06fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50760/0 (socket says 172.21.15.2:50760) 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d14e7640 1 -- 172.21.15.2:0/1480905274 learned_addr learned my addr 172.21.15.2:0/1480905274 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25cbfff640 1 --2- 172.21.15.2:0/1480905274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc15d6d0 0x7f25cc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d0ce6640 1 -- 172.21.15.2:0/1480905274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc15d6d0 msgr2=0x7f25cc0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d0ce6640 1 --2- 172.21.15.2:0/1480905274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc15d6d0 0x7f25cc0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d0ce6640 1 -- 172.21.15.2:0/1480905274 >> v1:172.21.15.2:6789/0 conn(0x7f25cc0cd100 legacy=0x7f25cc06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d0ce6640 1 -- 172.21.15.2:0/1480905274 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc0adea0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25cb7fe640 1 -- 172.21.15.2:0/1480905274 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200209657 0 0) 0x7f25cc0ad8e0 con 0x7f25cc0cd100 2023-11-04T01:50:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.534+0000 7f25d0ce6640 1 --2- 172.21.15.2:0/1480905274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0ad2b0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0097c0 tx=0x7f25bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef0b191dc74e1d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cb7fe640 1 -- 172.21.15.2:0/1480905274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0ac640 con 0x7f25cc15d2f0 2023-11-04T01:50:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cb7fe640 1 -- 172.21.15.2:0/1480905274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc0ac7a0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cb7fe640 1 -- 172.21.15.2:0/1480905274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc0acb30 con 0x7f25cc15d2f0 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- 172.21.15.2:0/1480905274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 msgr2=0x7f25cc0ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/1480905274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0ad2b0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0097c0 tx=0x7f25bc01c480 comp rx=0 tx=0).stop 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- 172.21.15.2:0/1480905274 shutdown_connections 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/1480905274 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc15d6d0 0x7f25cc0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/1480905274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0ad2b0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- 172.21.15.2:0/1480905274 >> 172.21.15.2:0/1480905274 conn(0x7f25cc0ced10 msgr2=0x7f25cc0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- 172.21.15.2:0/1480905274 shutdown_connections 2023-11-04T01:50:04.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- 172.21.15.2:0/1480905274 wait complete. 2023-11-04T01:50:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 Processor -- start 2023-11-04T01:50:04.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- start start 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc0cd100 0x7f25cc154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25cc15d6d0 0x7f25cc157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0c6320 con 0x7f25cc15d2f0 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc156520 con 0x7f25cc15d6d0 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d2f4a640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc156800 con 0x7f25cc0cd100 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39564/0 (socket says 172.21.15.2:39564) 2023-11-04T01:50:04.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 -- 172.21.15.2:0/263323277 learned_addr learned my addr 172.21.15.2:0/263323277 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d0ce6640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc0cd100 0x7f25cc154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25d14e7640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25cc15d6d0 0x7f25cc157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 -- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc0cd100 msgr2=0x7f25cc154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc0cd100 0x7f25cc154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 -- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25cc15d6d0 msgr2=0x7f25cc157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25cc15d6d0 0x7f25cc157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 -- 172.21.15.2:0/263323277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009420 con 0x7f25cc15d2f0 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25cbfff640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0c5de0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007e40 tx=0x7f25c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.538+0000 7f25c97fa640 1 -- 172.21.15.2:0/263323277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0014620 con 0x7f25cc15d2f0 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25c97fa640 1 -- 172.21.15.2:0/263323277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c000ee90 con 0x7f25cc15d2f0 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc156ae0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25c97fa640 1 -- 172.21.15.2:0/263323277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c00149c0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1570a0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc04e4a0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25c97fa640 1 -- 172.21.15.2:0/263323277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25c0014b20 con 0x7f25cc15d2f0 2023-11-04T01:50:04.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25c97fa640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25b80664a0 0x7f25b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25c97fa640 1 -- 172.21.15.2:0/263323277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f25c00850a0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25d0ce6640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25b80664a0 0x7f25b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.542+0000 7f25d0ce6640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25b80664a0 0x7f25b8068960 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ae000 tx=0x7f25bc0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.546+0000 7f25c97fa640 1 -- 172.21.15.2:0/263323277 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25c0051c90 con 0x7f25cc15d2f0 2023-11-04T01:50:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.702+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f25cc0b1b20 con 0x7f25cc15d2f0 2023-11-04T01:50:04.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.702+0000 7f25c97fa640 1 -- 172.21.15.2:0/263323277 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v110) v1 ==== 103+0+11 (secure 0 0 0) 0x7f25c00552b0 con 0x7f25cc15d2f0 2023-11-04T01:50:04.705 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25b80664a0 msgr2=0x7f25b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25b80664a0 0x7f25b8068960 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0ae000 tx=0x7f25bc0a7000 comp rx=0 tx=0).stop 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 msgr2=0x7f25cc0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0c5de0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007e40 tx=0x7f25c000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 shutdown_connections 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f25b80664a0 0x7f25b8068960 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25cc15d6d0 0x7f25cc157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25cc15d2f0 0x7f25cc0c5de0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 --2- 172.21.15.2:0/263323277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f25cc0cd100 0x7f25cc154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 >> 172.21.15.2:0/263323277 conn(0x7f25cc0ced10 msgr2=0x7f25cc15c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:04.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 shutdown_connections 2023-11-04T01:50:04.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.706+0000 7f25d2f4a640 1 -- 172.21.15.2:0/263323277 wait complete. 2023-11-04T01:50:04.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:50:04.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c2adaa640 1 Processor -- start 2023-11-04T01:50:04.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c2adaa640 1 -- start start 2023-11-04T01:50:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c2adaa640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 0x7f3c240d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c2adaa640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240d09b0 con 0x7f3c2415d1c0 2023-11-04T01:50:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c2adaa640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240d0110 con 0x7f3c2415d5a0 2023-11-04T01:50:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c2adaa640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240d03f0 con 0x7f3c240d1cb0 2023-11-04T01:50:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c28b46640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c2415d1c0 0x7f3c240d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50764/0 (socket says 172.21.15.2:50764) 2023-11-04T01:50:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c28b46640 1 -- 172.21.15.2:0/568971333 learned_addr learned my addr 172.21.15.2:0/568971333 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c23fff640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 0x7f3c240d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378831063 0 0) 0x7f3c240d09b0 con 0x7f3c2415d1c0 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c0c003530 con 0x7f3c2415d1c0 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924249674 0 0) 0x7f3c0c003530 con 0x7f3c2415d1c0 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 msgr2=0x7f3c240d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 0x7f3c240d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 >> v1:172.21.15.90:6789/0 conn(0x7f3c2415d5a0 legacy=0x7f3c240b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240d06d0 con 0x7f3c2415d1c0 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f3c14001680 con 0x7f3c2415d1c0 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 >> v1:172.21.15.2:6789/0 conn(0x7f3c2415d1c0 legacy=0x7f3c240d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 0x7f3c0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 0x7f3c0c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240d03f0 con 0x7f3c0c0047d0 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c00ba40 con 0x7f3c0c0039b0 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c00bc00 con 0x7f3c240d1cb0 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c23fff640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c29347640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 0x7f3c0c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c28b46640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 0x7f3c0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c23fff640 1 -- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 msgr2=0x7f3c0c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c23fff640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 0x7f3c0c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c23fff640 1 -- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 msgr2=0x7f3c0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c23fff640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c0c0039b0 0x7f3c0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c23fff640 1 -- 172.21.15.2:0/568971333 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c003530 con 0x7f3c0c0047d0 2023-11-04T01:50:04.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.846+0000 7f3c29347640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c240d1cb0 0x7f3c0c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:04.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c23fff640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c0c004c50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009ab0 tx=0x7f3c1801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980867063f2882df server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180a6500 con 0x7f3c0c0047d0 2023-11-04T01:50:04.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c180a6660 con 0x7f3c0c0047d0 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c237fe640 1 -- 172.21.15.2:0/568971333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180a6a10 con 0x7f3c0c0047d0 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 -- 172.21.15.2:0/568971333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 msgr2=0x7f3c0c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 --2- 172.21.15.2:0/568971333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c0c004c50 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009ab0 tx=0x7f3c1801ca10 comp rx=0 tx=0).stop 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c29347640 1 -- 172.21.15.2:0/568971333 reap_dead start 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 -- 172.21.15.2:0/568971333 shutdown_connections 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 -- 172.21.15.2:0/568971333 >> 172.21.15.2:0/568971333 conn(0x7f3c240d2fc0 msgr2=0x7f3c240d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 -- 172.21.15.2:0/568971333 shutdown_connections 2023-11-04T01:50:04.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 -- 172.21.15.2:0/568971333 wait complete. 2023-11-04T01:50:04.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 Processor -- start 2023-11-04T01:50:04.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.850+0000 7f3c2adaa640 1 -- start start 2023-11-04T01:50:04.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c240b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241f3680 0x7f3c240ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240cc030 0x7f3c240cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240cc9f0 con 0x7f3c0c0047d0 2023-11-04T01:50:04.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240cb510 con 0x7f3c240cc030 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ca990 con 0x7f3c241f3680 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c240b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c240b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39578/0 (socket says 172.21.15.2:39578) 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 -- 172.21.15.2:0/1841618871 learned_addr learned my addr 172.21.15.2:0/1841618871 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c23fff640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241f3680 0x7f3c240ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c29347640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240cc030 0x7f3c240cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 -- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241f3680 msgr2=0x7f3c240ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241f3680 0x7f3c240ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 -- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240cc030 msgr2=0x7f3c240cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240cc030 0x7f3c240cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 -- 172.21.15.2:0/1841618871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240cac70 con 0x7f3c0c0047d0 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c23fff640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241f3680 0x7f3c240ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c28b46640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c240b3f50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f3c14011900 tx=0x7f3c14011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c217fa640 1 -- 172.21.15.2:0/1841618871 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400fb60 con 0x7f3c0c0047d0 2023-11-04T01:50:04.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c217fa640 1 -- 172.21.15.2:0/1841618871 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1400fce0 con 0x7f3c0c0047d0 2023-11-04T01:50:04.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c240caf50 con 0x7f3c0c0047d0 2023-11-04T01:50:04.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c217fa640 1 -- 172.21.15.2:0/1841618871 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14015650 con 0x7f3c0c0047d0 2023-11-04T01:50:04.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240b4490 con 0x7f3c0c0047d0 2023-11-04T01:50:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c240b2280 con 0x7f3c0c0047d0 2023-11-04T01:50:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c217fa640 1 -- 172.21.15.2:0/1841618871 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3c140157b0 con 0x7f3c0c0047d0 2023-11-04T01:50:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c217fa640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c217fa640 1 -- 172.21.15.2:0/1841618871 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f3c140883a0 con 0x7f3c0c0047d0 2023-11-04T01:50:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.854+0000 7f3c23fff640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:04.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.858+0000 7f3c23fff640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3c180af000 tx=0x7f3c180046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:04.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:04.858+0000 7f3c217fa640 1 -- 172.21.15.2:0/1841618871 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3c14058b10 con 0x7f3c0c0047d0 2023-11-04T01:50:05.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.010+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f3c240b2280 con 0x7f3c0c0047d0 2023-11-04T01:50:05.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.010+0000 7f3c217fa640 1 -- 172.21.15.2:0/1841618871 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v110) v1 ==== 107+0+11 (secure 0 0 0) 0x7f3c240b2280 con 0x7f3c0c0047d0 2023-11-04T01:50:05.011 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:05.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 msgr2=0x7f3c10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.013 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3c180af000 tx=0x7f3c180046d0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 msgr2=0x7f3c240b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c240b3f50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f3c14011900 tx=0x7f3c14011dc0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 shutdown_connections 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f3c100664a0 0x7f3c10068960 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c240cc030 0x7f3c240cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f3c241f3680 0x7f3c240ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 --2- 172.21.15.2:0/1841618871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0047d0 0x7f3c240b3f50 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 >> 172.21.15.2:0/1841618871 conn(0x7f3c240d2fc0 msgr2=0x7f3c241601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 shutdown_connections 2023-11-04T01:50:05.014 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.014+0000 7f3c2adaa640 1 -- 172.21.15.2:0/1841618871 wait complete. 2023-11-04T01:50:05.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:50:05.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c4b5fc640 1 Processor -- start 2023-11-04T01:50:05.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c4b5fc640 1 -- start start 2023-11-04T01:50:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c4b5fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2c4415b120 0x7f2c440d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c4b5fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2c440b2fb0 0x7f2c440b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c4b5fc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4415eca0 con 0x7f2c440cff30 2023-11-04T01:50:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c4b5fc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4415ef80 con 0x7f2c4415b120 2023-11-04T01:50:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c4b5fc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4415f260 con 0x7f2c440b2fb0 2023-11-04T01:50:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c49398640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2c4415b120 0x7f2c440d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c48b97640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2c440cff30 0x7f2c440b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50780/0 (socket says 172.21.15.2:50780) 2023-11-04T01:50:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c48b97640 1 -- 172.21.15.2:0/3977568140 learned_addr learned my addr 172.21.15.2:0/3977568140 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c49b99640 1 --2- 172.21.15.2:0/3977568140 >> v2:172.21.15.90:3300/0 conn(0x7f2c440b2fb0 0x7f2c440b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c49398640 1 -- 172.21.15.2:0/3977568140 >> v2:172.21.15.90:3300/0 conn(0x7f2c440b2fb0 msgr2=0x7f2c440b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c49398640 1 --2- 172.21.15.2:0/3977568140 >> v2:172.21.15.90:3300/0 conn(0x7f2c440b2fb0 0x7f2c440b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c49398640 1 -- 172.21.15.2:0/3977568140 >> v1:172.21.15.2:6789/0 conn(0x7f2c440cff30 legacy=0x7f2c440b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c49398640 1 -- 172.21.15.2:0/3977568140 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4415f540 con 0x7f2c4415b120 2023-11-04T01:50:05.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.158+0000 7f2c3bfff640 1 -- 172.21.15.2:0/3977568140 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616881438 0 0) 0x7f2c4415eca0 con 0x7f2c440cff30 2023-11-04T01:50:05.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c49398640 1 --2- 172.21.15.2:0/3977568140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c4415b120 0x7f2c440d0790 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f2c44073c10 tx=0x7f2c4001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3203dcbdef13bf86 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c3bfff640 1 -- 172.21.15.2:0/3977568140 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400ab680 con 0x7f2c4415b120 2023-11-04T01:50:05.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c3bfff640 1 -- 172.21.15.2:0/3977568140 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400ab7e0 con 0x7f2c4415b120 2023-11-04T01:50:05.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c3bfff640 1 -- 172.21.15.2:0/3977568140 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400abb70 con 0x7f2c4415b120 2023-11-04T01:50:05.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/3977568140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c4415b120 msgr2=0x7f2c440d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/3977568140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c4415b120 0x7f2c440d0790 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f2c44073c10 tx=0x7f2c4001c460 comp rx=0 tx=0).stop 2023-11-04T01:50:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/3977568140 shutdown_connections 2023-11-04T01:50:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/3977568140 >> v2:172.21.15.90:3300/0 conn(0x7f2c440b2fb0 0x7f2c440b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/3977568140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c4415b120 0x7f2c440d0790 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/3977568140 >> 172.21.15.2:0/3977568140 conn(0x7f2c440cd8a0 msgr2=0x7f2c440cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/3977568140 shutdown_connections 2023-11-04T01:50:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/3977568140 wait complete. 2023-11-04T01:50:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 Processor -- start 2023-11-04T01:50:05.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- start start 2023-11-04T01:50:05.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c440b2fb0 0x7f2c4415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c440cff30 0x7f2c44149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c4415b120 0x7f2c441f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440c29f0 con 0x7f2c440cff30 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440c2cd0 con 0x7f2c440b2fb0 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c4b5fc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440c2fb0 con 0x7f2c4415b120 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c48b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c440cff30 0x7f2c44149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c48b97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c440cff30 0x7f2c44149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39594/0 (socket says 172.21.15.2:39594) 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.162+0000 7f2c48b97640 1 -- 172.21.15.2:0/2002649735 learned_addr learned my addr 172.21.15.2:0/2002649735 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c49398640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c440b2fb0 0x7f2c4415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c49b99640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c4415b120 0x7f2c441f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c48b97640 1 -- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c4415b120 msgr2=0x7f2c441f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c48b97640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c4415b120 0x7f2c441f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c48b97640 1 -- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c440b2fb0 msgr2=0x7f2c4415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c48b97640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c440b2fb0 0x7f2c4415be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c48b97640 1 -- 172.21.15.2:0/2002649735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009420 con 0x7f2c440cff30 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c49b99640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c4415b120 0x7f2c441f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c49398640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c440b2fb0 0x7f2c4415be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c48b97640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c440cff30 0x7f2c44149230 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f2c340011f0 tx=0x7f2c3400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c39ffb640 1 -- 172.21.15.2:0/2002649735 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340074e0 con 0x7f2c440cff30 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c39ffb640 1 -- 172.21.15.2:0/2002649735 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c34007640 con 0x7f2c440cff30 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c39ffb640 1 -- 172.21.15.2:0/2002649735 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c34004a10 con 0x7f2c440cff30 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c440c3290 con 0x7f2c440cff30 2023-11-04T01:50:05.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c440c2680 con 0x7f2c440cff30 2023-11-04T01:50:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c440b5d00 con 0x7f2c440cff30 2023-11-04T01:50:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c39ffb640 1 -- 172.21.15.2:0/2002649735 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c34004b70 con 0x7f2c440cff30 2023-11-04T01:50:05.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c39ffb640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2c280664d0 0x7f2c28068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c39ffb640 1 -- 172.21.15.2:0/2002649735 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f2c34083940 con 0x7f2c440cff30 2023-11-04T01:50:05.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.166+0000 7f2c49398640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2c280664d0 0x7f2c28068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.170+0000 7f2c49398640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2c280664d0 0x7f2c28068990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2c400af000 tx=0x7f2c40008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.170+0000 7f2c39ffb640 1 -- 172.21.15.2:0/2002649735 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2c340504a0 con 0x7f2c440cff30 2023-11-04T01:50:05.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.322+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c440cfb00 con 0x7f2c440cff30 2023-11-04T01:50:05.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.322+0000 7f2c39ffb640 1 -- 172.21.15.2:0/2002649735 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c34018020 con 0x7f2c440cff30 2023-11-04T01:50:05.325 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2c280664d0 msgr2=0x7f2c28068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2c280664d0 0x7f2c28068990 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2c400af000 tx=0x7f2c40008040 comp rx=0 tx=0).stop 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c440cff30 msgr2=0x7f2c44149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c440cff30 0x7f2c44149230 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f2c340011f0 tx=0x7f2c3400c9b0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 shutdown_connections 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f2c280664d0 0x7f2c28068990 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2c4415b120 0x7f2c441f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c440cff30 0x7f2c44149230 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 --2- 172.21.15.2:0/2002649735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c440b2fb0 0x7f2c4415be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 >> 172.21.15.2:0/2002649735 conn(0x7f2c440cd8a0 msgr2=0x7f2c44156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:05.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 shutdown_connections 2023-11-04T01:50:05.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.326+0000 7f2c4b5fc640 1 -- 172.21.15.2:0/2002649735 wait complete. 2023-11-04T01:50:05.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:50:05.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c3a10640 1 Processor -- start 2023-11-04T01:50:05.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c3a10640 1 -- start start 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c3a10640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc1556c0 0x7f04bc15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c3a10640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04bc0cb050 0x7f04bc0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c3a10640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc15c600 con 0x7f04bc0cabd0 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c3a10640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc0cb4e0 con 0x7f04bc0cb050 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c3a10640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc06fe50 con 0x7f04bc1556c0 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c1fad640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04bc0cb050 0x7f04bc0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c1fad640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f04bc0cb050 0x7f04bc0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39606/0 (socket says 172.21.15.2:39606) 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c1fad640 1 -- 172.21.15.2:0/2932269042 learned_addr learned my addr 172.21.15.2:0/2932269042 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c17ac640 1 --2- 172.21.15.2:0/2932269042 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc1556c0 0x7f04bc15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c1fad640 1 -- 172.21.15.2:0/2932269042 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc1556c0 msgr2=0x7f04bc15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:05.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c1fad640 1 --2- 172.21.15.2:0/2932269042 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc1556c0 0x7f04bc15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c1fad640 1 -- 172.21.15.2:0/2932269042 >> v1:172.21.15.90:6789/0 conn(0x7f04bc0cabd0 legacy=0x7f04bc0c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:05.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.458+0000 7f04c1fad640 1 -- 172.21.15.2:0/2932269042 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0ae7f0 con 0x7f04bc0cb050 2023-11-04T01:50:05.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c1fad640 1 --2- 172.21.15.2:0/2932269042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc0cb050 0x7f04bc0c9a70 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009870 tx=0x7f04ac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89d0ecbbbfb7587 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04bbfff640 1 -- 172.21.15.2:0/2932269042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0aa670 con 0x7f04bc0cb050 2023-11-04T01:50:05.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04bbfff640 1 -- 172.21.15.2:0/2932269042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac0aa7d0 con 0x7f04bc0cb050 2023-11-04T01:50:05.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04bbfff640 1 -- 172.21.15.2:0/2932269042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0aab60 con 0x7f04bc0cb050 2023-11-04T01:50:05.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- 172.21.15.2:0/2932269042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc0cb050 msgr2=0x7f04bc0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 --2- 172.21.15.2:0/2932269042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc0cb050 0x7f04bc0c9a70 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009870 tx=0x7f04ac01c510 comp rx=0 tx=0).stop 2023-11-04T01:50:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- 172.21.15.2:0/2932269042 shutdown_connections 2023-11-04T01:50:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 --2- 172.21.15.2:0/2932269042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc0cb050 0x7f04bc0c9a70 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 --2- 172.21.15.2:0/2932269042 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc1556c0 0x7f04bc15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- 172.21.15.2:0/2932269042 >> 172.21.15.2:0/2932269042 conn(0x7f04bc0ced10 msgr2=0x7f04bc0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- 172.21.15.2:0/2932269042 shutdown_connections 2023-11-04T01:50:05.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- 172.21.15.2:0/2932269042 wait complete. 2023-11-04T01:50:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 Processor -- start 2023-11-04T01:50:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- start start 2023-11-04T01:50:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc0cabd0 0x7f04bc1494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04bc0cb050 0x7f04bc14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc1556c0 0x7f04bc14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc1531e0 con 0x7f04bc1556c0 2023-11-04T01:50:05.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc149a30 con 0x7f04bc0cb050 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c3a10640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc154e30 con 0x7f04bc0cabd0 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c1fad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc1556c0 0x7f04bc14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c1fad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc1556c0 0x7f04bc14c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39616/0 (socket says 172.21.15.2:39616) 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c1fad640 1 -- 172.21.15.2:0/4195526277 learned_addr learned my addr 172.21.15.2:0/4195526277 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c17ac640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc0cabd0 0x7f04bc1494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.462+0000 7f04c0fab640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04bc0cb050 0x7f04bc14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c1fad640 1 -- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc0cabd0 msgr2=0x7f04bc1494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c1fad640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc0cabd0 0x7f04bc1494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c1fad640 1 -- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04bc0cb050 msgr2=0x7f04bc14bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c1fad640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04bc0cb050 0x7f04bc14bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c1fad640 1 -- 172.21.15.2:0/4195526277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0094d0 con 0x7f04bc1556c0 2023-11-04T01:50:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c1fad640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc1556c0 0x7f04bc14c400 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f04ac01a140 tx=0x7f04ac01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04b9ffb640 1 -- 172.21.15.2:0/4195526277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0b3800 con 0x7f04bc1556c0 2023-11-04T01:50:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc1528b0 con 0x7f04bc1556c0 2023-11-04T01:50:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04b9ffb640 1 -- 172.21.15.2:0/4195526277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac0b3960 con 0x7f04bc1556c0 2023-11-04T01:50:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04b9ffb640 1 -- 172.21.15.2:0/4195526277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0b3d10 con 0x7f04bc1556c0 2023-11-04T01:50:05.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc152e70 con 0x7f04bc1556c0 2023-11-04T01:50:05.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc153390 con 0x7f04bc1556c0 2023-11-04T01:50:05.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04b9ffb640 1 -- 172.21.15.2:0/4195526277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f04ac0b2380 con 0x7f04bc1556c0 2023-11-04T01:50:05.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04b9ffb640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a80664d0 0x7f04a8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04b9ffb640 1 -- 172.21.15.2:0/4195526277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f04ac11ef40 con 0x7f04bc1556c0 2023-11-04T01:50:05.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c17ac640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a80664d0 0x7f04a8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.468 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.466+0000 7f04c17ac640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a80664d0 0x7f04a8068990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f04b4003b90 tx=0x7f04b40098d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.470+0000 7f04b9ffb640 1 -- 172.21.15.2:0/4195526277 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f04bc153390 con 0x7f04bc1556c0 2023-11-04T01:50:05.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.618+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04bc153390 con 0x7f04bc1556c0 2023-11-04T01:50:05.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.618+0000 7f04b9ffb640 1 -- 172.21.15.2:0/4195526277 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04bc153390 con 0x7f04bc1556c0 2023-11-04T01:50:05.621 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:50:05.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a80664d0 msgr2=0x7f04a8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a80664d0 0x7f04a8068990 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f04b4003b90 tx=0x7f04b40098d0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc1556c0 msgr2=0x7f04bc14c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc1556c0 0x7f04bc14c400 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f04ac01a140 tx=0x7f04ac01ad50 comp rx=0 tx=0).stop 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 shutdown_connections 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f04a80664d0 0x7f04a8068990 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04bc1556c0 0x7f04bc14c400 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04bc0cb050 0x7f04bc14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 --2- 172.21.15.2:0/4195526277 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f04bc0cabd0 0x7f04bc1494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 >> 172.21.15.2:0/4195526277 conn(0x7f04bc0ced10 msgr2=0x7f04bc0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 shutdown_connections 2023-11-04T01:50:05.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.622+0000 7f04c3a10640 1 -- 172.21.15.2:0/4195526277 wait complete. 2023-11-04T01:50:05.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:50:05.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe583c53640 1 Processor -- start 2023-11-04T01:50:05.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe583c53640 1 -- start start 2023-11-04T01:50:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe583c53640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c15d310 0x7fe57c160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe583c53640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c0b3be0 con 0x7fe57c0b4bc0 2023-11-04T01:50:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe583c53640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c0b38b0 con 0x7fe57c0b4070 2023-11-04T01:50:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe583c53640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c1614f0 con 0x7fe57c15d310 2023-11-04T01:50:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5811ee640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe57c0b4bc0 0x7fe57c06cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50788/0 (socket says 172.21.15.2:50788) 2023-11-04T01:50:05.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5811ee640 1 -- 172.21.15.2:0/1689853748 learned_addr learned my addr 172.21.15.2:0/1689853748 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5819ef640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c15d310 0x7fe57c160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700016141 0 0) 0x7fe57c0b3be0 con 0x7fe57c0b4bc0 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe568003530 con 0x7fe57c0b4bc0 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 145382315 0 0) 0x7fe568003530 con 0x7fe57c0b4bc0 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c15d310 msgr2=0x7fe57c160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c15d310 0x7fe57c160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 >> v1:172.21.15.90:6789/0 conn(0x7fe57c0b4070 legacy=0x7fe57c06a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c161790 con 0x7fe57c0b4bc0 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fe56c001680 con 0x7fe57c0b4bc0 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 >> v1:172.21.15.2:6789/0 conn(0x7fe57c0b4bc0 legacy=0x7fe57c06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe568003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5680047d0 0x7fe568004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c15d310 0x7fe5680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c1614f0 con 0x7fe5680039b0 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56800bac0 con 0x7fe5680047d0 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56800bc80 con 0x7fe57c15d310 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5819ef640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe568003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5819ef640 1 -- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c15d310 msgr2=0x7fe5680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5819ef640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c15d310 0x7fe5680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5811ee640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5680047d0 0x7fe568004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5819ef640 1 -- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5680047d0 msgr2=0x7fe568004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5819ef640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5680047d0 0x7fe568004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5819ef640 1 -- 172.21.15.2:0/1689853748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568003530 con 0x7fe5680039b0 2023-11-04T01:50:05.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.754+0000 7fe5811ee640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5680047d0 0x7fe568004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe5819ef640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe568003dd0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe574009ae0 tx=0x7fe57401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea88bcedc452100 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740a5540 con 0x7fe5680039b0 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740a56a0 con 0x7fe5680039b0 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe5809ed640 1 -- 172.21.15.2:0/1689853748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740a5a50 con 0x7fe5680039b0 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- 172.21.15.2:0/1689853748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 msgr2=0x7fe568003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 --2- 172.21.15.2:0/1689853748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe568003dd0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe574009ae0 tx=0x7fe57401ca60 comp rx=0 tx=0).stop 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe5821f0640 1 -- 172.21.15.2:0/1689853748 reap_dead start 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- 172.21.15.2:0/1689853748 shutdown_connections 2023-11-04T01:50:05.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- 172.21.15.2:0/1689853748 >> 172.21.15.2:0/1689853748 conn(0x7fe57c0b18a0 msgr2=0x7fe57c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:05.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- 172.21.15.2:0/1689853748 shutdown_connections 2023-11-04T01:50:05.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- 172.21.15.2:0/1689853748 wait complete. 2023-11-04T01:50:05.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 Processor -- start 2023-11-04T01:50:05.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- start start 2023-11-04T01:50:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe57c153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c0cd2b0 0x7fe57c0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe57c0ce470 0x7fe57c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0ce9f0 con 0x7fe5680039b0 2023-11-04T01:50:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0cc7d0 con 0x7fe57c0ce470 2023-11-04T01:50:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe583c53640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0ccab0 con 0x7fe57c0cd2b0 2023-11-04T01:50:05.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.758+0000 7fe5819ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe57c153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe57c153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39634/0 (socket says 172.21.15.2:39634) 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 -- 172.21.15.2:0/2626779064 learned_addr learned my addr 172.21.15.2:0/2626779064 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5821f0640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe57c0ce470 0x7fe57c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5811ee640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c0cd2b0 0x7fe57c0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 -- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c0cd2b0 msgr2=0x7fe57c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c0cd2b0 0x7fe57c0cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 -- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe57c0ce470 msgr2=0x7fe57c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe57c0ce470 0x7fe57c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 -- 172.21.15.2:0/2626779064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0ccd90 con 0x7fe5680039b0 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5819ef640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe57c153300 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe574009ae0 tx=0x7fe568005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5727fc640 1 -- 172.21.15.2:0/2626779064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740a5e30 con 0x7fe5680039b0 2023-11-04T01:50:05.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5727fc640 1 -- 172.21.15.2:0/2626779064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574004020 con 0x7fe5680039b0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c0cecd0 con 0x7fe5680039b0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5727fc640 1 -- 172.21.15.2:0/2626779064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740043d0 con 0x7fe5680039b0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c1559b0 con 0x7fe5680039b0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c0ccf20 con 0x7fe5680039b0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5727fc640 1 -- 172.21.15.2:0/2626779064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5740b4040 con 0x7fe5680039b0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5727fc640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5600664a0 0x7fe560068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5727fc640 1 -- 172.21.15.2:0/2626779064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7fe57411e690 con 0x7fe5680039b0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5811ee640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5600664a0 0x7fe560068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:05.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.762+0000 7fe5811ee640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5600664a0 0x7fe560068960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe56c001ec0 tx=0x7fe56c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:05.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.766+0000 7fe5727fc640 1 -- 172.21.15.2:0/2626779064 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5740eb4f0 con 0x7fe5680039b0 2023-11-04T01:50:05.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.926+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe57c0b3180 con 0x7fe5680039b0 2023-11-04T01:50:05.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe5727fc640 1 -- 172.21.15.2:0/2626779064 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v110) v1 ==== 81+0+1373 (secure 0 0 0) 0x7fe5740eeb10 con 0x7fe5680039b0 2023-11-04T01:50:05.929 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/4169282097 2023-11-04T02:50:00.880111+0000 2023-11-04T01:50:05.929 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/3695355178 2023-11-05T01:49:53.201635+0000 2023-11-04T01:50:05.929 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2988241810 2023-11-04T02:49:10.916906+0000 2023-11-04T01:50:05.929 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:50:05.929 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/2449846925 2023-11-05T01:49:45.775757+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:50:05.930 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:50:05.931 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/3695355178 2023-11-05T01:49:53.201635+0000 2023-11-04T01:50:05.931 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:50:05.931 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:50:05.931 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/2449846925 2023-11-05T01:49:45.775757+0000 2023-11-04T01:50:05.931 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2023608941 2023-11-04T02:48:20.721790+0000 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:listed 23 entries 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5600664a0 msgr2=0x7fe560068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5600664a0 0x7fe560068960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe56c001ec0 tx=0x7fe56c009040 comp rx=0 tx=0).stop 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 msgr2=0x7fe57c153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe57c153300 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe574009ae0 tx=0x7fe568005800 comp rx=0 tx=0).stop 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 shutdown_connections 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe5600664a0 0x7fe560068960 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe57c0ce470 0x7fe57c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe57c0cd2b0 0x7fe57c0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 --2- 172.21.15.2:0/2626779064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe5680039b0 0x7fe57c153300 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:05.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 >> 172.21.15.2:0/2626779064 conn(0x7fe57c0b18a0 msgr2=0x7fe57c0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:05.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 shutdown_connections 2023-11-04T01:50:05.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:05.930+0000 7fe583c53640 1 -- 172.21.15.2:0/2626779064 wait complete. 2023-11-04T01:50:05.946 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:50:05.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:05.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:05.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[59155]: fuse finished with error 0 and tester_r 0 2023-11-04T01:50:05.957 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:50:05.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:05.957 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:50:06.006 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:50:06.006 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:06.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:50:06.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-04T01:50:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08da066640 1 Processor -- start 2023-11-04T01:50:06.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08da066640 1 -- start start 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08da066640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08d40c92b0 0x7f08d40cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08da066640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08d406c1c0 0x7f08d41442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08da066640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d40c9ac0 con 0x7f08d406bde0 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08da066640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d40caf20 con 0x7f08d406c1c0 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08da066640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d40c97e0 con 0x7f08d40c92b0 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f08d406c1c0 0x7f08d41442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f08d406bde0 0x7f08d415c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50804/0 (socket says 172.21.15.2:50804) 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d37fe640 1 -- 172.21.15.2:0/1748526928 learned_addr learned my addr 172.21.15.2:0/1748526928 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:06.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d2ffd640 1 --2- 172.21.15.2:0/1748526928 >> v2:172.21.15.90:3300/0 conn(0x7f08d40c92b0 0x7f08d40cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d3fff640 1 -- 172.21.15.2:0/1748526928 >> v2:172.21.15.90:3300/0 conn(0x7f08d40c92b0 msgr2=0x7f08d40cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d3fff640 1 --2- 172.21.15.2:0/1748526928 >> v2:172.21.15.90:3300/0 conn(0x7f08d40c92b0 0x7f08d40cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d3fff640 1 -- 172.21.15.2:0/1748526928 >> v1:172.21.15.2:6789/0 conn(0x7f08d406bde0 legacy=0x7f08d415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:06.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.222+0000 7f08d3fff640 1 -- 172.21.15.2:0/1748526928 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40cb1c0 con 0x7f08d406c1c0 2023-11-04T01:50:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08d3fff640 1 --2- 172.21.15.2:0/1748526928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406c1c0 0x7f08d41442b0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f08d406dfc0 tx=0x7f08cc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a1422331776a17 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08d27fc640 1 -- 172.21.15.2:0/1748526928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0a58c0 con 0x7f08d406c1c0 2023-11-04T01:50:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08d27fc640 1 -- 172.21.15.2:0/1748526928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc0a5a20 con 0x7f08d406c1c0 2023-11-04T01:50:06.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08d27fc640 1 -- 172.21.15.2:0/1748526928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0a5db0 con 0x7f08d406c1c0 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 -- 172.21.15.2:0/1748526928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406c1c0 msgr2=0x7f08d41442b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 --2- 172.21.15.2:0/1748526928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406c1c0 0x7f08d41442b0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f08d406dfc0 tx=0x7f08cc01c910 comp rx=0 tx=0).stop 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 -- 172.21.15.2:0/1748526928 shutdown_connections 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 --2- 172.21.15.2:0/1748526928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406c1c0 0x7f08d41442b0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 --2- 172.21.15.2:0/1748526928 >> v2:172.21.15.90:3300/0 conn(0x7f08d40c92b0 0x7f08d40cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 -- 172.21.15.2:0/1748526928 >> 172.21.15.2:0/1748526928 conn(0x7f08d40b0890 msgr2=0x7f08d40b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 -- 172.21.15.2:0/1748526928 shutdown_connections 2023-11-04T01:50:06.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 -- 172.21.15.2:0/1748526928 wait complete. 2023-11-04T01:50:06.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 Processor -- start 2023-11-04T01:50:06.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 -- start start 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.226+0000 7f08da066640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406bde0 0x7f08d40c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08d406c1c0 0x7f08d415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d40c92b0 0x7f08d413c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d41f7510 con 0x7f08d406bde0 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d413cc00 con 0x7f08d40c92b0 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40c6310 con 0x7f08d406c1c0 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406bde0 0x7f08d40c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406bde0 0x7f08d40c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39660/0 (socket says 172.21.15.2:39660) 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 -- 172.21.15.2:0/1140991789 learned_addr learned my addr 172.21.15.2:0/1140991789 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d2ffd640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08d406c1c0 0x7f08d415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:06.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d3fff640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d40c92b0 0x7f08d413c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 -- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08d406c1c0 msgr2=0x7f08d415a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08d406c1c0 0x7f08d415a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 -- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d40c92b0 msgr2=0x7f08d413c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d40c92b0 0x7f08d413c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 -- 172.21.15.2:0/1140991789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc009a70 con 0x7f08d406bde0 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d2ffd640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08d406c1c0 0x7f08d415a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d37fe640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406bde0 0x7f08d40c5d30 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f08c400c500 tx=0x7f08c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08bbfff640 1 -- 172.21.15.2:0/1140991789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4005cf0 con 0x7f08d406bde0 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08bbfff640 1 -- 172.21.15.2:0/1140991789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c4005e50 con 0x7f08d406bde0 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d40c65f0 con 0x7f08d406bde0 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08bbfff640 1 -- 172.21.15.2:0/1140991789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c40072f0 con 0x7f08d406bde0 2023-11-04T01:50:06.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d41f7760 con 0x7f08d406bde0 2023-11-04T01:50:06.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d40c6b10 con 0x7f08d406bde0 2023-11-04T01:50:06.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08bbfff640 1 -- 172.21.15.2:0/1140991789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f08c4007450 con 0x7f08d406bde0 2023-11-04T01:50:06.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08bbfff640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08c00664a0 0x7f08c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:06.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08bbfff640 1 -- 172.21.15.2:0/1140991789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f08c4083b10 con 0x7f08d406bde0 2023-11-04T01:50:06.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.230+0000 7f08d2ffd640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08c00664a0 0x7f08c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:06.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.234+0000 7f08d2ffd640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08c00664a0 0x7f08c0068960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f08d41f7470 tx=0x7f08c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:06.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.234+0000 7f08bbfff640 1 -- 172.21.15.2:0/1140991789 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f08c4050850 con 0x7f08d406bde0 2023-11-04T01:50:06.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f08d404e4a0 con 0x7f08d406bde0 2023-11-04T01:50:06.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08bbfff640 1 -- 172.21.15.2:0/1140991789 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v118) v1 ==== 53+0+73 (secure 0 0 0) 0x7f08c4017070 con 0x7f08d406bde0 2023-11-04T01:50:06.426 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-04T01:50:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08c00664a0 msgr2=0x7f08c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08c00664a0 0x7f08c0068960 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f08d41f7470 tx=0x7f08c8008040 comp rx=0 tx=0).stop 2023-11-04T01:50:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406bde0 msgr2=0x7f08d40c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406bde0 0x7f08d40c5d30 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f08c400c500 tx=0x7f08c400c9c0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 shutdown_connections 2023-11-04T01:50:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f08c00664a0 0x7f08c0068960 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08d40c92b0 0x7f08d413c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f08d406c1c0 0x7f08d415a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 --2- 172.21.15.2:0/1140991789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f08d406bde0 0x7f08d40c5d30 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 >> 172.21.15.2:0/1140991789 conn(0x7f08d40b0890 msgr2=0x7f08d40b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 shutdown_connections 2023-11-04T01:50:06.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:06.426+0000 7f08da066640 1 -- 172.21.15.2:0/1140991789 wait complete. 2023-11-04T01:50:06.443 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-04T01:50:06.443 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-04T01:50:06.443 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-04T01:50:06.443 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-04T01:50:06.443 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:06.443 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-04T01:50:06.444 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-04T01:50:06.444 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-04T01:50:06.444 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:50:06.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.444 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-04T01:50:06.450 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-04T01:50:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-04T01:50:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-04T01:50:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-04T01:50:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41738sec preferred_lft 41738sec 2023-11-04T01:50:06.451 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 02:42:ec:08:03:70 brd ff:ff:ff:ff:ff:ff 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-04T01:50:06.452 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-04T01:50:06.453 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-04T01:50:06.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.454 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-04T01:50:06.503 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-04T01:50:06.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.505 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-04T01:50:06.555 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-04T01:50:06.555 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-04T01:50:06.555 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-04T01:50:06.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-04T01:50:06.555 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-04T01:50:06.555 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-04T01:50:06.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.556 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-04T01:50:06.556 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-04T01:50:06.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-04T01:50:06.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-04T01:50:06.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-04T01:50:06.556 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-04T01:50:06.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.633 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:50:06.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:50:06.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:50:06.682 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:50:06.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-04T01:50:06.739 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-04T01:50:06.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:50:06.739 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:06.786 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:50:06.786 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-04T01:50:06.786 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:06.834 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:50:06.884 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:50:06.885 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:50:06.886 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:50:06.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.887 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:50:06.933 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-04T01:50:06.934 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-04T01:50:06.978 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:50:06.979 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:50:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:50:06.985 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:50:06.985 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:50:06.985 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:50:06.985 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:50:06.985 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:50:06.986 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:50:06.987 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:50:06.988 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:50:06.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:06.988 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:50:07.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:50:07.062+0000 7ff8adc1a580 -1 init, newargv = 0x563d769dfc70 newargc=15 2023-11-04T01:50:07.063 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[60192]: starting ceph client 2023-11-04T01:50:07.073 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[60192]: starting fuse 2023-11-04T01:50:08.139 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-04T01:50:08.148 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/run/lock 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/fs/nfsd 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysusers.service 2023-11-04T01:50:08.149 INFO:teuthology.orchestra.run.smithi002.stdout:/run/rpc_pipefs 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:50:08.150 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:08.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:08.151 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-04T01:50:08.198 INFO:teuthology.orchestra.run.smithi002.stdout:45 2023-11-04T01:50:08.198 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-11-04T01:50:08.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-04T01:50:08.198 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-04T01:50:08.198 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-04T01:50:08.198 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:50:08.198 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-04T01:50:08.199 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-04T01:50:08.200 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-04T01:50:08.200 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-04T01:50:08.200 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-04T01:50:08.200 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-04T01:50:08.200 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-04T01:50:08.200 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-04T01:50:08.200 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:50:08.324 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.60192.asok 2023-11-04T01:50:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:50:08.336 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60192.asok 2023-11-04T01:50:08.336 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:50:08.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- ceph --admin-daemon /var/run/ceph/ceph-client.0.60192.asok status 2023-11-04T01:50:08.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4", 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev)", 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-04T01:50:08.541 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "60192", 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 8592, 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 8592 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:50:08.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1320137356 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1320137356 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.8592 192.168.0.1:0/1320137356", 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/1320137356", 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-04T01:50:08.543 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 118, 2023-11-04T01:50:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 110, 2023-11-04T01:50:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-04T01:50:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-04T01:50:08.544 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-04T01:50:08.544 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:50:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:50:08.562 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:50:08.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- stat --file-system '--printf=%T 2023-11-04T01:50:08.563 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:08.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:50:08.614 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-04T01:50:08.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:50:08.621 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:08.621 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:50:08.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:08.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:50:08.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:50:08.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2023-11-04T01:50:08.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.793+0000 7f142841e640 1 Processor -- start 2023-11-04T01:50:08.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.793+0000 7f142841e640 1 -- start start 2023-11-04T01:50:08.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.793+0000 7f142841e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f14200cf830 0x7f14200af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.793+0000 7f142841e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14200af640 0x7f1420070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.793+0000 7f142841e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14200afa50 con 0x7f1420159720 2023-11-04T01:50:08.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.793+0000 7f142841e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200ca5a0 con 0x7f14200af640 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.793+0000 7f142841e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14200c9fe0 con 0x7f14200cf830 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14200af640 0x7f1420070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f14200af640 0x7f1420070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39668/0 (socket says 172.21.15.2:39668) 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 -- 172.21.15.2:0/4154709490 learned_addr learned my addr 172.21.15.2:0/4154709490 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14259b9640 1 --2- 172.21.15.2:0/4154709490 >> v2:172.21.15.90:3300/0 conn(0x7f14200cf830 0x7f14200af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 -- 172.21.15.2:0/4154709490 >> v2:172.21.15.90:3300/0 conn(0x7f14200cf830 msgr2=0x7f14200af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 --2- 172.21.15.2:0/4154709490 >> v2:172.21.15.90:3300/0 conn(0x7f14200cf830 0x7f14200af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 -- 172.21.15.2:0/4154709490 >> v1:172.21.15.90:6789/0 conn(0x7f1420159720 legacy=0x7f14200c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 -- 172.21.15.2:0/4154709490 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14200ca2c0 con 0x7f14200af640 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14269bb640 1 --2- 172.21.15.2:0/4154709490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14200af640 0x7f1420070880 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f14200cebf0 tx=0x7f141c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f1d568621e9015 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14251b8640 1 -- 172.21.15.2:0/4154709490 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0ab600 con 0x7f14200af640 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14251b8640 1 -- 172.21.15.2:0/4154709490 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0a7050 con 0x7f14200af640 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f14251b8640 1 -- 172.21.15.2:0/4154709490 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0ab980 con 0x7f14200af640 2023-11-04T01:50:08.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 -- 172.21.15.2:0/4154709490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14200af640 msgr2=0x7f1420070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 --2- 172.21.15.2:0/4154709490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14200af640 0x7f1420070880 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f14200cebf0 tx=0x7f141c01c400 comp rx=0 tx=0).stop 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 -- 172.21.15.2:0/4154709490 shutdown_connections 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 --2- 172.21.15.2:0/4154709490 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f14200af640 0x7f1420070880 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 --2- 172.21.15.2:0/4154709490 >> v2:172.21.15.90:3300/0 conn(0x7f14200cf830 0x7f14200af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 -- 172.21.15.2:0/4154709490 >> 172.21.15.2:0/4154709490 conn(0x7f14200ced10 msgr2=0x7f14200cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 -- 172.21.15.2:0/4154709490 shutdown_connections 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.797+0000 7f142841e640 1 -- 172.21.15.2:0/4154709490 wait complete. 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 Processor -- start 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 -- start start 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14200af640 0x7f1420149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14200cf830 0x7f14201498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1420159720 0x7f14200ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14201556b0 con 0x7f1420159720 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1420155080 con 0x7f14200cf830 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14200c7c20 con 0x7f14200af640 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1420159720 0x7f14200ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1420159720 0x7f14200ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39672/0 (socket says 172.21.15.2:39672) 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 -- 172.21.15.2:0/1087815651 learned_addr learned my addr 172.21.15.2:0/1087815651 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14259b9640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14200cf830 0x7f14201498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14261ba640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14200af640 0x7f1420149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 -- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14200af640 msgr2=0x7f1420149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14200af640 0x7f1420149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 -- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14200cf830 msgr2=0x7f14201498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14200cf830 0x7f14201498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 -- 172.21.15.2:0/1087815651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c0094d0 con 0x7f1420159720 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14259b9640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14200cf830 0x7f14201498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:08.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f14269bb640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1420159720 0x7f14200ac8f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f141c01a030 tx=0x7f141c0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f1416ffd640 1 -- 172.21.15.2:0/1087815651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0b5400 con 0x7f1420159720 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f1416ffd640 1 -- 172.21.15.2:0/1087815651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0b5560 con 0x7f1420159720 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14200c7f00 con 0x7f1420159720 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f1416ffd640 1 -- 172.21.15.2:0/1087815651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0b5910 con 0x7f1420159720 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.801+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142014a650 con 0x7f1420159720 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f1416ffd640 1 -- 172.21.15.2:0/1087815651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f141c0b5a70 con 0x7f1420159720 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f1416ffd640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14040664a0 0x7f1404068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f1416ffd640 1 -- 172.21.15.2:0/1087815651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f141c11ed70 con 0x7f1420159720 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14261ba640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14040664a0 0x7f1404068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 Processor -- start 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- start start 2023-11-04T01:50:08.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14261ba640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14040664a0 0x7f1404068960 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f14201517c0 tx=0x7f14180094d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1d49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf18a7f0 0x55cadf18abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadf052d80 con 0x55cadf18a7f0 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadefe37a0 con 0x55cadf1d4f10 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cadefe0cd0 con 0x55cadf1d45f0 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf18a7f0 0x55cadf18abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf18a7f0 0x55cadf18abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39688/0 (socket says 172.21.15.2:39688) 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 -- 172.21.15.2:0/3652034283 learned_addr learned my addr 172.21.15.2:0/3652034283 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14259b9640 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14261ba640 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1d49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 -- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 msgr2=0x55cadf1d49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1d49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 -- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 msgr2=0x55cadf18a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 -- 172.21.15.2:0/3652034283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cadef79180 con 0x55cadf18a7f0 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f14269bb640 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf18a7f0 0x55cadf18abd0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f141c0f73f0 tx=0x7f141c0eba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab86f17b22967bb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f1403fff640 1 -- 172.21.15.2:0/3652034283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0f7920 con 0x55cadf18a7f0 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f1403fff640 1 -- 172.21.15.2:0/3652034283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c0ed9c0 con 0x55cadf18a7f0 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f1403fff640 1 -- 172.21.15.2:0/3652034283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c0ef880 con 0x55cadf18a7f0 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- 172.21.15.2:0/3652034283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf18a7f0 msgr2=0x55cadf18abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf18a7f0 0x55cadf18abd0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f141c0f73f0 tx=0x7f141c0eba90 comp rx=0 tx=0).stop 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- 172.21.15.2:0/3652034283 shutdown_connections 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf18a7f0 0x55cadf18abd0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 --2- 172.21.15.2:0/3652034283 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1d49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- 172.21.15.2:0/3652034283 >> 172.21.15.2:0/3652034283 conn(0x55cadf072d50 msgr2=0x55cadf188b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- 172.21.15.2:0/3652034283 shutdown_connections 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.805+0000 7f142b54b000 1 -- 172.21.15.2:0/3652034283 wait complete. 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 -- start start 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 Processor -- start 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf18a7f0 0x55cadf18ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadefdc5c0 con 0x55cadf1d4f10 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadef9a8c0 con 0x55cadf18a7f0 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cadef9a560 con 0x55cadf1d45f0 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 10 client.0 _ll_register_callbacks cb 0x55cadf175ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39700/0 (socket says 172.21.15.2:39700) 2023-11-04T01:50:08.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 -- 172.21.15.2:0/3831722660 learned_addr learned my addr 172.21.15.2:0/3831722660 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14261ba640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf18a7f0 0x55cadf18ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14259b9640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 -- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 msgr2=0x55cadf1b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 -- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf18a7f0 msgr2=0x55cadf18ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf18a7f0 0x55cadf18ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 -- 172.21.15.2:0/3831722660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142014a650 con 0x55cadf1d4f10 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14261ba640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf18a7f0 0x55cadf18ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14269bb640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1b8d20 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f141c01c970 tx=0x7f141c11d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536daa113bbb79bc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14017fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14017fa640 1 -- 172.21.15.2:0/3831722660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c11b070 con 0x55cadf1d4f10 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14017fa640 1 -- 172.21.15.2:0/3831722660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f141c0eeb10 con 0x55cadf1d4f10 2023-11-04T01:50:08.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cadefa7da0 con 0x55cadf1d4f10 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14017fa640 1 -- 172.21.15.2:0/3831722660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7f141c0eecd0 con 0x55cadf1d4f10 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 10 client.8604 fetch_fsmap learned FSMap version 118 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=118,monmap=2+}) v3 -- 0x55cadecd4e20 con 0x55cadf1d4f10 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14017fa640 1 -- 172.21.15.2:0/3831722660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141c111080 con 0x55cadf1d4f10 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14017fa640 1 -- 172.21.15.2:0/3831722660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 118) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f141c0b5d20 con 0x55cadf1d4f10 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 10 client.8604 fetch_fsmap finished waiting for FSMap version 118 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 10 client.8604 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 20 client.8604 populate_metadata read hostname 'smithi002' 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf1dac30 0x55cadf1db040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 4 client.8604 mds_command: new command op to 6925 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 --> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cadefa7b80 con 0x55cadf1dac30 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14261ba640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf1dac30 0x55cadf1db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14017fa640 10 client.8604 ms_handle_connect on v2:172.21.15.90:6834/2981602016 2023-11-04T01:50:08.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.809+0000 7f14261ba640 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf1dac30 0x55cadf1db040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17dbf98b7648def3 server_cookie=13d15d97dd6a2beb in_seq=0 out_seq=0 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f14017fa640 1 -- 172.21.15.2:0/3831722660 <== mds.0 v2:172.21.15.90:6834/2981602016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cadefa7b80 con 0x55cadf1dac30 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f14017fa640 10 client.8604 handle_command_reply: tid=0 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 client.8604 shutdown 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 msgr2=0x55cadf1b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1b8d20 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f141c01c970 tx=0x7f141c11d000 comp rx=0 tx=0).stop 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 shutdown_connections 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1b8d20 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf1d45f0 0x55cadf1b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf1dac30 0x55cadf1db040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 --2- 172.21.15.2:0/3831722660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf18a7f0 0x55cadf18ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 >> 172.21.15.2:0/3831722660 conn(0x55cadf072d50 msgr2=0x55cadf188b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f14017fa640 0 client.8604 ms_handle_reset on v2:172.21.15.90:6834/2981602016 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 shutdown_connections 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 1 -- 172.21.15.2:0/3831722660 wait complete. 2023-11-04T01:50:08.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.813+0000 7f142b54b000 20 client.8604 trim_cache size 0 max 16384 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 Processor -- start 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 -- start start 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf18bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d45f0 0x55cadf18abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadec95aa0 con 0x55cadf1d45f0 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadefd7f30 con 0x55cadf1d4f10 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cadefd68c0 con 0x55cadf18a7f0 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f14259b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d45f0 0x55cadf18abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f14259b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d45f0 0x55cadf18abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39716/0 (socket says 172.21.15.2:39716) 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.825+0000 7f14259b9640 1 -- 172.21.15.2:0/3253988636 learned_addr learned my addr 172.21.15.2:0/3253988636 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14261ba640 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf18bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14259b9640 1 -- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 msgr2=0x55cadf18bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14259b9640 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf18bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14259b9640 1 -- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 msgr2=0x55cadf18b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14259b9640 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14259b9640 1 -- 172.21.15.2:0/3253988636 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cadef9d2f0 con 0x55cadf1d45f0 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14259b9640 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d45f0 0x55cadf18abd0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f1410007880 tx=0x7f1410007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31094632eb9b1957 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f1414ff9640 1 -- 172.21.15.2:0/3253988636 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410004020 con 0x55cadf1d45f0 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f1414ff9640 1 -- 172.21.15.2:0/3253988636 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410004180 con 0x55cadf1d45f0 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f1414ff9640 1 -- 172.21.15.2:0/3253988636 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410004330 con 0x55cadf1d45f0 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- 172.21.15.2:0/3253988636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d45f0 msgr2=0x55cadf18abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d45f0 0x55cadf18abd0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f1410007880 tx=0x7f1410007d40 comp rx=0 tx=0).stop 2023-11-04T01:50:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- 172.21.15.2:0/3253988636 shutdown_connections 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d4f10 0x55cadf18b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d45f0 0x55cadf18abd0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 --2- 172.21.15.2:0/3253988636 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf18bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- 172.21.15.2:0/3253988636 >> 172.21.15.2:0/3253988636 conn(0x55cadf072d50 msgr2=0x55cadf1b74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- 172.21.15.2:0/3253988636 shutdown_connections 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- 172.21.15.2:0/3253988636 wait complete. 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- start start 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 Processor -- start 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf1d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d45f0 0x55cadf1f1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1f1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadf1b8a10 con 0x55cadf1d4f10 2023-11-04T01:50:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cadf078fd0 con 0x55cadf1d45f0 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cadefb2e80 con 0x55cadf18a7f0 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 10 client.0 _ll_register_callbacks cb 0x55cadf08dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39718/0 (socket says 172.21.15.2:39718) 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 -- 172.21.15.2:0/3605440623 learned_addr learned my addr 172.21.15.2:0/3605440623 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14261ba640 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf1d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14259b9640 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d45f0 0x55cadf1f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 -- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 msgr2=0x55cadf1d9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf1d9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 -- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d45f0 msgr2=0x55cadf1f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d45f0 0x55cadf1f1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 -- 172.21.15.2:0/3605440623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141000e040 con 0x55cadf1d4f10 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14269bb640 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1f1750 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f141c0abfd0 tx=0x7f141c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13aef27036d6cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:08.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14017fa640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14017fa640 1 -- 172.21.15.2:0/3605440623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141c11b040 con 0x55cadf1d4f10 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14017fa640 1 -- 172.21.15.2:0/3605440623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f141c109030 con 0x55cadf1d4f10 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cadf18ca30 con 0x55cadf1d4f10 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14017fa640 1 -- 172.21.15.2:0/3605440623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7f141c0f7740 con 0x55cadf1d4f10 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 10 client.8610 fetch_fsmap learned FSMap version 118 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=118,monmap=2+}) v3 -- 0x55cadef837f0 con 0x55cadf1d4f10 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.829+0000 7f14017fa640 1 -- 172.21.15.2:0/3605440623 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cadf18ca30 con 0x55cadf1d4f10 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f14017fa640 1 -- 172.21.15.2:0/3605440623 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 118) v1 ==== 3306+0+0 (secure 0 0 0) 0x7f141c0b5d20 con 0x55cadf1d4f10 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f142b54b000 10 client.8610 fetch_fsmap finished waiting for FSMap version 118 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f142b54b000 10 client.8610 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f142b54b000 20 client.8610 populate_metadata read hostname 'smithi002' 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f142b54b000 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf234a60 0x55cadf234e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:08.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f142b54b000 4 client.8610 mds_command: new command op to 6925 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2023-11-04T01:50:08.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 --> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cadefd38b0 con 0x55cadf234a60 2023-11-04T01:50:08.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f14261ba640 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf234a60 0x55cadf234e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:08.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f14261ba640 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf234a60 0x55cadf234e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa3bcf84707e9c9d server_cookie=9e57c288adecc491 in_seq=0 out_seq=0 2023-11-04T01:50:08.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.833+0000 7f14017fa640 10 client.8610 ms_handle_connect on v2:172.21.15.90:6834/2981602016 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f14017fa640 1 -- 172.21.15.2:0/3605440623 <== mds.0 v2:172.21.15.90:6834/2981602016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cadefd38b0 con 0x55cadf234a60 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f14017fa640 10 client.8610 handle_command_reply: tid=0 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 client.8610 shutdown 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 msgr2=0x55cadf1f1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1f1750 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f141c0abfd0 tx=0x7f141c009240 comp rx=0 tx=0).stop 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 shutdown_connections 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cadf1d4f10 0x55cadf1f1750 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:6834/2981602016,v1:172.21.15.90:6837/2981602016] conn(0x55cadf234a60 0x55cadf234e70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cadf1d45f0 0x55cadf1f1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 --2- 172.21.15.2:0/3605440623 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x55cadf18a7f0 0x55cadf1d9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 >> 172.21.15.2:0/3605440623 conn(0x55cadf072d50 msgr2=0x55cadf18e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f14017fa640 0 client.8610 ms_handle_reset on v2:172.21.15.90:6834/2981602016 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 shutdown_connections 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 1 -- 172.21.15.2:0/3605440623 wait complete. 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.845+0000 7f142b54b000 20 client.8610 trim_cache size 0 max 16384 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "message": "", 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stdout: "return_code": 0 2023-11-04T01:50:08.852 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-04T01:50:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14040664a0 msgr2=0x7f1404068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14040664a0 0x7f1404068960 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f14201517c0 tx=0x7f14180094d0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1420159720 msgr2=0x7f14200ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1420159720 0x7f14200ac8f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f141c01a030 tx=0x7f141c0191a0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 shutdown_connections 2023-11-04T01:50:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f14040664a0 0x7f1404068960 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1420159720 0x7f14200ac8f0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f14200cf830 0x7f14201498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 --2- 172.21.15.2:0/1087815651 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f14200af640 0x7f1420149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 >> 172.21.15.2:0/1087815651 conn(0x7f14200ced10 msgr2=0x7f14200cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 shutdown_connections 2023-11-04T01:50:08.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:08.849+0000 7f142841e640 1 -- 172.21.15.2:0/1087815651 wait complete. 2023-11-04T01:50:08.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:08.866 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir d1/dir/.snap/*) 2023-11-04T01:50:08.894 INFO:tasks.cephfs.test_snapshots:testing snapclient mds_kill_mdstable_at=3 2023-11-04T01:50:08.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:09.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 Processor -- start 2023-11-04T01:50:09.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 -- start start 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ee01605b0 0x7f6ee00cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00d1560 0x7f6ee00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ee00ce570 0x7f6ee00cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee00d3e20 con 0x7f6ee01605b0 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ee00d1b30 con 0x7f6ee00ce570 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6ee602e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00d1e10 con 0x7f6ee00d1560 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ee01605b0 0x7f6ee00cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6ee01605b0 0x7f6ee00cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39726/0 (socket says 172.21.15.2:39726) 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 -- 172.21.15.2:0/2306002807 learned_addr learned my addr 172.21.15.2:0/2306002807 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edeffd640 1 --2- 172.21.15.2:0/2306002807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00d1560 0x7f6ee00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edffff640 1 --2- 172.21.15.2:0/2306002807 >> v2:172.21.15.90:3300/0 conn(0x7f6ee00ce570 0x7f6ee00cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 -- 172.21.15.2:0/2306002807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00d1560 msgr2=0x7f6ee00ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 --2- 172.21.15.2:0/2306002807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00d1560 0x7f6ee00ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 -- 172.21.15.2:0/2306002807 >> v2:172.21.15.90:3300/0 conn(0x7f6ee00ce570 msgr2=0x7f6ee00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 --2- 172.21.15.2:0/2306002807 >> v2:172.21.15.90:3300/0 conn(0x7f6ee00ce570 0x7f6ee00cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edf7fe640 1 -- 172.21.15.2:0/2306002807 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee00b29e0 con 0x7f6ee01605b0 2023-11-04T01:50:09.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.053+0000 7f6edffff640 1 --2- 172.21.15.2:0/2306002807 >> v2:172.21.15.90:3300/0 conn(0x7f6ee00ce570 0x7f6ee00cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:09.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6edf7fe640 1 --2- 172.21.15.2:0/2306002807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00cdaf0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00cd8a0 tx=0x7f6ed001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3208d644fc5bf6c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ede7fc640 1 -- 172.21.15.2:0/2306002807 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00a89b0 con 0x7f6ee01605b0 2023-11-04T01:50:09.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ede7fc640 1 -- 172.21.15.2:0/2306002807 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed00a8b10 con 0x7f6ee01605b0 2023-11-04T01:50:09.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ede7fc640 1 -- 172.21.15.2:0/2306002807 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00a8ea0 con 0x7f6ee01605b0 2023-11-04T01:50:09.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- 172.21.15.2:0/2306002807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 msgr2=0x7f6ee00cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 --2- 172.21.15.2:0/2306002807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00cdaf0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00cd8a0 tx=0x7f6ed001ecf0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- 172.21.15.2:0/2306002807 shutdown_connections 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 --2- 172.21.15.2:0/2306002807 >> v2:172.21.15.90:3300/0 conn(0x7f6ee00ce570 0x7f6ee00cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 --2- 172.21.15.2:0/2306002807 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00d1560 0x7f6ee00ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 --2- 172.21.15.2:0/2306002807 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00cdaf0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- 172.21.15.2:0/2306002807 >> 172.21.15.2:0/2306002807 conn(0x7f6ee00d2fe0 msgr2=0x7f6ee00d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- 172.21.15.2:0/2306002807 shutdown_connections 2023-11-04T01:50:09.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- 172.21.15.2:0/2306002807 wait complete. 2023-11-04T01:50:09.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 Processor -- start 2023-11-04T01:50:09.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- start start 2023-11-04T01:50:09.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00ce570 0x7f6ee015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ee00d1560 0x7f6ee00b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00b6810 con 0x7f6ee01605b0 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00b6af0 con 0x7f6ee00d1560 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.057+0000 7f6ee602e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee00b6dd0 con 0x7f6ee00ce570 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39740/0 (socket says 172.21.15.2:39740) 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 -- 172.21.15.2:0/3600575823 learned_addr learned my addr 172.21.15.2:0/3600575823 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edeffd640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ee00d1560 0x7f6ee00b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edf7fe640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00ce570 0x7f6ee015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 -- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00ce570 msgr2=0x7f6ee015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00ce570 0x7f6ee015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 -- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ee00d1560 msgr2=0x7f6ee00b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ee00d1560 0x7f6ee00b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 -- 172.21.15.2:0/3600575823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00094d0 con 0x7f6ee01605b0 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edffff640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00c7f10 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007e10 tx=0x7f6ed800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ec7fff640 1 -- 172.21.15.2:0/3600575823 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8003ba0 con 0x7f6ee01605b0 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ec7fff640 1 -- 172.21.15.2:0/3600575823 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed800f040 con 0x7f6ee01605b0 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee00b70b0 con 0x7f6ee01605b0 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ec7fff640 1 -- 172.21.15.2:0/3600575823 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800de80 con 0x7f6ee01605b0 2023-11-04T01:50:09.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee015e810 con 0x7f6ee01605b0 2023-11-04T01:50:09.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee0067610 con 0x7f6ee01605b0 2023-11-04T01:50:09.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ec7fff640 1 -- 172.21.15.2:0/3600575823 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6ed8004030 con 0x7f6ee01605b0 2023-11-04T01:50:09.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ec7fff640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ecc0664a0 0x7f6ecc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6ec7fff640 1 -- 172.21.15.2:0/3600575823 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f6ed8084a10 con 0x7f6ee01605b0 2023-11-04T01:50:09.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.061+0000 7f6edf7fe640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ecc0664a0 0x7f6ecc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.065+0000 7f6edf7fe640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ecc0664a0 0x7f6ecc068960 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00b2000 tx=0x7f6ed0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.065+0000 7f6ec7fff640 1 -- 172.21.15.2:0/3600575823 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ed8051610 con 0x7f6ee01605b0 2023-11-04T01:50:09.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.253+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ee00d2dc0 con 0x7f6ee01605b0 2023-11-04T01:50:09.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ec7fff640 1 -- 172.21.15.2:0/3600575823 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4925 (secure 0 0 0) 0x7f6ed801a020 con 0x7f6ee01605b0 2023-11-04T01:50:09.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:09.258 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:02.280323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:09.258 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 118 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ecc0664a0 msgr2=0x7f6ecc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ecc0664a0 0x7f6ecc068960 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00b2000 tx=0x7f6ed0008040 comp rx=0 tx=0).stop 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 msgr2=0x7f6ee00c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00c7f10 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8007e10 tx=0x7f6ed800d4a0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 shutdown_connections 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f6ecc0664a0 0x7f6ecc068960 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ee01605b0 0x7f6ee00c7f10 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ee00d1560 0x7f6ee00b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 --2- 172.21.15.2:0/3600575823 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f6ee00ce570 0x7f6ee015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 >> 172.21.15.2:0/3600575823 conn(0x7f6ee00d2fe0 msgr2=0x7f6ee006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 shutdown_connections 2023-11-04T01:50:09.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.257+0000 7f6ee602e640 1 -- 172.21.15.2:0/3600575823 wait complete. 2023-11-04T01:50:09.276 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dump snaps --server 2023-11-04T01:50:09.419 INFO:teuthology.orchestra.run.smithi090.stdout:{"last_snap":14,"last_created":12,"last_destroyed":13,"pending_noop":[],"snaps":[{"snapid":12,"ino":1099511627777,"stamp":"2023-11-04T01:49:22.909916+0000","name":"s26","metadata":{}}],"need_to_purge":{"16":[11,13]},"pending_update":[],"pending_destroy":[{"version":27,"removed_snap":12,"seq":14}]} 2023-11-04T01:50:09.419 DEBUG:tasks.cephfs.filesystem:_json_asok output { "last_created": 12, "last_destroyed": 13, "last_snap": 14, "need_to_purge": { "16": [ 11, 13 ] }, "pending_destroy": [ { "removed_snap": 12, "seq": 14, "version": 27 } ], "pending_noop": [], "pending_update": [], "snaps": [ { "ino": 1099511627777, "metadata": {}, "name": "s26", "snapid": 12, "stamp": "2023-11-04T01:49:22.909916+0000" } ] } 2023-11-04T01:50:09.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319d089640 1 Processor -- start 2023-11-04T01:50:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319d089640 1 -- start start 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319d089640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31980b27d0 0x7f31980ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319d089640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f319815ef50 0x7f319815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319d089640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319815f920 con 0x7f31980b5ef0 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319d089640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319815ea70 con 0x7f319815ef50 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319d089640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31980b2c90 con 0x7f31980b27d0 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319759e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f319815ef50 0x7f319815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319759e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f319815ef50 0x7f319815f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39744/0 (socket says 172.21.15.2:39744) 2023-11-04T01:50:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319759e640 1 -- 172.21.15.2:0/3969212381 learned_addr learned my addr 172.21.15.2:0/3969212381 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319659c640 1 --2- 172.21.15.2:0/3969212381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31980b27d0 0x7f31980ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319759e640 1 -- 172.21.15.2:0/3969212381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31980b27d0 msgr2=0x7f31980ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319759e640 1 --2- 172.21.15.2:0/3969212381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31980b27d0 0x7f31980ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319759e640 1 -- 172.21.15.2:0/3969212381 >> v1:172.21.15.90:6789/0 conn(0x7f31980b5ef0 legacy=0x7f319815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:09.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.549+0000 7f319759e640 1 -- 172.21.15.2:0/3969212381 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980b2f70 con 0x7f319815ef50 2023-11-04T01:50:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319759e640 1 --2- 172.21.15.2:0/3969212381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f319815ef50 0x7f319815f3e0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f3190009e50 tx=0x7f319001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0a2ddf8e6cff5f server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f3195d9b640 1 -- 172.21.15.2:0/3969212381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900a5820 con 0x7f319815ef50 2023-11-04T01:50:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f3195d9b640 1 -- 172.21.15.2:0/3969212381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31900a5980 con 0x7f319815ef50 2023-11-04T01:50:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f3195d9b640 1 -- 172.21.15.2:0/3969212381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31900a5d10 con 0x7f319815ef50 2023-11-04T01:50:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 -- 172.21.15.2:0/3969212381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f319815ef50 msgr2=0x7f319815f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 --2- 172.21.15.2:0/3969212381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f319815ef50 0x7f319815f3e0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f3190009e50 tx=0x7f319001c9a0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 -- 172.21.15.2:0/3969212381 shutdown_connections 2023-11-04T01:50:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 --2- 172.21.15.2:0/3969212381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f319815ef50 0x7f319815f3e0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 --2- 172.21.15.2:0/3969212381 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f31980b27d0 0x7f31980ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 -- 172.21.15.2:0/3969212381 >> 172.21.15.2:0/3969212381 conn(0x7f319806a130 msgr2=0x7f319806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 -- 172.21.15.2:0/3969212381 shutdown_connections 2023-11-04T01:50:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 -- 172.21.15.2:0/3969212381 wait complete. 2023-11-04T01:50:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 Processor -- start 2023-11-04T01:50:09.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.553+0000 7f319d089640 1 -- start start 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31980b27d0 0x7f319814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31980b5ef0 0x7f31980c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f319815ef50 0x7f3198157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319814f800 con 0x7f31980b27d0 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319814fe60 con 0x7f31980b5ef0 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3198150140 con 0x7f319815ef50 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31980b27d0 0x7f319814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319759e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f319815ef50 0x7f3198157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31980b27d0 0x7f319814f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39746/0 (socket says 172.21.15.2:39746) 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 -- 172.21.15.2:0/2015963421 learned_addr learned my addr 172.21.15.2:0/2015963421 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319659c640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31980b5ef0 0x7f31980c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 -- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f319815ef50 msgr2=0x7f3198157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f319815ef50 0x7f3198157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 -- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31980b5ef0 msgr2=0x7f31980c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31980b5ef0 0x7f31980c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 -- 172.21.15.2:0/2015963421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009b30 con 0x7f31980b27d0 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319659c640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31980b5ef0 0x7f31980c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f3196d9d640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31980b27d0 0x7f319814f2c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f318800c450 tx=0x7f318800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f317f7fe640 1 -- 172.21.15.2:0/2015963421 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188012830 con 0x7f31980b27d0 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f317f7fe640 1 -- 172.21.15.2:0/2015963421 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31880129b0 con 0x7f31980b27d0 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3198150420 con 0x7f31980b27d0 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f317f7fe640 1 -- 172.21.15.2:0/2015963421 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188012d60 con 0x7f31980b27d0 2023-11-04T01:50:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31981509e0 con 0x7f31980b27d0 2023-11-04T01:50:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31980c46f0 con 0x7f31980b27d0 2023-11-04T01:50:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f317f7fe640 1 -- 172.21.15.2:0/2015963421 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f318801c460 con 0x7f31980b27d0 2023-11-04T01:50:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f317f7fe640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f31840664d0 0x7f3184068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f317f7fe640 1 -- 172.21.15.2:0/2015963421 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f3188084430 con 0x7f31980b27d0 2023-11-04T01:50:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.557+0000 7f319659c640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f31840664d0 0x7f3184068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.561+0000 7f319659c640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f31840664d0 0x7f3184068990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3198157de0 tx=0x7f318c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.561+0000 7f317f7fe640 1 -- 172.21.15.2:0/2015963421 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31880510c0 con 0x7f31980b27d0 2023-11-04T01:50:09.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.753+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31980c7720 con 0x7f31980b27d0 2023-11-04T01:50:09.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.753+0000 7f317f7fe640 1 -- 172.21.15.2:0/2015963421 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4925 (secure 0 0 0) 0x7f31880546e0 con 0x7f31980b27d0 2023-11-04T01:50:09.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:09.756 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":118,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:02.280323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:09.757 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 118 2023-11-04T01:50:09.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f31840664d0 msgr2=0x7f3184068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f31840664d0 0x7f3184068990 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3198157de0 tx=0x7f318c008040 comp rx=0 tx=0).stop 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31980b27d0 msgr2=0x7f319814f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31980b27d0 0x7f319814f2c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f318800c450 tx=0x7f318800c910 comp rx=0 tx=0).stop 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 shutdown_connections 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f31840664d0 0x7f3184068990 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f319815ef50 0x7f3198157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31980b5ef0 0x7f31980c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 --2- 172.21.15.2:0/2015963421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31980b27d0 0x7f319814f2c0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 >> 172.21.15.2:0/2015963421 conn(0x7f319806a130 msgr2=0x7f319806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 shutdown_connections 2023-11-04T01:50:09.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.757+0000 7f319d089640 1 -- 172.21.15.2:0/2015963421 wait complete. 2023-11-04T01:50:09.775 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds freeze 6:1 true 2023-11-04T01:50:09.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.901+0000 7f021c5d2640 1 Processor -- start 2023-11-04T01:50:09.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.901+0000 7f021c5d2640 1 -- start start 2023-11-04T01:50:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f021c5d2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02140c9a70 0x7f02140b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f021c5d2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140caaa0 0x7f02140cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f021c5d2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02140ccdf0 con 0x7f021415d410 2023-11-04T01:50:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f021c5d2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021406fe50 con 0x7f02140c9a70 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f021c5d2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02140aef20 con 0x7f02140caaa0 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02140c9a70 0x7f02140b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02140c9a70 0x7f02140b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39758/0 (socket says 172.21.15.2:39758) 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 -- 172.21.15.2:0/1583927838 learned_addr learned my addr 172.21.15.2:0/1583927838 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f021ab6f640 1 --2- 172.21.15.2:0/1583927838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140caaa0 0x7f02140cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 -- 172.21.15.2:0/1583927838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140caaa0 msgr2=0x7f02140cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 --2- 172.21.15.2:0/1583927838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140caaa0 0x7f02140cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 -- 172.21.15.2:0/1583927838 >> v1:172.21.15.90:6789/0 conn(0x7f021415d410 legacy=0x7f02140c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 -- 172.21.15.2:0/1583927838 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02140b0750 con 0x7f02140c9a70 2023-11-04T01:50:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.905+0000 7f0219b6d640 1 --2- 172.21.15.2:0/1583927838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02140c9a70 0x7f02140b0210 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f02040098a0 tx=0x7f020401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b9bf1e7c7e365b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021936c640 1 -- 172.21.15.2:0/1583927838 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02040ab600 con 0x7f02140c9a70 2023-11-04T01:50:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021936c640 1 -- 172.21.15.2:0/1583927838 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02040a7050 con 0x7f02140c9a70 2023-11-04T01:50:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021936c640 1 -- 172.21.15.2:0/1583927838 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02040ab980 con 0x7f02140c9a70 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- 172.21.15.2:0/1583927838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02140c9a70 msgr2=0x7f02140b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 --2- 172.21.15.2:0/1583927838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02140c9a70 0x7f02140b0210 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f02040098a0 tx=0x7f020401c520 comp rx=0 tx=0).stop 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- 172.21.15.2:0/1583927838 shutdown_connections 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 --2- 172.21.15.2:0/1583927838 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140caaa0 0x7f02140cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 --2- 172.21.15.2:0/1583927838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02140c9a70 0x7f02140b0210 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- 172.21.15.2:0/1583927838 >> 172.21.15.2:0/1583927838 conn(0x7f02140ced10 msgr2=0x7f02140cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- 172.21.15.2:0/1583927838 shutdown_connections 2023-11-04T01:50:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- 172.21.15.2:0/1583927838 wait complete. 2023-11-04T01:50:09.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 Processor -- start 2023-11-04T01:50:09.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- start start 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140c9a70 0x7f0214150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02140caaa0 0x7f021414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f021415d410 0x7f02140cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0214151150 con 0x7f021415d410 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02140c25b0 con 0x7f02140caaa0 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0214150b90 con 0x7f02140c9a70 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f021415d410 0x7f02140cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f021415d410 0x7f02140cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39772/0 (socket says 172.21.15.2:39772) 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 -- 172.21.15.2:0/3886127595 learned_addr learned my addr 172.21.15.2:0/3886127595 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021a36e640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140c9a70 0x7f0214150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f0219b6d640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02140caaa0 0x7f021414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 -- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140c9a70 msgr2=0x7f0214150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140c9a70 0x7f0214150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 -- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02140caaa0 msgr2=0x7f021414f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02140caaa0 0x7f021414f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 -- 172.21.15.2:0/3886127595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040094d0 con 0x7f021415d410 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021ab6f640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f021415d410 0x7f02140cb7d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f020c007e40 tx=0x7f020c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f020affd640 1 -- 172.21.15.2:0/3886127595 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c014620 con 0x7f021415d410 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f020affd640 1 -- 172.21.15.2:0/3886127595 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00ee90 con 0x7f021415d410 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0214150e70 con 0x7f021415d410 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f020affd640 1 -- 172.21.15.2:0/3886127595 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c0149e0 con 0x7f021415d410 2023-11-04T01:50:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.909+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021414df90 con 0x7f021415d410 2023-11-04T01:50:09.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.913+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02140c2410 con 0x7f021415d410 2023-11-04T01:50:09.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.913+0000 7f020affd640 1 -- 172.21.15.2:0/3886127595 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f020c014b40 con 0x7f021415d410 2023-11-04T01:50:09.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.913+0000 7f020affd640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f01f80664a0 0x7f01f8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:09.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.913+0000 7f020affd640 1 -- 172.21.15.2:0/3886127595 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7f020c0850a0 con 0x7f021415d410 2023-11-04T01:50:09.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.913+0000 7f021a36e640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f01f80664a0 0x7f01f8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:09.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.913+0000 7f021a36e640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f01f80664a0 0x7f01f8068960 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0210000f70 tx=0x7f0210009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:09.917+0000 7f020affd640 1 -- 172.21.15.2:0/3886127595 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f02140c2410 con 0x7f021415d410 2023-11-04T01:50:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.137+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"} v 0) v1 -- 0x7f02140c2410 con 0x7f021415d410 2023-11-04T01:50:10.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:50:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:50:10.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.681+0000 7f020affd640 1 -- 172.21.15.2:0/3886127595 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mds freeze", "role_or_gid": "6:1", "val": "true"}]=0 freezing mds.8445 v119) v1 ==== 112+0+0 (secure 0 0 0) 0x7f02140c2410 con 0x7f021415d410 2023-11-04T01:50:10.683 INFO:teuthology.orchestra.run.smithi002.stderr:freezing mds.8445 2023-11-04T01:50:10.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f01f80664a0 msgr2=0x7f01f8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:10.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f01f80664a0 0x7f01f8068960 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0210000f70 tx=0x7f0210009040 comp rx=0 tx=0).stop 2023-11-04T01:50:10.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f021415d410 msgr2=0x7f02140cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f021415d410 0x7f02140cb7d0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f020c007e40 tx=0x7f020c00e4b0 comp rx=0 tx=0).stop 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 shutdown_connections 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f01f80664a0 0x7f01f8068960 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f021415d410 0x7f02140cb7d0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02140caaa0 0x7f021414f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 --2- 172.21.15.2:0/3886127595 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f02140c9a70 0x7f0214150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 >> 172.21.15.2:0/3886127595 conn(0x7f02140ced10 msgr2=0x7f021415c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 shutdown_connections 2023-11-04T01:50:10.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:10.685+0000 7f021c5d2640 1 -- 172.21.15.2:0/3886127595 wait complete. 2023-11-04T01:50:10.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_kill_mdstable_at 3 2023-11-04T01:50:10.847 INFO:teuthology.orchestra.run.smithi002.stdout:{"success":"mds_kill_mdstable_at = '3' (not observed, change may require restart) "} 2023-11-04T01:50:10.847 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_kill_mdstable_at = '3' (not observed, change may require restart) " } 2023-11-04T01:50:10.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:10.847 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir d1/dir/.snap/s33) 2023-11-04T01:50:10.850 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-11-04T01:50:10.861 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f2d134fd640 time 2023-11-04T01:50:10.863495+0000 2023-11-04T01:50:10.861 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2d19629fae] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.863 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr:*** Caught signal (Aborted) ** 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7f2d134fd640 thread_name:ms_dispatch 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:50:10.861+0000 7f2d134fd640 -1 ./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f2d134fd640 time 2023-11-04T01:50:10.863495+0000 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2d19629fae] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.864 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2d18f64520] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2d1962a008] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.865 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-04T01:50:10.861+0000 7f2d134fd640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7f2d134fd640 thread_name:ms_dispatch 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2d18f64520] 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:50:10.866 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2d1962a008] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:50:10.867 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: -1> 2023-11-04T01:50:10.861+0000 7f2d134fd640 -1 ./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f2d134fd640 time 2023-11-04T01:50:10.863495+0000 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2d19629fae] 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.870 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 0> 2023-11-04T01:50:10.861+0000 7f2d134fd640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7f2d134fd640 thread_name:ms_dispatch 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2d18f64520] 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:50:10.871 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2d1962a008] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:50:10.872 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.875 INFO:tasks.ceph.mds.a.smithi002.stderr: -1> 2023-11-04T01:50:10.861+0000 7f2d134fd640 -1 ./src/mds/MDSTableClient.cc: In function 'void MDSTableClient::handle_request(ceph::cref_t&)' thread 7f2d134fd640 time 2023-11-04T01:50:10.863495+0000 2023-11-04T01:50:10.875 INFO:tasks.ceph.mds.a.smithi002.stderr:./src/mds/MDSTableClient.cc: 76: FAILED ceph_assert(g_conf()->mds_kill_mdstable_at != 3) 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2d19629fae] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.876 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 0> 2023-11-04T01:50:10.861+0000 7f2d134fd640 -1 *** Caught signal (Aborted) ** 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: in thread 7f2d134fd640 thread_name:ms_dispatch 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: ceph version 18.0.0-7035-g7532011a (7532011aba9c81bdc6f987da6b4c05fb8ea5f4d4) reef (dev) 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2d18f64520] 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 2: pthread_kill() 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 3: raise() 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 4: abort() 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2d1962a008] 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x170162) [0x7f2d1962a162] 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 7: (MDSTableClient::handle_request(boost::intrusive_ptr const&)+0x115e) [0x56328b54a68e] 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xd05) [0x56328b2e2585] 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x4cb) [0x56328b2e39eb] 2023-11-04T01:50:10.877 INFO:tasks.ceph.mds.a.smithi002.stderr: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56328b2e3ebc] 2023-11-04T01:50:10.878 INFO:tasks.ceph.mds.a.smithi002.stderr: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x195) [0x56328b2ce7f5] 2023-11-04T01:50:10.878 INFO:tasks.ceph.mds.a.smithi002.stderr: 12: (DispatchQueue::entry()+0x5ea) [0x7f2d19815f2a] 2023-11-04T01:50:10.878 INFO:tasks.ceph.mds.a.smithi002.stderr: 13: /usr/lib/ceph/libceph-common.so.2(+0x3ee7f1) [0x7f2d198a87f1] 2023-11-04T01:50:10.878 INFO:tasks.ceph.mds.a.smithi002.stderr: 14: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7f2d18fb6b43] 2023-11-04T01:50:10.878 INFO:tasks.ceph.mds.a.smithi002.stderr: 15: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7f2d19048a00] 2023-11-04T01:50:10.878 INFO:tasks.ceph.mds.a.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-11-04T01:50:10.878 INFO:tasks.ceph.mds.a.smithi002.stderr: 2023-11-04T01:50:10.980 INFO:teuthology.orchestra.run.smithi002.stdout:{"mds_beacon_grace":"15.000000"} 2023-11-04T01:50:10.981 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-11-04T01:50:10.981 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:11.087 INFO:tasks.ceph.mds.a.smithi002.stderr:daemon-helper: command crashed with signal 6 2023-11-04T01:50:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe680f48640 1 Processor -- start 2023-11-04T01:50:11.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe680f48640 1 -- start start 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe680f48640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe67c15ae00 0x7fe67c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe680f48640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 0x7fe67c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe680f48640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67c15fa80 con 0x7fe67c15b1e0 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe680f48640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67c0cadc0 con 0x7fe67c15ae00 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe680f48640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0c9920 con 0x7fe67c15f210 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe67c15b1e0 0x7fe67c15eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50820/0 (socket says 172.21.15.2:50820) 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 -- 172.21.15.2:0/3830652348 learned_addr learned my addr 172.21.15.2:0/3830652348 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe67ad9d640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 0x7fe67c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe67a59c640 1 --2- 172.21.15.2:0/3830652348 >> v2:172.21.15.90:3300/0 conn(0x7fe67c15ae00 0x7fe67c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913316855 0 0) 0x7fe67c15fa80 con 0x7fe67c15b1e0 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe668003530 con 0x7fe67c15b1e0 2023-11-04T01:50:11.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719911337 0 0) 0x7fe668003530 con 0x7fe67c15b1e0 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 msgr2=0x7fe67c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 0x7fe67c06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 >> v2:172.21.15.90:3300/0 conn(0x7fe67c15ae00 msgr2=0x7fe67c06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 --2- 172.21.15.2:0/3830652348 >> v2:172.21.15.90:3300/0 conn(0x7fe67c15ae00 0x7fe67c06d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c15f7a0 con 0x7fe67c15b1e0 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fe664001680 con 0x7fe67c15b1e0 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 >> v1:172.21.15.2:6789/0 conn(0x7fe67c15b1e0 legacy=0x7fe67c15eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 0x7fe668003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe6680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe668004d10 0x7fe668005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0cadc0 con 0x7fe668003f00 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0c9920 con 0x7fe668004d10 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66800b9e0 con 0x7fe67c15f210 2023-11-04T01:50:11.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe6680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 -- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 msgr2=0x7fe668003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe67a59c640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 0x7fe668003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c15f210 0x7fe668003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 -- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe668004d10 msgr2=0x7fe668005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe668004d10 0x7fe668005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.149+0000 7fe671d9b640 1 -- 172.21.15.2:0/3830652348 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668003530 con 0x7fe668003f00 2023-11-04T01:50:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe671d9b640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe6680047d0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c2c0 tx=0x7fe66401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a331d29bab348ab server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640058e0 con 0x7fe668003f00 2023-11-04T01:50:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664005a40 con 0x7fe668003f00 2023-11-04T01:50:11.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe679d9b640 1 -- 172.21.15.2:0/3830652348 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664005df0 con 0x7fe668003f00 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- 172.21.15.2:0/3830652348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 msgr2=0x7fe6680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 --2- 172.21.15.2:0/3830652348 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe6680047d0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe66400c2c0 tx=0x7fe66401cc70 comp rx=0 tx=0).stop 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe67ad9d640 1 -- 172.21.15.2:0/3830652348 reap_dead start 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- 172.21.15.2:0/3830652348 shutdown_connections 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- 172.21.15.2:0/3830652348 >> 172.21.15.2:0/3830652348 conn(0x7fe67c0ceb50 msgr2=0x7fe67c0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- 172.21.15.2:0/3830652348 shutdown_connections 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- 172.21.15.2:0/3830652348 wait complete. 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 Processor -- start 2023-11-04T01:50:11.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- start start 2023-11-04T01:50:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe67c0b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c14ed50 0x7fe67c14f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67c151690 0x7fe67c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c0c5d50 con 0x7fe668003f00 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c1523a0 con 0x7fe67c151690 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe680f48640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67c152680 con 0x7fe67c14ed50 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.153+0000 7fe67a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe67c0b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe67c0b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39792/0 (socket says 172.21.15.2:39792) 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 -- 172.21.15.2:0/2922477395 learned_addr learned my addr 172.21.15.2:0/2922477395 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67ad9d640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67c151690 0x7fe67c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe671d9b640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c14ed50 0x7fe67c14f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 -- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c14ed50 msgr2=0x7fe67c14f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c14ed50 0x7fe67c14f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 -- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67c151690 msgr2=0x7fe67c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67c151690 0x7fe67c151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 -- 172.21.15.2:0/2922477395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c152960 con 0x7fe668003f00 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe67a59c640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe67c0b2ff0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00f350 tx=0x7fe66c00f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe6737fe640 1 -- 172.21.15.2:0/2922477395 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c017600 con 0x7fe668003f00 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe6737fe640 1 -- 172.21.15.2:0/2922477395 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c011040 con 0x7fe668003f00 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67c152c40 con 0x7fe668003f00 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe6737fe640 1 -- 172.21.15.2:0/2922477395 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0179c0 con 0x7fe668003f00 2023-11-04T01:50:11.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67c152030 con 0x7fe668003f00 2023-11-04T01:50:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67c04e4a0 con 0x7fe668003f00 2023-11-04T01:50:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe6737fe640 1 -- 172.21.15.2:0/2922477395 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe66c017b20 con 0x7fe668003f00 2023-11-04T01:50:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe6737fe640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe65c0664d0 0x7fe65c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe6737fe640 1 -- 172.21.15.2:0/2922477395 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7877+0+0 (secure 0 0 0) 0x7fe66c084db0 con 0x7fe668003f00 2023-11-04T01:50:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe671d9b640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe65c0664d0 0x7fe65c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:11.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.157+0000 7fe671d9b640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe65c0664d0 0x7fe65c068990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe6640aa000 tx=0x7fe664001a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:11.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.161+0000 7fe6737fe640 1 -- 172.21.15.2:0/2922477395 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe66c051a70 con 0x7fe668003f00 2023-11-04T01:50:11.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.349+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe67c0ce930 con 0x7fe668003f00 2023-11-04T01:50:11.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.349+0000 7fe6737fe640 1 -- 172.21.15.2:0/2922477395 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4925 (secure 0 0 0) 0x7fe66c01c070 con 0x7fe668003f00 2023-11-04T01:50:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:11.352 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:10.139968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:11.352 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 119 2023-11-04T01:50:11.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe65c0664d0 msgr2=0x7fe65c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:11.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe65c0664d0 0x7fe65c068990 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe6640aa000 tx=0x7fe664001a10 comp rx=0 tx=0).stop 2023-11-04T01:50:11.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 msgr2=0x7fe67c0b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:11.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe67c0b2ff0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00f350 tx=0x7fe66c00f810 comp rx=0 tx=0).stop 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 shutdown_connections 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fe65c0664d0 0x7fe65c068990 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe67c151690 0x7fe67c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fe67c14ed50 0x7fe67c14f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 --2- 172.21.15.2:0/2922477395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe668003f00 0x7fe67c0b2ff0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 >> 172.21.15.2:0/2922477395 conn(0x7fe67c0ceb50 msgr2=0x7fe67c159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 shutdown_connections 2023-11-04T01:50:11.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:11.353+0000 7fe680f48640 1 -- 172.21.15.2:0/2922477395 wait complete. 2023-11-04T01:50:11.370 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:50:15.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-04T01:50:16.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509e6ab640 1 Processor -- start 2023-11-04T01:50:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509e6ab640 1 -- start start 2023-11-04T01:50:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509e6ab640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 0x7f50980b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509e6ab640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50980b2fa0 con 0x7f509815b030 2023-11-04T01:50:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509e6ab640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50980cb460 con 0x7f5098070310 2023-11-04T01:50:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509e6ab640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50980ca500 con 0x7f50980caa00 2023-11-04T01:50:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5097fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f509815b030 0x7f50980b2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:53488/0 (socket says 172.21.15.2:53488) 2023-11-04T01:50:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5097fff640 1 -- 172.21.15.2:0/779092600 learned_addr learned my addr 172.21.15.2:0/779092600 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509cc48640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 0x7f50980b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931524907 0 0) 0x7f50980b2fa0 con 0x7f509815b030 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5084003530 con 0x7f509815b030 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422555122 0 0) 0x7f5084003530 con 0x7f509815b030 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 msgr2=0x7f50980b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 0x7f50980b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 >> v1:172.21.15.90:6789/0 conn(0x7f5098070310 legacy=0x7f509806a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50980707d0 con 0x7f509815b030 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f5088001680 con 0x7f509815b030 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 >> v1:172.21.15.2:6789/0 conn(0x7f509815b030 legacy=0x7f50980b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50840039b0 0x7f5084003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 0x7f50840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f5084005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50980ca500 con 0x7f5084004d10 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508400b990 con 0x7f50840039b0 2023-11-04T01:50:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508400bb50 con 0x7f50980caa00 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509cc48640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f5084005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f50977fe640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 0x7f50840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5097fff640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50840039b0 0x7f5084003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509cc48640 1 -- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 msgr2=0x7f50840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509cc48640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980caa00 0x7f50840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509cc48640 1 -- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50840039b0 msgr2=0x7f5084003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509cc48640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50840039b0 0x7f5084003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f509cc48640 1 -- 172.21.15.2:0/779092600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084003530 con 0x7f5084004d10 2023-11-04T01:50:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.505+0000 7f5097fff640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50840039b0 0x7f5084003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509cc48640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f5084005190 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f5090009fc0 tx=0x7f509001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14af1895946956b server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900a5c70 con 0x7f5084004d10 2023-11-04T01:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000f040 con 0x7f5084004d10 2023-11-04T01:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f5096ffd640 1 -- 172.21.15.2:0/779092600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900ad440 con 0x7f5084004d10 2023-11-04T01:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 -- 172.21.15.2:0/779092600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 msgr2=0x7f5084005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 --2- 172.21.15.2:0/779092600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f5084005190 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f5090009fc0 tx=0x7f509001cc60 comp rx=0 tx=0).stop 2023-11-04T01:50:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509cc48640 1 -- 172.21.15.2:0/779092600 reap_dead start 2023-11-04T01:50:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 -- 172.21.15.2:0/779092600 shutdown_connections 2023-11-04T01:50:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 -- 172.21.15.2:0/779092600 >> 172.21.15.2:0/779092600 conn(0x7f50980b1050 msgr2=0x7f50980b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 -- 172.21.15.2:0/779092600 shutdown_connections 2023-11-04T01:50:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 -- 172.21.15.2:0/779092600 wait complete. 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 Processor -- start 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.509+0000 7f509e6ab640 1 -- start start 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f509814db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980c8160 0x7f5098154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50981f3fd0 0x7f50981f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981f4990 con 0x7f5084004d10 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509814d8e0 con 0x7f50981f3fd0 2023-11-04T01:50:16.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5098154db0 con 0x7f50980c8160 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f509814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f509814db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41998/0 (socket says 172.21.15.2:41998) 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 -- 172.21.15.2:0/2574308113 learned_addr learned my addr 172.21.15.2:0/2574308113 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509cc48640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50981f3fd0 0x7f50981f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f50977fe640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980c8160 0x7f5098154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 -- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980c8160 msgr2=0x7f5098154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980c8160 0x7f5098154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 -- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50981f3fd0 msgr2=0x7f50981f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50981f3fd0 0x7f50981f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 -- 172.21.15.2:0/2574308113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50980c8700 con 0x7f5084004d10 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f50977fe640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980c8160 0x7f5098154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5097fff640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f509814db70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f5088010c30 tx=0x7f508800e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:16.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5094ff9640 1 -- 172.21.15.2:0/2574308113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088010e40 con 0x7f5084004d10 2023-11-04T01:50:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5094ff9640 1 -- 172.21.15.2:0/2574308113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50880143a0 con 0x7f5084004d10 2023-11-04T01:50:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509814e6a0 con 0x7f5084004d10 2023-11-04T01:50:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5094ff9640 1 -- 172.21.15.2:0/2574308113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088014710 con 0x7f5084004d10 2023-11-04T01:50:16.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509814ec60 con 0x7f5084004d10 2023-11-04T01:50:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509814ee20 con 0x7f5084004d10 2023-11-04T01:50:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.513+0000 7f5094ff9640 1 -- 172.21.15.2:0/2574308113 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5088014870 con 0x7f5084004d10 2023-11-04T01:50:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.517+0000 7f5094ff9640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50780664a0 0x7f5078068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.517+0000 7f5094ff9640 1 -- 172.21.15.2:0/2574308113 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7933+0+0 (secure 0 0 0) 0x7f5088087bf0 con 0x7f5084004d10 2023-11-04T01:50:16.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.517+0000 7f50977fe640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50780664a0 0x7f5078068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:16.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.517+0000 7f50977fe640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50780664a0 0x7f5078068960 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f509814d5d0 tx=0x7f5080009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:16.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.517+0000 7f5094ff9640 1 -- 172.21.15.2:0/2574308113 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5088054830 con 0x7f5084004d10 2023-11-04T01:50:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.705+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f509814e500 con 0x7f5084004d10 2023-11-04T01:50:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f5094ff9640 1 -- 172.21.15.2:0/2574308113 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4925 (secure 0 0 0) 0x7f509814e500 con 0x7f5084004d10 2023-11-04T01:50:16.711 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:16.711 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:10.139968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 119 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50780664a0 msgr2=0x7f5078068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50780664a0 0x7f5078068960 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f509814d5d0 tx=0x7f5080009040 comp rx=0 tx=0).stop 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 msgr2=0x7f509814db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f509814db70 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f5088010c30 tx=0x7f508800e4d0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 shutdown_connections 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f50780664a0 0x7f5078068960 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f50981f3fd0 0x7f50981f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f50980c8160 0x7f5098154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 --2- 172.21.15.2:0/2574308113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5084004d10 0x7f509814db70 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 >> 172.21.15.2:0/2574308113 conn(0x7f50980b1050 msgr2=0x7f509815a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 shutdown_connections 2023-11-04T01:50:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:16.709+0000 7f509e6ab640 1 -- 172.21.15.2:0/2574308113 wait complete. 2023-11-04T01:50:16.729 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:50:21.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:21.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~7s 2023-11-04T01:50:21.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 Processor -- start 2023-11-04T01:50:21.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 -- start start 2023-11-04T01:50:21.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feabc0cb8b0 0x7feabc0cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feabc0ccd70 0x7feabc1651a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc161bb0 con 0x7feabc0ccd70 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc0cd200 con 0x7feabc0cb8b0 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac32de640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc161da0 con 0x7feabc162860 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feabc0ccd70 0x7feabc1651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7feabc0ccd70 0x7feabc1651a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50744/0 (socket says 172.21.15.2:50744) 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 -- 172.21.15.2:0/171193096 learned_addr learned my addr 172.21.15.2:0/171193096 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac0879640 1 --2- 172.21.15.2:0/171193096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac107a640 1 --2- 172.21.15.2:0/171193096 >> v2:172.21.15.90:3300/0 conn(0x7feabc0cb8b0 0x7feabc0cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 -- 172.21.15.2:0/171193096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 msgr2=0x7feabc0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:21.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 --2- 172.21.15.2:0/171193096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 -- 172.21.15.2:0/171193096 >> v2:172.21.15.90:3300/0 conn(0x7feabc0cb8b0 msgr2=0x7feabc0cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:21.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 --2- 172.21.15.2:0/171193096 >> v2:172.21.15.90:3300/0 conn(0x7feabc0cb8b0 0x7feabc0cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac187b640 1 -- 172.21.15.2:0/171193096 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc165ed0 con 0x7feabc0ccd70 2023-11-04T01:50:21.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.865+0000 7feac107a640 1 --2- 172.21.15.2:0/171193096 >> v2:172.21.15.90:3300/0 conn(0x7feabc0cb8b0 0x7feabc0cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac187b640 1 --2- 172.21.15.2:0/171193096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0ccd70 0x7feabc1651a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7feabc06dcf0 tx=0x7feab401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bd33748807ccc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feab3fff640 1 -- 172.21.15.2:0/171193096 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40a5850 con 0x7feabc0ccd70 2023-11-04T01:50:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feab3fff640 1 -- 172.21.15.2:0/171193096 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab40a59b0 con 0x7feabc0ccd70 2023-11-04T01:50:21.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feab3fff640 1 -- 172.21.15.2:0/171193096 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40a5d40 con 0x7feabc0ccd70 2023-11-04T01:50:21.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- 172.21.15.2:0/171193096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0ccd70 msgr2=0x7feabc1651a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:21.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 --2- 172.21.15.2:0/171193096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0ccd70 0x7feabc1651a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7feabc06dcf0 tx=0x7feab401c9d0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- 172.21.15.2:0/171193096 shutdown_connections 2023-11-04T01:50:21.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 --2- 172.21.15.2:0/171193096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0ccd70 0x7feabc1651a0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 --2- 172.21.15.2:0/171193096 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 --2- 172.21.15.2:0/171193096 >> v2:172.21.15.90:3300/0 conn(0x7feabc0cb8b0 0x7feabc0cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- 172.21.15.2:0/171193096 >> 172.21.15.2:0/171193096 conn(0x7feabc0b0890 msgr2=0x7feabc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- 172.21.15.2:0/171193096 shutdown_connections 2023-11-04T01:50:21.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- 172.21.15.2:0/171193096 wait complete. 2023-11-04T01:50:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 Processor -- start 2023-11-04T01:50:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- start start 2023-11-04T01:50:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0cb8b0 0x7feabc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feabc0ccd70 0x7feabc164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1635b0 con 0x7feabc0cb8b0 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1643f0 con 0x7feabc0ccd70 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac32de640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1637e0 con 0x7feabc162860 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0cb8b0 0x7feabc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0cb8b0 0x7feabc157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50750/0 (socket says 172.21.15.2:50750) 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 -- 172.21.15.2:0/1514061733 learned_addr learned my addr 172.21.15.2:0/1514061733 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac0879640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feabc0ccd70 0x7feabc164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac187b640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 -- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 msgr2=0x7feabc159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 -- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feabc0ccd70 msgr2=0x7feabc164880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feabc0ccd70 0x7feabc164880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.869+0000 7feac107a640 1 -- 172.21.15.2:0/1514061733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009b30 con 0x7feabc0cb8b0 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feac107a640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0cb8b0 0x7feabc157a80 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7feab800c7f0 tx=0x7feab800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feab1ffb640 1 -- 172.21.15.2:0/1514061733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8007820 con 0x7feabc0cb8b0 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feab1ffb640 1 -- 172.21.15.2:0/1514061733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab8007980 con 0x7feabc0cb8b0 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc163ac0 con 0x7feabc0cb8b0 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feab1ffb640 1 -- 172.21.15.2:0/1514061733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab8007d30 con 0x7feabc0cb8b0 2023-11-04T01:50:21.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc164080 con 0x7feabc0cb8b0 2023-11-04T01:50:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc04e4a0 con 0x7feabc0cb8b0 2023-11-04T01:50:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feab1ffb640 1 -- 172.21.15.2:0/1514061733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feab8024480 con 0x7feabc0cb8b0 2023-11-04T01:50:21.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feab1ffb640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feaa00664a0 0x7feaa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feab1ffb640 1 -- 172.21.15.2:0/1514061733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7feab8084e30 con 0x7feabc0cb8b0 2023-11-04T01:50:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feac0879640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feaa00664a0 0x7feaa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:21.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.873+0000 7feac0879640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feaa00664a0 0x7feaa0068960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7feabc0ccc70 tx=0x7feaac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:21.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:21.877+0000 7feab1ffb640 1 -- 172.21.15.2:0/1514061733 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7feab8051a60 con 0x7feabc0cb8b0 2023-11-04T01:50:22.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feabc06cf10 con 0x7feabc0cb8b0 2023-11-04T01:50:22.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feab1ffb640 1 -- 172.21.15.2:0/1514061733 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4925 (secure 0 0 0) 0x7feab801f070 con 0x7feabc0cb8b0 2023-11-04T01:50:22.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:22.067 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:10.139968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:22.067 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 119 2023-11-04T01:50:22.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feaa00664a0 msgr2=0x7feaa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:22.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feaa00664a0 0x7feaa0068960 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7feabc0ccc70 tx=0x7feaac008040 comp rx=0 tx=0).stop 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0cb8b0 msgr2=0x7feabc157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0cb8b0 0x7feabc157a80 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7feab800c7f0 tx=0x7feab800ccb0 comp rx=0 tx=0).stop 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 shutdown_connections 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7feaa00664a0 0x7feaa0068960 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7feabc162860 0x7feabc159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feabc0ccd70 0x7feabc164880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 --2- 172.21.15.2:0/1514061733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feabc0cb8b0 0x7feabc157a80 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 >> 172.21.15.2:0/1514061733 conn(0x7feabc0b0890 msgr2=0x7feabc0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.065+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 shutdown_connections 2023-11-04T01:50:22.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:22.069+0000 7feac32de640 1 -- 172.21.15.2:0/1514061733 wait complete. 2023-11-04T01:50:22.085 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:50:25.346 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:25.349 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:27.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:27.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.217+0000 7fd79124e640 1 Processor -- start 2023-11-04T01:50:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd79124e640 1 -- start start 2023-11-04T01:50:27.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd79124e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 0x7fd78c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd79124e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd78c06c1c0 0x7fd78c1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd79124e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c0c9ac0 con 0x7fd78c06bde0 2023-11-04T01:50:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd79124e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c0caf20 con 0x7fd78c06c1c0 2023-11-04T01:50:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd79124e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0c97e0 con 0x7fd78c0c92b0 2023-11-04T01:50:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd78c06bde0 0x7fd78c15c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:55758/0 (socket says 172.21.15.2:55758) 2023-11-04T01:50:27.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 -- 172.21.15.2:0/4232666212 learned_addr learned my addr 172.21.15.2:0/4232666212 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78259c640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 0x7fd78c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78b59e640 1 --2- 172.21.15.2:0/4232666212 >> v2:172.21.15.90:3300/0 conn(0x7fd78c06c1c0 0x7fd78c1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020906455 0 0) 0x7fd78c0c9ac0 con 0x7fd78c06bde0 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd778003530 con 0x7fd78c06bde0 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 897427490 0 0) 0x7fd778003530 con 0x7fd78c06bde0 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 msgr2=0x7fd78c0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 0x7fd78c0cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 >> v2:172.21.15.90:3300/0 conn(0x7fd78c06c1c0 msgr2=0x7fd78c1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:27.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 --2- 172.21.15.2:0/4232666212 >> v2:172.21.15.90:3300/0 conn(0x7fd78c06c1c0 0x7fd78c1442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0cb1c0 con 0x7fd78c06bde0 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fd77c001680 con 0x7fd78c06bde0 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 >> v1:172.21.15.2:6789/0 conn(0x7fd78c06bde0 legacy=0x7fd78c15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd778003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 0x7fd7780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd778004d10 0x7fd778005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0caf20 con 0x7fd778003980 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0c97e0 con 0x7fd778004d10 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77800b9c0 con 0x7fd78c0c92b0 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78b59e640 1 --2- 172.21.15.2:0/4232666212 >> v2:172.21.15.90:3300/0 conn(0x7fd78c06c1c0 0x7fd78c1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd778003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:27.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78b59e640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd778004d10 0x7fd778005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 -- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 msgr2=0x7fd7780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78259c640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 0x7fd7780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 0x7fd7780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 -- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd778004d10 msgr2=0x7fd778005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd778004d10 0x7fd778005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78ad9d640 1 -- 172.21.15.2:0/4232666212 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778003530 con 0x7fd778003980 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78b59e640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd778004d10 0x7fd778005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:27.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.221+0000 7fd78259c640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c0c92b0 0x7fd7780047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78ad9d640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd778003da0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c1c0 tx=0x7fd77c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de38975531cff3a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:27.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c005ae0 con 0x7fd778003980 2023-11-04T01:50:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c005c40 con 0x7fd778003980 2023-11-04T01:50:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78a59c640 1 -- 172.21.15.2:0/4232666212 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c007070 con 0x7fd778003980 2023-11-04T01:50:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- 172.21.15.2:0/4232666212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 msgr2=0x7fd778003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 --2- 172.21.15.2:0/4232666212 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd778003da0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00c1c0 tx=0x7fd77c01cc20 comp rx=0 tx=0).stop 2023-11-04T01:50:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78b59e640 1 -- 172.21.15.2:0/4232666212 reap_dead start 2023-11-04T01:50:27.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- 172.21.15.2:0/4232666212 shutdown_connections 2023-11-04T01:50:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- 172.21.15.2:0/4232666212 >> 172.21.15.2:0/4232666212 conn(0x7fd78c0b0890 msgr2=0x7fd78c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- 172.21.15.2:0/4232666212 shutdown_connections 2023-11-04T01:50:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- 172.21.15.2:0/4232666212 wait complete. 2023-11-04T01:50:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 Processor -- start 2023-11-04T01:50:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- start start 2023-11-04T01:50:27.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd78c0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c13f6f0 0x7fd78c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c142720 0x7fd78c142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c0c8da0 con 0x7fd778003980 2023-11-04T01:50:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1602d0 con 0x7fd78c142720 2023-11-04T01:50:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd79124e640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1430e0 con 0x7fd78c13f6f0 2023-11-04T01:50:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd78c0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78ad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd78c0c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50760/0 (socket says 172.21.15.2:50760) 2023-11-04T01:50:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.225+0000 7fd78ad9d640 1 -- 172.21.15.2:0/1134324451 learned_addr learned my addr 172.21.15.2:0/1134324451 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78ad9d640 1 -- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c13f6f0 msgr2=0x7fd78c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78ad9d640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c13f6f0 0x7fd78c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78ad9d640 1 -- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c142720 msgr2=0x7fd78c142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78ad9d640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c142720 0x7fd78c142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78ad9d640 1 -- 172.21.15.2:0/1134324451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0b2660 con 0x7fd778003980 2023-11-04T01:50:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78ad9d640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd78c0c8860 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fd77c01ca50 tx=0x7fd778005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd783fff640 1 -- 172.21.15.2:0/1134324451 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0b4070 con 0x7fd778003980 2023-11-04T01:50:27.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd783fff640 1 -- 172.21.15.2:0/1134324451 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c005e70 con 0x7fd778003980 2023-11-04T01:50:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd783fff640 1 -- 172.21.15.2:0/1134324451 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c001640 con 0x7fd778003980 2023-11-04T01:50:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c15f9d0 con 0x7fd778003980 2023-11-04T01:50:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c15f6f0 con 0x7fd778003980 2023-11-04T01:50:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c04e4a0 con 0x7fd778003980 2023-11-04T01:50:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd783fff640 1 -- 172.21.15.2:0/1134324451 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd77c007040 con 0x7fd778003980 2023-11-04T01:50:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd783fff640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd76c0664d0 0x7fd76c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:27.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd783fff640 1 -- 172.21.15.2:0/1134324451 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7fd77c11d6a0 con 0x7fd778003980 2023-11-04T01:50:27.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78259c640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd76c0664d0 0x7fd76c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:27.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.229+0000 7fd78259c640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd76c0664d0 0x7fd76c068990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd78c1f7ab0 tx=0x7fd774008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:27.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.233+0000 7fd783fff640 1 -- 172.21.15.2:0/1134324451 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd77c0edd10 con 0x7fd778003980 2023-11-04T01:50:27.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.421+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd78c0b4c40 con 0x7fd778003980 2023-11-04T01:50:27.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.421+0000 7fd783fff640 1 -- 172.21.15.2:0/1134324451 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+4925 (secure 0 0 0) 0x7fd77c0ed8a0 con 0x7fd778003980 2023-11-04T01:50:27.424 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:27.424 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":119,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:10.139968+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:27.425 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 119 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd76c0664d0 msgr2=0x7fd76c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd76c0664d0 0x7fd76c068990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd78c1f7ab0 tx=0x7fd774008040 comp rx=0 tx=0).stop 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 msgr2=0x7fd78c0c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd78c0c8860 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fd77c01ca50 tx=0x7fd778005800 comp rx=0 tx=0).stop 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 shutdown_connections 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fd76c0664d0 0x7fd76c068990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd78c142720 0x7fd78c142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fd78c13f6f0 0x7fd78c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 --2- 172.21.15.2:0/1134324451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd778003980 0x7fd78c0c8860 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 >> 172.21.15.2:0/1134324451 conn(0x7fd78c0b0890 msgr2=0x7fd78c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:27.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 shutdown_connections 2023-11-04T01:50:27.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:27.425+0000 7fd79124e640 1 -- 172.21.15.2:0/1134324451 wait complete. 2023-11-04T01:50:27.442 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-11-04T01:50:28.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2023-11-04T01:50:32.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:50:32.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7440e51640 1 Processor -- start 2023-11-04T01:50:32.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7440e51640 1 -- start start 2023-11-04T01:50:32.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7440e51640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f743c160680 0x7f743c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7440e51640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0cf000 con 0x7f743c160a60 2023-11-04T01:50:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7440e51640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0b5de0 con 0x7f743c0ce7f0 2023-11-04T01:50:32.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7440e51640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0d09b0 con 0x7f743c160680 2023-11-04T01:50:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7439d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f743c160a60 0x7f743c0ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57140/0 (socket says 172.21.15.2:57140) 2023-11-04T01:50:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f743a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f743c160680 0x7f743c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.577+0000 7f7439d9b640 1 -- 172.21.15.2:0/2002003872 learned_addr learned my addr 172.21.15.2:0/2002003872 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743a59c640 1 -- 172.21.15.2:0/2002003872 >> v1:172.21.15.90:6789/0 conn(0x7f743c0ce7f0 legacy=0x7f743c0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743a59c640 1 -- 172.21.15.2:0/2002003872 >> v1:172.21.15.2:6789/0 conn(0x7f743c160a60 legacy=0x7f743c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743959a640 1 -- 172.21.15.2:0/2002003872 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526970082 0 0) 0x7f743c0cf000 con 0x7f743c160a60 2023-11-04T01:50:32.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743a59c640 1 -- 172.21.15.2:0/2002003872 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0d1610 con 0x7f743c160680 2023-11-04T01:50:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743a59c640 1 --2- 172.21.15.2:0/2002003872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c160680 0x7f743c0cdba0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f742c0097c0 tx=0x7f742c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede516a87ed48c5d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743959a640 1 -- 172.21.15.2:0/2002003872 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0ab650 con 0x7f743c160680 2023-11-04T01:50:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743959a640 1 -- 172.21.15.2:0/2002003872 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c0ab7b0 con 0x7f743c160680 2023-11-04T01:50:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f743959a640 1 -- 172.21.15.2:0/2002003872 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0abb40 con 0x7f743c160680 2023-11-04T01:50:32.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f7440e51640 1 -- 172.21.15.2:0/2002003872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c160680 msgr2=0x7f743c0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f7440e51640 1 --2- 172.21.15.2:0/2002003872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c160680 0x7f743c0cdba0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f742c0097c0 tx=0x7f742c01c450 comp rx=0 tx=0).stop 2023-11-04T01:50:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f7440e51640 1 -- 172.21.15.2:0/2002003872 shutdown_connections 2023-11-04T01:50:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f7440e51640 1 --2- 172.21.15.2:0/2002003872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c160680 0x7f743c0cdba0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f7440e51640 1 -- 172.21.15.2:0/2002003872 >> 172.21.15.2:0/2002003872 conn(0x7f743c0d2f90 msgr2=0x7f743c0d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f7440e51640 1 -- 172.21.15.2:0/2002003872 shutdown_connections 2023-11-04T01:50:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.581+0000 7f7440e51640 1 -- 172.21.15.2:0/2002003872 wait complete. 2023-11-04T01:50:32.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 Processor -- start 2023-11-04T01:50:32.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 -- start start 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c0ce7f0 0x7f743c1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f743c160680 0x7f743c15f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f743c160a60 0x7f743c14b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c14ced0 con 0x7f743c0ce7f0 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c15fef0 con 0x7f743c160680 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c14f0e0 con 0x7f743c160a60 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c0ce7f0 0x7f743c1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c0ce7f0 0x7f743c1537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44922/0 (socket says 172.21.15.2:44922) 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 -- 172.21.15.2:0/3159910724 learned_addr learned my addr 172.21.15.2:0/3159910724 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7439d9b640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f743c160680 0x7f743c15f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:32.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743ad9d640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f743c160a60 0x7f743c14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 -- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f743c160a60 msgr2=0x7f743c14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f743c160a60 0x7f743c14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 -- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f743c160680 msgr2=0x7f743c15f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f743c160680 0x7f743c15f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 -- 172.21.15.2:0/3159910724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c009420 con 0x7f743c0ce7f0 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f743a59c640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c0ce7f0 0x7f743c1537c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f742c0ad040 tx=0x7f742c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f742affd640 1 -- 172.21.15.2:0/3159910724 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c004220 con 0x7f743c0ce7f0 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f742affd640 1 -- 172.21.15.2:0/3159910724 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c0b9070 con 0x7f743c0ce7f0 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c14c250 con 0x7f743c0ce7f0 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f742affd640 1 -- 172.21.15.2:0/3159910724 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0ab610 con 0x7f743c0ce7f0 2023-11-04T01:50:32.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c14c810 con 0x7f743c0ce7f0 2023-11-04T01:50:32.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c04e4a0 con 0x7f743c0ce7f0 2023-11-04T01:50:32.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.585+0000 7f742affd640 1 -- 172.21.15.2:0/3159910724 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f742c003620 con 0x7f743c0ce7f0 2023-11-04T01:50:32.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.589+0000 7f742affd640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f741c0664a0 0x7f741c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:32.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.589+0000 7f742affd640 1 -- 172.21.15.2:0/3159910724 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f742c0bb070 con 0x7f743c0ce7f0 2023-11-04T01:50:32.589 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.589+0000 7f7439d9b640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f741c0664a0 0x7f741c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:32.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.589+0000 7f7439d9b640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f741c0664a0 0x7f741c068960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f743c158690 tx=0x7f7430007d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:32.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.593+0000 7f742affd640 1 -- 172.21.15.2:0/3159910724 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f742c0ebfe0 con 0x7f743c0ce7f0 2023-11-04T01:50:32.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.781+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f743c06c6d0 con 0x7f743c0ce7f0 2023-11-04T01:50:32.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.781+0000 7f742affd640 1 -- 172.21.15.2:0/3159910724 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+4973 (secure 0 0 0) 0x7f742c0c4020 con 0x7f743c0ce7f0 2023-11-04T01:50:32.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:32.784 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":120,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/2111299834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":2111299834},{"type":"v1","addr":"172.21.15.90:6836","nonce":2111299834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40},{"gid":8484,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/36191221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":36191221},{"type":"v1","addr":"172.21.15.2:6835","nonce":36191221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":115}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-11-04T01:45:35.008340+0000","modified":"2023-11-04T01:50:29.678944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":2,"in":[0,1],"up":{"mds_0":6925,"mds_1":8445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6925":{"gid":6925,"name":"d","rank":0,"incarnation":111,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6837/2981602016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2981602016},{"type":"v1","addr":"172.21.15.90:6837","nonce":2981602016}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_8445":{"gid":8445,"name":"a","rank":1,"incarnation":114,"state":"up:active","state_seq":7,"addr":"172.21.15.2:6833/2395309853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":2395309853},{"type":"v1","addr":"172.21.15.2:6833","nonce":2395309853}]},"join_fscid":-1,"laggy_since":"2023-11-04T01:50:29.678944+0000","export_targets":[],"features":4540138322906710015,"flags":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-11-04T01:50:32.784 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 120 2023-11-04T01:50:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f741c0664a0 msgr2=0x7f741c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f741c0664a0 0x7f741c068960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f743c158690 tx=0x7f7430007d10 comp rx=0 tx=0).stop 2023-11-04T01:50:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c0ce7f0 msgr2=0x7f743c1537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c0ce7f0 0x7f743c1537c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f742c0ad040 tx=0x7f742c01ac90 comp rx=0 tx=0).stop 2023-11-04T01:50:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 shutdown_connections 2023-11-04T01:50:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f741c0664a0 0x7f741c068960 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:32.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f743c160a60 0x7f743c14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f743c160680 0x7f743c15f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 --2- 172.21.15.2:0/3159910724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f743c0ce7f0 0x7f743c1537c0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 >> 172.21.15.2:0/3159910724 conn(0x7f743c0d2f90 msgr2=0x7f743c0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 shutdown_connections 2023-11-04T01:50:32.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:32.785+0000 7f7440e51640 1 -- 172.21.15.2:0/3159910724 wait complete. 2023-11-04T01:50:32.802 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-11-04T01:50:32.802 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -n kernel.core_pattern 2023-11-04T01:50:32.812 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-04T01:50:32.813 INFO:tasks.cephfs.cephfs_test_case:Clearing core from directory: /home/ubuntu/cephtest/archive/coredump 2023-11-04T01:50:32.813 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo ls | sudo xargs file 2023-11-04T01:50:32.871 INFO:teuthology.orchestra.run.smithi002.stdout:1699062610.59552.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i a', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-mds', platform: 'x86_64' 2023-11-04T01:50:32.873 INFO:tasks.cephfs.cephfs_test_case:Enumerated cores: ['1699062610.59552.core'] 2023-11-04T01:50:32.873 INFO:tasks.cephfs.cephfs_test_case:Found core file 1699062610.59552.core, deleting it 2023-11-04T01:50:32.873 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/archive/coredump && sudo rm -f 1699062610.59552.core 2023-11-04T01:50:32.934 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:50:32.934 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-04T01:50:32.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:32.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 down 2023-11-04T01:50:32.990 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:50:32.991 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:50:32.991 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:33.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:50:33.081 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:50:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:50:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff302fc9640 1 Processor -- start 2023-11-04T01:50:33.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff302fc9640 1 -- start start 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff302fc9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2fc06bde0 0x7ff2fc0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff302fc9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff302fc9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc0c9ac0 con 0x7ff2fc06c1c0 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff302fc9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0caf20 con 0x7ff2fc06bde0 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff302fc9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc15c5d0 con 0x7ff2fc0c92b0 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff300d65640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2fc06bde0 0x7ff2fc0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff301566640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff2fc06c1c0 0x7ff2fc1442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57156/0 (socket says 172.21.15.2:57156) 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff301566640 1 -- 172.21.15.2:0/3456091028 learned_addr learned my addr 172.21.15.2:0/3456091028 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff2fbfff640 1 --2- 172.21.15.2:0/3456091028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff300d65640 1 -- 172.21.15.2:0/3456091028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 msgr2=0x7ff2fc15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff300d65640 1 --2- 172.21.15.2:0/3456091028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff300d65640 1 -- 172.21.15.2:0/3456091028 >> v1:172.21.15.2:6789/0 conn(0x7ff2fc06c1c0 legacy=0x7ff2fc1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff300d65640 1 -- 172.21.15.2:0/3456091028 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0c97e0 con 0x7ff2fc06bde0 2023-11-04T01:50:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff2fb7fe640 1 -- 172.21.15.2:0/3456091028 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927361032 0 0) 0x7ff2fc0c9ac0 con 0x7ff2fc06c1c0 2023-11-04T01:50:33.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.205+0000 7ff2fbfff640 1 --2- 172.21.15.2:0/3456091028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff300d65640 1 --2- 172.21.15.2:0/3456091028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0cbca0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097c0 tx=0x7ff2ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63e89acce8a6d33 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff2fb7fe640 1 -- 172.21.15.2:0/3456091028 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0ab600 con 0x7ff2fc06bde0 2023-11-04T01:50:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff2fb7fe640 1 -- 172.21.15.2:0/3456091028 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec0a7050 con 0x7ff2fc06bde0 2023-11-04T01:50:33.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff2fb7fe640 1 -- 172.21.15.2:0/3456091028 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0ab980 con 0x7ff2fc06bde0 2023-11-04T01:50:33.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- 172.21.15.2:0/3456091028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 msgr2=0x7ff2fc0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3456091028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0cbca0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097c0 tx=0x7ff2ec01c480 comp rx=0 tx=0).stop 2023-11-04T01:50:33.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- 172.21.15.2:0/3456091028 shutdown_connections 2023-11-04T01:50:33.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3456091028 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3456091028 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0cbca0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- 172.21.15.2:0/3456091028 >> 172.21.15.2:0/3456091028 conn(0x7ff2fc0b0890 msgr2=0x7ff2fc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- 172.21.15.2:0/3456091028 shutdown_connections 2023-11-04T01:50:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- 172.21.15.2:0/3456091028 wait complete. 2023-11-04T01:50:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 Processor -- start 2023-11-04T01:50:33.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- start start 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2fc06c1c0 0x7ff2fc0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0c67f0 con 0x7ff2fc06bde0 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0c6ad0 con 0x7ff2fc06c1c0 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff302fc9640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0c6db0 con 0x7ff2fc0c92b0 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff300d65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff300d65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44940/0 (socket says 172.21.15.2:44940) 2023-11-04T01:50:33.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.209+0000 7ff300d65640 1 -- 172.21.15.2:0/3656007215 learned_addr learned my addr 172.21.15.2:0/3656007215 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff301566640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2fbfff640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2fc06c1c0 0x7ff2fc0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff300d65640 1 -- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 msgr2=0x7ff2fc15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff300d65640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff300d65640 1 -- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2fc06c1c0 msgr2=0x7ff2fc0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff300d65640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2fc06c1c0 0x7ff2fc0c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff300d65640 1 -- 172.21.15.2:0/3656007215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec009420 con 0x7ff2fc06bde0 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2fbfff640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2fc06c1c0 0x7ff2fc0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff300d65640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0b3e30 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0ae040 tx=0x7ff2ec01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2f97fa640 1 -- 172.21.15.2:0/3656007215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0b7650 con 0x7ff2fc06bde0 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2f97fa640 1 -- 172.21.15.2:0/3656007215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec0abe90 con 0x7ff2fc06bde0 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc0c7090 con 0x7ff2fc06bde0 2023-11-04T01:50:33.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2f97fa640 1 -- 172.21.15.2:0/3656007215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0b7a10 con 0x7ff2fc06bde0 2023-11-04T01:50:33.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc13d4a0 con 0x7ff2fc06bde0 2023-11-04T01:50:33.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc04e4a0 con 0x7ff2fc06bde0 2023-11-04T01:50:33.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2f97fa640 1 -- 172.21.15.2:0/3656007215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2ec0b7b70 con 0x7ff2fc06bde0 2023-11-04T01:50:33.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2f97fa640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664d0 0x7ff2dc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2f97fa640 1 -- 172.21.15.2:0/3656007215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7ff2ec11f060 con 0x7ff2fc06bde0 2023-11-04T01:50:33.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2fbfff640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664d0 0x7ff2dc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.216 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.213+0000 7ff2fbfff640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664d0 0x7ff2dc068990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0c8e50 tx=0x7ff2e4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.217+0000 7ff2f97fa640 1 -- 172.21.15.2:0/3656007215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2ec0ebbb0 con 0x7ff2fc06bde0 2023-11-04T01:50:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.373+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2fc06cf10 con 0x7ff2fc06bde0 2023-11-04T01:50:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff2f97fa640 1 -- 172.21.15.2:0/3656007215 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+23444 (secure 0 0 0) 0x7ff2ec0ef1d0 con 0x7ff2fc06bde0 2023-11-04T01:50:33.377 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:33.377 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:50:19.674243+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.f","mappings":[{"from":2,"to":3}]},{"pgid":"16.12","mappings":[{"from":4,"to":3}]},{"pgid":"16.39","mappings":[{"from":4,"to":6}]},{"pgid":"16.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4169282097":"2023-11-04T02:50:00.880111+0000","172.21.15.2:6833/3695355178":"2023-11-05T01:49:53.201635+0000","192.168.0.1:0/2988241810":"2023-11-04T02:49:10.916906+0000","172.21.15.90:6837/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.90:6834/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.2:6833/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6837/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.2:6832/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.2:6833/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.90:6834/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6834/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.2:6832/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6834/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.90:6837/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6834/2449846925":"2023-11-05T01:49:45.775757+0000","172.21.15.2:6832/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.90:6834/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6833/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.2:6832/3695355178":"2023-11-05T01:49:53.201635+0000","172.21.15.90:6837/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6835/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.2:6835/2449846925":"2023-11-05T01:49:45.775757+0000","192.168.0.1:0/2023608941":"2023-11-04T02:48:20.721790+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664d0 msgr2=0x7ff2dc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664d0 0x7ff2dc068990 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0c8e50 tx=0x7ff2e4008040 comp rx=0 tx=0).stop 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 msgr2=0x7ff2fc0b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0b3e30 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0ae040 tx=0x7ff2ec01acc0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 shutdown_connections 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664d0 0x7ff2dc068990 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2fc0c92b0 0x7ff2fc15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2fc06c1c0 0x7ff2fc0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 --2- 172.21.15.2:0/3656007215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2fc06bde0 0x7ff2fc0b3e30 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 >> 172.21.15.2:0/3656007215 conn(0x7ff2fc0b0890 msgr2=0x7ff2fc15b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 shutdown_connections 2023-11-04T01:50:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.377+0000 7ff302fc9640 1 -- 172.21.15.2:0/3656007215 wait complete. 2023-11-04T01:50:33.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:45:33.227500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:45:34.004628+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 111, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:50:33.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:50:33.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.509+0000 7f48f0685640 1 Processor -- start 2023-11-04T01:50:33.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48f0685640 1 -- start start 2023-11-04T01:50:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48f0685640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 0x7f48e80b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48f0685640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e80ccdf0 con 0x7f48e80caaa0 2023-11-04T01:50:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48f0685640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e80b0750 con 0x7f48e80c9a70 2023-11-04T01:50:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48f0685640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e806fe50 con 0x7f48e815d410 2023-11-04T01:50:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48edc20640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f48e80caaa0 0x7f48e80c9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57166/0 (socket says 172.21.15.2:57166) 2023-11-04T01:50:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48edc20640 1 -- 172.21.15.2:0/4236433405 learned_addr learned my addr 172.21.15.2:0/4236433405 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:33.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ee421640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 0x7f48e80b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661115185 0 0) 0x7f48e80ccdf0 con 0x7f48e80caaa0 2023-11-04T01:50:33.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d4003530 con 0x7f48e80caaa0 2023-11-04T01:50:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 590958219 0 0) 0x7f48d4003530 con 0x7f48e80caaa0 2023-11-04T01:50:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 msgr2=0x7f48e80b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.516 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 0x7f48e80b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 >> v1:172.21.15.90:6789/0 conn(0x7f48e80c9a70 legacy=0x7f48e80cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80ae960 con 0x7f48e80caaa0 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f48d8001680 con 0x7f48e80caaa0 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 >> v1:172.21.15.2:6789/0 conn(0x7f48e80caaa0 legacy=0x7f48e80c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d40039b0 0x7f48d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 0x7f48d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d400ba40 con 0x7f48d40039b0 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d400bb80 con 0x7f48d4004d10 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d400bd40 con 0x7f48e815d410 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ee421640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d40039b0 0x7f48d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48edc20640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 0x7f48d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.517 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48eec22640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ee421640 1 -- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 msgr2=0x7f48d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ee421640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e815d410 0x7f48d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ee421640 1 -- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4004d10 msgr2=0x7f48d4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ee421640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48ee421640 1 -- 172.21.15.2:0/4236433405 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4003530 con 0x7f48d40039b0 2023-11-04T01:50:33.518 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.513+0000 7f48eec22640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48ee421640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d40039b0 0x7f48d4003dd0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f48e40093e0 tx=0x7f48e401ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6028f128bf3f1a16 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40a7620 con 0x7f48d40039b0 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e40a7780 con 0x7f48d40039b0 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48ed41f640 1 -- 172.21.15.2:0/4236433405 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40a7b30 con 0x7f48d40039b0 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 -- 172.21.15.2:0/4236433405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d40039b0 msgr2=0x7f48d4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 --2- 172.21.15.2:0/4236433405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48d40039b0 0x7f48d4003dd0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f48e40093e0 tx=0x7f48e401ec40 comp rx=0 tx=0).stop 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48eec22640 1 -- 172.21.15.2:0/4236433405 reap_dead start 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 -- 172.21.15.2:0/4236433405 shutdown_connections 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 -- 172.21.15.2:0/4236433405 >> 172.21.15.2:0/4236433405 conn(0x7f48e80ced10 msgr2=0x7f48e80cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 -- 172.21.15.2:0/4236433405 shutdown_connections 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 -- 172.21.15.2:0/4236433405 wait complete. 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 Processor -- start 2023-11-04T01:50:33.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 -- start start 2023-11-04T01:50:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d40039b0 0x7f48e81f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.517+0000 7f48f0685640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e8150f90 0x7f48e80b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48f0685640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e80c41c0 0x7f48e80c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48f0685640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e81f5960 con 0x7f48e80c41c0 2023-11-04T01:50:33.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48f0685640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80b4990 con 0x7f48d40039b0 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48f0685640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80c3440 con 0x7f48e8150f90 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e80c41c0 0x7f48e80c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e80c41c0 0x7f48e80c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44958/0 (socket says 172.21.15.2:44958) 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 -- 172.21.15.2:0/1307273928 learned_addr learned my addr 172.21.15.2:0/1307273928 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48ee421640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d40039b0 0x7f48e81f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48edc20640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e8150f90 0x7f48e80b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 -- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e8150f90 msgr2=0x7f48e80b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e8150f90 0x7f48e80b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 -- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d40039b0 msgr2=0x7f48e81f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d40039b0 0x7f48e81f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 -- 172.21.15.2:0/1307273928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80c7d20 con 0x7f48e80c41c0 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48eec22640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e80c41c0 0x7f48e80c4650 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f48e80680c0 tx=0x7f48e000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48deffd640 1 -- 172.21.15.2:0/1307273928 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0006d60 con 0x7f48e80c41c0 2023-11-04T01:50:33.523 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48deffd640 1 -- 172.21.15.2:0/1307273928 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0003980 con 0x7f48e80c41c0 2023-11-04T01:50:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e80c36e0 con 0x7f48e80c41c0 2023-11-04T01:50:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48deffd640 1 -- 172.21.15.2:0/1307273928 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0003d30 con 0x7f48e80c41c0 2023-11-04T01:50:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e80c3ca0 con 0x7f48e80c41c0 2023-11-04T01:50:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e804e4a0 con 0x7f48e80c41c0 2023-11-04T01:50:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48deffd640 1 -- 172.21.15.2:0/1307273928 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f48e0005070 con 0x7f48e80c41c0 2023-11-04T01:50:33.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48deffd640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48cc0664a0 0x7f48cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48deffd640 1 -- 172.21.15.2:0/1307273928 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f48e0084530 con 0x7f48e80c41c0 2023-11-04T01:50:33.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48ee421640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48cc0664a0 0x7f48cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.521+0000 7f48ee421640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48cc0664a0 0x7f48cc068960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f48e40b1000 tx=0x7f48e40046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.525+0000 7f48deffd640 1 -- 172.21.15.2:0/1307273928 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f48e0051120 con 0x7f48e80c41c0 2023-11-04T01:50:33.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.681+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48e80c3e60 con 0x7f48e80c41c0 2023-11-04T01:50:33.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.681+0000 7f48deffd640 1 -- 172.21.15.2:0/1307273928 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48e0054740 con 0x7f48e80c41c0 2023-11-04T01:50:33.683 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48cc0664a0 msgr2=0x7f48cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48cc0664a0 0x7f48cc068960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f48e40b1000 tx=0x7f48e40046d0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e80c41c0 msgr2=0x7f48e80c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e80c41c0 0x7f48e80c4650 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f48e80680c0 tx=0x7f48e000dc00 comp rx=0 tx=0).stop 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 shutdown_connections 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f48cc0664a0 0x7f48cc068960 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48e80c41c0 0x7f48e80c4650 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f48e8150f90 0x7f48e80b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 --2- 172.21.15.2:0/1307273928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d40039b0 0x7f48e81f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 >> 172.21.15.2:0/1307273928 conn(0x7f48e80ced10 msgr2=0x7f48e8070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:33.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 shutdown_connections 2023-11-04T01:50:33.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.685+0000 7f48f0685640 1 -- 172.21.15.2:0/1307273928 wait complete. 2023-11-04T01:50:33.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:50:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.829+0000 7f8191fb7640 1 Processor -- start 2023-11-04T01:50:33.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.829+0000 7f8191fb7640 1 -- start start 2023-11-04T01:50:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f8191fb7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c0cddd0 0x7f818c0cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f8191fb7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f818c15ddd0 0x7f818c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f8191fb7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c15ebb0 con 0x7f818c0cd9f0 2023-11-04T01:50:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f8191fb7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c1613c0 con 0x7f818c15ddd0 2023-11-04T01:50:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f8191fb7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c1616a0 con 0x7f818c0cddd0 2023-11-04T01:50:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f818c0cd9f0 0x7f818c0ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57176/0 (socket says 172.21.15.2:57176) 2023-11-04T01:50:33.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 -- 172.21.15.2:0/1972186048 learned_addr learned my addr 172.21.15.2:0/1972186048 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818affd640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c0cddd0 0x7f818c0cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818bfff640 1 --2- 172.21.15.2:0/1972186048 >> v2:172.21.15.90:3300/0 conn(0x7f818c15ddd0 0x7f818c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986133039 0 0) 0x7f818c15ebb0 con 0x7f818c0cd9f0 2023-11-04T01:50:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8174003530 con 0x7f818c0cd9f0 2023-11-04T01:50:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3819207261 0 0) 0x7f8174003530 con 0x7f818c0cd9f0 2023-11-04T01:50:33.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c0cddd0 msgr2=0x7f818c0cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c0cddd0 0x7f818c0cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 >> v2:172.21.15.90:3300/0 conn(0x7f818c15ddd0 msgr2=0x7f818c15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 --2- 172.21.15.2:0/1972186048 >> v2:172.21.15.90:3300/0 conn(0x7f818c15ddd0 0x7f818c15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c161980 con 0x7f818c0cd9f0 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f817c001680 con 0x7f818c0cd9f0 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 >> v1:172.21.15.2:6789/0 conn(0x7f818c0cd9f0 legacy=0x7f818c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8174003980 0x7f8174003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81740047d0 0x7f8174004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c0cddd0 0x7f8174005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c1613c0 con 0x7f8174003980 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c1616a0 con 0x7f81740047d0 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817400b990 con 0x7f818c0cddd0 2023-11-04T01:50:33.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8174003980 0x7f8174003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818affd640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81740047d0 0x7f8174004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 -- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c0cddd0 msgr2=0x7f8174005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f818c0cddd0 0x7f8174005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 -- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81740047d0 msgr2=0x7f8174004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:33.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81740047d0 0x7f8174004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.833+0000 7f818b7fe640 1 -- 172.21.15.2:0/1972186048 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174003530 con 0x7f8174003980 2023-11-04T01:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818b7fe640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8174003980 0x7f8174003da0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c290 tx=0x7f817c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38e2b8727616f64 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c0058e0 con 0x7f8174003980 2023-11-04T01:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c005a40 con 0x7f8174003980 2023-11-04T01:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818a7fc640 1 -- 172.21.15.2:0/1972186048 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817c005df0 con 0x7f8174003980 2023-11-04T01:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- 172.21.15.2:0/1972186048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8174003980 msgr2=0x7f8174003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 --2- 172.21.15.2:0/1972186048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8174003980 0x7f8174003da0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f817c00c290 tx=0x7f817c01cce0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818bfff640 1 -- 172.21.15.2:0/1972186048 reap_dead start 2023-11-04T01:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- 172.21.15.2:0/1972186048 shutdown_connections 2023-11-04T01:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- 172.21.15.2:0/1972186048 >> 172.21.15.2:0/1972186048 conn(0x7f818c06dd20 msgr2=0x7f818c06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- 172.21.15.2:0/1972186048 shutdown_connections 2023-11-04T01:50:33.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- 172.21.15.2:0/1972186048 wait complete. 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 Processor -- start 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- start start 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8174003980 0x7f818c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b4540 0x7f818c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c1461f0 0x7f818c1607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b23a0 con 0x7f818c0b4540 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b0dc0 con 0x7f818c1461f0 2023-11-04T01:50:33.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f8191fb7640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b10a0 con 0x7f8174003980 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b4540 0x7f818c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b4540 0x7f818c0b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44976/0 (socket says 172.21.15.2:44976) 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818affd640 1 -- 172.21.15.2:0/275117113 learned_addr learned my addr 172.21.15.2:0/275117113 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818b7fe640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8174003980 0x7f818c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.837+0000 7f818bfff640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c1461f0 0x7f818c1607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818affd640 1 -- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8174003980 msgr2=0x7f818c0b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818affd640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8174003980 0x7f818c0b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818affd640 1 -- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c1461f0 msgr2=0x7f818c1607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818affd640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c1461f0 0x7f818c1607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818affd640 1 -- 172.21.15.2:0/275117113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0b1380 con 0x7f818c0b4540 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818b7fe640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8174003980 0x7f818c0b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:33.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818affd640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b4540 0x7f818c0b1e60 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8180011560 tx=0x7f8180011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8173fff640 1 -- 172.21.15.2:0/275117113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180015930 con 0x7f818c0b4540 2023-11-04T01:50:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8173fff640 1 -- 172.21.15.2:0/275117113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8180015a90 con 0x7f818c0b4540 2023-11-04T01:50:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c0b1660 con 0x7f818c0b4540 2023-11-04T01:50:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8173fff640 1 -- 172.21.15.2:0/275117113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180015e20 con 0x7f818c0b4540 2023-11-04T01:50:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c0b49a0 con 0x7f818c0b4540 2023-11-04T01:50:33.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c04e4a0 con 0x7f818c0b4540 2023-11-04T01:50:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8173fff640 1 -- 172.21.15.2:0/275117113 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f818000f460 con 0x7f818c0b4540 2023-11-04T01:50:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8173fff640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664d0 0x7f8178068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f8173fff640 1 -- 172.21.15.2:0/275117113 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f8180084f60 con 0x7f818c0b4540 2023-11-04T01:50:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818b7fe640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664d0 0x7f8178068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:33.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.841+0000 7f818b7fe640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664d0 0x7f8178068990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f817c0aa000 tx=0x7f817c001a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:33.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:33.845+0000 7f8173fff640 1 -- 172.21.15.2:0/275117113 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8180051ab0 con 0x7f818c0b4540 2023-11-04T01:50:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.005+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7f818c070080 con 0x7f818c0b4540 2023-11-04T01:50:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.005+0000 7f8173fff640 1 -- 172.21.15.2:0/275117113 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7f81800550d0 con 0x7f818c0b4540 2023-11-04T01:50:34.007 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664d0 msgr2=0x7f8178068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664d0 0x7f8178068990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f817c0aa000 tx=0x7f817c001a10 comp rx=0 tx=0).stop 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b4540 msgr2=0x7f818c0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b4540 0x7f818c0b1e60 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8180011560 tx=0x7f8180011a20 comp rx=0 tx=0).stop 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 shutdown_connections 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81780664d0 0x7f8178068990 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f818c1461f0 0x7f818c1607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f818c0b4540 0x7f818c0b1e60 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 --2- 172.21.15.2:0/275117113 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8174003980 0x7f818c0b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.010 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 >> 172.21.15.2:0/275117113 conn(0x7f818c06dd20 msgr2=0x7f818c06be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 shutdown_connections 2023-11-04T01:50:34.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.009+0000 7f8191fb7640 1 -- 172.21.15.2:0/275117113 wait complete. 2023-11-04T01:50:34.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:50:34.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074e94c640 1 Processor -- start 2023-11-04T01:50:34.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074e94c640 1 -- start start 2023-11-04T01:50:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074e94c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f074806a840 0x7f074806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074e94c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f07480b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074e94c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0748071b60 con 0x7f074815b0f0 2023-11-04T01:50:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074e94c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0748071550 con 0x7f074806a840 2023-11-04T01:50:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074e94c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07480ccda0 con 0x7f07480ca3c0 2023-11-04T01:50:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f0747fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f074815b0f0 0x7f074806a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.2:37092/0 (socket says 172.21.15.2:37092) 2023-11-04T01:50:34.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f0747fff640 1 -- 172.21.15.2:0/2834615905 learned_addr learned my addr 172.21.15.2:0/2834615905 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:34.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074cee9640 1 --2- 172.21.15.2:0/2834615905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f07480b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f07477fe640 1 --2- 172.21.15.2:0/2834615905 >> v2:172.21.15.90:3300/0 conn(0x7f074806a840 0x7f074806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f0746ffd640 1 -- 172.21.15.2:0/2834615905 <== mon.1 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194074156 0 0) 0x7f0748071b60 con 0x7f074815b0f0 2023-11-04T01:50:34.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f0746ffd640 1 -- 172.21.15.2:0/2834615905 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0734003530 con 0x7f074815b0f0 2023-11-04T01:50:34.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074cee9640 1 -- 172.21.15.2:0/2834615905 >> v2:172.21.15.90:3300/0 conn(0x7f074806a840 msgr2=0x7f074806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:34.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074cee9640 1 --2- 172.21.15.2:0/2834615905 >> v2:172.21.15.90:3300/0 conn(0x7f074806a840 0x7f074806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074cee9640 1 -- 172.21.15.2:0/2834615905 >> v1:172.21.15.90:6789/0 conn(0x7f074815b0f0 legacy=0x7f074806a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.145+0000 7f074cee9640 1 -- 172.21.15.2:0/2834615905 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07480cd600 con 0x7f07480ca3c0 2023-11-04T01:50:34.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074cee9640 1 --2- 172.21.15.2:0/2834615905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f07480b2bc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07380097c0 tx=0x7f073801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff7a5e097798f7d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f0746ffd640 1 -- 172.21.15.2:0/2834615905 <== mon.2 v2:172.21.15.90:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380ab600 con 0x7f07480ca3c0 2023-11-04T01:50:34.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f0746ffd640 1 -- 172.21.15.2:0/2834615905 <== mon.2 v2:172.21.15.90:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07380a7050 con 0x7f07480ca3c0 2023-11-04T01:50:34.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f0746ffd640 1 -- 172.21.15.2:0/2834615905 <== mon.2 v2:172.21.15.90:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380ab980 con 0x7f07480ca3c0 2023-11-04T01:50:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 -- 172.21.15.2:0/2834615905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 msgr2=0x7f07480b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 --2- 172.21.15.2:0/2834615905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f07480b2bc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07380097c0 tx=0x7f073801c480 comp rx=0 tx=0).stop 2023-11-04T01:50:34.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 -- 172.21.15.2:0/2834615905 shutdown_connections 2023-11-04T01:50:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 --2- 172.21.15.2:0/2834615905 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f07480b2bc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 --2- 172.21.15.2:0/2834615905 >> v2:172.21.15.90:3300/0 conn(0x7f074806a840 0x7f074806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 -- 172.21.15.2:0/2834615905 >> 172.21.15.2:0/2834615905 conn(0x7f074806b240 msgr2=0x7f074806b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 -- 172.21.15.2:0/2834615905 shutdown_connections 2023-11-04T01:50:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.149+0000 7f074e94c640 1 -- 172.21.15.2:0/2834615905 wait complete. 2023-11-04T01:50:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 Processor -- start 2023-11-04T01:50:34.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 -- start start 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074806a840 0x7f0748158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f0748150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f074815b0f0 0x7f07481513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0748151920 con 0x7f074806a840 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07480ce8c0 con 0x7f074815b0f0 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074814fa40 con 0x7f07480ca3c0 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074806a840 0x7f0748158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074806a840 0x7f0748158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44992/0 (socket says 172.21.15.2:44992) 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 -- 172.21.15.2:0/2521724357 learned_addr learned my addr 172.21.15.2:0/2521724357 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:34.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f07477fe640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f0748150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074cee9640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f074815b0f0 0x7f07481513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 -- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 msgr2=0x7f0748150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f0748150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 -- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f074815b0f0 msgr2=0x7f07481513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f074815b0f0 0x7f07481513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 -- 172.21.15.2:0/2521724357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738009420 con 0x7f074806a840 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0747fff640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074806a840 0x7f0748158820 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f074000cbc0 tx=0x7f074000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0744ff9640 1 -- 172.21.15.2:0/2521724357 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000ad40 con 0x7f074806a840 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0744ff9640 1 -- 172.21.15.2:0/2521724357 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0740012400 con 0x7f074806a840 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0744ff9640 1 -- 172.21.15.2:0/2521724357 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074000aea0 con 0x7f074806a840 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074814fd20 con 0x7f074806a840 2023-11-04T01:50:34.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07481502e0 con 0x7f074806a840 2023-11-04T01:50:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07481504d0 con 0x7f074806a840 2023-11-04T01:50:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.153+0000 7f0744ff9640 1 -- 172.21.15.2:0/2521724357 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0740007070 con 0x7f074806a840 2023-11-04T01:50:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.157+0000 7f0744ff9640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07280664a0 0x7f0728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.157+0000 7f0744ff9640 1 -- 172.21.15.2:0/2521724357 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f07400845f0 con 0x7f074806a840 2023-11-04T01:50:34.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.157+0000 7f07477fe640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07280664a0 0x7f0728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.157+0000 7f07477fe640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07280664a0 0x7f0728068960 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f074815a720 tx=0x7f0730008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.161+0000 7f0744ff9640 1 -- 172.21.15.2:0/2521724357 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0740051310 con 0x7f074806a840 2023-11-04T01:50:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.309+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f07480c2ee0 con 0x7f074806a840 2023-11-04T01:50:34.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f0744ff9640 1 -- 172.21.15.2:0/2521724357 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07400170a0 con 0x7f074806a840 2023-11-04T01:50:34.313 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:34.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07280664a0 msgr2=0x7f0728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07280664a0 0x7f0728068960 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f074815a720 tx=0x7f0730008040 comp rx=0 tx=0).stop 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074806a840 msgr2=0x7f0748158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074806a840 0x7f0748158820 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f074000cbc0 tx=0x7f074000a430 comp rx=0 tx=0).stop 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 shutdown_connections 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f07280664a0 0x7f0728068960 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f074815b0f0 0x7f07481513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f07480ca3c0 0x7f0748150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 --2- 172.21.15.2:0/2521724357 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f074806a840 0x7f0748158820 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 >> 172.21.15.2:0/2521724357 conn(0x7f074806b240 msgr2=0x7f07480af760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 shutdown_connections 2023-11-04T01:50:34.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.313+0000 7f074e94c640 1 -- 172.21.15.2:0/2521724357 wait complete. 2023-11-04T01:50:34.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:50:34.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.453+0000 7f9d61223640 1 Processor -- start 2023-11-04T01:50:34.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.453+0000 7f9d61223640 1 -- start start 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d61223640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c0d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d61223640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d5c0cff30 0x7f9d5c0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d61223640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9d5c0b2de0 0x7f9d5c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d61223640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b3270 con 0x7f9d5c0cff30 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d61223640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c15eca0 con 0x7f9d5c0b2de0 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d61223640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c15ef80 con 0x7f9d5c15b120 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d5c0cff30 0x7f9d5c0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d5c0cff30 0x7f9d5c0b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45004/0 (socket says 172.21.15.2:45004) 2023-11-04T01:50:34.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 -- 172.21.15.2:0/397026720 learned_addr learned my addr 172.21.15.2:0/397026720 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5b59e640 1 --2- 172.21.15.2:0/397026720 >> v2:172.21.15.90:3300/0 conn(0x7f9d5c0b2de0 0x7f9d5c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5ad9d640 1 --2- 172.21.15.2:0/397026720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c0d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 -- 172.21.15.2:0/397026720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 msgr2=0x7f9d5c0d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 --2- 172.21.15.2:0/397026720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c0d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 -- 172.21.15.2:0/397026720 >> v2:172.21.15.90:3300/0 conn(0x7f9d5c0b2de0 msgr2=0x7f9d5c0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 --2- 172.21.15.2:0/397026720 >> v2:172.21.15.90:3300/0 conn(0x7f9d5c0b2de0 0x7f9d5c0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 -- 172.21.15.2:0/397026720 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c15f260 con 0x7f9d5c0cff30 2023-11-04T01:50:34.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d5a59c640 1 --2- 172.21.15.2:0/397026720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c0b28a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0667c0 tx=0x7f9d4401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73aebfd25cade941 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d59d9b640 1 -- 172.21.15.2:0/397026720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d440a5870 con 0x7f9d5c0cff30 2023-11-04T01:50:34.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d59d9b640 1 -- 172.21.15.2:0/397026720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d440a59d0 con 0x7f9d5c0cff30 2023-11-04T01:50:34.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.457+0000 7f9d59d9b640 1 -- 172.21.15.2:0/397026720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d440a5d60 con 0x7f9d5c0cff30 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- 172.21.15.2:0/397026720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 msgr2=0x7f9d5c0b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 --2- 172.21.15.2:0/397026720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c0b28a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0667c0 tx=0x7f9d4401c9d0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- 172.21.15.2:0/397026720 shutdown_connections 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 --2- 172.21.15.2:0/397026720 >> v2:172.21.15.90:3300/0 conn(0x7f9d5c0b2de0 0x7f9d5c0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 --2- 172.21.15.2:0/397026720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c0b28a0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 --2- 172.21.15.2:0/397026720 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c0d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- 172.21.15.2:0/397026720 >> 172.21.15.2:0/397026720 conn(0x7f9d5c0cd8a0 msgr2=0x7f9d5c0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- 172.21.15.2:0/397026720 shutdown_connections 2023-11-04T01:50:34.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- 172.21.15.2:0/397026720 wait complete. 2023-11-04T01:50:34.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 Processor -- start 2023-11-04T01:50:34.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- start start 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d5c0b2de0 0x7f9d5c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c15d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c146fb0 con 0x7f9d5c0cff30 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c147290 con 0x7f9d5c0b2de0 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c147570 con 0x7f9d5c15b120 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c15d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c15d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45010/0 (socket says 172.21.15.2:45010) 2023-11-04T01:50:34.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 -- 172.21.15.2:0/2425763215 learned_addr learned my addr 172.21.15.2:0/2425763215 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5ad9d640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d5c0b2de0 0x7f9d5c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5b59e640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 -- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 msgr2=0x7f9d5c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 -- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d5c0b2de0 msgr2=0x7f9d5c0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d5c0b2de0 0x7f9d5c0b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 -- 172.21.15.2:0/2425763215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44009b30 con 0x7f9d5c0cff30 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5ad9d640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d5c0b2de0 0x7f9d5c0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d5a59c640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c15d410 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f9d440af040 tx=0x7f9d44019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d537fe640 1 -- 172.21.15.2:0/2425763215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d440b8880 con 0x7f9d5c0cff30 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d537fe640 1 -- 172.21.15.2:0/2425763215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d440b8a20 con 0x7f9d5c0cff30 2023-11-04T01:50:34.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d537fe640 1 -- 172.21.15.2:0/2425763215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d440b8dd0 con 0x7f9d5c0cff30 2023-11-04T01:50:34.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c147850 con 0x7f9d5c0cff30 2023-11-04T01:50:34.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.461+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c1496f0 con 0x7f9d5c0cff30 2023-11-04T01:50:34.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.465+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c147d00 con 0x7f9d5c0cff30 2023-11-04T01:50:34.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.465+0000 7f9d537fe640 1 -- 172.21.15.2:0/2425763215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9d440c2410 con 0x7f9d5c0cff30 2023-11-04T01:50:34.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.465+0000 7f9d537fe640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9d3c0664d0 0x7f9d3c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.465+0000 7f9d537fe640 1 -- 172.21.15.2:0/2425763215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f9d4411fa80 con 0x7f9d5c0cff30 2023-11-04T01:50:34.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.465+0000 7f9d5ad9d640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9d3c0664d0 0x7f9d3c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.465+0000 7f9d5ad9d640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9d3c0664d0 0x7f9d3c068990 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00b9f0 tx=0x7f9d4c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.472 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.469+0000 7f9d537fe640 1 -- 172.21.15.2:0/2425763215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9d440ec530 con 0x7f9d5c0cff30 2023-11-04T01:50:34.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.625+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7f9d5c0cfb00 con 0x7f9d5c0cff30 2023-11-04T01:50:34.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.625+0000 7f9d537fe640 1 -- 172.21.15.2:0/2425763215 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v112) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9d440efb50 con 0x7f9d5c0cff30 2023-11-04T01:50:34.627 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:34.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9d3c0664d0 msgr2=0x7f9d3c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9d3c0664d0 0x7f9d3c068990 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00b9f0 tx=0x7f9d4c008040 comp rx=0 tx=0).stop 2023-11-04T01:50:34.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 msgr2=0x7f9d5c15d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c15d410 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f9d440af040 tx=0x7f9d44019770 comp rx=0 tx=0).stop 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 shutdown_connections 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9d3c0664d0 0x7f9d3c068990 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9d5c15b120 0x7f9d5c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c0cff30 0x7f9d5c15d410 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 --2- 172.21.15.2:0/2425763215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d5c0b2de0 0x7f9d5c0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 >> 172.21.15.2:0/2425763215 conn(0x7f9d5c0cd8a0 msgr2=0x7f9d5c0ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 shutdown_connections 2023-11-04T01:50:34.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.629+0000 7f9d61223640 1 -- 172.21.15.2:0/2425763215 wait complete. 2023-11-04T01:50:34.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:50:34.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2d08f8640 1 Processor -- start 2023-11-04T01:50:34.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2d08f8640 1 -- start start 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2d08f8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2cc15d2f0 0x7fc2cc0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2d08f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 0x7fc2cc0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2d08f8640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc0ad8e0 con 0x7fc2cc0cd100 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2d08f8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc0cd590 con 0x7fc2cc15d2f0 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2d08f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0adbc0 con 0x7fc2cc15d6d0 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc2cc0cd100 0x7fc2cc06fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57180/0 (socket says 172.21.15.2:57180) 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 -- 172.21.15.2:0/2165843862 learned_addr learned my addr 172.21.15.2:0/2165843862 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:34.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c9d9b640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 0x7fc2cc0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2ca59c640 1 --2- 172.21.15.2:0/2165843862 >> v2:172.21.15.90:3300/0 conn(0x7fc2cc15d2f0 0x7fc2cc0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198121785 0 0) 0x7fc2cc0ad8e0 con 0x7fc2cc0cd100 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b8003530 con 0x7fc2cc0cd100 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3421848661 0 0) 0x7fc2b8003530 con 0x7fc2cc0cd100 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 msgr2=0x7fc2cc0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 0x7fc2cc0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 >> v2:172.21.15.90:3300/0 conn(0x7fc2cc15d2f0 msgr2=0x7fc2cc0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 --2- 172.21.15.2:0/2165843862 >> v2:172.21.15.90:3300/0 conn(0x7fc2cc15d2f0 0x7fc2cc0ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0adea0 con 0x7fc2cc0cd100 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fc2c4001680 con 0x7fc2cc0cd100 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 >> v1:172.21.15.2:6789/0 conn(0x7fc2cc0cd100 legacy=0x7fc2cc06fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b8003980 0x7fc2b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 0x7fc2b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8004d10 0x7fc2b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0cd590 con 0x7fc2b8004d10 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0adbc0 con 0x7fc2b8003980 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b800b990 con 0x7fc2cc15d6d0 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8004d10 0x7fc2b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2c9d9b640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 0x7fc2b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2ca59c640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b8003980 0x7fc2b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 -- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 msgr2=0x7fc2b80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2cc15d6d0 0x7fc2b80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 -- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b8003980 msgr2=0x7fc2b8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b8003980 0x7fc2b8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2cad9d640 1 -- 172.21.15.2:0/2165843862 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8003530 con 0x7fc2b8004d10 2023-11-04T01:50:34.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.769+0000 7fc2ca59c640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b8003980 0x7fc2b8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:34.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2cad9d640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8004d10 0x7fc2b8005190 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c270 tx=0x7fc2c401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b670d9017bad4743 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40a5960 con 0x7fc2b8004d10 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40a5ac0 con 0x7fc2b8004d10 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2c959a640 1 -- 172.21.15.2:0/2165843862 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40a5e90 con 0x7fc2b8004d10 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 -- 172.21.15.2:0/2165843862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8004d10 msgr2=0x7fc2b8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 --2- 172.21.15.2:0/2165843862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2b8004d10 0x7fc2b8005190 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c270 tx=0x7fc2c401cc60 comp rx=0 tx=0).stop 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2cad9d640 1 -- 172.21.15.2:0/2165843862 reap_dead start 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 -- 172.21.15.2:0/2165843862 shutdown_connections 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 -- 172.21.15.2:0/2165843862 >> 172.21.15.2:0/2165843862 conn(0x7fc2cc0ced10 msgr2=0x7fc2cc0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 -- 172.21.15.2:0/2165843862 shutdown_connections 2023-11-04T01:50:34.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 -- 172.21.15.2:0/2165843862 wait complete. 2023-11-04T01:50:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 Processor -- start 2023-11-04T01:50:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.773+0000 7fc2d08f8640 1 -- start start 2023-11-04T01:50:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2b8004d10 0x7fc2cc1e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2cc159fb0 0x7fc2cc1e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2cc1e6120 0x7fc2cc1f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc1f6bb0 con 0x7fc2cc1e6120 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc1e3230 con 0x7fc2cc159fb0 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc1e3510 con 0x7fc2b8004d10 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2cc1e6120 0x7fc2cc1f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2cc1e6120 0x7fc2cc1f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45028/0 (socket says 172.21.15.2:45028) 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 -- 172.21.15.2:0/1367975335 learned_addr learned my addr 172.21.15.2:0/1367975335 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2c9d9b640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2cc159fb0 0x7fc2cc1e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2ca59c640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2b8004d10 0x7fc2cc1e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 -- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2b8004d10 msgr2=0x7fc2cc1e42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2b8004d10 0x7fc2cc1e42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 -- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2cc159fb0 msgr2=0x7fc2cc1e5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2cc159fb0 0x7fc2cc1e5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 -- 172.21.15.2:0/1367975335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc1e37f0 con 0x7fc2cc1e6120 2023-11-04T01:50:34.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2cad9d640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2cc1e6120 0x7fc2cc1f5cc0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c190 tx=0x7fc2b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2c2ffd640 1 -- 172.21.15.2:0/1367975335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40072d0 con 0x7fc2cc1e6120 2023-11-04T01:50:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2c2ffd640 1 -- 172.21.15.2:0/1367975335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c4007430 con 0x7fc2cc1e6120 2023-11-04T01:50:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc1e3ad0 con 0x7fc2cc1e6120 2023-11-04T01:50:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2c2ffd640 1 -- 172.21.15.2:0/1367975335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40077a0 con 0x7fc2cc1e6120 2023-11-04T01:50:34.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc1e4810 con 0x7fc2cc1e6120 2023-11-04T01:50:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc04e4a0 con 0x7fc2cc1e6120 2023-11-04T01:50:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2c2ffd640 1 -- 172.21.15.2:0/1367975335 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2c40af440 con 0x7fc2cc1e6120 2023-11-04T01:50:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2c2ffd640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2ac0664d0 0x7fc2ac068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2c2ffd640 1 -- 172.21.15.2:0/1367975335 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7fc2c40b5030 con 0x7fc2cc1e6120 2023-11-04T01:50:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.777+0000 7fc2ca59c640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2ac0664d0 0x7fc2ac068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:34.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.781+0000 7fc2ca59c640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2ac0664d0 0x7fc2ac068990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc007440 tx=0x7fc2bc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:34.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.781+0000 7fc2c2ffd640 1 -- 172.21.15.2:0/1367975335 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc2c40eb4f0 con 0x7fc2cc1e6120 2023-11-04T01:50:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc2cc0cf610 con 0x7fc2cc1e6120 2023-11-04T01:50:34.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2c2ffd640 1 -- 172.21.15.2:0/1367975335 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc2c40bf020 con 0x7fc2cc1e6120 2023-11-04T01:50:34.942 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2ac0664d0 msgr2=0x7fc2ac068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2ac0664d0 0x7fc2ac068990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc007440 tx=0x7fc2bc00b040 comp rx=0 tx=0).stop 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2cc1e6120 msgr2=0x7fc2cc1f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2cc1e6120 0x7fc2cc1f5cc0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400c190 tx=0x7fc2b8005800 comp rx=0 tx=0).stop 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 shutdown_connections 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fc2ac0664d0 0x7fc2ac068990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2cc1e6120 0x7fc2cc1f5cc0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2cc159fb0 0x7fc2cc1e5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 --2- 172.21.15.2:0/1367975335 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fc2b8004d10 0x7fc2cc1e42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 >> 172.21.15.2:0/1367975335 conn(0x7fc2cc0ced10 msgr2=0x7fc2cc06d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.941+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 shutdown_connections 2023-11-04T01:50:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:34.945+0000 7fc2d08f8640 1 -- 172.21.15.2:0/1367975335 wait complete. 2023-11-04T01:50:34.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:50:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-11-04T01:50:35.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.089+0000 7f24693ed640 1 Processor -- start 2023-11-04T01:50:35.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24693ed640 1 -- start start 2023-11-04T01:50:35.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24693ed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 0x7f24640d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24693ed640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24640d09b0 con 0x7f24640d1cb0 2023-11-04T01:50:35.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24693ed640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24640d0110 con 0x7f246415d1c0 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24693ed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640d03f0 con 0x7f246415d5a0 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24627fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f24640d1cb0 0x7f24640b0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57192/0 (socket says 172.21.15.2:57192) 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24627fc640 1 -- 172.21.15.2:0/2989491888 learned_addr learned my addr 172.21.15.2:0/2989491888 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24637fe640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 0x7f24640d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209237760 0 0) 0x7f24640d09b0 con 0x7f24640d1cb0 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f244c003530 con 0x7f24640d1cb0 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307309715 0 0) 0x7f244c003530 con 0x7f24640d1cb0 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 msgr2=0x7f24640d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 0x7f24640d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 >> v1:172.21.15.90:6789/0 conn(0x7f246415d1c0 legacy=0x7f24640d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640d06d0 con 0x7f24640d1cb0 2023-11-04T01:50:35.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7f2458001680 con 0x7f24640d1cb0 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 >> v1:172.21.15.2:6789/0 conn(0x7f24640d1cb0 legacy=0x7f24640b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244c0039b0 0x7f244c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 0x7f244c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c004d10 0x7f244c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640d03f0 con 0x7f244c004d10 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c00ba40 con 0x7f244c0039b0 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c00bc00 con 0x7f246415d5a0 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24637fe640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c004d10 0x7f244c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f2462ffd640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244c0039b0 0x7f244c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24627fc640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 0x7f244c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24637fe640 1 -- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 msgr2=0x7f244c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24637fe640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f246415d5a0 0x7f244c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24637fe640 1 -- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244c0039b0 msgr2=0x7f244c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24637fe640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f244c0039b0 0x7f244c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.093+0000 7f24637fe640 1 -- 172.21.15.2:0/2989491888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c003530 con 0x7f244c004d10 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24637fe640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c004d10 0x7f244c005190 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f246408d4e0 tx=0x7f245c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2cc4072d44036a server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c0a5c10 con 0x7f244c004d10 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c00f040 con 0x7f244c004d10 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f2461ffb640 1 -- 172.21.15.2:0/2989491888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c0ad440 con 0x7f244c004d10 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- 172.21.15.2:0/2989491888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c004d10 msgr2=0x7f244c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 --2- 172.21.15.2:0/2989491888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f244c004d10 0x7f244c005190 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f246408d4e0 tx=0x7f245c01cc00 comp rx=0 tx=0).stop 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24637fe640 1 -- 172.21.15.2:0/2989491888 reap_dead start 2023-11-04T01:50:35.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- 172.21.15.2:0/2989491888 shutdown_connections 2023-11-04T01:50:35.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- 172.21.15.2:0/2989491888 >> 172.21.15.2:0/2989491888 conn(0x7f24640d2fc0 msgr2=0x7f24640d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:35.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- 172.21.15.2:0/2989491888 shutdown_connections 2023-11-04T01:50:35.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- 172.21.15.2:0/2989491888 wait complete. 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 Processor -- start 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- start start 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f244c004d10 0x7f246414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2464157340 0x7f24640a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464147df0 0x7f24641546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24641577c0 con 0x7f2464147df0 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640cb280 con 0x7f2464157340 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24693ed640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640cb560 con 0x7f244c004d10 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464147df0 0x7f24641546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24637fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464147df0 0x7f24641546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45034/0 (socket says 172.21.15.2:45034) 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.097+0000 7f24637fe640 1 -- 172.21.15.2:0/4075061449 learned_addr learned my addr 172.21.15.2:0/4075061449 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:35.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24627fc640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2464157340 0x7f24640a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f2462ffd640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f244c004d10 0x7f246414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24637fe640 1 -- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f244c004d10 msgr2=0x7f246414aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24637fe640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f244c004d10 0x7f246414aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24637fe640 1 -- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2464157340 msgr2=0x7f24640a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24637fe640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2464157340 0x7f24640a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24637fe640 1 -- 172.21.15.2:0/4075061449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640cb840 con 0x7f2464147df0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24637fe640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464147df0 0x7f24641546b0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f245c002240 tx=0x7f245c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f244b7fe640 1 -- 172.21.15.2:0/4075061449 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c0039a0 con 0x7f2464147df0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f244b7fe640 1 -- 172.21.15.2:0/4075061449 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c003b00 con 0x7f2464147df0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f244b7fe640 1 -- 172.21.15.2:0/4075061449 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c003e70 con 0x7f2464147df0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24640cbb20 con 0x7f2464147df0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2464148270 con 0x7f2464147df0 2023-11-04T01:50:35.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24640cbd10 con 0x7f2464147df0 2023-11-04T01:50:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f244b7fe640 1 -- 172.21.15.2:0/4075061449 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f245c0b4040 con 0x7f2464147df0 2023-11-04T01:50:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f244b7fe640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24500664a0 0x7f2450068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f244b7fe640 1 -- 172.21.15.2:0/4075061449 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f245c11e370 con 0x7f2464147df0 2023-11-04T01:50:35.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f2462ffd640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24500664a0 0x7f2450068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.101+0000 7f2462ffd640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24500664a0 0x7f2450068960 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f24640c9480 tx=0x7f2454009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.105+0000 7f244b7fe640 1 -- 172.21.15.2:0/4075061449 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f245c0eaf70 con 0x7f2464147df0 2023-11-04T01:50:35.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.261+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f246404e4a0 con 0x7f2464147df0 2023-11-04T01:50:35.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.261+0000 7f244b7fe640 1 -- 172.21.15.2:0/4075061449 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f245c0be020 con 0x7f2464147df0 2023-11-04T01:50:35.264 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:50:35.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24500664a0 msgr2=0x7f2450068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24500664a0 0x7f2450068960 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f24640c9480 tx=0x7f2454009040 comp rx=0 tx=0).stop 2023-11-04T01:50:35.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464147df0 msgr2=0x7f24641546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464147df0 0x7f24641546b0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f245c002240 tx=0x7f245c009750 comp rx=0 tx=0).stop 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 shutdown_connections 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f24500664a0 0x7f2450068960 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2464147df0 0x7f24641546b0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2464157340 0x7f24640a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 --2- 172.21.15.2:0/4075061449 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f244c004d10 0x7f246414aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 >> 172.21.15.2:0/4075061449 conn(0x7f24640d2fc0 msgr2=0x7f246415db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 shutdown_connections 2023-11-04T01:50:35.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.265+0000 7f24693ed640 1 -- 172.21.15.2:0/4075061449 wait complete. 2023-11-04T01:50:35.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:50:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82be9da640 1 Processor -- start 2023-11-04T01:50:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82be9da640 1 -- start start 2023-11-04T01:50:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82be9da640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f82b80c92b0 0x7f82b80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82be9da640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b80c9ac0 con 0x7f82b806c1c0 2023-11-04T01:50:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82be9da640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b80caf20 con 0x7f82b806bde0 2023-11-04T01:50:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82be9da640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b80c97e0 con 0x7f82b80c92b0 2023-11-04T01:50:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82bcf77640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f82b806c1c0 0x7f82b81442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57202/0 (socket says 172.21.15.2:57202) 2023-11-04T01:50:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82bcf77640 1 -- 172.21.15.2:0/2530728604 learned_addr learned my addr 172.21.15.2:0/2530728604 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82b77fe640 1 --2- 172.21.15.2:0/2530728604 >> v2:172.21.15.90:3300/0 conn(0x7f82b80c92b0 0x7f82b80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82b6ffd640 1 -- 172.21.15.2:0/2530728604 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882881011 0 0) 0x7f82b80c9ac0 con 0x7f82b806c1c0 2023-11-04T01:50:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82b6ffd640 1 -- 172.21.15.2:0/2530728604 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a0003530 con 0x7f82b806c1c0 2023-11-04T01:50:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82b77fe640 1 -- 172.21.15.2:0/2530728604 >> v1:172.21.15.90:6789/0 conn(0x7f82b806bde0 legacy=0x7f82b815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82b77fe640 1 -- 172.21.15.2:0/2530728604 >> v1:172.21.15.2:6789/0 conn(0x7f82b806c1c0 legacy=0x7f82b81442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.413+0000 7f82b77fe640 1 -- 172.21.15.2:0/2530728604 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80cb1c0 con 0x7f82b80c92b0 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82b77fe640 1 --2- 172.21.15.2:0/2530728604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 0x7f82b80cbca0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0097c0 tx=0x7f82ac01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a85890e17bbfff8e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82b6ffd640 1 -- 172.21.15.2:0/2530728604 <== mon.1 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0ab600 con 0x7f82b80c92b0 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82b6ffd640 1 -- 172.21.15.2:0/2530728604 <== mon.1 v2:172.21.15.90:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac0a7050 con 0x7f82b80c92b0 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82b6ffd640 1 -- 172.21.15.2:0/2530728604 <== mon.1 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0ab960 con 0x7f82b80c92b0 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 -- 172.21.15.2:0/2530728604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 msgr2=0x7f82b80cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 --2- 172.21.15.2:0/2530728604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 0x7f82b80cbca0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0097c0 tx=0x7f82ac01c480 comp rx=0 tx=0).stop 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 -- 172.21.15.2:0/2530728604 shutdown_connections 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 --2- 172.21.15.2:0/2530728604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 0x7f82b80cbca0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 -- 172.21.15.2:0/2530728604 >> 172.21.15.2:0/2530728604 conn(0x7f82b80b0890 msgr2=0x7f82b80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:35.419 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 -- 172.21.15.2:0/2530728604 shutdown_connections 2023-11-04T01:50:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 -- 172.21.15.2:0/2530728604 wait complete. 2023-11-04T01:50:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 Processor -- start 2023-11-04T01:50:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.417+0000 7f82be9da640 1 -- start start 2023-11-04T01:50:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82b806bde0 0x7f82b80b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b806c1c0 0x7f82b813b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 0x7f82b8158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80c8fb0 con 0x7f82b806c1c0 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80b20a0 con 0x7f82b80c92b0 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b813bbf0 con 0x7f82b806bde0 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b806c1c0 0x7f82b813b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b806c1c0 0x7f82b813b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45046/0 (socket says 172.21.15.2:45046) 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 -- 172.21.15.2:0/4084402476 learned_addr learned my addr 172.21.15.2:0/4084402476 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b7fff640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82b806bde0 0x7f82b80b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82bcf77640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 0x7f82b8158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 -- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82b806bde0 msgr2=0x7f82b80b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82b806bde0 0x7f82b80b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 -- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 msgr2=0x7f82b8158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 0x7f82b8158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 -- 172.21.15.2:0/4084402476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac009420 con 0x7f82b806c1c0 2023-11-04T01:50:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b77fe640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b806c1c0 0x7f82b813b6b0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0097c0 tx=0x7f82ac019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b4ff9640 1 -- 172.21.15.2:0/4084402476 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac003af0 con 0x7f82b806c1c0 2023-11-04T01:50:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b4ff9640 1 -- 172.21.15.2:0/4084402476 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac003c50 con 0x7f82b806c1c0 2023-11-04T01:50:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b80c89f0 con 0x7f82b806c1c0 2023-11-04T01:50:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b4ff9640 1 -- 172.21.15.2:0/4084402476 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac0ab400 con 0x7f82b806c1c0 2023-11-04T01:50:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b80b1d30 con 0x7f82b806c1c0 2023-11-04T01:50:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b80b2230 con 0x7f82b806c1c0 2023-11-04T01:50:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b4ff9640 1 -- 172.21.15.2:0/4084402476 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82ac0b2040 con 0x7f82b806c1c0 2023-11-04T01:50:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b4ff9640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a40664a0 0x7f82a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b4ff9640 1 -- 172.21.15.2:0/4084402476 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f82ac11e510 con 0x7f82b806c1c0 2023-11-04T01:50:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.421+0000 7f82b7fff640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a40664a0 0x7f82a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.425+0000 7f82b7fff640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a40664a0 0x7f82a4068960 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f82a8001810 tx=0x7f82a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.425+0000 7f82b4ff9640 1 -- 172.21.15.2:0/4084402476 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82ac0eb230 con 0x7f82b806c1c0 2023-11-04T01:50:35.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.597+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82b804e4a0 con 0x7f82b806c1c0 2023-11-04T01:50:35.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.597+0000 7f82b4ff9640 1 -- 172.21.15.2:0/4084402476 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v112) v1 ==== 81+0+1373 (secure 0 0 0) 0x7f82ac0b8570 con 0x7f82b806c1c0 2023-11-04T01:50:35.599 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/4169282097 2023-11-04T02:50:00.880111+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/3695355178 2023-11-05T01:49:53.201635+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2988241810 2023-11-04T02:49:10.916906+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:50:35.600 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/2449846925 2023-11-05T01:49:45.775757+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/3695355178 2023-11-05T01:49:53.201635+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/2449846925 2023-11-05T01:49:45.775757+0000 2023-11-04T01:50:35.601 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2023608941 2023-11-04T02:48:20.721790+0000 2023-11-04T01:50:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:listed 23 entries 2023-11-04T01:50:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a40664a0 msgr2=0x7f82a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a40664a0 0x7f82a4068960 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f82a8001810 tx=0x7f82a8009040 comp rx=0 tx=0).stop 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b806c1c0 msgr2=0x7f82b813b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b806c1c0 0x7f82b813b6b0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0097c0 tx=0x7f82ac019220 comp rx=0 tx=0).stop 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 shutdown_connections 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f82a40664a0 0x7f82a4068960 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82b80c92b0 0x7f82b8158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b806c1c0 0x7f82b813b6b0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 --2- 172.21.15.2:0/4084402476 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f82b806bde0 0x7f82b80b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 >> 172.21.15.2:0/4084402476 conn(0x7f82b80b0890 msgr2=0x7f82b806f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 shutdown_connections 2023-11-04T01:50:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.601+0000 7f82be9da640 1 -- 172.21.15.2:0/4084402476 wait complete. 2023-11-04T01:50:35.620 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:50:35.620 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:50:35.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-04T01:50:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cf2a3640 1 Processor -- start 2023-11-04T01:50:35.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cf2a3640 1 -- start start 2023-11-04T01:50:35.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cf2a3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cf2a3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81c8160a60 0x7f81c80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cf2a3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80cf000 con 0x7f81c80b3e30 2023-11-04T01:50:35.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cf2a3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80b5de0 con 0x7f81c8160a60 2023-11-04T01:50:35.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cf2a3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80d1610 con 0x7f81c8160680 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cc83e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81c8160a60 0x7f81c80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cc83e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81c8160a60 0x7f81c80ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45058/0 (socket says 172.21.15.2:45058) 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cc83e640 1 -- 172.21.15.2:0/2897378501 learned_addr learned my addr 172.21.15.2:0/2897378501 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cd03f640 1 --2- 172.21.15.2:0/2897378501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cc83e640 1 -- 172.21.15.2:0/2897378501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 msgr2=0x7f81c80cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cc83e640 1 --2- 172.21.15.2:0/2897378501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cc83e640 1 -- 172.21.15.2:0/2897378501 >> v1:172.21.15.90:6789/0 conn(0x7f81c80b3e30 legacy=0x7f81c80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.805+0000 7f81cc83e640 1 -- 172.21.15.2:0/2897378501 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80d18f0 con 0x7f81c8160a60 2023-11-04T01:50:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cc83e640 1 --2- 172.21.15.2:0/2897378501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c8160a60 0x7f81c80ce0e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009870 tx=0x7f81b801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d9ef9f249e565e server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81bffff640 1 -- 172.21.15.2:0/2897378501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b80ab680 con 0x7f81c8160a60 2023-11-04T01:50:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81bffff640 1 -- 172.21.15.2:0/2897378501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b80ab7e0 con 0x7f81c8160a60 2023-11-04T01:50:35.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81bffff640 1 -- 172.21.15.2:0/2897378501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b80abb70 con 0x7f81c8160a60 2023-11-04T01:50:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 -- 172.21.15.2:0/2897378501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c8160a60 msgr2=0x7f81c80ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/2897378501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c8160a60 0x7f81c80ce0e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f81b8009870 tx=0x7f81b801c480 comp rx=0 tx=0).stop 2023-11-04T01:50:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 -- 172.21.15.2:0/2897378501 shutdown_connections 2023-11-04T01:50:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/2897378501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c8160a60 0x7f81c80ce0e0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/2897378501 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 -- 172.21.15.2:0/2897378501 >> 172.21.15.2:0/2897378501 conn(0x7f81c80d2f90 msgr2=0x7f81c80d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 -- 172.21.15.2:0/2897378501 shutdown_connections 2023-11-04T01:50:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 -- 172.21.15.2:0/2897378501 wait complete. 2023-11-04T01:50:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 Processor -- start 2023-11-04T01:50:35.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.809+0000 7f81cf2a3640 1 -- start start 2023-11-04T01:50:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c80b3e30 0x7f81c815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c8160a60 0x7f81c815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c815d8d0 con 0x7f81c80b3e30 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c815cc50 con 0x7f81c8160a60 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c815cf30 con 0x7f81c8160680 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c80b3e30 0x7f81c815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c80b3e30 0x7f81c815dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45062/0 (socket says 172.21.15.2:45062) 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 -- 172.21.15.2:0/1554076824 learned_addr learned my addr 172.21.15.2:0/1554076824 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cc83e640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd840640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c8160a60 0x7f81c815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 -- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 msgr2=0x7f81c80cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 -- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c8160a60 msgr2=0x7f81c815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c8160a60 0x7f81c815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 -- 172.21.15.2:0/1554076824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80094d0 con 0x7f81c80b3e30 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cc83e640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd840640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c8160a60 0x7f81c815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cd03f640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c80b3e30 0x7f81c815dcf0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f81c0007ef0 tx=0x7f81c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81bdffb640 1 -- 172.21.15.2:0/1554076824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0014620 con 0x7f81c80b3e30 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81bdffb640 1 -- 172.21.15.2:0/1554076824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0014780 con 0x7f81c80b3e30 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c815d210 con 0x7f81c80b3e30 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81bdffb640 1 -- 172.21.15.2:0/1554076824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0014b30 con 0x7f81c80b3e30 2023-11-04T01:50:35.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c8156dd0 con 0x7f81c80b3e30 2023-11-04T01:50:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c804e4a0 con 0x7f81c80b3e30 2023-11-04T01:50:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81bdffb640 1 -- 172.21.15.2:0/1554076824 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81c0014c90 con 0x7f81c80b3e30 2023-11-04T01:50:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.813+0000 7f81bdffb640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81ac0664a0 0x7f81ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:35.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.817+0000 7f81bdffb640 1 -- 172.21.15.2:0/1554076824 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f81c0085120 con 0x7f81c80b3e30 2023-11-04T01:50:35.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.817+0000 7f81cc83e640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81ac0664a0 0x7f81ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:35.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.817+0000 7f81cc83e640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81ac0664a0 0x7f81ac068960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f81b80af000 tx=0x7f81b80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:35.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.821+0000 7f81bdffb640 1 -- 172.21.15.2:0/1554076824 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f81c0051d10 con 0x7f81c80b3e30 2023-11-04T01:50:35.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.977+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81c8158a50 con 0x7f81c80b3e30 2023-11-04T01:50:35.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.981+0000 7f81bdffb640 1 -- 172.21.15.2:0/1554076824 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+23444 (secure 0 0 0) 0x7f81c0055330 con 0x7f81c80b3e30 2023-11-04T01:50:35.984 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-04T01:50:35.985 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":112,"fsid":"5d11bb68-eb80-4957-a295-0326089fcc10","created":"2023-11-04T01:41:59.808566+0000","modified":"2023-11-04T01:50:19.674243+0000","last_up_change":"2023-11-04T01:42:11.573841+0000","last_in_change":"2023-11-04T01:42:02.252578+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-04T01:42:10.840284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"snap-test-pool","create_time":"2023-11-04T01:43:37.516173+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test_data_pool","create_time":"2023-11-04T01:44:39.164974+0000","flags":16385,"flags_names":"hashpspool,pool_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"pool","snap_seq":2,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test_metadata_pool","create_time":"2023-11-04T01:44:40.256284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-11-04T01:45:33.227500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-11-04T01:45:34.004628+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":14,"snap_epoch":111,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b98eb46-0787-4344-9794-6296461471f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6809","nonce":1112677023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6811","nonce":1112677023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6815","nonce":1112677023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1112677023},{"type":"v1","addr":"172.21.15.2:6813","nonce":1112677023}]},"public_addr":"172.21.15.2:6809/1112677023","cluster_addr":"172.21.15.2:6811/1112677023","heartbeat_back_addr":"172.21.15.2:6815/1112677023","heartbeat_front_addr":"172.21.15.2:6813/1112677023","state":["exists","up"]},{"osd":1,"uuid":"19381572-605e-4337-a904-1a4a1057f1e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6817","nonce":1987543960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6819","nonce":1987543960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6826","nonce":1987543960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1987543960},{"type":"v1","addr":"172.21.15.2:6822","nonce":1987543960}]},"public_addr":"172.21.15.2:6817/1987543960","cluster_addr":"172.21.15.2:6819/1987543960","heartbeat_back_addr":"172.21.15.2:6826/1987543960","heartbeat_front_addr":"172.21.15.2:6822/1987543960","state":["exists","up"]},{"osd":2,"uuid":"80984f1f-d33a-4749-9e85-c8a026d24552","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6823","nonce":3669990359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6827","nonce":3669990359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6831","nonce":3669990359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3669990359},{"type":"v1","addr":"172.21.15.2:6829","nonce":3669990359}]},"public_addr":"172.21.15.2:6823/3669990359","cluster_addr":"172.21.15.2:6827/3669990359","heartbeat_back_addr":"172.21.15.2:6831/3669990359","heartbeat_front_addr":"172.21.15.2:6829/3669990359","state":["exists","up"]},{"osd":3,"uuid":"081f0dcf-f419-490d-8553-3aebdef7e5ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6801","nonce":4067471271}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6803","nonce":4067471271}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6807","nonce":4067471271}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":4067471271},{"type":"v1","addr":"172.21.15.2:6805","nonce":4067471271}]},"public_addr":"172.21.15.2:6801/4067471271","cluster_addr":"172.21.15.2:6803/4067471271","heartbeat_back_addr":"172.21.15.2:6807/4067471271","heartbeat_front_addr":"172.21.15.2:6805/4067471271","state":["exists","up"]},{"osd":4,"uuid":"3620286f-8097-49a2-aba7-ca472a29caad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6809","nonce":151665990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6811","nonce":151665990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6815","nonce":151665990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":151665990},{"type":"v1","addr":"172.21.15.90:6813","nonce":151665990}]},"public_addr":"172.21.15.90:6809/151665990","cluster_addr":"172.21.15.90:6811/151665990","heartbeat_back_addr":"172.21.15.90:6815/151665990","heartbeat_front_addr":"172.21.15.90:6813/151665990","state":["exists","up"]},{"osd":5,"uuid":"36f5bec4-109c-432c-b807-cdc87e8ca112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6817","nonce":315309868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6819","nonce":315309868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6823","nonce":315309868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":315309868},{"type":"v1","addr":"172.21.15.90:6821","nonce":315309868}]},"public_addr":"172.21.15.90:6817/315309868","cluster_addr":"172.21.15.90:6819/315309868","heartbeat_back_addr":"172.21.15.90:6823/315309868","heartbeat_front_addr":"172.21.15.90:6821/315309868","state":["exists","up"]},{"osd":6,"uuid":"d13ad869-187b-4b0d-a52b-223debadef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6825","nonce":1846736802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6827","nonce":1846736802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6831","nonce":1846736802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1846736802},{"type":"v1","addr":"172.21.15.90:6829","nonce":1846736802}]},"public_addr":"172.21.15.90:6825/1846736802","cluster_addr":"172.21.15.90:6827/1846736802","heartbeat_back_addr":"172.21.15.90:6831/1846736802","heartbeat_front_addr":"172.21.15.90:6829/1846736802","state":["exists","up"]},{"osd":7,"uuid":"994cb1fb-92a2-4a71-9517-c45e2c77c20d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6801","nonce":3369299530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6803","nonce":3369299530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6807","nonce":3369299530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":3369299530},{"type":"v1","addr":"172.21.15.90:6805","nonce":3369299530}]},"public_addr":"172.21.15.90:6801/3369299530","cluster_addr":"172.21.15.90:6803/3369299530","heartbeat_back_addr":"172.21.15.90:6807/3369299530","heartbeat_front_addr":"172.21.15.90:6805/3369299530","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.801113+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.890486+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.821608+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.799056+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:09.580461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.914981+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.865527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-04T01:42:07.623232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.f","mappings":[{"from":2,"to":3}]},{"pgid":"16.12","mappings":[{"from":4,"to":3}]},{"pgid":"16.39","mappings":[{"from":4,"to":6}]},{"pgid":"16.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"192.168.0.1:0/4169282097":"2023-11-04T02:50:00.880111+0000","172.21.15.2:6833/3695355178":"2023-11-05T01:49:53.201635+0000","192.168.0.1:0/2988241810":"2023-11-04T02:49:10.916906+0000","172.21.15.90:6837/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.90:6834/238645283":"2023-11-05T01:49:02.752564+0000","172.21.15.2:6833/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6837/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.2:6832/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.2:6833/792110972":"2023-11-05T01:46:46.354936+0000","172.21.15.90:6834/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6834/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.2:6832/3051439603":"2023-11-05T01:48:55.822867+0000","172.21.15.90:6834/1345296201":"2023-11-05T01:46:20.984713+0000","172.21.15.90:6837/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6834/2449846925":"2023-11-05T01:49:45.775757+0000","172.21.15.2:6832/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.90:6834/3941825889":"2023-11-05T01:47:11.675457+0000","172.21.15.2:6833/2515781456":"2023-11-05T01:47:37.879054+0000","172.21.15.2:6832/3695355178":"2023-11-05T01:49:53.201635+0000","172.21.15.90:6837/433120793":"2023-11-05T01:48:05.613405+0000","172.21.15.2:6835/3725992406":"2023-11-05T01:48:12.536544+0000","172.21.15.2:6835/2449846925":"2023-11-05T01:49:45.775757+0000","192.168.0.1:0/2023608941":"2023-11-04T02:48:20.721790+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":16,"snaps":[{"begin":11,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81ac0664a0 msgr2=0x7f81ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81ac0664a0 0x7f81ac068960 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f81b80af000 tx=0x7f81b80a7000 comp rx=0 tx=0).stop 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c80b3e30 msgr2=0x7f81c815dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c80b3e30 0x7f81c815dcf0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f81c0007ef0 tx=0x7f81c000e4b0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 shutdown_connections 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f81ac0664a0 0x7f81ac068960 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81c8160a60 0x7f81c815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f81c8160680 0x7f81c80cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 --2- 172.21.15.2:0/1554076824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81c80b3e30 0x7f81c815dcf0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:35.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 >> 172.21.15.2:0/1554076824 conn(0x7f81c80d2f90 msgr2=0x7f81c80d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:35.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 shutdown_connections 2023-11-04T01:50:35.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:35.985+0000 7f81cf2a3640 1 -- 172.21.15.2:0/1554076824 wait complete. 2023-11-04T01:50:36.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-04T01:42:10.840284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'snap-test-pool', 'create_time': '2023-11-04T01:43:37.516173+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'test_data_pool', 'create_time': '2023-11-04T01:44:39.164974+0000', 'flags': 16385, 'flags_names': 'hashpspool,pool_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'pool', 'snap_seq': 2, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'test_metadata_pool', 'create_time': '2023-11-04T01:44:40.256284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-04T01:45:33.227500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-11-04T01:45:34.004628+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 111, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-04T01:50:36.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-04T01:50:36.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.133+0000 7f8be1e54640 1 Processor -- start 2023-11-04T01:50:36.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.133+0000 7f8be1e54640 1 -- start start 2023-11-04T01:50:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8be1e54640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8bdc1556c0 0x7f8bdc15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8be1e54640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0cabd0 0x7f8bdc0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8be1e54640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8bdc0c9360 0x7f8bdc0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8be1e54640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc0cb590 con 0x7f8bdc0c9360 2023-11-04T01:50:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8be1e54640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc15c600 con 0x7f8bdc1556c0 2023-11-04T01:50:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8be1e54640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc06fe50 con 0x7f8bdc0cabd0 2023-11-04T01:50:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8bdc0c9360 0x7f8bdc0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8bdc0c9360 0x7f8bdc0c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45072/0 (socket says 172.21.15.2:45072) 2023-11-04T01:50:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 -- 172.21.15.2:0/3395463558 learned_addr learned my addr 172.21.15.2:0/3395463558 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdaffd640 1 --2- 172.21.15.2:0/3395463558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0cabd0 0x7f8bdc0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdb7fe640 1 --2- 172.21.15.2:0/3395463558 >> v2:172.21.15.90:3300/0 conn(0x7f8bdc1556c0 0x7f8bdc15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 -- 172.21.15.2:0/3395463558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0cabd0 msgr2=0x7f8bdc0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 --2- 172.21.15.2:0/3395463558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0cabd0 0x7f8bdc0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 -- 172.21.15.2:0/3395463558 >> v2:172.21.15.90:3300/0 conn(0x7f8bdc1556c0 msgr2=0x7f8bdc15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 --2- 172.21.15.2:0/3395463558 >> v2:172.21.15.90:3300/0 conn(0x7f8bdc1556c0 0x7f8bdc15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.137+0000 7f8bdbfff640 1 -- 172.21.15.2:0/3395463558 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0ae7f0 con 0x7f8bdc0c9360 2023-11-04T01:50:36.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8bdbfff640 1 --2- 172.21.15.2:0/3395463558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc0c9360 0x7f8bdc0c97f0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc071fd0 tx=0x7f8bd401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9f4a0efcf2cf0d server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8bda7fc640 1 -- 172.21.15.2:0/3395463558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40a5820 con 0x7f8bdc0c9360 2023-11-04T01:50:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8bda7fc640 1 -- 172.21.15.2:0/3395463558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd40a5980 con 0x7f8bdc0c9360 2023-11-04T01:50:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8bda7fc640 1 -- 172.21.15.2:0/3395463558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40a5d10 con 0x7f8bdc0c9360 2023-11-04T01:50:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 -- 172.21.15.2:0/3395463558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc0c9360 msgr2=0x7f8bdc0c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 --2- 172.21.15.2:0/3395463558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc0c9360 0x7f8bdc0c97f0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc071fd0 tx=0x7f8bd401c9a0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 -- 172.21.15.2:0/3395463558 shutdown_connections 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 --2- 172.21.15.2:0/3395463558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc0c9360 0x7f8bdc0c97f0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 --2- 172.21.15.2:0/3395463558 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0cabd0 0x7f8bdc0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 --2- 172.21.15.2:0/3395463558 >> v2:172.21.15.90:3300/0 conn(0x7f8bdc1556c0 0x7f8bdc15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 -- 172.21.15.2:0/3395463558 >> 172.21.15.2:0/3395463558 conn(0x7f8bdc0ced10 msgr2=0x7f8bdc0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 -- 172.21.15.2:0/3395463558 shutdown_connections 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 -- 172.21.15.2:0/3395463558 wait complete. 2023-11-04T01:50:36.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 Processor -- start 2023-11-04T01:50:36.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.141+0000 7f8be1e54640 1 -- start start 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0c9360 0x7f8bdc147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bdc0cabd0 0x7f8bdc0b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc1556c0 0x7f8bdc0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0b3d40 con 0x7f8bdc1556c0 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0b3130 con 0x7f8bdc0cabd0 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0b3410 con 0x7f8bdc0c9360 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc1556c0 0x7f8bdc0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc1556c0 0x7f8bdc0cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45080/0 (socket says 172.21.15.2:45080) 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 -- 172.21.15.2:0/1999421318 learned_addr learned my addr 172.21.15.2:0/1999421318 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdb7fe640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0c9360 0x7f8bdc147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdaffd640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bdc0cabd0 0x7f8bdc0b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 -- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0c9360 msgr2=0x7f8bdc147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0c9360 0x7f8bdc147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 -- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bdc0cabd0 msgr2=0x7f8bdc0b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bdc0cabd0 0x7f8bdc0b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 -- 172.21.15.2:0/1999421318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4009b30 con 0x7f8bdc1556c0 2023-11-04T01:50:36.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdbfff640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc1556c0 0x7f8bdc0cda80 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f8bd401b050 tx=0x7f8bd4019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bc3fff640 1 -- 172.21.15.2:0/1999421318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40b8670 con 0x7f8bdc1556c0 2023-11-04T01:50:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bc3fff640 1 -- 172.21.15.2:0/1999421318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd40b87d0 con 0x7f8bdc1556c0 2023-11-04T01:50:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bc3fff640 1 -- 172.21.15.2:0/1999421318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40b8b80 con 0x7f8bdc1556c0 2023-11-04T01:50:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc0b36f0 con 0x7f8bdc1556c0 2023-11-04T01:50:36.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc147a80 con 0x7f8bdc1556c0 2023-11-04T01:50:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc0b3eb0 con 0x7f8bdc1556c0 2023-11-04T01:50:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bc3fff640 1 -- 172.21.15.2:0/1999421318 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8bd40b8ce0 con 0x7f8bdc1556c0 2023-11-04T01:50:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bc3fff640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8bc80664d0 0x7f8bc8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bc3fff640 1 -- 172.21.15.2:0/1999421318 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f8bd411f710 con 0x7f8bdc1556c0 2023-11-04T01:50:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.145+0000 7f8bdb7fe640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8bc80664d0 0x7f8bc8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.149+0000 7f8bdb7fe640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8bc80664d0 0x7f8bc8068990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009af0 tx=0x7f8bcc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.149+0000 7f8bc3fff640 1 -- 172.21.15.2:0/1999421318 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8bd40ec2f0 con 0x7f8bdc1556c0 2023-11-04T01:50:36.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.309+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8bdc04e4a0 con 0x7f8bdc1556c0 2023-11-04T01:50:36.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.309+0000 7f8bc3fff640 1 -- 172.21.15.2:0/1999421318 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8bd4009510 con 0x7f8bdc1556c0 2023-11-04T01:50:36.312 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8bc80664d0 msgr2=0x7f8bc8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8bc80664d0 0x7f8bc8068990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009af0 tx=0x7f8bcc008040 comp rx=0 tx=0).stop 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc1556c0 msgr2=0x7f8bdc0cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc1556c0 0x7f8bdc0cda80 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f8bd401b050 tx=0x7f8bd4019740 comp rx=0 tx=0).stop 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 shutdown_connections 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f8bc80664d0 0x7f8bc8068990 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8bdc1556c0 0x7f8bdc0cda80 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8bdc0cabd0 0x7f8bdc0b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 --2- 172.21.15.2:0/1999421318 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f8bdc0c9360 0x7f8bdc147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 >> 172.21.15.2:0/1999421318 conn(0x7f8bdc0ced10 msgr2=0x7f8bdc153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:36.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 shutdown_connections 2023-11-04T01:50:36.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.313+0000 7f8be1e54640 1 -- 172.21.15.2:0/1999421318 wait complete. 2023-11-04T01:50:36.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get snap-test-pool pg_num 2023-11-04T01:50:36.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.453+0000 7fde85332640 1 Processor -- start 2023-11-04T01:50:36.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.453+0000 7fde85332640 1 -- start start 2023-11-04T01:50:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde85332640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde800d1cb0 0x7fde800d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde85332640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde800d09b0 con 0x7fde8015d1c0 2023-11-04T01:50:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde85332640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde800d0110 con 0x7fde8015d5a0 2023-11-04T01:50:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde85332640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde800d03f0 con 0x7fde800d1cb0 2023-11-04T01:50:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7e7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde800d1cb0 0x7fde800d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7e7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fde800d1cb0 0x7fde800d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45086/0 (socket says 172.21.15.2:45086) 2023-11-04T01:50:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7e7fc640 1 -- 172.21.15.2:0/2238723930 learned_addr learned my addr 172.21.15.2:0/2238723930 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:36.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7e7fc640 1 -- 172.21.15.2:0/2238723930 >> v1:172.21.15.90:6789/0 conn(0x7fde8015d5a0 legacy=0x7fde800b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7e7fc640 1 -- 172.21.15.2:0/2238723930 >> v1:172.21.15.2:6789/0 conn(0x7fde8015d1c0 legacy=0x7fde800d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7dffb640 1 -- 172.21.15.2:0/2238723930 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411141751 0 0) 0x7fde800d09b0 con 0x7fde8015d1c0 2023-11-04T01:50:36.459 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7e7fc640 1 -- 172.21.15.2:0/2238723930 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800d06d0 con 0x7fde800d1cb0 2023-11-04T01:50:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7e7fc640 1 --2- 172.21.15.2:0/2238723930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde800d3ae0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fde68009870 tx=0x7fde6801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7108e4ee39b9b2fc server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7dffb640 1 -- 172.21.15.2:0/2238723930 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde680aa650 con 0x7fde800d1cb0 2023-11-04T01:50:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7dffb640 1 -- 172.21.15.2:0/2238723930 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde680aa7b0 con 0x7fde800d1cb0 2023-11-04T01:50:36.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.457+0000 7fde7dffb640 1 -- 172.21.15.2:0/2238723930 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde680aab40 con 0x7fde800d1cb0 2023-11-04T01:50:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- 172.21.15.2:0/2238723930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 msgr2=0x7fde800d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 --2- 172.21.15.2:0/2238723930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde800d3ae0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fde68009870 tx=0x7fde6801c510 comp rx=0 tx=0).stop 2023-11-04T01:50:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- 172.21.15.2:0/2238723930 shutdown_connections 2023-11-04T01:50:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 --2- 172.21.15.2:0/2238723930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde800d3ae0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- 172.21.15.2:0/2238723930 >> 172.21.15.2:0/2238723930 conn(0x7fde800d2fc0 msgr2=0x7fde800d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- 172.21.15.2:0/2238723930 shutdown_connections 2023-11-04T01:50:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- 172.21.15.2:0/2238723930 wait complete. 2023-11-04T01:50:36.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 Processor -- start 2023-11-04T01:50:36.462 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- start start 2023-11-04T01:50:36.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde801570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde8015d1c0 0x7fde800ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde8015d5a0 0x7fde80157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde800cb4e0 con 0x7fde800d1cb0 2023-11-04T01:50:36.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80157b50 con 0x7fde8015d5a0 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde80157d80 con 0x7fde8015d1c0 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde801570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde801570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45096/0 (socket says 172.21.15.2:45096) 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 -- 172.21.15.2:0/2360731317 learned_addr learned my addr 172.21.15.2:0/2360731317 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7e7fc640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde8015d1c0 0x7fde800ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7f7fe640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde8015d5a0 0x7fde80157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 -- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde8015d1c0 msgr2=0x7fde800ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde8015d1c0 0x7fde800ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 -- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde8015d5a0 msgr2=0x7fde80157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde8015d5a0 0x7fde80157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 -- 172.21.15.2:0/2360731317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680094d0 con 0x7fde800d1cb0 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7f7fe640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde8015d5a0 0x7fde80157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:36.465 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7e7fc640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde8015d1c0 0x7fde800ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde7effd640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde801570b0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c480 tx=0x7fde7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde777fe640 1 -- 172.21.15.2:0/2360731317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70005480 con 0x7fde800d1cb0 2023-11-04T01:50:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde777fe640 1 -- 172.21.15.2:0/2360731317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70003600 con 0x7fde800d1cb0 2023-11-04T01:50:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde777fe640 1 -- 172.21.15.2:0/2360731317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700039b0 con 0x7fde800d1cb0 2023-11-04T01:50:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde800cab40 con 0x7fde800d1cb0 2023-11-04T01:50:36.466 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.461+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde800cb100 con 0x7fde800d1cb0 2023-11-04T01:50:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.465+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8004e4a0 con 0x7fde800d1cb0 2023-11-04T01:50:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.465+0000 7fde777fe640 1 -- 172.21.15.2:0/2360731317 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fde70003b10 con 0x7fde800d1cb0 2023-11-04T01:50:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.465+0000 7fde777fe640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde600664d0 0x7fde60068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.465+0000 7fde777fe640 1 -- 172.21.15.2:0/2360731317 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7fde70084360 con 0x7fde800d1cb0 2023-11-04T01:50:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.465+0000 7fde7e7fc640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde600664d0 0x7fde60068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.467 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.465+0000 7fde7e7fc640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde600664d0 0x7fde60068990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fde680ae000 tx=0x7fde68008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.469+0000 7fde777fe640 1 -- 172.21.15.2:0/2360731317 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde70050f30 con 0x7fde800d1cb0 2023-11-04T01:50:36.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"} v 0) v1 -- 0x7fde800b58a0 con 0x7fde800d1cb0 2023-11-04T01:50:36.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde777fe640 1 -- 172.21.15.2:0/2360731317 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "snap-test-pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7fde70054550 con 0x7fde800d1cb0 2023-11-04T01:50:36.625 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde600664d0 msgr2=0x7fde60068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde600664d0 0x7fde60068990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fde680ae000 tx=0x7fde68008040 comp rx=0 tx=0).stop 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 msgr2=0x7fde801570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde801570b0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c480 tx=0x7fde7000c940 comp rx=0 tx=0).stop 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 shutdown_connections 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fde600664d0 0x7fde60068990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde8015d5a0 0x7fde80157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fde8015d1c0 0x7fde800ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 --2- 172.21.15.2:0/2360731317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fde800d1cb0 0x7fde801570b0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 >> 172.21.15.2:0/2360731317 conn(0x7fde800d2fc0 msgr2=0x7fde800d36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:36.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 shutdown_connections 2023-11-04T01:50:36.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.625+0000 7fde85332640 1 -- 172.21.15.2:0/2360731317 wait complete. 2023-11-04T01:50:36.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_data_pool pg_num 2023-11-04T01:50:36.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.757+0000 7f9b2d529640 1 Processor -- start 2023-11-04T01:50:36.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.757+0000 7f9b2d529640 1 -- start start 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b2d529640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b2815d1c0 0x7f9b280d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b2d529640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d5a0 0x7f9b280d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b2d529640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b280d09b0 con 0x7f9b280b1ec0 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b2d529640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b280d0110 con 0x7f9b2815d1c0 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b2d529640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280d03f0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b26ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b2815d1c0 0x7f9b280d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b277fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9b280b1ec0 0x7f9b280cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57218/0 (socket says 172.21.15.2:57218) 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b277fe640 1 -- 172.21.15.2:0/4106679734 learned_addr learned my addr 172.21.15.2:0/4106679734 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b26ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b2815d1c0 0x7f9b280d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45110/0 (socket says 172.21.15.2:45110) 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b267fc640 1 --2- 172.21.15.2:0/4106679734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d5a0 0x7f9b280d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b26ffd640 1 -- 172.21.15.2:0/4106679734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d5a0 msgr2=0x7f9b280d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:36.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b26ffd640 1 --2- 172.21.15.2:0/4106679734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d5a0 0x7f9b280d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b26ffd640 1 -- 172.21.15.2:0/4106679734 >> v1:172.21.15.2:6789/0 conn(0x7f9b280b1ec0 legacy=0x7f9b280cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b26ffd640 1 -- 172.21.15.2:0/4106679734 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280d06d0 con 0x7f9b2815d1c0 2023-11-04T01:50:36.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.761+0000 7f9b25ffb640 1 -- 172.21.15.2:0/4106679734 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296725552 0 0) 0x7f9b280d09b0 con 0x7f9b280b1ec0 2023-11-04T01:50:36.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b26ffd640 1 --2- 172.21.15.2:0/4106679734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d1c0 0x7f9b280d3ae0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9b180097c0 tx=0x7f9b1801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b017edd72981ec server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b25ffb640 1 -- 172.21.15.2:0/4106679734 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180a7070 con 0x7f9b2815d1c0 2023-11-04T01:50:36.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b25ffb640 1 -- 172.21.15.2:0/4106679734 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b180ab430 con 0x7f9b2815d1c0 2023-11-04T01:50:36.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b25ffb640 1 -- 172.21.15.2:0/4106679734 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180ab7c0 con 0x7f9b2815d1c0 2023-11-04T01:50:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- 172.21.15.2:0/4106679734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d1c0 msgr2=0x7f9b280d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 --2- 172.21.15.2:0/4106679734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d1c0 0x7f9b280d3ae0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9b180097c0 tx=0x7f9b1801c450 comp rx=0 tx=0).stop 2023-11-04T01:50:36.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- 172.21.15.2:0/4106679734 shutdown_connections 2023-11-04T01:50:36.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 --2- 172.21.15.2:0/4106679734 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d5a0 0x7f9b280d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 --2- 172.21.15.2:0/4106679734 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d1c0 0x7f9b280d3ae0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- 172.21.15.2:0/4106679734 >> 172.21.15.2:0/4106679734 conn(0x7f9b280d2fc0 msgr2=0x7f9b280d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:36.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- 172.21.15.2:0/4106679734 shutdown_connections 2023-11-04T01:50:36.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- 172.21.15.2:0/4106679734 wait complete. 2023-11-04T01:50:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 Processor -- start 2023-11-04T01:50:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- start start 2023-11-04T01:50:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b280b1ec0 0x7f9b281f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d1c0 0x7f9b28145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d5a0 0x7f9b281592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280b4ca0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280b27c0 con 0x7f9b280b1ec0 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b2d529640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b281f9c80 con 0x7f9b2815d1c0 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d5a0 0x7f9b281592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d5a0 0x7f9b281592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45124/0 (socket says 172.21.15.2:45124) 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.765+0000 7f9b277fe640 1 -- 172.21.15.2:0/583355546 learned_addr learned my addr 172.21.15.2:0/583355546 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b267fc640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d1c0 0x7f9b28145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b26ffd640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b280b1ec0 0x7f9b281f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b277fe640 1 -- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d1c0 msgr2=0x7f9b28145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b277fe640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d1c0 0x7f9b28145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b277fe640 1 -- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b280b1ec0 msgr2=0x7f9b281f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b277fe640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b280b1ec0 0x7f9b281f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b277fe640 1 -- 172.21.15.2:0/583355546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18009420 con 0x7f9b2815d5a0 2023-11-04T01:50:36.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b277fe640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d5a0 0x7f9b281592b0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c7e0 tx=0x7f9b2000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/583355546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000a640 con 0x7f9b2815d5a0 2023-11-04T01:50:36.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/583355546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2000a7a0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b281455d0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/583355546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000ab50 con 0x7f9b2815d5a0 2023-11-04T01:50:36.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b280b40d0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b280b4de0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/583355546 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9b2000acb0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b0f7fe640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b140664a0 0x7f9b14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:36.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/583355546 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f9b20084040 con 0x7f9b2815d5a0 2023-11-04T01:50:36.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b26ffd640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b140664a0 0x7f9b14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:36.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.769+0000 7f9b26ffd640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b140664a0 0x7f9b14068960 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9b180af000 tx=0x7f9b18008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:36.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.773+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/583355546 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9b280b4de0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.929+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"} v 0) v1 -- 0x7f9b280b4de0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b0f7fe640 1 -- 172.21.15.2:0/583355546 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_data_pool", "var": "pg_num"}]=0 v112) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b280b4de0 con 0x7f9b2815d5a0 2023-11-04T01:50:36.933 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b140664a0 msgr2=0x7f9b14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b140664a0 0x7f9b14068960 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9b180af000 tx=0x7f9b18008040 comp rx=0 tx=0).stop 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d5a0 msgr2=0x7f9b281592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d5a0 0x7f9b281592b0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c7e0 tx=0x7f9b2000cca0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 shutdown_connections 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9b140664a0 0x7f9b14068960 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b2815d5a0 0x7f9b281592b0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9b2815d1c0 0x7f9b28145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 --2- 172.21.15.2:0/583355546 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b280b1ec0 0x7f9b281f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 >> 172.21.15.2:0/583355546 conn(0x7f9b280d2fc0 msgr2=0x7f9b2815e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 shutdown_connections 2023-11-04T01:50:36.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:36.933+0000 7f9b2d529640 1 -- 172.21.15.2:0/583355546 wait complete. 2023-11-04T01:50:36.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get test_metadata_pool pg_num 2023-11-04T01:50:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f6afc640 1 Processor -- start 2023-11-04T01:50:37.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f6afc640 1 -- start start 2023-11-04T01:50:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f6afc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2f01556c0 0x7ff2f015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f6afc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 0x7ff2f00cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f6afc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f015c600 con 0x7ff2f00c9360 2023-11-04T01:50:37.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f6afc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f00cb590 con 0x7ff2f01556c0 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f6afc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f006fe50 con 0x7ff2f00cabd0 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f5099640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff2f00c9360 0x7ff2f00c97f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57220/0 (socket says 172.21.15.2:57220) 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f5099640 1 -- 172.21.15.2:0/353252641 learned_addr learned my addr 172.21.15.2:0/353252641 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2effff640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 0x7ff2f00cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f4898640 1 --2- 172.21.15.2:0/353252641 >> v2:172.21.15.90:3300/0 conn(0x7ff2f01556c0 0x7ff2f015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139246974 0 0) 0x7ff2f015c600 con 0x7ff2f00c9360 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d8003530 con 0x7ff2f00c9360 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362960118 0 0) 0x7ff2d8003530 con 0x7ff2f00c9360 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 msgr2=0x7ff2f00cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 0x7ff2f00cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 >> v2:172.21.15.90:3300/0 conn(0x7ff2f01556c0 msgr2=0x7ff2f015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 --2- 172.21.15.2:0/353252641 >> v2:172.21.15.90:3300/0 conn(0x7ff2f01556c0 0x7ff2f015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00ae7f0 con 0x7ff2f00c9360 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7ff2e8001a00 con 0x7ff2f00c9360 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 >> v1:172.21.15.2:6789/0 conn(0x7ff2f00c9360 legacy=0x7ff2f00c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d8003980 0x7ff2d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d80047d0 0x7ff2d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 0x7ff2d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00cb590 con 0x7ff2d8003980 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f006fe50 con 0x7ff2d80047d0 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d800b990 con 0x7ff2f00cabd0 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f4898640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d8003980 0x7ff2d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2effff640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d80047d0 0x7ff2d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f5099640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 0x7ff2d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f4898640 1 -- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 msgr2=0x7ff2d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f4898640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2f00cabd0 0x7ff2d8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f4898640 1 -- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d80047d0 msgr2=0x7ff2d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f4898640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d80047d0 0x7ff2d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2f4898640 1 -- 172.21.15.2:0/353252641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8003530 con 0x7ff2d8003980 2023-11-04T01:50:37.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.073+0000 7ff2effff640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d80047d0 0x7ff2d8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-04T01:50:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f4898640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d8003980 0x7ff2d8003da0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009ae0 tx=0x7ff2e001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4eb110e75b0100c server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00a5550 con 0x7ff2d8003980 2023-11-04T01:50:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00a56b0 con 0x7ff2d8003980 2023-11-04T01:50:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2ef7fe640 1 -- 172.21.15.2:0/353252641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00a5a60 con 0x7ff2d8003980 2023-11-04T01:50:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 -- 172.21.15.2:0/353252641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d8003980 msgr2=0x7ff2d8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 --2- 172.21.15.2:0/353252641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d8003980 0x7ff2d8003da0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009ae0 tx=0x7ff2e001ca60 comp rx=0 tx=0).stop 2023-11-04T01:50:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f5099640 1 -- 172.21.15.2:0/353252641 reap_dead start 2023-11-04T01:50:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 -- 172.21.15.2:0/353252641 shutdown_connections 2023-11-04T01:50:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 -- 172.21.15.2:0/353252641 >> 172.21.15.2:0/353252641 conn(0x7ff2f00ced10 msgr2=0x7ff2f00cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 -- 172.21.15.2:0/353252641 shutdown_connections 2023-11-04T01:50:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 -- 172.21.15.2:0/353252641 wait complete. 2023-11-04T01:50:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 Processor -- start 2023-11-04T01:50:37.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.077+0000 7ff2f6afc640 1 -- start start 2023-11-04T01:50:37.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2d8003980 0x7ff2f00c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f00c79a0 0x7ff2f014e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f0164eb0 0x7ff2f0165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f0165870 con 0x7ff2f0164eb0 2023-11-04T01:50:37.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f01f3dc0 con 0x7ff2f00c79a0 2023-11-04T01:50:37.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00b2450 con 0x7ff2d8003980 2023-11-04T01:50:37.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f0164eb0 0x7ff2f0165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f0164eb0 0x7ff2f0165330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45134/0 (socket says 172.21.15.2:45134) 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 -- 172.21.15.2:0/2848530567 learned_addr learned my addr 172.21.15.2:0/2848530567 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f4898640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2d8003980 0x7ff2f00c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2effff640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f00c79a0 0x7ff2f014e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 -- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2d8003980 msgr2=0x7ff2f00c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2d8003980 0x7ff2f00c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 -- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f00c79a0 msgr2=0x7ff2f014e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f00c79a0 0x7ff2f014e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 -- 172.21.15.2:0/2848530567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00c81b0 con 0x7ff2f0164eb0 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f5099640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f0164eb0 0x7ff2f0165330 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b4ec0 tx=0x7ff2e800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2ed7fa640 1 -- 172.21.15.2:0/2848530567 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8007a80 con 0x7ff2f0164eb0 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2ed7fa640 1 -- 172.21.15.2:0/2848530567 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e800eda0 con 0x7ff2f0164eb0 2023-11-04T01:50:37.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f00b1b20 con 0x7ff2f0164eb0 2023-11-04T01:50:37.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2ed7fa640 1 -- 172.21.15.2:0/2848530567 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8014670 con 0x7ff2f0164eb0 2023-11-04T01:50:37.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f00b20e0 con 0x7ff2f0164eb0 2023-11-04T01:50:37.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f004e4a0 con 0x7ff2f0164eb0 2023-11-04T01:50:37.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2ed7fa640 1 -- 172.21.15.2:0/2848530567 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2e80147d0 con 0x7ff2f0164eb0 2023-11-04T01:50:37.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2ed7fa640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664a0 0x7ff2dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2ed7fa640 1 -- 172.21.15.2:0/2848530567 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7ff2e8084510 con 0x7ff2f0164eb0 2023-11-04T01:50:37.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.081+0000 7ff2f4898640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664a0 0x7ff2dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.085+0000 7ff2f4898640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664a0 0x7ff2dc068960 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00af000 tx=0x7ff2e00046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.085+0000 7ff2ed7fa640 1 -- 172.21.15.2:0/2848530567 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff2e8051100 con 0x7ff2f0164eb0 2023-11-04T01:50:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.237+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"} v 0) v1 -- 0x7ff2f0154e60 con 0x7ff2f0164eb0 2023-11-04T01:50:37.238 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.237+0000 7ff2ed7fa640 1 -- 172.21.15.2:0/2848530567 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "test_metadata_pool", "var": "pg_num"}]=0 v112) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff2e8054720 con 0x7ff2f0164eb0 2023-11-04T01:50:37.239 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.237+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664a0 msgr2=0x7ff2dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.237+0000 7ff2f6afc640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664a0 0x7ff2dc068960 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00af000 tx=0x7ff2e00046d0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.237+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f0164eb0 msgr2=0x7ff2f0165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f0164eb0 0x7ff2f0165330 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b4ec0 tx=0x7ff2e800e530 comp rx=0 tx=0).stop 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 shutdown_connections 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7ff2dc0664a0 0x7ff2dc068960 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2f0164eb0 0x7ff2f0165330 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2f00c79a0 0x7ff2f014e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 --2- 172.21.15.2:0/2848530567 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7ff2d8003980 0x7ff2f00c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 >> 172.21.15.2:0/2848530567 conn(0x7ff2f00ced10 msgr2=0x7ff2f00cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 shutdown_connections 2023-11-04T01:50:37.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.241+0000 7ff2f6afc640 1 -- 172.21.15.2:0/2848530567 wait complete. 2023-11-04T01:50:37.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-04T01:50:37.372 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.369+0000 7f9dd0db2640 1 Processor -- start 2023-11-04T01:50:37.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dd0db2640 1 -- start start 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dd0db2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9dcc15af80 0x7f9dcc070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dd0db2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9dcc071380 0x7f9dcc06a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dd0db2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc071de0 con 0x7f9dcc15b360 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dd0db2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc071820 con 0x7f9dcc15af80 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dd0db2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc071b00 con 0x7f9dcc071380 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9dcc15af80 0x7f9dcc070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9dcc15af80 0x7f9dcc070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45138/0 (socket says 172.21.15.2:45138) 2023-11-04T01:50:37.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 -- 172.21.15.2:0/1672175381 learned_addr learned my addr 172.21.15.2:0/1672175381 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dc9d9b640 1 --2- 172.21.15.2:0/1672175381 >> v2:172.21.15.90:3300/0 conn(0x7f9dcc071380 0x7f9dcc06a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 -- 172.21.15.2:0/1672175381 >> v2:172.21.15.90:3300/0 conn(0x7f9dcc071380 msgr2=0x7f9dcc06a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 --2- 172.21.15.2:0/1672175381 >> v2:172.21.15.90:3300/0 conn(0x7f9dcc071380 0x7f9dcc06a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 -- 172.21.15.2:0/1672175381 >> v1:172.21.15.90:6789/0 conn(0x7f9dcc15b360 legacy=0x7f9dcc0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 -- 172.21.15.2:0/1672175381 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0cc0e0 con 0x7f9dcc15af80 2023-11-04T01:50:37.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dca59c640 1 --2- 172.21.15.2:0/1672175381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc070e40 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0c6f10 tx=0x7f9dc001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d28af423fad0b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dc959a640 1 -- 172.21.15.2:0/1672175381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00aa610 con 0x7f9dcc15af80 2023-11-04T01:50:37.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dc959a640 1 -- 172.21.15.2:0/1672175381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc00a6040 con 0x7f9dcc15af80 2023-11-04T01:50:37.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.373+0000 7f9dc959a640 1 -- 172.21.15.2:0/1672175381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00aa990 con 0x7f9dcc15af80 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- 172.21.15.2:0/1672175381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 msgr2=0x7f9dcc070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/1672175381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc070e40 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0c6f10 tx=0x7f9dc001c490 comp rx=0 tx=0).stop 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- 172.21.15.2:0/1672175381 shutdown_connections 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/1672175381 >> v2:172.21.15.90:3300/0 conn(0x7f9dcc071380 0x7f9dcc06a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/1672175381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc070e40 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- 172.21.15.2:0/1672175381 >> 172.21.15.2:0/1672175381 conn(0x7f9dcc0b1a20 msgr2=0x7f9dcc0b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- 172.21.15.2:0/1672175381 shutdown_connections 2023-11-04T01:50:37.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- 172.21.15.2:0/1672175381 wait complete. 2023-11-04T01:50:37.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 Processor -- start 2023-11-04T01:50:37.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- start start 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dcc071380 0x7f9dcc151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc0c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dcc15b360 0x7f9dcc157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1f79c0 con 0x7f9dcc15af80 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc15c8e0 con 0x7f9dcc071380 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dd0db2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc1f7bd0 con 0x7f9dcc15b360 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc0c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc0c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45152/0 (socket says 172.21.15.2:45152) 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 -- 172.21.15.2:0/3747939211 learned_addr learned my addr 172.21.15.2:0/3747939211 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dca59c640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dcc071380 0x7f9dcc151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dcad9d640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dcc15b360 0x7f9dcc157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 -- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dcc15b360 msgr2=0x7f9dcc157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dcc15b360 0x7f9dcc157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 -- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dcc071380 msgr2=0x7f9dcc151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dcc071380 0x7f9dcc151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 -- 172.21.15.2:0/3747939211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00094d0 con 0x7f9dcc15af80 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dcad9d640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dcc15b360 0x7f9dcc157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.377+0000 7f9dc9d9b640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc0c39c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c820 tx=0x7f9dbc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dbaffd640 1 -- 172.21.15.2:0/3747939211 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc004220 con 0x7f9dcc15af80 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dbaffd640 1 -- 172.21.15.2:0/3747939211 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0043a0 con 0x7f9dcc15af80 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc1f7eb0 con 0x7f9dcc15af80 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dbaffd640 1 -- 172.21.15.2:0/3747939211 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc004510 con 0x7f9dcc15af80 2023-11-04T01:50:37.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc1f8470 con 0x7f9dcc15af80 2023-11-04T01:50:37.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc04e4a0 con 0x7f9dcc15af80 2023-11-04T01:50:37.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dbaffd640 1 -- 172.21.15.2:0/3747939211 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9dbc007a70 con 0x7f9dcc15af80 2023-11-04T01:50:37.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dbaffd640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9dac0664a0 0x7f9dac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dbaffd640 1 -- 172.21.15.2:0/3747939211 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f9dbc084460 con 0x7f9dcc15af80 2023-11-04T01:50:37.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dca59c640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9dac0664a0 0x7f9dac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.384 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.381+0000 7f9dca59c640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9dac0664a0 0x7f9dac068960 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ae000 tx=0x7f9dc00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.386 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.385+0000 7f9dbaffd640 1 -- 172.21.15.2:0/3747939211 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9dbc0510d0 con 0x7f9dcc15af80 2023-11-04T01:50:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.537+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9dcc0ca430 con 0x7f9dcc15af80 2023-11-04T01:50:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.537+0000 7f9dbaffd640 1 -- 172.21.15.2:0/3747939211 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v112) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9dbc01e020 con 0x7f9dcc15af80 2023-11-04T01:50:37.539 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-04T01:50:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9dac0664a0 msgr2=0x7f9dac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9dac0664a0 0x7f9dac068960 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ae000 tx=0x7f9dc00a7000 comp rx=0 tx=0).stop 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 msgr2=0x7f9dcc0c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc0c39c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c820 tx=0x7f9dbc00cce0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 shutdown_connections 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f9dac0664a0 0x7f9dac068960 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f9dcc15b360 0x7f9dcc157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dcc15af80 0x7f9dcc0c39c0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 --2- 172.21.15.2:0/3747939211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9dcc071380 0x7f9dcc151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 >> 172.21.15.2:0/3747939211 conn(0x7f9dcc0b1a20 msgr2=0x7f9dcc0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:37.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 shutdown_connections 2023-11-04T01:50:37.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.541+0000 7f9dd0db2640 1 -- 172.21.15.2:0/3747939211 wait complete. 2023-11-04T01:50:37.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-04T01:50:37.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6bfb2640 1 Processor -- start 2023-11-04T01:50:37.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6bfb2640 1 -- start start 2023-11-04T01:50:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6bfb2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d6415d3e0 0x7f4d64160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6bfb2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d640b2fb0 0x7f4d6406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6bfb2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d640d0b30 con 0x7f4d6406c780 2023-11-04T01:50:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6bfb2640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d64070490 con 0x7f4d6415d3e0 2023-11-04T01:50:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6bfb2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640ceb90 con 0x7f4d640b2fb0 2023-11-04T01:50:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d69d4e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d6415d3e0 0x7f4d64160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d69d4e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4d6415d3e0 0x7f4d64160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45166/0 (socket says 172.21.15.2:45166) 2023-11-04T01:50:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d69d4e640 1 -- 172.21.15.2:0/1905553123 learned_addr learned my addr 172.21.15.2:0/1905553123 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d6a54f640 1 --2- 172.21.15.2:0/1905553123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d640b2fb0 0x7f4d6406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d69d4e640 1 -- 172.21.15.2:0/1905553123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d640b2fb0 msgr2=0x7f4d6406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d69d4e640 1 --2- 172.21.15.2:0/1905553123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d640b2fb0 0x7f4d6406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d69d4e640 1 -- 172.21.15.2:0/1905553123 >> v1:172.21.15.90:6789/0 conn(0x7f4d6406c780 legacy=0x7f4d640b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.685+0000 7f4d69d4e640 1 -- 172.21.15.2:0/1905553123 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640cee70 con 0x7f4d6415d3e0 2023-11-04T01:50:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d69d4e640 1 --2- 172.21.15.2:0/1905553123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d6415d3e0 0x7f4d64160e10 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ae294dc17b3584 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d68d4c640 1 -- 172.21.15.2:0/1905553123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600aa610 con 0x7f4d6415d3e0 2023-11-04T01:50:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d68d4c640 1 -- 172.21.15.2:0/1905553123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600a6040 con 0x7f4d6415d3e0 2023-11-04T01:50:37.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d68d4c640 1 -- 172.21.15.2:0/1905553123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600aa990 con 0x7f4d6415d3e0 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/1905553123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d6415d3e0 msgr2=0x7f4d64160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/1905553123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d6415d3e0 0x7f4d64160e10 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6001c4d0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/1905553123 shutdown_connections 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/1905553123 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d640b2fb0 0x7f4d6406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/1905553123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d6415d3e0 0x7f4d64160e10 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/1905553123 >> 172.21.15.2:0/1905553123 conn(0x7f4d640cd8a0 msgr2=0x7f4d640cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/1905553123 shutdown_connections 2023-11-04T01:50:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/1905553123 wait complete. 2023-11-04T01:50:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 Processor -- start 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- start start 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d6406c780 0x7f4d64152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640b2fb0 0x7f4d6413b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415d3e0 0x7f4d6413da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6413c3d0 con 0x7f4d640b2fb0 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6413c6b0 con 0x7f4d6406c780 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6bfb2640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6413c990 con 0x7f4d6415d3e0 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640b2fb0 0x7f4d6413b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640b2fb0 0x7f4d6413b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45180/0 (socket says 172.21.15.2:45180) 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 -- 172.21.15.2:0/39810409 learned_addr learned my addr 172.21.15.2:0/39810409 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d69d4e640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d6406c780 0x7f4d64152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6a54f640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415d3e0 0x7f4d6413da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 -- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415d3e0 msgr2=0x7f4d6413da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415d3e0 0x7f4d6413da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 -- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d6406c780 msgr2=0x7f4d64152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d6406c780 0x7f4d64152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 -- 172.21.15.2:0/39810409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600094d0 con 0x7f4d640b2fb0 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.689+0000 7f4d6954d640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640b2fb0 0x7f4d6413b980 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c410 tx=0x7f4d5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d5a7fc640 1 -- 172.21.15.2:0/39810409 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54011790 con 0x7f4d640b2fb0 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d5a7fc640 1 -- 172.21.15.2:0/39810409 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d54011910 con 0x7f4d640b2fb0 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6413cc70 con 0x7f4d640b2fb0 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d5a7fc640 1 -- 172.21.15.2:0/39810409 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54011d00 con 0x7f4d640b2fb0 2023-11-04T01:50:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d64152d80 con 0x7f4d640b2fb0 2023-11-04T01:50:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6413d190 con 0x7f4d640b2fb0 2023-11-04T01:50:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d5a7fc640 1 -- 172.21.15.2:0/39810409 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d5401c460 con 0x7f4d640b2fb0 2023-11-04T01:50:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d5a7fc640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d5a7fc640 1 -- 172.21.15.2:0/39810409 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7f4d54084580 con 0x7f4d640b2fb0 2023-11-04T01:50:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d69d4e640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.693+0000 7f4d69d4e640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ae000 tx=0x7f4d600a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.697+0000 7f4d5a7fc640 1 -- 172.21.15.2:0/39810409 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d6413d190 con 0x7f4d640b2fb0 2023-11-04T01:50:37.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.849+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d6413d190 con 0x7f4d640b2fb0 2023-11-04T01:50:37.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.849+0000 7f4d5a7fc640 1 -- 172.21.15.2:0/39810409 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v112) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d6413d190 con 0x7f4d640b2fb0 2023-11-04T01:50:37.852 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 msgr2=0x7f4d48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ae000 tx=0x7f4d600a7000 comp rx=0 tx=0).stop 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640b2fb0 msgr2=0x7f4d6413b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640b2fb0 0x7f4d6413b980 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c410 tx=0x7f4d5400c8d0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 shutdown_connections 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7f4d480664a0 0x7f4d48068960 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f4d6415d3e0 0x7f4d6413da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d640b2fb0 0x7f4d6413b980 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 --2- 172.21.15.2:0/39810409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d6406c780 0x7f4d64152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 >> 172.21.15.2:0/39810409 conn(0x7f4d640cd8a0 msgr2=0x7f4d6406f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 shutdown_connections 2023-11-04T01:50:37.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.853+0000 7f4d6bfb2640 1 -- 172.21.15.2:0/39810409 wait complete. 2023-11-04T01:50:37.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-04T01:50:37.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb462d3640 1 Processor -- start 2023-11-04T01:50:37.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb462d3640 1 -- start start 2023-11-04T01:50:37.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb462d3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb400b4bc0 0x7fcb4006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb462d3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb400b3be0 con 0x7fcb4015d310 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb462d3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb400b38b0 con 0x7fcb4006d190 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb462d3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb40161790 con 0x7fcb400b4bc0 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb3ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fcb4015d310 0x7fcb40160fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57232/0 (socket says 172.21.15.2:57232) 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.989+0000 7fcb3ffff640 1 -- 172.21.15.2:0/226511157 learned_addr learned my addr 172.21.15.2:0/226511157 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/226511157 >> v2:172.21.15.90:3300/0 conn(0x7fcb400b4bc0 0x7fcb4006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180754813 0 0) 0x7fcb400b3be0 con 0x7fcb4015d310 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb28003530 con 0x7fcb4015d310 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3971227106 0 0) 0x7fcb28003530 con 0x7fcb4015d310 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 >> v2:172.21.15.90:3300/0 conn(0x7fcb400b4bc0 msgr2=0x7fcb4006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 --2- 172.21.15.2:0/226511157 >> v2:172.21.15.90:3300/0 conn(0x7fcb400b4bc0 0x7fcb4006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 >> v1:172.21.15.90:6789/0 conn(0x7fcb4006d190 legacy=0x7fcb400b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40161a70 con 0x7fcb4015d310 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 421264689 0 0) 0x7fcb30001a00 con 0x7fcb4015d310 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 >> v1:172.21.15.2:6789/0 conn(0x7fcb4015d310 legacy=0x7fcb40160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb28003980 0x7fcb28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb28005190 0x7fcb2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40161790 con 0x7fcb280047d0 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2800c130 con 0x7fcb28005190 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2800c2f0 con 0x7fcb28003980 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3ffff640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb28003980 0x7fcb28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb44870640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb28005190 0x7fcb2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb28003980 msgr2=0x7fcb28003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb28003980 0x7fcb28003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb28005190 msgr2=0x7fcb2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-04T01:50:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb28005190 0x7fcb2800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3f7fe640 1 -- 172.21.15.2:0/226511157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28003530 con 0x7fcb280047d0 2023-11-04T01:50:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb44870640 1 -- 172.21.15.2:0/226511157 reap_dead start 2023-11-04T01:50:37.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.993+0000 7fcb3ffff640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb28003980 0x7fcb28003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:37.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb28004c50 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009ae0 tx=0x7fcb3401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91ab4f98c56b745 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:37.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340a6510 con 0x7fcb280047d0 2023-11-04T01:50:37.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb340a6670 con 0x7fcb280047d0 2023-11-04T01:50:37.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3effd640 1 -- 172.21.15.2:0/226511157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb340a6a20 con 0x7fcb280047d0 2023-11-04T01:50:37.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- 172.21.15.2:0/226511157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 msgr2=0x7fcb28004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:37.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb28004c50 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009ae0 tx=0x7fcb3401ca20 comp rx=0 tx=0).stop 2023-11-04T01:50:37.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- 172.21.15.2:0/226511157 shutdown_connections 2023-11-04T01:50:37.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 --2- 172.21.15.2:0/226511157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb28004c50 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:37.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- 172.21.15.2:0/226511157 >> 172.21.15.2:0/226511157 conn(0x7fcb400b18a0 msgr2=0x7fcb400b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:37.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- 172.21.15.2:0/226511157 shutdown_connections 2023-11-04T01:50:37.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- 172.21.15.2:0/226511157 wait complete. 2023-11-04T01:50:37.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 Processor -- start 2023-11-04T01:50:37.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- start start 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb40146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb401fa8a0 0x7fcb400ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb400cecc0 0x7fcb4015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4015c370 con 0x7fcb280047d0 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb400cf140 con 0x7fcb401fa8a0 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40146c50 con 0x7fcb400cecc0 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb40146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb40146710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45196/0 (socket says 172.21.15.2:45196) 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 -- 172.21.15.2:0/2072980694 learned_addr learned my addr 172.21.15.2:0/2072980694 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb401fa8a0 0x7fcb400ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb44870640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb400cecc0 0x7fcb4015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 -- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb400cecc0 msgr2=0x7fcb4015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:38.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb400cecc0 0x7fcb4015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 -- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb401fa8a0 msgr2=0x7fcb400ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb401fa8a0 0x7fcb400ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 -- 172.21.15.2:0/2072980694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4015c090 con 0x7fcb280047d0 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb44870640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb400cecc0 0x7fcb4015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3ffff640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb40146710 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fcb30001340 tx=0x7fcb3000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3cff9640 1 -- 172.21.15.2:0/2072980694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30004b70 con 0x7fcb280047d0 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3cff9640 1 -- 172.21.15.2:0/2072980694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30004cd0 con 0x7fcb280047d0 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb401f9dc0 con 0x7fcb280047d0 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:37.997+0000 7fcb3cff9640 1 -- 172.21.15.2:0/2072980694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300072f0 con 0x7fcb280047d0 2023-11-04T01:50:38.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.001+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb401fa380 con 0x7fcb280047d0 2023-11-04T01:50:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.001+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb401f9c20 con 0x7fcb280047d0 2023-11-04T01:50:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.001+0000 7fcb3cff9640 1 -- 172.21.15.2:0/2072980694 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb30007450 con 0x7fcb280047d0 2023-11-04T01:50:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.001+0000 7fcb3cff9640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb2c0664a0 0x7fcb2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:50:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.001+0000 7fcb3cff9640 1 -- 172.21.15.2:0/2072980694 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7905+0+0 (secure 0 0 0) 0x7fcb30084910 con 0x7fcb280047d0 2023-11-04T01:50:38.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.001+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb2c0664a0 0x7fcb2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-04T01:50:38.004 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.001+0000 7fcb3f7fe640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb2c0664a0 0x7fcb2c068960 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcb340af000 tx=0x7fcb340046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-04T01:50:38.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.005+0000 7fcb3cff9640 1 -- 172.21.15.2:0/2072980694 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcb401f9c20 con 0x7fcb280047d0 2023-11-04T01:50:38.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.165+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb401f9c20 con 0x7fcb280047d0 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.165+0000 7fcb3cff9640 1 -- 172.21.15.2:0/2072980694 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 23 entries v112) v1 ==== 81+0+1373 (secure 0 0 0) 0x7fcb401f9c20 con 0x7fcb280047d0 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/4169282097 2023-11-04T02:50:00.880111+0000 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/3695355178 2023-11-05T01:49:53.201635+0000 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2988241810 2023-11-04T02:49:10.916906+0000 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/238645283 2023-11-05T01:49:02.752564+0000 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:50:38.167 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/792110972 2023-11-05T01:46:46.354936+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/3051439603 2023-11-05T01:48:55.822867+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/1345296201 2023-11-05T01:46:20.984713+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6834/2449846925 2023-11-05T01:49:45.775757+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6834/3941825889 2023-11-05T01:47:11.675457+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6833/2515781456 2023-11-05T01:47:37.879054+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6832/3695355178 2023-11-05T01:49:53.201635+0000 2023-11-04T01:50:38.168 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.90:6837/433120793 2023-11-05T01:48:05.613405+0000 2023-11-04T01:50:38.169 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/3725992406 2023-11-05T01:48:12.536544+0000 2023-11-04T01:50:38.169 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6835/2449846925 2023-11-05T01:49:45.775757+0000 2023-11-04T01:50:38.169 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.1:0/2023608941 2023-11-04T02:48:20.721790+0000 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:listed 23 entries 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb2c0664a0 msgr2=0x7fcb2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb2c0664a0 0x7fcb2c068960 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcb340af000 tx=0x7fcb340046d0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 msgr2=0x7fcb40146710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb40146710 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fcb30001340 tx=0x7fcb3000b4a0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 shutdown_connections 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:6832/650491919,v1:172.21.15.90:6833/650491919] conn(0x7fcb2c0664a0 0x7fcb2c068960 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7fcb400cecc0 0x7fcb4015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb401fa8a0 0x7fcb400ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 --2- 172.21.15.2:0/2072980694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb280047d0 0x7fcb40146710 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:50:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 >> 172.21.15.2:0/2072980694 conn(0x7fcb400b18a0 msgr2=0x7fcb400ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-04T01:50:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 shutdown_connections 2023-11-04T01:50:38.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38.169+0000 7fcb462d3640 1 -- 172.21.15.2:0/2072980694 wait complete. 2023-11-04T01:50:38.184 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-04T01:50:38.184 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:50:38.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:38.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2023-11-04T01:50:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2023-11-04T01:50:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:38 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2023-11-04T01:50:38.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:50:38.242 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi002.front.sepia.ceph.com, aborting... 2023-11-04T01:50:38.242 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:50:38.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer --timeout=300 -- env PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-11-04T01:50:39.197 INFO:teuthology.orchestra.run.smithi002.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-11-04T01:50:39.197 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.197 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.197 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-04T01:50:39.197 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.198 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.199 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 3w CHR 1,11 0t0 11 /dev/kmsg 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 6r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 7r DIR 0,28 0 1 /sys/fs/cgroup 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 9u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 10r REG 0,23 0 17002 /proc/1/mountinfo 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 11r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 12r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 14r REG 0,23 0 4026532081 /proc/swaps 2023-11-04T01:50:39.200 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 15u netlink 0t0 17003 KOBJECT_UEVENT 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 16r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 17r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 18u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 19u unix 0xffff955a90d83740 0t0 17007 /run/systemd/private type=STREAM 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 20u unix 0xffff955a90d850c0 0t0 17009 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 21u unix 0xffff955a90d85940 0t0 17010 /run/systemd/io.system.ManagedOOM type=STREAM 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 22u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 23u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 24u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 25u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 26u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 27u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.201 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 28r CHR 10,235 0t0 430 /dev/autofs 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 29u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 30u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 34u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 35u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 37u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 38u a_inode 0,14 0 12540 bpf-prog 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 40u unix 0xffff955a90d81100 0t0 17004 /run/systemd/notify type=DGRAM 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 41u unix 0xffff955a90d84840 0t0 17005 type=DGRAM 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 45u unix 0xffff955a91f08000 0t0 133111 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 52u unix 0xffff955a90db7700 0t0 18544 type=DGRAM 2023-11-04T01:50:39.202 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 53u netlink 0t0 18545 AUDIT 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 54u unix 0xffff955a90d83300 0t0 17006 type=DGRAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 55u unix 0xffff955a8c181dc0 0t0 22856 type=DGRAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 56u unix 0xffff955a8c1861c0 0t0 22857 type=DGRAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 59u netlink 0t0 17047 ROUTE 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 60u unix 0xffff955a90d80440 0t0 17018 /run/lvm/lvmpolld.socket type=STREAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 61u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 62u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 71u FIFO 0,25 0t0 420 /run/initctl 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 72u unix 0xffff955a90d80000 0t0 17034 /run/systemd/fsck.progress type=STREAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 73u unix 0xffff955a8c182200 0t0 22862 type=STREAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 74u unix 0xffff955a90d82ec0 0t0 17032 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 75u unix 0xffff955a94404400 0t0 15975 @ISCSIADM_ABSTRACT_NAMESPACE type=STREAM 2023-11-04T01:50:39.203 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 76u netlink 0t0 17050 KOBJECT_UEVENT 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 77u unix 0xffff955a94402ec0 0t0 15976 /run/uuidd/request type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 81u netlink 0t0 17040 AUDIT 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 98u CHR 10,242 0t0 3 /dev/rfkill 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 103u unix 0xffff955a89d8e600 0t0 132890 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 106u unix 0xffff955a90db3fc0 0t0 127706 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 107u unix 0xffff955a89d88440 0t0 75850 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 109u unix 0xffff955a94407b40 0t0 19251 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 113u unix 0xffff955a8b6b8880 0t0 23081 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 114u unix 0xffff955a90db5500 0t0 23059 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 117u unix 0xffff955a83c3a640 0t0 23058 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 118u unix 0xffff955a90db50c0 0t0 23056 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 119u unix 0xffff955a90d82a80 0t0 23035 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.204 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 120u unix 0xffff955a91f08880 0t0 21933 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 121u unix 0xffff955a90d872c0 0t0 21929 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 122u unix 0xffff955a8b6bb740 0t0 21928 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 123u unix 0xffff955a94403300 0t0 21927 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 124u unix 0xffff955a94401540 0t0 19991 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 125u unix 0xffff955a8b6bea40 0t0 19990 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 126u unix 0xffff955a83c3aec0 0t0 22853 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 127u unix 0xffff955a944050c0 0t0 21874 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 128u unix 0xffff955a80fbee80 0t0 24500 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 129u unix 0xffff955a80fbb740 0t0 22722 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 130u unix 0xffff955a89d8f2c0 0t0 122162 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 131u unix 0xffff955a91f08cc0 0t0 134754 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 147u unix 0xffff955a90d84400 0t0 17020 /run/rpcbind.sock type=STREAM 2023-11-04T01:50:39.205 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 148u IPv4 18515 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 149u IPv4 18516 0t0 UDP *:sunrpc 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 150u IPv6 17453 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 151u IPv6 18517 0t0 UDP *:sunrpc 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 152u FIFO 0,25 0t0 413 /run/dmeventd-server 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 153u FIFO 0,25 0t0 414 /run/dmeventd-client 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 154u unix 0xffff955a8b6be600 0t0 24566 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 155u unix 0xffff955a90d86e80 0t0 17048 /run/udev/control type=SEQPACKET 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 156u unix 0xffff955a90d80cc0 0t0 17041 /run/systemd/journal/dev-log type=DGRAM 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 157u unix 0xffff955a90d83fc0 0t0 17043 /run/systemd/journal/socket type=DGRAM 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 158u unix 0xffff955a90d84c80 0t0 17045 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1 root 159r FIFO 0,13 0t0 17015 pipe 2023-11-04T01:50:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-11-04T01:50:39.207 INFO:teuthology.orchestra.run.smithi002.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:netns 6 root txt unknown /proc/6/exe 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.208 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 13 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 13 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 13 root txt unknown /proc/13/exe 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_sched 14 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_sched 14 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:rcu_sched 14 root txt unknown /proc/14/exe 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:migration 15 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:migration 15 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:migration 15 root txt unknown /proc/15/exe 2023-11-04T01:50:39.209 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 16 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 16 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 16 root txt unknown /proc/16/exe 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/0 18 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/0 18 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/0 18 root txt unknown /proc/18/exe 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/1 19 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/1 19 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/1 19 root txt unknown /proc/19/exe 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 20 root txt unknown /proc/20/exe 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:migration 21 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.210 INFO:teuthology.orchestra.run.smithi002.stdout:migration 21 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:migration 21 root txt unknown /proc/21/exe 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 22 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 22 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 22 root txt unknown /proc/22/exe 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 24 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 24 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 24 root txt unknown /proc/24/exe 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/2 25 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/2 25 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/2 25 root txt unknown /proc/25/exe 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 26 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 26 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 26 root txt unknown /proc/26/exe 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:migration 27 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:migration 27 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:migration 27 root txt unknown /proc/27/exe 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 28 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 28 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 28 root txt unknown /proc/28/exe 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 30 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 30 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 30 root txt unknown /proc/30/exe 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/3 31 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/3 31 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/3 31 root txt unknown /proc/31/exe 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 32 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.212 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 32 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 32 root txt unknown /proc/32/exe 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:migration 33 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:migration 33 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:migration 33 root txt unknown /proc/33/exe 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 34 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 34 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 34 root txt unknown /proc/34/exe 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 36 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 36 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 36 root txt unknown /proc/36/exe 2023-11-04T01:50:39.213 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/4 37 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/4 37 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/4 37 root txt unknown /proc/37/exe 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 38 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 38 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 38 root txt unknown /proc/38/exe 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:migration 39 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:migration 39 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:migration 39 root txt unknown /proc/39/exe 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 40 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 40 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 40 root txt unknown /proc/40/exe 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 42 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.214 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 42 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 42 root txt unknown /proc/42/exe 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/5 43 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/5 43 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/5 43 root txt unknown /proc/43/exe 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 44 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 44 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 44 root txt unknown /proc/44/exe 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:migration 45 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:migration 45 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:migration 45 root txt unknown /proc/45/exe 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 46 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 46 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.215 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 46 root txt unknown /proc/46/exe 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 48 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 48 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 48 root txt unknown /proc/48/exe 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/6 49 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/6 49 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/6 49 root txt unknown /proc/49/exe 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 50 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 50 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 50 root txt unknown /proc/50/exe 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:migration 51 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:migration 51 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:migration 51 root txt unknown /proc/51/exe 2023-11-04T01:50:39.216 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 52 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 52 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 52 root txt unknown /proc/52/exe 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 54 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 54 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 54 root txt unknown /proc/54/exe 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/7 55 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/7 55 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:cpuhp/7 55 root txt unknown /proc/55/exe 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 56 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 56 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:idle_inje 56 root txt unknown /proc/56/exe 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:migration 57 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.217 INFO:teuthology.orchestra.run.smithi002.stdout:migration 57 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:migration 57 root txt unknown /proc/57/exe 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 58 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 58 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:ksoftirqd 58 root txt unknown /proc/58/exe 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 60 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 60 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 60 root txt unknown /proc/60/exe 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:kdevtmpfs 61 root cwd DIR 0,5 4280 1 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:kdevtmpfs 61 root rtd DIR 0,5 4280 1 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:kdevtmpfs 61 root txt unknown /proc/61/exe 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:inet_frag 62 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.218 INFO:teuthology.orchestra.run.smithi002.stdout:inet_frag 62 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:inet_frag 62 root txt unknown /proc/62/exe 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:kauditd 63 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:kauditd 63 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:kauditd 63 root txt unknown /proc/63/exe 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:khungtask 64 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:khungtask 64 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:khungtask 64 root txt unknown /proc/64/exe 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:oom_reape 65 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:oom_reape 65 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:oom_reape 65 root txt unknown /proc/65/exe 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:writeback 66 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:writeback 66 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.219 INFO:teuthology.orchestra.run.smithi002.stdout:writeback 66 root txt unknown /proc/66/exe 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:kcompactd 67 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:kcompactd 67 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:kcompactd 67 root txt unknown /proc/67/exe 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:ksmd 68 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:ksmd 68 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:ksmd 68 root txt unknown /proc/68/exe 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:khugepage 69 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:khugepage 69 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:khugepage 69 root txt unknown /proc/69/exe 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:kintegrit 116 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:kintegrit 116 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:kintegrit 116 root txt unknown /proc/116/exe 2023-11-04T01:50:39.220 INFO:teuthology.orchestra.run.smithi002.stdout:kblockd 117 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:kblockd 117 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:kblockd 117 root txt unknown /proc/117/exe 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:blkcg_pun 118 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:blkcg_pun 118 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:blkcg_pun 118 root txt unknown /proc/118/exe 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:tpm_dev_w 119 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:tpm_dev_w 119 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:tpm_dev_w 119 root txt unknown /proc/119/exe 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:ata_sff 120 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:ata_sff 120 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:ata_sff 120 root txt unknown /proc/120/exe 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:md 121 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:md 121 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.221 INFO:teuthology.orchestra.run.smithi002.stdout:md 121 root txt unknown /proc/121/exe 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:edac-poll 122 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:edac-poll 122 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:edac-poll 122 root txt unknown /proc/122/exe 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:devfreq_w 123 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:devfreq_w 123 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:devfreq_w 123 root txt unknown /proc/123/exe 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:watchdogd 124 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:watchdogd 124 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:watchdogd 124 root txt unknown /proc/124/exe 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 126 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 126 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.222 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 126 root txt unknown /proc/126/exe 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:kswapd0 134 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:kswapd0 134 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:kswapd0 134 root txt unknown /proc/134/exe 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:ecryptfs- 135 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:ecryptfs- 135 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:ecryptfs- 135 root txt unknown /proc/135/exe 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:kthrotld 137 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:kthrotld 137 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:kthrotld 137 root txt unknown /proc/137/exe 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:acpi_ther 138 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:acpi_ther 138 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:acpi_ther 138 root txt unknown /proc/138/exe 2023-11-04T01:50:39.223 INFO:teuthology.orchestra.run.smithi002.stdout:vfio-irqf 141 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:vfio-irqf 141 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:vfio-irqf 141 root txt unknown /proc/141/exe 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:mld 142 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:mld 142 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:mld 142 root txt unknown /proc/142/exe 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:ipv6_addr 143 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:ipv6_addr 143 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:ipv6_addr 143 root txt unknown /proc/143/exe 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:kstrp 152 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:kstrp 152 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:kstrp 152 root txt unknown /proc/152/exe 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:zswap-shr 157 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.224 INFO:teuthology.orchestra.run.smithi002.stdout:zswap-shr 157 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:zswap-shr 157 root txt unknown /proc/157/exe 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 158 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 158 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 158 root txt unknown /proc/158/exe 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:charger_m 163 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:charger_m 163 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:charger_m 163 root txt unknown /proc/163/exe 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 186 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 186 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 186 root txt unknown /proc/186/exe 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 207 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.225 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 207 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 207 root txt unknown /proc/207/exe 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-wq 218 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-wq 218 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-wq 218 root txt unknown /proc/218/exe 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-rese 219 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-rese 219 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-rese 219 root txt unknown /proc/219/exe 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-dele 220 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-dele 220 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.226 INFO:teuthology.orchestra.run.smithi002.stdout:nvme-dele 220 root txt unknown /proc/220/exe 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_0 221 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_0 221 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_0 221 root txt unknown /proc/221/exe 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 222 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 222 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 222 root txt unknown /proc/222/exe 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_1 223 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_1 223 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_1 223 root txt unknown /proc/223/exe 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 224 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 224 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.227 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 224 root txt unknown /proc/224/exe 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_2 225 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_2 225 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_2 225 root txt unknown /proc/225/exe 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 226 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 226 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 226 root txt unknown /proc/226/exe 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 228 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 228 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 228 root txt unknown /proc/228/exe 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_3 229 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_3 229 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_3 229 root txt unknown /proc/229/exe 2023-11-04T01:50:39.228 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 230 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 230 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 230 root txt unknown /proc/230/exe 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:ixgbe 231 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:ixgbe 231 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:ixgbe 231 root txt unknown /proc/231/exe 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 242 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 242 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 242 root txt unknown /proc/242/exe 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 244 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 244 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 244 root txt unknown /proc/244/exe 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 246 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.229 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 246 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 246 root txt unknown /proc/246/exe 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 252 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 252 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 252 root txt unknown /proc/252/exe 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 253 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 253 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 253 root txt unknown /proc/253/exe 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_4 262 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_4 262 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_4 262 root txt unknown /proc/262/exe 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 263 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 263 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.230 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 263 root txt unknown /proc/263/exe 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_5 264 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_5 264 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_5 264 root txt unknown /proc/264/exe 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 265 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 265 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 265 root txt unknown /proc/265/exe 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_6 266 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_6 266 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_6 266 root txt unknown /proc/266/exe 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 267 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 267 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 267 root txt unknown /proc/267/exe 2023-11-04T01:50:39.231 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_7 268 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_7 268 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_7 268 root txt unknown /proc/268/exe 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 269 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 269 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 269 root txt unknown /proc/269/exe 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_8 270 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_8 270 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_8 270 root txt unknown /proc/270/exe 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 271 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 271 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 271 root txt unknown /proc/271/exe 2023-11-04T01:50:39.232 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_9 272 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_9 272 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_eh_9 272 root txt unknown /proc/272/exe 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 273 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 273 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:scsi_tmf_ 273 root txt unknown /proc/273/exe 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 276 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 276 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 276 root txt unknown /proc/276/exe 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:jbd2/sda1 309 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:jbd2/sda1 309 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:jbd2/sda1 309 root txt unknown /proc/309/exe 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:ext4-rsv- 310 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.233 INFO:teuthology.orchestra.run.smithi002.stdout:ext4-rsv- 310 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:ext4-rsv- 310 root txt unknown /proc/310/exe 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root txt REG 8,1 162176 19789 /usr/lib/systemd/systemd-journald 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 16777216 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 8388608 655414 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.234 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.235 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root mem REG 0,25 8 434 /run/systemd/journal/kernel-seqnum 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 3u unix 0xffff955a90d80cc0 0t0 17041 /run/systemd/journal/dev-log type=DGRAM 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 4u unix 0xffff955a90d83fc0 0t0 17043 /run/systemd/journal/socket type=DGRAM 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 5u unix 0xffff955a90d84c80 0t0 17045 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.236 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 6u netlink 0t0 17040 AUDIT 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 7w CHR 1,11 0t0 11 /dev/kmsg 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 9u CHR 1,11 0t0 11 /dev/kmsg 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 10u unix 0xffff955a94401dc0 0t0 15725 /run/systemd/journal/io.systemd.journal type=STREAM 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 11r REG 0,23 0 15726 /proc/sys/kernel/hostname 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 12u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 13u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 14u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 15u unix 0xffff955a944061c0 0t0 15727 type=DGRAM 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 16u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 17u unix 0xffff955a944050c0 0t0 21874 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 18u unix 0xffff955a80fbee80 0t0 24500 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.237 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 19u unix 0xffff955a8b6bea40 0t0 19990 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 20u unix 0xffff955a80fbb740 0t0 22722 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 21u unix 0xffff955a83c3aec0 0t0 22853 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 22u REG 8,1 8388608 655414 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 23u unix 0xffff955a94401540 0t0 19991 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 24u unix 0xffff955a8b6bb740 0t0 21928 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 25u unix 0xffff955a94403300 0t0 21927 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 26u unix 0xffff955a90d872c0 0t0 21929 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 27u unix 0xffff955a89d8f2c0 0t0 122162 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 28u unix 0xffff955a94407b40 0t0 19251 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 29u unix 0xffff955a91f08880 0t0 21933 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 30u unix 0xffff955a8b6b8880 0t0 23081 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.238 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 31u unix 0xffff955a90d82a80 0t0 23035 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 32u REG 8,1 16777216 6947 /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/user-1000.journal 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 33u unix 0xffff955a89d88440 0t0 75850 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 34u unix 0xffff955a90db50c0 0t0 23056 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 35u unix 0xffff955a90db3fc0 0t0 127706 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 36u unix 0xffff955a83c3a640 0t0 23058 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 37u unix 0xffff955a90db5500 0t0 23059 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 38u unix 0xffff955a91f08cc0 0t0 134754 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 40u unix 0xffff955a89d8e600 0t0 132890 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-j 357 root 42u unix 0xffff955a91f08000 0t0 133111 /run/systemd/journal/stdout type=STREAM 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:rpciod 358 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:rpciod 358 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:rpciod 358 root txt unknown /proc/358/exe 2023-11-04T01:50:39.239 INFO:teuthology.orchestra.run.smithi002.stdout:xprtiod 359 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:xprtiod 359 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:xprtiod 359 root txt unknown /proc/359/exe 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:ext4lazyi 386 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:ext4lazyi 386 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:ext4lazyi 386 root txt unknown /proc/386/exe 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:iscsi_eh 389 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:iscsi_eh 389 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:iscsi_eh 389 root txt unknown /proc/389/exe 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:iscsi_con 390 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:iscsi_con 390 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:iscsi_con 390 root txt unknown /proc/390/exe 2023-11-04T01:50:39.240 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root txt REG 8,1 1131856 13517 /usr/bin/udevadm 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 11124932 33003 /usr/lib/udev/hwdb.bin 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.241 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 1u unix 0xffff955a80fbb300 0t0 20587 type=STREAM 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 2u unix 0xffff955a80fbb300 0t0 20587 type=STREAM 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 3u netlink 0t0 17050 KOBJECT_UEVENT 2023-11-04T01:50:39.242 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 4u unix 0xffff955a90d86e80 0t0 17048 /run/udev/control type=SEQPACKET 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 5u unix 0xffff955a80fbd0c0 0t0 20596 type=DGRAM 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 6u unix 0xffff955a80fbd940 0t0 20600 type=DGRAM 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 7u unix 0xffff955a80fb8440 0t0 20601 type=DGRAM 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 9u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 10u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 11u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 12r REG 8,1 11124932 33003 /usr/lib/udev/hwdb.bin 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-u 428 root 13u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network txt REG 8,1 1513936 19795 /usr/lib/systemd/systemd-networkd 2023-11-04T01:50:39.243 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.244 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 1u unix 0xffff955a80fbcc80 0t0 20664 type=STREAM 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 2u unix 0xffff955a80fbcc80 0t0 20664 type=STREAM 2023-11-04T01:50:39.245 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 3u netlink 0t0 17047 ROUTE 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 4u unix 0xffff955a94405500 0t0 15901 type=DGRAM 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 6u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 7u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 9u netlink 0t0 15905 GENERIC 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 10u netlink 0t0 15906 KOBJECT_UEVENT 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 11u unix 0xffff955a94406600 0t0 15907 type=DGRAM 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 12u unix 0xffff955a944072c0 0t0 15908 type=DGRAM 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 13u unix 0xffff955a94406a40 0t0 15909 type=DGRAM 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 14u unix 0xffff955a94401100 0t0 15910 type=DGRAM 2023-11-04T01:50:39.246 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 16u sock 0,8 0t0 15919 protocol: UDP 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-n 480 systemd-network 17u unix 0xffff955a91f09dc0 0t0 19989 type=STREAM 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:ipmi-msgh 484 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:ipmi-msgh 484 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:ipmi-msgh 484 root txt unknown /proc/484/exe 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc txt REG 8,1 63912 4337 /usr/sbin/rpcbind 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.247 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.248 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 1u unix 0xffff955a94403740 0t0 15916 type=STREAM 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 2u unix 0xffff955a94403740 0t0 15916 type=STREAM 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 3u unix 0xffff955a90d84400 0t0 17020 /run/rpcbind.sock type=STREAM 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 4u IPv4 18515 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 5u IPv4 18516 0t0 UDP *:sunrpc 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 6u IPv6 17453 0t0 TCP *:sunrpc (LISTEN) 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 7u IPv6 18517 0t0 UDP *:sunrpc 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 8rW REG 0,25 0 1310 /run/rpcbind.lock 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:rpcbind 492 _rpc 9u unix 0xffff955a8b6ba200 0t0 22526 /run/rpcbind.sock type=STREAM 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:cryptd 541 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:cryptd 541 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.249 INFO:teuthology.orchestra.run.smithi002.stdout:cryptd 541 root txt unknown /proc/541/exe 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:kipmi0 543 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:kipmi0 543 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:kipmi0 543 root txt unknown /proc/543/exe 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root txt REG 8,1 39224 2570 /usr/sbin/blkmapd 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root 3wW REG 0,25 4 1307 /run/blkmapd.pid 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root 4r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:blkmapd 574 root 5u unix 0xffff955a83c3d0c0 0t0 21901 type=DGRAM 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root txt REG 8,1 47592 3135 /usr/sbin/rpc.idmapd 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.251 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root mem REG 8,1 211136 486 /usr/lib/x86_64-linux-gnu/libevent_core-2.1.so.7.0.1 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root mem REG 8,1 39584 4155 /usr/lib/x86_64-linux-gnu/libnfsidmap.so.1.0.0 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root mem REG 8,1 35480 48372 /usr/lib/x86_64-linux-gnu/libnfsidmap/nsswitch.so 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 4u unix 0xffff955a8b6b9980 0t0 24561 type=DGRAM 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 6r FIFO 0,13 0t0 24564 pipe 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 7w FIFO 0,13 0t0 24564 pipe 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 8u REG 0,23 0 4026532453 /proc/578/net/rpc/nfs4.nametoid/channel 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 9u REG 0,23 0 4026532449 /proc/578/net/rpc/nfs4.idtoname/channel 2023-11-04T01:50:39.252 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.idmap 578 root 10r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root txt REG 8,1 55864 3888 /usr/sbin/nfsdcld 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root mem REG 8,1 211136 486 /usr/lib/x86_64-linux-gnu/libevent_core-2.1.so.7.0.1 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 4r FIFO 0,13 0t0 15951 pipe 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 5w FIFO 0,13 0t0 15951 pipe 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 6u REG 8,1 32768 139416 /var/lib/nfs/nfsdcld/main.sqlite 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:nfsdcld 581 root 8u FIFO 0,36 0t0 113 /run/rpc_pipefs/nfsd/cld 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve txt REG 8,1 489904 19802 /usr/lib/systemd/systemd-resolved 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.254 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.255 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.256 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 1u unix 0xffff955a83c3c400 0t0 21911 type=STREAM 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 2u unix 0xffff955a83c3c400 0t0 21911 type=STREAM 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 3u unix 0xffff955a90d81980 0t0 25170 type=DGRAM 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 6u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 7r REG 0,40 0 20940 /proc/sys/kernel/hostname 2023-11-04T01:50:39.257 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 9u netlink 0t0 20941 ROUTE 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 10u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 12u unix 0xffff955a80fba200 0t0 20942 type=STREAM 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 13u IPv4 20943 0t0 UDP localhost:domain 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 14u IPv4 20944 0t0 TCP localhost:domain (LISTEN) 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 15u unix 0xffff955a80fb9dc0 0t0 20945 /run/systemd/resolve/io.systemd.Resolve type=STREAM 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 16u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-r 607 systemd-resolve 17u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-04T01:50:39.258 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.259 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.260 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 1u unix 0xffff955a8b6bf2c0 0t0 24572 type=STREAM 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 2u unix 0xffff955a8b6bf2c0 0t0 24572 type=STREAM 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 5u sock 0,8 0t0 18674 protocol: UNIX-STREAM 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.261 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.262 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 1u unix 0xffff955a8b6bf2c0 0t0 24572 type=STREAM 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 2u unix 0xffff955a8b6bf2c0 0t0 24572 type=STREAM 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.263 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 5u sock 0,8 0t0 18674 protocol: UNIX-STREAM 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 629 gmain root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root txt REG 8,1 166328 9721 /usr/libexec/accounts-daemon 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.264 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.265 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 1u unix 0xffff955a8b6bf2c0 0t0 24572 type=STREAM 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 2u unix 0xffff955a8b6bf2c0 0t0 24572 type=STREAM 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 5u sock 0,8 0t0 18674 protocol: UNIX-STREAM 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:accounts- 610 651 gdbus root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.266 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus txt REG 8,1 232776 9094 /usr/bin/dbus-daemon 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:50:39.267 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 1u unix 0xffff955a94407700 0t0 16004 type=STREAM 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 2u unix 0xffff955a94407700 0t0 16004 type=STREAM 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 3u unix 0xffff955a8b6be600 0t0 24566 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 5u sock 0,8 0t0 16025 protocol: NETLINK 2023-11-04T01:50:39.268 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 6u unix 0xffff955a94405940 0t0 16029 type=DGRAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 8u unix 0xffff955a94401980 0t0 16030 type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 9u unix 0xffff955a94403b80 0t0 16031 type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 10u unix 0xffff955a91f0a640 0t0 16032 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 11u unix 0xffff955a8c182640 0t0 16033 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 12u unix 0xffff955a80fbaa80 0t0 16034 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 13u sock 0,8 0t0 16035 protocol: UNIX-STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 14u unix 0xffff955a91f0d500 0t0 16036 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 15u unix 0xffff955a8c183300 0t0 16068 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 16u unix 0xffff955a8b6bc400 0t0 18710 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 17u unix 0xffff955a83c3e1c0 0t0 25369 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 18u unix 0xffff955a91f09980 0t0 138536 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.269 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 19u unix 0xffff955a94400000 0t0 23177 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 20u unix 0xffff955a89d8c400 0t0 72168 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 21u unix 0xffff955a89d8bb80 0t0 139377 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:dbus-daem 611 messagebus 24u unix 0xffff955a8435c400 0t0 136952 /run/dbus/system_bus_socket type=STREAM 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root txt REG 8,1 68464 2451 /usr/sbin/irqbalance 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.270 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root 1u unix 0xffff955a94404840 0t0 16013 type=STREAM 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root 2u unix 0xffff955a94404840 0t0 16013 type=STREAM 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.271 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 root 5u unix 0xffff955a94400cc0 0t0 16023 /run/irqbalance/irqbalance617.sock type=STREAM 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root txt REG 8,1 68464 2451 /usr/sbin/irqbalance 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.272 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root 1u unix 0xffff955a94404840 0t0 16013 type=STREAM 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root 2u unix 0xffff955a94404840 0t0 16013 type=STREAM 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:irqbalanc 617 633 gmain root 5u unix 0xffff955a94400cc0 0t0 16023 /run/irqbalance/irqbalance617.sock type=STREAM 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.273 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.274 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.275 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.276 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.277 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.278 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.279 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.280 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.281 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.282 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.283 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.285 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.286 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.287 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 682 HT\x20cle root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.289 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.290 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.291 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.292 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.293 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.294 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.295 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 683 lttng-ses root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.296 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.297 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.298 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.299 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.300 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.302 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 684 Health root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.303 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.304 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.305 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.306 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.307 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.308 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.309 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.310 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 685 Notificat root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.311 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.312 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.313 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.314 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.315 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.316 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.317 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 686 Action root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.318 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.319 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.321 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.322 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.324 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 687 Timer root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.325 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.326 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.327 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.328 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.329 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.330 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.331 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.332 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 688 Rotation root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.333 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.334 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.335 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.336 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.337 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.338 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.339 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 689 Client root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.340 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.341 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.342 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.343 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.344 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.346 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 690 UST\x20re root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.347 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.348 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.349 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.350 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.351 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.352 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.353 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 691 UST\x20ap root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.354 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.355 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.357 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.359 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 692 UST\x20ap root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.361 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.363 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.364 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.365 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.366 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.367 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 693 Applicati root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.368 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.369 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.370 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.371 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.372 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.373 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.374 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 694 Agent\x20 root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 821379 524296 /usr/lib/modules/5.15.0-88-generic/modules.symbols.bin 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 1492437 524293 /usr/lib/modules/5.15.0-88-generic/modules.alias.bin 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 974302 525659 /usr/lib/modules/5.15.0-88-generic/modules.dep.bin 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.375 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 13012 524297 /usr/lib/modules/5.15.0-88-generic/modules.builtin.bin 2023-11-04T01:50:39.376 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 26433 524298 /usr/lib/modules/5.15.0-88-generic/modules.builtin.alias.bin 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root mem REG 0,26 4096 2 /dev/shm/lttng-ust-wait-8 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 3wW REG 0,25 0 1398 /run/lttng/lttng-sessiond.lck 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 4u unix 0xffff955a80fbc400 0t0 20955 type=STREAM 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 5r FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 6w FIFO 0,13 0t0 20957 pipe 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 7r FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 8w FIFO 0,13 0t0 20958 pipe 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 9r FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 10w FIFO 0,13 0t0 20959 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 11r FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 12w FIFO 0,13 0t0 20960 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 13r FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 14w FIFO 0,13 0t0 20961 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 15r FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 16w FIFO 0,13 0t0 20962 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 17r FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 18w FIFO 0,13 0t0 20963 pipe 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 20u unix 0xffff955a80fb9100 0t0 20966 /var/run/lttng/kconsumerd/error type=STREAM 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 21u unix 0xffff955a80fb9540 0t0 20967 /var/run/lttng/ustconsumerd64/error type=STREAM 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 22u unix 0xffff955a80fbf700 0t0 20968 /var/run/lttng/ustconsumerd32/error type=STREAM 2023-11-04T01:50:39.378 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 23r FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 24w FIFO 0,13 0t0 20969 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 25r FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 26w FIFO 0,13 0t0 20970 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 27r FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 28w FIFO 0,13 0t0 20971 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 29r FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 30w FIFO 0,13 0t0 20974 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 31u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 32u unix 0xffff955a90db4400 0t0 18682 /var/run/lttng/sessiond-health type=STREAM 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 33r FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 34w FIFO 0,13 0t0 20975 pipe 2023-11-04T01:50:39.379 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 35u unix 0xffff955a91f0ea40 0t0 20077 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 36u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 37r FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 38w FIFO 0,13 0t0 22939 pipe 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 39r FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 40w FIFO 0,13 0t0 22940 pipe 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 41u unix 0xffff955a8c1850c0 0t0 22941 /var/run/lttng/client-lttng-sessiond type=STREAM 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 42u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 43u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 44u unix 0xffff955a80fbe600 0t0 20976 type=STREAM 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 45u unix 0xffff955a80fb9980 0t0 20078 /var/run/lttng/sessiond-notification type=STREAM 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 46r FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.380 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 47w FIFO 0,13 0t0 22942 pipe 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 48u unix 0xffff955a8c186a40 0t0 22943 /var/run/lttng/lttng-ust-sock-8 type=STREAM 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 49u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 50r FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 51w FIFO 0,13 0t0 22944 pipe 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 52r FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 53w FIFO 0,13 0t0 22945 pipe 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 54u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 55r FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 56w FIFO 0,13 0t0 22946 pipe 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 57u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 58u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 59u IPv4 22497 0t0 TCP localhost:5345 (LISTEN) 2023-11-04T01:50:39.381 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 60r FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 61w FIFO 0,13 0t0 22947 pipe 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 62u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-ses 618 695 Kernel root 63u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.383 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.384 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root 1u unix 0xffff955a90d86600 0t0 25171 type=STREAM 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root 2u unix 0xffff955a90d86600 0t0 25171 type=STREAM 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root 3u unix 0xffff955a8b6b8440 0t0 25685 type=STREAM 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root 5u unix 0xffff955a80fbfb40 0t0 20980 type=STREAM 2023-11-04T01:50:39.385 INFO:teuthology.orchestra.run.smithi002.stdout:networkd- 619 root 6u unix 0xffff955a80fbd500 0t0 20981 type=STREAM 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root txt REG 8,1 601248 21354 /usr/sbin/smartd 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.386 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:smartd 630 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.387 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root txt REG 8,1 264712 19791 /usr/lib/systemd/systemd-logind 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.388 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.389 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 1u unix 0xffff955a91f0aa80 0t0 20002 type=STREAM 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 2u unix 0xffff955a91f0aa80 0t0 20002 type=STREAM 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 3u unix 0xffff955a91f0bb80 0t0 20023 type=DGRAM 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 6u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 7r REG 0,22 4096 26760 /sys/devices/virtual/tty/tty0/active 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 8u netlink 0t0 20031 KOBJECT_UEVENT 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 10r FIFO 0,25 0t0 1499 /run/systemd/inhibit/1.ref 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 11u netlink 0t0 20032 KOBJECT_UEVENT 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 12u netlink 0t0 20033 KOBJECT_UEVENT 2023-11-04T01:50:39.390 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 13u netlink 0t0 20034 KOBJECT_UEVENT 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 14u unix 0xffff955a91f09540 0t0 20035 type=STREAM 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 15u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 16u CHR 13,65 0t0 150 /dev/input/event1 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 17u CHR 13,64 0t0 149 /dev/input/event0 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 18u CHR 13,66 0t0 413 /dev/input/event2 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 19u CHR 4,6 0t0 26 /dev/tty6 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 20r FIFO 0,25 0t0 2038 /run/systemd/sessions/5.ref 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 22r FIFO 0,25 0t0 3264 /run/systemd/inhibit/8.ref 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:systemd-l 631 root 23r FIFO 0,25 0t0 3563 /run/systemd/inhibit/9.ref 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:50:39.391 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 3u unix 0xffff955a90d87700 0t0 25196 type=DGRAM 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 4r FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 6w FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 7w REG 8,1 1103 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 8u pack 18705 0t0 ALL type=SOCK_RAW 2023-11-04T01:50:39.392 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 root 9u IPv4 18706 0t0 UDP *:bootpc 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 3u unix 0xffff955a90d87700 0t0 25196 type=DGRAM 2023-11-04T01:50:39.393 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 4r FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 6w FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 7w REG 8,1 1103 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 8u pack 18705 0t0 ALL type=SOCK_RAW 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 696 isc-worke root 9u IPv4 18706 0t0 UDP *:bootpc 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:50:39.394 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 3u unix 0xffff955a90d87700 0t0 25196 type=DGRAM 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 4r FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 6w FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 7w REG 8,1 1103 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 8u pack 18705 0t0 ALL type=SOCK_RAW 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 697 isc-socke root 9u IPv4 18706 0t0 UDP *:bootpc 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.395 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root txt REG 8,1 453264 21677 /usr/sbin/dhclient 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root mem REG 8,1 475768 12518 /usr/lib/x86_64-linux-gnu/libisc-export.so.1105.0.2 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root mem REG 8,1 2269568 2084 /usr/lib/x86_64-linux-gnu/libdns-export.so.1110.0.2 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 3u unix 0xffff955a90d87700 0t0 25196 type=DGRAM 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 4r FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 6w FIFO 0,13 0t0 18689 pipe 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 7w REG 8,1 1103 5343 /var/lib/dhcp/dhclient.ens1f0.leases 2023-11-04T01:50:39.396 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 8u pack 18705 0t0 ALL type=SOCK_RAW 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:dhclient 680 698 isc-timer root 9u IPv4 18706 0t0 UDP *:bootpc 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root txt REG 8,1 1602304 16720 /usr/bin/lttng-sessiond 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 48152 27877 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.397 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 224432 16686 /usr/lib/x86_64-linux-gnu/liblttng-ust-ctl.so.5.0.0 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 43288 16693 /usr/lib/x86_64-linux-gnu/liburcu-cds.so.8.0.0 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 22672 16694 /usr/lib/x86_64-linux-gnu/liburcu-common.so.8.0.0 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 35536 16699 /usr/lib/x86_64-linux-gnu/liburcu.so.8.0.0 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 530864 3680 /usr/lib/x86_64-linux-gnu/liblttng-ctl.so.0.0.0 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.398 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root 1u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root 2u unix 0xffff955a8b6bb300 0t0 25639 type=STREAM 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:lttng-run 681 root 5u unix 0xffff955a80fbc840 0t0 20956 type=STREAM 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.399 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.400 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 4u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 6u unix 0xffff955a8c181100 0t0 22957 type=STREAM 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.401 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.402 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 4u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 6u unix 0xffff955a8c181100 0t0 22957 type=STREAM 2023-11-04T01:50:39.404 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 728 gmain root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root txt REG 8,1 121504 11947 /usr/libexec/polkitd 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.405 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.406 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 4u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 6u unix 0xffff955a8c181100 0t0 22957 type=STREAM 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 8r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:polkitd 727 730 gdbus root 9r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root txt REG 8,1 120640 3891 /usr/sbin/rpc.mountd 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.408 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 3u REG 0,23 0 4026532421 /proc/936/net/rpc/auth.unix.ip/channel 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 4u IPv4 21015 0t0 UDP *:37506 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 5u IPv4 21017 0t0 TCP *:55309 (LISTEN) 2023-11-04T01:50:39.409 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 6u IPv6 21019 0t0 UDP *:55308 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 7u IPv6 21021 0t0 TCP *:41151 (LISTEN) 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 8u IPv4 21023 0t0 UDP *:36574 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 9u IPv4 21025 0t0 TCP *:60641 (LISTEN) 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 10u IPv6 21027 0t0 UDP *:45763 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 11u IPv6 21029 0t0 TCP *:41931 (LISTEN) 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 12u IPv4 21031 0t0 UDP *:57041 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 13u IPv4 21033 0t0 TCP *:54519 (LISTEN) 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 14u IPv6 21035 0t0 UDP *:52960 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 15u IPv6 21037 0t0 TCP *:44069 (LISTEN) 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 16u REG 0,23 0 4026532425 /proc/936/net/rpc/auth.unix.gid/channel 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 17u REG 0,23 0 4026532441 /proc/936/net/rpc/nfsd.export/channel 2023-11-04T01:50:39.410 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 18u REG 0,23 0 4026532445 /proc/936/net/rpc/nfsd.fh/channel 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 19r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.mount 936 root 20u unix 0xffff955a94404c80 0t0 16110 type=DGRAM 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root cwd DIR 8,1 4096 1160 /var/spool/cron 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root txt REG 8,1 51792 1461 /usr/sbin/cron 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.411 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root 1u unix 0xffff955a90d82200 0t0 25306 type=STREAM 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root 2u unix 0xffff955a90d82200 0t0 25306 type=STREAM 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root 3uW REG 0,25 4 1459 /run/crond.pid 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:cron 958 root 4u unix 0xffff955a90d80880 0t0 25309 type=DGRAM 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios txt REG 8,1 79096 10043 /usr/sbin/nrpe 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.412 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios DEL REG 8,1 24692 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios 3u unix 0xffff955a90d85d80 0t0 25339 type=DGRAM 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios 4u IPv4 25347 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:50:39.413 INFO:teuthology.orchestra.run.smithi002.stdout:nrpe 959 nagios 5u IPv6 25348 0t0 TCP *:nrpe (LISTEN) 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd cwd DIR 8,1 4096 5393 /var/lib/nfs 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd txt REG 8,1 80944 2384 /usr/sbin/rpc.statd 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.414 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 4u unix 0xffff955a91f0d940 0t0 20159 type=DGRAM 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 5u IPv4 20160 0t0 UDP localhost:718 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 6w REG 0,25 4 1467 /run/rpc.statd.pid 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 8u IPv4 20164 0t0 UDP *:43709 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 9u IPv4 20166 0t0 TCP *:37689 (LISTEN) 2023-11-04T01:50:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 10u IPv6 20168 0t0 UDP *:42739 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:rpc.statd 966 statd 11u IPv6 20170 0t0 TCP *:54379 (LISTEN) 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root txt REG 8,1 436848 16646 /usr/sbin/tgtd 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.416 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 1u unix 0xffff955a90db5940 0t0 18778 type=STREAM 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 2u unix 0xffff955a90db5940 0t0 18778 type=STREAM 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 4ww REG 0,25 0 1487 /run/tgtd/socket.0.lock 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 5u unix 0xffff955a80fbe1c0 0t0 21083 /var/run/tgtd/socket.0 type=STREAM 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 6u IPv4 21100 0t0 TCP *:iscsi-target (LISTEN) 2023-11-04T01:50:39.417 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 7u IPv6 21101 0t0 TCP *:iscsi-target (LISTEN) 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:tgtd 969 root 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:50:39.418 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 347096 12961 /usr/lib/python3/dist-packages/apt_pkg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.419 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.420 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 1u unix 0xffff955a83c3ee80 0t0 22521 type=STREAM 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 2u unix 0xffff955a83c3ee80 0t0 22521 type=STREAM 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 3w REG 8,1 113 655443 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 4u unix 0xffff955a83c39dc0 0t0 26625 type=STREAM 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 7u unix 0xffff955a83c3a200 0t0 26628 type=STREAM 2023-11-04T01:50:39.421 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 8w FIFO 0,25 0t0 1499 /run/systemd/inhibit/1.ref 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 root 9u unix 0xffff955a83c3aa80 0t0 26629 type=STREAM 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 347096 12961 /usr/lib/python3/dist-packages/apt_pkg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.422 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 206984 100435 /usr/lib/x86_64-linux-gnu/girepository-1.0/GLib-2.0.typelib 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 137288 25527 /usr/lib/x86_64-linux-gnu/libgirepository-1.0.so.1.0.0 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 348656 25613 /usr/lib/python3/dist-packages/gi/_gi.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.423 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 168152 4430 /usr/lib/python3/dist-packages/_dbus_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 23040 4497 /usr/lib/python3/dist-packages/_dbus_glib_bindings.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.424 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 1u unix 0xffff955a83c3ee80 0t0 22521 type=STREAM 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 2u unix 0xffff955a83c3ee80 0t0 22521 type=STREAM 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 3w REG 8,1 113 655443 /var/log/unattended-upgrades/unattended-upgrades-shutdown.log 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 4u unix 0xffff955a83c39dc0 0t0 26625 type=STREAM 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 5u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.425 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 7u unix 0xffff955a83c3a200 0t0 26628 type=STREAM 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 8w FIFO 0,25 0t0 1499 /run/systemd/inhibit/1.ref 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:unattende 971 1069 gmain root 9u unix 0xffff955a83c3aa80 0t0 26629 type=STREAM 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.426 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.427 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.428 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1070 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.429 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.430 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1071 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.431 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.432 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1072 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.433 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1073 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.434 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.435 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1074 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.436 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.437 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1104 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.438 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1116 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.439 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.440 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1117 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.441 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.442 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1118 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.443 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1119 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.444 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.445 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1121 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.446 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.447 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 1122 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root txt REG 8,1 42870592 17011 /usr/bin/containerd 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root mem-W REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 1u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 2u unix 0xffff955a90db6a40 0t0 18782 type=STREAM 2023-11-04T01:50:39.448 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 3u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 4r FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 5w FIFO 0,13 0t0 19020 pipe 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 6uW REG 8,1 32768 5734 /var/lib/containerd/io.containerd.metadata.v1.bolt/meta.db 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 9r FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 10w FIFO 0,13 0t0 19032 pipe 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 11u unix 0xffff955a90db1980 0t0 19033 /run/containerd/containerd.sock.ttrpc type=STREAM 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 12u unix 0xffff955a90db3b80 0t0 19035 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 13u IPv4 20396 0t0 TCP localhost:35369 (LISTEN) 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 14u unix 0xffff955a8c184840 0t0 120520 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:container 972 5144 container root 15u unix 0xffff955a8b6bd940 0t0 120522 /run/containerd/containerd.sock type=STREAM 2023-11-04T01:50:39.449 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 985 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 985 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 985 root txt unknown /proc/985/exe 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:lockd 988 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:lockd 988 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:lockd 988 root txt unknown /proc/988/exe 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.450 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.451 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.452 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root 1u unix 0xffff955a8b6baa80 0t0 25753 type=STREAM 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root 2u unix 0xffff955a8b6baa80 0t0 25753 type=STREAM 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root 3u IPv4 25762 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 990 root 4u IPv6 25764 0t0 TCP *:ssh (LISTEN) 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:ib-comp-w 991 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:ib-comp-w 991 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:ib-comp-w 991 root txt unknown /proc/991/exe 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:ib-comp-u 992 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:ib-comp-u 992 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:ib-comp-u 992 root txt unknown /proc/992/exe 2023-11-04T01:50:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:ib_mcast 993 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:ib_mcast 993 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:ib_mcast 993 root txt unknown /proc/993/exe 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:ib_nl_sa_ 994 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:ib_nl_sa_ 994 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:ib_nl_sa_ 994 root txt unknown /proc/994/exe 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 997 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 997 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 997 root txt unknown /proc/997/exe 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 998 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 998 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 998 root txt unknown /proc/998/exe 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 999 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.454 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 999 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 999 root txt unknown /proc/999/exe 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1000 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1000 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1000 root txt unknown /proc/1000/exe 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1001 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1001 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1001 root txt unknown /proc/1001/exe 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1002 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1002 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1002 root txt unknown /proc/1002/exe 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1003 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1003 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.455 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1003 root txt unknown /proc/1003/exe 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1004 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1004 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:nfsd 1004 root txt unknown /proc/1004/exe 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:rdma_cm 1005 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:rdma_cm 1005 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:rdma_cm 1005 root txt unknown /proc/1005/exe 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root txt REG 8,1 56888 3161 /usr/sbin/agetty 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.456 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root 0u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root 1u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root 2u CHR 4,65 0t0 89 /dev/ttyS1 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1093 root 4r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root txt REG 8,1 56888 3161 /usr/sbin/agetty 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root mem REG 8,1 353616 44555 /usr/lib/locale/C.utf8/LC_CTYPE 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.457 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root 0u CHR 4,1 0t0 21 /dev/tty1 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root 1u CHR 4,1 0t0 21 /dev/tty1 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root 2u CHR 4,1 0t0 21 /dev/tty1 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:agetty 1095 root 4r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root txt REG 8,1 3798008 15961 /usr/bin/perl 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 35416 47035 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Time/HiRes/HiRes.so 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 68400 46935 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Compress/Raw/Zlib/Zlib.so 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 60360 33580 /usr/lib/x86_64-linux-gnu/perl-base/auto/List/Util/Util.so 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 23064 47032 /usr/lib/x86_64-linux-gnu/perl/5.34.0/auto/Sys/Syslog/Syslog.so 2023-11-04T01:50:39.458 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 31568 33577 /usr/lib/x86_64-linux-gnu/perl-base/auto/File/Glob/Glob.so 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 18992 33575 /usr/lib/x86_64-linux-gnu/perl-base/auto/Cwd/Cwd.so 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 47816 33582 /usr/lib/x86_64-linux-gnu/perl-base/auto/Socket/Socket.so 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 23152 33579 /usr/lib/x86_64-linux-gnu/perl-base/auto/IO/IO.so 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 110424 33581 /usr/lib/x86_64-linux-gnu/perl-base/auto/POSIX/POSIX.so 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 22896 33576 /usr/lib/x86_64-linux-gnu/perl-base/auto/Fcntl/Fcntl.so 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.459 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root 3r DIR 0,23 0 1 /proc 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:collectl 1157 root 4w REG 8,1 1212366 5295 /var/log/collectl/smithi002-20231104-012546.raw.gz 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.460 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.461 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 1u unix 0xffff955a94405d80 0t0 16269 type=STREAM 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 2u unix 0xffff955a94405d80 0t0 16269 type=STREAM 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 3u unix 0xffff955a94402640 0t0 16290 type=DGRAM 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 5u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 6r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 7r DIR 0,28 0 4830 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 8u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.462 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 9u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 10r REG 0,23 0 16301 /proc/1323/mountinfo 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 11r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 12u unix 0xffff955a8963a200 0t0 16317 /run/user/1000/bus type=STREAM 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 14r REG 0,23 0 4026532081 /proc/swaps 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 15u netlink 0t0 16302 KOBJECT_UEVENT 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 16u unix 0xffff955a94402a80 0t0 16308 /run/user/1000/systemd/notify type=DGRAM 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 17u unix 0xffff955a94400880 0t0 16309 type=DGRAM 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 18u unix 0xffff955a94406e80 0t0 16310 type=DGRAM 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 19u unix 0xffff955a94403fc0 0t0 16311 /run/user/1000/systemd/private type=STREAM 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 20u unix 0xffff955a94402200 0t0 16313 type=STREAM 2023-11-04T01:50:39.463 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 21u a_inode 0,14 0 12540 [timerfd] 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 26u unix 0xffff955a8963aa80 0t0 16319 /run/user/1000/gnupg/S.dirmngr type=STREAM 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 27u unix 0xffff955a89638880 0t0 16321 /run/user/1000/gnupg/S.gpg-agent.browser type=STREAM 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 28u unix 0xffff955a8963dd80 0t0 16323 /run/user/1000/gnupg/S.gpg-agent.extra type=STREAM 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 29u unix 0xffff955a8963fb40 0t0 16325 /run/user/1000/gnupg/S.gpg-agent.ssh type=STREAM 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 30u unix 0xffff955a8963bb80 0t0 16327 /run/user/1000/gnupg/S.gpg-agent type=STREAM 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:systemd 1323 ubuntu 31u unix 0xffff955a8963f700 0t0 16329 /run/user/1000/pk-debconf-socket type=STREAM 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu txt REG 8,1 1849992 19775 /usr/lib/systemd/systemd 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-04T01:50:39.464 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.465 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 35440 15410 /usr/lib/x86_64-linux-gnu/libip4tc.so.2.0.0 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.466 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 34888 16814 /usr/lib/x86_64-linux-gnu/libacl.so.1.1.2301 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 80768 8466 /usr/lib/x86_64-linux-gnu/libapparmor.so.1.8.2 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 108760 9108 /usr/lib/x86_64-linux-gnu/libkmod.so.2.3.7 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 125360 9036 /usr/lib/x86_64-linux-gnu/libseccomp.so.2.5.3 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 2840280 9114 /usr/lib/systemd/libsystemd-shared-249.so 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.467 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu 1u unix 0xffff955a94405d80 0t0 16269 type=STREAM 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu 2u unix 0xffff955a94405d80 0t0 16269 type=STREAM 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu 6w FIFO 0,13 0t0 16272 pipe 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:(sd-pam) 1324 ubuntu 7u unix 0xffff955a94400440 0t0 16280 type=DGRAM 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:50:39.468 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:50:39.469 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 3u unix 0xffff955a90d82ec0 0t0 17032 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 6u unix 0xffff955a8b6bbb80 0t0 26229 type=DGRAM 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 7w REG 8,1 537670 115293 /var/log/syslog 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 8w REG 8,1 1120153 658633 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 9w REG 8,1 721670 655441 /var/log/auth.log 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 syslog 11w REG 8,1 5759 658632 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:50:39.470 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 3u unix 0xffff955a90d82ec0 0t0 17032 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:50:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 6u unix 0xffff955a8b6bbb80 0t0 26229 type=DGRAM 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 7w REG 8,1 537670 115293 /var/log/syslog 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 8w REG 8,1 1120153 658633 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 9w REG 8,1 721670 655441 /var/log/auth.log 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1377 in:imuxso syslog 11w REG 8,1 5759 658632 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.474 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 3u unix 0xffff955a90d82ec0 0t0 17032 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 6u unix 0xffff955a8b6bbb80 0t0 26229 type=DGRAM 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 7w REG 8,1 537670 115293 /var/log/syslog 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 8w REG 8,1 1120153 658633 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 9w REG 8,1 721670 655441 /var/log/auth.log 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1378 in:imklog syslog 11w REG 8,1 5759 658632 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:50:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog txt REG 8,1 785600 25944 /usr/sbin/rsyslogd 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 28136 25376 /usr/lib/x86_64-linux-gnu/rsyslog/imklog.so 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 41080 25918 /usr/lib/x86_64-linux-gnu/rsyslog/imuxsock.so 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 51816 12678 /usr/lib/x86_64-linux-gnu/libfastjson.so.4.3.0 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 14496 10543 /usr/lib/x86_64-linux-gnu/libestr.so.0.0.0 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 31704 25919 /usr/lib/x86_64-linux-gnu/rsyslog/lmnet.so 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 1w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 3u unix 0xffff955a90d82ec0 0t0 17032 /run/systemd/journal/syslog type=DGRAM 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 4r CHR 1,9 0t0 10 /dev/urandom 2023-11-04T01:50:39.477 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 5r REG 0,23 0 4026532039 /proc/kmsg 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 6u unix 0xffff955a8b6bbb80 0t0 26229 type=DGRAM 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 7w REG 8,1 537670 115293 /var/log/syslog 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 8w REG 8,1 1120153 658633 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 9w REG 8,1 721670 655441 /var/log/auth.log 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 10w REG 8,1 116698 115294 /var/log/kern.log 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:rsyslogd 1376 1379 rs:main syslog 11w REG 8,1 5759 658632 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 12218 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 12218 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 12218 root txt unknown /proc/12218/exe 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.478 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.479 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.480 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:50:39.481 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.482 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.483 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.546 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 1u unix 0xffff955a89d8c840 0t0 73086 type=STREAM 2023-11-04T01:50:39.547 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 2u unix 0xffff955a89d8c840 0t0 73086 type=STREAM 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 3u unix 0xffff955a89d88000 0t0 73089 type=DGRAM 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 5u netlink 0t0 74850 ROUTE 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 8u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 9u unix 0xffff955a89d8aec0 0t0 73092 type=STREAM 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.548 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.549 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.550 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.552 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.553 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 1u unix 0xffff955a89d8c840 0t0 73086 type=STREAM 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 2u unix 0xffff955a89d8c840 0t0 73086 type=STREAM 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 3u unix 0xffff955a89d88000 0t0 73089 type=DGRAM 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 5u netlink 0t0 74850 ROUTE 2023-11-04T01:50:39.554 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 8u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 9u unix 0xffff955a89d8aec0 0t0 73092 type=STREAM 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13502 gmain root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root txt REG 8,1 301576 16829 /usr/libexec/packagekitd 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 31440 4482 /usr/lib/x86_64-linux-gnu/libdebuginfod-0.186.so 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.555 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.556 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 117400 4466 /usr/lib/x86_64-linux-gnu/libelf-0.186.so 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 825848 1712 /usr/lib/x86_64-linux-gnu/libstemmer.so.0d.0.0 2023-11-04T01:50:39.557 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 170056 4111 /usr/lib/x86_64-linux-gnu/libxmlb.so.2.0.0 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 700800 596 /usr/lib/x86_64-linux-gnu/libdw-0.186.so 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 80080 589 /usr/lib/x86_64-linux-gnu/libxxhash.so.0.8.1 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 531656 4130 /usr/lib/x86_64-linux-gnu/libappstream.so.0.15.2 2023-11-04T01:50:39.558 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1371192 18416 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0.2003.0 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root DEL REG 8,1 855 /usr/lib/x86_64-linux-gnu/libapt-pkg.so.6.0.0 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 358272 16234 /usr/lib/x86_64-linux-gnu/packagekit-backend/libpk_backend_aptcc.so 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.559 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.560 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 418280 18355 /usr/lib/x86_64-linux-gnu/libpackagekit-glib2.so.18.1.3 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 1u unix 0xffff955a89d8c840 0t0 73086 type=STREAM 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 2u unix 0xffff955a89d8c840 0t0 73086 type=STREAM 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 3u unix 0xffff955a89d88000 0t0 73089 type=DGRAM 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 5u netlink 0t0 74850 ROUTE 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 6u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 7r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 8u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.561 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 9u unix 0xffff955a89d8aec0 0t0 73092 type=STREAM 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:packageki 13501 13503 gdbus root 10u REG 8,1 32768 5265 /var/lib/PackageKit/transactions.db 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 16585 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 16585 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 16585 root txt unknown /proc/16585/exe 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 16959 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 16959 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 16959 root txt unknown /proc/16959/exe 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 16991 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 16991 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 16991 root txt unknown /proc/16991/exe 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17023 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.562 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17023 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17023 root txt unknown /proc/17023/exe 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17055 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17055 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17055 root txt unknown /proc/17055/exe 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17087 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17087 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:kdmflush 17087 root txt unknown /proc/17087/exe 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:xfsalloc 17285 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:xfsalloc 17285 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:xfsalloc 17285 root txt unknown /proc/17285/exe 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:xfs_mru_c 17286 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:xfs_mru_c 17286 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.563 INFO:teuthology.orchestra.run.smithi002.stdout:xfs_mru_c 17286 root txt unknown /proc/17286/exe 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 17287 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 17287 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 17287 root txt unknown /proc/17287/exe 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 17288 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 17288 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 17288 root txt unknown /proc/17288/exe 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 17289 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 17289 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 17289 root txt unknown /proc/17289/exe 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 17290 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 17290 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 17290 root txt unknown /proc/17290/exe 2023-11-04T01:50:39.564 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 17291 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 17291 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 17291 root txt unknown /proc/17291/exe 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 17292 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 17292 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 17292 root txt unknown /proc/17292/exe 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 17293 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 17293 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 17293 root txt unknown /proc/17293/exe 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 17294 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 17294 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 17294 root txt unknown /proc/17294/exe 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.565 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.567 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.568 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.569 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.570 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.571 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27626 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.572 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.573 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.574 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.575 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27627 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.576 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.577 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.578 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27628 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.579 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.580 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.581 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.582 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27629 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.583 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.586 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27630 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.587 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.588 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.589 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27631 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.590 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.591 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.592 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27632 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.593 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.594 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.595 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.596 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27633 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.597 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.598 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.599 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.600 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27634 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.601 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.602 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.603 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27635 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.605 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.606 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.607 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27732 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.608 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.609 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.610 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27733 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root txt REG 8,1 83568864 25354 /usr/bin/dockerd 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem-W REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem-W REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.611 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem-W REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem-W REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem-W REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.612 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem-W REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 1u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 2u unix 0xffff955a89d8d940 0t0 120503 type=STREAM 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 3u unix 0xffff955a83c3d500 0t0 122164 /var/run/docker/metrics.sock type=STREAM 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 4u unix 0xffff955a90d85500 0t0 25159 /run/docker.sock type=STREAM 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 6r FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 7w FIFO 0,13 0t0 120508 pipe 2023-11-04T01:50:39.613 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 8u unix 0xffff955a8c181980 0t0 116604 type=STREAM 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 9u unix 0xffff955a8b6b9540 0t0 121177 type=STREAM 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 10uW REG 8,1 32768 5823 /var/lib/docker/volumes/metadata.db 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 11r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 12u netlink 0t0 121242 ROUTE 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 13u netlink 0t0 121243 XFRM 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 14u netlink 0t0 121244 NETFILTER 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 15u unix 0xffff955a8c185500 0t0 116643 /var/run/docker/libnetwork/156e3e5360e4.sock type=STREAM 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 16uW REG 8,1 16384 5846 /var/lib/docker/buildkit/containerdmeta.db 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 17uW REG 8,1 16384 5848 /var/lib/docker/buildkit/snapshots.db 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 18uW REG 8,1 16384 5849 /var/lib/docker/buildkit/metadata_v2.db 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 19uW REG 8,1 32768 5851 /var/lib/docker/buildkit/cache.db 2023-11-04T01:50:39.614 INFO:teuthology.orchestra.run.smithi002.stdout:dockerd 27625 27734 dockerd root 20uW REG 8,1 16384 23370 /var/lib/docker/buildkit/history.db 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 18424 14480 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 18424 14482 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-04T01:50:39.615 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 14328 14484 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.616 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.617 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 3u unix 0xffff955a8b6baec0 0t0 121518 type=DGRAM 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 4u IPv4 119592 0t0 TCP smithi002.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:50292 (ESTABLISHED) 2023-11-04T01:50:39.618 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 6u unix 0xffff955a8b6bd500 0t0 121504 type=STREAM 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 7u unix 0xffff955a8b6b8000 0t0 121525 type=STREAM 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27882 root 8w FIFO 0,25 0t0 2038 /run/systemd/sessions/5.ref 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu txt REG 8,1 917192 24518 /usr/sbin/sshd 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 18424 14480 /usr/lib/x86_64-linux-gnu/security/pam_mail.so 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 18424 14482 /usr/lib/x86_64-linux-gnu/security/pam_motd.so 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:39.619 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 14328 14474 /usr/lib/x86_64-linux-gnu/security/pam_keyinit.so 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 14328 14479 /usr/lib/x86_64-linux-gnu/security/pam_loginuid.so 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 26616 14492 /usr/lib/x86_64-linux-gnu/security/pam_selinux.so 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 14328 14484 /usr/lib/x86_64-linux-gnu/security/pam_nologin.so 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.620 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.621 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 44872 1165 /usr/lib/x86_64-linux-gnu/libwrap.so.0.7.6 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 0u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.622 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 1u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 2u CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 3u unix 0xffff955a8b6baec0 0t0 121518 type=DGRAM 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 4u IPv4 119592 0t0 TCP smithi002.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:50292 (ESTABLISHED) 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 5u unix 0xffff955a8b6bc840 0t0 121524 type=STREAM 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 6u unix 0xffff955a8b6bd500 0t0 121504 type=STREAM 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 8w FIFO 0,25 0t0 2038 /run/systemd/sessions/5.ref 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 9w FIFO 0,13 0t0 144624 pipe 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 10r FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 11w FIFO 0,13 0t0 144627 pipe 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 12r FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 13r FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:39.623 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 14w FIFO 0,13 0t0 144646 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 15r FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 16r FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 17w FIFO 0,13 0t0 144649 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 18r FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 19r FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 20w FIFO 0,13 0t0 144652 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 21r FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 22r FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 23w FIFO 0,13 0t0 144655 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 24r FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 25r FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 26w FIFO 0,13 0t0 206345 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 27r FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:39.624 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 28r FIFO 0,13 0t0 206346 pipe 2023-11-04T01:50:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 29w FIFO 0,13 0t0 204086 pipe 2023-11-04T01:50:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 31r FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 32r FIFO 0,13 0t0 206347 pipe 2023-11-04T01:50:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 33r FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 35r FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 36r FIFO 0,13 0t0 206116 pipe 2023-11-04T01:50:39.625 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 38r FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:39.640 INFO:teuthology.orchestra.run.smithi002.stdout:sshd 27903 ubuntu 39r FIFO 0,13 0t0 206117 pipe 2023-11-04T01:50:39.640 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp txt REG 8,1 879688 5353 /usr/sbin/ntpd 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp mem REG 8,1 140800 30041 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 1r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.641 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 2r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 3u unix 0xffff955a90db1dc0 0t0 123048 type=DGRAM 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 4w REG 8,1 47041 655473 /var/log/ntpstats/rawstats.20231104 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 6w REG 8,1 6392 655474 /var/log/ntpstats/peerstats.20231104 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 7w REG 8,1 1044 82663 /var/log/ntpstats/loopstats.20231104 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 16u IPv6 123056 0t0 UDP *:ntp 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 17u IPv4 123059 0t0 UDP *:ntp 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 18u IPv4 123063 0t0 UDP localhost:ntp 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 19u IPv4 123065 0t0 UDP smithi002.front.sepia.ceph.com:ntp 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 20u IPv6 123067 0t0 UDP localhost:ntp 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 21u IPv6 123069 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 22u netlink 0t0 123070 ROUTE 2023-11-04T01:50:39.642 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 23u unix 0xffff955a90db0440 0t0 123071 type=STREAM 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 24u unix 0xffff955a90db7b40 0t0 123072 type=STREAM 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 25u IPv4 145404 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 26u IPv6 145408 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 ntp 28u IPv6 152756 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp txt REG 8,1 879688 5353 /usr/sbin/ntpd 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp DEL REG 8,1 24691 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.643 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp mem REG 8,1 140800 30041 /usr/lib/x86_64-linux-gnu/libopts.so.25.17.1 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 1r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 2r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 3u unix 0xffff955a90db1dc0 0t0 123048 type=DGRAM 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 4w REG 8,1 47041 655473 /var/log/ntpstats/rawstats.20231104 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 6w REG 8,1 6392 655474 /var/log/ntpstats/peerstats.20231104 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 7w REG 8,1 1044 82663 /var/log/ntpstats/loopstats.20231104 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 16u IPv6 123056 0t0 UDP *:ntp 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 17u IPv4 123059 0t0 UDP *:ntp 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 18u IPv4 123063 0t0 UDP localhost:ntp 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 19u IPv4 123065 0t0 UDP smithi002.front.sepia.ceph.com:ntp 2023-11-04T01:50:39.644 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 20u IPv6 123067 0t0 UDP localhost:ntp 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 21u IPv6 123069 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 22u netlink 0t0 123070 ROUTE 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 23u unix 0xffff955a90db0440 0t0 123071 type=STREAM 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 24u unix 0xffff955a90db7b40 0t0 123072 type=STREAM 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 25u IPv4 145404 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 26u IPv6 145408 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ntpd 27923 27924 ntpd ntp 28u IPv6 152756 0t0 UDP smithi002:ntp 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph 1u unix 0xffff955a90db3740 0t0 135275 type=STREAM 2023-11-04T01:50:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-cras 30572 ceph 2u unix 0xffff955a90db3740 0t0 135275 type=STREAM 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root txt REG 8,1 3397048 676608 /usr/sbin/wpa_supplicant 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.647 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 43064 16927 /usr/lib/x86_64-linux-gnu/libpcsclite.so.1.0.0 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 32256 26981 /usr/lib/x86_64-linux-gnu/libnl-genl-3.so.200.26.0 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root 1u unix 0xffff955a91f0f2c0 0t0 139301 type=STREAM 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root 2u unix 0xffff955a91f0f2c0 0t0 139301 type=STREAM 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root 3u unix 0xffff955a91f0bfc0 0t0 139304 type=DGRAM 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:wpa_suppl 32158 root 4u unix 0xffff955a91f0b300 0t0 139305 type=STREAM 2023-11-04T01:50:39.648 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root txt REG 8,1 3255560 674486 /usr/sbin/NetworkManager 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 43160 674484 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 39168 674478 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 298240 674481 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 27144 674296 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 47400 674480 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 1144904 674065 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 100584 674485 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 194000 673937 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-04T01:50:39.649 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 35120 674482 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 96544 674479 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.650 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.651 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.652 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.653 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 27280 674078 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 1u unix 0xffff955a89d8f700 0t0 138602 type=STREAM 2023-11-04T01:50:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 2u unix 0xffff955a89d8f700 0t0 138602 type=STREAM 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 5u unix 0xffff955a89d89980 0t0 138607 type=DGRAM 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 6u unix 0xffff955a89d88880 0t0 138608 type=STREAM 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 8r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 9r REG 0,4 0 4026532710 mnt 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 10u netlink 0t0 136683 KOBJECT_UEVENT 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 11u netlink 0t0 136684 GENERIC 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 12u netlink 0t0 136685 ROUTE 2023-11-04T01:50:39.655 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 14r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 15u netlink 0t0 136723 KOBJECT_UEVENT 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 16u netlink 0t0 136724 KOBJECT_UEVENT 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 17u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 root 19w FIFO 0,25 0t0 3264 /run/systemd/inhibit/8.ref 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root txt REG 8,1 3255560 674486 /usr/sbin/NetworkManager 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 43160 674484 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 39168 674478 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 298240 674481 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.656 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 27144 674296 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 47400 674480 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 1144904 674065 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 100584 674485 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 194000 673937 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 35120 674482 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 96544 674479 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.657 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.659 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 27280 674078 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.661 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 1u unix 0xffff955a89d8f700 0t0 138602 type=STREAM 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 2u unix 0xffff955a89d8f700 0t0 138602 type=STREAM 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 5u unix 0xffff955a89d89980 0t0 138607 type=DGRAM 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 6u unix 0xffff955a89d88880 0t0 138608 type=STREAM 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 8r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 9r REG 0,4 0 4026532710 mnt 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 10u netlink 0t0 136683 KOBJECT_UEVENT 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 11u netlink 0t0 136684 GENERIC 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 12u netlink 0t0 136685 ROUTE 2023-11-04T01:50:39.662 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 14r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 15u netlink 0t0 136723 KOBJECT_UEVENT 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 16u netlink 0t0 136724 KOBJECT_UEVENT 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 17u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32358 gmain root 19w FIFO 0,25 0t0 3264 /run/systemd/inhibit/8.ref 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root txt REG 8,1 3255560 674486 /usr/sbin/NetworkManager 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 43160 674484 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-settings-plugin-ifupdown.so 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 39168 674478 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-adsl.so 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 298240 674481 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wifi.so 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 313656 8637 /usr/lib/x86_64-linux-gnu/libdbus-1.so.3.19.13 2023-11-04T01:50:39.663 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 59864 74945 /usr/lib/x86_64-linux-gnu/libjansson.so.4.13.0 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 27144 674296 /usr/lib/x86_64-linux-gnu/libteamdctl.so.0.1.5 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 47400 674480 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-team.so 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 1144904 674065 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 100584 674485 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-wwan.so 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 194000 673937 /usr/lib/x86_64-linux-gnu/libbluetooth.so.3.19.6 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 35120 674482 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-wwan.so 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 96544 674479 /usr/lib/x86_64-linux-gnu/NetworkManager/1.36.6/libnm-device-plugin-bluetooth.so 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.664 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.665 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.666 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.667 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 653080 24484 /usr/lib/x86_64-linux-gnu/libcurl-gnutls.so.4.7.0 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 27280 674078 /usr/lib/x86_64-linux-gnu/libndp.so.0.2.0 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.668 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 1u unix 0xffff955a89d8f700 0t0 138602 type=STREAM 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 2u unix 0xffff955a89d8f700 0t0 138602 type=STREAM 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 5u unix 0xffff955a89d89980 0t0 138607 type=DGRAM 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 6u unix 0xffff955a89d88880 0t0 138608 type=STREAM 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 8r REG 0,4 0 4026531840 net 2023-11-04T01:50:39.669 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 9r REG 0,4 0 4026532710 mnt 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 10u netlink 0t0 136683 KOBJECT_UEVENT 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 11u netlink 0t0 136684 GENERIC 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 12u netlink 0t0 136685 ROUTE 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 13r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 14r a_inode 0,14 0 12540 inotify 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 15u netlink 0t0 136723 KOBJECT_UEVENT 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 16u netlink 0t0 136724 KOBJECT_UEVENT 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 17u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:NetworkMa 32352 32361 gdbus root 19w FIFO 0,25 0t0 3264 /run/systemd/inhibit/8.ref 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres cwd DIR 8,1 4096 677111 /var/lib/postgresql/14/main 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.670 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres txt REG 8,1 9509856 675165 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres DEL REG 0,1 3078 /dev/zero 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.671 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.672 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.673 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.2947433210 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres DEL REG 0,1 4 /SYSV000a54f7 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 1w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 2w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 3r FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.674 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 4w FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 5u IPv6 138709 0t0 TCP localhost:postgresql (LISTEN) 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 6u IPv4 138710 0t0 TCP localhost:postgresql (LISTEN) 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 7u unix 0xffff955a89d8b300 0t0 138711 /var/run/postgresql/.s.PGSQL.5432 type=STREAM 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32900 postgres 8u IPv6 138715 0t0 UDP localhost:35609->localhost:35609 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres cwd DIR 8,1 4096 677111 /var/lib/postgresql/14/main 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres txt REG 8,1 9509856 675165 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres DEL REG 0,1 3078 /dev/zero 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.675 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.676 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.677 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.678 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.2947433210 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres DEL REG 0,1 4 /SYSV000a54f7 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 1w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 2w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 3r FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 4u REG 8,1 16777216 677141 /var/lib/postgresql/14/main/pg_wal/000000010000000000000001 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 8u IPv6 138715 0t0 UDP localhost:35609->localhost:35609 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32902 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres cwd DIR 8,1 4096 677111 /var/lib/postgresql/14/main 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.679 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres txt REG 8,1 9509856 675165 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres DEL REG 0,1 3078 /dev/zero 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.680 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.681 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.682 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.2947433210 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres DEL REG 0,1 4 /SYSV000a54f7 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres 1w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres 2w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres 3r FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres 8u IPv6 138715 0t0 UDP localhost:35609->localhost:35609 2023-11-04T01:50:39.683 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32903 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres cwd DIR 8,1 4096 677111 /var/lib/postgresql/14/main 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres txt REG 8,1 9509856 675165 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres DEL REG 0,1 3078 /dev/zero 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.684 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.685 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.2947433210 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.687 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres DEL REG 0,1 4 /SYSV000a54f7 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 1w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 2w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 3r FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 4u REG 8,1 16777216 677141 /var/lib/postgresql/14/main/pg_wal/000000010000000000000001 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 8u IPv6 138715 0t0 UDP localhost:35609->localhost:35609 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32904 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres cwd DIR 8,1 4096 677111 /var/lib/postgresql/14/main 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres txt REG 8,1 9509856 675165 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres DEL REG 0,1 3078 /dev/zero 2023-11-04T01:50:39.688 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.689 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.690 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.2947433210 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres DEL REG 0,1 4 /SYSV000a54f7 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 1w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 2w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 3r FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 4u REG 8,1 8192 677189 /var/lib/postgresql/14/main/global/1262 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 8u IPv6 138715 0t0 UDP localhost:35609->localhost:35609 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.692 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32905 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres cwd DIR 8,1 4096 677111 /var/lib/postgresql/14/main 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres txt REG 8,1 9509856 675165 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.693 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.694 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.695 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 1w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 2w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 3r FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.696 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 8u IPv6 138715 0t0 UDP localhost:35609->localhost:35609 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32906 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres cwd DIR 8,1 4096 677111 /var/lib/postgresql/14/main 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres txt REG 8,1 9509856 675165 /usr/lib/postgresql/14/bin/postgres 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres DEL REG 0,1 3078 /dev/zero 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.697 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 29476472 2385 /usr/lib/x86_64-linux-gnu/libicudata.so.70.1 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.698 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.699 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 2062664 75701 /usr/lib/x86_64-linux-gnu/libicuuc.so.70.1 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 3328472 2387 /usr/lib/x86_64-linux-gnu/libicui18n.so.70.1 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 1967384 79643 /usr/lib/x86_64-linux-gnu/libxml2.so.2.9.13 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 0,26 26976 18 /dev/shm/PostgreSQL.2947433210 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.700 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres DEL REG 0,1 4 /SYSV000a54f7 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 1w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 2w REG 8,1 651 677139 /var/log/postgresql/postgresql-14-main.log 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 3r FIFO 0,13 0t0 138703 pipe 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 4u REG 8,1 0 677220 /var/lib/postgresql/14/main/global/6100 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 8u IPv6 138715 0t0 UDP localhost:35609->localhost:35609 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 9u a_inode 0,14 0 12540 [signalfd] 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:postgres 32907 postgres 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.701 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root txt REG 8,1 2194240 674392 /usr/sbin/ModemManager 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14384 674346 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 63776 674375 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14352 674355 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 100632 674379 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 18608 674359 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14440 674363 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 47384 674367 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14392 674353 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22736 674345 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 30912 674381 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22872 674364 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-04T01:50:39.702 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14512 674361 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 47392 674344 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22816 674348 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 18760 674373 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 43336 674371 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 18720 674369 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 30992 674362 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14504 674376 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14464 674366 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 26944 674382 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14416 674374 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14424 674370 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 31008 674383 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-04T01:50:39.703 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14392 674352 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14360 674372 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22784 674380 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 18616 674357 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 137544 674347 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14384 674378 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 129376 674356 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22704 674377 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 26944 674358 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14384 674349 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 39352 674365 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 63808 674350 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14416 674354 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-04T01:50:39.704 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 43280 674351 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22800 674360 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 14400 674368 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 43176 674387 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 80120 674386 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 88312 674390 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 30968 674388 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 63736 674389 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22696 674385 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 63736 674391 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-04T01:50:39.705 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 18680 674384 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.706 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 632904 674041 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 3528776 674117 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.707 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 1144904 674065 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 1u unix 0xffff955a91f0e1c0 0t0 139557 type=STREAM 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 5u unix 0xffff955a91f08440 0t0 139562 type=DGRAM 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 6u unix 0xffff955a8435bfc0 0t0 137638 type=STREAM 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.708 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 8u netlink 0t0 139563 KOBJECT_UEVENT 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 root 10w FIFO 0,25 0t0 3563 /run/systemd/inhibit/9.ref 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root txt REG 8,1 2194240 674392 /usr/sbin/ModemManager 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14384 674346 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 63776 674375 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14352 674355 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 100632 674379 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 18608 674359 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14440 674363 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-04T01:50:39.709 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 47384 674367 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14392 674353 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22736 674345 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 30912 674381 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22872 674364 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14512 674361 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 47392 674344 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22816 674348 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 18760 674373 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 43336 674371 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 18720 674369 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 30992 674362 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-04T01:50:39.710 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14504 674376 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14464 674366 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 26944 674382 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14416 674374 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14424 674370 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 31008 674383 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14392 674352 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14360 674372 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22784 674380 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 18616 674357 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 137544 674347 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14384 674378 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 129376 674356 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-04T01:50:39.711 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22704 674377 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 26944 674358 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14384 674349 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 39352 674365 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 63808 674350 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14416 674354 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 43280 674351 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22800 674360 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 14400 674368 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 43176 674387 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 80120 674386 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 88312 674390 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-04T01:50:39.712 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 30968 674388 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 63736 674389 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22696 674385 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 63736 674391 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 18680 674384 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.713 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.714 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 632904 674041 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 3528776 674117 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 1144904 674065 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.715 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 1u unix 0xffff955a91f0e1c0 0t0 139557 type=STREAM 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 5u unix 0xffff955a91f08440 0t0 139562 type=DGRAM 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 6u unix 0xffff955a8435bfc0 0t0 137638 type=STREAM 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 8u netlink 0t0 139563 KOBJECT_UEVENT 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32981 gmain root 10w FIFO 0,25 0t0 3563 /run/systemd/inhibit/9.ref 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root txt REG 8,1 2194240 674392 /usr/sbin/ModemManager 2023-11-04T01:50:39.716 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14384 674346 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-broadmobi.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 63776 674375 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-simtech.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14352 674355 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-haier.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 100632 674379 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ublox.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 18608 674359 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-linktop.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14440 674363 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia-icera.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 47384 674367 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option-hso.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14392 674353 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-generic.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22736 674345 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-anydata.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 30912 674381 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-wavecom.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22872 674364 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-nokia.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14512 674361 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-motorola.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 47392 674344 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-altair-lte.so 2023-11-04T01:50:39.717 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22816 674348 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dell.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 18760 674373 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra-legacy.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 43336 674371 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-quectel.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 18720 674369 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-pantech.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 30992 674362 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-mtk.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14504 674376 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-telit.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14464 674366 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 26944 674382 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-x22x.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14416 674374 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-sierra.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14424 674370 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-qcom-soc.so 2023-11-04T01:50:39.718 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 31008 674383 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-zte.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14392 674352 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-foxconn.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14360 674372 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-samsung.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22784 674380 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-via.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 18616 674357 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-intel.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 137544 674347 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-cinterion.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14384 674378 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-tplink.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 129376 674356 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-huawei.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22704 674377 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-thuraya.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 26944 674358 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-iridium.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14384 674349 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-dlink.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 39352 674365 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-novatel-lte.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 63808 674350 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-ericsson-mbm.so 2023-11-04T01:50:39.719 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14416 674354 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-gosuncn.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 43280 674351 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-fibocom.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22800 674360 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-longcheer.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 14400 674368 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-plugin-option.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 43176 674387 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-novatel.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 80120 674386 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-icera.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 88312 674390 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-telit.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 30968 674388 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-option.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 63736 674389 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-sierra.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22696 674385 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-foxconn.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 63736 674391 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-xmm.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 18704 29008 /usr/lib/x86_64-linux-gnu/gconv/IBM850.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 18680 674384 /usr/lib/x86_64-linux-gnu/ModemManager/libmm-shared-fibocom.so 2023-11-04T01:50:39.720 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 18720 29113 /usr/lib/x86_64-linux-gnu/gconv/UTF-16.so 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 149760 632 /usr/lib/x86_64-linux-gnu/libgpg-error.so.0.32.1 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 1296312 890 /usr/lib/x86_64-linux-gnu/libgcrypt.so.20.3.4 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 273056 1087 /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 477296 18878 /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 126472 11980 /usr/lib/x86_64-linux-gnu/libpolkit-gobject-1.so.0.0.0 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 807936 9152 /usr/lib/x86_64-linux-gnu/libsystemd.so.0.32.0 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 51272 18682 /usr/lib/x86_64-linux-gnu/libgudev-1.0.so.0.3.0 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 632904 674041 /usr/lib/x86_64-linux-gnu/libmbim-glib.so.4.7.0 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 3528776 674117 /usr/lib/x86_64-linux-gnu/libqmi-glib.so.5.9.0 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 387464 1159 /usr/lib/x86_64-linux-gnu/libgobject-2.0.so.0.7200.4 2023-11-04T01:50:39.722 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 1920400 1059 /usr/lib/x86_64-linux-gnu/libgio-2.0.so.0.7200.4 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 1277712 1078 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0.7200.4 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 22736 1082 /usr/lib/x86_64-linux-gnu/libgmodule-2.0.so.0.7200.4 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 1144904 674065 /usr/lib/x86_64-linux-gnu/libmm-glib.so.0.9.0 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 1u unix 0xffff955a91f0e1c0 0t0 139557 type=STREAM 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 2w CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 3u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 4u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 5u unix 0xffff955a91f08440 0t0 139562 type=DGRAM 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 6u unix 0xffff955a8435bfc0 0t0 137638 type=STREAM 2023-11-04T01:50:39.723 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 7u a_inode 0,14 0 12540 [eventfd] 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 8u netlink 0t0 139563 KOBJECT_UEVENT 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:ModemMana 32980 32984 gdbus root 10w FIFO 0,25 0t0 3563 /run/systemd/inhibit/9.ref 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33241 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33241 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33241 root txt unknown /proc/33241/exe 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33242 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33242 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33242 root txt unknown /proc/33242/exe 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33243 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33243 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33243 root txt unknown /proc/33243/exe 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33244 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33244 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33244 root txt unknown /proc/33244/exe 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33245 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33245 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33245 root txt unknown /proc/33245/exe 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33246 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33246 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33246 root txt unknown /proc/33246/exe 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33247 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33247 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33247 root txt unknown /proc/33247/exe 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33248 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33248 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33248 root txt unknown /proc/33248/exe 2023-11-04T01:50:39.725 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33259 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33259 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33259 root txt unknown /proc/33259/exe 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33260 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33260 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33260 root txt unknown /proc/33260/exe 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33261 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33261 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33261 root txt unknown /proc/33261/exe 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33262 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33262 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33262 root txt unknown /proc/33262/exe 2023-11-04T01:50:39.726 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33263 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33263 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33263 root txt unknown /proc/33263/exe 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33264 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33264 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33264 root txt unknown /proc/33264/exe 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33265 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33265 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33265 root txt unknown /proc/33265/exe 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33266 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33266 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33266 root txt unknown /proc/33266/exe 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33277 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.727 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33277 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33277 root txt unknown /proc/33277/exe 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33278 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33278 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33278 root txt unknown /proc/33278/exe 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33279 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33279 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33279 root txt unknown /proc/33279/exe 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33280 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33280 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33280 root txt unknown /proc/33280/exe 2023-11-04T01:50:39.728 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33281 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33281 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33281 root txt unknown /proc/33281/exe 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33282 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33282 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33282 root txt unknown /proc/33282/exe 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33283 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33283 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33283 root txt unknown /proc/33283/exe 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33284 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33284 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33284 root txt unknown /proc/33284/exe 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33295 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.729 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33295 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-buf/d 33295 root txt unknown /proc/33295/exe 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33296 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33296 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-conv/ 33296 root txt unknown /proc/33296/exe 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33297 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33297 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-recla 33297 root txt unknown /proc/33297/exe 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33298 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33298 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-block 33298 root txt unknown /proc/33298/exe 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33299 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.730 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33299 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-inode 33299 root txt unknown /proc/33299/exe 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33300 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33300 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-log/d 33300 root txt unknown /proc/33300/exe 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33301 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33301 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfs-cil/d 33301 root txt unknown /proc/33301/exe 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33302 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33302 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:xfsaild/d 33302 root txt unknown /proc/33302/exe 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-0 33317 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-0 33317 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.731 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-0 33317 root txt unknown /proc/33317/exe 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-1 34458 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-1 34458 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-1 34458 root txt unknown /proc/34458/exe 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-2 35599 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-2 35599 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-2 35599 root txt unknown /proc/35599/exe 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-3 36740 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-3 36740 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:dio/dm-3 36740 root txt unknown /proc/36740/exe 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.732 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.733 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 0r FIFO 0,13 0t0 144624 pipe 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.735 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 3r FIFO 0,13 0t0 141766 pipe 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 4w FIFO 0,13 0t0 141766 pipe 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 6u netlink 0t0 141775 AUDIT 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38011 root 7u unix 0xffff955a90db6e80 0t0 141776 type=DGRAM 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.736 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root 0r FIFO 0,13 0t0 144624 pipe 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38012 root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:39.737 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.738 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.739 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 0r FIFO 0,13 0t0 144627 pipe 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 3r FIFO 0,13 0t0 140692 pipe 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 4w FIFO 0,13 0t0 140692 pipe 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:39.740 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 6u netlink 0t0 140701 AUDIT 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38014 root 7u unix 0xffff955a8963a640 0t0 140702 type=DGRAM 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38020 log root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38021 service root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38022 admin_soc root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38023 signal_ha root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38024 rocksdb:l root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38025 rocksdb:h root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38041 ceph-mon root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38042 fn_monsto root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38043 msgr-work root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38044 msgr-work root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38045 msgr-work root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38046 OpHistory root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38047 fin root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38048 safe_time root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38049 cpu_tp root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38050 cpu_tp root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38051 cpu_tp root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38052 cpu_tp root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38053 ms_dispat root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38054 ms_local root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38055 safe_time root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38056 ms_dispat root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 38057 ms_local root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root txt REG 8,1 26411896 51314 /usr/bin/ceph-mon 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:39.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 1w FIFO 0,13 0t0 144625 pipe 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 2w FIFO 0,13 0t0 144626 pipe 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 3r FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 4w FIFO 0,13 0t0 141780 pipe 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 5w REG 8,1 55502529 676958 /var/log/ceph/ceph-mon.a.log 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 6uW REG 0,25 6 3600 /run/ceph/ceph-mon.a.pid 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 7r FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 8w FIFO 0,13 0t0 141781 pipe 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 9u unix 0xffff955a90db0000 0t0 141782 /var/run/ceph/ceph-mon.a.asok type=STREAM 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 10r FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 11w FIFO 0,13 0t0 141783 pipe 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 12u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 13r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 14uW REG 253,4 0 33595527 /var/lib/ceph/mon/ceph-a/store.db/LOCK 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 15r DIR 253,4 152 33595526 /var/lib/ceph/mon/ceph-a/store.db 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 17r REG 253,4 5547245 33595533 /var/lib/ceph/mon/ceph-a/store.db/000015.sst 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 18w REG 253,4 416 33595535 /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 19u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 20r FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 21w FIFO 0,13 0t0 141790 pipe 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 22u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 23r FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 24w FIFO 0,13 0t0 141791 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 25u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 26r FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 27w FIFO 0,13 0t0 141792 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 28u IPv4 145442 0t0 TCP smithi002.front.sepia.ceph.com:3300 (LISTEN) 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 29u IPv4 145443 0t0 TCP smithi002.front.sepia.ceph.com:6789 (LISTEN) 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 30r FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 31w FIFO 0,13 0t0 141793 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 32u IPv4 138978 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:47154 (ESTABLISHED) 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 33w REG 8,1 176128 676987 /var/log/ceph/ceph.audit.log 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 34r FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 35w FIFO 0,13 0t0 141794 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 36r FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 37w FIFO 0,13 0t0 141795 pipe 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 38u IPv4 145468 0t0 TCP smithi002.front.sepia.ceph.com:49914->smithi090.front.sepia.ceph.com:3301 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 39u IPv4 144634 0t0 TCP smithi002.front.sepia.ceph.com:43128->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 40w REG 8,1 101775 676959 /var/log/ceph/ceph.log 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 41u IPv4 145559 0t0 TCP smithi002.front.sepia.ceph.com:46808->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 42u IPv4 145562 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37478 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 43u IPv4 140911 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37504 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 44u IPv4 145568 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:37512 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 45u IPv4 142124 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi090.front.sepia.ceph.com:48084 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 46w REG 253,4 1952838 33595531 /var/lib/ceph/mon/ceph-a/store.db/000013.log 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 47u IPv4 204096 0t0 TCP smithi002.front.sepia.ceph.com:3300->smithi002.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mon 38015 57517 rstore_co root 49u IPv4 206020 0t0 TCP smithi002.front.sepia.ceph.com:3300->192.168.0.1:57910 (ESTABLISHED) 2023-11-04T01:50:39.950 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.951 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root 0r FIFO 0,13 0t0 144627 pipe 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38017 root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:39.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:39.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:39.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38059 log root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:39.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:39.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38061 msgr-work root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:39.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:39.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:39.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:39.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:39.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:39.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38062 msgr-work root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:39.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38063 msgr-work root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38097 service root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38098 admin_soc root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38099 ceph_time root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38100 fn_anonym root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38101 signal_ha root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38102 mgrsb-fin root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38103 ms_dispat root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38104 ms_local root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38105 io_contex root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38106 io_contex root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38107 safe_time root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38108 safe_time root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38109 safe_time root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38110 fn_anonym root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38111 flusher root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38112 safe_time root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38211 ceph-mgr root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38212 ceph-mgr root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38213 ceph-mgr root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38214 ceph-mgr root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38215 ceph-mgr root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38216 ceph-mgr root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root txt REG 8,1 4329360 51306 /usr/bin/ceph-mgr 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 31264 50108 /usr/lib/python3.10/lib-dynload/termios.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 24336 50089 /usr/lib/python3.10/lib-dynload/_multiprocessing.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 78624 50069 /usr/lib/python3.10/lib-dynload/_asyncio.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 63840 66923 /usr/lib/python3/dist-packages/scipy/_lib/_ccallback_c.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 822512 80156 /usr/lib/python3/dist-packages/numpy/random/_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 54360 80165 /usr/lib/python3/dist-packages/numpy/random/_sfc64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 96328 80160 /usr/lib/python3/dist-packages/numpy/random/_pcg64.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 81464 80162 /usr/lib/python3/dist-packages/numpy/random/_philox.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 94408 80158 /usr/lib/python3/dist-packages/numpy/random/_mt19937.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 350576 80152 /usr/lib/python3/dist-packages/numpy/random/_bounded_integers.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 230960 80154 /usr/lib/python3/dist-packages/numpy/random/_common.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 170840 80167 /usr/lib/python3/dist-packages/numpy/random/bit_generator.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 694312 80171 /usr/lib/python3/dist-packages/numpy/random/mtrand.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 72128 79990 /usr/lib/python3/dist-packages/numpy/fft/_pocketfft_internal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 148960 80076 /usr/lib/python3/dist-packages/numpy/linalg/_umath_linalg.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 7092680 47993 /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 125544 22386 /usr/lib/python3/dist-packages/numpy/core/_multiarray_tests.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 289592 4405 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 2989432 4414 /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 38017672 47994 /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 395776 47992 /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 3804808 22387 /usr/lib/python3/dist-packages/numpy/core/_multiarray_umath.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 129240 4237 /usr/lib/x86_64-linux-gnu/libyaml-0.so.2.0.6 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 246624 4535 /usr/lib/python3/dist-packages/yaml/_yaml.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 136216 50079 /usr/lib/python3.10/lib-dynload/_ctypes.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 765704 5526 /usr/lib/python3/dist-packages/_brotli.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 72080 875 /usr/lib/x86_64-linux-gnu/libjson-c.so.5.1.0 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 35000 2009 /usr/lib/x86_64-linux-gnu/libargon2.so.1 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 438864 641 /usr/lib/x86_64-linux-gnu/libdevmapper.so.1.02.1 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 484720 9046 /usr/lib/x86_64-linux-gnu/libcryptsetup.so.12.7.0 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 7344608 50506 /usr/lib/librbd.so.1.18.0 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 14536 50077 /usr/lib/python3.10/lib-dynload/_contextvars.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 1112896 50550 /usr/lib/python3/dist-packages/rbd.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 104672 673665 /usr/lib/x86_64-linux-gnu/ossl-modules/legacy.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 858960 43846 /usr/lib/python3/dist-packages/cryptography/hazmat/bindings/_openssl.abi3.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 49936 670183 /usr/lib/python3/dist-packages/simplejson/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 187200 12815 /usr/lib/x86_64-linux-gnu/libmpdec.so.2.5.1 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 19136 80077 /usr/lib/python3/dist-packages/numpy/linalg/lapack_lite.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 14848 664421 /usr/lib/python3/dist-packages/markupsafe/_speedups.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 180632 50084 /usr/lib/python3.10/lib-dynload/_decimal.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 216560 48613 /usr/lib/python3.10/lib-dynload/_ssl.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 63728 48611 /usr/lib/python3.10/lib-dynload/_hashlib.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 23664 50091 /usr/lib/python3.10/lib-dynload/_queue.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 1898968 50515 /usr/lib/libcephfs.so.2.0.0 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 509272 50534 /usr/lib/python3/dist-packages/cephfs.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 194472 5651 /usr/lib/python3/dist-packages/_cffi_backend.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 43336 666352 /usr/lib/python3/dist-packages/bcrypt/_bcrypt.abi3.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 30920 2951 /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 14688 50098 /usr/lib/python3.10/lib-dynload/_uuid.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 110888 50092 /usr/lib/python3.10/lib-dynload/_sqlite3.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 1116728 50522 /usr/lib/python3/dist-packages/rados.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 49160 50085 /usr/lib/python3.10/lib-dynload/_json.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 14672 48612 /usr/lib/python3.10/lib-dynload/_opcode.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 1608696 50497 /usr/lib/librados.so.2.0.0 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 5846784 85677 /usr/lib/x86_64-linux-gnu/libpython3.10.so.1.0 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 1358520 20539 /usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 299744 51293 /usr/lib/libcephsqlite.so 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 1w FIFO 0,13 0t0 144628 pipe 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 2w FIFO 0,13 0t0 144629 pipe 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 3r FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 4w FIFO 0,13 0t0 145452 pipe 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 6r FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 7w FIFO 0,13 0t0 145453 pipe 2023-11-04T01:50:40.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 9r FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 10w FIFO 0,13 0t0 145454 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 12r FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 13w FIFO 0,13 0t0 145455 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 14w REG 8,1 651231 676960 /var/log/ceph/ceph-mgr.y.log 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 15uW REG 0,25 6 3603 /run/ceph/ceph-mgr.y.pid 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 16r FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 17w FIFO 0,13 0t0 138971 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 18u unix 0xffff955a89d8a200 0t0 138972 /var/run/ceph/ceph-mgr.y.asok type=STREAM 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 19r FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 20w FIFO 0,13 0t0 138976 pipe 2023-11-04T01:50:40.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 21r FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 22w FIFO 0,13 0t0 138977 pipe 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 23u IPv4 137904 0t0 TCP smithi002.front.sepia.ceph.com:46820->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mgr 38058 38217 ceph-mgr root 24u IPv4 141843 0t0 TCP smithi002.front.sepia.ceph.com:47154->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.270 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:40.271 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:40.272 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 0r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 3r FIFO 0,13 0t0 143040 pipe 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 4w FIFO 0,13 0t0 143040 pipe 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 6u netlink 0t0 143049 AUDIT 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38113 root 7u unix 0xffff955a8b6ba640 0t0 143050 type=DGRAM 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:40.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:40.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:40.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 0r FIFO 0,13 0t0 144649 pipe 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 3r FIFO 0,13 0t0 143633 pipe 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 4w FIFO 0,13 0t0 143633 pipe 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 6u netlink 0t0 143642 AUDIT 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38114 root 7u unix 0xffff955a8c180440 0t0 143643 type=DGRAM 2023-11-04T01:50:40.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.277 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:40.278 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 0r FIFO 0,13 0t0 144652 pipe 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:40.279 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 3r FIFO 0,13 0t0 139028 pipe 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 4w FIFO 0,13 0t0 139028 pipe 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 6u netlink 0t0 139037 AUDIT 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38115 root 7u unix 0xffff955a89d8b740 0t0 139038 type=DGRAM 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:40.280 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:40.281 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:40.282 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 0r FIFO 0,13 0t0 144655 pipe 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 3r FIFO 0,13 0t0 137875 pipe 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 4w FIFO 0,13 0t0 137875 pipe 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 6u netlink 0t0 137884 AUDIT 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 38116 root 7u unix 0xffff955a8435fb40 0t0 137885 type=DGRAM 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root 0r FIFO 0,13 0t0 144646 pipe 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.284 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38117 root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.285 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root 0r FIFO 0,13 0t0 144649 pipe 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38119 root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.286 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root 0r FIFO 0,13 0t0 144655 pipe 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38121 root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:40.287 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root 0r FIFO 0,13 0t0 144652 pipe 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:40.288 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 38123 root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38133 log root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38135 msgr-work root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38136 msgr-work root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38137 msgr-work root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38149 service root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38150 admin_soc root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38223 signal_ha root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38224 io_contex root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38225 io_contex root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38242 OpHistory root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38243 ceph_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38287 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38299 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38307 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38318 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38330 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38342 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38354 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38374 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38375 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38376 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38377 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38378 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38379 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38380 fn_anonym root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38385 rocksdb:l root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38386 rocksdb:l root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38387 rocksdb:l root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 38388 rocksdb:h root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40059 bstore_ai root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40060 bstore_di root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40793 bstore_ai root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 40794 bstore_di root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41203 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41204 cfin root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41205 bstore_kv root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41206 bstore_kv root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41207 bstore_me root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41319 ms_dispat root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41322 ms_local root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41325 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41328 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41331 ms_dispat root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41334 ms_local root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41336 ms_dispat root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:40.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:40.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:40.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:40.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:40.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:40.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:40.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:40.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41338 ms_local root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:40.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:40.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:40.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41341 ms_dispat root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41342 ms_local root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41343 ms_dispat root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41346 ms_local root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41349 ms_dispat root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41351 ms_local root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41353 ms_dispat root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41355 ms_local root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41357 fn_anonym root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41359 finisher root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41361 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41363 safe_time root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41365 ceph-osd root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41367 osd_srv_a root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 14w REG 8,1 49875760 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41370 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41371 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41372 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41375 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41377 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41379 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41381 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41383 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41385 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41388 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41389 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41392 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41394 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41397 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41399 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41400 tp_osd_tp root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root DEL REG 0,19 143915 /[aio] 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root DEL REG 0,19 143913 /[aio] 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 1w FIFO 0,13 0t0 144647 pipe 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 2w FIFO 0,13 0t0 144648 pipe 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 3r FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 4w FIFO 0,13 0t0 139069 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 6r FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 7w FIFO 0,13 0t0 139070 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 9r FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 10w FIFO 0,13 0t0 139071 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 12r FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 13w FIFO 0,13 0t0 139072 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 14w REG 8,1 49875973 673676 /var/log/ceph/ceph-osd.0.log 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 15uW REG 0,25 6 3605 /run/ceph/ceph-osd.0.pid 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 16r FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 17w FIFO 0,13 0t0 143077 pipe 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 18u unix 0xffff955a8b6b9100 0t0 143078 /var/run/ceph/ceph-osd.0.asok type=STREAM 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 19u IPv4 143684 0t0 TCP *:6808 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 20u IPv4 143694 0t0 TCP *:6809 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 21u IPv4 143705 0t0 TCP *:6810 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 22u IPv4 143717 0t0 TCP *:6811 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 23u IPv4 143730 0t0 TCP *:6812 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 24u IPv4 143744 0t0 TCP *:6813 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 25u IPv4 143759 0t0 TCP *:6814 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 26u IPv4 143775 0t0 TCP *:6815 (LISTEN) 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 27r FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 28w FIFO 0,13 0t0 143123 pipe 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 29r FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 30w FIFO 0,13 0t0 143124 pipe 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 31u sock 0,8 0t0 143900 protocol: UDPv6 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 32r DIR 253,0 357 64 /var/lib/ceph/osd/ceph-0 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 33uW REG 253,0 37 69 /var/lib/ceph/osd/ceph-0/fsid 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 34u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 35u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 36u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 37u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 38u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 39u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 40u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 41u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 42u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 43u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 44u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 45u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 46u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 47u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 48u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 49u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 50u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 51u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 52u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 53u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 54u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 55u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 56u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 57u REG 253,0 96636764160 70 /var/lib/ceph/osd/ceph-0/block 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 59u IPv4 143916 0t0 TCP smithi002.front.sepia.ceph.com:41798->smithi090.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 60r FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 61w FIFO 0,13 0t0 145579 pipe 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 62r FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 63w FIFO 0,13 0t0 145580 pipe 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 64u IPv4 143170 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36918 (ESTABLISHED) 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 65u IPv4 143173 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46172 (ESTABLISHED) 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 66u IPv4 137970 0t0 TCP smithi002.front.sepia.ceph.com:48950->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 67u IPv4 142141 0t0 TCP smithi002.front.sepia.ceph.com:36126->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 68u IPv4 137971 0t0 TCP smithi002.front.sepia.ceph.com:55430->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 69u IPv4 137972 0t0 TCP smithi002.front.sepia.ceph.com:48806->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 70u IPv4 137973 0t0 TCP smithi002.front.sepia.ceph.com:58526->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 71u IPv4 142142 0t0 TCP smithi002.front.sepia.ceph.com:37532->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 72u IPv4 143176 0t0 TCP smithi002.front.sepia.ceph.com:43760->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 73u IPv4 137974 0t0 TCP smithi002.front.sepia.ceph.com:50468->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 74u IPv4 142143 0t0 TCP smithi002.front.sepia.ceph.com:36188->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 75u IPv4 143177 0t0 TCP smithi002.front.sepia.ceph.com:58142->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 76u IPv4 143178 0t0 TCP smithi002.front.sepia.ceph.com:52654->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 77u IPv4 143179 0t0 TCP smithi002.front.sepia.ceph.com:35284->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 78u IPv4 143180 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49716 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 79u IPv4 142144 0t0 TCP smithi002.front.sepia.ceph.com:41196->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 80u IPv4 142145 0t0 TCP smithi002.front.sepia.ceph.com:55112->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 81u IPv4 143183 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37162 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 82u IPv4 143186 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46180 (ESTABLISHED) 2023-11-04T01:50:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 83u IPv4 143189 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36928 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 84u IPv4 144703 0t0 TCP smithi002.front.sepia.ceph.com:60902->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 85u IPv4 139133 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37170 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 86u IPv4 139136 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49722 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 87u IPv4 139139 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49738 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 88u IPv4 139142 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37186 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 89u IPv4 139145 0t0 TCP smithi002.front.sepia.ceph.com:47234->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 90u IPv4 143195 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi002.front.sepia.ceph.com:46196 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 91u IPv4 139146 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi002.front.sepia.ceph.com:33002 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 92u IPv4 145597 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi002.front.sepia.ceph.com:36944 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 93u IPv4 140946 0t0 TCP smithi002.front.sepia.ceph.com:38202->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 94u IPv4 139148 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52120 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 95u IPv4 139149 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52128 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 96u IPv4 145600 0t0 TCP smithi002.front.sepia.ceph.com:6814->smithi090.front.sepia.ceph.com:37188 (ESTABLISHED) 2023-11-04T01:50:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 97u IPv4 145603 0t0 TCP smithi002.front.sepia.ceph.com:6812->smithi090.front.sepia.ceph.com:49742 (ESTABLISHED) 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 98u IPv4 142146 0t0 TCP smithi002.front.sepia.ceph.com:45588->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 99u IPv4 139152 0t0 TCP smithi002.front.sepia.ceph.com:6810->smithi090.front.sepia.ceph.com:52132 (ESTABLISHED) 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 100u IPv4 144718 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38129 41401 osd_srv_h root 101u IPv4 201450 0t0 TCP smithi002.front.sepia.ceph.com:6808->smithi090.front.sepia.ceph.com:40010 (ESTABLISHED) 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 14w REG 8,1 58013866 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38163 log root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38165 msgr-work root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38166 msgr-work root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38167 msgr-work root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38183 service root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38184 admin_soc root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38218 signal_ha root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38219 io_contex root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38220 io_contex root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38238 OpHistory root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38239 ceph_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38278 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38290 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38303 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38315 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38327 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38339 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38351 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38363 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 14w REG 8,1 57936585 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38364 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 14w REG 8,1 57946567 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38365 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 14w REG 8,1 57963914 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38366 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 14w REG 8,1 57966765 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38367 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 14w REG 8,1 57966765 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38368 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 14w REG 8,1 57969536 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38369 fn_anonym root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 14w REG 8,1 57972346 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38580 rocksdb:l root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 14w REG 8,1 57972346 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38581 rocksdb:l root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 14w REG 8,1 57972346 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38582 rocksdb:l root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 14w REG 8,1 57973529 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 38583 rocksdb:h root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 14w REG 8,1 57976796 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39875 bstore_ai root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 14w REG 8,1 57976796 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 39876 bstore_di root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 14w REG 8,1 57976796 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40611 bstore_ai root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 14w REG 8,1 57981268 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40612 bstore_di root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 14w REG 8,1 57986934 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40977 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40978 cfin root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:41.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:41.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:41.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:41.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:41.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:41.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:41.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:41.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:41.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40979 bstore_kv root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:41.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:41.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:41.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:41.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40980 bstore_kv root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 40981 bstore_me root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41162 ms_dispat root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41163 ms_local root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41164 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41165 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41166 ms_dispat root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41167 ms_local root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41168 ms_dispat root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41169 ms_local root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41170 ms_dispat root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41171 ms_local root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41172 ms_dispat root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41173 ms_local root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41174 ms_dispat root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41175 ms_local root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41176 ms_dispat root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41177 ms_local root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41178 fn_anonym root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41179 finisher root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41180 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41181 safe_time root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41182 ceph-osd root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41183 osd_srv_a root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41184 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41185 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41186 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41187 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41188 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41189 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41190 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 14w REG 8,1 57997182 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41191 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 14w REG 8,1 57999788 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41192 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 14w REG 8,1 57999788 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41193 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 14w REG 8,1 57999788 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41194 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 14w REG 8,1 57999788 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41195 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 14w REG 8,1 58004107 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41196 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 14w REG 8,1 58009566 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41197 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 14w REG 8,1 58010355 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41198 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 14w REG 8,1 58013866 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41199 tp_osd_tp root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root DEL REG 0,19 143158 /[aio] 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root DEL REG 0,19 143156 /[aio] 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 1w FIFO 0,13 0t0 144656 pipe 2023-11-04T01:50:42.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 2w FIFO 0,13 0t0 144657 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 3r FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 4w FIFO 0,13 0t0 140730 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 6r FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 7w FIFO 0,13 0t0 140731 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 9r FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 10w FIFO 0,13 0t0 140732 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 12r FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 13w FIFO 0,13 0t0 140733 pipe 2023-11-04T01:50:42.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 14w REG 8,1 58013866 676957 /var/log/ceph/ceph-osd.3.log 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 15uW REG 0,25 6 3611 /run/ceph/ceph-osd.3.pid 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 16r FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 17w FIFO 0,13 0t0 140735 pipe 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 18u unix 0xffff955a89639540 0t0 140736 /var/run/ceph/ceph-osd.3.asok type=STREAM 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 19u IPv4 143084 0t0 TCP *:6800 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 20u IPv4 143086 0t0 TCP *:6801 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 21u IPv4 143089 0t0 TCP *:6802 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 22u IPv4 143093 0t0 TCP *:6803 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 23u IPv4 143098 0t0 TCP *:6804 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 24u IPv4 143104 0t0 TCP *:6805 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 25u IPv4 143111 0t0 TCP *:6806 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 26u IPv4 143119 0t0 TCP *:6807 (LISTEN) 2023-11-04T01:50:42.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 27r FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 28w FIFO 0,13 0t0 140743 pipe 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 29r FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 30w FIFO 0,13 0t0 140744 pipe 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 31u sock 0,8 0t0 143144 protocol: UDPv6 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 32r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-3 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 33uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-3/fsid 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 34u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-3/block 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 59u IPv4 140909 0t0 TCP smithi002.front.sepia.ceph.com:37478->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 60r FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 61w FIFO 0,13 0t0 143920 pipe 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 62r FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 63w FIFO 0,13 0t0 143921 pipe 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 64u IPv4 137919 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:55180 (ESTABLISHED) 2023-11-04T01:50:42.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 65u IPv4 137922 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:47550 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 66u IPv4 140922 0t0 TCP smithi002.front.sepia.ceph.com:41454->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 67u IPv4 137925 0t0 TCP smithi002.front.sepia.ceph.com:49308->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 68u IPv4 137926 0t0 TCP smithi002.front.sepia.ceph.com:39532->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 69u IPv4 140923 0t0 TCP smithi002.front.sepia.ceph.com:37872->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 70u IPv4 143168 0t0 TCP smithi002.front.sepia.ceph.com:40012->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 71u IPv4 140924 0t0 TCP smithi002.front.sepia.ceph.com:37498->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 72u IPv4 140925 0t0 TCP smithi002.front.sepia.ceph.com:45912->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 73u IPv4 137927 0t0 TCP smithi002.front.sepia.ceph.com:43508->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 74u IPv4 137928 0t0 TCP smithi002.front.sepia.ceph.com:43024->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 75u IPv4 137929 0t0 TCP smithi002.front.sepia.ceph.com:39312->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 76u IPv4 137936 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:46992 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 77u IPv4 137939 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55668 (ESTABLISHED) 2023-11-04T01:50:42.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 78u IPv4 139108 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55672 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 79u IPv4 139111 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47008 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 80u IPv4 140926 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55678 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 81u IPv4 140929 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47022 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 82u IPv4 140932 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi090.front.sepia.ceph.com:55686 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 83u IPv4 140935 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi090.front.sepia.ceph.com:47026 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 84u IPv4 143169 0t0 TCP smithi002.front.sepia.ceph.com:46920->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 85u IPv4 140938 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59392 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 86u IPv4 140941 0t0 TCP smithi002.front.sepia.ceph.com:47224->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 87u IPv4 144698 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58512 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 88u IPv4 145587 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52650 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 89u IPv4 137975 0t0 TCP smithi002.front.sepia.ceph.com:6804->smithi002.front.sepia.ceph.com:58526 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 90u IPv4 137978 0t0 TCP smithi002.front.sepia.ceph.com:6806->smithi002.front.sepia.ceph.com:52654 (ESTABLISHED) 2023-11-04T01:50:42.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 91u IPv4 144701 0t0 TCP smithi002.front.sepia.ceph.com:48962->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 92u IPv4 143948 0t0 TCP smithi002.front.sepia.ceph.com:46180->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 93u IPv4 143949 0t0 TCP smithi002.front.sepia.ceph.com:36140->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 94u IPv4 137981 0t0 TCP smithi002.front.sepia.ceph.com:36928->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 95u IPv4 138002 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:51368 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 96u IPv4 137982 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38202 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 97u IPv4 145607 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59408 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 98u IPv4 137987 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59414 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 99u IPv4 139189 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi002.front.sepia.ceph.com:38214 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 100u IPv4 141018 0t0 TCP smithi002.front.sepia.ceph.com:6802->smithi090.front.sepia.ceph.com:59428 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38130 41200 osd_srv_h root 101u IPv4 203124 0t0 TCP smithi002.front.sepia.ceph.com:6800->smithi090.front.sepia.ceph.com:43984 (ESTABLISHED) 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38141 log root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38143 msgr-work root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38144 msgr-work root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38145 msgr-work root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38171 service root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38172 admin_soc root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38228 signal_ha root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38229 io_contex root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38230 io_contex root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38250 OpHistory root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38251 ceph_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38284 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 14w REG 8,1 57659151 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38296 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 14w REG 8,1 57659364 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38312 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 14w REG 8,1 57659364 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38321 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 14w REG 8,1 57659364 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38331 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 14w REG 8,1 57659364 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38345 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 14w REG 8,1 57659364 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38360 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 14w REG 8,1 57659364 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38653 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 14w REG 8,1 57659364 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38664 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38667 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38670 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38671 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:42.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:42.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:42.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38673 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:42.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:42.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:42.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:42.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:42.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:42.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:42.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38675 fn_anonym root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38959 rocksdb:l root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38960 rocksdb:l root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38961 rocksdb:l root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 38962 rocksdb:h root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40247 bstore_ai root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 40248 bstore_di root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41201 bstore_ai root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41202 bstore_di root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41471 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41472 cfin root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41473 bstore_kv root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41474 bstore_kv root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41475 bstore_me root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41476 ms_dispat root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41477 ms_local root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41478 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41479 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41480 ms_dispat root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41481 ms_local root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41482 ms_dispat root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41483 ms_local root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41484 ms_dispat root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41485 ms_local root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41486 ms_dispat root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41487 ms_local root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41488 ms_dispat root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41489 ms_local root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41490 ms_dispat root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41491 ms_local root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41492 fn_anonym root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41493 finisher root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41494 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41495 safe_time root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41496 ceph-osd root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41497 osd_srv_a root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41498 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41499 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41500 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41501 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41502 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41503 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41504 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41505 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41506 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41507 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41508 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41509 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41510 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41511 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41512 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41513 tp_osd_tp root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root DEL REG 0,19 140910 /[aio] 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root DEL REG 0,19 139088 /[aio] 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 1w FIFO 0,13 0t0 144650 pipe 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 2w FIFO 0,13 0t0 144651 pipe 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 3r FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 4w FIFO 0,13 0t0 144668 pipe 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 6r FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 7w FIFO 0,13 0t0 144669 pipe 2023-11-04T01:50:43.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 9r FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 10w FIFO 0,13 0t0 144670 pipe 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 12r FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 13w FIFO 0,13 0t0 144671 pipe 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 14w REG 8,1 57661960 673677 /var/log/ceph/ceph-osd.1.log 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 15uW REG 0,25 6 3607 /run/ceph/ceph-osd.1.pid 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 16r FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 17w FIFO 0,13 0t0 144673 pipe 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 18u unix 0xffff955a83c3bb80 0t0 144674 /var/run/ceph/ceph-osd.1.asok type=STREAM 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 19u IPv4 143792 0t0 TCP *:6816 (LISTEN) 2023-11-04T01:50:43.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 20u IPv4 143810 0t0 TCP *:6817 (LISTEN) 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 21u IPv4 143829 0t0 TCP *:6818 (LISTEN) 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 22u IPv4 143849 0t0 TCP *:6819 (LISTEN) 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 23u IPv4 140766 0t0 TCP *:6820 (LISTEN) 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 24u IPv4 140789 0t0 TCP *:6822 (LISTEN) 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 25u IPv4 140814 0t0 TCP *:6824 (LISTEN) 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 26u IPv4 140841 0t0 TCP *:6826 (LISTEN) 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 27r FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 28w FIFO 0,13 0t0 144682 pipe 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 29r FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 30w FIFO 0,13 0t0 144683 pipe 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 31u sock 0,8 0t0 142107 protocol: UDPv6 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 32r DIR 253,1 357 64 /var/lib/ceph/osd/ceph-1 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 33uW REG 253,1 37 69 /var/lib/ceph/osd/ceph-1/fsid 2023-11-04T01:50:43.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 34u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 35u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 36u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 37u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 38u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 39u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 40u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 41u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 42u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 43u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 44u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 45u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 46u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 47u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 48u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 49u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 50u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 51u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 52u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 53u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 54u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 55u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 56u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 57u REG 253,1 96636764160 70 /var/lib/ceph/osd/ceph-1/block 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 59u IPv4 143160 0t0 TCP smithi002.front.sepia.ceph.com:37512->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 60r FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 61w FIFO 0,13 0t0 137957 pipe 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 62r FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 63w FIFO 0,13 0t0 137958 pipe 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 64u IPv4 143943 0t0 TCP smithi002.front.sepia.ceph.com:46172->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 65u IPv4 139114 0t0 TCP smithi002.front.sepia.ceph.com:36918->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 66u IPv4 137966 0t0 TCP smithi002.front.sepia.ceph.com:48794->smithi002.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 67u IPv4 139115 0t0 TCP smithi002.front.sepia.ceph.com:43746->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 68u IPv4 139116 0t0 TCP smithi002.front.sepia.ceph.com:58512->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 69u IPv4 143944 0t0 TCP smithi002.front.sepia.ceph.com:36172->smithi002.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 70u IPv4 137967 0t0 TCP smithi002.front.sepia.ceph.com:55426->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 71u IPv4 137968 0t0 TCP smithi002.front.sepia.ceph.com:41190->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 72u IPv4 139117 0t0 TCP smithi002.front.sepia.ceph.com:50456->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 73u IPv4 143945 0t0 TCP smithi002.front.sepia.ceph.com:52650->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 74u IPv4 139118 0t0 TCP smithi002.front.sepia.ceph.com:58128->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 75u IPv4 143946 0t0 TCP smithi002.front.sepia.ceph.com:35268->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 76u IPv4 143947 0t0 TCP smithi002.front.sepia.ceph.com:37528->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 77u IPv4 137969 0t0 TCP smithi002.front.sepia.ceph.com:55104->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 78u IPv4 139119 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48950 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 79u IPv4 139122 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36126 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 80u IPv4 139125 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57058 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 81u IPv4 139126 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48962 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 82u IPv4 139129 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56568 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 83u IPv4 139130 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36140 (ESTABLISHED) 2023-11-04T01:50:43.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 84u IPv4 144702 0t0 TCP smithi002.front.sepia.ceph.com:33838->smithi090.front.sepia.ceph.com:6818 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 85u IPv4 143950 0t0 TCP smithi002.front.sepia.ceph.com:60910->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 86u IPv4 144704 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57074 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 87u IPv4 144707 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56570 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 88u IPv4 144710 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57076 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 89u IPv4 144713 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56580 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 90u IPv4 145596 0t0 TCP smithi002.front.sepia.ceph.com:33002->smithi002.front.sepia.ceph.com:6810 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 91u IPv4 139156 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi002.front.sepia.ceph.com:36144 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 92u IPv4 139159 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi002.front.sepia.ceph.com:48974 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 93u IPv4 143957 0t0 TCP smithi002.front.sepia.ceph.com:6820->smithi090.front.sepia.ceph.com:56582 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 94u IPv4 143954 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40234 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 95u IPv4 143960 0t0 TCP smithi002.front.sepia.ceph.com:6824->smithi090.front.sepia.ceph.com:57092 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 96u IPv4 143963 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57310 (ESTABLISHED) 2023-11-04T01:50:43.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 97u IPv4 142150 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57316 (ESTABLISHED) 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 98u IPv4 143966 0t0 TCP smithi002.front.sepia.ceph.com:6818->smithi090.front.sepia.ceph.com:40236 (ESTABLISHED) 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 99u IPv4 142153 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:57326 (ESTABLISHED) 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 100u IPv4 144743 0t0 TCP smithi002.front.sepia.ceph.com:45600->smithi090.front.sepia.ceph.com:6826 (ESTABLISHED) 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 101u IPv4 143248 0t0 TCP smithi002.front.sepia.ceph.com:38214->smithi002.front.sepia.ceph.com:6802 (ESTABLISHED) 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 102u IPv4 144018 0t0 TCP smithi002.front.sepia.ceph.com:47244->smithi002.front.sepia.ceph.com:6825 (ESTABLISHED) 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38131 41514 osd_srv_h root 103u IPv4 201333 0t0 TCP smithi002.front.sepia.ceph.com:6816->smithi090.front.sepia.ceph.com:35860 (ESTABLISHED) 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 14w REG 8,1 54002329 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38151 log root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 14w REG 8,1 54002329 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38153 msgr-work root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 14w REG 8,1 54002329 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38154 msgr-work root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.867 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.868 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.869 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 14w REG 8,1 54002329 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.870 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.873 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.874 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38155 msgr-work root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 14w REG 8,1 54002329 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38177 service root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38178 admin_soc root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38231 signal_ha root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38232 io_contex root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38233 io_contex root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38246 OpHistory root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.981 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.982 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:43.983 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38247 ceph_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:43.987 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:43.989 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:43.990 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:43.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:43.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:43.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:43.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:43.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38281 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38293 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38306 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38324 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38336 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38348 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38357 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.097 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.098 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.099 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.100 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.101 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.102 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.103 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.104 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.105 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38567 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38570 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38571 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38572 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38573 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38574 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38575 fn_anonym root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38633 rocksdb:l root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38636 rocksdb:l root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38638 rocksdb:l root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 38641 rocksdb:h root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.263 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40089 bstore_ai root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.271 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.272 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.273 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.274 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.275 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.276 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.277 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.278 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.279 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.281 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.282 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.283 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.284 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40090 bstore_di root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.285 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.286 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.287 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.288 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.290 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.291 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.292 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.294 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.295 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.296 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.297 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.298 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.299 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40795 bstore_ai root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.300 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.301 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.302 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.303 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.304 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.305 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.306 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.307 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.311 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.312 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.313 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.314 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 40796 bstore_di root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.315 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.316 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.317 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.318 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.319 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.320 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.321 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.322 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.323 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.324 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.325 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.326 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.328 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.329 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41208 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.330 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.331 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.332 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.333 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.334 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.335 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.337 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.338 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.339 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.340 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.341 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.342 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.343 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.344 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41209 cfin root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.345 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.346 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.349 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.350 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.351 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.352 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.353 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.354 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.355 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.356 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.357 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.358 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.359 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41210 bstore_kv root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.360 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.361 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.362 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.363 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.364 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.365 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.366 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.367 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.368 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.369 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.370 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.371 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.372 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.373 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41211 bstore_kv root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.374 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.376 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.377 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.378 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.379 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.380 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.381 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.382 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.383 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.384 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.385 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.386 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.387 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.388 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41212 bstore_me root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.389 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.390 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.391 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.392 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.393 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.394 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.395 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.396 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.397 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.398 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.399 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.400 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.401 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.402 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.403 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41432 ms_dispat root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.404 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.406 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.407 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.408 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.410 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.411 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.412 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.413 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.414 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.415 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.416 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.417 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.418 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41433 ms_local root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.419 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.420 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.421 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.422 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.423 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.424 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.425 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.426 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.427 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.428 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.429 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.430 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.431 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.432 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41434 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.434 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.435 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.436 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.437 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.438 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.439 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.441 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.442 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.443 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.444 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.445 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.446 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.447 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.448 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41435 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.449 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.450 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.451 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.452 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.453 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.454 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.455 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.456 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.457 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.458 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.459 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.460 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.461 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.462 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.463 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41436 ms_dispat root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.464 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.465 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.466 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.467 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.468 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.469 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.470 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.471 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.472 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.473 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.474 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.475 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.476 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.477 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.478 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41437 ms_local root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.480 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.481 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.482 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.484 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.485 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.486 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.487 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.488 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.489 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.490 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.491 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.493 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41438 ms_dispat root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.494 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.499 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.502 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.505 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.506 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.507 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.508 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41439 ms_local root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.509 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.510 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.511 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.512 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.513 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.514 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.516 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.517 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.518 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.519 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.521 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.522 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.523 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41440 ms_dispat root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.524 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.525 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.526 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.527 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.528 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.529 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.530 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.531 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.532 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.533 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.534 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.535 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.536 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.537 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.538 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41441 ms_local root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.539 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.540 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.541 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.542 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.543 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.544 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.545 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.546 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.547 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.548 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.549 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.550 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.551 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.552 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.553 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.554 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41442 ms_dispat root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.555 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.556 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.557 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.558 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.559 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.560 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.561 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.562 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.563 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.565 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.566 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.567 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.568 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.569 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41443 ms_local root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.570 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.571 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.572 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.573 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.574 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.575 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.576 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.577 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.578 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.579 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.580 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.581 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.582 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.583 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.584 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41444 ms_dispat root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.585 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.586 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.587 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.588 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.589 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.590 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.591 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.592 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.593 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.594 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.595 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.596 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.597 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.598 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.599 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41445 ms_local root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.601 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.602 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.603 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.604 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.605 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.606 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.608 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.609 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.610 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.611 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.613 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.614 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41446 ms_dispat root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.615 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.616 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.617 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.618 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.619 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.620 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.622 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.623 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.624 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.625 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.626 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.627 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.628 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.629 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41447 ms_local root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.630 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.631 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.632 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.635 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.636 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.638 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.639 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.640 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.642 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.643 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.644 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41448 fn_anonym root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.645 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.646 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.647 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.648 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.649 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.650 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.651 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.652 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.653 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.654 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.655 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.656 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.657 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.658 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41449 finisher root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.660 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.661 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.662 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.664 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.665 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.667 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.668 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.669 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.670 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.671 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.672 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.673 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.674 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41450 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.676 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.677 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.678 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.679 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.681 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.682 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 14w REG 8,1 54004929 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.683 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.684 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.685 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.686 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.687 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.688 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.689 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41451 safe_time root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.690 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.691 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.692 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.693 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.694 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.695 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.696 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.697 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.698 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.699 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.700 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.701 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.702 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.703 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.704 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41452 ceph-osd root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.705 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.706 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.707 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.708 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.709 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.710 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.712 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.713 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.714 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.716 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.717 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.718 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.719 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41453 osd_srv_a root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.720 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.721 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.722 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.723 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.724 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.725 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.727 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.729 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.730 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.733 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.734 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41454 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.735 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.736 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.737 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.738 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.739 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.740 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.741 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.742 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.743 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.744 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.745 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.746 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.747 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.748 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41455 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.749 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.750 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.751 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.752 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.753 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.754 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.755 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.756 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.757 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.758 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.759 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.760 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.761 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.762 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.763 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41456 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.764 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.765 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.766 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.767 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.768 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.769 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.770 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.771 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.772 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.773 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.774 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.775 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.776 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.777 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.778 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41457 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.779 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.780 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.781 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.782 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.783 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.784 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.785 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.786 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.787 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.788 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.789 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.790 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.791 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.792 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41458 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.793 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.796 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.798 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.800 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.801 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.802 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.803 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.804 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.806 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41459 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.807 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.808 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.809 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.810 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.811 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.812 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.813 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.814 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.815 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.816 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.818 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.820 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.821 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.822 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41460 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.823 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.824 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.825 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.826 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.827 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.828 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.829 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.830 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.831 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.832 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.833 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.834 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.835 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.836 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41461 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.837 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.838 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.839 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.840 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.841 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.842 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.844 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.845 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.846 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.847 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.848 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.849 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.850 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41462 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.851 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.852 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.853 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.854 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.855 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.856 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.857 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.858 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.859 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.860 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.861 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.862 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.863 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.865 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.866 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41463 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.877 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.878 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.879 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.880 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.881 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.882 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.883 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.884 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.885 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.886 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.887 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.888 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.890 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.891 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41464 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.892 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.893 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.894 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.895 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.896 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.897 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.898 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.899 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.900 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.901 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.903 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.904 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.905 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.906 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41465 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.907 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.908 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.909 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.913 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.914 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.916 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.917 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.918 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.919 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.920 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41466 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.921 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.922 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.923 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.924 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.925 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.928 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.929 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.930 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.931 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.932 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.933 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.934 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.935 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41467 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.936 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.937 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.938 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.939 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.940 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.941 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.942 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.943 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.944 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.945 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.947 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.948 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.949 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41468 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.950 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.951 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.952 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.953 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.954 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.955 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.956 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.957 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.958 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.959 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.960 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.961 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.962 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.963 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.964 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41469 tp_osd_tp root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root txt REG 8,1 39090728 51330 /usr/bin/ceph-osd 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 113624 664061 /usr/lib/rados-classes/libcls_rgw_gc.so.1.0.0 2023-11-04T01:50:44.965 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 1285744 664060 /usr/lib/rados-classes/libcls_rgw.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 43800 664064 /usr/lib/rados-classes/libcls_timeindex.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 68688 664046 /usr/lib/rados-classes/libcls_cas.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 216168 664049 /usr/lib/rados-classes/libcls_fifo.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 68400 664065 /usr/lib/rados-classes/libcls_user.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 84992 664057 /usr/lib/rados-classes/libcls_queue.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 35648 664050 /usr/lib/rados-classes/libcls_hello.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 39688 664047 /usr/lib/rados-classes/libcls_cephfs.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 117792 664045 /usr/lib/rados-classes/libcls_2pc_queue.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 806216 664059 /usr/lib/rados-classes/libcls_refcount.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 72688 664052 /usr/lib/rados-classes/libcls_lock.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 64384 664048 /usr/lib/rados-classes/libcls_cmpomap.so.1.0.0 2023-11-04T01:50:44.966 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 47920 664053 /usr/lib/rados-classes/libcls_log.so.1.0.0 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 80872 664051 /usr/lib/rados-classes/libcls_journal.so.1.0.0 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 396768 664058 /usr/lib/rados-classes/libcls_rbd.so.1.0.0 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 67736 50574 /usr/lib/x86_64-linux-gnu/liboath.so.0.1.3 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 27352 664055 /usr/lib/rados-classes/libcls_numops.so.1.0.0 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 68520 664056 /usr/lib/rados-classes/libcls_otp.so.1.0.0 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 35560 664066 /usr/lib/rados-classes/libcls_version.so.1.0.0 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 1372216 664037 /usr/lib/ceph/erasure-code/libec_lrc.so 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 335232 664033 /usr/lib/ceph/erasure-code/libec_jerasure.so 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root DEL REG 0,19 145561 /[aio] 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root DEL REG 0,19 142120 /[aio] 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 64464 664043 /usr/lib/ceph/extblkdev/libceph_ebd_vdo.so 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.967 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 31432 663992 /usr/lib/ceph/compressor/libceph_snappy.so.2.0.0 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.968 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.970 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 125152 8837 /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.3 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 35184 16894 /usr/lib/x86_64-linux-gnu/libsnappy.so.1.1.8 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 14456 12608 /usr/lib/x86_64-linux-gnu/libaio.so.1.0.1 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:44.971 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 0,14 12540 anon_inode:[io_uring] (stat: No such file or directory) 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 1w FIFO 0,13 0t0 144653 pipe 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 2w FIFO 0,13 0t0 144654 pipe 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 3r FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 4w FIFO 0,13 0t0 141856 pipe 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 6r FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 7w FIFO 0,13 0t0 141857 pipe 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.972 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 9r FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 10w FIFO 0,13 0t0 141858 pipe 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 12r FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 13w FIFO 0,13 0t0 141859 pipe 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 14w REG 8,1 54007529 673678 /var/log/ceph/ceph-osd.2.log 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 15uW REG 0,25 6 3609 /run/ceph/ceph-osd.2.pid 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 16r FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 17w FIFO 0,13 0t0 143660 pipe 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 18u unix 0xffff955a8c185940 0t0 143661 /var/run/ceph/ceph-osd.2.asok type=STREAM 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 19u IPv4 141889 0t0 TCP *:6821 (LISTEN) 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 20u IPv4 141913 0t0 TCP *:6823 (LISTEN) 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 21u IPv4 141939 0t0 TCP *:6825 (LISTEN) 2023-11-04T01:50:44.973 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 22u IPv4 141967 0t0 TCP *:6827 (LISTEN) 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 23u IPv4 141996 0t0 TCP *:6828 (LISTEN) 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 24u IPv4 142026 0t0 TCP *:6829 (LISTEN) 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 25u IPv4 142057 0t0 TCP *:6830 (LISTEN) 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 26u IPv4 142089 0t0 TCP *:6831 (LISTEN) 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 27r FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 28w FIFO 0,13 0t0 137896 pipe 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 29r FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 30w FIFO 0,13 0t0 137897 pipe 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 31u sock 0,8 0t0 140890 protocol: UDPv6 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 32r DIR 253,2 357 64 /var/lib/ceph/osd/ceph-2 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 33uW REG 253,2 37 69 /var/lib/ceph/osd/ceph-2/fsid 2023-11-04T01:50:44.974 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 34u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 35u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 36u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 37u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 38u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 39u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 40u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 41u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 42u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 43u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 44u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 45u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.975 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 46u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 47u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 48u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 49u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 50u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 51u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 52u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 53u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 54u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 55u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 56u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 57u REG 253,2 96636764160 70 /var/lib/ceph/osd/ceph-2/block 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 58u a_inode 0,14 0 12540 [io_uring] 2023-11-04T01:50:44.976 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 59u IPv4 143918 0t0 TCP smithi002.front.sepia.ceph.com:37504->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 60r FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 61w FIFO 0,13 0t0 140916 pipe 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 62r FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 63w FIFO 0,13 0t0 140917 pipe 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 64u IPv4 137915 0t0 TCP smithi002.front.sepia.ceph.com:47550->smithi002.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 65u IPv4 140919 0t0 TCP smithi002.front.sepia.ceph.com:55180->smithi002.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 66u IPv4 140920 0t0 TCP smithi002.front.sepia.ceph.com:43014->smithi090.front.sepia.ceph.com:6806 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 67u IPv4 137916 0t0 TCP smithi002.front.sepia.ceph.com:45898->smithi090.front.sepia.ceph.com:6828 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 68u IPv4 139099 0t0 TCP smithi002.front.sepia.ceph.com:40010->smithi090.front.sepia.ceph.com:6830 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 69u IPv4 140921 0t0 TCP smithi002.front.sepia.ceph.com:37858->smithi090.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 70u IPv4 137917 0t0 TCP smithi002.front.sepia.ceph.com:49298->smithi090.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 71u IPv4 139100 0t0 TCP smithi002.front.sepia.ceph.com:39516->smithi090.front.sepia.ceph.com:6804 (ESTABLISHED) 2023-11-04T01:50:44.977 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 72u IPv4 137918 0t0 TCP smithi002.front.sepia.ceph.com:39306->smithi090.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 73u IPv4 139101 0t0 TCP smithi002.front.sepia.ceph.com:37484->smithi090.front.sepia.ceph.com:6822 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 74u IPv4 137930 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:41454 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 75u IPv4 137933 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:43508 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 76u IPv4 139102 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52368 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 77u IPv4 139105 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37142 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 78u IPv4 143928 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37144 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 79u IPv4 137942 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52374 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 80u IPv4 137945 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52382 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 81u IPv4 137948 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37150 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 82u IPv4 137951 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi090.front.sepia.ceph.com:37160 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 83u IPv4 137954 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi090.front.sepia.ceph.com:52388 (ESTABLISHED) 2023-11-04T01:50:44.978 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 84u IPv4 137965 0t0 TCP smithi002.front.sepia.ceph.com:46914->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 85u IPv4 143931 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45652 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 86u IPv4 142135 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48794 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 87u IPv4 143936 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47224 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 88u IPv4 142138 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36172 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 89u IPv4 143937 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45654 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 90u IPv4 143938 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45666 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 91u IPv4 143939 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi090.front.sepia.ceph.com:45678 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 92u IPv4 145590 0t0 TCP smithi002.front.sepia.ceph.com:6830->smithi002.front.sepia.ceph.com:48806 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 93u IPv4 145593 0t0 TCP smithi002.front.sepia.ceph.com:6828->smithi002.front.sepia.ceph.com:36188 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 94u IPv4 143192 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47234 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 95u IPv4 142147 0t0 TCP smithi002.front.sepia.ceph.com:48974->smithi002.front.sepia.ceph.com:6824 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 96u IPv4 137985 0t0 TCP smithi002.front.sepia.ceph.com:36144->smithi002.front.sepia.ceph.com:6820 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 97u IPv4 140949 0t0 TCP smithi002.front.sepia.ceph.com:46196->smithi002.front.sepia.ceph.com:6814 (ESTABLISHED) 2023-11-04T01:50:44.979 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 98u IPv4 142148 0t0 TCP smithi002.front.sepia.ceph.com:36944->smithi002.front.sepia.ceph.com:6812 (ESTABLISHED) 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 99u IPv4 143198 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:47794 (ESTABLISHED) 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 100u IPv4 200477 0t0 TCP smithi002.front.sepia.ceph.com:6821->smithi090.front.sepia.ceph.com:44868 (ESTABLISHED) 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-osd 38132 41470 osd_srv_h root 101u IPv4 138012 0t0 TCP smithi002.front.sepia.ceph.com:6825->smithi002.front.sepia.ceph.com:47244 (ESTABLISHED) 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 41639 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 41639 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 41639 root txt unknown /proc/41639/exe 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 41735 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 41735 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 41735 root txt unknown /proc/41735/exe 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 41739 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 41739 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.980 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/4 41739 root txt unknown /proc/41739/exe 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 41876 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 41876 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 41876 root txt unknown /proc/41876/exe 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 41985 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 41985 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 41985 root txt unknown /proc/41985/exe 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 42032 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 42032 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 42032 root txt unknown /proc/42032/exe 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42067 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42067 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42067 root txt unknown /proc/42067/exe 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 42188 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.981 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 42188 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 42188 root txt unknown /proc/42188/exe 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 42365 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 42365 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/7 42365 root txt unknown /proc/42365/exe 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42455 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42455 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42455 root txt unknown /proc/42455/exe 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42475 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42475 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 42475 root txt unknown /proc/42475/exe 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 42532 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 42532 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.982 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 42532 root txt unknown /proc/42532/exe 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 42606 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 42606 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 42606 root txt unknown /proc/42606/exe 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 42689 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 42689 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 42689 root txt unknown /proc/42689/exe 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 42705 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 42705 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 42705 root txt unknown /proc/42705/exe 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 42828 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 42828 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 42828 root txt unknown /proc/42828/exe 2023-11-04T01:50:44.983 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 42938 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 42938 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 42938 root txt unknown /proc/42938/exe 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 42941 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 42941 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/3 42941 root txt unknown /proc/42941/exe 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 56823 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 56823 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/0 56823 root txt unknown /proc/56823/exe 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 57346 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 57346 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/2 57346 root txt unknown /proc/57346/exe 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58428 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.984 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58428 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58428 root txt unknown /proc/58428/exe 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58429 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58429 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58429 root txt unknown /proc/58429/exe 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58430 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58430 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/5 58430 root txt unknown /proc/58430/exe 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59516 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59516 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59516 root txt unknown /proc/59516/exe 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59517 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59517 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.985 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59517 root txt unknown /proc/59517/exe 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59518 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59518 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/1 59518 root txt unknown /proc/59518/exe 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.986 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:44.987 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.988 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 0r FIFO 0,13 0t0 204086 pipe 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 3r FIFO 0,13 0t0 201386 pipe 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 4w FIFO 0,13 0t0 201386 pipe 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 6u netlink 0t0 204091 AUDIT 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 59734 root 7u unix 0xffff955a91f0e600 0t0 204092 type=DGRAM 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:44.989 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root 0r FIFO 0,13 0t0 204086 pipe 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:44.990 INFO:teuthology.orchestra.run.smithi002.stdout:daemon-he 59736 root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.991 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.992 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:44.993 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:44.994 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:44.995 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:44.996 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:44.997 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:44.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:44.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.000 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.001 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.002 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59742 log root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.004 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.005 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.006 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.007 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.008 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.009 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59744 msgr-work root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.010 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.011 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.013 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.014 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.015 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.016 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59745 msgr-work root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.017 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.019 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.020 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.021 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.022 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.023 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59746 msgr-work root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.026 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.028 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.029 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59750 service root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.030 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.031 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.032 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.033 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.035 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59751 admin_soc root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.037 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.038 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.039 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.040 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.042 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59752 signal_ha root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.043 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.044 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.046 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.047 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.048 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59753 io_contex root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.049 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.050 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.051 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.052 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.053 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.054 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.055 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59754 io_contex root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.056 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.057 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.059 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.060 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.061 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.062 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59755 ms_dispat root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.063 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.064 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.066 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.067 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.068 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.069 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59756 ms_local root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.070 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.071 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.072 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.073 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.074 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.075 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59757 safe_time root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.076 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.077 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.079 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.080 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.081 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.082 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59758 safe_time root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.083 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.084 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.085 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.086 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.087 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.088 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59759 ceph-mds root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.089 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root txt REG 8,1 6267560 73829 /usr/bin/ceph-mds 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.090 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.091 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.092 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 63744 2646 /usr/lib/x86_64-linux-gnu/libunwind.so.8.0.1 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 244664 1523 /usr/lib/x86_64-linux-gnu/liblua5.3.so.0.0.0 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 303168 5182 /usr/lib/x86_64-linux-gnu/libtcmalloc.so.4.5.9 2023-11-04T01:50:45.093 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 0r CHR 1,3 0t0 5 /dev/null 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 1w FIFO 0,13 0t0 204087 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 2w FIFO 0,13 0t0 204088 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 3r FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 4w FIFO 0,13 0t0 203402 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 5u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 6r FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 7w FIFO 0,13 0t0 203403 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 8u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 9r FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 10w FIFO 0,13 0t0 203404 pipe 2023-11-04T01:50:45.094 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 11u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 12r FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 13w FIFO 0,13 0t0 203405 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 14w REG 8,1 4453515 678306 /var/log/ceph/ceph-mds.c.log 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 15uW REG 0,25 6 4325 /run/ceph/ceph-mds.c.pid 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 16r FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 17w FIFO 0,13 0t0 203408 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 18u unix 0xffff955a8c184400 0t0 203409 /var/run/ceph/ceph-mds.c.asok type=STREAM 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 19u IPv4 198597 0t0 TCP *:6834 (LISTEN) 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 20u IPv4 198633 0t0 TCP *:6835 (LISTEN) 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 21r FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 22w FIFO 0,13 0t0 203411 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 23r FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 24w FIFO 0,13 0t0 203412 pipe 2023-11-04T01:50:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 25r FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 26u IPv4 202199 0t0 TCP smithi002.front.sepia.ceph.com:57074->smithi002.front.sepia.ceph.com:3300 (ESTABLISHED) 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 27w FIFO 0,13 0t0 201395 pipe 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 28r FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 29w FIFO 0,13 0t0 201396 pipe 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-mds 59741 59782 safe_time root 30u IPv4 200579 0t0 TCP smithi002.front.sepia.ceph.com:56034->smithi090.front.sepia.ceph.com:6832 (ESTABLISHED) 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 60157 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 60157 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/u 60157 root txt unknown /proc/60157/exe 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu txt REG 8,1 1396520 886 /usr/bin/bash 2023-11-04T01:50:45.096 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu mem REG 8,1 200136 8423 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.3 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu 0r FIFO 0,13 0t0 205089 pipe 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60183 ubuntu 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:45.098 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:45.099 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 0r FIFO 0,13 0t0 205089 pipe 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 3r FIFO 0,13 0t0 207998 pipe 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 4w FIFO 0,13 0t0 207998 pipe 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:45.100 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 6u netlink 0t0 208007 AUDIT 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60185 root 7u unix 0xffff955a90db61c0 0t0 208008 type=DGRAM 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:45.102 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.103 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 0r FIFO 0,13 0t0 205089 pipe 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 3r FIFO 0,13 0t0 205102 pipe 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 4w FIFO 0,13 0t0 205102 pipe 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 6u sock 0,8 0t0 205112 protocol: NETLINK 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60188 root 7u sock 0,8 0t0 205113 protocol: UNIX 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:45.104 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root 0r FIFO 0,13 0t0 205089 pipe 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.105 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root 3r FIFO 0,13 0t0 202335 pipe 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60189 root 4w FIFO 0,13 0t0 202335 pipe 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.106 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.107 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.108 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.109 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.110 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.111 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.112 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.113 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.114 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.115 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.116 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.117 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60193 log root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.118 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.119 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.120 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.121 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.123 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.124 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60195 msgr-work root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.125 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.126 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.127 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.128 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.130 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60196 msgr-work root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.131 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.132 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.133 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.134 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.135 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.136 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60197 msgr-work root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.137 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.138 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.139 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.140 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.142 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60201 service root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.144 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.145 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.146 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.148 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60202 admin_soc root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.150 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.151 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.152 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.153 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.154 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.155 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60203 signal_ha root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.156 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.157 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.158 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.159 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.160 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.161 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60204 io_contex root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.162 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.163 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.165 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.166 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.167 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60205 io_contex root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.169 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.170 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.171 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.172 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.173 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60206 ceph_time root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.174 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.175 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.176 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.177 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.178 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.180 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60207 fn_anonym root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.181 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.182 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.183 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.184 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.186 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60208 fn_anonym root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.187 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.188 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.189 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.191 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.192 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60209 fn_anonym root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.193 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.194 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.195 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.196 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.197 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.198 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60210 fn_anonym root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.199 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.200 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.202 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.203 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.204 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60211 fn_anonym root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.205 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.206 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.207 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.208 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.209 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.210 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.211 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60212 safe_time root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.212 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.214 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.215 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.217 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60213 fn_anonym root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.218 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.219 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.220 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.221 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.222 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.223 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60214 flusher root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.224 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.225 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.226 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.227 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.228 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60215 ms_dispat root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.230 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.231 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.232 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.233 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.234 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.235 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60216 ms_local root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.236 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.237 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.238 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.239 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.240 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.241 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60217 safe_time root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.242 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.243 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.244 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.245 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.246 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.247 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60218 ceph-fuse root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.249 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.250 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.252 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.253 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.254 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60220 ceph-fuse root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.255 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.256 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.257 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.258 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.259 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60222 ceph-fuse root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root cwd DIR 8,1 4096 655472 /home/ubuntu/cephtest 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.261 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root txt REG 8,1 2411720 73794 /usr/bin/ceph-fuse 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 51896 5507 /usr/lib/x86_64-linux-gnu/liblttng-ust-common.so.1.0.0 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 51568 50433 /usr/lib/x86_64-linux-gnu/liblttng-ust-tracepoint.so.1.0.0 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 47688 718 /usr/lib/x86_64-linux-gnu/libffi.so.8.1.0 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 92312 811 /usr/lib/x86_64-linux-gnu/libtasn1.so.6.6.2 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 1285888 821 /usr/lib/x86_64-linux-gnu/libp11-kit.so.0.3.0 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 137560 16841 /usr/lib/x86_64-linux-gnu/libbrotlicommon.so.1.0.9 2023-11-04T01:50:45.262 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 105376 20591 /usr/lib/x86_64-linux-gnu/libsasl2.so.2.0.25 2023-11-04T01:50:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:50:45.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.264 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 526896 794 /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.1 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 281000 977 /usr/lib/x86_64-linux-gnu/libnettle.so.8.4 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 289800 594 /usr/lib/x86_64-linux-gnu/libhogweed.so.6.4 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 2000320 795 /usr/lib/x86_64-linux-gnu/libgnutls.so.30.31.0 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 1743016 721 /usr/lib/x86_64-linux-gnu/libunistring.so.2.2.0 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 51512 27605 /usr/lib/x86_64-linux-gnu/libbrotlidec.so.1.0.9 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 841808 646 /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.8 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 63992 2956 /usr/lib/x86_64-linux-gnu/liblber-2.5.so.0.1.8 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 376512 16064 /usr/lib/x86_64-linux-gnu/libldap-2.5.so.0.1.8 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.265 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 667864 673664 /usr/lib/x86_64-linux-gnu/libssl.so.3 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 75768 74580 /usr/lib/x86_64-linux-gnu/libpsl.so.5.3.2 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 441944 16075 /usr/lib/x86_64-linux-gnu/libssh.so.4.8.7 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 121864 15508 /usr/lib/x86_64-linux-gnu/librtmp.so.1 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 129096 730 /usr/lib/x86_64-linux-gnu/libidn2.so.0.3.7 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 166256 15296 /usr/lib/x86_64-linux-gnu/libnghttp2.so.14.20.1 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 138136 26992 /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 524448 13345 /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 620728 50488 /usr/lib/x86_64-linux-gnu/libthrift-0.16.0.so 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 673560 16077 /usr/lib/x86_64-linux-gnu/libcurl.so.4.7.0 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 122144 3645 /usr/lib/x86_64-linux-gnu/librdmacm.so.1.3.39.0 2023-11-04T01:50:45.266 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 142112 5024 /usr/lib/x86_64-linux-gnu/libibverbs.so.1.14.39.0 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 166240 11009 /usr/lib/x86_64-linux-gnu/libudev.so.1.7.2 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 4451632 673663 /usr/lib/x86_64-linux-gnu/libcrypto.so.3 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 220192 1156 /usr/lib/x86_64-linux-gnu/libblkid.so.1.1.0 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 125488 805 /usr/lib/x86_64-linux-gnu/libgcc_s.so.1 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 2252096 806 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.30 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 9469840 663826 /usr/lib/ceph/libceph-common.so.2 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 260376 4930 /usr/lib/x86_64-linux-gnu/libfuse.so.2.9.9 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.267 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 0r FIFO 0,13 0t0 202336 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 1w FIFO 0,13 0t0 205090 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 2w FIFO 0,13 0t0 205091 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 3w REG 8,1 305844 678890 /var/log/ceph/ceph-client.0.60192.log 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 4u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 5r FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 6w FIFO 0,13 0t0 201526 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 7u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 8r FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 9w FIFO 0,13 0t0 201527 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 10u a_inode 0,14 0 12540 [eventpoll] 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 11r FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 12w FIFO 0,13 0t0 201528 pipe 2023-11-04T01:50:45.268 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 13r FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 14w FIFO 0,13 0t0 202342 pipe 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 15u sock 0,8 0t0 202343 protocol: UNIX-STREAM 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 16r FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 17w FIFO 0,13 0t0 202344 pipe 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 18r FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 19w FIFO 0,13 0t0 202345 pipe 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 20u sock 0,8 0t0 204572 protocol: TCP 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 21u sock 0,8 0t0 203602 protocol: TCP 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 22u sock 0,8 0t0 208014 protocol: TCP 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 23u CHR 10,229 0t0 86 /dev/fuse 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 24r FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.269 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 25w FIFO 0,13 0t0 202352 pipe 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 26r FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 27w FIFO 0,13 0t0 206927 pipe 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 29r FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-fuse 60192 60292 ceph-fuse root 30w FIFO 0,13 0t0 204298 pipe 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu txt REG 8,1 1396520 886 /usr/bin/bash 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu mem REG 8,1 200136 8423 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.3 2023-11-04T01:50:45.270 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu 0r FIFO 0,13 0t0 206115 pipe 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu 1w FIFO 0,13 0t0 206116 pipe 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60375 ubuntu 2w FIFO 0,13 0t0 206117 pipe 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu cwd DIR 0,45 0 1 /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu txt REG 8,1 68096 8052 /usr/bin/mkdir 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.271 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu 0r FIFO 0,13 0t0 206115 pipe 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu 1w FIFO 0,13 0t0 206116 pipe 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir 60376 ubuntu 2w FIFO 0,13 0t0 206117 pipe 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 60526 root cwd DIR 8,1 4096 2 / 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 60526 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:kworker/6 60526 root txt unknown /proc/60526/exe 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu txt REG 8,1 1396520 886 /usr/bin/bash 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu mem REG 8,1 200136 8423 /usr/lib/x86_64-linux-gnu/libtinfo.so.6.3 2023-11-04T01:50:45.272 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu 0r FIFO 0,13 0t0 206345 pipe 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu 1w FIFO 0,13 0t0 206346 pipe 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:bash 60948 ubuntu 2w FIFO 0,13 0t0 206347 pipe 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root txt REG 8,1 232416 12806 /usr/bin/sudo 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 472008 9123 /usr/lib/x86_64-linux-gnu/security/pam_systemd.so 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 39024 9015 /usr/lib/x86_64-linux-gnu/libcap.so.2.44 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 18528 650 /usr/lib/x86_64-linux-gnu/libpam_misc.so.0.82.1 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 14328 23146 /usr/lib/x86_64-linux-gnu/security/pam_umask.so 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 14328 841 /usr/lib/x86_64-linux-gnu/security/pam_cap.so 2023-11-04T01:50:45.273 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 309600 1358 /usr/lib/x86_64-linux-gnu/libnss_systemd.so.2 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 93280 17230 /usr/lib/x86_64-linux-gnu/libnsl.so.2.0.1 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 198664 2137 /usr/lib/x86_64-linux-gnu/libcrypt.so.1.1.0 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 14328 14485 /usr/lib/x86_64-linux-gnu/security/pam_permit.so 2023-11-04T01:50:45.274 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 13960 8913 /usr/lib/x86_64-linux-gnu/security/pam_deny.so 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 59464 23148 /usr/lib/x86_64-linux-gnu/security/pam_unix.so 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 18424 8915 /usr/lib/x86_64-linux-gnu/security/pam_env.so 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 67736 629 /usr/lib/x86_64-linux-gnu/libpam.so.0.85.1 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 516992 95600 /usr/libexec/sudo/sudoers.so 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 27072 1559 /usr/lib/x86_64-linux-gnu/libcap-ng.so.0.0.0 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 130040 95595 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:45.275 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 133200 775 /usr/lib/x86_64-linux-gnu/libaudit.so.1.0.0 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 26696 14476 /usr/lib/x86_64-linux-gnu/security/pam_limits.so 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 0r FIFO 0,13 0t0 206345 pipe 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 1w FIFO 0,13 0t0 206346 pipe 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 2w FIFO 0,13 0t0 206347 pipe 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 3r FIFO 0,13 0t0 202611 pipe 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 4w FIFO 0,13 0t0 202611 pipe 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 5r REG 8,1 1698 9228 /etc/sudoers 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 6u netlink 0t0 202620 AUDIT 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:sudo 60949 root 7u unix 0xffff955a8b6b8cc0 0t0 202621 type=DGRAM 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.276 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root txt REG 8,1 5921160 4454 /usr/bin/python3.10 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 170456 595 /usr/lib/x86_64-linux-gnu/liblzma.so.5.2.5 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 74848 12212 /usr/lib/x86_64-linux-gnu/libbz2.so.1.0.4 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 45240 50087 /usr/lib/python3.10/lib-dynload/_lzma.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 32120 50070 /usr/lib/python3.10/lib-dynload/_bz2.cpython-310-x86_64-linux-gnu.so 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 18704 29062 /usr/lib/x86_64-linux-gnu/gconv/ISO8859-1.so 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 108936 12946 /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 194872 8481 /usr/lib/x86_64-linux-gnu/libexpat.so.1.8.7 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 940560 11166 /usr/lib/x86_64-linux-gnu/libm.so.6 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 27002 29118 /usr/lib/x86_64-linux-gnu/gconv/gconv-modules.cache 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.277 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root 0r FIFO 0,13 0t0 206345 pipe 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root 1w FIFO 0,13 0t0 206346 pipe 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root 2w FIFO 0,13 0t0 206347 pipe 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root 3r FIFO 0,13 0t0 204669 pipe 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root 4w FIFO 0,13 0t0 204669 pipe 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:stdin-kil 60950 root 6w FIFO 0,13 0t0 204670 pipe 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root txt REG 8,1 167544 14991 /usr/bin/lsof 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.278 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root 0r FIFO 0,13 0t0 204670 pipe 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root 1w FIFO 0,13 0t0 206346 pipe 2023-11-04T01:50:45.279 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root 2w FIFO 0,13 0t0 206347 pipe 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root 3r DIR 0,23 0 1 /proc 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root 4r DIR 0,23 0 209039 /proc/60951/fd 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root 5w FIFO 0,13 0t0 209051 pipe 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60951 root 6r FIFO 0,13 0t0 209052 pipe 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root cwd DIR 8,1 4096 6935 /home/ubuntu 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root rtd DIR 8,1 4096 2 / 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root txt REG 8,1 167544 14991 /usr/bin/lsof 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 6039648 4922 /usr/lib/locale/locale-archive 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 68552 27621 /usr/lib/x86_64-linux-gnu/libresolv.so.2 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 22600 499 /usr/lib/x86_64-linux-gnu/libkeyutils.so.1.9 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 52080 11612 /usr/lib/x86_64-linux-gnu/libkrb5support.so.0.1 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 18504 16447 /usr/lib/x86_64-linux-gnu/libcom_err.so.2.1 2023-11-04T01:50:45.280 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 182928 2341 /usr/lib/x86_64-linux-gnu/libk5crypto.so.3.1 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 828000 9998 /usr/lib/x86_64-linux-gnu/libkrb5.so.3.3 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 613064 813 /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.10.4 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 338712 15290 /usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2.2 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 2216304 8857 /usr/lib/x86_64-linux-gnu/libc.so.6 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 166280 834 /usr/lib/x86_64-linux-gnu/libselinux.so.1 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 182912 17184 /usr/lib/x86_64-linux-gnu/libtirpc.so.3.0.0 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root mem REG 8,1 240936 8851 /usr/lib/x86_64-linux-gnu/ld-linux-x86-64.so.2 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root 4r FIFO 0,13 0t0 209051 pipe 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:lsof 60952 root 7w FIFO 0,13 0t0 209052 pipe 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:root 2 0.0 0.0 0 0 ? S 01:25 0:00 [kthreadd] 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:root 3 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [rcu_gp] 2023-11-04T01:50:45.281 INFO:teuthology.orchestra.run.smithi002.stdout:root 4 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [rcu_par_gp] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 5 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [slub_flushwq] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 6 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [netns] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 8 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/0:0H-events_highpri] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 10 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [mm_percpu_wq] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 11 0.0 0.0 0 0 ? S 01:25 0:00 \_ [rcu_tasks_rude_] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 12 0.0 0.0 0 0 ? S 01:25 0:00 \_ [rcu_tasks_trace] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 13 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/0] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 14 0.0 0.0 0 0 ? I 01:25 0:01 \_ [rcu_sched] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 15 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/0] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 16 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/0] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 18 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/0] 2023-11-04T01:50:45.282 INFO:teuthology.orchestra.run.smithi002.stdout:root 19 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/1] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 20 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/1] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 21 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/1] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 22 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/1] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 24 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/1:0H-events_highpri] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 25 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/2] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 26 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/2] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 27 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/2] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 28 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/2] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 30 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/2:0H-events_highpri] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 31 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/3] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 32 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/3] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 33 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/3] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 34 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/3] 2023-11-04T01:50:45.283 INFO:teuthology.orchestra.run.smithi002.stdout:root 36 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/3:0H-events_highpri] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 37 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/4] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 38 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/4] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 39 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/4] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 40 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/4] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 42 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/4:0H-events_highpri] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 43 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/5] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 44 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/5] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 45 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/5] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 46 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/5] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 48 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/5:0H-events_highpri] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 49 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/6] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 50 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/6] 2023-11-04T01:50:45.284 INFO:teuthology.orchestra.run.smithi002.stdout:root 51 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/6] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 52 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/6] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 54 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/6:0H-events_highpri] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 55 0.0 0.0 0 0 ? S 01:25 0:00 \_ [cpuhp/7] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 56 0.0 0.0 0 0 ? S 01:25 0:00 \_ [idle_inject/7] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 57 0.0 0.0 0 0 ? S 01:25 0:00 \_ [migration/7] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 58 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ksoftirqd/7] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 60 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/7:0H-events_highpri] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 61 0.0 0.0 0 0 ? S 01:25 0:00 \_ [kdevtmpfs] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 62 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [inet_frag_wq] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 63 0.0 0.0 0 0 ? S 01:25 0:00 \_ [kauditd] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 64 0.0 0.0 0 0 ? S 01:25 0:00 \_ [khungtaskd] 2023-11-04T01:50:45.285 INFO:teuthology.orchestra.run.smithi002.stdout:root 65 0.0 0.0 0 0 ? S 01:25 0:00 \_ [oom_reaper] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 66 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [writeback] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 67 0.0 0.0 0 0 ? S 01:25 0:00 \_ [kcompactd0] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 68 0.0 0.0 0 0 ? SN 01:25 0:00 \_ [ksmd] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 69 0.0 0.0 0 0 ? SN 01:25 0:00 \_ [khugepaged] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 116 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kintegrityd] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 117 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kblockd] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 118 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [blkcg_punt_bio] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 119 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [tpm_dev_wq] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 120 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ata_sff] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 121 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [md] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 122 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [edac-poller] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 123 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [devfreq_wq] 2023-11-04T01:50:45.286 INFO:teuthology.orchestra.run.smithi002.stdout:root 124 0.0 0.0 0 0 ? S 01:25 0:00 \_ [watchdogd] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 126 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/0:1H-xfs-log/dm-4] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 134 0.0 0.0 0 0 ? S 01:25 0:00 \_ [kswapd0] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 135 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ecryptfs-kthrea] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 137 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kthrotld] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 138 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [acpi_thermal_pm] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 141 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [vfio-irqfd-clea] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 142 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [mld] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 143 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ipv6_addrconf] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 152 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kstrp] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 157 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [zswap-shrink] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 158 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/u17:0-xprtiod] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 163 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [charger_manager] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 186 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/7:1H-kblockd] 2023-11-04T01:50:45.287 INFO:teuthology.orchestra.run.smithi002.stdout:root 207 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/1:1H-xfs-log/dm-4] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 218 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [nvme-wq] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 219 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [nvme-reset-wq] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 220 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [nvme-delete-wq] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 221 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_0] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 222 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_0] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 223 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_1] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 224 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_1] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 225 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_2] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 226 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_2] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 228 0.0 0.0 0 0 ? I 01:25 0:00 \_ [kworker/u16:4-events_power_efficient] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 229 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_3] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 230 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_3] 2023-11-04T01:50:45.288 INFO:teuthology.orchestra.run.smithi002.stdout:root 231 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ixgbe] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 242 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/4:1H-kblockd] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 244 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/6:1H-kblockd] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 246 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/3:1H-kblockd] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 252 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/5:1H-kblockd] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 253 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/2:1H-xfs-log/dm-3] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 262 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_4] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 263 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_4] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 264 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_5] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 265 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_5] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 266 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_6] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 267 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_6] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 268 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_7] 2023-11-04T01:50:45.289 INFO:teuthology.orchestra.run.smithi002.stdout:root 269 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_7] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 270 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_8] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 271 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_8] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 272 0.0 0.0 0 0 ? S 01:25 0:00 \_ [scsi_eh_9] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 273 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [scsi_tmf_9] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 276 0.0 0.0 0 0 ? I 01:25 0:00 \_ [kworker/u16:9-flush-253:0] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 309 0.0 0.0 0 0 ? S 01:25 0:00 \_ [jbd2/sda1-8] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 310 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ext4-rsv-conver] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 358 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [rpciod] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 359 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [xprtiod] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 386 0.0 0.0 0 0 ? S 01:25 0:00 \_ [ext4lazyinit] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 389 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [iscsi_eh] 2023-11-04T01:50:45.290 INFO:teuthology.orchestra.run.smithi002.stdout:root 390 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [iscsi_conn_clea] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 484 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ipmi-msghandler] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 541 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [cryptd] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 543 0.0 0.0 0 0 ? SN 01:25 0:00 \_ [kipmi0] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 985 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [kworker/u17:1] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 988 0.0 0.0 0 0 ? S 01:25 0:00 \_ [lockd] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 991 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ib-comp-wq] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 992 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ib-comp-unb-wq] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 993 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ib_mcast] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 994 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [ib_nl_sa_wq] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 997 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 998 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 999 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.291 INFO:teuthology.orchestra.run.smithi002.stdout:root 1000 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 1001 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 1002 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 1003 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 1004 0.0 0.0 0 0 ? S 01:25 0:00 \_ [nfsd] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 1005 0.0 0.0 0 0 ? I< 01:25 0:00 \_ [rdma_cm] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 12218 0.0 0.0 0 0 ? I 01:31 0:00 \_ [kworker/u16:0-flush-8:0] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 16585 0.0 0.0 0 0 ? I 01:34 0:00 \_ [kworker/u16:2-flush-253:0] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 16959 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [kdmflush] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 16991 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [kdmflush] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 17023 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [kdmflush] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 17055 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [kdmflush] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 17087 0.0 0.0 0 0 ? I< 01:34 0:00 \_ [kdmflush] 2023-11-04T01:50:45.292 INFO:teuthology.orchestra.run.smithi002.stdout:root 17285 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfsalloc] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17286 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs_mru_cache] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17287 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-buf/dm-4] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17288 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-conv/dm-4] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17289 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17290 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17291 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17292 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-log/dm-4] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17293 0.0 0.0 0 0 ? I< 01:35 0:00 \_ [xfs-cil/dm-4] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 17294 0.0 0.0 0 0 ? S 01:35 0:00 \_ [xfsaild/dm-4] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 33241 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-buf/dm-0] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 33242 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-conv/dm-0] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 33243 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:50:45.293 INFO:teuthology.orchestra.run.smithi002.stdout:root 33244 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33245 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33246 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-log/dm-0] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33247 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-cil/dm-0] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33248 0.0 0.0 0 0 ? S 01:41 0:00 \_ [xfsaild/dm-0] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33259 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-buf/dm-1] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33260 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-conv/dm-1] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33261 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33262 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33263 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33264 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-log/dm-1] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33265 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-cil/dm-1] 2023-11-04T01:50:45.294 INFO:teuthology.orchestra.run.smithi002.stdout:root 33266 0.0 0.0 0 0 ? S 01:41 0:00 \_ [xfsaild/dm-1] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33277 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-buf/dm-2] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33278 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-conv/dm-2] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33279 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33280 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33281 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33282 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-log/dm-2] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33283 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-cil/dm-2] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33284 0.0 0.0 0 0 ? S 01:41 0:00 \_ [xfsaild/dm-2] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33295 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-buf/dm-3] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33296 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-conv/dm-3] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33297 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-reclaim/dm-] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33298 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-blockgc/dm-] 2023-11-04T01:50:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:root 33299 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-inodegc/dm-] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 33300 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-log/dm-3] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 33301 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [xfs-cil/dm-3] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 33302 0.0 0.0 0 0 ? S 01:41 0:00 \_ [xfsaild/dm-3] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 33317 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [dio/dm-0] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 34458 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [dio/dm-1] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 35599 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [dio/dm-2] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 36740 0.0 0.0 0 0 ? I< 01:41 0:00 \_ [dio/dm-3] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 41639 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/5:12-events] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 41735 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/4:17-dio/dm-3] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 41739 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/4:19-events] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 41876 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/6:70-events] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 41985 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/2:71-mm_percpu_wq] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 42032 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/7:45-mm_percpu_wq] 2023-11-04T01:50:45.296 INFO:teuthology.orchestra.run.smithi002.stdout:root 42067 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/0:7-xfs-sync/dm-0] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42188 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/5:41-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42365 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/7:170-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42455 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/0:87-mm_percpu_wq] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42475 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/0:107-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42532 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/2:125-mm_percpu_wq] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42606 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/2:199-xfs-sync/dm-3] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42689 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/1:109-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42705 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/1:125-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42828 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/6:197-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42938 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/3:184-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 42941 0.0 0.0 0 0 ? I 01:42 0:00 \_ [kworker/3:187-events] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 56823 0.0 0.0 0 0 ? I 01:47 0:00 \_ [kworker/0:0-xfs-sync/dm-0] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 57346 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/2:0] 2023-11-04T01:50:45.297 INFO:teuthology.orchestra.run.smithi002.stdout:root 58428 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/5:0-events] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 58429 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/5:1] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 58430 0.0 0.0 0 0 ? I 01:48 0:00 \_ [kworker/5:2-events] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 59516 0.0 0.0 0 0 ? I 01:49 0:00 \_ [kworker/1:0-events] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 59517 0.0 0.0 0 0 ? I 01:49 0:00 \_ [kworker/1:1] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 59518 0.0 0.0 0 0 ? I 01:49 0:00 \_ [kworker/1:2-rcu_gp] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 60157 0.0 0.0 0 0 ? I 01:50 0:00 \_ [kworker/u16:1-flush-253:2] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 60526 0.0 0.0 0 0 ? I 01:50 0:00 \_ [kworker/6:0-events] 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 1 0.7 0.0 167684 13216 ? Ss 01:25 0:11 /sbin/init 2023-11-04T01:50:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:root 357 0.1 0.0 57064 27332 ? S stdin-killer -- python3 -c ' 2023-11-04T01:50:45.305 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-04T01:50:45.305 DEBUG:teuthology.orchestra.run.smithi002:> path = "/sys/fs/fuse/connections/45/abort" 2023-11-04T01:50:45.305 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists(path): 2023-11-04T01:50:45.305 DEBUG:teuthology.orchestra.run.smithi002:> open(path, "w").write("1") 2023-11-04T01:50:45.305 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-04T01:50:45.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:50:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-04T01:50:45.387 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2023-11-04T01:50:45.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:50:45.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2023-11-04T01:50:45.439 INFO:teuthology.orchestra.run.smithi002.stderr:mkdir: cannot create directory 'd1/dir/.snap/s33': Software caused connection abort 2023-11-04T01:50:45.441 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T01:50:46.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~27s 2023-11-04T01:50:52.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~38s 2023-11-04T01:50:55.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:55.398 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:50:59.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~44s 2023-11-04T01:51:06.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~51s 2023-11-04T01:51:12.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~58s 2023-11-04T01:51:19.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~64s 2023-11-04T01:51:25.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:25.465 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:26.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~71s 2023-11-04T01:51:32.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~77s 2023-11-04T01:51:39.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~84s 2023-11-04T01:51:45.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~91s 2023-11-04T01:51:52.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~97s 2023-11-04T01:51:55.509 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:55.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:51:59.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~104s 2023-11-04T01:52:05.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~111s 2023-11-04T01:52:12.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~117s 2023-11-04T01:52:18.923 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~124s 2023-11-04T01:52:25.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2023-11-04T01:52:25.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:25.567 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:32.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~137s 2023-11-04T01:52:38.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~144s 2023-11-04T01:52:45.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2023-11-04T01:52:51.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~157s 2023-11-04T01:52:55.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:55.614 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:52:58.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~163s 2023-11-04T01:53:05.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~170s 2023-11-04T01:53:11.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~177s 2023-11-04T01:53:18.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~183s 2023-11-04T01:53:25.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~190s 2023-11-04T01:53:25.667 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:25.671 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:31.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~196s 2023-11-04T01:53:38.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~203s 2023-11-04T01:53:44.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~210s 2023-11-04T01:53:51.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~216s 2023-11-04T01:53:55.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:55.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:53:58.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~223s 2023-11-04T01:54:04.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~230s 2023-11-04T01:54:11.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~236s 2023-11-04T01:54:17.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~243s 2023-11-04T01:54:24.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~249s 2023-11-04T01:54:25.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:25.781 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:31.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~256s 2023-11-04T01:54:37.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~263s 2023-11-04T01:54:44.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~269s 2023-11-04T01:54:50.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~276s 2023-11-04T01:54:55.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:55.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:54:57.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~282s 2023-11-04T01:55:04.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~289s 2023-11-04T01:55:10.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~296s 2023-11-04T01:55:17.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~302s 2023-11-04T01:55:17.443 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-04T01:55:17.443 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:55:17.443 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:17.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:55:17.451 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi002.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-04T01:55:17.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:55:17.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:17.451 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:55:17.499 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:55:17.499 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:17.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:55:17.547 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi002.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-04T01:55:17.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:55:17.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:17.547 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:55:17.594 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:55:17.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:17.595 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:55:17.595 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:17.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:55:17.602 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-04T01:55:17.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:55:17.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:17.602 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:55:17.648 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:55:17.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:17.649 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:55:17.649 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:55:17.697 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:55:17.697 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi090.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-04T01:55:17.697 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:55:17.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:17.697 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:55:17.744 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:55:17.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:19.356 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-04T01:55:19.356 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-04T01:55:19.356 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-04T01:55:19.356 INFO:tasks.ceph.osd.3:Sent signal 15 2023-11-04T01:55:19.357 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-04T01:55:19.357 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-04T01:55:19.357 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-04T01:55:19.357 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-04T01:55:19.358 INFO:tasks.ceph.mds.c:Sent signal 15 2023-11-04T01:55:19.358 INFO:tasks.ceph.mds.b:Sent signal 15 2023-11-04T01:55:19.358 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-04T01:55:19.358 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-04T01:55:19.358 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-04T01:55:19.359 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-04T01:55:19.359 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-04T01:55:19.359 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-04T01:55:19.360 INFO:tasks.ceph.osd.4.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f4dffe7c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 38442) UID: 0 2023-11-04T01:55:19.360 INFO:tasks.ceph.osd.4.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f4dffe7c640 -1 osd.4 112 *** Got signal Terminated *** 2023-11-04T01:55:19.360 INFO:tasks.ceph.osd.4.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f4dffe7c640 -1 osd.4 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.360 INFO:tasks.ceph.osd.5.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f3f5cee5640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 38444) UID: 0 2023-11-04T01:55:19.360 INFO:tasks.ceph.osd.5.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f3f5cee5640 -1 osd.5 112 *** Got signal Terminated *** 2023-11-04T01:55:19.361 INFO:tasks.ceph.osd.5.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f3f5cee5640 -1 osd.5 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.361 INFO:tasks.ceph.osd.6.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f468c92e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 38445) UID: 0 2023-11-04T01:55:19.361 INFO:tasks.ceph.osd.6.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f468c92e640 -1 osd.6 112 *** Got signal Terminated *** 2023-11-04T01:55:19.361 INFO:tasks.ceph.osd.6.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f468c92e640 -1 osd.6 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.361 INFO:tasks.ceph.osd.7.smithi090.stderr:2023-11-04T01:55:19.356+0000 7fbceb024640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 38447) UID: 0 2023-11-04T01:55:19.362 INFO:tasks.ceph.osd.7.smithi090.stderr:2023-11-04T01:55:19.356+0000 7fbceb024640 -1 osd.7 112 *** Got signal Terminated *** 2023-11-04T01:55:19.362 INFO:tasks.ceph.osd.7.smithi090.stderr:2023-11-04T01:55:19.356+0000 7fbceb024640 -1 osd.7 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.362 INFO:tasks.ceph.mds.b.smithi090.stderr:2023-11-04T01:55:19.356+0000 7ffaa2f36640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 44038) UID: 0 2023-11-04T01:55:19.362 INFO:tasks.ceph.mds.b.smithi090.stderr:2023-11-04T01:55:19.356+0000 7ffaa2f36640 -1 mds.b *** got signal Terminated *** 2023-11-04T01:55:19.362 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f76bf387640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 44284) UID: 0 2023-11-04T01:55:19.363 INFO:tasks.ceph.mds.d.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f76bf387640 -1 mds.d *** got signal Terminated *** 2023-11-04T01:55:19.363 INFO:tasks.ceph.mon.b.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f90b7028640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 38128) UID: 0 2023-11-04T01:55:19.363 INFO:tasks.ceph.mon.b.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f90b7028640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:55:19.363 INFO:tasks.ceph.mon.c.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f999c94b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 38131) UID: 0 2023-11-04T01:55:19.363 INFO:tasks.ceph.mon.c.smithi090.stderr:2023-11-04T01:55:19.356+0000 7f999c94b640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-04T01:55:19.364 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:55:19.360+0000 7fdc9dd10640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 38133) UID: 0 2023-11-04T01:55:19.364 INFO:tasks.ceph.mgr.x.smithi090.stderr:2023-11-04T01:55:19.360+0000 7fdc9dd10640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-11-04T01:55:19.364 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f541b047640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 38117) UID: 0 2023-11-04T01:55:19.364 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f541b047640 -1 osd.0 112 *** Got signal Terminated *** 2023-11-04T01:55:19.364 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f541b047640 -1 osd.0 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.365 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-04T01:55:19.361+0000 7ffa2ea1c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 38119) UID: 0 2023-11-04T01:55:19.365 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-04T01:55:19.361+0000 7ffa2ea1c640 -1 osd.1 112 *** Got signal Terminated *** 2023-11-04T01:55:19.365 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-04T01:55:19.361+0000 7ffa2ea1c640 -1 osd.1 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.365 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f214aa4c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 38123) UID: 0 2023-11-04T01:55:19.365 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f214aa4c640 -1 osd.2 112 *** Got signal Terminated *** 2023-11-04T01:55:19.366 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f214aa4c640 -1 osd.2 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.366 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-04T01:55:19.361+0000 7fb0560f4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 38121) UID: 0 2023-11-04T01:55:19.366 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-04T01:55:19.361+0000 7fb0560f4640 -1 osd.3 112 *** Got signal Terminated *** 2023-11-04T01:55:19.366 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-04T01:55:19.361+0000 7fb0560f4640 -1 osd.3 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-04T01:55:19.366 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:55:19.361+0000 7ff162ebe640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 59736) UID: 0 2023-11-04T01:55:19.366 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-04T01:55:19.361+0000 7ff162ebe640 -1 mds.c *** got signal Terminated *** 2023-11-04T01:55:19.367 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f4ba0283640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 38012) UID: 0 2023-11-04T01:55:19.367 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-04T01:55:19.361+0000 7f4ba0283640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-04T01:55:19.561 INFO:tasks.ceph.mgr.y.smithi002.stderr:daemon-helper: command crashed with signal 15 2023-11-04T01:55:25.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:25.886 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:33.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-04T01:55:33 stdin-killer ERROR: timeout expired: sending signal 9 to command and myself 2023-11-04T01:55:33.105 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:bash: line 1: 60185 Killed ( cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage stdin-killer --timeout=300 --signal=9 -- ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 ) 2023-11-04T01:55:38.306 DEBUG:teuthology.orchestra.run:got remote process result: 137 2023-11-04T01:55:38.307 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:55:38.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:55:38.307 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:55:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:55:38.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:55:38.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:55:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c24184640 1 Processor -- start 2023-11-04T01:55:38.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c24184640 1 -- start start 2023-11-04T01:55:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c24184640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 0x7f0c1c06a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c24184640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c1c15a020 2023-11-04T01:55:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c24184640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15a400 con 0x7f0c1c072040 2023-11-04T01:55:38.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c24184640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c1c0c9f10 2023-11-04T01:55:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c1c15a020 legacy=0x7f0c1c071930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 msgr2=0x7f0c1c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 0x7f0c1c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:38.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.493+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c1c0cdf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.697+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c1c15a020 legacy=0x7f0c1c071930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.697+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c1c0cdf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.697+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 msgr2=0x7f0c1c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:38.697+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 0x7f0c1c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.101+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c1c15a020 legacy=0x7f0c1c071930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.101+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 msgr2=0x7f0c1c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:39.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.101+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c1c0cdf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.101+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 0x7f0c1c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.905+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c1c15a020 legacy=0x7f0c1c071930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:39.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.905+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 msgr2=0x7f0c1c06a130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.905+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c1c0cdf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:39.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:39.905+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 0x7f0c1c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 msgr2=0x7f0c1c06a130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c1c0c9f10 0x7f0c1c06a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c1c0cdf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c1c15a020 legacy=0x7f0c1c071930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 0x7f0c08005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 0x7f0c08008600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08006140 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c080036b0 2023-11-04T01:55:41.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 msgr2=0x7f0c08008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 0x7f0c08008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 msgr2=0x7f0c08005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:41.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.493+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 0x7f0c08005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:41.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.697+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 msgr2=0x7f0c08008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.697+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 0x7f0c08008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.697+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 msgr2=0x7f0c08005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:41.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:41.697+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 0x7f0c08005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.101+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 msgr2=0x7f0c08008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:42.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.101+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 0x7f0c08008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.101+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 msgr2=0x7f0c08005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:42.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.101+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 0x7f0c08005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:42.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.905+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 msgr2=0x7f0c08008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:42.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.905+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 0x7f0c08008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.905+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 msgr2=0x7f0c08005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:42.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:42.905+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 0x7f0c08005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:44.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 msgr2=0x7f0c08005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080036b0 0x7f0c08005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 msgr2=0x7f0c08008600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08006140 0x7f0c08008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 0x7f0c080065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c08006b30 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c1c072040 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08003af0 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08006b30 legacy=0x7f0c08006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 msgr2=0x7f0c080065f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:44.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.493+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 0x7f0c080065f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:44.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.697+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08006b30 legacy=0x7f0c08006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.697+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 msgr2=0x7f0c080065f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.697+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 0x7f0c080065f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:44.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:44.697+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.101+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08006b30 legacy=0x7f0c08006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.101+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 msgr2=0x7f0c080065f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.101+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 0x7f0c080065f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:45.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.101+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.905+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08006b30 legacy=0x7f0c08006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.905+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 msgr2=0x7f0c080065f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.905+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 0x7f0c080065f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:45.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:45.905+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:47.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 msgr2=0x7f0c080065f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08003af0 0x7f0c080065f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08006b30 legacy=0x7f0c08006fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 0x7f0c08010b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800e6e0 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08011170 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 msgr2=0x7f0c08010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:47.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 0x7f0c08010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:47.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.493+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:47.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.697+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 msgr2=0x7f0c08010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:47.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.697+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:47.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.697+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 0x7f0c08010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:47.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:47.697+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:48.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.101+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 msgr2=0x7f0c08010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:48.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.101+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:48.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.101+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 0x7f0c08010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:48.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.101+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.905+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 msgr2=0x7f0c08010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.905+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.905+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 0x7f0c08010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:48.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:48.905+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:50.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:50.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:50.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 msgr2=0x7f0c08010b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800e6e0 0x7f0c08010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c1c072040 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065f0 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08011170 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:50.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.497+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:50.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.701+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:50.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.701+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:50.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.701+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:50.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.701+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:50.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:50.701+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:51.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.105+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:51.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.105+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:51.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.105+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:51.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.105+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:51.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.105+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:51.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.909+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:51.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.909+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:51.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.909+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:51.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.909+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:51.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:51.909+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c1c072040 legacy=0x7f0c0800afb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 0x7f0c08007b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c080080d0 2023-11-04T01:55:53.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080077b0 2023-11-04T01:55:53.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080080d0 legacy=0x7f0c08013c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:53.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 msgr2=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:53.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.497+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 0x7f0c08007b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:53.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.701+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080080d0 legacy=0x7f0c08013c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:53.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.701+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 msgr2=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:53.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:53.701+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 0x7f0c08007b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:54.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:54.105+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080080d0 legacy=0x7f0c08013c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:54.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:54.105+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 msgr2=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:54.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:54.105+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 0x7f0c08007b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:54.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:54.909+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080080d0 legacy=0x7f0c08013c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:54.909+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 msgr2=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:54.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:54.909+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 0x7f0c08007b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:55.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:55.935 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:55:56.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 msgr2=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:56.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080077b0 0x7f0c08007b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:56.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080080d0 legacy=0x7f0c08013c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:56.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:55:56.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c080077b0 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065f0 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08011170 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:56.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.497+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:56.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.701+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:56.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.701+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:56.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.701+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:56.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.701+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:56.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:56.701+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:55:57.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.105+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:57.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.105+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:57.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.105+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:57.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.105+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:57.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.105+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:55:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.909+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:55:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.909+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:55:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.909+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:57.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.909+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:55:57.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:57.909+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 msgr2=0x7f0c08013560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:59.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08011170 0x7f0c08013560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065f0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c0800bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c0800c500 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08010ad0 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c0800bfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800c500 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:59.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.497+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c0800bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:55:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.701+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c0800bfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:55:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.701+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800c500 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:55:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:55:59.701+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c0800bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:00.105+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c0800bfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:00.105+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800c500 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:00.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:00.105+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c0800bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:00.909+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c0800bfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:00.909+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800c500 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:00.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:00.909+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c0800bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c0800bfc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c0800bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800c500 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c080077b0 2023-11-04T01:56:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c0800e030 2023-11-04T01:56:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065d0 2023-11-04T01:56:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c08017c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.497+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.701+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.701+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.701+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:02.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:02.701+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c08017c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.105+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.105+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.105+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:03.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.105+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c08017c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:03.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.909+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:03.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.909+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:03.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.909+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:03.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:03.909+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c08017c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c08017c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080077b0 legacy=0x7f0c08007bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:05.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 0x7f0c08011170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 0x7f0c08008f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800d920 2023-11-04T01:56:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08010ad0 2023-11-04T01:56:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 msgr2=0x7f0c08011170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 msgr2=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 0x7f0c08008f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:05.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.497+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 0x7f0c08011170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:05.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.701+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 msgr2=0x7f0c08011170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:05.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.701+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 msgr2=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:05.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.701+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 0x7f0c08011170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:05.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:05.701+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 0x7f0c08008f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.105+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 msgr2=0x7f0c08011170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.105+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 msgr2=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.105+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 0x7f0c08011170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:06.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.105+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 0x7f0c08008f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.909+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 msgr2=0x7f0c08011170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.909+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 msgr2=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.909+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 0x7f0c08011170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:06.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:06.909+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 0x7f0c08008f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 msgr2=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08010ad0 0x7f0c08008f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 msgr2=0x7f0c08011170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800d920 0x7f0c08011170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:08.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08010ad0 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c08007790 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065d0 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:08.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.497+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.701+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.701+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.701+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:08.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:08.701+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.105+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.105+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.105+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:09.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.105+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:09.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.909+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.909+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.909+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:09.909+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:11.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800dd00 2023-11-04T01:56:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c0800d920 2023-11-04T01:56:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:11.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.497+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.701+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.701+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.701+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:11.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:11.701+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:12.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.105+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:12.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.105+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:12.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.105+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:12.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.105+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:12.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.909+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:12.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.909+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:12.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.909+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:12.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:12.909+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c08007790 2023-11-04T01:56:14.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065d0 2023-11-04T01:56:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c0800dd00 2023-11-04T01:56:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:14.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.497+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.701+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.701+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.701+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.701+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:14.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:14.701+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.105+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.105+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.105+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.105+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:15.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.105+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.909+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.909+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.909+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.909+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:15.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:15.909+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065d0 0x7f0c08006fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08010ad0 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800d920 2023-11-04T01:56:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.497+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.501+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.501+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:17.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.701+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:17.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.705+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:17.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:17.705+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:18.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:18.105+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:18.109+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:18.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:18.109+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:18.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:18.909+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:18.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:18.913+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:18.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:18.913+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:20.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:20.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:20.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c08013180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:20.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c080065d0 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800dd00 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c0800d920 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065d0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:20.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.501+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:20.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.705+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:20.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.705+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:20.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.705+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065d0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:20.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.705+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:20.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:20.705+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.109+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065d0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.109+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.109+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.109+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.109+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:21.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.913+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065d0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:21.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.913+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:21.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.913+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:21.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.913+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:21.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:21.913+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:23.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 msgr2=0x7f0c0800bf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800d920 0x7f0c0800bf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 msgr2=0x7f0c0800e110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800dd00 0x7f0c0800e110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065d0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08007ea0 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08010ad0 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007ea0 legacy=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:23.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.501+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:23.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.705+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:23.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.705+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007ea0 legacy=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:23.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:23.705+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:24.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:24.109+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:24.109+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007ea0 legacy=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:24.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:24.109+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:24.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:24.913+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007ea0 legacy=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:24.913+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:24.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:24.913+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:25.994 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:25.997 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007ea0 legacy=0x7f0c08008f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:26.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 0x7f0c08008f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c08007790 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08010ad0 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c080065d0 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:26.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.501+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.705+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.705+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.705+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.705+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:26.705+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:27.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.109+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:27.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.109+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:27.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.109+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:27.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.109+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:27.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.109+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:27.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.913+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:27.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.913+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:27.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.913+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:27.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.913+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:27.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:27.913+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c080065d0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08006f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08010ad0 0x7f0c08006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007790 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 0x7f0c08007bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:29.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c0800e030 2023-11-04T01:56:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800be00 2023-11-04T01:56:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:29.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.501+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:29.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.705+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:29.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.705+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:29.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:29.705+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:30.109+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:30.109+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:30.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:30.109+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:30.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:30.913+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:30.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:30.913+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:30.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:30.913+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:32.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:32.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800be00 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:32.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800e030 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:32.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:32.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:32.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08006f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c08014160 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065b0 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08007790 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08014160 legacy=0x7f0c08011140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:32.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.501+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.705+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08014160 legacy=0x7f0c08011140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.705+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:32.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.705+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.705+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:32.700 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:32.705+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.109+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08014160 legacy=0x7f0c08011140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.109+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.109+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.109+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:33.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.109+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:33.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.913+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08014160 legacy=0x7f0c08011140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:33.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.913+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08006f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:33.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.913+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:33.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.913+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:33.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:33.913+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:35.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:35.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:35.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08006f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:35.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:35.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08014160 legacy=0x7f0c08011140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:35.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:35.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08013860 2023-11-04T01:56:35.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08010ad0 2023-11-04T01:56:35.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:35.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08013860 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.505+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:35.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.709+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.709+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08013860 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:35.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:35.709+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:36.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:36.113+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:36.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:36.113+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08013860 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:36.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:36.113+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:36.917+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:36.917+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08013860 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:36.917+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08013860 legacy=0x7f0c0800b6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c080065b0 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08010ad0 2023-11-04T01:56:38.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08007790 2023-11-04T01:56:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:38.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.505+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.709+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.709+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.709+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.709+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:38.709+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:39.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.113+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.113+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.113+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.113+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:39.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.113+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:39.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.917+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:39.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.917+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:39.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.917+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:39.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.917+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:39.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:39.917+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 msgr2=0x7f0c08008f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08010ad0 0x7f0c08008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 0x7f0c08016170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:41.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08006f10 2023-11-04T01:56:41.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800bc40 2023-11-04T01:56:41.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 msgr2=0x7f0c08016170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:41.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 0x7f0c08016170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:41.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.505+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800b530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:41.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.709+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 msgr2=0x7f0c08016170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.709+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 0x7f0c08016170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:41.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:41.709+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800b530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:42.113+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 msgr2=0x7f0c08016170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:42.113+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 0x7f0c08016170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:42.113+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800b530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:42.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:42.917+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 msgr2=0x7f0c08016170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:42.917+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 0x7f0c08016170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:42.917+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800b530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:44.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 msgr2=0x7f0c08016170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bc40 0x7f0c08016170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800b530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c0800c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c08006f10 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065b0 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08007790 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:44.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:44.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.505+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:44.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.709+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:44.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.709+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:44.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.709+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:44.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.709+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:44.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:44.709+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:45.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.113+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.113+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.113+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.113+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:45.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.113+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.917+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.917+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.917+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.917+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:45.917+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08007bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08007bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 0x7f0c08016120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08010ad0 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800bf60 2023-11-04T01:56:47.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c0800d560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:47.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:47.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.504+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:47.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.708+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c0800d560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.708+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:47.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:47.708+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:48.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:48.112+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c0800d560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:48.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:48.112+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:48.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:48.112+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:48.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:48.916+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c0800d560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:48.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:48.916+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:48.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:48.916+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:50.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bf60 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08010ad0 legacy=0x7f0c0800d560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08007bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c08016660 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08006f10 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c080065b0 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08016660 legacy=0x7f0c08016a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08007bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08007bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:50.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.504+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:50.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.708+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08007bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:50.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.708+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08016660 legacy=0x7f0c08016a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:50.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.708+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08007bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:50.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:50.708+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.112+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08007bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:51.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.112+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08016660 legacy=0x7f0c08016a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:51.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.112+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08007bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:51.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.112+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:51.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.916+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08007bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:51.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.916+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08016660 legacy=0x7f0c08016a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:51.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.916+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08007bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:51.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:51.916+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:53.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 msgr2=0x7f0c08007bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:53.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c080065b0 0x7f0c08007bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08016660 legacy=0x7f0c08016a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08016120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c0800b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08008f40 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08007790 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c0800b360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c0800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:53.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.504+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:53.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.708+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c0800b360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.708+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.708+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c0800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:53.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:53.708+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:54.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.112+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:54.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.112+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c0800b360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:54.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.112+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:54.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.112+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c0800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:54.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.916+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c0800b360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.916+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.916+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c0800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:54.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:54.916+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:56.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:56.044 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:56:56.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 msgr2=0x7f0c08016120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08007790 0x7f0c08016120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c0800b360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c0800b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 0x7f0c08007b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 0x7f0c0800b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c080065b0 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08007790 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08006f10 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 msgr2=0x7f0c0800b330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:56.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 0x7f0c0800b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:56.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 msgr2=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:56.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.504+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 0x7f0c08007b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.708+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.708+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 msgr2=0x7f0c0800b330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.708+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 0x7f0c0800b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.708+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 msgr2=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:56.708+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 0x7f0c08007b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:56:57.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.112+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:57.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.112+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 msgr2=0x7f0c0800b330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:57.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.112+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 0x7f0c0800b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:57.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.112+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 msgr2=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:57.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.112+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 0x7f0c08007b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:56:57.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.916+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:56:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.916+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 msgr2=0x7f0c0800b330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:56:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.916+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 0x7f0c0800b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.916+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 msgr2=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:56:57.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:57.916+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 0x7f0c08007b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:56:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 msgr2=0x7f0c08007b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08006f10 0x7f0c08007b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 msgr2=0x7f0c0800b330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08007790 0x7f0c0800b330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c0800b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c0800bdb0 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08008f40 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800bdb0 legacy=0x7f0c08015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c0800b870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:59.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.504+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c0800b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:56:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.708+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800bdb0 legacy=0x7f0c08015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:56:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.708+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c0800b870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:56:59.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:56:59.708+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c0800b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:00.112+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c0800b870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:00.112+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800bdb0 legacy=0x7f0c08015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:00.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:00.112+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c0800b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:00.916+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800bdb0 legacy=0x7f0c08015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:00.916+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c0800b870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:00.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:00.916+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c0800b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c0800b870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c0800b870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c0800bdb0 legacy=0x7f0c08015110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:02.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c080065b0 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c15e650 con 0x7f0c08006f10 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08009f50 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:02.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.508+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:02.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.712+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:02.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.712+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:02.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.712+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:02.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:02.712+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.116+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.116+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.116+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.116+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.920+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.920+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.920+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:03.920+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:05.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800a890 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c0800b1e0 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:05.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:05.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.504+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:05.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.708+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:05.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.708+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:05.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.708+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:05.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:05.708+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:06.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.112+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:06.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.112+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:06.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.112+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:06.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.112+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.916+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.916+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:06.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.916+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:06.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:06.916+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:08.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:08.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:08.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c080065b0 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08009f50 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c0800a890 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:08.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.504+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:08.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.708+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:08.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.708+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:08.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.708+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:08.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.708+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:08.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:08.708+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.112+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.112+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:09.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.112+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.112+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:09.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.112+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:09.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.916+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:09.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.916+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:09.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.916+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.916+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:09.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:09.916+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 msgr2=0x7f0c0800aca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800a890 0x7f0c0800aca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 msgr2=0x7f0c0800a350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:11.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009f50 0x7f0c0800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c08006f10 2023-11-04T01:57:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800b1e0 2023-11-04T01:57:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:11.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.508+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.712+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.712+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:11.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:11.712+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:12.116+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:12.116+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:12.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:12.116+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:12.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:12.920+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:12.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:12.920+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:12.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:12.920+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c0800b1e0 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08006f10 legacy=0x7f0c0800d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 0x7f0c0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c080065b0 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800b5f0 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08008f40 2023-11-04T01:57:14.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 msgr2=0x7f0c0800b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 0x7f0c0800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:14.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.508+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.712+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 msgr2=0x7f0c0800b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.712+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 0x7f0c0800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.712+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.712+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:14.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:14.712+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.116+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 msgr2=0x7f0c0800b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.116+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 0x7f0c0800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.116+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:15.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.116+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:15.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.116+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.920+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 msgr2=0x7f0c0800b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.920+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 0x7f0c0800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.920+0000 7f0c22721640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.920+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:15.920+0000 7f0c22721640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 msgr2=0x7f0c0800b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800b5f0 0x7f0c0800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 0x7f0c08017120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c080098f0 2023-11-04T01:57:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08009d00 2023-11-04T01:57:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080098f0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.508+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.712+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080098f0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.712+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:17.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:17.712+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:18.116+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080098f0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:18.116+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:18.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:18.116+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:18.920+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080098f0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:18.920+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:18.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:18.920+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:20.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08009d00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c080098f0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 0x7f0c0800b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c080065b0 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08009d00 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c08008f40 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:20.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.508+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.712+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.712+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.712+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:20.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.712+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:20.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:20.712+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.116+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.116+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.116+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.116+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.116+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:21.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.920+0000 7f0c22721640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:21.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.920+0000 7f0c22721640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:21.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.920+0000 7f0c2171f640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:21.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.920+0000 7f0c21f20640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:21.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:21.920+0000 7f0c2171f640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 msgr2=0x7f0c080093b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c08008f40 0x7f0c080093b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 msgr2=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08009d00 0x7f0c0800b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c080065b0 legacy=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 0x7f0c0800c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:23.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c0800ce50 2023-11-04T01:57:23.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800bb30 2023-11-04T01:57:23.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800ce50 legacy=0x7f0c0800d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:23.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:23.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.508+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.712+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800ce50 legacy=0x7f0c0800d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:23.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.712+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:23.709 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:23.712+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:24.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:24.116+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800ce50 legacy=0x7f0c0800d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:24.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:24.116+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:24.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:24.116+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:24.920+0000 7f0c2171f640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800ce50 legacy=0x7f0c0800d2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:24.920+0000 7f0c21f20640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:24.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:24.920+0000 7f0c21f20640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:26.088 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:26.091 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:26.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bb30 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c0800ce50 legacy=0x7f0c0800d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08009d00 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08008f40 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c080065b0 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:26.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:26.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:26.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:26.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.508+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.712+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.712+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.712+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.712+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:26.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:26.712+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.116+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.116+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.116+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.116+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.116+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:27.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.920+0000 7f0c2171f640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:27.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.920+0000 7f0c2171f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:27.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.920+0000 7f0c22721640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.920+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:27.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:27.920+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 0x7f0c08017120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c08007cd0 2023-11-04T01:57:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800bd00 2023-11-04T01:57:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:29.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.508+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:29.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.712+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:29.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.712+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:29.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:29.712+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:30.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:30.116+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:30.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:30.116+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:30.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:30.116+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:30.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:30.920+0000 7f0c21f20640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:30.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:30.920+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:30.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:30.920+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:32.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c08017120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:32.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c0800bd00 0x7f0c08017120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:32.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c22721640 1 -- reap_dead start 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1c0c9d10 con 0x7f0c08009d00 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c08008f40 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c1b7fe640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08008cc0 con 0x7f0c080065b0 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:32.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.508+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:32.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.712+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.712+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.712+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.712+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:32.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:32.712+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.116+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.116+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:33.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.116+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.116+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:33.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.116+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.920+0000 7f0c22721640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.920+0000 7f0c2171f640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.920+0000 7f0c21f20640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:33.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.920+0000 7f0c2171f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:33.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:33.920+0000 7f0c21f20640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 msgr2=0x7f0c08009390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f0c080065b0 0x7f0c08009390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 msgr2=0x7f0c08007790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c08008f40 0x7f0c08007790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f0c08009d00 legacy=0x7f0c0800b5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 0x7f0c0800c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080088b0 con 0x7f0c08007cd0 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c1b7fe640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c1c070e90 con 0x7f0c0800bd00 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.508+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.712+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.712+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:35.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:35.712+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:36.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:36.116+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:36.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:36.116+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:36.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:36.116+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:36.919+0000 7f0c21f20640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 msgr2=0x7f0c0800c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:36.919+0000 7f0c21f20640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0c0800bd00 0x7f0c0800c910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:36.919+0000 7f0c2171f640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f0c08007cd0 legacy=0x7f0c0800ce50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:38.374 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:57:38.375 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-04T01:57:38.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:57:38.438 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-04T01:57:38.489 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-04T01:57:38.490 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:57:38.490 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:38.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:57:38.499 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:57:38.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:38.499 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-04T01:57:38.540 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-04T01:57:38.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:57:38.542 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:57:38.542 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:38.548 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:57:38.548 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:57:38.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:38.548 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-04T01:57:38.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:57:38.597 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-04T01:57:38.597 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:57:38.598 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:38.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:57:38.604 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T01:57:38.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:38.604 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-04T01:57:38.652 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-04T01:57:38.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:57:38.653 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:57:38.654 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:57:38.659 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:57:38.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T01:57:38.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:57:38.660 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-04T01:57:38.708 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-04T01:57:38.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T01:57:38.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-04T01:57:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d3cf5c640 1 Processor -- start 2023-11-04T01:57:38.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d3cf5c640 1 -- start start 2023-11-04T01:57:38.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d3cf5c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 0x7f2d380ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d3cf5c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d38160680 2023-11-04T01:57:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d3cf5c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d380ce7f0 2023-11-04T01:57:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d3cf5c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d38160a60 2023-11-04T01:57:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 msgr2=0x7f2d380ce2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d380ce7f0 legacy=0x7f2d380b62e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:38.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:38.843+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 0x7f2d380ce2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.047+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.047+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 msgr2=0x7f2d380ce2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:39.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.047+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d380ce7f0 legacy=0x7f2d380b62e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:39.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.047+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 0x7f2d380ce2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.451+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.451+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 msgr2=0x7f2d380ce2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.451+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d380ce7f0 legacy=0x7f2d380b62e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:39.451+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 0x7f2d380ce2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:40.255+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d380cdba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:40.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:40.255+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 msgr2=0x7f2d380ce2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:40.255+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d380ce7f0 legacy=0x7f2d380b62e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:40.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:40.255+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 0x7f2d380ce2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 msgr2=0x7f2d380ce2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d38160a60 0x7f2d380ce2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d380ce7f0 legacy=0x7f2d380b62e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d380cdba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 0x7f2d18005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 0x7f2d180085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d180036b0 2023-11-04T01:57:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18006120 2023-11-04T01:57:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 msgr2=0x7f2d18005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 0x7f2d18005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 msgr2=0x7f2d180085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:41.847+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 0x7f2d180085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.051+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 msgr2=0x7f2d18005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.051+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 0x7f2d18005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:42.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.051+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 msgr2=0x7f2d180085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:42.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.051+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 0x7f2d180085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.455+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 msgr2=0x7f2d18005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.455+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 0x7f2d18005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.455+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 msgr2=0x7f2d180085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:42.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:42.455+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 0x7f2d180085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:43.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:43.259+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 msgr2=0x7f2d18005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:43.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:43.259+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 0x7f2d18005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:43.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:43.259+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 msgr2=0x7f2d180085e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:43.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:43.259+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 0x7f2d180085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:44.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 msgr2=0x7f2d180085e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18006120 0x7f2d180085e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 msgr2=0x7f2d18005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180036b0 0x7f2d18005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d38160680 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d18006b10 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18003b20 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d1800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:44.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:44.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006b10 legacy=0x7f2d18006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:44.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:44.847+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:45.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.051+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d1800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:45.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.051+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.051+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006b10 legacy=0x7f2d18006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:45.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.051+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.455+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d1800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:45.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.455+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:45.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.455+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006b10 legacy=0x7f2d18006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:45.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:45.455+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:46.259+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d1800afa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:46.259+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:46.259+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006b10 legacy=0x7f2d18006fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:46.259+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006b10 legacy=0x7f2d18006fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d38160680 legacy=0x7f2d1800afa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 0x7f2d180133f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18011000 2023-11-04T01:57:47.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d1800e6d0 2023-11-04T01:57:47.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:47.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:47.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:47.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:47.847+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:48.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.051+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:48.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.051+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:48.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.051+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:48.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.051+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.455+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.455+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:48.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.455+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:48.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:48.455+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:49.259+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:49.259+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:49.259+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:49.259+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:50.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18011000 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 0x7f2d180133f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18013b10 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18003b20 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008f90 con 0x7f2d1800e6d0 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:50.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:50.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:50.847+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:51.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.051+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:51.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.051+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.051+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.051+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.051+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:51.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.051+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.455+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.455+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.455+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:51.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.455+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:51.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.455+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:51.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:51.455+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:52.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:52.259+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:52.259+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:52.259+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:52.259+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:52.259+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:52.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:52.259+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:53.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18003b20 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 msgr2=0x7f2d180133f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18013b10 0x7f2d180133f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d18007000 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d18007bf0 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18007000 legacy=0x7f2d180073e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:53.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:53.847+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18013fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:54.051+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18007000 legacy=0x7f2d180073e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:54.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:54.051+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18013fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:54.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:54.455+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18007000 legacy=0x7f2d180073e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:54.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:54.455+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18013fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:55.259+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18007000 legacy=0x7f2d180073e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:55.259+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18013fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:57:56.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:56.154 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:57:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18013fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18007000 legacy=0x7f2d180073e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:57:56.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d18005b30 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18007bf0 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d1800e6d0 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:56.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:56.847+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.051+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.051+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.051+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.051+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.051+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:57:57.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.455+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.455+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.455+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.455+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:57.455+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:57:58.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:58.259+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:57:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:58.259+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:57:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:58.259+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:57:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:58.259+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:58.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:58.259+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d180133f0 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18007710 2023-11-04T01:57:59.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:57:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:57:59.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:57:59.847+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:00.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:00.051+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:00.051+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:00.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:00.051+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:00.455+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:00.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:00.455+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:00.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:00.455+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:01.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:01.259+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:01.259+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:01.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:01.259+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d18005b30 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d180133f0 2023-11-04T01:58:02.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800e6d0 2023-11-04T01:58:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:02.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:02.847+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.051+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.051+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.051+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:03.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.051+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.455+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.455+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.455+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:03.455+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:04.259+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:04.259+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:04.259+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:04.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:04.259+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:05.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 msgr2=0x7f2d18010ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:05.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800e6d0 0x7f2d18010ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:05.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180133f0 legacy=0x7f2d18007000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:05.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:05.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18007710 2023-11-04T01:58:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18007bf0 2023-11-04T01:58:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:05.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:05.851+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:06.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.055+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:06.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.055+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:06.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.055+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:06.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.055+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:06.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.459+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:06.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.459+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:06.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.459+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:06.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:06.459+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:07.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:07.263+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:07.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:07.263+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:07.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:07.263+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:07.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:07.263+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bf0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 msgr2=0x7f2d1800d150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18007710 0x7f2d1800d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:08.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 0x7f2d180065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d18005b30 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d18007bf0 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d180133f0 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:08.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:08.851+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.055+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:09.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.055+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:09.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.055+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:09.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.055+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.458+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.458+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.458+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:09.454 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:09.458+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:10.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:10.262+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:10.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:10.262+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18006fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:10.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:10.262+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:10.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:10.262+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:11.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 msgr2=0x7f2d180065d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:11.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d180133f0 0x7f2d180065d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:11.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18007bf0 legacy=0x7f2d18006fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:11.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18007fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:11.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 0x7f2d1800f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:11.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 0x7f2d1800fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:11.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800fbe0 2023-11-04T01:58:11.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d180076f0 2023-11-04T01:58:11.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 msgr2=0x7f2d1800fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:11.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 0x7f2d1800fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:11.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 msgr2=0x7f2d1800f6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:11.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:11.850+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 0x7f2d1800f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.054+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 msgr2=0x7f2d1800fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.054+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 0x7f2d1800fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.054+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 msgr2=0x7f2d1800f6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:12.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.054+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 0x7f2d1800f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:12.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.458+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 msgr2=0x7f2d1800fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.458+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 0x7f2d1800fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.458+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 msgr2=0x7f2d1800f6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:12.458+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 0x7f2d1800f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:13.262+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 msgr2=0x7f2d1800fff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:13.262+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 0x7f2d1800fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:13.262+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 msgr2=0x7f2d1800f6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:13.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:13.262+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 0x7f2d1800f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 msgr2=0x7f2d1800f6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180076f0 0x7f2d1800f6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 msgr2=0x7f2d1800fff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fbe0 0x7f2d1800fff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d18006fc0 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d180105c0 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d1800fff0 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006fc0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:14.850+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.054+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.054+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006fc0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.054+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.054+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:15.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.054+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:15.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.458+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:15.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.458+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:15.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.458+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006fc0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:15.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.458+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:15.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:15.458+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:16.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:16.262+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:16.262+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:16.262+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006fc0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:16.262+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:16.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:16.262+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800fff0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:17.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d18006fc0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d18008300 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d180133f0 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18008300 legacy=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:17.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:17.850+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800c140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:18.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:18.054+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18008300 legacy=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:18.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:18.054+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:18.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:18.054+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800c140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:18.458+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:18.458+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18008300 legacy=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:18.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:18.458+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800c140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:19.262+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800c140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:19.262+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18008300 legacy=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:19.262+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800c140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800c140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800c140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18008300 legacy=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d18005b30 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d180133f0 2023-11-04T01:58:20.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d180105c0 2023-11-04T01:58:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d1800c680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:20.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:20.850+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:21.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.054+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d1800c680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.054+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.054+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.054+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:21.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.054+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.458+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d1800c680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.458+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.458+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.458+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:21.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:21.458+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:22.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:22.262+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d1800c680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:22.262+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:22.262+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:22.262+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:22.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:22.262+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d180109a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180105c0 0x7f2d180109a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d1800c680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800fec0 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800dda0 2023-11-04T01:58:23.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:23.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:23.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:23.850+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:24.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:24.054+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:24.054+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:24.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:24.054+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:24.458+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:24.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:24.458+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:24.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:24.458+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:25.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:25.262+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:25.262+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:25.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:25.262+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:26.206 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:26.209 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:26.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d18005b30 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800fec0 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800dda0 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:26.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:26.850+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.054+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.054+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.054+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:27.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.054+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:27.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.458+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:27.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.458+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:27.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.458+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:27.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:27.458+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:28.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:28.262+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:28.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:28.262+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:28.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:28.262+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:28.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:28.262+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d1800dda0 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800fec0 legacy=0x7f2d18007bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d18005b30 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d18010a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d180105c0 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d180133f0 2023-11-04T01:58:29.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d18010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d18010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:29.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:29.850+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:30.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.054+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d18010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:30.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.054+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d18010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:30.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.054+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:30.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.054+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.458+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d18010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.458+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d18010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.458+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:30.458+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:31.262+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d18010a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:31.262+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d18010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:31.262+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:31.262+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:32.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 msgr2=0x7f2d1800f600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:32.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d180133f0 0x7f2d1800f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:32.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d18010a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d18010a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d1800fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d180105c0 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d1800c140 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008f90 con 0x7f2d18005b30 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d1800fe60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d1800fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:32.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:32.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:32.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:32.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:32.850+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:33.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.054+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d1800fe60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:33.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.054+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d1800fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:33.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.054+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:33.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.054+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:33.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.054+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:33.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.054+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.458+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d1800fe60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.458+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d1800fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.458+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.458+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.458+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:33.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:33.458+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:34.262+0000 7f2d36d9d640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d1800fe60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:34.262+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d1800fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:34.262+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:34.262+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:34.262+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:34.262+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 msgr2=0x7f2d1800fe60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:35.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d180105c0 0x7f2d1800fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d180109a0 2023-11-04T01:58:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d1800f600 2023-11-04T01:58:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d180109a0 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:35.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:35.854+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800f600 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:36.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:36.058+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d180109a0 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:36.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:36.058+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800f600 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:36.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:36.462+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d180109a0 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:36.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:36.462+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800f600 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:37.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:37.266+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d180109a0 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:37.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:37.266+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800f600 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800f600 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d180109a0 legacy=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800db10 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800c140 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18005b30 2023-11-04T01:58:38.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:38.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:38.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:38.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:38.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:38.854+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.058+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.058+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.058+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.058+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:39.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.058+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.462+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.462+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.462+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.462+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:39.462+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:40.266+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:40.266+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:40.266+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:40.266+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:40.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:40.266+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 msgr2=0x7f2d1800c520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c140 0x7f2d1800c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d180105c0 2023-11-04T01:58:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800fe60 2023-11-04T01:58:41.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:41.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:41.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:41.854+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180105c0 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:42.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:42.058+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:42.058+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:42.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:42.058+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180105c0 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:42.462+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:42.462+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:42.462+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180105c0 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:43.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:43.266+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:43.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:43.266+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:43.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:43.266+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180105c0 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d180105c0 legacy=0x7f2d18007bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800db10 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d1800b840 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18005b30 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:44.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:44.853+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.057+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.057+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.057+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:45.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.057+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:45.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.461+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:45.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.461+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:45.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.461+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:45.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:45.461+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:46.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:46.265+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:46.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:46.265+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:46.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:46.265+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:46.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:46.265+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800b0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800fe60 2023-11-04T01:58:47.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18007bc0 2023-11-04T01:58:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:47.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:47.853+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:48.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.057+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.057+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.057+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.057+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.461+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.461+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.461+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:48.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:48.461+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:49.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:49.265+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:49.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:49.265+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:49.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:49.265+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:49.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:49.265+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:50.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe60 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:50.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:50.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d1800db10 2023-11-04T01:58:50.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800b840 2023-11-04T01:58:50.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18005b30 2023-11-04T01:58:50.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:50.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:50.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:50.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:50.853+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:51.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.057+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:51.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.057+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:51.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.057+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:51.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.057+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.461+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.461+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.461+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:51.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:51.461+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:52.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:52.265+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:52.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:52.265+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:52.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:52.265+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:52.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:52.265+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:53.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:53.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 0x7f2d1800ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800fe00 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18007bc0 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:53.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:53.853+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.057+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.057+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.057+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:54.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.057+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:54.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.461+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.461+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.461+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:54.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:54.461+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:55.265+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:55.265+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:55.265+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:55.265+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:56.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:56.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800fe00 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d1800db10 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d1800b840 2023-11-04T01:58:56.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800bc20 2023-11-04T01:58:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:56.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:56.853+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.057+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.057+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.057+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:58:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.057+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:57.456 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.461+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.461+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.461+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:58:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:57.461+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:58.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:58.265+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:58:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:58.265+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:58:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:58.265+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:58:58.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:58.265+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800f240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 0x7f2d1800ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800c540 2023-11-04T01:58:59.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18005b30 2023-11-04T01:58:59.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:58:59.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:58:59.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:58:59.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:58:59.853+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:00.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.057+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.057+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.057+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:00.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.057+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:00.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.461+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:00.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.461+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:00.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.461+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:00.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:00.461+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:01.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:01.265+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:01.265+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:01.265+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:01.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:01.265+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:02.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 msgr2=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c540 0x7f2d1800ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800bc20 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18007bc0 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008f90 con 0x7f2d18005b30 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:02.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:02.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:02.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:02.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:02.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:02.853+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.057+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.057+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.057+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.057+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.057+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:03.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.057+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.461+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.461+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.461+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.461+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.461+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:03.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:03.461+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:04.265+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:04.265+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:04.265+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:04.265+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:04.265+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:04.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:04.265+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:05.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:05.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d18006f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d18006f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 msgr2=0x7f2d1800c000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800bc20 0x7f2d1800c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800b840 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d1800db10 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:05.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:05.857+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:06.061+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:06.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:06.061+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:06.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:06.465+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:06.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:06.465+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:07.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:07.269+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:07.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:07.269+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800b840 legacy=0x7f2d1800e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d1800f410 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800db10 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18005b30 2023-11-04T01:59:08.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:08.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:08.853+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.057+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.057+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.057+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.057+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.461+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.461+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.461+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:09.461+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:10.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:10.265+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:10.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:10.265+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:10.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:10.265+0000 7f2d36d9d640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:10.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:10.265+0000 7f2d36d9d640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:11.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d180065b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:11.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d180065b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:11.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800db10 legacy=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:11.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:11.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:11.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:11.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18006f80 2023-11-04T01:59:11.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18007bc0 2023-11-04T01:59:11.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:11.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:11.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:11.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:11.853+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:12.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.057+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:12.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.057+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:12.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.057+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:12.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.057+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.461+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.461+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.461+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:12.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:12.461+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:13.265+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:13.265+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:13.265+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:13.265+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 msgr2=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18007bc0 0x7f2d1800ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:14.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d1800a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d1800f410 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18006f80 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d1800c160 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d1800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:14.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:14.857+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d1800a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:15.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.061+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.061+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.061+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.061+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d1800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:15.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.061+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d1800a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.465+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.465+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.465+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.465+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d1800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:15.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:15.465+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d1800a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:16.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:16.269+0000 7f2d36d9d640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:16.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:16.269+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:16.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:16.269+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:16.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:16.269+0000 7f2d3659c640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d1800a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:16.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:16.269+0000 7f2d3659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d1800a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d1800a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d1800a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800ece0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d18006590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d1800e5d0 2023-11-04T01:59:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18005b30 2023-11-04T01:59:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800e5d0 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:17.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:17.857+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:18.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:18.061+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:18.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:18.061+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800e5d0 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:18.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:18.061+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:18.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:18.465+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:18.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:18.465+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800e5d0 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:18.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:18.465+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:19.269+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:19.269+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800e5d0 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:19.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:19.269+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b30 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800e5d0 legacy=0x7f2d1800a0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:20.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d18006590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d1800f410 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18006f80 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d1800c160 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:20.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:20.857+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:21.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.061+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:21.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.061+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:21.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.061+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:21.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.061+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:21.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.061+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:21.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.465+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:21.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.465+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:21.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.465+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:21.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.465+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:21.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:21.465+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:22.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:22.269+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:22.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:22.269+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:22.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:22.269+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:22.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:22.269+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:22.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:22.269+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:23.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d1800c160 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800da70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d1800eb10 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18005b10 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:23.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:23.856+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:24.060+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:24.060+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:24.060+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:24.464+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:24.464+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:24.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:24.464+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:25.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:25.268+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:25.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:25.268+0000 7f2d2ffff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:25.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:25.268+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:26.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:26.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:26.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:59:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d1800f410 2023-11-04T01:59:26.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380b5de0 con 0x7f2d1800eb10 2023-11-04T01:59:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18005b10 2023-11-04T01:59:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:26.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:26.856+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.060+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.060+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.060+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:27.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.060+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.464+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.464+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.464+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:27.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:27.464+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:28.268+0000 7f2d3659c640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:28.268+0000 7f2d2ffff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:28.268+0000 7f2d36d9d640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:28.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:28.268+0000 7f2d2ffff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800eb10 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:29.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 0x7f2d18006590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d1800eef0 2023-11-04T01:59:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18006f80 2023-11-04T01:59:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:29.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:29.856+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.060+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.060+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.060+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:30.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.060+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.464+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.464+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.464+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:30.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:30.464+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:31.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:31.268+0000 7f2d3659c640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:31.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:31.268+0000 7f2d3659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:31.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:31.268+0000 7f2d2ffff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:31.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:31.268+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:32.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:32.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 msgr2=0x7f2d18006590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d1800eef0 0x7f2d18006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d36d9d640 1 -- reap_dead start 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380d1610 con 0x7f2d1800f410 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18006f80 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d34d99640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18008cb0 con 0x7f2d18005b10 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:32.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:32.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:32.856+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:33.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.060+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:33.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.060+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:33.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.060+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:33.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.060+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:33.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.060+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:33.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.464+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:33.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.464+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:33.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.464+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:33.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.464+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:33.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:33.464+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:34.268+0000 7f2d2ffff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:34.268+0000 7f2d3659c640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:34.268+0000 7f2d36d9d640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:34.268+0000 7f2d3659c640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:34.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:34.268+0000 7f2d36d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 msgr2=0x7f2d1800e5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f2d18005b10 0x7f2d1800e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 msgr2=0x7f2d1800bc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d18006f80 0x7f2d1800bc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f2d1800f410 legacy=0x7f2d1800b0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 0x7f2d1800eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d380cf000 con 0x7f2d1800c160 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d34d99640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d380d09b0 con 0x7f2d18006590 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 msgr2=0x7f2d1800eb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 0x7f2d1800eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:35.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:35.856+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800c160 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:36.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:36.060+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 msgr2=0x7f2d1800eb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:36.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:36.060+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 0x7f2d1800eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:36.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:36.060+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800c160 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:36.464+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 msgr2=0x7f2d1800eb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:36.464+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 0x7f2d1800eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:36.461 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:36.464+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800c160 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:37.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:37.268+0000 7f2d2ffff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 msgr2=0x7f2d1800eb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:37.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:37.268+0000 7f2d2ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d18006590 0x7f2d1800eb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:37.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:37.268+0000 7f2d3659c640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f2d1800c160 legacy=0x7f2d1800ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:38.729 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T01:59:38.732 INFO:tasks.cephfs_test_runner:check snaptable transcation ... ERROR 2023-11-04T01:59:38.732 INFO:tasks.cephfs_test_runner:ERROR 2023-11-04T01:59:38.732 INFO:tasks.cephfs_test_runner: 2023-11-04T01:59:38.732 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:59:38.733 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:59:38.734 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner: 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:59:38.735 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:59:38.736 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner: 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:59:38.737 INFO:tasks.cephfs_test_runner:Ran 5 tests in 999.956s 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner: 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner: 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:59:38.738 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 174, in test_kill_mdstable 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: self.assertEqual(len(self._get_pending_snap_update(rank=0)), 1) 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 38, in _get_pending_snap_update 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: return self._get_snapserver_dump(rank,status=status)["pending_update"] 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/test_snapshots.py", line 29, in _get_snapserver_dump 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: return self.fs.rank_asok(["dump", "snaps", "--server"], rank=rank, status=status) 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1295, in rank_asok 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: info = self.get_rank(rank=rank, status=status) 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 1101, in get_rank 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: status = self.getinfo() 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 565, in getinfo 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: status = self.status() 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:59:38.739 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:59:38.740 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner:ERROR: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner:check snaptable transcation 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/cephfs_test_case.py", line 208, in tearDown 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: self.mds_cluster.delete_all_filesystems() 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 493, in delete_all_filesystems 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: for fs in self.status().get_filesystems(): 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 396, in status 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: return FSStatus(self.mon_manager, epoch) 2023-11-04T01:59:38.741 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs/filesystem.py", line 88, in __init__ 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-04T01:59:38.742 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-04T01:59:38.743 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2023-11-04T01:59:38.743 INFO:tasks.cephfs_test_runner: 2023-11-04T01:59:38.743 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:59:38.843 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cb6f7c6381a14c6e9bc68f34c4447a20 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2023-11-04T01:59:38.845 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-04T01:59:38.855 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-04T01:59:38.900 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-04T01:59:38.901 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:59:38.901 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:59:38.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:59:38.914 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-04T01:59:38.914 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:59:38.961 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16339644k,nr_inodes=4084911,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17015 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275312k,nr_inodes=818828,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275316k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-04T01:59:38.962 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:59:38.962 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:59:38.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:59:38.968 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2023-11-04T01:59:38.968 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-04T01:59:39.017 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336488k,nr_inodes=4084122,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16830 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274680k,nr_inodes=818670,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-04T01:59:39.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.018 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-04T01:59:39.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-04T01:59:39.024 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-04T01:59:39.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-04T01:59:39.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-04T01:59:39.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-11-04T01:59:39.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.331 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2023-11-04T01:59:39.337 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-04T01:59:39.337 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-04T01:59:39.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.338 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-04T01:59:39.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.395 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-04T01:59:39.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-04T01:59:39.453 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2023-11-04T01:59:39.642 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-04T01:59:39.651 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-04T01:59:39.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-04T01:59:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b78765640 1 Processor -- start 2023-11-04T01:59:39.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b78765640 1 -- start start 2023-11-04T01:59:39.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b78765640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b700b4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b78765640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b700b4bc0 2023-11-04T01:59:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b78765640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b7015d310 2023-11-04T01:59:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b78765640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b700b4070 2023-11-04T01:59:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b7006cc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b7015d310 legacy=0x7f5b70160fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b700b4500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:39.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.788+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b700b4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:39.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.992+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b7006cc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.992+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b700b4500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.992+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b7015d310 legacy=0x7f5b70160fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:39.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:39.992+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b700b4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:40.396+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b7006cc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:40.396+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b700b4500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:40.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:40.396+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b7015d310 legacy=0x7f5b70160fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:40.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:40.396+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b700b4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:41.200+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b7006cc50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:41.200+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b7015d310 legacy=0x7f5b70160fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:41.200+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b700b4500 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:41.200+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b700b4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b700b4500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:42.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b700b4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b7015d310 legacy=0x7f5b70160fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b7006cc50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 0x7f5b54005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b54008600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54006140 2023-11-04T01:59:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b540036b0 2023-11-04T01:59:42.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b54008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:42.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b54008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:42.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 msgr2=0x7f5b54005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:42.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.792+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 0x7f5b54005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.996+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b54008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.996+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b54008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:42.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.996+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 msgr2=0x7f5b54005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:42.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:42.996+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 0x7f5b54005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:43.400+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b54008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:43.400+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b54008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:43.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:43.400+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 msgr2=0x7f5b54005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:43.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:43.400+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 0x7f5b54005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:44.204+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b54008600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:44.204+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b54008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:44.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:44.204+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 msgr2=0x7f5b54005b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:44.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:44.204+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 0x7f5b54005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 msgr2=0x7f5b54005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540036b0 0x7f5b54005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b54008600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b54008600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T01:59:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:45.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b700b4bc0 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54006140 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b700b4070 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b5400afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:45.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.792+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.996+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.996+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b5400afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.996+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.996+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:45.996+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:46.400+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b5400afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:46.400+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:46.400+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:46.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:46.400+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:46.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:46.400+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:47.204+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b5400afe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:47.204+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:47.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:47.204+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:47.204+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:47.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:47.204+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:48.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b700b4bc0 legacy=0x7f5b5400afe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b54003af0 2023-11-04T01:59:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b540108e0 2023-11-04T01:59:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54003af0 legacy=0x7f5b5400f1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:48.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:48.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.792+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.996+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54003af0 legacy=0x7f5b5400f1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:48.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.996+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:48.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:48.996+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:49.400+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54003af0 legacy=0x7f5b5400f1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:49.400+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:49.400+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:50.204+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54003af0 legacy=0x7f5b5400f1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:50.204+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:50.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:50.204+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:51.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:51.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:51.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54003af0 legacy=0x7f5b5400f1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:51.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:51.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:51.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T01:59:51.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:51.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54006140 2023-11-04T01:59:51.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b700b4070 2023-11-04T01:59:51.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54013210 con 0x7f5b540108e0 2023-11-04T01:59:51.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:51.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:51.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:51.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:51.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:51.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.791+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:51.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.995+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:51.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.995+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:51.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.995+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:51.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.995+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:51.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.995+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:51.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:51.995+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:52.399+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:52.399+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:52.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:52.399+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:52.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:52.399+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:52.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:52.399+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:52.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:52.399+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:53.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:53.203+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T01:59:53.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:53.203+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:53.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:53.203+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T01:59:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:53.203+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:53.203+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:53.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:53.203+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T01:59:54.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 msgr2=0x7f5b5400e710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b700b4070 0x7f5b5400e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 msgr2=0x7f5b5400ec80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54006140 0x7f5b5400ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T01:59:54.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b5400f1c0 2023-11-04T01:59:54.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400fd30 2023-11-04T01:59:54.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f1c0 legacy=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:54.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.791+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.995+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f1c0 legacy=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:54.995+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:55.399+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f1c0 legacy=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:55.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:55.399+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:56.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:56.203+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f1c0 legacy=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:56.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:56.203+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:56.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:56.383 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T01:59:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f1c0 legacy=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T01:59:57.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b5400f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b54010330 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b5400fd30 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b540108e0 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54016370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:57.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.791+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b5400f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T01:59:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.995+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54016370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.995+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.995+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:57.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:57.995+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b5400f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T01:59:58.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:58.399+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54016370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:58.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:58.399+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:58.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:58.399+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:58.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:58.399+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b5400f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T01:59:59.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:59.203+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54016370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T01:59:59.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:59.203+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T01:59:59.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:59.203+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T01:59:59.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T01:59:59.203+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b5400f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:00.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 msgr2=0x7f5b5400f600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540108e0 0x7f5b5400f600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54016370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 0x7f5b54012cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 0x7f5b5400bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400ec80 2023-11-04T02:00:00.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54013a60 2023-11-04T02:00:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 msgr2=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:00.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.791+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 0x7f5b5400bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.995+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.995+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.995+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 msgr2=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:00.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:00.995+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 0x7f5b5400bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:01.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:01.399+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:01.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:01.399+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:01.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:01.399+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 msgr2=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:01.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:01.399+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 0x7f5b5400bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:02.203+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:02.203+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:02.203+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 msgr2=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:02.203+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 0x7f5b5400bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 msgr2=0x7f5b5400bff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013a60 0x7f5b5400bff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 msgr2=0x7f5b54012cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400ec80 0x7f5b54012cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 0x7f5b5400e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:03.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54017a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400fd30 2023-11-04T02:00:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009fe0 2023-11-04T02:00:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54013e90 2023-11-04T02:00:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54017a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54017a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:03.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 msgr2=0x7f5b5400e540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:03.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.791+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 0x7f5b5400e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.995+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54017a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.995+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54017a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:03.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.995+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 msgr2=0x7f5b5400e540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.995+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:03.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:03.995+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 0x7f5b5400e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:04.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:04.399+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54017a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:04.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:04.399+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54017a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:04.399+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:04.399+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 msgr2=0x7f5b5400e540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:04.399+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 0x7f5b5400e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:05.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:05.203+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54017a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:05.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:05.203+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54017a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:05.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:05.203+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:05.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:05.203+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 msgr2=0x7f5b5400e540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:05.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:05.203+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 0x7f5b5400e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 msgr2=0x7f5b5400e540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013e90 0x7f5b5400e540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54017a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:06.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54017a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b54010330 2023-11-04T02:00:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400f5e0 2023-11-04T02:00:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:06.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.795+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.999+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:06.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.999+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:06.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:06.999+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:07.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:07.403+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:07.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:07.403+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:07.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:07.403+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:08.207+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:08.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:08.207+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:08.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:08.207+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:09.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54010330 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400fd30 2023-11-04T02:00:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009fe0 2023-11-04T02:00:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400f5e0 2023-11-04T02:00:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.795+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.999+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.999+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.999+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.999+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:09.999+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:10.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:10.403+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:10.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:10.403+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:10.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:10.403+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:10.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:10.403+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:10.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:10.403+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:11.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:11.207+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:11.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:11.207+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:11.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:11.207+0000 7f5b76d02640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:11.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:11.207+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:11.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:11.207+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:12.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b540123e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:12.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b540123e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:12.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:12.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:12.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:12.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:12.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b54013e70 2023-11-04T02:00:12.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54010330 2023-11-04T02:00:12.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54013e70 legacy=0x7f5b5400e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:12.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:12.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.791+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:12.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.995+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54013e70 legacy=0x7f5b5400e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:12.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.995+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:12.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:12.995+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:13.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:13.399+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54013e70 legacy=0x7f5b5400e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:13.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:13.399+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:13.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:13.399+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:14.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:14.203+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54013e70 legacy=0x7f5b5400e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:14.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:14.203+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:14.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:14.203+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:15.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:15.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:15.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54013e70 legacy=0x7f5b5400e4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b54016320 2023-11-04T02:00:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400fd30 2023-11-04T02:00:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009fe0 2023-11-04T02:00:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54016320 legacy=0x7f5b54018710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.791+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:15.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.995+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54016320 legacy=0x7f5b54018710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:15.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.995+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:15.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.995+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:15.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:15.995+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:16.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:16.399+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54016320 legacy=0x7f5b54018710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:16.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:16.399+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:16.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:16.399+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:16.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:16.399+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:17.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:17.203+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54016320 legacy=0x7f5b54018710 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:17.203+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:17.203+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:17.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:17.203+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:18.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 msgr2=0x7f5b54012920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fe0 0x7f5b54012920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54016320 legacy=0x7f5b54018710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:18.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b54011200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400f5e0 2023-11-04T02:00:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54010330 2023-11-04T02:00:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:18.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b54011200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:18.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:18.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.795+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b54011200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.999+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.999+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b54011200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:18.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.999+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:18.999+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b54011200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:19.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:19.403+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:19.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:19.403+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b54011200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:19.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:19.403+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:19.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:19.403+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b54011200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:20.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:20.206+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b54011200 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:20.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:20.206+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:20.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:20.206+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b54011200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:20.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:20.206+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54010330 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b54011200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b54011200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:21.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b5400f5e0 2023-11-04T02:00:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400fd30 2023-11-04T02:00:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54011740 2023-11-04T02:00:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400e3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:21.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:21.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.794+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400e3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:21.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.998+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:21.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.998+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400e3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:21.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.998+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:21.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:21.998+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400e3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:22.402+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:22.402+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400e3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:22.402+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:22.402+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400e3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:23.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:23.206+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:23.206+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400e3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:23.206+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:23.206+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400e3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400e3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:24.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400e3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 0x7f5b5400add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009fb0 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400a960 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 msgr2=0x7f5b5400add0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:24.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.794+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 0x7f5b5400add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:24.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.998+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.998+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.998+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 msgr2=0x7f5b5400add0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:24.998+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 0x7f5b5400add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:25.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:25.402+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:25.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:25.402+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:25.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:25.402+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 msgr2=0x7f5b5400add0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:25.402+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 0x7f5b5400add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:26.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:26.206+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:26.206+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:26.206+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 msgr2=0x7f5b5400add0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:26.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:26.206+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 0x7f5b5400add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:26.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:00:26.444 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:00:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 msgr2=0x7f5b5400add0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400a960 0x7f5b5400add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:27.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400f5e0 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009fb0 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54011740 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:27.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:27.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.794+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:27.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.998+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.998+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.998+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.998+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:27.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:27.998+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:28.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:28.402+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:28.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:28.402+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:28.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:28.402+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:28.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:28.402+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:28.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:28.402+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:29.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:29.206+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:29.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:29.206+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:29.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:29.206+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:29.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:29.206+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:29.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:29.206+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:30.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 msgr2=0x7f5b5400d320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:30.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54011740 0x7f5b5400d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:30.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:30.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:30.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:30.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 0x7f5b5400ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:30.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b5400a960 2023-11-04T02:00:30.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400fd30 2023-11-04T02:00:30.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 msgr2=0x7f5b5400ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:30.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400a960 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:30.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.794+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 0x7f5b5400ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:30.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.998+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 msgr2=0x7f5b5400ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.998+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400a960 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:30.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:30.998+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 0x7f5b5400ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:31.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:31.402+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 msgr2=0x7f5b5400ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:31.402+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400a960 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:31.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:31.402+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 0x7f5b5400ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:32.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:32.206+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 msgr2=0x7f5b5400ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:32.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:32.206+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400a960 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:32.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:32.206+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 0x7f5b5400ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 msgr2=0x7f5b5400ad70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:33.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400fd30 0x7f5b5400ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400a960 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 0x7f5b54013350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400fd30 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009fb0 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400a960 2023-11-04T02:00:33.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 msgr2=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:33.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.794+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 0x7f5b54013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.998+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.998+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.998+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.998+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 msgr2=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:33.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:33.998+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 0x7f5b54013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:34.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:34.402+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:34.402+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:34.402+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:34.402+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 msgr2=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:34.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:34.402+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 0x7f5b54013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:35.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:35.206+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:35.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:35.206+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:35.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:35.206+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:35.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:35.206+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 msgr2=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:35.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:35.206+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 0x7f5b54013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:36.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 msgr2=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:36.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400a960 0x7f5b54013350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:36.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 msgr2=0x7f5b5400a420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:36.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009fb0 0x7f5b5400a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:36.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:36.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b540096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:36.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b54011cd0 2023-11-04T02:00:36.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400f5e0 2023-11-04T02:00:36.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540096b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:36.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54011cd0 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:36.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:36.798+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b540096b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:36.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:37.002+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540096b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:37.002+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54011cd0 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:36.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:37.002+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b540096b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:37.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:37.406+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540096b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:37.406+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54011cd0 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:37.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:37.406+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b540096b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:38.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:38.210+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54011cd0 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:38.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:38.210+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540096b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:38.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:38.210+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b540096b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:39.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540096b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:39.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400f5e0 0x7f5b540096b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:39.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54011cd0 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400fd30 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400f5e0 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54013350 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:39.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:39.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:39.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:39.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:39.798+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.002+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.002+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.002+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.002+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:39.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.002+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:40.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.406+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.406+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.406+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.406+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:40.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:40.406+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:41.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:41.210+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:41.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:41.210+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:41.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:41.210+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:41.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:41.210+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:41.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:41.210+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:42.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 0x7f5b5400e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b54009920 2023-11-04T02:00:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b540094e0 2023-11-04T02:00:42.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b54016260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:42.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 msgr2=0x7f5b5400e440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:42.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:42.798+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 0x7f5b5400e440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:42.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:43.002+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b54016260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:43.002+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 msgr2=0x7f5b5400e440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:42.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:43.002+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 0x7f5b5400e440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:43.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:43.406+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b54016260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:43.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:43.406+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 msgr2=0x7f5b5400e440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:43.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:43.406+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 0x7f5b5400e440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:44.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:44.210+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b54016260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:44.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:44.210+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 msgr2=0x7f5b5400e440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:44.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:44.210+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 0x7f5b5400e440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 msgr2=0x7f5b5400e440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b540094e0 0x7f5b5400e440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b54016260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 0x7f5b54019990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400fd30 2023-11-04T02:00:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54013350 2023-11-04T02:00:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54009d30 2023-11-04T02:00:45.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 msgr2=0x7f5b54019990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:45.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:45.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:45.798+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 0x7f5b54019990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.002+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.002+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 msgr2=0x7f5b54019990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.002+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.002+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 0x7f5b54019990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.002+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.406+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.406+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 msgr2=0x7f5b54019990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.406+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.406+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:46.406+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 0x7f5b54019990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:47.210+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:47.210+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 msgr2=0x7f5b54019990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:47.210+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:47.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:47.210+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:47.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:47.210+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 0x7f5b54019990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 msgr2=0x7f5b54019990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b54009d30 0x7f5b54019990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b54009920 2023-11-04T02:00:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400f5e0 2023-11-04T02:00:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:48.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:48.797+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:48.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:49.001+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:49.001+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:48.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:49.001+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:49.405+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:49.405+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:49.405+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:50.205 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:50.209+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:50.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:50.209+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:50.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:50.209+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:51.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:51.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b5400f5e0 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:51.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:51.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:51.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:51.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b54009920 2023-11-04T02:00:51.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b5400fd30 2023-11-04T02:00:51.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54013350 2023-11-04T02:00:51.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:51.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:51.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:51.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:51.797+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:51.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.001+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:51.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.001+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:51.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.001+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:51.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.001+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.405+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.405+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.405+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:52.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:52.405+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:53.209+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:00:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:53.209+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:53.209+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:53.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:53.209+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009920 legacy=0x7f5b5400c250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 0x7f5b540127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009d30 2023-11-04T02:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400f5e0 2023-11-04T02:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:54.797+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.001+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.001+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.001+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.001+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:55.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.405+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:55.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.405+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:55.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.405+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:55.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:55.405+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:56.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:56.209+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:00:56.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:56.209+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:56.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:56.209+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:56.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:56.209+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:56.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:00:56.494 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:00:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:57.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009d30 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400fd30 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54013350 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400f5e0 2023-11-04T02:00:57.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:57.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:57.797+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:00:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.001+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.001+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.001+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.001+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:57.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.001+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:00:58.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.405+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:58.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.405+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:58.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.405+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:58.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.405+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:58.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:58.405+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:00:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:59.209+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:00:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:59.209+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:00:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:59.209+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:00:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:59.209+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:00:59.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:00:59.209+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 msgr2=0x7f5b5400d970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:00.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400f5e0 0x7f5b5400d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400fd30 legacy=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b54009d30 2023-11-04T02:01:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009920 2023-11-04T02:01:00.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:00.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:00.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:00.797+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:00.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:01.001+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:00.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:01.001+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:00.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:01.001+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:01.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:01.405+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:01.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:01.405+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:01.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:01.405+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:02.206 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:02.209+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:02.209+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:02.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:02.209+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:01:03.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b54009d30 2023-11-04T02:01:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54009920 2023-11-04T02:01:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400fd30 2023-11-04T02:01:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:03.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:03.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:03.801+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.005+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.005+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.005+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:04.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.005+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:04.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.005+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:04.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.409+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:04.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.409+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:04.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.409+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:04.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.409+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:04.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:04.409+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:05.213+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:05.213+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:05.213+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:05.213+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:05.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:05.213+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:06.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 msgr2=0x7f5b540127f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54009920 0x7f5b540127f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54009d30 legacy=0x7f5b5400deb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 0x7f5b540120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400f5e0 2023-11-04T02:01:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b5400e5c0 2023-11-04T02:01:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:06.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:06.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:06.801+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:07.005+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:07.005+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:07.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:07.005+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:07.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:07.409+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:07.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:07.409+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:07.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:07.409+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:08.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:08.213+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:08.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:08.213+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:08.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:08.213+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b5400e5c0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400f5e0 legacy=0x7f5b54013350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:01:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400d260 2023-11-04T02:01:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54013350 2023-11-04T02:01:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400fd30 2023-11-04T02:01:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:09.801+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.005+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.005+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.005+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.005+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.005+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:10.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.409+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:10.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.409+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:10.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.409+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.409+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:10.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:10.409+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:11.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:11.213+0000 7f5b76d02640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:11.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:11.213+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:11.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:11.213+0000 7f5b75d00640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:11.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:11.213+0000 7f5b75d00640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:11.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:11.213+0000 7f5b76d02640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd30 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:12.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400dd50 2023-11-04T02:01:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b540120e0 2023-11-04T02:01:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.797+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:12.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:12.801+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:13.005+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:13.005+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:13.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:13.005+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:13.409+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:13.409+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:13.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:13.409+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:14.213+0000 7f5b76501640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:14.213+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:14.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:14.213+0000 7f5b76501640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:15.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400dd50 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b5400d260 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54013350 2023-11-04T02:01:15.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:15.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:15.800+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.004+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.004+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:16.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.004+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:16.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.004+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.408+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.408+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:16.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.408+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:16.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:16.408+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:17.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:17.212+0000 7f5b76d02640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:17.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:17.212+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:17.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:17.212+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:17.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:17.212+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400d260 legacy=0x7f5b5400d640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400dd50 legacy=0x7f5b5400e130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:18.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b540120e0 2023-11-04T02:01:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400fd00 2023-11-04T02:01:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:18.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:18.800+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.004+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:19.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.004+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.004+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:19.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.004+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:19.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.408+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:19.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.408+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:19.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.408+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:19.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:19.408+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:20.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:20.212+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:20.212+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:20.212+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:20.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:20.212+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:21.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:01:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b540120e0 2023-11-04T02:01:21.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54013350 2023-11-04T02:01:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54013210 con 0x7f5b5400fd00 2023-11-04T02:01:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:21.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:21.800+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.004+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:22.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.004+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:22.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.004+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:22.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.004+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:22.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.004+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:22.003 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.004+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.408+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.408+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.408+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.408+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.408+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:22.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:22.408+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:23.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:23.212+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:23.212+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:23.212+0000 7f5b76501640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:23.212+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:23.212+0000 7f5b76501640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:23.212+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b54009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b54009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 msgr2=0x7f5b540124c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:24.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b540120e0 0x7f5b540124c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:24.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b5400cd10 2023-11-04T02:01:24.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b5400c220 2023-11-04T02:01:24.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400cd10 legacy=0x7f5b5400d260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:24.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:24.800+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400c220 legacy=0x7f5b5400c600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:25.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:25.004+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400cd10 legacy=0x7f5b5400d260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:25.002 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:25.004+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400c220 legacy=0x7f5b5400c600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:25.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:25.408+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400cd10 legacy=0x7f5b5400d260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:25.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:25.408+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400c220 legacy=0x7f5b5400c600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:26.212+0000 7f5b75d00640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400cd10 legacy=0x7f5b5400d260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:26.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:26.212+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400c220 legacy=0x7f5b5400c600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:26.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:01:26.575 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:01:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b5400c220 legacy=0x7f5b5400c600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b5400cd10 legacy=0x7f5b5400d260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:27.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:01:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b540120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54012620 2023-11-04T02:01:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b54013350 2023-11-04T02:01:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54013210 con 0x7f5b5400fd00 2023-11-04T02:01:27.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:27.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:27.800+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.004+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.004+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.004+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:28.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.004+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.004+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:28.001 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.004+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.408+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.408+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:28.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.408+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.408+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.408+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:28.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:28.408+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:29.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:29.212+0000 7f5b76d02640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:29.212+0000 7f5b76d02640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:29.212+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:29.212+0000 7f5b76501640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:29.212+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:29.211 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:29.212+0000 7f5b76501640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b54013350 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:30.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b54011200 2023-11-04T02:01:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b70161790 con 0x7f5b540115e0 2023-11-04T02:01:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54011200 legacy=0x7f5b5400d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:30.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:30.800+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b540115e0 legacy=0x7f5b5400e030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:31.004+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54011200 legacy=0x7f5b5400d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:31.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:31.004+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b540115e0 legacy=0x7f5b5400e030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:31.408+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54011200 legacy=0x7f5b5400d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:31.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:31.408+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b540115e0 legacy=0x7f5b5400e030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:32.212+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54011200 legacy=0x7f5b5400d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:32.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:32.212+0000 7f5b75d00640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b540115e0 legacy=0x7f5b5400e030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b67fff640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b540115e0 legacy=0x7f5b5400e030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:33.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54011200 legacy=0x7f5b5400d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b76d02640 1 -- reap_dead start 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b67fff640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b3be0 con 0x7f5b54012a00 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b67fff640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b54012620 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b67fff640 1 -- --> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b54008cc0 con 0x7f5b5400fd00 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54012a00 legacy=0x7f5b5401a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:33.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:33.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:33.804+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.008+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:34.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.008+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54012a00 legacy=0x7f5b5401a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.008+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.008+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:34.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.008+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.412+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:34.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.412+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54012a00 legacy=0x7f5b5401a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.412+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.412+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:34.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:34.412+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:35.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:35.216+0000 7f5b75d00640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.2:3300/0 2023-11-04T02:01:35.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:35.216+0000 7f5b76501640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54012a00 legacy=0x7f5b5401a290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.2:6789/0 2023-11-04T02:01:35.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:35.216+0000 7f5b75d00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:35.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:35.216+0000 7f5b76d02640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3301/0 2023-11-04T02:01:35.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:35.216+0000 7f5b76d02640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:36.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 -- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 msgr2=0x7f5b54008f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.90:3301/0,v1:172.21.15.90:6790/0] conn(0x7f5b5400fd00 0x7f5b54008f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 -- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 msgr2=0x7f5b54010cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5b54012620 0x7f5b54010cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-04T02:01:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 -- >> v1:172.21.15.2:6789/0 conn(0x7f5b54012a00 legacy=0x7f5b5401a290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-04T02:01:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 0x7f5b540120e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-04T02:01:36.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b38b0 con 0x7f5b54013350 2023-11-04T02:01:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b67fff640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b4a40 con 0x7f5b540115e0 2023-11-04T02:01:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54013350 legacy=0x7f5b5400b910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:36.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:36.804+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-04T02:01:37.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:37.008+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54013350 legacy=0x7f5b5400b910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:37.006 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:37.008+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:37.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:37.008+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-04T02:01:37.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:37.412+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:37.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:37.412+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54013350 legacy=0x7f5b5400b910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:37.410 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:37.412+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-04T02:01:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:38.216+0000 7f5b75d00640 1 -- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 msgr2=0x7f5b540120e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.90:3300/0 2023-11-04T02:01:38.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:38.216+0000 7f5b76501640 1 -- >> v1:172.21.15.90:6789/0 conn(0x7f5b54013350 legacy=0x7f5b5400b910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.90:6789/0 2023-11-04T02:01:38.215 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-04T02:01:38.216+0000 7f5b75d00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b540115e0 0x7f5b540120e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-04T02:01:39.673 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-04T02:01:39.674 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T02:01:39.685 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-04T02:01:39.685 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-04T02:01:39.685 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T02:01:39.688 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-11-04T02:01:39.699 INFO:tasks.ceph.mds.a:Stopped 2023-11-04T02:01:39.699 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-04T02:01:39.699 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.699 INFO:tasks.ceph.mds.c:Stopped 2023-11-04T02:01:39.699 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-04T02:01:39.699 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.700 INFO:tasks.ceph.mds.b:Stopped 2023-11-04T02:01:39.700 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-04T02:01:39.700 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.700 INFO:tasks.ceph.mds.d:Stopped 2023-11-04T02:01:39.700 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-04T02:01:39.701 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-04T02:01:39.701 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.701 INFO:tasks.ceph.osd.0:Stopped 2023-11-04T02:01:39.701 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-04T02:01:39.702 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.702 INFO:tasks.ceph.osd.1:Stopped 2023-11-04T02:01:39.702 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-04T02:01:39.702 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.702 INFO:tasks.ceph.osd.2:Stopped 2023-11-04T02:01:39.703 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-04T02:01:39.703 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.703 INFO:tasks.ceph.osd.3:Stopped 2023-11-04T02:01:39.704 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-04T02:01:39.704 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.704 INFO:tasks.ceph.osd.4:Stopped 2023-11-04T02:01:39.704 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-04T02:01:39.705 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.705 INFO:tasks.ceph.osd.5:Stopped 2023-11-04T02:01:39.705 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-04T02:01:39.705 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.706 INFO:tasks.ceph.osd.6:Stopped 2023-11-04T02:01:39.707 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-04T02:01:39.707 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.707 INFO:tasks.ceph.osd.7:Stopped 2023-11-04T02:01:39.707 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-04T02:01:39.707 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-04T02:01:39.707 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T02:01:39.708 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-11-04T02:01:39.719 INFO:tasks.ceph.mgr.y:Stopped 2023-11-04T02:01:39.720 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-04T02:01:39.720 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.720 INFO:tasks.ceph.mgr.x:Stopped 2023-11-04T02:01:39.720 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-04T02:01:39.720 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-04T02:01:39.721 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.721 INFO:tasks.ceph.mon.a:Stopped 2023-11-04T02:01:39.721 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-04T02:01:39.721 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.722 INFO:tasks.ceph.mon.b:Stopped 2023-11-04T02:01:39.722 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-04T02:01:39.722 INFO:teuthology.orchestra.run:waiting for 300 2023-11-04T02:01:39.722 INFO:tasks.ceph.mon.c:Stopped 2023-11-04T02:01:39.722 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-04T02:01:39.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v RECENT_CRASH | head -n 1 2023-11-04T02:01:39.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T02:01:39.752 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-04T02:01:39.994 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T02:01:39.994 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-04T02:01:40.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T02:01:40.163 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-04T02:01:40.354 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T02:01:40.355 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-04T02:01:40.537 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T02:01:40.538 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-04T02:01:40.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T02:01:40.789 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-04T02:01:41.012 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T02:01:41.013 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-04T02:01:41.270 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T02:01:41.270 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-04T02:01:41.530 INFO:tasks.ceph:Archiving mon data... 2023-11-04T02:01:41.531 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/data/mon.a.tgz 2023-11-04T02:01:41.531 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2023-11-04T02:01:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.TtoZ1AgfBO 2023-11-04T02:01:41.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.TtoZ1AgfBO 2023-11-04T02:01:41.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.TtoZ1AgfBO 2023-11-04T02:01:41.739 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.TtoZ1AgfBO is 356KB 2023-11-04T02:01:41.800 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.TtoZ1AgfBO 2023-11-04T02:01:41.806 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/data/mon.b.tgz 2023-11-04T02:01:41.806 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2023-11-04T02:01:41.811 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.o60uMtQsYW 2023-11-04T02:01:41.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.o60uMtQsYW 2023-11-04T02:01:41.946 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.o60uMtQsYW 2023-11-04T02:01:42.009 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.o60uMtQsYW is 360KB 2023-11-04T02:01:42.070 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.o60uMtQsYW 2023-11-04T02:01:42.076 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/data/mon.c.tgz 2023-11-04T02:01:42.076 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2023-11-04T02:01:42.129 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.Lst7xaufnU 2023-11-04T02:01:42.129 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Lst7xaufnU 2023-11-04T02:01:42.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.Lst7xaufnU 2023-11-04T02:01:42.333 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.Lst7xaufnU is 360KB 2023-11-04T02:01:42.395 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.Lst7xaufnU 2023-11-04T02:01:42.400 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-04T02:01:42.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T02:01:42.403 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-04T02:01:42.458 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-04T02:01:42.458 DEBUG:teuthology.orchestra.run.smithi002:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T02:01:42.460 DEBUG:teuthology.orchestra.run.smithi090:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-04T02:01:42.486 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T02:01:42.525 INFO:teuthology.orchestra.run.smithi090.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-04T02:01:42.529 INFO:tasks.ceph:Archiving crash dumps... 2023-11-04T02:01:42.531 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/remote/smithi002/crash 2023-11-04T02:01:42.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T02:01:42.622 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/remote/smithi090/crash 2023-11-04T02:01:42.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-04T02:01:42.672 INFO:tasks.ceph:Shutting down logrotate 2023-11-04T02:01:42.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:01:42.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-04T02:01:42.751 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T02:01:42.765 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-04T02:01:42.804 INFO:tasks.ceph:Compressing logs... 2023-11-04T02:01:42.805 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T02:01:42.807 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-04T02:01:42.818 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58473.log 2023-11-04T02:01:42.819 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2023-11-04T02:01:42.820 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51904.log 2023-11-04T02:01:42.820 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58473.log.gz 2023-11-04T02:01:42.821 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54021.log 2023-11-04T02:01:42.821 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2023-11-04T02:01:42.821 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56684.log 2023-11-04T02:01:42.823 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51904.log.gz 2023-11-04T02:01:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.54021.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49960.log 2023-11-04T02:01:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43473.log 2023-11-04T02:01:42.823 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54021.log.gz 2023-11-04T02:01:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49960.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.56684.log.gz -- 2023-11-04T02:01:42.823 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.47346.log 2023-11-04T02:01:42.824 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49960.log.gz 2023-11-04T02:01:42.824 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57157.log 2023-11-04T02:01:42.824 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47346.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43473.log.gzgzip 2023-11-04T02:01:42.824 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56604.log 2023-11-04T02:01:42.824 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57157.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47346.log.gz 2023-11-04T02:01:42.824 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58571.log 2023-11-04T02:01:42.832 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57157.log.gz 2023-11-04T02:01:42.832 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52209.log 2023-11-04T02:01:42.832 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56243.log 2023-11-04T02:01:42.832 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58571.log.gz 2023-11-04T02:01:42.832 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51037.log 2023-11-04T02:01:42.832 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56604.log.gz 2023-11-04T02:01:42.832 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52209.log.gz 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.56243.log: -- /var/log/ceph/ceph-client.admin.47856.log 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51037.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56243.log.gz 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46649.log 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51037.log.gz 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54728.log 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46649.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47856.log.gz -5 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55654.log 2023-11-04T02:01:42.833 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54728.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46649.log.gz 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54203.log 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54728.log.gz 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52445.log 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55654.log.gz 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55976.log 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54203.log.gz 2023-11-04T02:01:42.834 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45775.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52445.log.gz 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56528.log 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54047.log 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60870.log 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55976.log.gz 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54047.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56528.log.gz 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48064.log 2023-11-04T02:01:42.835 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54047.log.gz 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50291.log 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60870.log.gz 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.48064.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53863.log 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50064.log 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48064.log.gz 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50291.log.gz 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52627.log 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53863.log.gz 2023-11-04T02:01:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50064.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-04T02:01:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52627.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50064.log.gz 2023-11-04T02:01:42.837 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53941.log 2023-11-04T02:01:42.848 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52627.log.gz 2023-11-04T02:01:42.848 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53837.log 2023-11-04T02:01:42.848 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48618.log 2023-11-04T02:01:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53837.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53941.log.gz 2023-11-04T02:01:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59551.log 2023-11-04T02:01:42.849 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53837.log.gz 2023-11-04T02:01:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54676.log 2023-11-04T02:01:42.849 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48618.log.gz 2023-11-04T02:01:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55706.log 2023-11-04T02:01:42.849 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59551.log: /var/log/ceph/ceph-client.admin.54676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55836.log 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59551.log.gz 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55706.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54676.log.gz 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49899.log 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55836.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55706.log.gz 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60661.log 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52706.log 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55836.log.gz 2023-11-04T02:01:42.850 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60661.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49899.log.gz 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52817.log 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60661.log.gz 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52895.log 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52706.log.gz 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52817.log: /var/log/ceph/ceph-client.admin.52895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56471.log 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52817.log.gz 2023-11-04T02:01:42.851 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52895.log.gz 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49216.log 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50116.log 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56471.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49216.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56471.log.gz 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59948.log 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49216.log.gz 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60243.log 2023-11-04T02:01:42.852 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44383.log 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50116.log.gz 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59948.log.gz 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58767.log 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58067.log 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60243.log.gz 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58767.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44383.log.gz 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46857.log 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58767.log.gz 2023-11-04T02:01:42.853 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.58067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46435.log 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58822.log 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54858.log 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46857.log.gz 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46435.log.gz 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49512.log 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58822.log: /var/log/ceph/ceph-client.admin.54858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58885.log 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58822.log.gz 2023-11-04T02:01:42.854 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50220.log 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49512.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54858.log.gz 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52789.log 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.58067.log.gz 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58885.log.gz 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49512.log.gz 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58601.log 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50220.log: /var/log/ceph/ceph-client.admin.52789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55898.log 2023-11-04T02:01:42.855 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52789.log.gz 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58601.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50220.log.gz 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50396.log 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58601.log.gz 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60078.log 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55898.log: /var/log/ceph/ceph-client.admin.50396.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55898.log.gz 2023-11-04T02:01:42.856 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50396.log.gz 2023-11-04T02:01:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2023-11-04T02:01:42.857 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60078.log.gz 2023-11-04T02:01:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59623.log 2023-11-04T02:01:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58852.log 2023-11-04T02:01:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.59623.log: --verbose -- /var/log/ceph/ceph-client.admin.38019.log 2023-11-04T02:01:42.857 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2023-11-04T02:01:42.857 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58852.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59623.log.gz 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54963.log 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58852.log.gz 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46513.log 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38019.log: /var/log/ceph/ceph-client.0.54963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46623.log 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.38019.log.gz 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57094.log 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46513.log.gz 2023-11-04T02:01:42.858 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59403.log 2023-11-04T02:01:42.873 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43526.log 2023-11-04T02:01:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38343.log 2023-11-04T02:01:42.874 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.1.43526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38391.log 2023-11-04T02:01:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38247.log 2023-11-04T02:01:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38343.log: 90.7% -- replaced with /var/log/ceph/ceph-client.1.43526.log.gz 2023-11-04T02:01:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38391.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-04T02:01:42.885 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38391.log.gz 2023-11-04T02:01:42.885 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38343.log.gz 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38247.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38247.log.gz 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43636.log 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.3.43636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38415.log 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38415.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T02:01:42.886 INFO:teuthology.orchestra.run.smithi090.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.3.43636.log.gz 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38415.log.gz 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38319.log 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38271.log 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38319.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38319.log.gz 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38271.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38271.log.gz 2023-11-04T02:01:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-04T02:01:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-04T02:01:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.d.log: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T02:01:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-04T02:01:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.b.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T02:01:42.891 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-04T02:01:42.910 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38367.log 2023-11-04T02:01:42.917 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38295.log 2023-11-04T02:01:42.917 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38367.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38367.log.gz 2023-11-04T02:01:42.922 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38295.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38295.log.gz 2023-11-04T02:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57094.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46623.log.gz 2023-11-04T02:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43956.log 2023-11-04T02:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57094.log.gz 2023-11-04T02:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48819.log 2023-11-04T02:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59403.log: /var/log/ceph/ceph-client.admin.43956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2023-11-04T02:01:42.935 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59403.log.gz 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43956.log.gz 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46224.log 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48819.log.gz 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55479.log 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51501.log 2023-11-04T02:01:42.936 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46224.log.gz 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43499.log: /var/log/ceph/ceph-client.admin.55479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55132.log 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55479.log.gz 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57269.log 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55132.log: 84.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.51501.log.gz -5 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50370.log 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60192.log 2023-11-04T02:01:42.937 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55132.log.gz 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50370.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57269.log.gz 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51089.log 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50370.log.gz 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52510.log 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.60192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52008.log 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51089.log: /var/log/ceph/ceph-client.admin.52510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59377.log 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52510.log.gz 2023-11-04T02:01:42.938 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51089.log.gz 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47700.log 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52008.log: /var/log/ceph/ceph-client.admin.59377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57295.log 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52008.log.gz 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59377.log.gz 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53577.log 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47700.log: /var/log/ceph/ceph-client.admin.57295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52654.log 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57295.log.gz 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47700.log.gz 2023-11-04T02:01:42.939 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45690.log 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53577.log: /var/log/ceph/ceph-client.admin.52654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48193.log 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52654.log.gz 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53577.log.gz 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59429.log 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45690.log: /var/log/ceph/ceph-client.admin.48193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46701.log 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48193.log.gz 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45690.log.gz 2023-11-04T02:01:42.940 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59015.log 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59429.log: /var/log/ceph/ceph-client.admin.46701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54624.log 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46701.log.gz 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59429.log.gz 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59015.log: /var/log/ceph/ceph-client.admin.54624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46068.log 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59015.log.gz 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54624.log.gz 2023-11-04T02:01:42.941 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56968.log 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57820.log 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46068.log.gz 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56968.log.gz 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47202.log 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.57820.log: --verbose -- /var/log/ceph/ceph-client.admin.48514.log 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47202.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57820.log.gz 2023-11-04T02:01:42.942 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48514.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47202.log.gz 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56407.log 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48514.log.gz 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48039.log 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47586.log: /var/log/ceph/ceph-client.admin.56407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48039.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56407.log.gz 2023-11-04T02:01:42.943 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56381.log 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51167.log 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57729.log 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56381.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60104.log 2023-11-04T02:01:42.944 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56381.log.gz 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57729.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51167.log.gz 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52732.log 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57729.log.gz 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57464.log 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59312.log 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60104.log.gz 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.52732.log.gz --verbose 2023-11-04T02:01:42.945 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.57494.log 2023-11-04T02:01:42.946 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57464.log: /var/log/ceph/ceph-client.admin.59312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51115.log 2023-11-04T02:01:42.946 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57464.log.gz 2023-11-04T02:01:42.946 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59312.log.gz 2023-11-04T02:01:42.946 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.54963.log.gz 2023-11-04T02:01:42.946 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57597.log 2023-11-04T02:01:42.946 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57494.log: 95.4% -- replaced with /var/log/ceph/ceph-client.0.60192.log.gz 2023-11-04T02:01:42.946 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59892.log 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51115.log.gz 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57494.log.gz 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45586.log 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57597.log.gz 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59892.log.gz 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54516.log 2023-11-04T02:01:42.947 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53707.log 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45586.log.gz 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54516.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz /var/log/ceph/ceph-client.admin.51476.log 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54516.log.gz 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50012.log 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45132.log 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53707.log.gz 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57623.log 2023-11-04T02:01:42.948 INFO:teuthology.orchestra.run.smithi002.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.51476.log.gz 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50012.log.gz 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58545.log 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45132.log.gz 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48897.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57623.log.gz 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51713.log 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2023-11-04T02:01:42.949 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2023-11-04T02:01:42.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59491.log 2023-11-04T02:01:42.950 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58545.log.gz 2023-11-04T02:01:42.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45742.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51713.log.gz 2023-11-04T02:01:42.950 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2023-11-04T02:01:42.950 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz 2023-11-04T02:01:42.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2023-11-04T02:01:42.950 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44171.log 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59491.log.gz 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44176.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46753.log 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.44171.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45378.log 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48488.log 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44171.log.gz 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45378.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46753.log.gz 2023-11-04T02:01:42.951 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55299.log 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45378.log.gz 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57675.log 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59068.log 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48488.log.gz 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57675.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55299.log.gz 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57675.log.gz 2023-11-04T02:01:42.952 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57928.log 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51526.log 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59068.log.gz 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57928.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47293.log 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57928.log.gz 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52261.log 2023-11-04T02:01:42.953 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51526.log.gz 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47319.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47293.log.gz 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45879.log 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52261.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52261.log.gz 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.2.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45879.log.gz 2023-11-04T02:01:42.954 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60635.log 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45220.log 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59100.log 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60635.log.gz 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45220.log: /var/log/ceph/ceph-client.admin.54832.log 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59522.log 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45220.log.gz 2023-11-04T02:01:42.955 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54832.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59100.log.gz 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55584.log 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54832.log.gz 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59974.log 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59522.log.gz 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55584.log.gz 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57131.log 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48660.log 2023-11-04T02:01:42.956 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59974.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50194.log 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59974.log.gz 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54780.log 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57131.log.gz 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48660.log.gz 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44617.log 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50194.log.gz 2023-11-04T02:01:42.957 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60792.log 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58715.log 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54780.log.gz 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60792.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44617.log.gz 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54438.log 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60792.log.gz 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52235.log 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47452.log 2023-11-04T02:01:42.958 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58715.log.gz 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54438.log: /var/log/ceph/ceph-client.admin.52235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58224.log 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54438.log.gz 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52235.log.gz 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55558.log 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58224.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47452.log.gz 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55558.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58224.log.gz 2023-11-04T02:01:42.959 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59740.log 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55558.log.gz 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56091.log 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51269.log 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59740.log: /var/log/ceph/ceph-client.admin.56091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56091.log.gz 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51269.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59740.log.gz 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2023-11-04T02:01:42.960 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53266.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51269.log.gz 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60000.log 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47620.log 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43551.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60000.log.gz 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55331.log 2023-11-04T02:01:42.961 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47620.log.gz 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59349.log 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55331.log.gz 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60687.log 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2023-11-04T02:01:42.962 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51429.log 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59349.log.gz 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43754.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60687.log.gz 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49847.log 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 88.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz /var/log/ceph/ceph-client.admin.46276.log 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50791.log 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49847.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.51429.log.gz 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51557.log 2023-11-04T02:01:42.963 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43969.log/var/log/ceph/ceph-client.admin.50791.log: 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46276.log.gz 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49847.log.gz 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2%/var/log/ceph/ceph-client.admin.51557.log: -- replaced with /var/log/ceph/ceph-client.admin.50791.log.gz 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48962.log 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43969.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51557.log.gz 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43953.log 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43969.log.gz 2023-11-04T02:01:42.964 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58012.log 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53025.log 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48962.log.gz 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60557.log 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43953.log.gz 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54598.log 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58012.log.gz 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53025.log.gz 2023-11-04T02:01:42.965 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44643.log 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60557.log: /var/log/ceph/ceph-client.admin.54598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60557.log.gz 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44643.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49030.log 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54598.log.gz 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44643.log.gz 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49030.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2023-11-04T02:01:42.966 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60583.log 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49030.log.gz 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52601.log: /var/log/ceph/ceph-client.admin.60583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45638.log 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60818.log 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60583.log.gz 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45638.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gz 2023-11-04T02:01:42.967 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57649.log 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45638.log.gz 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56800.log 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60818.log: /var/log/ceph/ceph-client.admin.57649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49486.log 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60818.log.gz 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56800.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57649.log.gz 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43155.log 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56800.log.gz 2023-11-04T02:01:42.968 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49486.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33165.log 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43155.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49486.log.gz 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45274.log 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43155.log.gz 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46727.log 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.33165.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33165.log.gz 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50422.log 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59866.log 2023-11-04T02:01:42.969 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45274.log.gz 2023-11-04T02:01:42.970 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46727.log.gz 2023-11-04T02:01:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48167.log 2023-11-04T02:01:42.970 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50422.log.gzgzip 2023-11-04T02:01:42.970 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45168.log 2023-11-04T02:01:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59866.log: /var/log/ceph/ceph-client.admin.48167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60740.log 2023-11-04T02:01:42.970 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59866.log.gz 2023-11-04T02:01:42.970 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59206.log 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48167.log.gz 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45168.log: /var/log/ceph/ceph-client.admin.60740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59840.log 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45168.log.gz 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60740.log.gz 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45482.log 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59597.log 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59206.log.gz 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49738.log 2023-11-04T02:01:42.971 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59840.log.gz 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45482.log.gz 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57792.log/var/log/ceph/ceph-client.admin.59597.log: 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55019.log 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49738.log: 88.8%/var/log/ceph/ceph-client.admin.57792.log: -- replaced with /var/log/ceph/ceph-client.admin.59597.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59455.log 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49738.log.gz 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55019.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.57792.log.gz -5 2023-11-04T02:01:42.972 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59649.log 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59455.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55019.log.gz 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59455.log.gz 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54177.log 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45194.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59649.log.gz 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44157.log 2023-11-04T02:01:42.973 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57386.log 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48715.log 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54177.log.gz 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44157.log: /var/log/ceph/ceph-client.admin.57386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59155.log 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44157.log.gz 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60437.log 2023-11-04T02:01:42.974 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57386.log.gz 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.59155.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48715.log.gz 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47882.log 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60437.log.gz -5/var/log/ceph/ceph-client.admin.47882.log: 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53103.log 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2023-11-04T02:01:42.975 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44925.log 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47882.log.gz 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47804.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.53103.log.gz 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.59155.log.gz 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53153.log 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.44925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43037.log 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53785.log 2023-11-04T02:01:42.976 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43037.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53153.log.gz 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43037.log.gz 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46487.log 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.44925.log.gz 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53785.log.gz 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.44409.log: --verbose -- /var/log/ceph/ceph-client.admin.51376.log 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51324.log 2023-11-04T02:01:42.977 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2023-11-04T02:01:42.978 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46487.log.gz 2023-11-04T02:01:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47752.log 2023-11-04T02:01:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.51324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43965.log 2023-11-04T02:01:42.978 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51376.log.gz 2023-11-04T02:01:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38128.log 2023-11-04T02:01:42.978 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47752.log.gz 2023-11-04T02:01:42.978 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56295.log 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.0.51324.log.gz 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43965.log.gz 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38128.log.gz 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52289.log 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2023-11-04T02:01:42.979 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38254.log: /var/log/ceph/ceph-client.admin.50474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48767.log 2023-11-04T02:01:42.980 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2023-11-04T02:01:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52289.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz 2023-11-04T02:01:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47672.log 2023-11-04T02:01:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51878.log 2023-11-04T02:01:42.980 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52289.log.gz 2023-11-04T02:01:42.980 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48767.log.gz 2023-11-04T02:01:42.980 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58261.log 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51878.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47672.log.gz 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43421.log 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51878.log.gz 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54754.log 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43421.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58261.log.gz 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2023-11-04T02:01:42.981 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 2023-11-04T02:01:42.982 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2023-11-04T02:01:42.982 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log 2023-11-04T02:01:42.982 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54754.log: /var/log/ceph/ceph-client.admin.50344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45326.log 2023-11-04T02:01:42.982 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54754.log.gz 2023-11-04T02:01:42.982 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz/var/log/ceph/ceph-client.admin.49056.log: 2023-11-04T02:01:42.982 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48930.log 2023-11-04T02:01:42.982 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56654.log 2023-11-04T02:01:42.983 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2023-11-04T02:01:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51661.log 2023-11-04T02:01:42.983 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45326.log.gz 2023-11-04T02:01:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56654.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48930.log.gz 2023-11-04T02:01:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59788.log 2023-11-04T02:01:42.983 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51661.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-04T02:01:42.983 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56654.log.gz 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59788.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.51661.log.gz 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46356.log 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59788.log.gz 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45560.log 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48089.log 2023-11-04T02:01:42.984 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46356.log: /var/log/ceph/ceph-client.admin.45560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52419.log 2023-11-04T02:01:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48089.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53464.log 2023-11-04T02:01:42.985 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45560.log.gz 2023-11-04T02:01:42.985 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46356.log.gz 2023-11-04T02:01:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52419.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2023-11-04T02:01:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52947.log 2023-11-04T02:01:42.985 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52419.log.gz 2023-11-04T02:01:42.985 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2023-11-04T02:01:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53464.log: /var/log/ceph/ceph-client.admin.52947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58911.log 2023-11-04T02:01:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48462.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52947.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51011.log 2023-11-04T02:01:42.986 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:42.986 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53464.log.gz 2023-11-04T02:01:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58911.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2023-11-04T02:01:42.986 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2023-11-04T02:01:42.986 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58911.log.gz 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60410.log 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51011.log: /var/log/ceph/ceph-client.admin.45932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52086.log 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51011.log.gz 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52086.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47558.log 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60410.log.gz 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52086.log.gz 2023-11-04T02:01:42.987 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50959.log: /var/log/ceph/ceph-client.admin.47558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48332.log 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47426.log 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47558.log.gz 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48540.log 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48332.log.gz 2023-11-04T02:01:42.988 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47372.log 2023-11-04T02:01:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58663.log 2023-11-04T02:01:42.989 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47426.log.gz 2023-11-04T02:01:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47372.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48540.log.gz 2023-11-04T02:01:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2023-11-04T02:01:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53295.log 2023-11-04T02:01:42.989 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47372.log.gz 2023-11-04T02:01:42.989 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51774.log 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58663.log.gz 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46779.log: /var/log/ceph/ceph-client.admin.53295.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53295.log.gz 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51774.log: /var/log/ceph/ceph-client.admin.44747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47170.log 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51193.log 2023-11-04T02:01:42.990 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51774.log.gz 2023-11-04T02:01:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47170.log: 88.6% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2023-11-04T02:01:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54544.log 2023-11-04T02:01:42.991 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2023-11-04T02:01:42.991 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47170.log.gz 2023-11-04T02:01:42.991 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51193.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51193.log.gz 2023-11-04T02:01:42.992 INFO:teuthology.orchestra.run.smithi090.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-04T02:01:43.006 INFO:teuthology.orchestra.run.smithi090.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-04T02:01:43.055 INFO:teuthology.orchestra.run.smithi090.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-04T02:01:43.059 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50819.log 2023-11-04T02:01:43.059 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46935.log 2023-11-04T02:01:43.059 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54544.log: /var/log/ceph/ceph-client.admin.50819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53759.log 2023-11-04T02:01:43.059 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55045.log 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54544.log.gz 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50819.log.gz 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53759.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46935.log.gz 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58519.log 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53759.log.gz 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54412.log 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55045.log: /var/log/ceph/ceph-client.admin.58519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46330.log 2023-11-04T02:01:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58689.log 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58519.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55045.log.gz 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46330.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54412.log.gz 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43128.log 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46330.log.gz 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58689.log: /var/log/ceph/ceph-client.admin.43128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55182.log 2023-11-04T02:01:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45984.log 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58689.log.gz 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43128.log.gz 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51454.log 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61083.log 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45984.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55182.log.gz 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51454.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45984.log.gz 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51454.log.gz 2023-11-04T02:01:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56433.log 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61083.log: /var/log/ceph/ceph-client.admin.56433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58365.log 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56433.log.gz 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54572.log 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58365.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58365.log.gz 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45853.log 2023-11-04T02:01:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49382.log 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45853.log: 89.1% 95.7% -- replaced with /var/log/ceph/ceph-client.admin.54572.log.gz -- replaced with /var/log/ceph/ceph-client.admin.61083.log.gz 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45853.log.gz 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57241.log 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53551.log 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49382.log: /var/log/ceph/ceph-client.admin.57241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44513.log 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53551.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49382.log.gz 2023-11-04T02:01:43.064 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57241.log.gz 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51956.log 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53551.log.gz 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57902.log 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44513.log: /var/log/ceph/ceph-client.admin.51956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57902.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51956.log.gz 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57902.log.gz 2023-11-04T02:01:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55680.log 2023-11-04T02:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2023-11-04T02:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43964.log: /var/log/ceph/ceph-client.admin.55680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58401.log 2023-11-04T02:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43707.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2023-11-04T02:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55680.log.gz 2023-11-04T02:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55950.log 2023-11-04T02:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2023-11-04T02:01:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58401.log: /var/log/ceph/ceph-client.admin.55950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53655.log 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43259.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58401.log.gz 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55950.log.gz 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49356.log 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58168.log 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53655.log: /var/log/ceph/ceph-client.admin.49356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57846.log 2023-11-04T02:01:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58168.log: 87.7% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53655.log.gz 2023-11-04T02:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49356.log.gz 2023-11-04T02:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58168.log.gz 2023-11-04T02:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48566.log 2023-11-04T02:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55447.log 2023-11-04T02:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57846.log: /var/log/ceph/ceph-client.admin.48566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56355.log 2023-11-04T02:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55447.log: 88.8% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57846.log.gz 2023-11-04T02:01:43.068 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48566.log.gz 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55447.log.gz 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52843.log 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55862.log 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58741.log 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56355.log.gz 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55862.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52843.log.gz 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56774.log 2023-11-04T02:01:43.069 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55862.log.gz 2023-11-04T02:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58741.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58741.log.gz 2023-11-04T02:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2023-11-04T02:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61000.log 2023-11-04T02:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56774.log: /var/log/ceph/ceph-client.admin.44461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47014.log 2023-11-04T02:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61000.log: 87.8% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56774.log.gz 2023-11-04T02:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2023-11-04T02:01:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57321.log 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53077.log 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47014.log: /var/log/ceph/ceph-client.admin.57321.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57321.log.gz 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51687.log 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53437.log 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53077.log: 95.6%/var/log/ceph/ceph-client.admin.51687.log: -- replaced with /var/log/ceph/ceph-client.admin.61000.log.gz 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53077.log.gz 2023-11-04T02:01:43.071 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51687.log.gz 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57571.log 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55924.log 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57571.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53437.log.gz -5 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57044.log 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55924.log: -- replaced with /var/log/ceph/ceph-client.admin.57571.log.gz 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55924.log.gz 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54806.log 2023-11-04T02:01:43.072 INFO:teuthology.orchestra.run.smithi002.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.57044.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57438.log 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44174.log: /var/log/ceph/ceph-client.admin.54806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57438.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54806.log.gz 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56863.log 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57438.log.gz 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54464.log 2023-11-04T02:01:43.073 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46675.log: /var/log/ceph/ceph-client.admin.56863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45906.log 2023-11-04T02:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2023-11-04T02:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54464.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56863.log.gz 2023-11-04T02:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48271.log 2023-11-04T02:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54464.log.gz 2023-11-04T02:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2023-11-04T02:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45906.log: /var/log/ceph/ceph-client.admin.48271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49934.log 2023-11-04T02:01:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49250.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48271.log.gz 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45906.log.gz 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45300.log 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56269.log 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49934.log: /var/log/ceph/ceph-client.admin.45300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45456.log 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56269.log: 89.4% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49934.log.gz 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45300.log.gz 2023-11-04T02:01:43.075 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56269.log.gz 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58434.log 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57703.log 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45456.log: /var/log/ceph/ceph-client.admin.58434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51219.log 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57703.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45456.log.gz 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58434.log.gz 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57703.log.gz 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2023-11-04T02:01:43.076 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51219.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49188.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51219.log.gz 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59922.log 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51826.log 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49873.log: /var/log/ceph/ceph-client.admin.59922.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59922.log.gz 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-11-04T02:01:43.077 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60136.log 2023-11-04T02:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60609.log 2023-11-04T02:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51826.log: /var/log/ceph/ceph-client.admin.60136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52999.log 2023-11-04T02:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60609.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51826.log.gz 2023-11-04T02:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60136.log.gz 2023-11-04T02:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58198.log 2023-11-04T02:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60609.log.gz 2023-11-04T02:01:43.078 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58989.log 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52999.log: /var/log/ceph/ceph-client.admin.58198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45612.log 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58989.log: 88.0% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52999.log.gz 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58198.log.gz 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58989.log.gz 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55622.log 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59701.log 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45612.log: /var/log/ceph/ceph-client.admin.55622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44669.log 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59701.log: 88.2% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55622.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45612.log.gz 2023-11-04T02:01:43.079 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59701.log.gz 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52138.log 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44669.log: /var/log/ceph/ceph-client.admin.52138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52393.log 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43343.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44669.log.gz 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52138.log.gz 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50317.log 2023-11-04T02:01:43.080 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52393.log: /var/log/ceph/ceph-client.admin.50317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44173.log 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44695.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52393.log.gz 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50317.log.gz 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52575.log 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49713.log 2023-11-04T02:01:43.081 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44173.log: /var/log/ceph/ceph-client.admin.52575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46597.log 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49713.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44173.log.gz 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52575.log.gz 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49713.log.gz 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52367.log 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45061.log 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46597.log: /var/log/ceph/ceph-client.admin.52367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.2.45061.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52367.log.gz 2023-11-04T02:01:43.082 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46597.log.gz 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60026.log 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57954.log 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49108.log: 91.4%/var/log/ceph/ceph-client.admin.60026.log: -- replaced with /var/log/ceph/ceph-client.2.45061.log.gz 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60026.log.gz 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47092.log 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52183.log 2023-11-04T02:01:43.083 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57954.log: /var/log/ceph/ceph-client.admin.47092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55505.log 2023-11-04T02:01:43.084 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52183.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57954.log.gz 2023-11-04T02:01:43.084 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47092.log.gz 2023-11-04T02:01:43.084 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55806.log 2023-11-04T02:01:43.084 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52183.log.gz 2023-11-04T02:01:43.084 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60896.log 2023-11-04T02:01:43.084 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55505.log: /var/log/ceph/ceph-client.admin.55806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46909.log 2023-11-04T02:01:43.084 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60896.log: 88.5% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55505.log.gz 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55806.log.gz 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60896.log.gz 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43629.log 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47646.log 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46909.log: /var/log/ceph/ceph-client.admin.43629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45106.log 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47646.log: 88.5% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46909.log.gz 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43629.log.gz 2023-11-04T02:01:43.085 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47726.log 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45106.log: /var/log/ceph/ceph-client.admin.47726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58118.log 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43743.log: 88.5% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45106.log.gz 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47726.log.gz 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54358.log 2023-11-04T02:01:43.086 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60322.log 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58118.log: /var/log/ceph/ceph-client.admin.54358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58937.log 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60322.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54358.log.gz 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60322.log.gz 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58118.log.gz 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49795.log 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60766.log 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58937.log: /var/log/ceph/ceph-client.admin.49795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56746.log 2023-11-04T02:01:43.087 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60766.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58937.log.gz 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49795.log.gz 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56827.log 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60766.log.gz 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53490.log 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56746.log: /var/log/ceph/ceph-client.admin.56827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48219.log 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53490.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56746.log.gz 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56827.log.gz 2023-11-04T02:01:43.088 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53333.log 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53490.log.gz 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48219.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48219.log.gz 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60713.log 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58963.log 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53333.log: /var/log/ceph/ceph-client.admin.60713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58963.log: 87.5% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53333.log.gz 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60713.log.gz 2023-11-04T02:01:43.089 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58963.log.gz 2023-11-04T02:01:43.090 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2023-11-04T02:01:43.090 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45664.log 2023-11-04T02:01:43.090 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49434.log: /var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45801.log 2023-11-04T02:01:43.090 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4%/var/log/ceph/ceph-client.admin.45664.log: -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2023-11-04T02:01:43.090 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz 2023-11-04T02:01:43.090 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45664.log.gz 2023-11-04T02:01:43.090 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53516.log 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45801.log: /var/log/ceph/ceph-client.admin.53516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44149.log: 87.6% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45801.log.gz 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53516.log.gz 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50142.log 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49276.log 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46539.log: /var/log/ceph/ceph-client.admin.50142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57183.log 2023-11-04T02:01:43.091 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49276.log: 89.1% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50142.log.gz 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49276.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53967.log 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46304.log 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57183.log: /var/log/ceph/ceph-client.admin.53967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48410.log 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46304.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57183.log.gz 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53967.log.gz 2023-11-04T02:01:43.092 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57980.log 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46304.log.gz 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55079.log 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48410.log: /var/log/ceph/ceph-client.admin.57980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52315.log 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55079.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48410.log.gz 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57980.log.gz 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58339.log 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55079.log.gz 2023-11-04T02:01:43.093 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52315.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52315.log.gz 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56994.log 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51930.log 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58339.log: /var/log/ceph/ceph-client.admin.56994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56193.log 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51930.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58339.log.gz 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60491.log 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr: 91.1% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51930.log.gz 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56994.log.gz 2023-11-04T02:01:43.094 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56193.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.56193.log.gz 2023-11-04T02:01:43.095 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59286.log 2023-11-04T02:01:43.095 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45246.log 2023-11-04T02:01:43.095 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60491.log: /var/log/ceph/ceph-client.admin.59286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2023-11-04T02:01:43.095 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45246.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60491.log.gz 2023-11-04T02:01:43.095 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59286.log.gz 2023-11-04T02:01:43.095 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2023-11-04T02:01:43.095 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45246.log.gz 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52478.log 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58287.log 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52478.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52478.log.gz 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2023-11-04T02:01:43.096 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46198.log 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58287.log.gz 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48845.log: /var/log/ceph/ceph-client.admin.46382.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45508.log 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55391.log 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45508.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45958.log 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46198.log.gz 2023-11-04T02:01:43.097 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45508.log.gz 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48136.log 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55391.log: /var/log/ceph/ceph-client.admin.45958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60844.log 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48136.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55391.log.gz 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45958.log.gz 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 86.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48136.log.gz -- 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.60052.log 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60844.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60844.log.gz 2023-11-04T02:01:43.098 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50735.log 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60052.log: /var/log/ceph/ceph-client.admin.48741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58793.log 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50735.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60052.log.gz 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52758.log 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50735.log.gz 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58793.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.58793.log.gz 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50168.log 2023-11-04T02:01:43.099 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51635.log 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52758.log: /var/log/ceph/ceph-client.admin.50168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54908.log 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51635.log: 88.5% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52758.log.gz 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50168.log.gz 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51635.log.gz 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51800.log 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53995.log 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54908.log: /var/log/ceph/ceph-client.admin.51800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60384.log 2023-11-04T02:01:43.100 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53995.log: 87.9% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54908.log.gz 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51800.log.gz 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50985.log 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53995.log.gz 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47398.log 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60384.log: /var/log/ceph/ceph-client.admin.50985.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47398.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60384.log.gz 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50985.log.gz 2023-11-04T02:01:43.101 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47398.log.gz 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.43751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.c.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46883.log 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55421.log 2023-11-04T02:01:43.102 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43603.log: /var/log/ceph/ceph-client.admin.46883.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46883.log.gz 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61039.log 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55421.log: /var/log/ceph/ceph-client.admin.61039.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55421.log.gz 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60348.log 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.a.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.61039.log.gz 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49082.log 2023-11-04T02:01:43.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60348.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60348.log.gz 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56710.log 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49082.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49082.log.gz 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45534.log 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56710.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56710.log.gz 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56117.log 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45534.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45534.log.gz 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54073.log 2023-11-04T02:01:43.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56117.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56117.log.gz 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56894.log 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54073.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54073.log.gz 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48384.log 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56894.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56894.log.gz 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56143.log 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48384.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48384.log.gz 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56942.log 2023-11-04T02:01:43.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56143.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56143.log.gz 2023-11-04T02:01:43.106 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2023-11-04T02:01:43.106 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56942.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56942.log.gz 2023-11-04T02:01:43.106 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48358.log 2023-11-04T02:01:43.106 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2023-11-04T02:01:43.106 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57524.log 2023-11-04T02:01:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48358.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48358.log.gz 2023-11-04T02:01:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49986.log 2023-11-04T02:01:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57524.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57524.log.gz 2023-11-04T02:01:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50448.log 2023-11-04T02:01:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49986.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49986.log.gz 2023-11-04T02:01:43.142 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46461.log 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50448.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50448.log.gz 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59675.log 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46461.log.gz 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52112.log 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59675.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59675.log.gz 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56043.log 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52112.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52112.log.gz 2023-11-04T02:01:43.143 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56043.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56043.log.gz 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53915.log 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47066.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53915.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53915.log.gz 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56012.log 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54332.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2023-11-04T02:01:43.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49769.log 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56012.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56012.log.gz 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49769.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49769.log.gz 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58313.log 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46094.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60465.log 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58313.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58313.log.gz 2023-11-04T02:01:43.145 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43315.log 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60465.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60465.log.gz 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53051.log 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43315.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43315.log.gz 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60922.log 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53051.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53051.log.gz 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60922.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60922.log.gz 2023-11-04T02:01:43.146 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59256.log 2023-11-04T02:01:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46805.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2023-11-04T02:01:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2023-11-04T02:01:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59256.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59256.log.gz 2023-11-04T02:01:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56327.log 2023-11-04T02:01:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46571.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2023-11-04T02:01:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51609.log 2023-11-04T02:01:43.147 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56327.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56327.log.gz 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51609.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51609.log.gz 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57215.log 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50761.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47932.log 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57215.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57215.log.gz 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44721.log 2023-11-04T02:01:43.148 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47932.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47932.log.gz 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54650.log 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44721.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44721.log.gz 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54650.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54650.log.gz 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53208.log 2023-11-04T02:01:43.149 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50038.log: /var/log/ceph/ceph-client.admin.43760.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49617.log 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.53208.log: /var/log/ceph/ceph-client.admin.43756.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.53208.log.gz 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49821.log 2023-11-04T02:01:43.150 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.49617.log: /var/log/ceph/ceph-client.admin.43369.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54384.log 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.0.49617.log.gz 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49821.log.gz 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54384.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54384.log.gz 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51141.log 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54702.log 2023-11-04T02:01:43.151 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44970.log: /var/log/ceph/ceph-client.admin.51141.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51141.log.gz 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55361.log 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54702.log: /var/log/ceph/ceph-client.admin.55361.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54702.log.gz 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55361.log.gz 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46042.log 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2023-11-04T02:01:43.152 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43758.log: /var/log/ceph/ceph-client.admin.46042.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46042.log.gz 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47118.log 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43004.log: /var/log/ceph/ceph-client.admin.47118.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47118.log.gz 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49330.log 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48297.log 2023-11-04T02:01:43.153 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43955.log: /var/log/ceph/ceph-client.admin.49330.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49330.log.gz 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50879.log 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51852.log 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50879.log: /var/log/ceph/ceph-client.admin.48297.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50879.log.gz 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48297.log.gz 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54268.log 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50709.log 2023-11-04T02:01:43.154 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51852.log: /var/log/ceph/ceph-client.admin.54268.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51852.log.gz 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54268.log.gz 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44565.log 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50709.log: /var/log/ceph/ceph-client.admin.44591.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50709.log.gz 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52034.log 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60296.log 2023-11-04T02:01:43.155 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44565.log: /var/log/ceph/ceph-client.admin.52034.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44565.log.gz 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52034.log.gz 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53681.log 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50933.log 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60296.log: /var/log/ceph/ceph-client.admin.53681.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60296.log.gz 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53681.log.gz 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53385.log 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46172.log 2023-11-04T02:01:43.156 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50933.log: /var/log/ceph/ceph-client.admin.53385.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50933.log.gz 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53385.log.gz 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57876.log 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55106.log 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46172.log: /var/log/ceph/ceph-client.admin.57876.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46172.log.gz 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57876.log.gz 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59814.log 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45430.log 2023-11-04T02:01:43.157 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55106.log: /var/log/ceph/ceph-client.admin.59814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55106.log.gz 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59814.log.gz 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49160.log 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45430.log: /var/log/ceph/ceph-client.admin.44156.log: 88.6% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45430.log.gz 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49460.log 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55756.log 2023-11-04T02:01:43.158 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49160.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-04T02:01:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49460.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49460.log.gz 88.9% 2023-11-04T02:01:43.159 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49160.log.gz 2023-11-04T02:01:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43525.log 2023-11-04T02:01:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56554.log 2023-11-04T02:01:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55756.log: /var/log/ceph/ceph-client.admin.43525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43655.log 2023-11-04T02:01:43.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56554.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2023-11-04T02:01:43.159 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55756.log.gz 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56554.log.gz 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48592.log 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52921.log 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43655.log: /var/log/ceph/ceph-client.admin.48592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60531.log 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52921.log: 88.6% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43655.log.gz 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48592.log.gz 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.52921.log.gz -- 2023-11-04T02:01:43.160 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.43577.log 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59042.log 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60531.log: /var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47530.log 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60531.log.gz 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5%/var/log/ceph/ceph-client.admin.59042.log: -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57350.log 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47530.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59042.log.gz 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47530.log.gz 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55267.log 2023-11-04T02:01:43.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46146.log 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57350.log: /var/log/ceph/ceph-client.admin.55267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54151.log 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46146.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57350.log.gz 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55267.log.gz 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46146.log.gz 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54151.log: /var/log/ceph/ceph-client.admin.53359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50246.log 2023-11-04T02:01:43.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43681.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54151.log.gz 2023-11-04T02:01:43.163 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2023-11-04T02:01:43.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47144.log 2023-11-04T02:01:43.165 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2023-11-04T02:01:43.165 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43447.log 2023-11-04T02:01:43.165 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50246.log: /var/log/ceph/ceph-client.admin.47144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43759.log 2023-11-04T02:01:43.165 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43447.log: 87.8% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50246.log.gz 2023-11-04T02:01:43.165 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47144.log.gz 2023-11-04T02:01:43.165 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43447.log.gz 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47830.log 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43759.log: /var/log/ceph/ceph-client.admin.43102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51404.log 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47830.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43759.log.gz 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49562.log 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47830.log.gz 2023-11-04T02:01:43.166 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51404.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51404.log.gz 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45352.log 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49562.log: /var/log/ceph/ceph-client.admin.45352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58637.log 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48793.log: 89.1% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45352.log.gz 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49562.log.gz 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54490.log 2023-11-04T02:01:43.167 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47987.log 2023-11-04T02:01:43.168 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58637.log: /var/log/ceph/ceph-client.admin.54490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46831.log 2023-11-04T02:01:43.168 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.47987.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58637.log.gz 2023-11-04T02:01:43.168 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54490.log.gz 2023-11-04T02:01:43.168 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46988.log 2023-11-04T02:01:43.168 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2023-11-04T02:01:43.168 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9%/var/log/ceph/ceph-client.admin.46831.log: -- replaced with /var/log/ceph/ceph-client.0.47987.log.gz/var/log/ceph/ceph-client.admin.46988.log: 2023-11-04T02:01:43.183 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46831.log.gz 2023-11-04T02:01:43.183 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46988.log.gz 2023-11-04T02:01:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48245.log 2023-11-04T02:01:43.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50500.log 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44435.log: /var/log/ceph/ceph-client.admin.48245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55531.log 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50500.log: 88.6% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48245.log.gz 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50500.log.gz 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53811.log 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53629.log 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55531.log: /var/log/ceph/ceph-client.admin.53811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2023-11-04T02:01:43.184 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53629.log: 87.8% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55531.log.gz 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53811.log.gz 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53629.log.gz 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49688.log 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52973.log 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47040.log: /var/log/ceph/ceph-client.admin.49688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52973.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.49688.log.gz 2023-11-04T02:01:43.185 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52973.log.gz 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49666.log: /var/log/ceph/ceph-client.admin.46961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48689.log 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51583.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54099.log 2023-11-04T02:01:43.186 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47778.log 2023-11-04T02:01:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46408.log 2023-11-04T02:01:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54099.log: /var/log/ceph/ceph-client.admin.47778.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54099.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48689.log.gz 2023-11-04T02:01:43.187 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.187 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47778.log.gz 2023-11-04T02:01:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48436.log 2023-11-04T02:01:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50853.log 2023-11-04T02:01:43.187 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46408.log: /var/log/ceph/ceph-client.admin.48436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53411.log 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50853.log: 87.6% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48436.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46408.log.gz 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50853.log.gz 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44357.log 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45827.log 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53411.log: /var/log/ceph/ceph-client.admin.44357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54125.log 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45827.log: 88.6% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53411.log.gz 2023-11-04T02:01:43.188 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44357.log.gz 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45827.log.gz 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54236.log 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52060.log 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54125.log: /var/log/ceph/ceph-client.admin.54236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57412.log 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52060.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54125.log.gz 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54236.log.gz 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52060.log.gz 2023-11-04T02:01:43.189 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56502.log 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57412.log.gz/var/log/ceph/ceph-client.admin.43207.log: 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50533.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48871.log 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51982.log 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48871.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56502.log.gz 2023-11-04T02:01:43.190 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53733.log 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52680.log 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48871.log.gz 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51982.log: /var/log/ceph/ceph-client.admin.53733.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51982.log.gz 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53733.log.gz 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47478.log 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51063.log 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52680.log: /var/log/ceph/ceph-client.admin.47478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44539.log 2023-11-04T02:01:43.191 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51063.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52680.log.gz 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47478.log.gz 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52341.log 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51063.log.gz 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44539.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44539.log.gz 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53889.log 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49134.log 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52341.log: /var/log/ceph/ceph-client.admin.53889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53603.log 2023-11-04T02:01:43.192 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49134.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52341.log.gz 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53889.log.gz 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46250.log 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49134.log.gz 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55237.log 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53603.log: /var/log/ceph/ceph-client.admin.46250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57759.log 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55237.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53603.log.gz 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46250.log.gz 2023-11-04T02:01:43.193 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52869.log 2023-11-04T02:01:43.194 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55237.log.gz 2023-11-04T02:01:43.194 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57759.log: /var/log/ceph/ceph-client.admin.52869.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57759.log.gz 2023-11-04T02:01:43.194 INFO:teuthology.orchestra.run.smithi002.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52869.log.gz 2023-11-04T02:01:43.225 INFO:teuthology.orchestra.run.smithi090.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-04T02:01:43.312 INFO:teuthology.orchestra.run.smithi090.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-04T02:01:43.454 INFO:teuthology.orchestra.run.smithi090.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-04T02:01:43.533 INFO:teuthology.orchestra.run.smithi090.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-04T02:01:43.553 INFO:teuthology.orchestra.run.smithi090.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-04T02:01:43.556 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-04T02:01:43.557 INFO:teuthology.orchestra.run.smithi090.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-04T02:01:43.558 INFO:teuthology.orchestra.run.smithi090.stderr: 2023-11-04T02:01:43.558 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m0.696s 2023-11-04T02:01:43.559 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m3.560s 2023-11-04T02:01:43.559 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m0.142s 2023-11-04T02:01:43.614 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-04T02:01:43.633 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-04T02:01:43.671 INFO:teuthology.orchestra.run.smithi002.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-04T02:01:43.784 INFO:teuthology.orchestra.run.smithi002.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-04T02:01:43.785 INFO:teuthology.orchestra.run.smithi002.stderr: 2023-11-04T02:01:43.785 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m0.975s 2023-11-04T02:01:43.785 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m4.463s 2023-11-04T02:01:43.785 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.329s 2023-11-04T02:01:43.786 INFO:tasks.ceph:Archiving logs... 2023-11-04T02:01:43.786 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/remote/smithi002/log 2023-11-04T02:01:43.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T02:01:44.761 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/remote/smithi090/log 2023-11-04T02:01:44.762 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-04T02:01:45.178 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T02:01:45.191 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-04T02:01:45.201 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_702f9e6492477037e018f68dfdf636a30c24f329/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T02:01:45.205 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-04T02:01:45.206 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T02:01:45.211 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-04T02:01:45.272 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-04T02:01:45.281 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-04T02:01:45.282 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T02:01:45.284 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-04T02:01:45.294 INFO:teuthology.orchestra.run.smithi002.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T02:01:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================== 2023-11-04T02:01:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:*hv01.front.sepi 44.4.53.2 2 u 6 64 377 0.097 -8.200 0.897 2023-11-04T02:01:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.074 -6.568 0.944 2023-11-04T02:01:45.295 INFO:teuthology.orchestra.run.smithi002.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.087 -4.707 1.077 2023-11-04T02:01:45.295 INFO:teuthology.orchestra.run.smithi002.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-11-04T02:01:45.297 INFO:teuthology.orchestra.run.smithi090.stdout: remote refid st t when poll reach delay offset jitter 2023-11-04T02:01:45.297 INFO:teuthology.orchestra.run.smithi090.stdout:============================================================================== 2023-11-04T02:01:45.298 INFO:teuthology.orchestra.run.smithi090.stdout:*hv01.front.sepi 44.4.53.2 2 u 3 64 377 0.078 -5.803 0.669 2023-11-04T02:01:45.298 INFO:teuthology.orchestra.run.smithi090.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 64 377 0.063 -3.100 0.289 2023-11-04T02:01:45.298 INFO:teuthology.orchestra.run.smithi090.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.099 -2.348 0.309 2023-11-04T02:01:45.298 INFO:teuthology.orchestra.run.smithi090.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2023-11-04T02:01:45.299 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-04T02:01:45.314 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-04T02:01:45.314 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-04T02:01:45.365 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-04T02:01:45.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-04T02:01:45.465 INFO:teuthology.task.internal:Duration was 2139.422512 seconds 2023-11-04T02:01:45.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-04T02:01:45.515 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-04T02:01:45.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T02:01:45.518 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-04T02:01:45.600 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-04T02:01:45.600 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2023-11-04T02:01:45.600 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T02:01:45.611 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2023-11-04T02:01:45.611 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-04T02:01:45.621 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-04T02:01:45.622 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T02:01:45.655 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-04T02:01:45.685 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-04T02:01:45.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T02:01:45.727 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-04T02:01:45.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-04T02:01:45.807 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-04T02:01:45.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T02:01:45.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-04T02:01:45.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-04T02:01:45.839 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T02:01:45.865 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-04T02:01:45.872 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2023-11-04T02:01:45.884 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2023-11-04T02:01:45.896 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T02:01:45.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T02:01:45.929 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-04T02:01:45.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-04T02:01:45.944 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-04T02:01:45.955 INFO:teuthology.task.internal:Transferring archived files... 2023-11-04T02:01:45.956 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/remote/smithi002 2023-11-04T02:01:45.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T02:01:45.992 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922/remote/smithi090 2023-11-04T02:01:45.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-04T02:01:46.011 INFO:teuthology.task.internal:Removing archive directory... 2023-11-04T02:01:46.012 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T02:01:46.031 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-04T02:01:46.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-04T02:01:46.069 INFO:teuthology.task.internal:Not uploading archives. 2023-11-04T02:01:46.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-04T02:01:46.100 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-04T02:01:46.100 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T02:01:46.103 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-04T02:01:46.106 INFO:teuthology.orchestra.run.smithi002.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 02:01 /home/ubuntu/cephtest 2023-11-04T02:01:46.108 INFO:teuthology.orchestra.run.smithi090.stdout: 655476 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 4 02:01 /home/ubuntu/cephtest 2023-11-04T02:01:46.109 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-04T02:01:46.150 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-04T02:01:46.201 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi002 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-11-04T02:01:46.201 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T02:01:46.229 DEBUG:teuthology.nuke:shortname: smithi002 2023-11-04T02:01:46.229 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T02:01:46.254 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:36.791963', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOD0jW6E3I+clddOmIj07v/rlwclmd5mvPtTmVtQlTOPepyoKz8yD1/es570Vm9uYYDvuuRT9W5qhw05GGFbgGs='} 2023-11-04T02:01:46.258 DEBUG:teuthology.nuke:shortname: smithi090 2023-11-04T02:01:46.258 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T02:01:46.283 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:12:33-fs:functional-main-distro-default-smithi/7445922', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:36.790783', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJXX70ohOtHXVLtKw4roiKmJIEL1kDj6tbpju/9xVCAKESxMwgNBG57aBnKloHwb3zFrz06nxHez4jsZMRFjt5c='} 2023-11-04T02:01:46.315 INFO:teuthology.orchestra.console.smithi002:Power off 2023-11-04T02:01:46.316 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T02:01:46.342 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-11-04T02:01:46.342 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:01:46.360 INFO:teuthology.orchestra.console.smithi090:Power off 2023-11-04T02:01:46.360 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T02:01:46.383 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-11-04T02:01:46.384 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:01:46.395 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-11-04T02:01:46.409 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-11-04T02:01:50.396 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:01:50.411 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:01:50.509 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-11-04T02:01:50.523 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-11-04T02:01:54.514 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:01:54.523 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:01:54.625 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-11-04T02:01:54.635 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-11-04T02:01:54.727 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-11-04T02:01:58.638 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T02:01:58.748 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-11-04T02:01:58.849 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-11-04T02:01:58.956 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} duration: 2139.422511577606 failure_reason: 'Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots), test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cb6f7c6381a14c6e9bc68f34c4447a20 status: fail success: false 2023-11-04T02:01:58.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T02:01:59.034 INFO:teuthology.run:FAIL